Glass heating control method and device, terminal, storage medium and product

Abstract

The application discloses a glass heating control method and device, a terminal, a medium and a product, and belongs to the technical field of vehicle control. The method comprises the following steps: in response to a vehicle perceiving a trigger condition, the vehicle is controlled to enter a perception state; based on the vehicle entering the perception state, first information perceived by the vehicle is acquired, the first information being a trigger condition of glass heating of the vehicle; and in response to the first information meeting a preset condition, the vehicle is controlled to start a glass heating function. The application automatically detects and triggers the glass heating function, so that the driver does not need to manually intervene and the glass of the vehicle is not damaged due to manual deicing. Meanwhile, the driver can control the vehicle to start the heating glass function through a remote instruction, which is also helpful to save the time of the driver.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of vehicle control, and in particular, relate to a glass heating control method and device, a terminal, a storage medium, and a product. BACKGROUND

[0002] In relatively cold weather, if a vehicle is parked outdoors for a long time, ice will accumulate on the vehicle glass, which will hinder the driver's view and affect safe driving.

[0003] In related technologies, when the driver finds that the vehicle glass is icing up and blocking the view, the driver needs to manually remove the ice on the vehicle glass before driving the vehicle. For example, an ice remover or chemical de-icing agent may be used to remove the ice on the vehicle glass.

[0004] However, this approach requires the driver to wait for a long time to remove the ice on the vehicle glass, and manual de-icing can easily cause damage to the vehicle. SUMMARY

[0005] The present application provides a glass heating control method, device, terminal, medium, and product, and the technical solution is as follows:

[0006] According to an aspect of the present application, a glass heating control method is provided, which includes:

[0007] In response to the vehicle perceiving a trigger condition, controlling the vehicle to enter a perception state;

[0008] Based on the vehicle entering the perception state, obtaining first information perceived by the vehicle, the first information being a trigger condition for glass heating of the vehicle;

[0009] In response to the first information meeting a preset condition, controlling the vehicle to start a glass heating function.

[0010] According to an aspect of the present application, a glass heating control device is provided, which includes:

[0011] A control module configured to, in response to a vehicle perceiving a trigger condition, control the vehicle to enter a perception state;

[0012] An acquisition module configured to, based on the vehicle entering the perception state, acquire first information perceived by the vehicle, the first information being a trigger condition for glass heating of the vehicle;

[0013] A control module configured to, in response to the first information meeting a preset condition, control the vehicle to start a glass heating function.

[0014] In accordance with another aspect of the present application, a vehicle terminal is provided, which comprises a processor and a memory, the memory having at least one program stored therein, the at least one program being loaded and executed by the processor to implement the control method for glass heating according to the above aspect.

[0015] In accordance with another aspect of the present application, a computer storage medium is provided, the computer storage medium having at least one computer instruction stored therein, the at least one computer instruction being loaded and executed by a processor to implement the control method for glass heating according to the above aspect.

[0016] In accordance with another aspect of the present application, a computer program product is provided, which comprises a computer program stored in a computer readable storage medium; the computer program is read and executed by a processor of a computer device from the computer readable storage medium, so that the computer device executes the control method for glass heating according to the above aspect.

[0017] The technical scheme provided by the embodiments of the present application has at least the following beneficial effects:

[0018] When the vehicle perceives the triggering condition, the vehicle enters a perception state (working state), and the vehicle in the perception state acquires the first information triggering the glass heating of the vehicle. The vehicle checks whether the first information meets the preset condition. If yes, the driver can control the vehicle to start the glass heating function, or the vehicle automatically starts the glass heating function. By automatically detecting and triggering the glass heating function, the driver does not need to manually intervene, and the vehicle glass can be ensured to be clear without causing damage to the vehicle glass by manual deicing. Further, the driver can control the vehicle to start the glass heating function by a remote instruction, which also helps to save the time of the driver. BRIEF DESCRIPTION OF DRAWINGS

[0019] In order to more clearly illustrate the technical scheme in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative effort.

[0020] Figure 1 is a schematic diagram of the architecture of the vehicle terminal provided by an exemplary embodiment of the present application;

[0021] Figure 2 is a flowchart of the control method for glass heating provided by an exemplary embodiment of the present application;

[0022] Figure 3is a flow chart of a control method of glass heating provided by an example embodiment of the present application;

[0023] Figure 4 is a flow chart of a control method of glass heating provided by an example embodiment of the present application;

[0024] Figure 5 is a flow chart of a control method of glass heating provided by an example embodiment of the present application;

[0025] Figure 6 is a flow chart of a control method of glass heating provided by an example embodiment of the present application;

[0026] Figure 7 is a structural block diagram of a control device of glass heating provided by an example embodiment of the present application;

[0027] Figure 8 is a structural block diagram of a vehicle terminal provided by an example embodiment of the present application. DETAILED DESCRIPTION

[0028] For the purpose of making the objects, technical solutions and advantages of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the drawings.

[0029] The example embodiments will be described in detail below with reference to the drawings. Unless otherwise indicated, the same numbers on different drawings represent the same or similar elements. The implementations described in the following example embodiments represent merely examples consistent with the present application. Alternatively, they are merely examples of apparatus and methods consistent with some aspects of the present application as detailed in the appended claims.

[0030] The terms used in the present disclosure are merely for the purpose of describing particular embodiments and are not intended to limit the present disclosure. The singular forms "a," "an," and "the" used in the present disclosure and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise.

[0031] In the embodiments of the present application, the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of related data need to comply with relevant laws, regulations and standards of relevant countries and regions. For example, the attack operation and other object behaviors involved in the present application are obtained under full authorization.

[0032] It should be understood that, although the terms first, second, etc. can be employed in this disclosure to describe various information, these information should not be limited to these terms. These terms are only used to differentiate one piece of information from another piece of information. For example, a first parameter can also be referred to as a second parameter, and similarly, a second parameter can also be referred to as a first parameter, without departing from the scope of the present disclosure. Depending on the context, the word "if' as used herein can be interpreted as meaning "when" or "upon" or "in response to determining".

[0033] First, the terms involved in the embodiments of the present application are briefly introduced:

[0034] VCU (Vehicle Control Unit, vehicle controller): is the core electronic control unit in the vehicle, responsible for coordinating and managing various functions and subsystems of the vehicle, such as engine control, speed control, brake system, battery management system, heating system, etc. In the embodiments of the present application, the VCU is responsible for receiving information from the temperature sensor and the personal terminal, and executing the corresponding control instructions to realize the control and adjustment of the vehicle functions. For example, the VCU controls the start and stop of the glass heating function.

[0035] Heating system: a system for controlling heating in a vehicle, such as an air conditioning system in a vehicle. Optionally, the heating system is connected to the VCU, and in response to receiving the heating instruction sent by the VCU, the heating system will confirm the heating instruction, and after confirmation, execute the heating instruction to turn on the glass heating function.

[0036] In the related art, when the driver finds that the target vehicle (also referred to as vehicle for short) glass is frozen and blocks the line of sight, the driver manually removes the ice on the vehicle glass before driving the vehicle, or uses a thawing agent to remove the ice on the vehicle glass. However, this way requires the driver to wait for a long time to remove the ice on the vehicle glass, and the long waiting time will affect the user's driving experience.

[0037] In the embodiments of the present application, based on the personal terminal (such as a mobile phone, a tablet), the target vehicle, and the vehicle terminal of the target vehicle, the glass heating of the target vehicle is realized.

[0038] In some embodiments, after receiving the start instruction, the target vehicle enters a start state. In the start state, the target vehicle can obtain first information. The first information can be a trigger condition for the glass heating of the target vehicle. For example, the first information is image information of the target vehicle, which indicates icing of the glass of the target vehicle. The first information is environmental information of the target vehicle, which includes internal temperature and external temperature of the target vehicle. The first information is microphone state information of the target vehicle, which is used to receive voice instructions of the driver. When the first information of the target vehicle meets a preset condition, the vehicle terminal of the target vehicle starts the glass heating function of the vehicle. Alternatively, the following are different conditions for triggering the target vehicle to start the glass heating function:

[0039] Method one: based on a personal terminal to control the target vehicle to start the glass heating function.

[0040] Optionally, the personal terminal is installed with a target application program connected with the target vehicle.

[0041] In some embodiments, the driver sends a start instruction to the target vehicle through the personal terminal. The start instruction is a remote instruction. In response to receiving the start instruction, the target vehicle enters a start state. A camera in the target vehicle captures image information of the vehicle glass, which indicates icing of the glass of the target vehicle. Optionally, the vehicle terminal sends the image information to the personal terminal. The personal terminal can determine whether the glass of the target vehicle is iced based on the image information. When the glass of the target vehicle is iced, the driver sends a heating instruction to the target vehicle through the personal terminal. After receiving the heating instruction, the vehicle terminal of the target vehicle controls the heating system to start the glass heating function. Optionally, the glass of the target vehicle is installed with a heating wire that is powered on to heat the glass.

[0042] In some embodiments, the driver can send a reservation heating time to the target vehicle through the personal terminal. The vehicle terminal starts the glass heating function according to the reservation heating time.

[0043] In some embodiments, a camera is installed in the target vehicle. When the target vehicle obtains image information of the vehicle through the camera, the image information is input into a neural network model in the vehicle terminal. The neural network model is used to identify the image information of the vehicle. When the neural network model identifies that the image information of the vehicle has icing, the vehicle is automatically controlled to start the glass heating function, and information about starting the glass heating function is transmitted to the driver. Optionally, the neural network model is a machine learning model with image recognition capability. The neural network model can be installed in an application program of the vehicle terminal, or the neural network model exists in a server, and the vehicle terminal obtains the identification result of the neural network model through the server. The embodiments of the present application take the model installed in the application program of the vehicle terminal as an example for description.

[0044] Method two: starting the glass heating function of the target vehicle based on a physical button in the target vehicle.

[0045] The physical button is a start button in the target vehicle.

[0046] In some embodiments, the driver sends a starting instruction to the target vehicle through the physical button, and the starting instruction is a button starting instruction. In response to the target vehicle receiving the button starting instruction, the target vehicle enters a starting state. Optionally, when the target vehicle enters the starting state, a temperature sensor in the target vehicle monitors the external temperature of the vehicle. When the external temperature is lower than a preset temperature (for example, 0°C), the automatic glass heating function is triggered.

[0047] In a possible implementation, the temperature sensor in the target vehicle automatically monitors the internal temperature and the external temperature of the target vehicle. When the difference between the internal temperature and the external temperature of the target vehicle reaches a preset temperature difference, it is determined that the glass of the target vehicle has icing. Optionally, the vehicle terminal of the target vehicle controls the heating system to automatically start the glass heating function.

[0048] Method three: starting the glass heating function of the target vehicle based on a microphone in the target vehicle.

[0049] The microphone is a voice system in the target vehicle.

[0050] In some embodiments, the driver sends a starting instruction to the target vehicle through the microphone, and the starting instruction is a voice starting instruction. In response to the target vehicle receiving the voice starting instruction, the target vehicle enters a starting state. Optionally, the driver sends a voice instruction for heating to the target vehicle through the microphone. In response to the microphone in the target vehicle receiving the voice instruction for heating, the vehicle terminal of the target vehicle controls the heating system to start the glass heating function.

[0051] In some embodiments, when the opening time of the glass heating function reaches the preset time, the vehicle terminal of the target vehicle acquires the temperature state of the glass, when the temperature state reaches the preset temperature protection threshold, the driver can send a stop heating instruction to the target vehicle through the personal terminal (way one), or the driver sends a stop heating instruction to the target vehicle through the off button (way two), or the driver sends a stop heating instruction to the target vehicle through the microphone (way three), in response to receiving the stop heating instruction, the vehicle terminal of the target vehicle controls the heating system to stop the glass heating function. Optionally, when the vehicle terminal receives the related instruction of opening the glass heating function again, the glass heating function is opened again until the icing condition of the glass of the target vehicle is completely eliminated.

[0052] Please refer to Figure 1 which shows the architecture diagram of the vehicle terminal provided by an exemplary embodiment of the present application. The implementation environment involves a target vehicle 110, a vehicle terminal 120 of the target vehicle 110, a personal terminal 130 and a server 140 for controlling the target vehicle 110.

[0053] Optionally, the target vehicle 110 includes a conventional car, a smart car, an unmanned vehicle and the like, which can be manually driven by a driver or driven by an automatic driving system to realize unmanned driving. Optionally, the target vehicle 110 is also installed with a vehicle sensor, a camera, a steering wheel, a controller, a data processor and the like, which can realize the exchange and sharing between traffic participants by means of modern mobile communication and network technology such as Internet of Vehicles, 5G (5th Generation Mobile Networks) and V2X (Vehicle-to-Everything), so as to have the functions of sensing and perception, decision planning, control execution and the like in complex environment.

[0054] In some embodiments, the main control system of the target vehicle 110 is composed of a hardware part and a software part intelligent vehicle operation system, which is used to control the driving route and driving parameters of the vehicle, and can acquire real-time information of the vehicle, such as image information of the vehicle. The target vehicle 110 is deployed with a vehicle terminal 120, which can be a control system of the target vehicle 110, which can acquire user instructions and execute and control the instructions sent by the user. The control system can be a vehicle controller (VCU).

[0055] In some embodiments, the personal terminal 130 can be an electronic device such as a mobile phone, a tablet computer, a wearable device, a personal computer (PC), etc. The personal terminal 130 can be installed with a client running a target application, which can be an application sending an instruction to the vehicle terminal 120, and the present application does not limit the same. Alternatively, the driver can send a heating instruction to the vehicle terminal 120 through the personal terminal 130.

[0056] Alternatively, the server 140 can be a standalone physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services, a cloud database, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content distribution networks, and basic cloud computing services such as big data and artificial intelligence platforms. The cloud server of the big data and artificial intelligence platform can provide artificial intelligence cloud services. The server 140 can be a background server of the target application, for providing background services for the client of the target application.

[0057] Among them, the vehicle terminal 120 and the server 140 are connected through a communication network; the personal terminal 130 and the vehicle terminal 120 are connected through a communication network; the personal terminal 130 and the server 140 are connected through a communication network.

[0058] For example, in the embodiment of the present application, the driver views the real-time state of the target vehicle 110 through the personal terminal 130, and when the target vehicle 110 needs to be deiced, the driver can send a heating instruction to the vehicle terminal 120 through the personal terminal 130. Alternatively, the server 140 transmits the heating instruction sent by the personal terminal 130 to the vehicle terminal 120, and the VCU in the vehicle terminal 120 receives the heating instruction. The VCU is connected to the heating system of the target vehicle 110, the heating system confirms the heating instruction, and turns on the glass heating function of the target vehicle 110 to heat the vehicle glass. The VCU can monitor the heating time and temperature of the glass. Alternatively, the driver views the heating state of the target vehicle 110 through the personal terminal 130, and when the heating reaches a preset time or a preset temperature, sends a stop heating instruction to the vehicle terminal 120.

[0059] In combination with the above-mentioned brief introduction of terms and description of the implementation environment, the control method of glass heating provided in the embodiment of the present application is described. Figure 2 is a flowchart of the control method of glass heating provided by an exemplary embodiment of the present application. The method can be executed by a vehicle terminal, as shown in Figure 2 The method includes the following steps:

[0060] Step 210: in response to the vehicle perceiving the trigger condition, controlling the vehicle to enter a perception state;

[0061] The trigger condition is used to indicate that the vehicle enters the perception state. The perception state refers to a working state of the vehicle, so that the vehicle can perceive the surrounding environment through its sensors and systems. Optionally, after the vehicle enters the perception state, the trigger condition for glass heating is automatically obtained.

[0062] In some embodiments, the trigger condition for the vehicle to enter the perception state includes at least one of the following:

[0063] · in response to receiving an opening instruction for the vehicle;

[0064] · in response to the time or distance of the vehicle driving from the indoor location to the outdoor location satisfying a first condition;

[0065] · in response to the time or distance of the vehicle driving from the outdoor location to the indoor location satisfying a second condition.

[0066] In some embodiments, the trigger condition is receiving an opening instruction for the vehicle. The opening instruction refers to a signal or command sent to the vehicle, which is used to activate or start the vehicle to enter the opening state. Optionally, the opening instruction can be an instruction issued by the driver through an operation interface (such as a button, a switch or a voice command) inside the vehicle, or an instruction issued through a remote control (such as a mobile phone APP or a smart key). The vehicle refers to the target vehicle that needs to be heated, and the type of vehicle includes at least one of a pure electric vehicle, a hybrid vehicle, a fuel cell electric vehicle, etc. The type of vehicle is not limited in the present application.

[0067] Optionally, the opening instruction can also be an automatic opening instruction triggered according to historical driving rules. The vehicle system analyzes the driving rules and habits of the driver, learns and identifies the behavior pattern of the driver, and can obtain the predicted starting time point of the vehicle, i.e. the time point at which the vehicle enters the opening state. Optionally, the vehicle can determine the predicted starting time point according to periodic events, for example, the vehicle can determine the predicted starting time point according to the driver's work or off-work time. Optionally, the vehicle can control the vehicle to enter the perception state before a preset time period of the predicted starting time point, and obtain the first information perceived by the vehicle. The preset time period is determined based on the current outdoor temperature. Optionally, the lower the outdoor temperature, the longer the preset time period; the higher the outdoor temperature, the shorter the preset time period (where "higher" and "lower" are relative). For example, when the outdoor temperature is minus five degrees, the preset time period is ten minutes, and when the outdoor temperature is minus three degrees, the preset time period is five minutes.

[0068] For example, the vehicle determines the preset starting time point as 9:00 am according to the driver's work time, and the vehicle can enter the perception state before the preset starting time point, for example, the preset time length can be 5 minutes, that is, the vehicle can enter the perception state at 8:55 and obtain the external temperature information of the vehicle.

[0069] In some embodiments, the triggering condition is that the time length or distance of the vehicle driving from the building-in position to the building-out position meets a first condition. The building-in position refers to a position where the vehicle is located inside the building, such as an underground garage, an indoor parking lot, or a tunnel. The building-out position refers to a position where the vehicle is located outside the building, i.e., an outdoor environment, such as a road outside the building, a parking lot exit, or other outdoor positions. The first condition refers to that the time length of the vehicle driving from the building-in position to the building-out position meets a first preset time length, or the first condition refers to that the time length of the vehicle driving from the building-in position to the building-out position meets a first preset distance. Alternatively, the first condition is a preset time length or distance condition for triggering the vehicle to enter the perception state when driving from the building-in position to the building-out position.

[0070] For example, during driving, the building-in position is an underground garage position, and the building-out position is a position on the ground. When the vehicle drives out of the underground garage position for 5 seconds, the vehicle enters the perception state, and the vehicle obtains the triggering condition of whether the vehicle's glass needs to be heated, such as whether the vehicle's glass is fogged, frosted, or iced.

[0071] It should be noted that the embodiments of the present application take the occurrence of ice on the vehicle's glass as an example to illustrate the removal of ice on the glass by glass heating. The removal of fog or frost on the glass by glass heating is also applicable to the embodiments of the present application.

[0072] In some embodiments, the triggering condition is that the time length or distance of the vehicle driving from the building-out position to the building-in position meets a second condition. The building-in position refers to a position where the vehicle is located inside the building, such as an underground garage, an indoor parking lot, or a tunnel. The building-out position refers to a position where the vehicle is located outside the building, i.e., an outdoor environment, such as a road outside the building, a parking lot exit, or other outdoor positions. The second condition refers to that the time length of the vehicle driving from the building-out position to the building-in position meets a second preset time length, or the second condition refers to that the time length of the vehicle driving from the building-out position to the building-in position meets a second preset distance. Alternatively, the second condition is a preset time length or distance condition for triggering the vehicle to enter the perception state when driving from the building-out position to the building-in position.

[0073] For example, the vehicle is in a normal road on a highway during driving, the out-of-building position is the normal road on the highway, the in-building position is a tunnel position, the vehicle enters the sensing state after driving 50 meters from the out-of-building position to the in-building position, and the vehicle obtains a triggering condition for sensing the vehicle to determine whether the glass of the vehicle needs to be heated, for example, whether the glass of the vehicle is frosted or iced.

[0074] The embodiment of the present application mainly takes the triggering condition that the vehicle receives an opening instruction as an example for description.

[0075] Step 220: obtaining first information sensed by the vehicle based on the vehicle entering the sensing state.

[0076] The first information is a triggering condition for heating the glass of the vehicle. In some embodiments, the vehicle enters an opening (working) state in response to receiving an opening instruction from the driver. Optionally, when the vehicle enters the opening state, the first information related to the vehicle is obtained, that is, the triggering condition for heating the glass of the vehicle is obtained.

[0077] In some embodiments, the first information is a condition required for starting the glass heating function of the vehicle, and the first information can be a vehicle state, environmental information or other related factors. Optionally, the first information is a vehicle state, for example, the first information is image information of the vehicle, and whether the surface of the glass of the vehicle is iced is determined by the image information of the vehicle. Optionally, the first information is environmental information, for example, the environmental information is the external temperature where the vehicle is located, and whether the surface of the glass of the vehicle is iced is determined by the external temperature where the vehicle is located. Optionally, the first information is state information inside the vehicle, for example, the first information is an internal button or a voice system of the vehicle, and whether the vehicle can normally receive a voice instruction of the driver to control the vehicle to start the glass heating function is determined by a microphone state in the internal button or the voice system of the vehicle.

[0078] Optionally, the first information ensures that the vehicle starts the glass heating function in a safe and appropriate condition, so as to avoid damage to the vehicle. It should be noted that the embodiment of the present application takes the icing phenomenon of the glass of the vehicle as an example for description, and the defrosting of the glass by heating is also applicable to the embodiment of the present application.

[0079] Step 230: controlling the vehicle to start the glass heating function in response to the first information meeting a preset condition.

[0080] The preset condition is a condition or standard related to the glass heating function of the vehicle, which is used to determine when the vehicle executes the glass heating function.

[0081] In some embodiments, taking the first information as image information for example, the preset condition can be that the image information shows that the glass of the vehicle is icing. Optionally, the vehicle is equipped with a camera or other image capture device, which can detect temperature changes and icing conditions on the vehicle glass. When the vehicle identifies such a condition (vehicle glass icing) through image information, the glass heating function will be started.

[0082] In some embodiments, taking the first information as temperature information for example, the preset condition can be a preset temperature threshold or other environmental parameters. The temperature sensor of the vehicle can monitor the external temperature where the vehicle is located, and when the external temperature where the vehicle is located is lower than a certain preset temperature threshold, it can indicate that the vehicle glass is at risk of icing, thereby triggering the vehicle to start the glass heating function.

[0083] In some embodiments, taking the first information as state information inside the vehicle for example, for example, the first information is the voice system of the vehicle, the preset condition can be that the microphone in the voice system is in a normal working state. Optionally, when the first information meets the preset condition, the vehicle terminal receives the relevant voice instruction, and the glass heating function of the vehicle is started to deal with icing and the like. For example, the driver can start the glass heating function through voice instructions (such as "activate the deicing mode").

[0084] In some embodiments, the vehicle terminal has a control system of the vehicle, such as VCU, the VCU is connected with the heating system of the vehicle, and in response to receiving the heating instruction sent by the VCU, the heating system confirms the heating instruction and turns on the glass heating function of the vehicle to heat the vehicle glass. Optionally, the VCU can monitor the time and temperature of the glass heating.

[0085] In some embodiments, the glass of the vehicle usually contains a very thin heating wire (usually made of metal or alloy), which is embedded in the interlayer of the glass of the vehicle or directly coated on the surface of the glass. When deicing is needed, current passes through the heating wire to generate heat, thereby increasing the temperature of the glass of the vehicle. As the temperature of the glass of the vehicle rises, the accumulated ice on the surface of the glass begins to melt, thereby achieving the deicing effect. The above is an exemplary description, and the specific way of heating the glass of the vehicle is not limited in the application.

[0086] In summary, the method provided by the embodiments of the present application, when receiving the start instruction of the driver for the vehicle, the vehicle enters the start state (working state), and the vehicle after entering the start state acquires the first information triggering the glass heating of the vehicle. The vehicle checks whether the first information meets the preset condition. If yes, the driver can control the vehicle to start the glass heating function, or the vehicle automatically starts the glass heating function. By automatically detecting and triggering the glass heating function, the driver does not need to manually intervene, which will not cause damage to the glass of the vehicle, and can ensure that the vehicle glass remains clear and improve the driving safety. At the same time, this also helps to save the time of the driver, so that he can focus more on the driving task.

[0087] In some embodiments, the vehicle can enter the perception state based on different trigger conditions. The vehicle after entering the perception state acquires the first information perceived by the vehicle, that is, whether the current condition needs to trigger the glass heating of the vehicle. Taking the vehicle entering the perception state after receiving the start instruction as an example, the vehicle after receiving the start instruction enters the start state, and the vehicle after entering the start state can acquire the first information. The driver can determine whether the vehicle needs to start the glass heating function based on the first information. Optionally, the start instruction can be a remote instruction, a key start instruction, or a voice start instruction. The following describes the way of triggering the vehicle to start the glass heating function.

[0088] The following specifically describes the way of triggering the vehicle to start the glass heating function.

[0089] Method 1: Control the vehicle to start the glass heating function based on the personal terminal (remote instruction)

[0090] In some embodiments, the instruction received by the vehicle can be a remote instruction. The vehicle acquires the image information of the vehicle based on the remote instruction, and sends the image information of the vehicle to the terminal device used by the driver. The driver sends a heating instruction to the vehicle through the personal terminal. Figure 3 The flowchart of the control method of the glass heating provided by an example embodiment of the present application is shown. The step 210 can be replaced by the step 211, the step 220 can be replaced by the step 221, and the step 230 can be replaced by the step 231a and the step 231b.

[0091] Step 211: in response to receiving a remote instruction for the vehicle, controlling the vehicle to enter a perception state;

[0092] The remote instruction is used to indicate the vehicle to enter the start state.

[0093] In some embodiments, the remote instruction refers to an instruction from an external control system or a user, which can be transmitted to the VCU through a network or other remote communication means for triggering or controlling the vehicle to enter the start state. Alternatively, the remote instruction can be a simple on-off signal indicating that the vehicle enters the working state.

[0094] Alternatively, the driver sends the remote instruction to the vehicle through a personal terminal. Alternatively, the remote instruction generally refers to an instruction or request sent from a remote location (where the driver's personal terminal is located) to the vehicle's control system (VCU) through wireless communication technology (such as Bluetooth, Wi-Fi, cellular network, etc.). Among them, the personal terminal can be a smart phone, a smart watch, a tablet computer or a special remote control device provided by the vehicle manufacturer.

[0095] Step 221: based on the remote instruction received by the vehicle, obtaining image information of the vehicle;

[0096] Among them, the image information refers to the image data inside or outside the glass of the vehicle, which can be real-time images obtained through the camera in the vehicle or static images taken. The image information can only include all the window glasses of the vehicle, or can include the images of the whole vehicle, or the environmental conditions around the vehicle. Among them, the camera is a built-in camera inside the vehicle, and the installation position includes: in the steering wheel, above the inside rearview mirror or integrated in the instrument display screen. The above types of cameras and installation positions are only exemplary, and the embodiments of the present application are not limited thereto.

[0097] In some embodiments, in response to the vehicle receiving the remote instruction sent by the driver, the image information of the vehicle is obtained. Alternatively, the image information of the current vehicle can be obtained based on the camera or other image capture device on the vehicle. The image information can include whether there is icing or other conditions on the vehicle glass.

[0098] Step 231a: sending the image information of the vehicle to the personal terminal;

[0099] Among them, the personal terminal is a terminal device used by the driver. The personal terminal can be a smart phone, a smart watch, a tablet computer or a special remote control device provided by the vehicle manufacturer.

[0100] In some embodiments, after the camera of the vehicle captures the image information, the vehicle sends the image information to the personal terminal of the driver, so that the driver can remotely view the real-time situation of the vehicle, and the driver determines whether to start the glass heating function of the vehicle according to the image information of the vehicle. Optionally, the driver views the image information on the personal terminal, and when the image information of the vehicle shows that the glass of the vehicle has icing, the driver can send a heating instruction to the vehicle, and the vehicle starts the glass heating function based on the heating instruction.

[0101] Step 231b: in response to receiving the heating instruction for the vehicle, controlling the vehicle to start the glass heating function.

[0102] The heating instruction is an instruction sent by the driver to start the glass heating function of the vehicle. Optionally, the heating instruction is usually transmitted to the vehicle through remote communication to trigger or control the glass heating function of the vehicle. Optionally, the driver can send the heating instruction remotely through the personal terminal when being away from the vehicle.

[0103] In some embodiments, in response to the heating instruction for the vehicle sent by the driver, the VCU of the vehicle receives the heating instruction and transmits the heating instruction to the heating system of the vehicle, so that the heating system executes the heating instruction to start the glass heating function of the vehicle.

[0104] In one possible implementation, the vehicle starts the glass heating function immediately in response to receiving the heating instruction.

[0105] In another possible implementation, the heating instruction is a pre-booking heating time, that is, the heating instruction is a time for pre-booking heating of the glass of the vehicle. The vehicle receives the heating instruction including the pre-booking heating time, and controls the vehicle to start the glass heating function in response to the current time reaching the pre-booking heating time.

[0106] In some embodiments, the pre-booking heating time is a specific time point set in advance, which is used to indicate when the vehicle starts the glass heating function. Optionally, the driver can set the pre-booking heating time on the personal terminal according to the personal travel plan; or, the driver can send the heating instruction including the pre-booking heating time to the vehicle according to the recommended pre-booking heating time sent by the vehicle. For example, the VCU of the vehicle can send the recommended pre-booking heating time to the personal terminal of the driver according to the driving habit of the driver, such as the common departure time; or, the vehicle can send the recommended pre-booking heating time to the personal terminal of the driver according to the icing condition of the glass of the vehicle; or, the vehicle can send the recommended pre-booking heating time to the personal terminal of the driver according to the external environment information.

[0107] In some embodiments, in response to the current time reaching the scheduled heating time, the VCU of the vehicle delivers the heating instruction to the heating system of the vehicle at the scheduled heating time, and the heating system executes the heating instruction to turn on the glass heating function of the vehicle.

[0108] For example, the vehicle sends the image information to the personal terminal corresponding to the driver, the driver receives the image information at 8:00 am, and optionally, the driver sets the scheduled heating time as 8:30 am and sends the heating instruction including the scheduled heating time to the vehicle. When the time reaches the scheduled heating time, the VCU of the vehicle delivers the heating instruction to the heating system of the vehicle, and the heating system executes the heating instruction to turn on the glass heating function of the vehicle.

[0109] In the embodiments of the present application, by obtaining the image information of the vehicle and sending it to the personal terminal corresponding to the driver, the driver can know the situation of the external environment of the vehicle in real time. The driver sends a heating instruction to the vehicle according to the icing condition of the glass of the vehicle. When the heating instruction for the vehicle is received, the vehicle will automatically respond and turn on the glass heating function. This way of sending instructions remotely eliminates the need for manual operation by the driver and provides an automated experience.

[0110] Further, the vehicle can start the vehicle glass heating function when the scheduled heating time arrives, avoiding unnecessary energy consumption. Through the scheduled heating function, the driver can automatically start the vehicle glass heating at the desired time, providing a more convenient user experience.

[0111] Control the vehicle to start the glass heating function based on image information (automatic start)

[0112] In some embodiments, when the vehicle enters an on (working) state, the vehicle obtains image information, and optionally, the vehicle identifies the image information based on a neural network model. After identifying that the image information meets the preset condition, the vehicle can automatically turn on the glass heating function without waiting for the heating instruction sent by the driver. Figure 4 is a flowchart of a glass heating control method provided by an exemplary embodiment of the present application. The method can be executed by a vehicle terminal, as shown in Figure 4 The method includes the following steps:

[0113] Step 310: input the image information into a neural network model, and identify the image information of the vehicle based on the neural network model;

[0114] In some embodiments, the neural network model can be installed in an application program of the vehicle terminal; or, the vehicle terminal comprises an AI (Artificial Intelligence) chip, the AI chip comprises the neural network model, the neural network model in the vehicle terminal identifies the image information of the vehicle; or, the neural network model exists in a server, the neural network model in the server identifies the image information of the vehicle, and the vehicle terminal obtains the identification result of the image information through the server. The embodiments of the application take the neural network model existing in the vehicle terminal as an example for description.

[0115] The neural network model is an artificial neural network formed by n neurons connected with each other, and n is a positive integer. In the application, the neural network model is an artificial neural network for identifying the image information of the vehicle (icing condition of the glass of the vehicle). For example, the neural network model can be divided into an input layer, a hidden layer and an output layer, the vehicle terminal inputs the image information into the input layer of the neural network model, the hidden layer performs down-sampling on the input image information, that is, convolution calculation is performed on the pixel points in the image information, and finally the output layer outputs to obtain the identification result of the image information, that is, whether the image information exists icing condition and detailed information of the icing condition. For example, the neural network model comprises at least one of a CNN (Convolutional Neural Network) model, a FCN (Fully Convolutional Networks) model, a DNN (Deep Neural Network) model, a RNN (Recurrent Neural Networks) model, an embedding model, a GBDT (Gradient Boosting Decision Tree) model, an LR (Logistic Regression) model, etc.

[0116] Step 320: in response to the image information of the vehicle showing that the glass of the vehicle exists icing condition, the vehicle automatically starts the glass heating function under the control of the VCU.

[0117] In some embodiments, based on the identification of the neural network model on the image information of the vehicle, in response to the identification that the image information shows that the glass of the vehicle exists icing condition, the VCU of the vehicle controls the heating system to automatically start the glass heating function.

[0118] The icing condition comprises at least one of phenomena such as fogging, frosting and icing. The embodiments of the application take the icing condition as the icing condition for example for description.

[0119] Three implementation solutions for the neural network model:

[0120] Solution one: input the image information into the first neural network model, determine the glass icing condition of the vehicle based on the first neural network model, and control the vehicle to start the glass heating function in response to the glass icing condition of the vehicle meeting a preset icing level. The first neural network model is a neural network model trained according to images of glasses in different icing conditions. The icing condition includes at least one of phenomena such as fogging, frosting, and icing. The embodiments of the present application take the icing condition as an icing condition for example.

[0121] In some embodiments, the icing condition refers to the icing condition of the vehicle glass surface, that is, whether the vehicle window is iced. The preset icing level refers to a preset icing threshold value for determining whether the icing of the vehicle window reaches a degree requiring heating treatment or reaches a degree requiring heating treatment. Alternatively, the preset icing level can be set according to actual conditions, such as the thickness of the ice, the area covered, and other factors. When the icing on the vehicle window reaches the preset icing level, the vehicle will automatically start the glass heating function to eliminate or reduce the icing and improve driving safety. Alternatively, the preset icing level can be no ice, light icing, moderate icing, or severe icing.

[0122] In some embodiments, the images of the glasses in different icing conditions are input into the neural network model as first sample images, that is, as training images, to train the first neural network model to have the ability to identify the icing condition of the vehicle glass. Alternatively, during the training process, the first sample images in the data set are labeled, and the labeling information includes whether the training image (i.e., the first sample image) belongs to the icing condition and which level in the preset icing level it belongs to.

[0123] For example, each sample image can be labeled as "icing" or "non-icing" to indicate whether there is an icing condition in the sample image, and if there is icing, a further classification label is provided to indicate the severity of the icing, such as "no ice", "light icing", "moderate icing", or "severe icing". Alternatively, the labeled sample images are used as input data to train the first neural network model based on the image information of the glasses in different icing conditions, the first neural network model learns the relationship between the first sample images and the icing condition, and the first neural network model with the ability to identify the icing condition of the vehicle glass is obtained.

[0124] In some embodiments, the vehicle obtains image information, and identifies the image information based on the first neural network model. The first neural network model can make a prediction on the image information to identify whether there is an icing condition in the image information and which level in the preset icing level the icing condition belongs to.

[0125] In some embodiments, the target heating duration of the vehicle is determined in response to the icing condition of the vehicle satisfying a preset icing level. The preset icing level has a first correspondence relationship with the target heating duration. The target heating duration refers to the length of time for which the vehicle glass heating function needs to be continuously operated in order to achieve the ice removal effect. The first correspondence relationship refers to the direct correlation between the preset icing level and the target heating duration. The vehicle determines the specific duration for which the heating system needs to be operated according to the icing level detected in the image information.

[0126] For example, assuming that the control system of the vehicle has the following correspondence relationship between the preset icing level and the target heating duration: no ice: no heating; light icing: heating for 5 minutes; moderate icing: heating for 10 minutes; severe icing: heating for 15 minutes. If the first neural network model detects that the image information shows that the icing condition of the vehicle is moderate icing, the VCU in the vehicle will set the target heating duration to 10 minutes, control the heating system to start the glass heating function, and let it work continuously for 10 minutes to ensure that the accumulated ice is effectively melted.

[0127] Optionally, the first neural network model includes, but is not limited to, at least one of a CNN model, a FCN model, a DNN model, an RNN model, an embedding model, a GBDT model, and an LR model.

[0128] Optionally, the second neural network model is a neural network model trained according to images of the scene clarity of the vehicle under different icing conditions. The icing conditions include at least one of the phenomena of fogging, frosting, and icing. The embodiments of the present application take the icing condition as an example for illustration.

[0129] In some embodiments, the scene clarity refers to the clarity of the external scene observed through the glass of the vehicle. The external scene can refer to the environment around the vehicle, such as roads, buildings, pedestrians, vehicles, etc. When there is ice on the window, the clarity of the external scene may be affected due to the presence of the ice layer, and the observed external scene may become blurred or unclear. The preset clarity threshold refers to a preset clarity standard or critical value, which is used to determine whether the scene clarity is lower than the set level. It should be noted that the preset clarity threshold does not have a specific fixed value, and can be set according to specific circumstances and requirements. The setting standards of different vehicle manufacturers may differ. The present application does not limit this.

[0130] In some embodiments, the collected images of the vehicle scene clarity under different icing conditions are taken as second sample images, i.e., as training images, to input the neural network model for training, so as to obtain a second neural network model capable of identifying the clarity of the vehicle glass. Optionally, during the training process, the second sample images in the data set are labeled, and the label information includes labeling the clarity of the training image (i.e., the second sample image) as "clear" or "fuzzy". For example, the scene clarity lower than a preset clarity threshold is labeled as "fuzzy". By training using such labeled second sample images, the second neural network model capable of identifying the icing condition of the vehicle glass is obtained. The second neural network model can learn to identify the icing condition on the vehicle glass and predict the scene clarity.

[0131] In some embodiments, the vehicle obtains image information, identifies the image information based on the second neural network model capable of predicting the clarity in the image information, identifies whether the image information has an icing condition, and predicts the scene clarity. When the second neural network model determines that the scene clarity of the image information of the vehicle is lower than a preset clarity threshold, the vehicle automatically starts the glass heating function.

[0132] In some embodiments, in response to the clarity of the vehicle glass being lower than a preset clarity threshold, the vehicle is controlled to start the glass heating function, and a target heating duration of the vehicle is determined. The preset clarity threshold and the target heating duration have a second corresponding relationship. The target heating duration refers to the length of time during which the vehicle glass heating function needs to work in order to achieve the ice removal effect. The second corresponding relationship refers to the corresponding relationship between the preset clarity threshold and the target heating duration in the vehicle system. The vehicle determines the specific duration for which the heating system needs to work according to the scene clarity detected in the image information.

[0133] For example, if the second neural network model detects that the scene clarity of the vehicle in the image information is lower than a preset clarity threshold, the target heating duration is set according to the scene clarity. When the scene clarity is high, no heating is needed; when the scene clarity is lower than the preset clarity threshold, the VCU in the vehicle sets the target heating duration to 10 minutes, controls the heating system to start the glass heating function, and lets it work for 10 minutes to ensure that the accumulated ice is effectively melted.

[0134] Optionally, the second neural network model includes, but is not limited to, at least one of a CNN model, a FCN model, a DNN model, an RNN model, an embedding model, a GBDT model, and an LR model.

[0135] Option 3: input the image information into a third neural network model, identify the image information of the vehicle based on the third neural network model; in response to the image information belonging to an opening category, control the vehicle to open the glass heating function. The opening category is a category label used to indicate whether the image information of the vehicle belongs to the category of opening the glass heating function. The third neural network model is a neural network model trained by binding the behaviors of different drivers manually opening the glass heating function and the image information of the vehicle when the glass heating function is opened.

[0136] In some embodiments, the opening category refers to a category label in the classification task of the third neural network model, which is used to indicate whether the image information of the vehicle indicates the need to open the glass heating function.

[0137] In some embodiments, the image information is input into the third neural network model to determine whether the image information of the vehicle belongs to the opening category, thereby controlling whether the vehicle automatically opens the glass heating function. The third neural network model is a neural network model trained based on positive samples and negative samples.

[0138] Optionally, in the process of training the third neural network model, the positive samples are obtained by binding the behaviors of different drivers in the same region manually opening the glass heating function and the image information of the vehicle when the glass heating function is opened, and the negative samples are obtained by binding the behaviors of different drivers in the same region not opening the glass heating function within a third preset time interval after starting the vehicle and the image information of the vehicle when the glass heating function is not opened; or, the positive samples are obtained by binding the behaviors of different drivers in the same dimension manually opening the glass heating function and the image information of the vehicle when the glass heating function is opened, and the negative samples are obtained by binding the behaviors of different drivers in the same dimension not opening the glass heating function within a fourth preset time interval after starting the vehicle and the image information of the vehicle when the glass heating function is not opened. The third preset time interval refers to the time interval from starting the vehicle to the driver not opening the glass heating function in the same region. The fourth preset time interval refers to the time interval from starting the vehicle to the driver not opening the glass heating function in the same dimension. The same region can refer to a region with a preset size of geographical area, for example, the same region can refer to the same urban area, or the same region can refer to the same province. The environmental conditions (such as climate, temperature, humidity, etc.) in the same region are often consistent, which helps the third neural network model to learn the features related to the environment and improve the accuracy of identification.

[0139] In some embodiments, the behavior of different drivers manually turning on the glass heating function and the image information of the vehicle when the glass heating function is turned on are bound as positive samples, and the image information of the vehicle glass being clear and free of ice, which does not require the glass heating function to be turned on, can be used as negative samples to train the neural network model to obtain a third neural network model for identifying whether the image information of the vehicle belongs to the on category. The positive sample refers to a data sample that meets the preset condition or attribute, for example, the sample of the behavior of different drivers manually turning on the glass heating function and the image information of the vehicle when the glass heating function is turned on. The negative sample refers to a data sample that does not meet the preset condition or attribute, for example, the sample of the behavior of different drivers not turning on the glass heating function and the image information of the vehicle when the glass heating function is not turned on.

[0140] In some embodiments, during the training of the third neural network model, the behavior of different drivers manually turning on the glass heating function and the image information of the vehicle when the glass heating function is turned on are bound as positive samples, so that the third neural network model can learn the image information of the vehicle when the glass heating function is turned on. The third neural network model learns that the image information of the vehicle when the glass heating function is turned on is in an icing condition. During the training of the third neural network model, the condition that does not require the glass heating function to be turned on is usually used as a negative sample, which can include the image of the vehicle glass being clear and free of ice, and the behavior of different drivers not turning on the glass heating function and the image information of the vehicle when the glass heating function is not turned on. By inputting the negative sample into the third neural network model, the third neural network model can be trained to distinguish the condition that does not require the glass heating function to be turned on, thereby improving the accuracy and robustness of the third neural network model. During the training process, the positive sample and the negative sample are used to train the third neural network model, which can help the third neural network model to learn to distinguish when the glass heating function should be turned on. Through continuous training and adjustment, the performance of the third neural network model is optimized, so that the third neural network model can more accurately identify whether the image information of the vehicle belongs to the on category, i.e., whether the glass heating function needs to be turned on.

[0141] In some embodiments, the vehicle obtains image information, and identifies the image information based on the third neural network model. The third neural network model can make a prediction on the image information to determine whether the image information requires the driver to turn on the glass heating function. If the third neural network model predicts that the image information requires the driver to turn on the glass heating function, it is determined that the image information belongs to the on category, and the vehicle controls the heating system to automatically turn on the glass heating function.

[0142] Optionally, the third neural network model includes, but is not limited to, at least one of a CNN model, a FCN model, a DNN model, an RNN model, an embedding model, a GBDT model, and an LR model.

[0143] Optionally, the vehicle and the server are connected through a communication network.

[0144] In one possible implementation, when the temperature sensor of the vehicle detects that the external temperature where the vehicle is currently located is lower than a preset temperature, or when the image information acquired by the camera of the vehicle shows that the vehicle is at risk of icing, the vehicle sends an inquiry request to the server about whether the glass heating function needs to be turned on, and the server issues an instruction to the vehicle about whether heating is needed according to the actual situation. Optionally, the server makes a decision based on the opening conditions of other vehicles. The server takes the location where the current vehicle is located as the center, and the opening conditions (turning on the glass heating function) of other vehicles within a preset range as the judgment strategy. If the number of other vehicles within the preset range is n and the proportion of the number of vehicles within the preset range that have turned on the glass heating function reaches a preset proportion threshold, for example, 70%, within a preset time period, the server returns an instruction to turn on the glass heating function to the vehicle (the vehicle that sent the inquiry request), and the vehicle turns on the glass heating function according to the instruction returned by the server.

[0145] For example, the temperature sensor of the vehicle detects that the current external temperature is -5°C, which is lower than a preset temperature (for example, the preset temperature is 0°C). The vehicle automatically sends an inquiry request to the server about whether the glass heating function needs to be turned on. After receiving the inquiry request, the server makes a decision based on the opening conditions of other vehicles within a preset range. Taking the location where the current vehicle is located as the center, the server detects the opening conditions of the glass heating function of other vehicles within a preset range (for example, 1 km). The server collects data within the past 30 minutes and finds that there are 10 vehicles within the range, of which 7 have turned on the glass heating function, accounting for 70%. The data of the number of vehicles that have turned on the glass heating function meets the preset proportion threshold (for example, 70%). Based on this analysis, the server returns an instruction to turn on the glass heating function to the vehicle that sent the inquiry request. After receiving the instruction from the server, the vehicle automatically turns on the glass heating function.

[0146] In the embodiments of the present application, by inputting the image information into the first neural network model, the icing condition of the vehicle glass can be determined, the icing condition of the image information is judged to meet the preset icing, and the target heating time of the vehicle is intelligently judged; or, by inputting the image information into the second neural network model, the scene clarity observed by the vehicle can be determined, and the clarity of the vehicle's field of view is evaluated through the scene clarity, if the scene clarity is lower than the preset threshold, the glass heating function is triggered to start; or, by inputting the image information of the vehicle into the third neural network model, the image information of the vehicle can be recognized, and whether it belongs to the category of starting the glass heating function is judged. The three neural network models are combined to realize the analysis and decision of the icing condition of the vehicle glass, the scene clarity and other image information, and automatically control the vehicle to start the glass heating function according to the needs, improve the safety and comfort of the driver. Through this intelligent control strategy, the vehicle can automatically take appropriate heating measures in different environments.

[0147] Method 2: Control the vehicle to start the glass heating function based on the physical button in the target vehicle (start after the temperature sensor senses) Figure 5

[0148] In some embodiments, the instruction received by the vehicle can be a key-on instruction, and the vehicle obtains the environmental information of the vehicle based on the key-on instruction. When the external temperature of the vehicle is lower than the preset temperature (for example, less than 0℃), the vehicle control unit (VCU) controls the vehicle to start the glass heating function. Method 3: Control the vehicle to start the glass heating function based on the microphone in the vehicle (voice instruction) A flowchart of the glass heating control method provided by an example embodiment of the present application is shown, and step 210 can be replaced by step 212, step 220 can be replaced by step 222, and step 230 can be replaced by step 232.

[0149] Step 212: in response to receiving a remote instruction for the vehicle, controlling the vehicle to enter a perception state;

[0150] The key-on instruction is used to indicate that the vehicle enters an on state.

[0151] In some embodiments, the key is a start button in the vehicle, and the driver sends an on instruction to the vehicle through the key. In response to receiving the key-on instruction, the vehicle enters an on state.

[0152] Step 222: based on the key-on instruction received by the vehicle, obtaining the environmental information of the vehicle;

[0153] The environmental information is the external temperature of the vehicle. Optionally, the environmental information can be temperature information obtained by a temperature sensor of the vehicle. Optionally, the temperature sensor can be mechanical (such as bimetallic strip) or electronic (such as thermistor or thermocouple). The temperature sensor can measure the temperature of the surrounding environment of the vehicle.

[0154] In some embodiments, the temperature sensor is connected to the data bus system of the vehicle and is capable of transmitting the measured temperature data (the external temperature where the vehicle is located) to the VCU of the vehicle in the form of an electrical signal. The VCU of the vehicle receives the signal from the temperature sensor and converts it into a usable temperature reading.

[0155] In some embodiments, after the vehicle enters the starting state, the VCU of the vehicle requests data from the temperature sensor, and the temperature sensor of the vehicle acquires the environmental information where the vehicle is located, i.e., the temperature sensor of the vehicle acquires the external temperature where the vehicle is located.

[0156] Step 232: In response to the external temperature where the vehicle is located being lower than the preset temperature, the vehicle is controlled to start the glass heating function.

[0157] In some embodiments, the preset temperature is a temperature threshold value set in advance, which is used to determine whether the glass heating function needs to be started. If the external temperature where the vehicle is located is lower than the preset temperature, the vehicle determines that the glass heating function needs to be started in order to eliminate the possible icing situation and improve the driving safety and comfort.

[0158] In some embodiments, the setting of the preset temperature takes into account various factors such as climate, region, vehicle type, etc., and the preset temperature can be set according to actual needs. Alternatively, the preset temperature can be adjusted and modified according to actual conditions to adapt to different needs and environments.

[0159] Alternatively, when the temperature sensor monitors that the external temperature where the vehicle is located is lower than the preset temperature, the vehicle controls the heating system to automatically start the glass heating function. For example, when the vehicle enters the starting state, the temperature sensor monitors that the external temperature where the vehicle is located is lower than 0℃, at which time the VCU in the vehicle controls the vehicle to start the glass heating function.

[0160] In one possible implementation, the environmental information includes the external temperature where the vehicle is located and the internal temperature of the vehicle. In response to the temperature difference between the external temperature where the vehicle is located and the internal temperature of the vehicle being lower than a preset temperature interval, the vehicle is controlled to start the glass heating function. The internal temperature of the vehicle is the temperature of the vehicle after a long time of parking in a closed environment, and the external temperature of the vehicle is the temperature of the location where the vehicle is located.

[0161] For example, after the temperature sensor obtains the environmental information, the internal temperature of the vehicle and the external temperature of the vehicle are determined, the VCU in the vehicle calculates the difference between the internal temperature and the external temperature, and in the case that the difference meets the preset temperature interval, the preset temperature interval can be set as [10, 30), and the preset temperature interval can be adjusted according to the day and night temperature difference in the region; for example, in the case that the internal temperature of the vehicle is 5°C and the external temperature of the vehicle is -10°C, the difference between the internal temperature and the external temperature is 15°C at this time, which meets the preset temperature interval, and the VCU in the vehicle will control the vehicle to start the glass heating function.

[0162] In the embodiments of the present application, when the external temperature of the vehicle is lower than the preset temperature, the vehicle can automatically start the glass heating function to prevent the glass from icing and provide a clear view for the driver, thereby increasing the safety of the driver. By controlling the vehicle to start the glass heating function, the glass can be prevented from being broken or damaged due to icing, thereby prolonging the service life of the glass and reducing the maintenance and replacement costs.

[0163] Figure 6

[0164] In some embodiments, the instruction received by the vehicle can be a voice start instruction, and the vehicle obtains the microphone state of the vehicle based on the voice start instruction. When the microphone state of the vehicle is met, the vehicle control unit (VCU) controls the vehicle to start the glass heating function in response to receiving the voice heating instruction of the driver. The vehicle starts the glass heating function according to the scheduled heating time A flowchart of the glass heating control method provided by an exemplary embodiment of the present application is shown, and step 210 can be replaced by step 213, step 220 can be replaced by step 223, and step 230 can be replaced by step 233.

[0165] Step 213: in response to receiving a voice start instruction for the vehicle, controlling the vehicle to enter a sensing state;

[0166] The voice start instruction is used to indicate that the vehicle enters an open state.

[0167] In some embodiments, the driver issues a voice start instruction to the vehicle, and in response to receiving the voice start instruction, the vehicle enters an open state.

[0168] Step 223: based on the voice start instruction received by the vehicle, obtaining the microphone state of the vehicle;

[0169] The microphone is a voice system in the vehicle. The microphone state refers to the current working condition of the built-in microphone of the vehicle, including whether the microphone has been started, whether it is receiving sound, whether there is a fault, etc. The microphone state is used to ensure that the microphone can normally receive the voice instruction of the driver.

[0170] In some embodiments, the working state of the microphone is detected or the connection state and functional performance of the microphone are obtained through a software interface. The microphone can send a signal feedback to the VCU of the vehicle to indicate whether it has successfully received the voice instruction of the driver. For example, when the microphone is working normally, a prompt sound or a corresponding indicator light can be emitted.

[0171] Step 233: In response to receiving the voice heating instruction for the vehicle, the vehicle is controlled to start the glass heating function.

[0172] In some embodiments, the voice heating instruction is a heating instruction input by the driver to the vehicle through voice, requiring the vehicle to start the glass heating function. When the voice system (microphone) of the vehicle receives the voice heating instruction from the driver, the corresponding operation is performed, i.e., the vehicle is controlled to start the glass heating function. For example, the voice heating instruction can be "start front windshield heating", "heat windshield", "start heating", or other similar voice heating instructions.

[0173] In some embodiments, when the voice system (microphone) of the vehicle receives the voice heating instruction from the driver, the VCU of the vehicle first checks the microphone state of the vehicle to ensure that the microphone is in a usable state and can receive the voice heating instruction. If the microphone state is good, the vehicle performs the corresponding operation, and the VCU of the vehicle controls the heating system to start the glass heating function. At this time, the vehicle starts to heat the glass to provide a clear view for the driver, thereby increasing the driving safety and improving the driving comfort.

[0174] In the embodiments of the present application, in response to receiving the voice heating instruction of the driver after the vehicle enters the start state, the vehicle starts the glass heating function. The driver interacts with the vehicle through voice to start the glass heating function, thereby improving the convenience of the driver, and the vehicle can quickly respond to the needs of the driver to increase the driving safety.

[0175] The vehicle stops the glass heating function

[0176] In one possible implementation, the vehicle receives a heating instruction for a scheduled heating time, the scheduled heating time being a time for heating the glass of the vehicle; and in response to the current time reaching the scheduled heating time, the vehicle is controlled to start the glass heating function.

[0177] In some embodiments, the pre-booking heating time is a pre-set heating time point for indicating when the vehicle starts the glass heating function. Optionally, the driver can set the pre-booking heating time on the personal terminal according to the individual travel plan; or, the driver can send a heating instruction including the pre-booking heating time to the vehicle according to the recommended pre-booking heating time sent by the vehicle. For example, the VCU of the vehicle can send the recommended pre-booking heating time to the personal terminal of the driver according to the driving habits of the driver, such as the common departure time; or, the vehicle can send the recommended pre-booking heating time to the personal terminal of the driver according to the icing condition of the glass of the vehicle; or, the vehicle can send the recommended pre-booking heating time to the personal terminal of the driver according to the external environmental information.

[0178] Optionally, the VCU of the vehicle can control the vehicle to automatically start the glass heating function when the time reaches the pre-booking heating time according to the driving habits of the driver. For example, the driver sets the pre-booking heating time as 9:00 am every day, that is, the vehicle starts the glass heating function at 9:00 am every day. When the driver sets the pre-booking heating time for two consecutive days, the vehicle can learn the driving habits of the driver, and in the state where the driver does not pre-book, the vehicle can automatically control to start the glass heating function at 9:00 am every day.

[0179] In some embodiments, in response to the current time reaching the pre-booking heating time, the VCU of the vehicle delivers the heating instruction to the heating system of the vehicle at the pre-booking heating time, and the heating system executes the heating instruction to start the glass heating function of the vehicle.

[0180] Figure 7

[0181] In some embodiments, in response to the start time of the glass heating function reaching a pre-set time, the temperature state of the vehicle is obtained, the temperature state being the current temperature information of the glass of the vehicle; the vehicle is controlled to turn off the glass heating function based on the current temperature information, or, in response to receiving a stop heating instruction for the vehicle, the vehicle is controlled to turn off the glass heating function.

[0182] The pre-set time refers to a pre-set time length in the vehicle control system for determining the time for which the glass heating function should be operated. The time length of the pre-set time is usually based on the consideration of overheat protection and efficiency, to ensure that the glass heating function operates for a sufficient time to remove ice, while avoiding excessive heating to cause damage to the glass of the vehicle.

[0183] In some embodiments, when the opening time of the glass heating function reaches the preset time, the temperature sensor of the vehicle acquires the current temperature information of the glass of the vehicle and displays the current temperature information to the driver. When the current temperature information of the glass is too high, the driver issues a stop heating instruction. In response to receiving the stop heating instruction of the vehicle, the VCU of the vehicle controls the heating system to stop the glass heating function.

[0184] Optionally, the indication mode of the stop heating instruction includes at least one of the following:

[0185] · issuing a remote stop heating instruction based on a personal terminal;

[0186] · issuing a stop heating instruction based on a shutdown button of the vehicle;

[0187] · issuing a voice form stop heating instruction based on the driver.

[0188] In some embodiments, the driver uses a personal terminal (smartphone, smartwatch or other remote control device) to send a stop heating instruction. For example, the driver selects a "stop heating" option in the application program on the personal terminal, and the stop heating instruction is transmitted to the vehicle through a wireless network (such as Wi-Fi or cellular network). The driver uses a physical button or a touch screen interface inside the vehicle to turn off the heating function. For example, the driver finds the heating function shutdown button on the vehicle control panel (such as the center control screen) and presses it, or selects the corresponding stop heating option on the touch screen. The driver instructs the vehicle to stop heating by voice, for example, the driver speaks a stop heating instruction such as "stop heating" or "turn off the glass heating", and the voice system of the vehicle recognizes the stop heating instruction, and then controls the heating system through the VCU to execute the stop heating operation.

[0189] In some embodiments, when the opening time of the glass heating function reaches the preset time, the temperature sensor of the vehicle acquires the current temperature information of the glass of the vehicle, and when the current temperature information is greater than a preset temperature threshold, it is in an overheating protection setting, and the vehicle can control the heating system to automatically turn off the glass heating function. The preset temperature threshold can be the highest temperature threshold set by the driver. Optionally, the VCU of the vehicle controls the heating system to automatically turn off the glass heating function without the driver issuing a stop heating instruction. When the vehicle terminal receives the related instruction to open the glass heating function again, the glass heating function is opened again until the icing condition of the glass of the target vehicle is completely eliminated.

[0190] In the embodiments of the present application, when the glass heating function is turned on, the vehicle records the opening time of the glass heating function, and compares it with the preset time. If the opening time reaches or exceeds the preset time, the temperature sensor obtains the temperature state of the vehicle, i.e., the current temperature information of the vehicle glass. The driver can issue a stop heating instruction through remote control, button operation on the vehicle or voice command to control the vehicle to turn off the glass heating function. Alternatively, when the opening time of the glass heating function reaches the preset time, or when the heating temperature of the glass reaches the preset temperature, the vehicle is in an overheating protection setting, and the VCU of the vehicle controls the heating system to automatically turn off the glass heating function without the driver issuing a stop heating instruction. This intelligent setting can prevent long-time heating from damaging the glass of the vehicle.

[0191] Figure 7 A structural block diagram of a glass heating control device provided by an embodiment of the present application is shown. The device has the functions of implementing the above-mentioned examples of the glass heating control method, which can be implemented by hardware or by executing corresponding software by hardware. The device can be a server introduced above or can be arranged in a server. As shown in the figure, the device 700 can include a control module 710 and an acquisition module 720. Figure 8

[0192] The control module 710 is configured to control the vehicle to enter a sensing state in response to the vehicle sensing a triggering condition.

[0193] The acquisition module 720 is configured to acquire first information sensed by the vehicle based on the vehicle entering the sensing state, the first information being a triggering condition of glass heating of the vehicle.

[0194] The control module 710 is configured to control the vehicle to turn on a glass heating function in response to the first information meeting a preset condition.

[0195] In an optional example, the triggering condition for the vehicle to enter the sensing state includes at least one of the following:

[0196] in response to receiving an opening instruction for the vehicle;

[0197] in response to a length of time or a distance that the vehicle travels from an indoor location to an outdoor location meeting a first condition;

[0198] in response to a length of time or a distance that the vehicle travels from the outdoor location to the indoor location meeting a second condition.

[0199] In some embodiments, the acquisition module 720 further includes an acquisition sub-module, and the control module 710 includes a sending sub-module and a control sub-module.

[0200] ​In an optional example, the obtaining submodule is configured to obtain image information of the vehicle based on remote instructions received by the vehicle; the sending submodule is configured to send the image information of the vehicle to a personal terminal, which is a terminal device used by the driver; and the control submodule is configured to control the vehicle to turn on the glass heating function in response to receiving a heating instruction for the vehicle.

[0201] In some embodiments, the apparatus 700 further includes an input module.

[0202] In an optional example, the input module is configured to input the image information into a neural network model, identify the image information of the vehicle based on the neural network model; and the control submodule is configured to control the vehicle to automatically turn on the glass heating function in response to the image information of the vehicle indicating that the glass of the vehicle is in a frozen condition.

[0203] In some embodiments, the input module further includes a determination submodule, an identification submodule, and a control submodule.

[0204] In an optional example, the determination submodule is configured to input the image information into a first neural network model, determine a frozen condition of the glass of the vehicle based on the first neural network model; and the control submodule is configured to control the vehicle to turn on the glass heating function in response to the frozen condition of the glass of the vehicle meeting a preset frozen level.

[0205] In an optional example, the determination submodule is configured to input the image information into a second neural network model, determine a scene definition based on the second neural network model; and the control submodule is configured to control the vehicle to turn on the glass heating function in response to the scene definition of the vehicle being lower than a preset definition threshold.

[0206] In an optional example, the identification submodule is configured to input the image information into a third neural network model, identify the image information of the vehicle based on the third neural network model; and the control submodule is configured to control the vehicle to turn on the glass heating function in response to the image information belonging to an on category.

[0207] In an optional example, the obtaining submodule is configured to obtain environmental information of the vehicle based on a button-on instruction received by the vehicle, the environmental information being an external temperature of the vehicle; and the control submodule is configured to control the vehicle to turn on the glass heating function in response to the external temperature of the vehicle being lower than a preset temperature.

[0208] In an optional example, the obtaining submodule is configured to obtain microphone state information of the vehicle based on a voice-on instruction received by the vehicle; and the control submodule is configured to control the vehicle to turn on the glass heating function in response to receiving a voice heating instruction for the vehicle.

[0209] In some embodiments, the apparatus further comprises a receiving module.

[0210] In an optional example, the receiving module is configured to receive a heating instruction for a scheduled heating time of the vehicle, the scheduled heating time being a time for scheduling heating of the glass of the vehicle; and the control module is configured to control the vehicle to turn on the glass heating function in response to a current time reaching the scheduled heating time.

[0211] In an optional example, the obtaining submodule is configured to obtain a temperature state of the vehicle in response to an on time of the glass heating function reaching a preset time, the temperature state being current temperature information of the glass of the vehicle; and the control submodule is configured to control the vehicle to turn off the glass heating function based on the current temperature information; or, in response to receiving a stop heating instruction for the vehicle, control the vehicle to turn off the glass heating function.

[0212] In an optional example, the indication manner of the stop heating instruction comprises at least one of the following:

[0213] issuing a remote stop heating instruction based on the personal terminal;

[0214] issuing a stop heating instruction based on an off button of the vehicle;

[0215] issuing a stop heating instruction in a voice form based on the driver.

[0216] In summary, the present application provides a glass heating control apparatus. After receiving an on instruction for the vehicle from the driver, the vehicle enters an on state (working state). After entering the on state, the vehicle obtains first information triggering the glass heating of the vehicle. The vehicle checks whether the first information meets a preset condition. If yes, the driver can control the vehicle to turn on the glass heating function, or the vehicle automatically turns on the glass heating function. Through automatic detection and triggering of the glass heating function, the driver does not need to manually intervene, and the vehicle glass is not damaged, so that the vehicle glass can be kept clear, and the driving safety is improved. At the same time, this also helps to save the time of the driver, so that he can focus more on the driving task.

[0217] It should be noted that the specific limitations in the above one or more embodiments of the glass heating control apparatus can refer to the limitations of the glass heating control method in the above, which will not be repeated here. The modules of the above apparatus can be realized by software, hardware and their combinations, and each module can be embedded in the processor of the computer device in hardware form or independent of the processor of the computer device, or can be stored in the memory of the computer device in software form, so as to be called and executed by the processor to perform the operations corresponding to each module.

[0218] The above-mentioned sequence numbers of embodiments of the present application are only for description, and do not represent advantages or disadvantages of the embodiments.

[0219] Figure 8 A structure block diagram of a vehicle terminal 800 provided by an example embodiment of the present application is shown. The vehicle terminal 800 can be a smart phone, a tablet computer, an MP3 (Moving Picture Experts Group Audio Layer III) player, an MP4 (Moving Picture Experts Group Audio Layer IV) player, a notebook computer, or a desktop computer. The vehicle terminal 800 can also be referred to as a user equipment, a portable terminal, a laptop terminal, a desktop terminal, or other names.

[0220] Generally, the vehicle terminal 800 includes a processor 801 and a memory 802.

[0221] The processor 801 can include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 801 can be implemented in at least one of a hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 801 can also include a main processor and a coprocessor. The main processor is a processor for processing data in an awake state, also referred to as a CPU (Central Processing Unit). The coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 801 can be integrated with a GPU (Graphics Processing Unit) for rendering and drawing content required to be displayed on a display screen. In some embodiments, the processor 801 can further include an AI processor for processing machine learning-related computing operations.

[0222] The memory 802 can include one or more computer-readable storage media. The computer-readable storage media can be non-transitory. The memory 802 can also include high-speed random access memory and nonvolatile, computer-readable storage media such as one or more magnetic disk storage devices, flash memory devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 802 is used to store at least one instruction for being executed by the processor 801 to implement the control method of glass heating provided by the method embodiments in the present application.

[0223] In some embodiments, the vehicle terminal 800 further includes other components, which can be understood by those skilled in the art, ​ The structure shown in the figure does not constitute a limitation on the vehicle terminal 800, and can include more or fewer components than shown, or combine certain components, or adopt different component arrangements.

[0224] The present application also provides a computer device, which includes a processor and a memory, and the memory stores at least one instruction, at least one program, a code set or an instruction set, which is loaded and executed by the processor to implement the control method of glass heating provided by the above-mentioned method embodiments.

[0225] The embodiments of the present application also provide a computer-readable storage medium, which stores at least one instruction, at least one program, a code set or an instruction set, which is loaded and executed by the processor to implement the control method of glass heating provided by the above-mentioned method embodiments.

[0226] The embodiments of the present application also provide a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. The processor of the vehicle terminal reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to make the vehicle terminal execute the control method of glass heating described in any of the above-mentioned embodiments.

[0227] The above-mentioned serial numbers of the embodiments of the present application are only for description, and do not represent the advantages and disadvantages of the embodiments.

[0228] Those skilled in the art can understand that all or part of the steps of the above-mentioned embodiments can be completed by software, or by a program instructing related software, and the program can be stored in a computer-readable storage medium. The above-mentioned storage medium can be a read-only memory, a magnetic disk or an optical disk, etc.

[0229] The above merely provides the optional embodiments of the present application, and is not intended to limit the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A control method of glass heating, characterized by, The method is executed by a vehicle terminal, and the method comprises: In response to the vehicle perceiving a trigger condition, controlling the vehicle to enter a perception state, the trigger condition comprising: in response to receiving an opening instruction for the vehicle; Based on the vehicle entering the perception state, acquiring first information perceived by the vehicle, the first information being a trigger condition for glass heating of the vehicle, when the opening instruction is a remote instruction, the acquiring first information perceived by the vehicle based on the vehicle entering the perception state comprising: based on the remote instruction received by the vehicle, acquiring image information of the vehicle; In response to the first information meeting a preset condition, controlling the vehicle to open a glass heating function, when the first information is the image information of the vehicle, the controlling the vehicle to open the glass heating function in response to the first information meeting a preset condition comprising: sending the image information of the vehicle to a personal terminal, the personal terminal being a terminal device used by a driver, in response to receiving a heating instruction for the vehicle, controlling the vehicle to open the glass heating function; or inputting the image information of the vehicle into a neural network model, identifying the image information of the vehicle based on the neural network model, in response to the image information of the vehicle showing that the glass of the vehicle has a freezing condition, controlling the vehicle to automatically open the glass heating function.

2. The method of claim 1, wherein, The trigger condition for the vehicle entering the perception state further comprises at least one of the following: In response to a time length or a distance that the vehicle travels from a position inside a building to a position outside the building meeting a first condition; In response to a time length or a distance that the vehicle travels from the position outside the building to the position inside the building meeting a second condition.

3. The method of claim 1, wherein, The opening instruction is a key opening instruction; The acquiring first information perceived by the vehicle based on the vehicle entering the perception state comprises: Based on the key opening instruction received by the vehicle, acquiring environmental information in which the vehicle is located, the environmental information being an external temperature in which the vehicle is located; The controlling the vehicle to open the glass heating function in response to the first information meeting a preset condition comprises: In response to the external temperature in which the vehicle is located being lower than a preset temperature, controlling the vehicle to open the glass heating function.

4. The method of claim 1, wherein, The opening instruction is a voice opening instruction; The acquiring first information perceived by the vehicle based on the vehicle entering the perception state comprises: Based on the voice opening instruction received by the vehicle, acquiring microphone state information of the vehicle; The controlling the vehicle to open the glass heating function in response to the first information meeting a preset condition comprises: In response to receiving a voice heating instruction for the vehicle, controlling the vehicle to open the glass heating function.

5. The method according to any one of claims 1 to 4, characterized in that, The method further comprises: Receiving a heating instruction for a scheduled heating time of the vehicle, the scheduled heating time being a time for scheduling heating of the glass of the vehicle; In response to a current time reaching the scheduled heating time, controlling the vehicle to open the glass heating function.

6. The method according to any one of claims 1 to 4, characterized in that, The method further comprises: in response to the opening time of the glass heating function reaching a preset time, obtaining a temperature state of the vehicle, the temperature state being current temperature information of the glass of the vehicle; controlling the vehicle to turn off the glass heating function based on the current temperature information; or, in response to receiving a stop heating instruction for the vehicle, controlling the vehicle to turn off the glass heating function.

7. The method of claim 6, wherein, The indication mode of the stop heating instruction includes at least one of the following: issuing a remote stop heating instruction based on a personal terminal; issuing a stop heating instruction based on a closing button of the vehicle; issuing a stop heating instruction in the form of voice based on a driver.

8. A control device for heating of glass, characterized in that The device includes: a control module configured to control the vehicle to enter a sensing state in response to the vehicle sensing a trigger condition, the trigger condition including: in response to receiving an opening instruction for the vehicle; an acquisition module configured to acquire first information sensed by the vehicle based on the vehicle entering the sensing state, the first information being a trigger condition of glass heating of the vehicle, and when the opening instruction is a remote instruction, the acquisition of the first information sensed by the vehicle based on the vehicle entering the sensing state includes: acquiring image information of the vehicle based on a remote instruction received by the vehicle; the control module is configured to control the vehicle to turn on a glass heating function in response to the first information meeting a preset condition, and when the first information is the image information of the vehicle, the control of the vehicle to turn on the glass heating function in response to the first information meeting the preset condition includes: sending the image information of the vehicle to a personal terminal, the personal terminal being a terminal device used by a driver, and in response to receiving a heating instruction for the vehicle, controlling the vehicle to turn on the glass heating function; or inputting the image information of the vehicle into a neural network model, identifying the image information of the vehicle based on the neural network model, and in response to the image information of the vehicle indicating that the glass of the vehicle has a freezing condition, controlling the vehicle to automatically turn on the glass heating function.

9. A vehicle terminal, characterized by The vehicle-mounted terminal includes a processor and a memory, and the memory stores at least one program, which is loaded and executed by the processor to implement the glass heating control method of any one of claims 1 to 7.

10. A computer storage medium, characterized in that, The computer storage medium stores at least one computer instruction, which is loaded and executed by the processor to implement the glass heating control method of any one of claims 1 to 7.

11. A computer program product, characterised in that, The computer program product includes a computer program stored in a computer readable storage medium; the computer program is read and executed by the processor of the computer device from the computer readable storage medium, so that the computer device executes the glass heating control method of any one of claims 1 to 7.

Images