Charging forgetting reminding method and device and computer readable storage medium

Abstract

The embodiment of the invention relates to the technical field of vehicle control, and discloses a charging forgetting reminding method and device and a computer readable storage medium, and the method comprises the steps: obtaining an in-vehicle image under the condition that it is detected that a charging area is switched from a standby mode to a working mode; based on the in-vehicle image, determining a target seat where a target object corresponding to the target equipment is located; the target equipment is equipment charged in the charging area; according to the target state information related to the target seat, the behavior state of the target object is determined; and when it is determined that the charging forgetting condition is met according to the behavior state, forgetting reminding is sent out. By applying the technical scheme of the invention, the accuracy and reliability of forgetting reminding can be improved.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of vehicle control technology, and specifically to a charging forgetting reminder method, device and computer-readable storage medium. Background Art

[0002] With the development of technology, in-vehicle charging technology has brought a lot of convenience to travel; when users charge their mobile devices through in-vehicle charging, it is easy for them to forget their mobile devices in the car when they get off the car.

[0003] In the related art, when the driver gets off the car and there is a mobile device in the charging area, a forgotten reminder is issued. This method can only provide a forgotten reminder to the driver, but cannot be implemented to provide forgotten reminders to other users in the car, resulting in poor reliability of the forgotten reminder. Summary of the invention

[0004] In view of the above problems, embodiments of the present invention provide a charging forgetting reminder method, device and computer-readable storage medium, which are used to solve the problem of poor reliability of forgetting reminder in the prior art.

[0005] According to one aspect of an embodiment of the present invention, a charging forgotten reminder method is provided, comprising: acquiring an in-vehicle image when detecting that a charging area switches from a standby mode to an operating mode; determining a target seat where a target object corresponding to a target device is located based on the in-vehicle image; the target device is a device that is charged in the charging area; determining a behavior state of the target object based on target state information related to the target seat; and issuing a forgotten reminder when determining that a charging forgotten condition is met based on the behavior state.

[0006] According to another aspect of an embodiment of the present invention, a charging forgetting reminder device is provided, comprising:

[0007] An acquisition module, used for acquiring an image inside the vehicle when detecting that the charging area switches from a standby mode to an operating mode;

[0008] The first processing module is used to determine, based on the in-vehicle image, a target seat where a target object corresponding to a target device is located; the target device is a device being charged in a charging area;

[0009] A second processing module determines a behavior state of the target object based on target state information related to the target seat;

[0010] The reminder module is used to issue a forgetting reminder when it is determined based on the behavior state that the charging forgetting condition is met.

[0011] According to another aspect of an embodiment of the present invention, a computer device is provided, including: a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other through the communication bus; the memory is used to store at least one executable instruction, and the executable instruction enables the processor to execute the operation of the above-mentioned charging forgotten reminder method.

[0012] According to another aspect of an embodiment of the present invention, a computer-readable storage medium is provided, wherein at least one executable instruction is stored in the storage medium, and the executable instruction enables a computer device to perform the following operations:

[0013] When it is detected that the charging area switches from standby mode to working mode, an image inside the vehicle is acquired; based on the image inside the vehicle, a target seat where a target object corresponding to a target device is located is determined; the target device is a device that is charged in the charging area; based on target state information related to the target seat, a behavior state of the target object is determined; and when it is determined based on the behavior state that the charging forgetting condition is met, a forgetting reminder is issued.

[0014] According to another aspect of an embodiment of the present invention, a computer program product is provided, including executable instructions, and when the executable instructions are executed by a processor, the operations of the above-mentioned charging forgetting reminder method are implemented.

[0015] In an embodiment of the present invention, when it is detected that the charging area is switched from the standby mode to the working mode, an image inside the vehicle is acquired, and the target seat where the target object corresponding to the target device in the vehicle image is located is determined according to the target state information related to the target seat, and when the behavior state satisfies the charging forgotten condition, a forgotten reminder is issued; that is, the target object corresponding to the target device and the behavior state of the target object are determined, and a forgotten reminder is issued when the target device is charging in the charging area and the target object corresponding to the target device is detected to leave the vehicle, rather than when the main driver leaves the vehicle and there is a device being charged in the charging area. The above-mentioned reminder that the target device is forgotten in the charging area is carried out for the target object corresponding to the target device. Such a targeted reminder can issue a timely forgotten reminder when the target object leaves the vehicle and forgets the target device in the charging area, thereby improving the accuracy and reliability of the forgotten reminder.

[0016] The above description is only an overview of the technical solution of the embodiment of the present invention. In order to more clearly understand the technical means of the embodiment of the present invention, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the embodiment of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The accompanying drawings are only used to illustrate the embodiments and are not to be considered as limiting the present invention. In addition, the same reference symbols are used to represent the same components throughout the accompanying drawings. In the accompanying drawings:

[0018] Figure 1 A schematic diagram showing a flow chart of a first embodiment of a charging forgetting reminder method provided by the present invention;

[0019] Figure 2 A schematic diagram showing a flow chart of a second embodiment of the charging forgetting reminder method provided by the present invention;

[0020] Figure 3 A schematic diagram showing a flow chart of a method for reminding a person to forget to charge provided by the present invention when the target seat is a passenger seat;

[0021] Figure 4 A schematic diagram showing a flow chart of a method for reminding a person to forget to charge provided by the present invention when the target seat is a rear seat;

[0022] Figure 5 A schematic diagram showing the structure of a first embodiment of a charging forgetting device provided by the present invention is shown;

[0023] Figure 6 A schematic structural diagram of an embodiment of a computer device provided by the present invention is shown. DETAILED DESCRIPTION

[0024] Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present invention are shown in the drawings, it should be understood that the present invention can be implemented in various forms and should not be limited to the embodiments set forth herein.

[0025] Figure 1 The flowchart of the first embodiment of the charging forgetting reminder method of the present invention is shown, and the method is executed by a computer device. Figure 1 As shown, the method comprises the following steps:

[0026] Step 110: When it is detected that the charging area switches from the standby mode to the working mode, an image inside the vehicle is acquired.

[0027] Among them, the charging area is the area where the device is charged through the vehicle's onboard power supply.

[0028] In an optional manner, the charging area includes a wireless charging plate, which realizes wireless transmission of electric energy through electromagnetic induction, thereby realizing wireless charging; in actual applications, a device with a wireless charging function is placed on the wireless charging plate, so that the receiving coil of the device and the transmitting coil of the wireless charging plate are aligned, and the device can be wirelessly charged.

[0029] In an optional manner, the charging area includes a wireless charging plate and a charging port, and the wireless charging plate can be used to wirelessly charge a device with a wireless charging function; for a device without a wireless charging function, the device can be placed on the wireless charging plate, and the power port and the charging port of the device can be connected via a charging cable to achieve wired charging of the device.

[0030] In an optional manner, the charging area includes a charging port and a device slot. The device is placed in the device slot, and the power port and the charging port of the device are connected via a charging cable to enable wired charging of the device. In this optional manner, the device slot is used to place the device and may not have a wireless charging function. When the device is charged through the charging area of ​​this optional manner, a charging reminder can be given if the device is placed in the device slot.

[0031] In an optional manner, the number of charging areas may be at least one; in actual applications, the number of charging areas of different vehicle models may be different, and the locations of the charging areas may also be different.

[0032] Exemplarily, when the number of charging areas is one, the charging area can be set in the central armrest box or in the dashboard area; when the number of charging areas is two, the two charging areas can be set in the central armrest box, wherein the charging area close to the driver's seat can be called the driver's charging area, through which the driver can conveniently charge the device, wherein the charging area close to the passenger seat can be called the passenger charging area, through which the passenger sitting in the passenger seat can conveniently charge the device; one of the two charging areas can be set in the central armrest box, and the other can be set in the dashboard area; of course, the number of charging areas can also be three, two of which can be set in the central armrest box, namely the driver's charging area and the passenger's charging area, and the other can be set in the dashboard area.

[0033] The number and location of the charging areas can be set according to the actual situation of the vehicle model. The above-mentioned number and location of the charging areas are examples. The embodiment of the present application does not limit the number and location of the charging areas.

[0034] The charging area is in standby mode, which means that the charging area is not performing a charging operation; the charging area is in working mode, which means that the charging area is performing a charging operation.

[0035] The in-car image is an image taken from inside the car, and the viewing area of ​​the in-car image includes the charging area. In practical applications, the in-car image can be collected by the on-board visual sensor in the car. It should be noted that when the vehicle has other functions that need to collect in-car images, this method can reuse the in-car images collected by other functions.

[0036] Specifically, the computer device detects the mode of the charging area in real time. When it is detected that the charging area switches from standby mode to working mode, an image inside the vehicle captured by an on-board visual sensor can be obtained; the obtained image inside the vehicle may include at least one of an image of the charging area in working mode, or an image of the charging area in standby mode.

[0037] Exemplarily, the vehicle-mounted visual sensor collects images inside the vehicle in real time and sends them to a computer device for storage; when the computer device detects that the charging area switches from standby mode to working mode, the computer device obtains the stored images inside the vehicle.

[0038] Step 120: Based on the in-vehicle image, determine the target seat where the target object corresponding to the target device is located; the target device is a device that is charged in the charging area.

[0039] Among them, the target device is a device that is charged in the charging area, such as mobile phones, smart watches, Bluetooth headsets and other mobile devices; the target object corresponding to the target device can be the user in the car to which the target device belongs, or the user in the car who performs a charging operation on the target device; the target seat can be any seat in the car.

[0040] Specifically, the computer device identifies the in-vehicle image to determine whether the target device being charged in the charging area belongs to the main driver's seat. If the target device belongs to the main driver's seat, the main driver's seat is used as the target seat. If the target device does not belong to the main driver's seat, the in-vehicle user who performs the charging operation on the target device based on the in-vehicle image recognition is used as the target object, and the seat where the in-vehicle user is located is used as the target seat. The in-vehicle user who performs the charging operation on the target device based on the in-vehicle image recognition can be the in-vehicle user who places the target device in the charging area through behavior recognition of the in-vehicle image.

[0041] It should be noted that the main driving object is an object in the main driving seat and is one of the registered objects bound to the vehicle, and the target device is one of the registered devices bound to the registered object; illustratively, for an object that often drives the vehicle, the object can be registered as a registered object bound to the vehicle through the face image of the object, and the registered device can be bound to the registered object through the appearance image of the registered device of the registered object; and then when determining whether the target device belongs to the main driving object, it can be determined whether the main driving object in the image inside the car is the registered object. If so, it is determined that the target device is a registered device bound to the registered object. If so, it is determined that the target device belongs to the main driving object.

[0042] Step 130: Determine the behavior state of the target object based on the target state information related to the target seat.

[0043] Among them, the target state information related to the target seat may include at least one of the occupancy information of the target seat or the switch state of the target door corresponding to the target seat; the occupancy information can reflect whether there is an occupant on the seat, and the switch state can reflect whether the door is in an open or closed state.

[0044] The behavior state can be a riding state or a leaving state.

[0045] Specifically, after determining the target seat, the computer device can detect target state information related to the target seat in real time, and determine the behavior state of the target object through changes in the target state information.

[0046] In an optional manner, the target state information includes the occupancy information of the target seat; for example, when the target seat is the driver's seat or the passenger seat, the behavior state of the target object can be determined through the occupancy information; for example, the target object charges the target device through the charging area, and the computer device determines the occupancy information of the target seat, and the occupancy information is used to reflect that there is an object sitting on the target seat, and the behavior state of the target object is the sitting state; when it is detected that the occupancy information switches to reflect that there is no object sitting on the target seat, the behavior state of the target object switches to the leaving vehicle state.

[0047] In an optional manner, the target state information includes the occupancy information of the target seat and the switch state of the target door; for example, when the target seat is a rear seat, the behavior state of the target object is determined by the occupancy information of the rear seat and the switch state of the rear door; for example, the target object charges the target device through the charging area, and the computer device determines the occupancy information of the target seat and the switch state of the target door, the occupancy information is used to reflect that there is an object sitting on the target seat, the switch state is closed, and the behavior state of the target object is the sitting state; when it is detected that the occupancy information switches to reflect that there is no object sitting on the target seat, the switch state switches to open state, and the behavior state of the target object switches to the leaving vehicle state.

[0048] In an optional manner, in accordance with standard driving operations, when a passenger in the vehicle gets off, the vehicle gear position needs to be switched to the parking gear position (P gear). Based on this, when it is detected that the vehicle gear position is the parking gear position, the target state information related to the target seat can be detected, and the behavior state of the target object can be determined according to the change of the target state information; for example, the target state information includes the target occupancy information of the target seat. When the vehicle gear position is the parking gear position, if it is detected that the target occupancy information is switched from occupied to idle, then it is determined that the behavior state of the target object is switched to the leaving vehicle state; for another example, the target state information includes the target occupancy information of the target seat and the target switch state of the target door. When the vehicle gear position is the parking gear position, if it is detected that the target occupancy information is switched from occupied to idle, and the target switch state is switched from the closed state to the open state, then it is determined that the behavior state of the target object is switched to the leaving vehicle state.

[0049] Step 140: When it is determined based on the behavior status that the charging forgetting condition is met, a forgetting reminder is issued.

[0050] Among them, the behavior status meets the charging forgetting condition, which means that the behavior status is used to reflect that the target object has got off the vehicle; the forgetting reminder can be issued in the form of graphics and / or audio.

[0051] In an optional manner, after determining the behavior state of the target object based on the target state information related to the target seat, it also includes: when the behavior state switches from the sitting state to the leaving-vehicle state, determining that the charging forgetting condition is met.

[0052] Specifically, when the target object charges the target device through the charging area, the target object is on the target seat, so the target object's behavior state is a sitting state; the computer device detects the target state information in real time to determine the target object's behavior state in real time, and when the computer device detects that the target object's behavior state switches from a sitting state to an off-vehicle state, it is determined that the charging forgetting condition is met.

[0053] It should be noted that since the above process is triggered when it is detected that the charging area is switched from standby mode to working mode, charging the target device through the charging area is the default condition; that is, when the target device is charged through the charging area and the behavior state of the target object is switched from the riding state to the leaving state, it is determined that the charging forgetting condition is met and a forgetting reminder is issued.

[0054] In the above embodiment, the behavior state of the target object is detected by the target state information related to the target seat. When the behavior state switches from the sitting state to the leaving state, it can be determined that the target object has got off the vehicle. A forgotten reminder is given according to the behavior state of the target object corresponding to the target device, making the forgotten reminder more targeted and improving the timeliness and accuracy of the forgotten reminder.

[0055] In an optional manner, issuing a forgetting reminder includes issuing the forgetting reminder by at least one of displaying a forgetting reminder graphic or text or playing a forgetting reminder audio.

[0056] Among them, the forgotten reminder graphic and text may include at least one of a forgotten reminder image, a forgotten reminder video or a forgotten reminder text; the forgotten reminder image, the forgotten reminder video, the forgotten reminder text and the forgotten reminder audio are all pre-set and used to express that the target device being charged has been forgotten.

[0057] Specifically, when it is determined that the charging forgetting condition is met, the computer device can display forgetting reminder graphics and texts on the central control display device, and / or play forgetting reminder audio through the in-car speakers.

[0058] In the above embodiment, the forgetting reminder is issued by using forgetting reminder pictures and texts or playing forgetting reminder audio, which improves the richness of forgetting reminder methods.

[0059] It should be noted that the computer device determines the behavior state of the target object based on the target state information. If the detected behavior state is the riding state and the charging area is switched from the working mode to the standby mode, it means that when the target object is in the car, the charging operation of the target device in the charging area has been stopped, and no forgotten reminder will be issued.

[0060] It is understandable that in the above process, the vehicle's power gear must be the power-on gear for the whole vehicle. Only when the whole vehicle is powered on can the steps of acquiring the image inside the vehicle, determining the target seat where the target object is located, detecting the target object's behavior status and issuing a forgotten reminder be realized.

[0061] In the above-mentioned charging forgotten reminder method, when it is detected that the charging area is switched from standby mode to working mode, an in-vehicle image is obtained, and the target seat where the target object corresponding to the target device in the in-vehicle image is located is determined according to the target state information related to the target seat, and a forgotten reminder is issued when the behavior state meets the charging forgotten condition; that is, the target object corresponding to the target device and the behavior state of the target object are determined, and a forgotten reminder is issued when the target device is charging in the charging area and the target object corresponding to the target device is detected to leave the vehicle, rather than when the main driver leaves the vehicle and there is a device being charged in the charging area. The above-mentioned reminder that the target device is forgotten in the charging area is for the target object corresponding to the target device. Such a targeted reminder can issue a timely forgotten reminder when the target object leaves the vehicle and forgets the target device in the charging area, thereby improving the accuracy and reliability of the forgotten reminder.

[0062] In an optional manner, a target seat where a target object corresponding to a target device is located is determined based on an in-vehicle image, including: extracting features of the target device based on the in-vehicle image to obtain target device features; when it is determined based on the target device features that the target device is a commonly used device for the main driver object, using the main driver seat where the main driver object is located as the target seat; when it is not possible to determine based on the target device features that the target device is a commonly used device for the main driver object, determining a moving trajectory of the target device based on the in-vehicle image, and determining a target seat where the target object corresponding to the target device is located based on the moving trajectory.

[0063] Among them, the number of in-vehicle images used to extract target device features may be one or more, and the one in-vehicle image may be an in-vehicle image when the charging area is in working mode; the multiple in-vehicle images may be multiple in-vehicle images when the charging area is in working mode, or may be multiple in-vehicle images when the charging area is in working mode and multiple in-vehicle images when the charging area is in standby mode.

[0064] The target device characteristics may include the appearance characteristics of the target device, and the appearance characteristics may include at least one of the overall shape characteristics of the target device, the desktop image characteristics displayed by the target device, and the protective shell image characteristics of the target device; through the overall shape characteristics, the type of the target device (such as a mobile phone, a smart watch or a Bluetooth headset) can be determined, and the size of the target device can also be determined; through the desktop image characteristics, the characteristics of the desktop image set by the target device; the protective shell image characteristics are the image characteristics of the protective shell included outside the target device and used to protect the target device.

[0065] The main driving object refers to the object driving the vehicle.

[0066] Specifically, the computer device can input the in-vehicle image into the feature extraction model, extract the features of the target device in the in-vehicle image through the feature extraction model, and obtain the target device features; and determine whether the target device is a commonly used device of the main driving object based on the target device features.

[0067] In an optional manner, a computer device obtains device features of each pre-set registered device, calculates the similarity between each device feature and the target device feature, selects the similarity belonging to a preset similarity interval among the similarities, obtains the registered device corresponding to the device feature for which the similarity is calculated, and the registered device is the target device; obtains a registered object associated with the registered device (i.e., the target device), and the computer device obtains a driver's facial image of the driver's object through an in-vehicle image, and determines whether the driver's object is a registered object based on the driver's facial image. If so, it is determined that the target device is a commonly used device of the driver's object; if not, it is determined that the target device is not a commonly used device of the driver's object.

[0068] In an optional manner, a computer device obtains facial images of each pre-set registration object, obtains the main driver's facial image of the main driver object through the in-vehicle image, and determines whether the main driver object is a certain registered object based on the main driver's facial image and the facial image of the registered object. If so, a registration device associated with the main driver object (registered object) is obtained, and device characteristics of the registered device are obtained. Based on the similarity between the device characteristics and the target device characteristics, it is determined whether the target device is a commonly used device associated with the main driver object. If so, it is determined that the target device is the device of the main driver object. If not, it is determined that the target device is not the device of the main driver object.

[0069] When it is determined that the target device is the device of the main driving object, the main driving seat where the main driving object is located is used as the target seat, and then the main driving object is the target object; when the target device is not the device of the main driving object, the moving trajectory of the target device is determined based on the in-vehicle image, and the target seat where the target object corresponding to the target device is located is determined according to the moving trajectory.

[0070] In the above embodiment, the feature of the target device is extracted through the in-vehicle image to obtain the target device feature, and it is determined whether the target device is the device of the main driver based on the target feature. If not, the movement trajectory of the target device is extracted, and the target object corresponding to the target device is determined based on the movement trajectory. Since in actual applications, the main driver often uses the charging area to charge his device, first determining whether the target device is the device of the main driver based on the target device feature can improve the efficiency of determining the target seat where the target object corresponding to the target device is located.

[0071] In an optional manner, after extracting features of the target device based on the in-vehicle image and obtaining the target device features, the method further includes: identifying the main driver object based on the in-vehicle image to obtain the main driver identity information; obtaining the main driver device features associated with the main driver identity information; determining the similarity between the main driver device features and the target device features; and determining that the target device is the device of the main driver object when the similarity falls within a preset similarity interval.

[0072] Among them, the main driver identity information is the identity information of the main driver object, which can be specifically the name of the main driver object; the main driver device characteristics can be the characteristics of the registered device of the registered object corresponding to the main driver identity information.

[0073] The similarity within the preset similarity interval is greater than the similarity not within the preset similarity interval. The specific value of the preset similarity interval can be set according to actual needs, and the embodiment of the present application does not limit this.

[0074] Specifically, the computer device captures the main driver's facial image of the main driver object based on the in-vehicle image. When the main driver object is one of the registered objects bound to the vehicle, the main driver's facial image is identified through the identity recognition model to obtain the identity information of the main driver object, obtain the main driver device features associated with the identity information, and calculate the similarity between the target device features and the main driver device features. When the similarity falls within a preset similarity interval, it is determined that the target device is the device of the main driver object, and then the target object is the main driver object, and the target seat is the main driver's seat; when the similarity does not fall within the preset similarity interval, it cannot be determined whether the target device is a commonly used device of the main driver object.

[0075] When the main driver object is not one of the registered objects, the main driver's facial image is identified through the identity recognition model, but the identity information of the main driver object cannot be obtained, and further it is impossible to determine whether the target device is a common device of the main driver object.

[0076] The identity recognition model is a neural network model, which can be obtained by fine-tuning a classification model through multiple face images and annotated identity information of multiple face images.

[0077] In the above embodiment, the main driver is identified based on the in-vehicle image, and the main driver's device characteristics associated with the main driver's identity information are obtained. Based on the main driver's device characteristics and the target device characteristics, it is possible to quickly determine whether the target device is a commonly used device of the main driver, thereby improving the efficiency of determining the target object and the target seat.

[0078] In an optional manner, the in-vehicle image includes a first in-vehicle image when the charging area is in a standby mode and a second in-vehicle image when the charging area is in a working mode; determining the movement trajectory of the target device based on the in-vehicle image includes: inputting the first in-vehicle image and the second in-vehicle image into a trajectory recognition model to obtain the movement trajectory of the target device.

[0079] Among them, for the convenience of description, the moment when the charging area is switched from standby mode to working mode is called the mode switching moment; the first in-vehicle image is acquired before the mode switching moment, and the second in-vehicle image is acquired after the mode switching moment; the first in-vehicle image and the second in-vehicle image can be temporally continuous in-vehicle images.

[0080] Specifically, the first in-vehicle image and the second in-vehicle image are input into a trajectory recognition model, and the movement trajectory of the target device is output through the trajectory recognition model; the movement trajectory includes the positions of the target device in the first in-vehicle image and the second in-vehicle image respectively.

[0081] The trajectory recognition model is a neural network model that can be obtained by fine-tuning the image processing model according to multiple image sets and the annotated movement trajectories of devices in multiple image sets.

[0082] It should be noted that, since the first in-car image is an in-car image when the charging area is in standby mode, and the second in-car image is an in-car image when the charging area is in working mode, the first in-car image and the second in-car image record the process of the target object placing the target device in the charging area, and by performing trajectory recognition on the first in-car image and the second in-car image, the movement trajectory of the target device can be obtained.

[0083] In the above embodiment, the moving trajectory of the target device can be quickly and accurately obtained through the trajectory recognition model, thereby improving the efficiency and accuracy of the subsequent determination of the target seat where the target object is located.

[0084] In an optional manner, a target seat where a target object corresponding to a target device is located is determined based on a moving trajectory, including: obtaining a seat area corresponding to a starting point of the moving trajectory; and using a seat in the seat area as a target seat where the target object corresponding to the target device is located.

[0085] The moving trajectory includes the positions of the target device in the first in-vehicle image and the second in-vehicle image respectively; and each position included in the moving trajectory corresponds to an image acquisition moment of each in-vehicle image respectively.

[0086] Specifically, the computer device obtains the image acquisition moments corresponding to each position included in the movement trajectory, obtains the earliest moment in the image acquisition moments, and takes the position of the target device in the in-vehicle image corresponding to the earliest moment as the starting position; if the starting position is within a preset seat area, the seat corresponding to the seat area where the position is located is taken as the target seat where the target object is located.

[0087] The preset seat area may be a main driver's seat area, a passenger seat area, and a rear seat area. Therefore, the target seat where the target object performing the charging operation on the target device is located may be the main driver's seat where the main driver is located, the passenger seat where the passenger is located, or the rear seat where the rear seat is located.

[0088] In actual applications, when the target object is the main driver object and the target seat is the main driver seat, it is possible that the main driver object is not a registered object of the vehicle, and then in the previous step, it is impossible to determine whether the target device is a common device of the main driver object based on the characteristics of the target device; or the main driver object is a registered object of the vehicle, and the target device is an unregistered device of the main driver object, and then it is impossible to determine whether the target device is a common device of the main driver object based on the characteristics of the target device. In this way, it can be determined that the target object performing the charging operation on the target device is the main driver object and the target seat is the main driver seat based on the movement trajectory.

[0089] It should be noted that, when the starting position is not in the preset seat area, it may mean that the number of the second in-car images is insufficient, resulting in the second in-car image not recording the complete process of the target object placing the target device in the charging area; therefore, if the starting position is not in the preset seat area, the in-car image captured before the second in-car image is obtained, and the first in-car image, the second in-car image and the in-car image captured before the second in-car image are input into the trajectory recognition model to obtain the updated movement trajectory of the target device, and determine the target seat where the target object that performs the charging operation on the target device is located according to the updated movement trajectory.

[0090] In the above embodiment, the seat area corresponding to the starting point position of the moving trajectory is used as the target seat where the target object that performs the charging operation on the target device is located, that is, the target object is the object that performs the charging operation, and then the object that performs the charging operation can be reminded of forgotten charging, making the forgotten reminder more targeted and improving the timeliness and accuracy of the forgotten reminder.

[0091] In an optional manner, the target seat is the driver's seat or the front passenger seat; the target state information related to the target seat includes: the target occupancy information of the target seat; based on the target state information related to the target seat, the behavior state of the target object is determined, including: when the target occupancy information switches from occupied to idle, determining that the behavior state of the target object is a leaving vehicle state.

[0092] Among them, the target seat information is occupied, indicating that there is an object sitting on the seat, and the target seat information is free, indicating that there is no object sitting on the seat; the behavior state of the target object is the leaving vehicle state, indicating that the target object has got off the vehicle.

[0093] When the target seat is the driver's seat, the target object is the driver's seat; when the target seat is the passenger seat, the target object is the passenger's seat.

[0094] Specifically, when the target seat is the driver's seat or the passenger seat, it is difficult for the driver to change seats from the driver's seat to other seats, and it is also difficult for the passenger to change seats from the passenger seat to other seats. Therefore, when the target occupancy information is occupied, it indicates that the behavior state of the driver or the passenger is in a sitting state, and when the target occupancy information is idle, it indicates that the behavior state of the driver or the passenger is in a leaving state; when the target occupancy information of the driver's seat or the passenger seat switches from occupied to idle, it indicates that the behavior state of the driver or the passenger switches from a sitting state to a leaving state.

[0095] In the above embodiment, the target seat is the driver's seat or the passenger seat, and the behavior state of the driver or the passenger seat can be determined based on the target occupancy information of the driver's seat or the passenger seat. Since less information is used to determine the behavior state, the efficiency of determining the behavior state of the driver or the passenger seat is improved.

[0096] It should be noted that the behavior state of the target object is determined by obtaining target state information when the target seat switches from a standby mode to an operating mode in a charging area and according to changes in the target state information.

[0097] In an optional manner, the target seat is the driver's seat or the front passenger seat; the target state information related to the target seat includes: the target occupancy information of the target seat and the target switch state of the target door corresponding to the target seat; based on the target state information related to the target seat, the behavior state of the target object is determined, including: when the charging area switches from standby mode to working mode, the target occupancy information is occupied, and the target switch state is in the closed state, when it is detected that the target occupancy information switches from occupied to idle, and the target switch state switches from the closed state to the open state, the behavior state of the target object is determined to be the leaving vehicle state.

[0098] Determining the behavior state of the target object based on the target state information related to the target seat also includes: when the charging area switches from standby mode to working mode, the target occupancy information is occupied, and the target switch state is on, when it is detected that the target occupancy information switches from occupied to idle, determining that the behavior state of the target object is off-vehicle state.

[0099] Among them, when the target seat is the driver's seat, the target door corresponding to the target seat can be the front door on the driver's side; when the target seat is the passenger seat, the target door corresponding to the target seat can be the front door on the passenger side.

[0100] Specifically, when the target seat is the driver's seat, the computer device detects the target occupancy information of the driver's seat and detects the target switch state of the driver's side front door. When the charging area switches from standby mode to working mode, the target occupancy information is occupied, and the target switch state is in the closed state. When it is detected that the target occupancy information of the driver's seat switches from occupied to idle, and the target switch state of the driver's side front door switches from the closed state to the open state, it can be determined that the driver has got off the vehicle, that is, the target object's behavior state is the leaving vehicle state; when the charging area switches from standby mode to working mode, the target occupancy information is occupied, and the target switch state is in the open state, when it is detected that the target occupancy information of the driver's seat switches from occupied to idle, it can be determined that the driver has gotten off the vehicle, that is, the target object's behavior state is the leaving vehicle state.

[0101] When the target seat is the front passenger seat, the computer device detects the target occupancy information of the front passenger seat and the target switch state of the front passenger door. When the charging area switches from standby mode to working mode, the target occupancy information is occupied and the target switch state is in the closed state. When it is detected that the target occupancy information of the front passenger seat switches from occupied to idle and the target switch state of the front passenger door switches from the closed state to the open state, it can be determined that the front passenger object has got off the vehicle; when the charging area switches from standby mode to working mode, the target occupancy information is occupied and the target switch state is in the open state. When it is detected that the target occupancy information of the front passenger seat switches from occupied to idle, it can be determined that the behavior state of the front passenger object is the leaving vehicle state.

[0102] In the above optional method, the target occupancy information and the target switch state of the target door are combined to determine the behavior state of the target object, thereby improving the accuracy of determining the behavior state.

[0103] In an optional manner, the target seat is the driver's seat or the front passenger seat; the target state information related to the target seat includes: target seat occupancy information of the target seat, target switch state of the target door corresponding to the target seat, and target seat belt state corresponding to the target seat; based on the target state information related to the target seat, the behavior state of the target object is determined, including: when the charging area switches from standby mode to working mode, the target seat occupancy information is occupied, the target switch state is closed, and the target seat belt state is fastened; when the target seat occupancy information switches from occupied to idle, the target switch state switches from closed to open, and the target seat belt state switches from fastened to unfastened, the behavior state of the target object is determined to be a leaving vehicle state.

[0104] In an optional manner, the behavior state of the target object is determined based on target state information related to the target seat, and also includes: when the charging area switches from standby mode to working mode, the target occupancy information is occupied, the target switch state is on, and the target seat belt state is unfastened, when the target occupancy information switches from occupied to idle, the behavior state of the target object is determined to be leaving the vehicle.

[0105] Among them, when the target seat is the driver's seat, the target seat belt state corresponding to the target seat may be the state of the seat belt of the driver's seat, the fastened state indicates that the seat belt of the driver's seat has been fastened, and the unfastened state indicates that the seat belt of the driver's seat has not been fastened; when the target seat is the passenger seat, the target seat belt state corresponding to the target seat may be the state of the seat belt of the passenger seat, the fastened state indicates that the seat belt of the passenger seat has been fastened, and the unfastened state indicates that the seat belt of the passenger seat has not been fastened.

[0106] In the above optional method, the target occupancy information, the target switch state of the target door and the target seat belt state are combined to determine the behavior state of the target object, thereby improving the accuracy of determining the behavior state.

[0107] It should be noted that when the target seat is the driver's seat or the front passenger seat, the change in the target occupancy information is an important factor in judging the behavior state of the target object. The target switch state of the target door and the target seat belt state can be used as auxiliary factors to improve the accuracy of determining the behavior state. In some cases, the change in the vehicle gear position can also be added. For example, when the target occupancy information switches from occupied to idle, and the vehicle gear position switches from other gears to the parking gear (P gear), it can be determined that the behavior state of the target object is leaving the vehicle.

[0108] In an optional manner, the target seat is a rear seat; the target state information related to the target seat includes: target occupancy information of the target seat and the switch state of the target door corresponding to the target seat; based on the target state information related to the target seat, the behavior state of the target object is determined, including: when the switch state is switched from a closed state to an open state, the target occupancy information and reference occupancy information of other seats in the rear row are obtained; when it is detected that the target occupancy information switches from occupied to idle, and the reference occupancy information shows that the number of occupancy has not increased, the behavior state of the target object is determined to be a leaving vehicle state.

[0109] Among them, the rear seat can be one of multiple seats in the rear row; when the vehicle has front and rear doors, the target door corresponding to the rear seat can be the door adjacent to the rear seat, or any door in the rear row; when the vehicle includes two doors on the left and right sides of the vehicle, the target door corresponding to the rear seat can be any one of the two doors.

[0110] When the target seat is a rear seat, the target object is an occupant sitting in the rear seat.

[0111] The other seats in the back row are the seats in the multiple seats in the back row except the target seat; the reference occupancy information is the occupancy information of the other seats.

[0112] Specifically, the computer detects that the switch state of the target door switches from a closed state to an open state, and obtains the target occupancy information of the rear seats and the reference occupancy information of other seats. When the switch state of the target door is in an open state, when the target occupancy information switches from occupied to idle, and the reference occupancy information shows that the number of occupied seats has not increased, it can be determined that the occupant of the rear seat (target object) has got off the vehicle, and then the target object's behavior state is a leaving vehicle state.

[0113] The computer device detects that the switch state of the target door switches from the closed state to the open state. During the process of the switch state of the target door being in the open state, if the target placeholder information switches from occupied to idle, and the number of occupied seats in the reference placeholder information increases, it may indicate that the target object has changed the rear seat and did not get off the vehicle. Therefore, the behavior state of the target object is the riding state.

[0114] When the computer device detects that the switch state of the target door switches from the closed state to the open state, while the switch state of the target door is in the open state, if the target occupancy information is detected to be occupied, it means that the target object has not gotten off the vehicle, so the behavior state of the target object is the riding state.

[0115] Exemplarily, the rear seat is the rear right seat, and the other seat is the rear left seat. When the charging area switches from the standby mode to the working mode, the target occupancy information of the rear right seat is occupied, and the reference occupancy information of the rear left seat is free. When the computer device detects that the target switch state of the target door is switched from the closed state to the open state, the target occupancy information and the reference occupancy information are detected. There are the following situations:

[0116] (1) The target occupancy information is occupied, indicating that the target object's behavior state is in the riding state;

[0117] (2) The target placeholder information switches from occupied to free, and the reference placeholder information is free (the number of reference placeholder information occupied has not increased), indicating that the behavior state of the target object is the leaving vehicle state;

[0118] (3) The target seat information switches from occupied to free, and the reference seat information is occupied (the reference seat information is the number of occupied seats increases), indicating that the target object moves from the target seat to another seat, and the target object's behavior state is the sitting state.

[0119] In the above embodiment, when the target seat is a rear seat, there may be a situation where the target object changes seats in the rear seat. Because determining the behavior state of the target object is relatively complicated, the behavior state of the target object is determined in combination with the switch state of the target door, the target occupancy information of the rear seat and the reference occupancy information of other seats, thereby avoiding misjudgment of the behavior state of the target object. When the target seat is a rear seat, the accuracy of determining the behavior state of the target object is improved.

[0120] The present application also provides an application scenario of the charging forgotten reminder method. In this application scenario, the charging area in the vehicle is a wireless charging area, and the number of wireless charging areas is two, namely, a first wireless charging area and a second wireless charging area. The first wireless charging area is arranged on the central armrest box and is close to the side of the main driver's seat, and the second wireless charging area is arranged on the central armrest box and is close to the side of the co-driver's seat. Therefore, the first wireless charging area can also be called the main driver's wireless charging area, and the second wireless charging area can also be called the co-driver's wireless charging area.

[0121] The charging forgetting reminder method provided in this application can be executed for both the main driver's wireless charging area and the co-driver's wireless charging area; the example of detecting that the main driver's wireless charging area switches from standby mode to working mode is used for explanation; in this application scenario, the computer device may include the vehicle's body domain controller (Body Domain Controller, BDC) and central domain controller (Central Domain Controller, CDC).

[0122] like Figure 2 As shown, when the BDC detects that the main driver's wireless charging area switches from standby mode to working mode, it obtains a first in-car image (an in-car image when the main driver's wireless charging area is in standby mode) and a second in-car image (an in-car image when the main driver's wireless charging area is in working mode). Based on the first in-car image and the second in-car image, an artificial intelligence model (feature extraction model, identity recognition model and trajectory recognition model) is used to determine the target seat where the target object corresponding to the target device charging in the main driver's wireless charging area is located; the target seat can be the main driver's seat, the co-driver's seat or the back seat.

[0123] When the target seat is the passenger seat, in an optional manner, the BDC detects target state information related to the passenger seat when detecting that the vehicle gear position is P gear. The target state information may include target occupancy information of the passenger seat. Exemplarily, the BDC detects that the target occupancy information switches from occupied to idle, and it can be determined that the behavior state of the passenger object is leaving the vehicle.

[0124] In this optional method, the vehicle's power gear is on, the vehicle gear is in P gear, the driver's wireless charging area is in working mode, and the target occupancy information of the passenger seat is occupied, which can be regarded as a prerequisite for the forgotten reminder. The target occupancy information switches from occupied to idle, which can be regarded as a triggering condition for the forgotten reminder.

[0125] In an alternative approach, Figure 3 As shown, the power gear of the vehicle is the whole vehicle is powered on. When the BDC detects that the vehicle gear is in P gear, it detects the target state information related to the passenger seat. The target state information may include the target occupancy information of the passenger seat, the target switch state of the passenger side front door and the target seat belt state of the passenger seat. Exemplarily, when it is detected that the target occupancy information switches from occupied to idle, the target switch state switches from closed state to open state, and the target seat belt state switches from fastened to unfastened, it can be determined that the behavior state of the passenger object is the leaving vehicle state.

[0126] In this optional method, the vehicle's power gear is on, the vehicle gear is in P gear, the main driver's wireless charging area is in working mode, the target occupancy information of the passenger seat is occupied, the target seat belt status is fastened, and the target switch status is off, which can be regarded as a prerequisite for forgetting reminder; the target occupancy information switches from occupied to idle, the target switch status switches from off to on, and the target seat belt status switches from fastened to not fastened, which can be regarded as a triggering condition for forgetting reminder.

[0127] When it is determined that the target object's behavior state is the out-of-vehicle state, the BDC determines that the forgotten reminder conditions are met and sends a forgotten reminder instruction to the CDC. According to the forgotten reminder instruction, the CDC drives the central control display device to display the forgotten reminder graphics and texts, and drives the speakers in the car to play the forgotten reminder audio.

[0128] When the target seat is a rear seat, such as Figure 4 As shown, the power gear of the vehicle is the whole vehicle is powered on. When it is detected that the vehicle gear is in P gear, the target occupancy information of the rear seats, the target switch status of the rear doors, and the reference occupancy information of other seats are detected; exemplarily, when the BDC detects that the target occupancy information switches from occupied to idle, the target switch status switches from closed to open, and the occupied number in the reference occupancy information does not increase, it determines that the behavior state of the target object is the leaving vehicle state.

[0129] When it is determined that the target object's behavior state is the out-of-vehicle state, the BDC determines that the forgotten reminder conditions are met and sends a forgotten reminder instruction to the CDC. According to the forgotten reminder instruction, the CDC drives the central control display device to display the forgotten reminder graphics and texts, and drives the speakers in the car to play the forgotten reminder audio.

[0130] If the BDC determines that the target object's behavior state is a riding state, the BDC does not issue a forgetting reminder instruction to the CDC.

[0131] In the above-mentioned charging forgotten reminder method, when it is detected that the charging area is switched from standby mode to working mode, an in-vehicle image is obtained, and the target seat where the target object corresponding to the target device in the in-vehicle image is located is determined according to the target state information related to the target seat, and a forgotten reminder is issued when the behavior state meets the charging forgotten condition; that is, the target object corresponding to the target device and the behavior state of the target object are determined, and a forgotten reminder is issued when the target device is charging in the charging area and the target object corresponding to the target device is detected to leave the vehicle, rather than when the main driver leaves the vehicle and there is a device being charged in the charging area. The above-mentioned reminder that the target device is forgotten in the charging area is for the target object corresponding to the target device. Such a targeted reminder can issue a timely forgotten reminder when the target object leaves the vehicle and forgets the target device in the charging area, thereby improving the accuracy and reliability of the forgotten reminder.

[0132] Figure 5 FIG. 1 is a schematic diagram showing the structure of an embodiment of a charging forgetting reminder device of the present invention. Figure 5 As shown, the charging forgetting reminder device 500 includes: an acquisition module 510 , a first processing module 520 , a second processing module 530 and a reminder module 540 .

[0133] The acquisition module 510 is used to acquire the image inside the vehicle when detecting that the charging area switches from the standby mode to the working mode;

[0134] The first processing module 520 is used to determine the target seat where the target object corresponding to the target device is located based on the in-vehicle image; the target device is a device that is charged in the charging area;

[0135] The second processing module 530 determines the behavior state of the target object according to the target state information related to the target seat;

[0136] The reminder module 540 is used to issue a forgetting reminder when it is determined according to the behavior state that the charging forgetting condition is met.

[0137] In an optional manner, the first processing module 520 is also used to extract features of the target device based on the in-vehicle image to obtain target device features; when it is determined based on the target device features that the target device is a commonly used device of the main driver, the main driver's seat where the main driver is located is used as the target seat; when it is not possible to determine that the target device is a commonly used device of the main driver based on the target device features, the moving trajectory of the target device is determined based on the in-vehicle image, and the target seat where the target object corresponding to the target device is located is determined based on the moving trajectory.

[0138] In an optional manner, the first processing module 520 is also used to identify the main driver based on the in-vehicle image to obtain the main driver identity information; obtain the main driver device characteristics associated with the main driver identity information; determine the similarity between the main driver device characteristics and the target device characteristics; and when the similarity falls within a preset similarity interval, determine that the target device is a commonly used device of the main driver.

[0139] In an optional manner, the in-vehicle image includes a first in-vehicle image when the charging area is in standby mode and a second in-vehicle image when the charging area is in working mode; the first processing module 520 is also used to input the first in-vehicle image and the second in-vehicle image into a trajectory recognition model to obtain the movement trajectory of the target device.

[0140] In an optional manner, the first processing module 520 is further used to obtain a seat area corresponding to the starting point position of the moving trajectory; and use the seat in the seat area as the target seat where the target object corresponding to the target device is located.

[0141] In an optional manner, the target seat is the driver's seat or the passenger seat; the target state information related to the target seat includes: the target occupancy information of the target seat; the second processing module 530 is also used to determine that the behavior state of the target object is a leaving vehicle state when the target occupancy information switches from occupied to idle.

[0142] In an optional manner, the target seat is a rear seat; the target state information related to the target seat includes: the target occupancy information of the target seat and the switch state of the target door corresponding to the target seat; the second processing module 530 is also used to obtain the target occupancy information and reference occupancy information of other seats in the rear row when the switch state is switched from a closed state to an open state; when it is detected that the target occupancy information switches from occupied to idle, and the reference occupancy information shows that the number of occupancy has not increased, it is determined that the behavior state of the target object is a leaving vehicle state.

[0143] In an optional manner, the forgetting charging reminder device further includes: a forgetting reminder condition judgment module, which is used to determine whether the forgetting charging condition is satisfied when the behavior state switches from the riding state to the leaving-vehicle state.

[0144] In an optional manner, the reminder module 540 is further configured to issue a forgetting reminder by at least one of displaying a forgetting reminder graphic or playing a forgetting reminder audio.

[0145] In the above-mentioned charging forgotten reminder device, when it is detected that the charging area is switched from standby mode to working mode, an image inside the vehicle is obtained, and the target seat where the target object corresponding to the target device in the vehicle image is located is determined according to the target state information related to the target seat, and a forgotten reminder is issued when the behavior state meets the charging forgotten condition; that is, the target object corresponding to the target device and the behavior state of the target object are determined, and a forgotten reminder is issued when the target device is charging in the charging area and the target object corresponding to the target device is detected to leave the vehicle, rather than when the main driver leaves the vehicle and there is a device being charged in the charging area. The above-mentioned reminder that the target device is forgotten in the charging area is for the target object corresponding to the target device. Such a targeted reminder can issue a timely forgotten reminder when the target object leaves the vehicle and forgets the target device in the charging area, thereby improving the accuracy and reliability of the forgotten reminder.

[0146] Figure 6 The schematic diagram of the structure of the embodiment of the computer device of the present invention is shown. The specific embodiment of the present invention does not limit the specific implementation of the computer device.

[0147] like Figure 6 As shown, the computer device may include: a processor (processor) 602 , a communication interface (Communications Interface) 606 , a memory (memory) 606 , and a communication bus 608 .

[0148] The processor 602, the communication interface 606, and the memory 606 communicate with each other via the communication bus 608. The communication interface 606 is used to communicate with other devices such as a client or other server network elements. The processor 602 is used to execute the program 610, which can specifically execute the relevant steps in the above-mentioned embodiment of the charging forgetting reminder method.

[0149] Specifically, the program 610 may include program code including computer executable instructions.

[0150] The processor 602 may be a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention. The one or more processors included in the computer device may be processors of the same type, such as one or more CPUs; or processors of different types, such as one or more CPUs and one or more ASICs.

[0151] The memory 606 is used to store the program 610. The memory 606 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0152] The program 610 may be specifically called by the processor 602 to enable the computer device to perform the following operations:

[0153] When it is detected that the charging area switches from standby mode to working mode, an image inside the vehicle is acquired; based on the image inside the vehicle, a target seat where a target object corresponding to a target device is located is determined; the target device is a device that is charged in the charging area; based on target state information related to the target seat, a behavior state of the target object is determined; and when it is determined based on the behavior state that the charging forgetting condition is met, a forgetting reminder is issued.

[0154] In an optional manner, a target seat where a target object corresponding to a target device is located is determined based on an in-vehicle image, including: extracting features of the target device based on the in-vehicle image to obtain target device features; when it is determined based on the target device features that the target device is a commonly used device for the main driver object, using the main driver seat where the main driver object is located as the target seat; when it is not possible to determine based on the target device features that the target device is a commonly used device for the main driver object, determining a moving trajectory of the target device based on the in-vehicle image, and determining a target seat where the target object corresponding to the target device is located based on the moving trajectory.

[0155] In an optional manner, after extracting features of the target device based on the in-vehicle image and obtaining the target device features, the method further includes: identifying the main driver based on the in-vehicle image to obtain the main driver identity information; obtaining the main driver device features associated with the main driver identity information; determining the similarity between the main driver device features and the target device features; and determining that the target device is a commonly used device of the main driver when the similarity falls within a preset similarity interval.

[0156] In an optional manner, the in-vehicle image includes a first in-vehicle image when the charging area is in a standby mode and a second in-vehicle image when the charging area is in a working mode; determining the movement trajectory of the target device based on the in-vehicle image includes: inputting the first in-vehicle image and the second in-vehicle image into a trajectory recognition model to obtain the movement trajectory of the target device.

[0157] In an optional manner, determining a target seat where a target object corresponding to a target device is located based on a moving trajectory includes: obtaining a seat area corresponding to a starting point of the moving trajectory; and using a seat in the seat area as a target seat where the target object corresponding to the target device is located.

[0158] In an optional manner, the target seat is the driver's seat or the front passenger seat; the target state information related to the target seat includes: the target occupancy information of the target seat; based on the target state information related to the target seat, the behavior state of the target object is determined, including: when the target occupancy information switches from occupied to idle, determining that the behavior state of the target object is a leaving vehicle state.

[0159] In an optional manner, the target seat is a rear seat; the target state information related to the target seat includes: target occupancy information of the target seat and the switch state of the target door corresponding to the target seat; based on the target state information related to the target seat, the behavior state of the target object is determined, including: when the switch state is switched from a closed state to an open state, the target occupancy information and reference occupancy information of other seats in the rear row are obtained; when it is detected that the target occupancy information switches from occupied to idle, and the reference occupancy information shows that the number of occupancy has not increased, the behavior state of the target object is determined to be a leaving vehicle state.

[0160] In an optional manner, after determining the behavior state of the target object based on the target state information related to the target seat, it also includes: when the behavior state switches from the sitting state to the leaving-vehicle state, determining that the charging forgetting condition is met.

[0161] In an optional manner, issuing a forgetting reminder includes issuing the forgetting reminder by at least one of displaying a forgetting reminder graphic or text or playing a forgetting reminder audio.

[0162] An embodiment of the present invention provides a computer-readable storage medium storing at least one executable instruction. When the executable instruction is executed on a computer device or a forgotten charging reminder device, the computer device or the forgotten charging reminder device executes the forgotten charging reminder method in any of the above method embodiments.

[0163] The algorithms or displays provided herein are not inherently related to any particular computer, virtual system or other device. In addition, the embodiments of the present invention are not directed to any particular programming language.

[0164] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. Similarly, in order to simplify the present invention and help understand one or more of the various inventive aspects, in the above description of exemplary embodiments of the present invention, the various features of the embodiments of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. Wherein, the claims that follow the specific embodiment are hereby expressly incorporated into the specific embodiment, wherein each claim itself is a separate embodiment of the present invention.

[0165] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and further may be divided into a plurality of submodules or subunits or subcomponents. Except that at least some of such features and / or processes or units are mutually exclusive.

[0166] It should be noted that the above embodiments illustrate the present invention rather than limit it, and that those skilled in the art may design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets shall not be construed as a limitation on the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "one" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present invention may be implemented by means of hardware comprising a number of different elements and by means of a suitably programmed computer. In a unit claim that lists a number of devices, several of these devices may be embodied by the same hardware item. The use of the words first, second, and third, etc. does not indicate any order. These words may be interpreted as names. The steps in the above embodiments, unless otherwise specified, should not be understood as limitations on the order of execution.

Claims

1. A charging forgetting reminder method, characterized in that: The method comprises: When detecting that the charging area switches from the standby mode to the working mode, acquiring an image inside the vehicle; Based on the in-vehicle image, determining a target seat where a target object corresponding to a target device is located; the target device is a device being charged in the charging area; Determining the behavior state of the target object according to the target state information related to the target seat; When it is determined according to the behavior state that the charging forgetting condition is met, a forgetting reminder is issued.

2. The method according to claim 1, characterized in that The step of determining, based on the in-vehicle image, a target seat where a target object corresponding to a target device is located includes: Extracting features of the target device based on the in-vehicle image to obtain features of the target device; In a case where it is determined based on the target device feature that the target device is a common device of the main driver, taking the main driver's seat where the main driver is located as the target seat; When it is impossible to determine that the target device is a common device of the main driver based on the target device characteristics, the movement trajectory of the target device is determined based on the in-vehicle image, and the target seat where the target object corresponding to the target device is located is determined based on the movement trajectory.

3. The method according to claim 2, characterized in that After extracting the features of the target device based on the in-vehicle image to obtain the features of the target device, the method further includes: Based on the in-vehicle image, the main driver's identity is identified to obtain the main driver's identity information; Obtaining a driver device characteristic associated with the driver identity information; Determining a similarity between the host device characteristics and the target device characteristics; When the similarity belongs to a preset similarity interval, it is determined that the target device is a commonly used device of the main driver.

4. The method according to claim 2, characterized in that: The in-vehicle image includes a first in-vehicle image when the charging area is in a standby mode and a second in-vehicle image when the charging area is in a working mode; The determining the moving track of the target device based on the in-vehicle image includes: The first in-vehicle image and the second in-vehicle image are input into a trajectory recognition model to obtain a movement trajectory of the target device.

5. The method according to claim 2, characterized in that: The step of determining a target seat where a target object corresponding to a target device is located according to the movement trajectory includes: Obtaining a seat area corresponding to the starting point position of the moving trajectory; The seat in the seat area is used as the target seat where the target object corresponding to the target device is located.

6. The method according to any one of claims 1 to 5, characterized in that The target seat is a driver's seat or a co-driver's seat; The target state information related to the target seat includes: target seat occupancy information of the target seat; The step of determining the behavior state of the target object based on the target state information related to the target seat includes: When the target place-occupancy information switches from occupied to idle, it is determined that the behavior state of the target object is a leaving-vehicle state.

7. The method according to any one of claims 1 to 5, characterized in that The target seat is a rear seat; the target state information related to the target seat includes: target seat occupancy information of the target seat and the switch state of the target door corresponding to the target seat; The step of determining the behavior state of the target object based on the target state information related to the target seat includes: When the switch state is switched from the off state to the on state, the target seat occupancy information and reference seat occupancy information of other seats in the back row are acquired; When it is detected that the target placeholder information switches from occupied to idle, and the reference placeholder information shows that the number of occupied places has not increased, it is determined that the behavior state of the target object is a leaving vehicle state.

8. The method according to any one of claims 1 to 5, characterized in that After determining the behavior state of the target object according to the target state information related to the target seat, the method further includes: When the behavior state is switched from the riding state to the leaving-vehicle state, it is determined that the charging forgetting condition is satisfied.

9. A charging forgetting reminder device, characterized in that: The device comprises: An acquisition module, used for acquiring an image inside the vehicle when detecting that the charging area switches from a standby mode to an operating mode; A first processing module is used to determine, based on the in-vehicle image, a target seat where a target object corresponding to a target device is located; the target device is a device being charged in the charging area; A second processing module determines the behavior state of the target object according to the target state information related to the target seat; The reminder module is used to issue a forgetting reminder when it is determined according to the behavior state that the charging forgetting condition is met.

10. A computer device, characterized in that: include: A processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; The memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform the operation of the charging forgetting reminder method as described in any one of claims 1-8.

Images