A method and device for reminding of forgetting of a vehicle-mounted mobile phone

Abstract

The application provides a method for reminding forgetting of a vehicle-mounted mobile phone, and relates to the technical field of vehicles, which comprises the following steps: acquiring sensing information on a seat and door state information to determine whether a driver or passenger has left the vehicle; if it is determined that the driver or passenger has left the vehicle, an in-vehicle image acquisition module at a set position is used to acquire images of a specific area in the vehicle; an image recognition module with a pre-trained mobile phone image recognition model is used to process the acquired images to determine whether mobile phone image data exists in the acquired images; and if the mobile phone image data is identified, a reminding module is used to issue sound and / or light reminders. The technical scheme solves the technical problem of how to timely remind forgetting of a mobile phone in the vehicle in the prior art.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of vehicles, in particular to a method and device for reminding of forgetting mobile phone in vehicle. BACKGROUND

[0002] With the popularity of smart phones, people increasingly rely on mobile phones for daily life and work; however, in the process of driving or riding, people often forget their mobile phones in the car due to carelessness, which may cause unnecessary trouble and loss. In recent years, with the development of automobile intelligence, there have been some schemes for reminding of forgetting mobile phone in vehicle, which can solve the problem of leaving mobile phone in the car to some extent, such as combining with wireless charging device, detecting the working state of wireless charging device to judge whether the mobile phone is forgotten in the car, or using the existing Bluetooth module in the car to locate whether the mobile phone is in the car by receiving the Bluetooth signal of the mobile phone, etc. If forgotten, remind the driver and passenger through the voice or other alarm sound in the car. Such schemes often only focus on the mobile phone forgetting situation of the driver, ignoring the mobile phone of the co-driver and the rear seat, and all need certain preconditions: the mobile phone has wireless charging function or has connected Bluetooth, etc. Another scheme is to detect the intention of the passenger to get on the car, obtain the image in the car, determine the carried articles of the passenger according to the image, and give a warning when it is determined that the passenger has the intention to get off the car. Such scheme often has low accuracy in mobile phone detection, and easily infringes the privacy of users. SUMMARY

[0003] The purpose of the present application is to provide a method and device for reminding of forgetting mobile phone in vehicle, to solve the technical problem of how to remind in time when the mobile phone is forgotten in the car in the prior art. The preferred technical solutions in the many technical solutions provided by the present application can produce many technical effects, which are described in detail below.

[0004] To achieve the above-mentioned purpose, on the one hand, the present application provides a method for reminding of forgetting mobile phone in vehicle, comprising:

[0005] obtaining sensing information on the seat and door state information to determine whether the driver and passenger have left the car;

[0006] if it is determined that the driver and passenger have left the car, the image acquisition module at the set position is used to acquire images of the specific area in the car;

[0007] the image recognition module with pre-trained mobile phone image recognition model is used to process the acquired images to identify whether there is mobile phone image data in the acquired images;

[0008] if the mobile phone image data is identified, the reminding module is used to issue sound and / or light reminder.

[0009] Optionally, the obtaining of the sensor information on the seat and the door state information to determine whether the passenger has left the vehicle comprises:

[0010] After obtaining the vehicle parking information, the door state information and the sensing information on the seat are received;

[0011] When the sensing information on the seat shows that the person has left, and the door state information on the same side of the seat shows that the door has undergone a state change from closing to opening to closing, it is determined that the person on the seat has left the vehicle.

[0012] According to the sensing information on the seat, if the person on the seat is determined to have left the vehicle, it is determined that the passenger has left the vehicle.

[0013] Optionally, the pre-trained mobile phone image recognition model is trained by inputting a set number of mobile phone image data to enable the model to realize mobile phone image recognition, and the mobile phone image recognition model can optimize the mobile phone image recognition capability according to new input mobile phone image data.

[0014] Optionally, the image acquisition module is a high-definition camera, and the specific position in the vehicle includes a seat and an armrest box.

[0015] Optionally, the sound and / or light reminder includes a sound and / or light reminder outside the vehicle.

[0016] In another aspect, the present application provides a device for reminding a forgotten mobile phone in a vehicle, comprising:

[0017] A passenger leaving monitoring module is configured to obtain sensing information on a seat and door state information to determine whether a passenger has left the vehicle.

[0018] An image acquisition module is configured to acquire images of a specific area in the vehicle through an image acquisition module at a set position when it is determined that the passenger has left the vehicle.

[0019] An image recognition module has a pre-trained mobile phone image recognition model and is configured to process the acquired images to determine whether mobile phone image data exists in the acquired images.

[0020] A reminding module is configured to issue a sound and / or light reminder when mobile phone image data is identified.

[0021] Optionally, the passenger leaving monitoring module is specifically configured to:

[0022] After obtaining the vehicle parking information, the door state information and the sensing information on the seat are received;

[0023] When the sensor on the seat indicates that a person has left the vehicle, and the door status information on the same side as the seat shows that the door has changed from closed to open to closed, it is determined that the person in the seat has left the vehicle.

[0024] Based on the sensor information on the seats, if all seats occupied are identified as places where the occupants have left the vehicle, then it is determined that the driver and passengers have left the vehicle.

[0025] Optionally, the pre-trained mobile phone image recognition model is trained by inputting a set number of mobile phone image data to enable the model to recognize mobile phone images, and the mobile phone image recognition model can optimize the mobile phone image recognition capability based on newly input mobile phone image data.

[0026] Optionally, the image acquisition module is a high-definition camera, and the specific locations inside the vehicle include seats and armrest boxes.

[0027] Optionally, the sound and / or light alerts include sound and / or light alerts from outside the vehicle.

[0028] The technical solution of the present invention may include the following beneficial effects:

[0029] This invention provides a method and device for reminding passengers to leave their phones in a vehicle. Utilizing image recognition technology, it captures and identifies images of specific areas inside the vehicle only after the driver or passenger has left, determining whether a phone has been left behind. This focused image capture improves accuracy and avoids collecting sensitive information such as the driver's or passenger's face, protecting their privacy. Customizable external sound effects and lighting signals enhance the reminder effect, while personalized audio and visual settings increase the fun and playability of the smart car. Therefore, this technical solution solves the existing problem of how to promptly remind passengers when their phones are left in the vehicle. Attached Figure Description

[0030] The accompanying drawings, which form part of this specification, are used to provide a further understanding of the invention. The illustrative embodiments of the invention and their descriptions are used to explain the invention and do not constitute an undue limitation of the invention. In the drawings:

[0031] Figure 1 This is a flowchart illustrating a method for providing a forgotten mobile phone reminder in a vehicle, according to an embodiment of the present invention.

[0032] Figure 2 This is a schematic diagram of a vehicle-mounted mobile phone forgetting reminder device according to an embodiment of the present invention;

[0033] Figure 3 This is a schematic diagram of the in-vehicle layout of a device for reminding users to forget their mobile phones, according to an embodiment of the present invention.

[0034] Fig. 1, personnel off-vehicle monitoring module; 2, image acquisition module; 3, image recognition module; 4, reminding module; 5, first camera; 6, second camera; 7, center console; 8, armrest box; 9, vehicle body. DETAILED DESCRIPTION

[0035] The present application will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments. It should be noted that the embodiments in the present application and the features in the embodiments can be combined with each other without conflict.

[0036] The following detailed description is exemplary and is intended to provide further details of the present application. Unless otherwise defined, all technical and scientific terms used in the present application have the same meanings as generally understood by those skilled in the art to which the present application belongs. The terms used in the present application are only for the purpose of describing the specific embodiments and are not intended to limit the exemplary embodiments according to the present application.

[0037] As shown in Figure 1 The present application provides a method for reminding forgetting of mobile phone in vehicle, comprising:

[0038] S10, acquiring sensor information on the seat and vehicle door state information to determine whether the driver or passenger has left the vehicle;

[0039] S20, if it is determined that the driver or passenger has left the vehicle, the image acquisition module 2 at the set position is used to acquire images of the specific area in the vehicle;

[0040] S30, the image recognition module 3 with pre-trained mobile phone image recognition model is used to process the acquired images to identify whether there is mobile phone image data in the acquired images;

[0041] S40, if the mobile phone image data is identified, the reminding module 4 is used to issue sound and / or light reminders.

[0042] As an optional embodiment, the acquisition of sensor information on the seat and vehicle door state information to determine whether the driver or passenger has left the vehicle comprises: when the vehicle parking information is acquired, the vehicle door state information and the sensor information on the seat are received; when the sensor information on the seat shows that the person has left and the vehicle door state information on the same side of the seat shows that the vehicle door has a state change of closing-opening-closing, it is determined that the person on the seat has left the vehicle; according to the sensor information on the seat, if all the seats with people are determined to have left the vehicle, it is determined that the driver or passenger has left the vehicle.

[0043] Specifically, by installing an infrared sensor on the seat and comprehensively considering the state change of the door, it is determined whether the driver or passenger gets off the vehicle, the accuracy of the personnel off-vehicle determination is improved, and false positives are avoided; the specific implementation is as follows: after parking, the infrared sensor installed on the seat is turned on when receiving the door opening request signal, when the infrared sensor detects that the personnel leaves, and the state of the door on this side changes from closed to open and then to closed, it can be determined that the personnel gets off the vehicle, and more preferably, the seat belt state, the vehicle lock state, etc. are comprehensively considered for judgment. When detecting that the driver or passenger gets off the vehicle, the image acquisition module 2 is triggered to perform image acquisition.

[0044] As an optional implementation, the image acquisition module is a high-definition camera, and the specific position in the vehicle includes a seat and an armrest box 9.

[0045] Specifically, the image acquisition module 2 includes two high-definition cameras, a first camera 5 located below the front console 7 in the vehicle body 9 and a second camera 6 located behind the armrest box, as shown in the schematic Figure 3 The image acquisition module 2 is responsible for acquiring images of specific areas in the vehicle, such as seats, armrest boxes, and other areas where mobile phones may be placed. The module uses high-definition cameras, which are arranged and adjusted at reasonable angles to ensure comprehensive coverage of the target area. At the same time, in order to avoid infringing on user privacy, the camera will use privacy protection techniques such as blurring and shielding during shooting to ensure that user privacy is not leaked.

[0046] As an optional implementation, the pre-trained mobile phone image recognition model is trained by inputting a certain number of mobile phone image data to enable the model to achieve mobile phone image recognition, and the mobile phone image recognition model can optimize the mobile phone image recognition ability according to new input mobile phone image data.

[0047] Specifically, the image recognition module 3 uses a deep learning algorithm to process and analyze the collected images to identify the mobile phone and its position in the image. The pre-trained mobile phone image recognition model is trained on a large amount of mobile phone image data to enable the model to accurately identify mobile phones. At the same time, the module also has real-time updating capability and can continuously optimize the recognition effect according to new data.

[0048] As an optional implementation, the sound and / or light reminder includes an external sound and / or light reminder.

[0049] Specifically, the reminding module 4 mainly includes an audio device and a light language device outside the vehicle, while allowing the user to preset various sound effects and light language modes according to his own preferences and needs. When the system detects that the mobile phone is forgotten, the preset sound effect and light language outside the vehicle will be automatically triggered. This reminding method is different from the general alarm sound or voice broadcast in the vehicle, which can more easily attract the attention of the person, especially when the driver closes the door and is not easy to hear the reminder in the vehicle. By using the combination of sound effects and light language outside the vehicle, a multi-level and all-round reminding system can be formed to ensure that the user's mobile phone will not be forgotten; not only improves the accuracy and effectiveness of the reminder, but also brings a more rich and interesting experience to the user.

[0050] In another aspect, the present application provides a device for reminding a forgotten mobile phone in a vehicle, comprising:

[0051] A personnel off-vehicle monitoring module 1 is configured to obtain sensing information on the seat and door status information to determine whether the driver has left the vehicle;

[0052] An image acquisition module 2 is configured to acquire images of a specific area in the vehicle through the image acquisition module at a set position when it is determined that the driver has left the vehicle;

[0053] An image recognition module 3 has a pre-trained mobile phone image recognition model, which is configured to process the acquired images to identify whether there is mobile phone image data in the acquired images;

[0054] A reminding module 4 is configured to issue a sound and / or light reminder when mobile phone image data is identified.

[0055] As an optional implementation, the personnel off-vehicle monitoring module 1 is specifically configured to:

[0056] When the vehicle parking information is obtained, the door status information and the sensing information on the seat are received;

[0057] When the sensing information on the seat shows that the person has left, and the door status information on the same side of the seat shows that the door has a state change of closing-opening-closing, it is determined that the person on the seat has left the vehicle;

[0058] According to the sensing information on the seat, if all the seats with people are determined to have left the vehicle, it is determined that the driver has left the vehicle.

[0059] As an optional implementation, the pre-trained mobile phone image recognition model is trained by inputting a set number of mobile phone image data to enable the model to realize mobile phone image recognition, and the mobile phone image recognition model can optimize the mobile phone image recognition capability according to the newly input mobile phone image data.

[0060] As an optional implementation, the image acquisition module 2 is a high-definition camera, and the specific position in the vehicle includes a seat and an armrest box 8.

[0061] As an optional implementation, the sound and / or light reminder includes a sound and / or light reminder outside the vehicle.

[0062] The scheme adopts an image recognition technology, only after determining that a driver or a passenger gets off the vehicle, image acquisition is performed on specific areas in the vehicle, such as a seat, an armrest box and other common mobile phone placement positions, recognition is performed, and it is determined whether a mobile phone is left behind, a collection range is concentrated, the accuracy of recognition is improved, and sensitive information such as a face of the driver or the passenger is avoided to be collected, personal privacy of the driver or the passenger is protected, the purpose of reminding the driver or the passenger is achieved through customizable sound effects and light language outside the vehicle, the reminding effect is increased, and personalized setting increases the interestingness and playability of the intelligent vehicle.

[0063] It is to be understood by those skilled in the art that the present application can be implemented by other embodiments without departing from the spirit or essential characteristics thereof. Therefore, the above-mentioned disclosed embodiments are merely illustrative in all aspects, and are not the only ones. All changes within the scope of the present application or within the scope equivalent to the present application are included in the present application.

[0064] Those skilled in the art should understand that embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can adopt a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can adopt a computer program product implemented on one or more computer usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer usable program codes.

[0065] The present application is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and the combination of flows and / or blocks in the flowcharts and / or block diagrams can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing apparatus to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing apparatus produce a device that implements the functions specified in the flowcharts and / or block diagrams. Figure 1 The functions specified in one flow or multiple flows and / or blocks Figure 1 The functions specified in one flow or multiple flows and / or blocks

[0066] These computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture including instructions which implement the flow Figure 1 The functions of a flow or multiple flows and / or a block or multiple blocks in conjunction with the disclosed methods. Figure 1

[0067] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flow Figure 1 The functions of a flow or multiple flows and / or a block or multiple blocks in conjunction with the disclosed methods. Figure 1 The functions of a flow or multiple flows and / or a block or multiple blocks in conjunction with the disclosed methods.

[0068] Finally, it should be noted that the above-mentioned embodiments are merely used to illustrate the technical solutions of the present application, rather than limiting the same. Even though the present application has been described in detail with reference to the above-mentioned embodiments, those skilled in the art should understand that the specific embodiments of the present application can be modified or replaced equivalently, and any modification or replacement without departing from the spirit and scope of the present application should be covered within the protection scope of the claims of the present application.​

Claims

1. A method for providing a forgotten mobile phone reminder in a vehicle, characterized in that, The application comprises the following steps: Obtaining sensor information on the seat and door status information to determine whether the driver has left the vehicle; If it is determined that the driver has left the vehicle, the image collection module at a set position is used to collect images of a specific area in the vehicle; The image recognition module with a pre-trained mobile phone image recognition model is used to process the collected images to identify whether there is mobile phone image data in the collected images; If mobile phone image data is identified, the reminding module is used to issue a sound and / or light reminder; The sensor information on the seat and the door status information are obtained to determine whether the driver has left the vehicle, which comprises the following steps: After obtaining the vehicle parking information, the door status information and the sensor information on the seat are received; When the sensor information on the seat shows that the person has left, and the door status information on the same side of the seat shows that the door has undergone a state change from closed to open and then to closed, it is determined that the person on the seat has left the vehicle; According to the sensor information on the seat, if it is determined that the person on each seat has left the vehicle, it is determined that the driver has left the vehicle; The pre-trained mobile phone image recognition model is trained by inputting a set number of mobile phone image data to enable the model to realize mobile phone image recognition, and the mobile phone image recognition model can optimize the mobile phone image recognition capability according to newly input mobile phone image data.

2. The method for reminding of forgetting of the vehicle-mounted mobile phone according to claim 1, wherein The image collection module is a high-definition camera, and the specific position in the vehicle includes a seat and an armrest box.

3. The method of claim 1 or 2, wherein the method further comprises: The sound and / or light reminder includes a sound and / or light reminder outside the vehicle.

4. A device for reminding users to forget their mobile phones in a vehicle, characterized in that, The application comprises the following steps: A person leaving the vehicle monitoring module is used to obtain sensor information on the seat and door status information to determine whether the driver has left the vehicle; An image collection module is used to collect images of a specific area in the vehicle by using an image collection module at a set position in the vehicle when it is determined that the driver has left the vehicle; An image recognition module with a pre-trained mobile phone image recognition model is used to process the collected images to identify whether there is mobile phone image data in the collected images; A reminding module is used to issue a sound and / or light reminder when mobile phone image data is identified. The person leaving the vehicle monitoring module is specifically used for: After obtaining the vehicle parking information, the door status information and the sensor information on the seat are received; When the sensor information on the seat shows that the person has left, and the door status information on the same side of the seat shows that the door has undergone a state change from closed to open and then to closed, it is determined that the person on the seat has left the vehicle; According to the sensor information on the seat, if it is determined that the person on each seat has left the vehicle, it is determined that the driver has left the vehicle; The pre-trained mobile phone image recognition model is trained by inputting a set number of mobile phone image data to enable the model to realize mobile phone image recognition, and the mobile phone image recognition model can optimize the mobile phone image recognition capability according to newly input mobile phone image data.

5. The apparatus for reminding of forgotten mobile phone in vehicle according to claim 4, wherein, The image collection module is a high-definition camera, and the specific position in the vehicle includes a seat and an armrest box.

6. The apparatus for reminding of leaving behind a mobile phone in a vehicle according to any one of claims 4 to 5, characterized by, The sound and / or light reminder includes a sound and / or light reminder outside the vehicle.

Images