Method and device for searching handheld terminal inside vehicle

Abstract

The present invention relates to the field of vehicle energy, and more particularly to a method and device for finding a mobile phone inside a vehicle, wherein the method comprises: responding to a user's handheld terminal search instruction; pre-storing standard in-vehicle picture information; activating a flashlight of a handheld terminal to be found based on the handheld terminal search instruction, and then activating an image acquisition device to use real-time in-vehicle picture information when the handheld terminal's position is uncertain; comparing the standard in-vehicle picture information with the real-time in-vehicle picture information to determine an abnormal position on the two picture information, and determining the abnormal position as a search range for the handheld terminal to be found. The flashlight on the mobile phone is activated based on the search instruction, so that the picture taken at this time will be different from the standard in-vehicle picture information, and the difference is caused by a change in brightness. Therefore, the abnormal position is the location of the handheld terminal, thereby achieving rapid positioning of the handheld terminal.

Description

Technical Field

[0001] The present invention relates to the field of vehicle auxiliary equipment, and in particular to a method and device for finding a handheld terminal inside a vehicle. Background Art

[0002] While riding in a car, you may suddenly lose your phone, forget where you put it, or your phone may accidentally fall under a seat or in the gap between seats. Usually in this case, you will use another phone to call to find your phone, but considering that sometimes there is only one phone in the car, or the current phone is set to silent, the traditional method will not work.

[0003] Patent document CN101132196A discloses a method for finding a mobile phone. The technical solution adopted is to send a signal to a wireless receiving module built into the mobile phone through a wireless transmitting module independent of the mobile phone, start the mobile phone ringing, so that people can quickly find the mobile phone.

[0004] However, in the prior art, if the mobile phone is in a silent state, it increases the difficulty of finding the mobile phone, so the mobile phone finding method in the prior art has limitations. Summary of the Invention

[0005] To this end, the present invention provides a method and device for searching a handheld terminal inside a vehicle, which can solve the problem of limitations in the handheld terminal searching process in the prior art.

[0006] To achieve the above object, the present invention provides a method for finding a handheld terminal inside a vehicle, the method comprising:

[0007] responding to a search instruction from a user's handheld terminal;

[0008] Standard in-car picture information is pre-stored;

[0009] Based on the handheld terminal search instruction, the flash light of the handheld terminal to be found is activated and then the image acquisition device is activated to obtain real-time in-vehicle picture information when the position of the handheld terminal is uncertain;

[0010] The standard in-vehicle picture information and the real-time in-vehicle picture information are compared to determine abnormal positions on the two picture information, and the abnormal positions are determined as the search range of the handheld terminal to be found.

[0011] Furthermore, it also includes: starting the camera of the handheld terminal to be found based on the handheld terminal search instruction to collect images of the current location of the handheld terminal, and receiving and displaying the images to determine the location of the handheld terminal to be found based on the images.

[0012] Furthermore, it also includes:

[0013] The vibration mode or the ringing mode of the handheld terminal to be found is started based on the handheld terminal search instruction, so as to determine the position of the handheld terminal to be found according to whether the handheld terminal to be found is in the vibration state or the ringing state.

[0014] Further, after determining the location of the handheld terminal to be found, determining whether the seat needs to be moved and / or raised; if so, issuing a movement instruction and / or a raising instruction;

[0015] The seat is moved and / or raised according to the movement instruction and / or the raising instruction to take out the handheld terminal to be found.

[0016] Furthermore, the handheld terminal is a mobile phone or a tablet computer.

[0017] Furthermore, the comparing the standard in-vehicle picture information with the real-time in-vehicle picture information to determine abnormal locations on the two picture information includes:

[0018] The frame difference method in image processing is used to calculate the area with the largest pixel difference between the two photos. This area is determined to be the bright light area of ​​the handheld terminal's flash. The position of the handheld terminal in the car is determined by analyzing this area.

[0019] If the area is in the upper left corner of the screen, the handheld terminal is considered to be near the driver's seat;

[0020] If the area is in the upper right corner of the screen, it is considered that the handheld terminal is near the co-pilot seat;

[0021] If the area is in the lower left of the screen, the handheld terminal is considered to be near the left rear seat;

[0022] If the area is in the lower right corner of the screen, it is considered to be near the right rear seat.

[0023] On the other hand, the present invention further provides a device for searching for a handheld terminal inside a vehicle, applying the method for searching for a handheld terminal inside a vehicle as described above, the device comprising:

[0024] A response module, used to respond to a search instruction from a user's handheld terminal;

[0025] A storage module for pre-storing standard in-vehicle picture information;

[0026] A first starting module is used to start the flashlight of the handheld terminal to be found based on the handheld terminal search instruction and then start the image acquisition device to use real-time in-vehicle picture information when the handheld terminal position is uncertain;

[0027] The comparison module is used to compare the standard in-vehicle picture information with the real-time in-vehicle picture information to determine an abnormal position on the two picture information, and determine the abnormal position as the search range of the handheld terminal to be found.

[0028] Furthermore, it also includes: a second starting module and a receiving module;

[0029] The second starting module is used to start the camera of the handheld terminal to be found based on the handheld terminal search instruction to collect images at the current location of the handheld terminal;

[0030] The receiving module is connected to the second starting module, and is used to receive and display the captured image, so as to determine the position of the handheld terminal to be found according to the captured image.

[0031] Furthermore, it also includes: a third starting module and a determining module;

[0032] The third starting module is used to start the vibration mode or ringing mode of the handheld terminal to be found based on the handheld terminal search instruction;

[0033] The determining module is used to determine the location of the handheld terminal to be found according to whether the handheld terminal to be found is in a vibrating state or a ringing state.

[0034] Furthermore, it also includes an instruction sending module and an instruction execution module;

[0035] The instruction sending module is used to determine whether the seat needs to be moved and / or raised after determining the location of the handheld terminal to be found; if so, to issue a moving instruction and / or a raising instruction;

[0036] The execution module is connected to the instruction sending module, and is used to move and / or elevate the seat according to the movement instruction and / or elevation instruction to take out the handheld terminal to be found.

[0037] Compared with the prior art, the beneficial effect of the present invention is that the handheld terminal can be searched inside the vehicle through the built-in search function in the vehicle. After the search function is started, it can receive the user's search instruction and start the flash on the mobile phone based on the search instruction. Therefore, after the flash set on the finger terminal is started, the brightness around the terminal to be found will change. Therefore, the picture taken at this time will be different from the picture information inside the standard car, and the difference is caused by the change in brightness. Therefore, the location where the abnormality occurs is the location of the handheld terminal, thereby realizing rapid positioning of the handheld terminal.

[0038] In particular, by starting the camera of the handheld terminal after receiving the search instruction, an image is taken at the current location of the handheld terminal. In actual applications, the camera can be used alone to capture the surrounding environment to determine the location of the mobile phone. The above two search methods can also be combined to quickly locate the handheld terminal to be found, which greatly improves the search efficiency and accurately locates the position of the handheld terminal.

[0039] In particular, by using vibration and ringing to search for handheld terminals, users can determine the location information of the handheld terminal by listening to the ringing or vibration sound. Among the multiple search methods provided in the embodiments of the present invention, each method can be used alone, or any two positioning methods can be used in combination, or all three positioning methods can be used at the same time to achieve efficient positioning of the handheld terminal to be found, and quickly find the handheld terminal to be found.

[0040] In particular, after determining the location of the mobile phone, it is necessary to pick up the mobile phone. When it is determined that the seat needs to be moved or raised at the location of the mobile phone, a movement instruction or a raising instruction is sent so that the seat can perform an action consistent with the instruction according to the instruction, so as to quickly take out the mobile phone or tablet computer, thereby improving the rapid removal of the mobile phone or tablet computer.

[0041] In particular, by comparing the information in the two images, the location of the terminal to be found can be accurately determined, which greatly saves the search time and improves the accuracy of the positioning range. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 A schematic diagram of a flow chart of a method for finding a handheld terminal inside a vehicle provided by an embodiment of the present invention;

[0043] Figure 2 A schematic diagram of the structure of a device for finding a handheld terminal inside a vehicle provided by an embodiment of the present invention;

[0044] Figure 3 The present invention provides a practical application process diagram. DETAILED DESCRIPTION

[0045] In order to make the objects and advantages of the present invention more clearly understood, the present invention is further described below in conjunction with embodiments; it should be understood that the specific embodiments described herein are merely used to explain the present invention and are not intended to limit the present invention.

[0046] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the scope of protection of the present invention.

[0047] It should be noted that, in the description of the present invention, terms such as "up", "down", "left", "right", "inside", and "outside" indicating directions or positional relationships are based on the directions or positional relationships shown in the accompanying drawings. This is only for the convenience of description and does not indicate or imply that the device or element must have a specific orientation, be constructed and operated in a specific orientation. Therefore, it cannot be understood as a limitation on the present invention.

[0048] Furthermore, it should be noted that, in the description of the present invention, unless otherwise expressly specified or limited, the terms "mounted," "connected," and "connected" should be understood in a broad sense. For example, they may refer to fixed connections, detachable connections, or integral connections; mechanical connections or electrical connections; direct connections or indirect connections through an intermediate medium; and internal communication between two components. Those skilled in the art will understand the specific meanings of the above terms in the present invention based on specific circumstances.

[0049] See also Figure 1 As shown, the method for finding a handheld terminal inside a vehicle provided by an embodiment of the present invention includes:

[0050] Step S100: responding to a search instruction from a user's handheld terminal;

[0051] Step S200: pre-store standard in-car picture information;

[0052] Step S300: activating the flashlight of the handheld terminal to be found based on the handheld terminal search instruction and then activating the image acquisition device to obtain real-time in-vehicle image information when the handheld terminal position is uncertain;

[0053] Step S400: Compare the standard in-vehicle picture information and the real-time in-vehicle picture information to determine an abnormal position on the two pictures, and determine the abnormal position as the search range of the handheld terminal to be found.

[0054] Specifically, the embodiment of the present invention searches for the handheld terminal inside the vehicle. Through the built-in search function in the vehicle, after the search function is started, it can receive the user's search instruction and start the flash on the mobile phone based on the search instruction. Therefore, after the flash set on the finger terminal is started, the brightness around the terminal to be found will change. Therefore, the picture taken at this time will be different from the picture information inside the standard car, and the difference is caused by the change in brightness. Therefore, the location where the abnormality occurs is the location of the handheld terminal, thereby realizing rapid positioning of the handheld terminal.

[0055] Specifically, the method also includes: starting the camera of the handheld terminal to be found based on the handheld terminal search instruction to collect images of the current location of the handheld terminal, and receiving and displaying the images to determine the location of the handheld terminal to be found based on the images.

[0056] The embodiment of the present invention starts the camera of the handheld terminal after receiving the search instruction, and takes an image at the current location of the handheld terminal. In actual application, the camera can be used alone to capture the surrounding environment to determine the location of the mobile phone, and the above two search methods can be combined to quickly locate the handheld terminal to be found, which greatly improves the search efficiency and accurately locates the position of the handheld terminal.

[0057] Specifically, the method further includes: starting a vibration mode or a ringing mode of the handheld terminal to be found based on the handheld terminal search instruction, so as to determine the position of the handheld terminal to be found according to the handheld terminal to be found being in a vibration state or a ringing state.

[0058] The embodiment of the present invention uses vibration and ringing to search for handheld terminals. The user can determine the location information of the handheld terminal by listening to the ringing or vibration sound. Among the multiple search methods provided in the embodiment of the present invention, each method can be used alone, or any two positioning methods can be used in combination, or all three positioning methods can be used simultaneously to achieve efficient positioning of the handheld terminal to be found, so as to quickly find the handheld terminal to be found.

[0059] Specifically, after determining the location of the handheld terminal to be found, determining whether the seat needs to be moved and / or raised; if so, issuing a movement instruction and / or a raising instruction;

[0060] The seat is moved and / or raised according to the movement instruction and / or the raising instruction to take out the handheld terminal to be found.

[0061] Specifically, the handheld terminal is a mobile phone or a tablet computer.

[0062] Specifically, the embodiment of the present invention determines the location of the mobile phone and needs to pick up the mobile phone. When it is determined that the seat needs to be moved or raised at the location of the mobile phone, a movement instruction or a raising instruction is sent so that the seat can execute actions consistent with the instructions according to the instructions, so as to quickly take out the mobile phone or tablet computer, thereby improving the rapid removal of the mobile phone or tablet computer.

[0063] Specifically, comparing the standard in-vehicle image information with the real-time in-vehicle image information to determine the abnormal position on the two image information includes:

[0064] The frame difference method in image processing is used to calculate the area with the largest pixel difference between the two photos. This area is determined to be the bright light area of ​​the handheld terminal's flash. The position of the handheld terminal in the car is determined by analyzing this area.

[0065] If the area is in the upper left corner of the screen, the handheld terminal is considered to be near the driver's seat;

[0066] If the area is in the upper right corner of the screen, it is considered that the handheld terminal is near the co-pilot seat;

[0067] If the area is in the lower left of the screen, the handheld terminal is considered to be near the left rear seat;

[0068] If the area is in the lower right corner of the screen, it is considered to be near the right rear seat.

[0069] Specifically, the embodiment of the present invention accurately determines the location of the terminal to be found by comparing information in two images, greatly saving search time and improving the accuracy of the positioning range.

[0070] The embodiment of the present invention further provides a device for searching a handheld terminal inside a vehicle, and the method for searching a handheld terminal inside a vehicle as described above is applied, such as Figure 2 As shown, the device includes:

[0071] The response module 10 is used to respond to the search instruction of the user's handheld terminal;

[0072] The storage module 20 is used to pre-store standard in-vehicle picture information;

[0073] A first activation module 30 is configured to activate a flashlight of the handheld terminal to be found based on the handheld terminal search instruction and then activate an image acquisition device to obtain real-time in-vehicle image information when the handheld terminal position is uncertain;

[0074] The comparison module 40 is used to compare the standard in-vehicle picture information with the real-time in-vehicle picture information to determine an abnormal position on the two pictures, and determine the abnormal position as the search range of the handheld terminal to be found.

[0075] Specifically, the device further includes: a second starting module and a receiving module;

[0076] The second starting module is used to start the camera of the handheld terminal to be found based on the handheld terminal search instruction to collect images at the current location of the handheld terminal;

[0077] The receiving module is connected to the second starting module, and is used to receive and display the captured image, so as to determine the position of the handheld terminal to be found according to the captured image.

[0078] Specifically, the device further includes: a third starting module and a determining module;

[0079] The third starting module is used to start the vibration mode or ringing mode of the handheld terminal to be found based on the handheld terminal search instruction;

[0080] The determining module is used to determine the location of the handheld terminal to be found according to whether the handheld terminal to be found is in a vibrating state or a ringing state.

[0081] Specifically, the device also includes an instruction sending module and an instruction execution module;

[0082] The instruction sending module is used to determine whether the seat needs to be moved and / or raised after determining the location of the handheld terminal to be found; if so, to issue a moving instruction and / or a raising instruction;

[0083] The execution module is connected to the instruction sending module, and is used to move and / or elevate the seat according to the movement instruction and / or elevation instruction to take out the handheld terminal to be found.

[0084] The device for searching for a handheld terminal inside a vehicle provided by the embodiment of the present invention can execute the method for searching for a handheld terminal inside a vehicle and has the same technical effect, which will not be described in detail here.

[0085] like Figure 3 As shown, the embodiment of the present invention is further described in conjunction with specific application scenarios.

[0086] In actual application, first of all, make sure that the mobile phone and the car computer are connected via Bluetooth, WiFi, or hotspot;

[0087] A surveillance camera is installed in the car. The camera is mainly used to capture the interior of the car. It can be installed at the sunroof switch position or at the center rear view position in the car (the sunroof switch position is used as an example below);

[0088] After the vehicle is powered on, the mobile phone search module is in standby mode. At this time, the in-vehicle surveillance camera takes a photo of the vehicle in normal condition (Photo 1).

[0089] While the vehicle is in motion, the driver or passenger finds that their mobile phone is lost, and the phone is muted or in arrears, and they cannot locate the phone by calling other phones;

[0090] At this time, open the mobile phone search module on the car computer (it can be an APP, or a button, etc.);

[0091] You can choose how to find your phone, such as making it ring or vibrate; turning on the flashlight and flashing it; turning on the camera and taking a photo;

[0092] If method 1 is selected, the user determines the approximate location of the phone based on the ringing and vibration sounds of the phone;

[0093] If you choose method 2, the photo taken by the mobile phone will be transmitted back to the car computer for display, and the owner or passengers can judge the possible location of the phone based on the photo;

[0094] If method 3 is selected, the phone's flashlight is turned on through the car computer. After that, the car's camera is used to take a picture of the current interior of the car (Photo 2). The normal photo (Photo 1) and the photo taken when searching for the phone (Photo 2) are transmitted to the phone search module. The phone search module uses image processing (such as frame difference method) to calculate the area with large pixel difference between the two photos. This area is determined to be a bright light area such as the phone flash. The approximate position of the phone in the car can be analyzed based on this area. If the area is in the upper left of the picture, the phone is considered to be near the driver's seat; if the area is in the upper right of the picture, the phone is considered to be near the passenger seat; if the area is in the lower left of the picture, the phone is considered to be near the left rear seat; if the area is in the lower right of the picture, the phone is considered to be near the right rear seat, etc. The phone search module will display the judgment result on the car computer, making it easier for the car owner to find the phone more quickly and conveniently.

[0095] The phone search module provides a one-touch seat raising and lowering function. If a phone falls under a seat, the module can send a CAN command to the seat controller to automatically raise or move the seat, making it easier to retrieve the phone.

[0096] Find the phone and end the process.

[0097] The embodiments of the present invention can assist in finding the location of a mobile phone through multiple channels such as vision and hearing, which is more intuitive and convenient, shortens the time of finding the mobile phone, provides convenience for car owners and passengers, and optimizes the riding experience.

[0098] In this embodiment of the present invention, a message is sent to a mobile phone via the vehicle computer via Bluetooth, WiFi, or a hotspot. Upon receiving the message, the mobile phone responds accordingly (e.g., emitting a sound, activating vibration, flashing the flashlight, or taking a photo). The photo captured by the mobile phone is then transmitted back to the vehicle computer for display, making it easier for the vehicle owner or passenger to determine the possible location of the mobile phone. After the vehicle is powered on, the mobile phone search module enters standby mode. The vehicle's internal camera captures a photo of the vehicle in a normal state (Photo 1). Upon entering the mobile phone search module, the vehicle computer activates the mobile phone's flashlight. After this, the internal camera captures the current vehicle interior (Photo 2). The normal state photo (Photo 1) and the photo captured during the search (Photo 2) are transmitted to the mobile phone search module. The mobile phone search module uses image processing (e.g., frame difference method) to calculate areas with significant pixel differences between the two photos. These areas are identified as bright light areas, such as the mobile phone flash. This area can be used to determine the approximate location of the mobile phone in the vehicle, such as the driver's seat, passenger seat, left rear, or right rear. The result is displayed on the vehicle computer, making it easier for the vehicle owner to find the mobile phone more quickly and conveniently.

[0099] Thus far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it will be readily understood by those skilled in the art that the scope of protection of the present invention is obviously not limited to these specific embodiments. Without departing from the principles of the present invention, those skilled in the art may make equivalent changes or substitutions to the relevant technical features, and the technical solutions after such changes or substitutions will fall within the scope of protection of the present invention.

[0100] The foregoing description is merely a preferred embodiment of the present invention and is not intended to limit the present invention. Those skilled in the art will readily appreciate that the present invention is susceptible to various modifications and variations. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of the present invention are intended to be within the scope of protection of the present invention.

Claims

1. A method for finding a handheld terminal inside a vehicle, characterized in that: include: responding to a search instruction from a user's handheld terminal; Standard in-car picture information is pre-stored; Based on the handheld terminal search instruction, the flash light of the handheld terminal to be found is activated and then the image acquisition device is activated to obtain real-time in-vehicle picture information when the position of the handheld terminal is uncertain; Comparing the standard in-vehicle picture information with the real-time in-vehicle picture information to determine an abnormal position on the two picture information, and determining the abnormal position as the search range of the handheld terminal to be found; Comparing the standard in-vehicle image information with the real-time in-vehicle image information to determine the abnormal position on the two image information includes: The frame difference method in image processing is used to calculate the area with the largest pixel difference between the two photos. This area is determined to be the bright light area of ​​the handheld terminal's flash. The position of the handheld terminal in the car is determined by analyzing this area. If the area is in the upper left corner of the screen, the handheld terminal is considered to be near the driver's seat; If the area is in the upper right corner of the screen, it is considered that the handheld terminal is near the co-pilot seat; If the area is in the lower left of the screen, the handheld terminal is considered to be near the left rear seat; If the area is in the lower right corner of the screen, it is considered to be near the right rear seat.

2. The method for finding a handheld terminal inside a vehicle according to claim 1, characterized in that: Also includes: The camera of the handheld terminal to be found is activated based on the handheld terminal search instruction to collect a captured image at the current location of the handheld terminal, and the captured image is received and displayed to determine the location of the handheld terminal to be found based on the captured image.

3. The method for finding a handheld terminal inside a vehicle according to claim 2, characterized in that: Also includes: The vibration mode or the ringing mode of the handheld terminal to be found is started based on the handheld terminal search instruction, so as to determine the position of the handheld terminal to be found according to whether the handheld terminal to be found is in the vibration state or the ringing state.

4. The method for finding a handheld terminal inside a vehicle according to any one of claims 1 to 3, characterized in that: After determining the location of the handheld terminal to be found, determining whether the seat needs to be moved and / or raised; if so, issuing a movement instruction and / or a raising instruction; The seat is moved and / or raised according to the movement instruction and / or the raising instruction to take out the handheld terminal to be found.

5. The method for finding a handheld terminal inside a vehicle according to claim 4, characterized in that: The handheld terminal is a mobile phone or a tablet computer.

6. A device for searching a handheld terminal inside a vehicle, applying the method for searching a handheld terminal inside a vehicle according to any one of claims 1 to 5, characterized in that: include: A response module, used to respond to a search instruction from a user's handheld terminal; A storage module for pre-storing standard in-vehicle picture information; A first starting module is used to start the flashlight of the handheld terminal to be found based on the handheld terminal search instruction and then start the image acquisition device to use real-time in-vehicle picture information when the handheld terminal position is uncertain; The comparison module is used to compare the standard in-vehicle picture information with the real-time in-vehicle picture information to determine an abnormal position on the two picture information, and determine the abnormal position as the search range of the handheld terminal to be found.

7. The device for finding a handheld terminal inside a vehicle according to claim 6, characterized in that: Also includes: A second starting module and a receiving module; The second starting module is used to start the camera of the handheld terminal to be found based on the handheld terminal search instruction to collect images at the current location of the handheld terminal; The receiving module is connected to the second starting module, and is used to receive and display the captured image, so as to determine the position of the handheld terminal to be found according to the captured image.

8. The device for finding a handheld terminal inside a vehicle according to claim 7, characterized in that: Also includes: A third starting module and a determining module; The third starting module is used to start the vibration mode or ringing mode of the handheld terminal to be found based on the handheld terminal search instruction; The determining module is used to determine the location of the handheld terminal to be found according to whether the handheld terminal to be found is in a vibrating state or a ringing state.

9. The device for finding a handheld terminal inside a vehicle according to claim 7, characterized in that: It also includes an instruction sending module and an instruction execution module; The instruction sending module is used to determine whether the seat needs to be moved and / or raised after determining the location of the handheld terminal to be found; if so, to issue a moving instruction and / or a raising instruction; The execution module is connected to the instruction sending module, and is used to move and / or elevate the seat according to the movement instruction and / or elevation instruction to take out the handheld terminal to be found.

Images