Riding reminding method and system based on visual tracking

Abstract

The present invention provides a riding reminding method based on visual tracking, comprising: on the basis of target station information and positioning information uploaded by a passenger by means of a mobile terminal, matching a target vehicle corresponding to a target station; determining, on the basis of the positioning information, that the passenger is at a first position, and then tracking a movement trajectory of the passenger by means of a visual component, so as to determine a second position of the passenger; and on the basis of the comparison between vehicle positioning information and the target station information, when a getting-off reminding requirement is met, reminding, on the basis of a target reminding strategy, the passenger to get off.

Description

A vehicle-riding reminding method and system based on visual tracking TECHNICAL FIELD

[0001] The present application relates to the field of vehicle software technology, and in particular to a vehicle-riding reminding method and system based on visual tracking. BACKGROUND

[0002] During a long time of riding a bus, a passenger is easy to fall asleep. Some passengers also wear earphones to isolate noise, so that the passengers are reminded in the form of broadcast when reaching a station. However, the reminding sound is not loud enough, so that some passengers who are asleep and passengers who wear earphones may miss the broadcast and miss the station. TECHNICAL PROBLEM

[0003] Technical problem: long time of riding a bus, a passenger is easy to miss the station. TECHNICAL SOLUTION

[0004] The present application aims to provide a vehicle-riding reminding method and system based on visual tracking to solve the above problems.

[0005] In order to achieve the above purpose, the technical scheme adopted by the present application is:

[0006] A vehicle-riding reminding method based on visual tracking, comprising:

[0007] Matching a target vehicle corresponding to a target station based on target station information and positioning information uploaded by a passenger based on a mobile terminal;

[0008] After determining that the passenger is at a first position based on the positioning information, tracking the motion trajectory of the passenger by a visual component to determine a second position of the passenger;

[0009] Based on the comparison of the vehicle positioning information and the target station information, when the passenger-riding reminding requirement is met, the passenger is reminded to get off the vehicle based on a target reminding strategy.

[0010] Further, when the distance between the positioning information and the target vehicle position information is less than a first preset value, it is determined that the passenger is at the first position, and the first position indicates that the passenger enters the target vehicle.

[0011] Further, when the passenger uploads the target station information, a passenger face image is obtained, and the face image is used to match the motion trajectory of the passenger in the vehicle compartment.

[0012] Further, the visual component is used to scan the passenger face image information in the vehicle compartment in real time, and when the face image of the passenger is at a fixed position, the second position of the passenger is determined, and the second position indicates the position of the passenger in the vehicle compartment.

[0013] Further, the second position is one of standing at a handrail position or sitting on a seat.

[0014] Further, the method further comprises:

[0015] Based on the face image of the passenger and the target vehicle, a corresponding relationship between the two is established to be stored in the control module of the target vehicle.

[0016] After the passenger is reminded to get off, the corresponding relationship and the passenger information are deleted from the control module.

[0017] Further, when the distance between the vehicle positioning information and the target station information is less than a second preset value, the passenger is reminded to get off.

[0018] Further, after the passenger is reminded to get off, the passenger is reminded to get off in a first reminding manner, and the passenger is reminded to get off in a second reminding manner according to the second position of the passenger.

[0019] Further, when the passenger stands at a handrail position in the car, the passenger is reminded to get off by vibrating the corresponding handrail; when the passenger sits on a seat in the car, the passenger is reminded to get off by vibrating the corresponding seat.

[0020] The application also provides a passenger reminding system based on visual tracking, comprising:

[0021] An intelligent passenger module is configured to match the target vehicle corresponding to the target station according to the target station information and the positioning information uploaded by the passenger based on the mobile terminal, and determine that the passenger is in a first position; and after the passenger is reminded to get off, a target reminding strategy is generated, and the passenger is reminded to get off in a first reminding manner.

[0022] A vehicle positioning module is configured to obtain the positioning information of the vehicle in real time.

[0023] A vehicle visual module is configured to scan the face image of the passenger in real time, and determine the second position of the passenger when the face image is in a fixed position.

[0024] A vibration prompting module is configured to remind the passenger to get off by vibrating the handrail or the seat based on the preset target reminding strategy. Advantages

[0025] Compared with the prior art, the application at least has the following advantages:

[0026] (1) Through the target station information and positioning information uploaded by the passenger, the corresponding vehicle is matched for the passenger, and at the same time, the passenger is reminded to get off according to the real-time positioning information of the vehicle when the reminding requirement is met, so as to ensure that each passenger accurately gets off at the station, so that the passenger can rest at ease and does not need to worry about over-station.

[0027] (2) The position of the passenger in the vehicle compartment is obtained in real time through the visual component, and the corresponding reminding strategy is generated according to the real-time position of the passenger, so as to realize the individualized reminding of each passenger to get off, and ensure that the passenger accurately gets off;

[0028] (3) The getting-off reminding mode provided by the present application can replace the manual reminding mode, so as to reduce the manual workload, and also improve the accuracy and efficiency of the station reminding. BRIEF DESCRIPTION OF DRAWINGS

[0029] In order to more clearly illustrate the technical solutions in the specific embodiments or prior art of the present application, the drawings needed to be used in the specific embodiments or prior art description will be briefly introduced as follows. Obviously, the drawings in the following description are some embodiments of the present application, and other drawings can also be obtained by those skilled in the art without creative labor on the basis of these drawings.

[0030] Fig. 1 is a step flow chart of the vehicle reminding method in the embodiment provided by the present application;

[0031] Fig. 2 is a framework diagram of the vehicle reminding system in the embodiment provided by the present application. Embodiments of the present application

[0032] It should be noted that in the present application, the description such as "first", "second", "one" and the like is only for the purpose of description, and cannot be understood as indicating or implying the relative importance of the indicated technical features or implicitly indicating the number of the indicated technical features. Therefore, the features limited by "first" and "second" can be explicitly or implicitly included at least one of the features. In the description of the present application, the meaning of "a plurality of" is at least two, such as two, three, etc., unless otherwise specifically limited.

[0033] In addition, the technical solutions of each embodiment of the present application can be combined with each other, but it must be based on the fact that a person skilled in the art can realize it, and when the combination of technical solutions appears contradictory or unachievable, it should be considered that the combination of technical solutions does not exist, nor is it within the scope of protection required by the present application.

[0034] The following are specific embodiments of the present application, and the technical solutions of the present application will be further described in conjunction with the drawings, but the present application is not limited to these embodiments.

[0035] As shown in FIG. 1, the embodiment provides a visual tracking-based ride reminding method, comprising the steps of:

[0036] S1, matching a target vehicle corresponding to a target station according to target station information and positioning information uploaded by a passenger based on a mobile terminal;

[0037] S2, after determining that the passenger is at a first position based on the positioning information, tracking a motion trajectory of the passenger by a visual component to determine a second position of the passenger;

[0038] S3, based on a comparison between vehicle positioning information and the target station information, when a passenger drop-off reminding requirement is met, reminding the passenger to get off based on a preset target reminding strategy.

[0039] When a passenger wants to use the drop-off reminding service, the first step is to upload target station information, a passenger's facial image, and the passenger's current positioning information on a mobile terminal such as a mobile phone through an APP or a mini program.

[0040] The uploaded information is matched with a corresponding vehicle by a system platform, and after a matching relationship is established between the vehicle and the passenger, the real-time positioning information of the vehicle and the positioning information of the passenger are compared. When the distance between the positioning information and the target vehicle position information is less than a first preset value, it is determined that the passenger is at a first position, and the first position indicates that the passenger has entered the target vehicle.

[0041] After determining that the passenger has entered the vehicle, the next step is to determine the passenger's position in the car compartment in order to generate a corresponding reminding strategy.

[0042] The facial image uploaded by the passenger is used to match the passenger's motion trajectory in the car compartment. The vehicle scans the passenger's facial image information in the car compartment in real time through a visual component, and when the passenger's facial image is at a fixed position, the second position of the passenger is determined, which indicates the passenger's position in the car compartment. The second position is one of standing at a certain handrail position or sitting on a certain seat.

[0043] After determining the specific position where the passenger stands or sits, the control module of the vehicle generates a corresponding target reminding strategy. In the target reminding strategy, different strategies are formed according to the position of the passenger in the car compartment.

[0044] When the passenger stands at a certain handrail position in the car compartment, the passenger is reminded to get off by vibrating the corresponding handrail; when the passenger sits on a certain seat in the car compartment, the passenger is reminded to get off by vibrating the corresponding seat.

[0045] Then based on the target reminding strategy, the vehicle compares the vehicle positioning information with the position distance of the target station in real time when the vehicle is running. When the distance between the vehicle positioning information and the position of the target station is less than a second preset value, the passenger drop-off reminding requirement is met, so as to remind the passenger to get off the vehicle.

[0046] After the passenger drop-off reminding requirement is met, the passenger is reminded to get off the vehicle in a first reminding manner. The first reminding manner is that the system platform sends a corresponding reminding short message or notification to the mobile terminal of the passenger to remind the passenger to get off the vehicle.

[0047] In addition, after the passenger is reminded to get off the vehicle, the corresponding relationship and the passenger information are deleted from the control module of the vehicle.

[0048] In the ride reminding method provided by the embodiment, the target station information and the positioning information uploaded by the passenger are used to match the corresponding vehicle for the passenger, and the passenger is reminded to get off the vehicle according to the real-time positioning information of the vehicle when the reminding requirement is met.

[0049] At the same time, the position of the passenger in the vehicle compartment is obtained in real time through the visual component, and a corresponding reminding strategy is generated according to the real-time position of the passenger, so as to realize individualized drop-off reminding for each passenger. When the passenger changes seats in the vehicle compartment, the passenger can also be reminded to get off the vehicle, so as to ensure that each passenger can accurately get off at the station, so that the passenger can rest comfortably without worrying about over-station.

[0050] The embodiment also provides a ride reminding system based on visual tracking, which comprises:

[0051] The intelligent ride module is configured to match the target vehicle corresponding to the target station according to the target station information and the positioning information uploaded by the passenger based on the mobile terminal, and determine that the passenger is at a first position; and after the passenger drop-off reminding requirement is met, a target reminding strategy is generated, and the passenger is reminded to get off the vehicle in a first reminding manner.

[0052] The vehicle positioning module is configured to obtain the positioning information of the vehicle in real time.

[0053] The vehicle visual module is configured to scan the face image of the passenger in real time, and determine the second position of the passenger when the face image is at a fixed position.

[0054] The vibration prompting module is configured to remind the passenger to get off the vehicle by vibrating the handrail or the seat based on the preset target reminding strategy.

[0055] The intelligent riding module matches the corresponding vehicle for the passenger according to the target station information and the positioning information uploaded by the passenger, and at the same time, the passenger is reminded to get off the vehicle according to the real-time positioning information of the vehicle when the reminding requirement is met, so as to ensure that each passenger accurately gets off at the station, so that the passenger can rest at ease and does not need to worry about over-station. At the same time, with the help of the vehicle vision module, the position of the passenger in the vehicle compartment is obtained in real time, and the corresponding reminding strategy is generated according to the real-time position of the passenger, so as to realize the individualized reminding of each passenger to get off the vehicle.

[0056] The specific embodiments described herein are merely illustrative of the spirit of the present application. Those skilled in the art of the present application can make various modifications or supplements to the described specific embodiments or replace them with similar ways, but will not deviate from the spirit of the present application or exceed the scope defined by the appended claims.

Claims

1. A method of a boarding reminder based on visual tracking, characterized by, The method comprises: matching a target vehicle corresponding to a target station according to target station information and positioning information uploaded by a passenger based on a mobile terminal; tracking a motion trajectory of the passenger by a visual component after determining that the passenger is at a first position based on the positioning information, to determine a second position of the passenger; comparing vehicle positioning information with the target station information, and reminding the passenger to get off the vehicle based on a target reminding strategy when a passenger reminder requirement is met.

2. The method of claim 1, wherein, The passenger is determined to be at the first position when the distance between the positioning information and the target vehicle position information is less than a first preset value, and the first position indicates that the passenger has entered the target vehicle. 3.The method of claim 1, wherein, A passenger face image is obtained when the passenger uploads the target station information, and the face image is used to match the motion trajectory of the passenger in the vehicle cabin. 4.The method of claim 3, wherein, The passenger face image information in the vehicle cabin is scanned in real time by a visual component, and the second position of the passenger is determined when the face image of the corresponding passenger is at a fixed position, and the second position indicates the position of the passenger in the vehicle cabin. 5.The method of claim 4, wherein, The second position is one of standing at a certain handrail position or sitting on a certain seat. 6.The method of claim 1, wherein, The method further comprises: establishing a corresponding relationship between the passenger face image and the target vehicle based on the passenger face image and the target vehicle, and storing the corresponding relationship in a control module of the target vehicle; after the passenger is reminded to get off the vehicle, the corresponding relationship and the passenger information are deleted from the control module. 7.The method of claim 1, wherein, The passenger reminder requirement is met when the distance between the vehicle positioning information and the target station information is less than a second preset value. 8.The method of claim 1, wherein, After the passenger reminder requirement is met, the passenger is reminded to get off the vehicle in a first reminding manner, and the passenger is reminded to get off the vehicle in a second reminding manner according to the second position of the passenger. 9.The method of claim 8, wherein, When the passenger stands at a certain handrail position in the vehicle cabin, the passenger is reminded to get off the vehicle by vibrating the corresponding handrail; when the passenger sits on a certain seat in the vehicle cabin, the passenger is reminded to get off the vehicle by vibrating the corresponding seat.

10. A boarding reminding system based on visual tracking, characterized by, The method comprises: an intelligent ride module configured to match a target vehicle corresponding to a target station according to target station information and positioning information uploaded by a passenger based on a mobile terminal, and to determine that the passenger is at a first position; and after the passenger reminder requirement is met, a target reminding strategy is generated, and the passenger is reminded to get off the vehicle in a first reminding manner; a vehicle positioning module configured to obtain positioning information of the vehicle in real time; a vehicle visual module configured to scan a passenger face image in real time, and to determine a second position of the passenger when the face image is at a fixed position; a vibration prompting module configured to remind the passenger to get off the vehicle by vibrating a handrail or a seat based on a preset target reminding strategy.

Images