Method and system for synchronizing journey information after waking up of passenger and vehicle

Abstract

The invention relates to the technical field of vehicles, and discloses a method and system for synchronizing journey information after a passenger wakes up, electronic equipment, a storage medium and a vehicle, and the method comprises the steps: recognizing the identity of the passenger, obtaining the passenger information, and monitoring the state of the passenger to judge whether the passenger is sober or not, analyzing the facial expression and the eye state of the passenger in real time to judge whether the passenger is converted into a waking state from a sleep state or not; obtaining the journey information, the journey information obtaining process involving interaction with the navigation service by requesting and receiving the journey information; and providing the journey information for the passenger, and selecting a corresponding reminding mode according to the position of the passenger and available equipment. According to the invention, the distance information can be timely, conveniently and automatically obtained after the passenger wakes up, the travel experience of the passenger is improved, the interference of active inquiry of the passenger to a driver is avoided, and the driving safety is guaranteed.

Description

Technical Field

[0001] The present invention relates to the field of vehicle technology, and in particular to a method, system, electronic device, storage medium and vehicle for synchronizing distance information after a passenger wakes up. Background Art

[0002] Currently, in existing transportation, when passengers fall asleep during a journey and then wake up, they often need to actively ask the driver or check related equipment to obtain journey information, such as current location, remaining time, estimated arrival time, etc.

[0003] This approach has the following problems:

[0004] 1. Passengers may not obtain timely information, which may cause inconvenience in their travel arrangements, such as missing important transfer times or being unable to prepare to get off the bus in advance.

[0005] 2. Actively asking questions may disturb the driver and affect driving safety.

[0006] 3. Checking the equipment is rather complicated, especially for passengers who have just woken up.

[0007] Therefore, the present application provides a method for synchronizing journey information after the passenger wakes up to solve the above technical problems. Summary of the invention

[0008] The purpose of the present invention is to provide a method, system, electronic device, storage medium and vehicle for synchronizing distance information after a passenger wakes up, so as to solve the technical problem in the prior art that a passenger cannot obtain distance information in time after waking up.

[0009] In order to solve the above technical problems, the present invention provides a method for synchronizing the distance information after the passenger wakes up, comprising:

[0010] A passenger identification step includes identifying the identity of a passenger and obtaining passenger information, wherein facial recognition is performed on the passenger and the passenger information is obtained based on the recognition result;

[0011] The state monitoring step includes monitoring the state of the passenger to determine whether the passenger is awake, wherein based on the captured passenger facial image, the passenger's facial expression and eye state are analyzed in real time to determine whether the passenger changes from a sleeping state to a waking state;

[0012] The route acquisition step includes acquiring route information, wherein the process of acquiring the route information involves interaction with the navigation service by requesting and receiving the route information;

[0013] The route synchronization step includes providing the route information to the passenger and selecting a corresponding reminder method according to the passenger's location and available equipment.

[0014] In some specific embodiments, the passenger identification step includes identifying the identity of the passenger and obtaining the passenger information, wherein facial recognition is performed on the passenger, and the passenger information is obtained according to the recognition result, further comprising:

[0015] Based on facial recognition algorithms, the facial features of the passenger are captured and analyzed in real time;

[0016] Matching the captured facial features with a pre-stored passenger information database to determine the identity of the passenger;

[0017] Based on the passenger identity, the corresponding passenger information is retrieved from the passenger information database and transmitted, wherein the passenger information includes the passenger's name, age and contact information.

[0018] In some specific embodiments, the state monitoring step includes monitoring the state of the passenger to determine whether the passenger is awake, wherein, based on the captured passenger facial image, the passenger's facial expression and eye state are analyzed in real time to determine whether the passenger changes from a sleeping state to a waking state, further comprising:

[0019] Capture passengers’ facial images in real time;

[0020] Analyzing the facial expression and eye state of the passenger in the facial image based on an image processing algorithm to determine whether the passenger is awake;

[0021] Determining whether the passenger is a child to avoid unnecessary information synchronization for the child;

[0022] When it is detected that the passenger is awake, a route information acquisition instruction is triggered, wherein a decision algorithm is used to determine whether the route information needs to be acquired and synchronized according to the awake state of the passenger.

[0023] In some specific embodiments, the route acquisition step includes acquiring route information, wherein the process of acquiring the route information involves interaction with a navigation service, and by requesting and receiving the route information, further includes:

[0024] In response to the communication with the navigation service, requesting the distance information, including current location, driving speed, remaining distance, and estimated time of arrival information;

[0025] Receive the route information provided by the navigation service and ensure the integrity and accuracy of the route information;

[0026] Processing the received route information to ensure the accuracy and real-time nature of the route information;

[0027] The processed route information is stored to ensure that the route information can be quickly retrieved and used in the route synchronization process.

[0028] In some specific embodiments, the route synchronization step includes providing the route information to the passenger, selecting a corresponding reminder method according to the passenger's location and available equipment, and further includes:

[0029] Determine the passenger's position to determine whether there is a display device in front of the passenger;

[0030] If there is the display device in front of the passenger, the distance information is displayed on the display device;

[0031] If there is no display device in front of the passenger, the distance information is announced by voice through the loudspeaker in the car;

[0032] If the display device and the speaker are not available, the passenger's mobile device is used to remind him of the journey information, including sending a notification or text message.

[0033] In some specific embodiments, it also includes:

[0034] Confirm whether the passenger's mobile device has logged into the vehicle application;

[0035] If the passenger is not logged in, the itinerary information will be sent to the passenger via SMS service, and the sending status process will be recorded to ensure the delivery of the information.

[0036] Based on the same concept, the present invention also provides a system for synchronizing the journey information after the passenger wakes up, comprising:

[0037] A passenger identification module is configured to identify the identity of a passenger and obtain passenger information, wherein facial recognition is performed on the passenger and the passenger information is obtained based on the recognition result;

[0038] a state monitoring module configured to monitor the state of a passenger to determine whether the passenger is awake, wherein based on the captured facial image of the passenger, the facial expression and eye state of the passenger are analyzed in real time to determine whether the passenger changes from a sleeping state to a awake state;

[0039] A route acquisition module, configured to acquire route information, wherein the process of acquiring the route information involves interaction with a navigation service by requesting and receiving the route information;

[0040] The route synchronization module is configured to provide the route information to the passenger and select a corresponding reminder method according to the passenger's location and available equipment.

[0041] Based on the same concept, the present invention also provides an electronic device, including: a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the method for synchronizing the journey information after the passenger wakes up.

[0042] Based on the same concept, the present invention also provides a computer-readable storage medium storing a computer program executable by an electronic device. When the computer program runs on the electronic device, the electronic device executes the steps of the method for synchronizing the journey information after the passenger wakes up.

[0043] Based on the same concept, the present invention also provides a vehicle provided with the above-mentioned system for synchronizing distance information after the passenger wakes up.

[0044] Compared with the prior art, the beneficial effects are:

[0045] The present invention discloses a method, system, electronic device, storage medium and vehicle for synchronizing distance information after a passenger wakes up, which can timely, conveniently and automatically obtain distance information after a passenger wakes up, improve the passenger's travel experience, avoid the interference of the driver caused by the passenger's active inquiries, and ensure driving safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Figure 1 It is a flowchart of some specific embodiments of a method for synchronizing the distance information after the passenger wakes up according to the present invention;

[0047] Figure 2 It is a flowchart of a method for synchronizing the distance information after the passenger wakes up in some applications of the present invention;

[0048] Figure 3 It is a schematic diagram of the structure of a system for synchronizing the distance information after the passenger wakes up in some specific embodiments of the present invention;

[0049] Figure 4 It is a schematic diagram of the structure of an electronic device in some specific embodiments of the present invention. DETAILED DESCRIPTION

[0050] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.

[0051] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the present application. The singular forms "a", "said" and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings, and "multiple" generally includes at least two.

[0052] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0053] It should be understood that although the terms first, second, third, etc. may be used to describe in the embodiments of the present application, these descriptions should not be limited to these terms. These terms are only used to distinguish the descriptions. For example, without departing from the scope of the embodiments of the present application, the first may also be referred to as the second, and similarly, the second may also be referred to as the first.

[0054] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.

[0055] It should also be noted that the term "includes", "comprising" or any other variation thereof is intended to cover non-exclusive inclusion, so that a commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprising a ..." do not exclude the existence of other identical elements in the commodity or device including the elements.

[0056] It should be particularly noted that any symbols and / or numbers in the specification that are not marked in the accompanying drawings are not drawing marks.

[0057] Reference Figure 1 , a method for synchronizing journey information after a passenger wakes up, comprising:

[0058] S101, a passenger identification step, including identifying a passenger and obtaining passenger information, wherein facial recognition is performed on the passenger, and the passenger information is obtained according to the recognition result;

[0059] It is understandable that this step is used to identify the passenger and obtain passenger information, including facial recognition algorithms and passenger information databases.

[0060] In some of these applications, the identity of a passenger is identified and passenger information is obtained. Facial recognition of the passenger is performed. In obtaining passenger information based on the recognition results, the passenger's facial features are captured and analyzed in real time based on a facial recognition algorithm; the captured facial features are matched with a pre-stored passenger information database to determine the passenger's identity; based on the passenger's identity, the corresponding passenger information is retrieved from the passenger information database and transmitted, and the passenger information includes the passenger's name, age, and contact information.

[0061] It is understood that the facial features of passengers are captured and analyzed in real time using a facial recognition algorithm. The facial recognition algorithm uses a high-resolution camera installed inside the vehicle to capture facial images of passengers. The camera is configured to automatically activate when the vehicle is started and start capturing images as soon as the passenger enters the vehicle. The capture frequency of facial images is set at 10 frames per second to ensure that a clear and continuous sequence of images is captured.

[0062] The captured facial image is processed by a facial recognition algorithm to extract key facial feature points, such as the location of the eyes, nose, and mouth. The feature points are converted into a feature vector, which is then matched with the facial feature vectors in the pre-stored passenger information database. The database stores facial feature vectors of multiple passengers, each of which is associated with a unique passenger ID.

[0063] The matching process uses the Euclidean distance algorithm to calculate the distance between the facial feature vector to be identified and each vector in the database. A threshold is set, and when the calculated distance is less than the threshold, the match is considered successful. For example, if the threshold is set to 0.6, if the distance between the facial feature vector to be identified and a vector in the database is less than 0.6, the identification is successful.

[0064] When the match is successful, the corresponding passenger information is retrieved from the passenger information database according to the matched passenger ID. The passenger information includes the passenger's name, age and contact information.

[0065] For example, if the passenger is identified as "Zhang San", the corresponding record in the database shows "Zhang San, 30 years old, contact number: 13800138000".

[0066] The retrieved passenger information is transmitted to the vehicle's central processing unit via the vehicle's internal communication system. During the transmission process, the information is encrypted to ensure data security and privacy.

[0067] For example, suppose a passenger named "Li Si" is captured by a camera and his facial features are extracted. The facial recognition algorithm processes these images and matches them with the vectors in the database. After a successful match, Li Si's information is retrieved: his name is "Li Si", his age is "28 years old", and his contact number is "12345678". The information is transmitted to the vehicle's central processing unit.

[0068] S102, a state monitoring step, comprising monitoring the state of the passenger to determine whether the passenger is awake, wherein, based on the captured passenger facial image, the passenger's facial expression and eye state are analyzed in real time to determine whether the passenger changes from a sleeping state to a waking state;

[0069] It can be understood that this step is used to monitor the passenger state to determine whether the passenger changes from a sleeping state to a waking state.

[0070] In some of these applications, the passenger status is monitored to determine whether the passenger is awake. Based on the captured passenger facial image, the passenger's facial expression and eye state are analyzed in real time to determine whether the passenger has changed from a sleeping state to a awake state. The passenger's facial image is captured in real time; based on the image processing algorithm, the passenger's facial expression and eye state in the facial image are analyzed to determine whether the passenger is awake; it is determined whether the passenger is a child to avoid unnecessary information synchronization for the child; when the passenger is detected to be awake, the route information acquisition instruction is triggered, and through the decision-making algorithm, it is decided whether the route information needs to be acquired and synchronized according to the passenger's awake state.

[0071] It is understood that facial images of passengers are captured in real time using a high-resolution camera installed inside the vehicle. The camera is configured to automatically activate when the vehicle is started and start capturing images immediately after the passengers get on the vehicle. The capture frequency of facial images is set at 5 frames per second to ensure that a clear and continuous sequence of images is captured.

[0072] The captured facial images are analyzed by an image processing algorithm. The algorithm first identifies key areas of the face, such as the eyes, eyebrows, mouth, etc. It then analyzes the features of these areas, such as the opening and closing state of the eyes, the movement of the eyelids, the position of the eyebrows, etc., to determine whether the passenger is awake. For example, the algorithm can set a threshold, and when the frequency of changes in the opening and closing state of the eyes exceeds 10 times per minute, it is considered that the passenger may be awake.

[0073] In order to avoid unnecessary information synchronization for children, the features in the facial image, such as facial proportions, eye size, etc., are analyzed to determine whether the passenger is a child. For example, if the proportion of the eyes in the facial image to the total facial area exceeds 30%, the passenger is determined to be a child.

[0074] When the image processing algorithm determines that the passenger is awake and confirms that the passenger is not a child, the decision algorithm is triggered. The decision algorithm determines whether to obtain and synchronize the route information based on the passenger's awake state. If the passenger is awake, a command is sent to the navigation system to request the current route information.

[0075] For example, suppose there is an adult passenger named "Wang Wu". The camera captures Wang Wu's facial image and uses the image processing algorithm to analyze his facial expression and eye state. After capturing the change frequency of Wang Wu's eye opening and closing state exceeding 10 times per minute, it is determined that Wang Wu may be awake. Then, Wang Wu's facial proportions are analyzed to determine that he is an adult. Based on this information, the decision algorithm triggers the route information acquisition instruction.

[0076] After receiving the command, the navigation system starts calculating the current location, driving speed, remaining distance and estimated time of arrival. It is then synchronized to the vehicle's central processing unit and is ready to provide it to Wang Wu once he is fully awake.

[0077] This application can accurately monitor the passenger's status and provide timely journey information when the passenger is awake, thereby improving the passenger's travel experience and ensuring the timeliness and relevance of the information.

[0078] S103, a route acquisition step, including acquiring route information, wherein the process of acquiring the route information involves interaction with a navigation service by requesting and receiving the route information;

[0079] It can be understood that this step is used to interact with the navigation service to obtain the route information.

[0080] In some of these applications, the process of obtaining distance information involves interaction with a navigation service, by requesting and receiving distance information, responding to communications with the navigation service, requesting distance information, including current location, driving speed, remaining distance, and estimated arrival time information; receiving distance information provided by the navigation service and ensuring the integrity and accuracy of the distance information; processing the received distance information to ensure the accuracy and real-time nature of the distance information; storing the processed distance information to ensure that the distance information can be quickly retrieved and used in the distance synchronization process.

[0081] It is understood that the current distance information is requested by communicating with the navigation service. The requested information includes the current location of the vehicle, the driving speed, the remaining distance, and the estimated time of arrival. The request is implemented by sending a data packet containing the vehicle location coordinates and a timestamp. For example, the data packet contains the following information: latitude 34.052235, longitude -118.243683, timestamp 2024-09-12T08:30:00.

[0082] After receiving the request, the navigation service sends the distance information. The distance information includes the vehicle's current location, driving speed, remaining distance, and estimated arrival time. The received information is as follows: current location "City Center Avenue", driving speed "60 km / h", remaining distance "15 km", and estimated arrival time "2024-09-12T09:00:00".

[0083] The received distance information is processed by the data processing unit to ensure the accuracy and timeliness of the information. The data processing unit updates the driving speed and remaining distance in real time, and predicts the estimated time of arrival based on the current time and traffic conditions. For example, if the traffic conditions show that the road ahead is congested, the data processing unit will adjust the estimated time of arrival to "2024-09-12T09:15:00".

[0084] The processed trip information is stored in the storage system to ensure that the information can be quickly retrieved and used for subsequent trip synchronization. The storage system includes a database in which the trip information is stored in the form of key-value pairs, for example: {"Current location":"City Center Avenue","Driving speed":"60 km / h","Remaining distance":"15 km","Estimated arrival time":"2024-09-12T09:15:00"}.

[0085] For example, a taxi is driving in the city, and the passenger needs to know the current distance information after waking up. By sending a request to the navigation service, the request includes the current GPS coordinates of the vehicle. The navigation service responds to the request and provides the following distance information: current location "City Center Avenue", driving speed "60 km / h", remaining distance "15 km", and estimated arrival time "2024-09-12T09:00:00". After receiving the information, the data processing unit analyzes the current traffic conditions and predicts that due to congestion on the road ahead, the estimated arrival time will be delayed to "2024-09-12T09:15:00". The processed information is stored in the database for quick retrieval and display when the passenger needs it.

[0086] S104, a route synchronization step, includes providing the route information to the passenger and selecting a corresponding reminder method according to the passenger's location and available equipment.

[0087] It can be understood that this step is used to select a corresponding reminder method according to the passenger's location and available equipment to provide the passenger with journey information.

[0088] In some of these applications, distance information is provided to passengers, and the corresponding reminder method is selected according to the passenger's location and available devices. The passenger's location is judged to determine whether there is a display device in front of the passenger; if there is a display device in front of the passenger, the distance information is displayed on the display device; if there is no display device in front of the passenger, the distance information is broadcast through the in-car speakers; if there is no display device and speaker, the distance information is reminded through the passenger's mobile device, including sending notifications or text messages.

[0089] It is understood that determining the exact position of the passenger can be achieved in a variety of ways, such as using infrared sensors, pressure sensors or cameras inside the vehicle. For example, the pressure distribution on the seat can be analyzed to determine whether the passenger is sitting in a specific seat.

[0090] If it is determined that there is a display device in front of the passenger, such as an in-vehicle screen or the passenger's personal tablet, the distance information is displayed on the display device. The distance information includes but is not limited to the current location, driving speed, remaining distance and estimated arrival time. For example, if the in-vehicle screen in front of the passenger is activated, it is displayed on the screen in the form of a graphical interface: "You are currently located at the city center avenue, the driving speed is 60 kilometers per hour, and there are 10 kilometers to the destination. The estimated arrival time is 2024-09-12T09:30:00."

[0091] If it is determined that there is no display device in front of the passenger, the route information will be announced through the in-car speakers. The voice announcement uses text-to-speech (TTS) technology to convert the route information into natural language. For example: "Dear passenger, you are currently on the city center avenue, driving at a speed of 60 km / h, 10 km away from the destination, and you are expected to arrive in 30 minutes."

[0092] If there is neither a display device nor a speaker in front of the passenger, the passenger's mobile device is used to remind the driver of the route information. This can be achieved by sending a notification or text message. First, check whether the passenger's mobile device has been paired with the vehicle system via Bluetooth or Wi-Fi. If it is paired, a notification is sent; if it is not paired, a message is sent via SMS service. For example, the notification content is: "You are currently located at the city center avenue, 10 kilometers away from the destination, and the estimated arrival time is 2024-09-12T09:30:00."

[0093] For example, a passenger is sitting in the back seat with no in-vehicle screen in front of him. Determine Zhao Liu's position and check if there is a display device in front of him. Since no display device is detected, the distance information is broadcast through the in-vehicle speakers. At the same time, it is detected that the passenger's mobile phone has been paired with the vehicle system via Bluetooth, so the notification of the distance information is also sent through the mobile phone.

[0094] This application ensures that passengers can obtain timely route information in different situations, whether through vision, hearing or mobile devices, thereby improving passengers' travel experience and satisfaction.

[0095] Some of these applications also include confirming whether the passenger's mobile device is logged into the vehicle application; if not, the journey information is sent to the passenger via SMS service and the sending status process is recorded to ensure the delivery of the information.

[0096] It is understandable that this application is used to confirm whether the passenger's mobile device has logged into the vehicle application, and to send journey information to the passenger through SMS service if the passenger is not logged in, and to record the sending status to ensure the delivery of the information.

[0097] Check whether the passenger's mobile device is logged into the vehicle application by detecting the Bluetooth or Wi-Fi connection between the mobile device and the vehicle system. For example, search for devices within a specific range and check whether they have been authenticated and connected to the vehicle application.

[0098] If it is determined that the passenger's mobile device is not logged into the vehicle computer application, the distance information is sent to the passenger. First, the passenger's mobile phone number is retrieved from the passenger information database, and then the text message content containing the distance information is constructed. Including: "Dear passenger, your current location is City Center Avenue, the estimated arrival time is 2024-09-12T10:00:00, and it is 5 kilometers away from the destination."

[0099] After sending a text message, the sending status is recorded in the information recording unit. The sending status includes the sending time, the receiving mobile phone number, the text message content and the sending result (success or failure). For example, the sending status is recorded as follows: "2024-09-12T09:45:00, 13800138000, Dear passenger, your current location is City Center Avenue, the estimated arrival time is 2024-09-12T10:00:00, 5 kilometers away from the destination, and the message is sent successfully."

[0100] This application can ensure that even if the passenger's mobile device is not logged into the vehicle application, it can provide passengers with timely and accurate route information, and ensure the reliability of information transmission by recording the sending status. It improves the passenger's travel experience and ensures the integrity and traceability of information transmission.

[0101] Combine the following Figure 2 The following describes some examples of the method for synchronizing the distance information after the passenger wakes up according to the present invention in some applications:

[0102] like Figure 2 As shown, the present invention realizes automatic synchronization of the route information after detecting that the passenger wakes up through the following steps:

[0103] After the passenger gets on the bus, the passenger information is obtained from the cloud through facial recognition, including the passenger's name, age, mobile phone number and other information.

[0104] Monitor the passenger status. When it detects that the passenger changes from sleep to wakefulness and determines that the passenger is not a child, the route information acquisition instruction is triggered. The vehicle system obtains real-time route information, including current location, driving speed, remaining distance, estimated arrival time, etc., through interaction with the navigation application.

[0105] Detect the passenger's position and confirm whether there is a screen at the passenger's location based on the passenger's position.

[0106] There is a screen at the passenger's location, which will broadcast the acquired distance information in an intuitive voice manner. At the same time, the current distance information interface will be displayed on the screen in front of the passenger, showing the current location, driving speed, remaining distance, estimated arrival time and other information.

[0107] There is no screen at the passenger station, and the current journey information, including current location, driving speed, remaining distance, estimated arrival time, etc., will be played through the speaker at the passenger station to the passenger at the same time.

[0108] The passenger has neither a screen nor a speaker. The passenger is reminded by the mobile phone, and the cloud confirms that the vehicle app on the passenger's mobile phone has been logged in. The mobile phone app pops up a notification message to synchronize the passenger's journey information. If the cloud does not detect the login status of the vehicle app, the passenger's mobile phone number will be obtained from the cloud, and the passenger's journey information will be synchronized by sending a text message.

[0109] If the above conditions are not met, the current location, remaining mileage and time will be synchronized to the passenger via the central control screen and voice.

[0110] This embodiment is described below in conjunction with application scenarios.

[0111] Suppose a passenger falls asleep during a long-distance car journey. After the passenger wakes up, it is detected that the passenger is not a child. At this time, it communicates with the navigation application and obtains that the current vehicle is on the main road in the city, 5 kilometers away from the destination, and is expected to arrive in 15 minutes. According to the passenger's position, it is detected that there is a screen in front of the passenger, and then the distance information is broadcast to the passenger in voice through the in-car audio, and the text and map information are simultaneously displayed on the display in front of the passenger, synchronizing the distance information such as the current vehicle position, remaining mileage, and remaining driving time.

[0112] For the method steps disclosed in the above embodiments, the method steps are described as a series of action combinations for the purpose of simple description, but those skilled in the art should know that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, some steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0113] like Figure 3 As shown, the present invention also provides a system for synchronizing the journey information after the passenger wakes up, comprising:

[0114] The passenger identification module 201 is configured to identify the identity of a passenger and obtain passenger information, wherein facial recognition is performed on the passenger and the passenger information is obtained based on the recognition result;

[0115] A state monitoring module 202 is configured to monitor the state of the passenger to determine whether the passenger is awake, wherein based on the captured passenger facial image, the passenger's facial expression and eye state are analyzed in real time to determine whether the passenger changes from a sleeping state to a waking state;

[0116] The route acquisition module 203 is configured to acquire route information, wherein the process of acquiring the route information involves interaction with the navigation service by requesting and receiving the route information;

[0117] The route synchronization module 204 is configured to provide the route information to the passenger and select a corresponding reminder method according to the passenger's location and available equipment.

[0118] It is worth noting that although only some basic functional modules are disclosed in the embodiments of the present invention, it does not mean that the composition of the present system is limited to the above basic functional modules. On the contrary, what the present embodiment wants to express is that on the basis of the above basic functional modules, those skilled in the art can arbitrarily add one or more functional modules in combination with the prior art to form an infinite number of embodiments or technical solutions. In other words, the present system is open rather than closed. Just because the present embodiment only discloses individual basic functional modules, it cannot be considered that the protection scope of the claims of the present invention is limited to the disclosed basic functional modules. At the same time, for the convenience of description, the above devices are described in terms of functions and are described separately in various units and modules. Of course, when implementing the present invention, the functions of each unit and module can be implemented in the same or one or more software and / or hardware.

[0119] like Figure 4As shown, the present invention also provides an electronic device, comprising: a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the method for synchronizing the distance information after the passenger wakes up.

[0120] Figure 4 Schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. Figure 4 The electronic device provided in the embodiment of the present invention includes: one or more processors 710 and a storage device 720; the processor 710 in the electronic device may be one or more, Figure 4 A processor 710 is taken as an example; the storage device 720 is used to store one or more programs; the one or more programs are executed by the one or more processors 710, so that the one or more processors 710 implement the method for synchronizing distance information after the passenger wakes up as described in any of the embodiments of the present invention.

[0121] The electronic device may further include: an input device 730 and an output device 740 .

[0122] The processor 710, storage device 720, input device 730 and output device 740 in the electronic device can be connected via a bus or other means. Figure 4 The example of connecting through bus is taken in the following.

[0123] The storage device 720 in the electronic device is a computer-readable storage medium that can be used to store one or more programs, which can be software programs, computer executable programs, and modules, such as the program instructions / modules corresponding to the method for synchronizing the distance information after the passenger wakes up provided in the embodiment of the present invention. The processor 710 executes various functional applications and data processing of the electronic device by running the software programs, instructions, and modules stored in the storage device 720, that is, the method for synchronizing the distance information after the passenger wakes up in the above method embodiment is implemented.

[0124] The storage device 720 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the electronic device, etc. In addition, the storage device 720 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some instances, the storage device 720 may further include a memory remotely arranged relative to the processor 710, and these remote memories may be connected to the device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0125] The input device 730 may be used to receive input digital or character information and generate key signal input related to user settings and function control of the electronic device. The output device 740 may include a display device such as a display screen.

[0126] The present invention also provides a computer-readable storage medium storing a computer program executable by an electronic device. When the computer program runs on the electronic device, the electronic device executes the steps of the method for synchronizing the distance information after the passenger wakes up.

[0127] Specifically, the computer storage medium of the embodiment of the present invention can adopt any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present embodiment, the computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by an instruction execution system, device or device or used in combination with it.

[0128] The present invention also provides a vehicle provided with the system for synchronizing distance information after a passenger wakes up as described above.

[0129] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for synchronizing journey information after a passenger wakes up, characterized in that: include: A passenger identification step includes identifying the identity of a passenger and obtaining passenger information, wherein facial recognition is performed on the passenger and the passenger information is obtained based on the recognition result; The state monitoring step includes monitoring the state of the passenger to determine whether the passenger is awake, wherein based on the captured passenger facial image, the passenger's facial expression and eye state are analyzed in real time to determine whether the passenger changes from a sleeping state to a waking state; The route acquisition step includes acquiring route information, wherein the process of acquiring the route information involves interaction with the navigation service by requesting and receiving the route information; The route synchronization step includes providing the route information to the passenger and selecting a corresponding reminder method according to the passenger's location and available equipment.

2. The method for synchronizing the distance information after the passenger wakes up according to claim 1, characterized in that: The passenger identification step includes identifying the identity of the passenger and obtaining the passenger information, wherein the passenger is subjected to facial recognition and the passenger information is obtained according to the recognition result, further comprising: Based on facial recognition algorithms, the facial features of the passenger are captured and analyzed in real time; Matching the captured facial features with a pre-stored passenger information database to determine the identity of the passenger; Based on the passenger identity, the corresponding passenger information is retrieved from the passenger information database and transmitted, wherein the passenger information includes the passenger's name, age and contact information.

3. The method for synchronizing distance information after a passenger wakes up according to claim 1, characterized in that: The state monitoring step includes monitoring the state of the passenger to determine whether the passenger is awake, wherein, based on the captured passenger facial image, the passenger's facial expression and eye state are analyzed in real time to determine whether the passenger changes from a sleeping state to a waking state, further comprising: Capture passengers’ facial images in real time; Analyzing the facial expression and eye state of the passenger in the facial image based on an image processing algorithm to determine whether the passenger is awake; Determining whether the passenger is a child to avoid unnecessary information synchronization for the child; When it is detected that the passenger is awake, a route information acquisition instruction is triggered, wherein a decision algorithm is used to determine whether the route information needs to be acquired and synchronized according to the awake state of the passenger.

4. The method for synchronizing distance information after a passenger wakes up according to claim 1, characterized in that: The route acquisition step includes acquiring route information, wherein the process of acquiring the route information involves interaction with the navigation service, and further includes: In response to the communication with the navigation service, requesting the distance information, including current location, driving speed, remaining distance, and estimated time of arrival information; Receive the route information provided by the navigation service and ensure the integrity and accuracy of the route information; Processing the received route information to ensure the accuracy and real-time nature of the route information; The processed route information is stored to ensure that the route information can be quickly retrieved and used in the route synchronization process.

5. The method for synchronizing distance information after a passenger wakes up according to claim 1, characterized in that: The route synchronization step includes providing the route information to the passenger, selecting a corresponding reminder method according to the passenger's location and available equipment, and further includes: Determine the passenger's position to determine whether there is a display device in front of the passenger; If there is the display device in front of the passenger, the distance information is displayed on the display device; If there is no display device in front of the passenger, the distance information is announced by voice through the loudspeaker in the car; If the display device and the speaker are not available, the passenger's mobile device is used to remind him of the journey information, including sending a notification or text message.

6. The method for synchronizing distance information after a passenger wakes up according to claim 5, characterized in that: Also includes: Confirm whether the passenger's mobile device has logged into the vehicle application; If the passenger is not logged in, the itinerary information will be sent to the passenger via SMS service, and the sending status process will be recorded to ensure the delivery of the information.

7. A system for synchronizing the journey information after the passenger wakes up, characterized in that: include: A passenger identification module is configured to identify the identity of a passenger and obtain passenger information, wherein facial recognition is performed on the passenger and the passenger information is obtained based on the recognition result; a state monitoring module configured to monitor the state of a passenger to determine whether the passenger is awake, wherein based on the captured facial image of the passenger, the facial expression and eye state of the passenger are analyzed in real time to determine whether the passenger changes from a sleeping state to a awake state; A route acquisition module, configured to acquire route information, wherein the process of acquiring the route information involves interaction with a navigation service by requesting and receiving the route information; The route synchronization module is configured to provide the route information to the passenger and select a corresponding reminder method according to the passenger's location and available equipment.

8. An electronic device, characterized in that: include: A processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the method described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: It stores a computer program executable by an electronic device, and when the computer program runs on the electronic device, the electronic device executes the steps of the method described in any one of claims 1 to 6.

10. A vehicle, characterized in that: The vehicle is provided with a system for synchronizing distance information after a passenger wakes up as claimed in claim 7.

Images