Cockpit system based on user state time information processing method and related device

Abstract

The application discloses a cockpit system time information processing method based on user state and related device, the method comprises: when the time when the vehicle travels is within a preset time period, the driving route where the vehicle is located is within a preset driving route, and the driving route where the vehicle is located is a congested route, the driver's gesture is collected through a camera, if the similarity of the collected driver's gesture and the pre-set gesture is greater than or equal to a first preset value, the driver's eye line focus area on the display screen is determined; the collected driver's eye line focus area is compared with the target time display area of the display screen, the target time display area is a preset display area that meets the driver's sitting posture under the current seat setting and has a display area greater than a preset area; if the matching degree of the collected driver's eye line focus area and the target time display area is greater than or equal to a second preset value, the display screen displays time-related information in the target time display area.

Description

Technical Field

[0001] This invention relates to information technology, applied to the field of driver assistance, and particularly to a method and related apparatus for processing time information based on user status in a cockpit system. Background Technology

[0002] During rush hour, drivers often need to check the time. When the cockpit system's display screen is in sleep mode or displaying other applications such as navigation, music, or video, the screen may not show the real-time time or the area displaying the time may be too small. Therefore, drivers cannot easily access the real-time time directly from the display and sometimes need to manually switch the screen to see it. This results in the driver focusing their attention on the display screen for an extended period, posing a significant driving risk. Summary of the Invention

[0003] One objective of this application is to provide a method and related apparatus for presenting real-time time. Its advantage lies in that, when the vehicle's travel time is within a preset time period, the vehicle's travel route is within a preset route, and the vehicle is on a congested route, the driver's gestures can be used to determine whether the driver needs to check the real-time time. If it is determined that the driver needs to check the time, and the area of ​​the driver's focused gaze area and the target time display area on the screen is greater than a preset area, time-related information is presented through the target time display area. This facilitates the driver's ability to check the real-time time while driving, reducing the time the driver spends checking the real-time time and lowering driving risks.

[0004] Firstly, this application discloses a method for processing time information based on user status in a cockpit system. The method is applied to a cockpit system in a vehicle, which includes an intelligent cockpit domain controller, a camera, and a display screen. The intelligent cockpit domain controller is communicatively connected to the camera and display screen in the vehicle's cockpit system. The method includes:

[0005] The time when the vehicle was traveling is obtained, and it is determined whether the time when the vehicle was traveling is within a preset time period, which includes the preset time when the driver clocks in at work.

[0006] When the vehicle is traveling within the preset time period, the driving route of the vehicle is obtained, and it is determined whether the driving route of the vehicle belongs to the preset driving route, which is the preset commuting route of the driver.

[0007] When the vehicle's route is within the preset route, determine whether the route is congested.

[0008] If the vehicle is traveling on a congested route, the driver's gestures are captured by the camera and compared with pre-set gestures.

[0009] If the similarity between the captured driver's gesture and the preset gesture is greater than or equal to a first preset value, then the driver's eye focus area on the display screen is determined; and,

[0010] The driver's gaze focus area is compared with the target time display area of ​​the display screen. The target time display area is a preset display area that matches the driver's sitting posture in the current seat setting and has a display area larger than the preset area.

[0011] If the matching degree between the driver's gaze focus area and the target time display area is greater than or equal to a second preset value, the display screen is controlled to display time-related information in the target time display area until the matching degree between the driver's gaze focus area and the target time display area is less than the second preset value.

[0012] In conjunction with the first aspect, in one possible implementation, determining the driver's eye's gaze focus area on the display screen includes:

[0013] Obtain the center positions of the driver's pupils and the center positions of the driver's eyeballs;

[0014] The driver's line of sight angle is determined based on the center position of the driver's pupils and the center position of the driver's eyeballs.

[0015] The driver's gaze focus area is determined based on the driver's line of sight angle and the distance between either of the driver's eyes and the display screen.

[0016] In conjunction with the first aspect, in one possible implementation, controlling the display screen to display time-related information in the target time display area includes:

[0017] Get the current time and the current location of the vehicle;

[0018] Query the pre-stored set of commuting events to obtain the reference clock-in time corresponding to the current time and the current location. The set of commuting events includes the correspondence between parameter groups and clock-in times. The parameter groups include time and location.

[0019] If it is determined that the reference clock-in time has exceeded the pre-stored latest clock-in time, then query the pre-stored set of late arrivals for this month to determine the number of times late arrivals have occurred this month.

[0020] If it is detected that the number of late arrivals this month can be offset by the pre-stored number of missed clock-in transactions and there is still a balance, then the display screen will show the current time and a prompt message that can be offset by missed clock-in transactions in the target time display area;

[0021] If it is detected that the number of late arrivals this month can be offset by the number of missed clock-in transactions and there is no balance, or if the number of late arrivals this month has exceeded the number of missed clock-in transactions, then the display screen will only display the current time in the target time display area.

[0022] If it is determined that the reference clock-in time does not exceed the pre-stored latest clock-in time, then the display screen will only display the current time in the target time display area.

[0023] In conjunction with the first aspect, in one possible implementation, controlling the display screen to display time-related information in the target time display area includes:

[0024] Acquire the image displayed on the screen;

[0025] Based on the image, it is determined whether the display screen is displaying a running application interface, where the application interface is the image displayed on the display screen when the application software is executed;

[0026] If not, control the display screen to present the time-related information in full screen;

[0027] If so, the display screen is divided into an application software display area and a target time display area, the application software display area is controlled to display the application interface, and the target time display area is controlled to only display the time-related information.

[0028] In conjunction with the first aspect, in one possible implementation, obtaining the vehicle's travel route includes:

[0029] Detect whether the application interface displayed on the screen is a navigation interface;

[0030] If so, determine the vehicle's driving route based on the navigation interface;

[0031] If not, collect the vehicle's driving direction and location, and determine the vehicle's driving route based on the vehicle's driving direction and location.

[0032] In conjunction with the first aspect, in one possible implementation, determining whether the vehicle's current travel route belongs to the preset travel route includes:

[0033] The location and direction of travel of the vehicle are obtained; if the location of the vehicle is within the preset travel route and the direction of travel of the vehicle is the same as the direction of travel of the preset travel route, it is determined that the travel route of the vehicle belongs to the preset travel route; if the location of the vehicle is not within the preset travel route, or the direction of travel of the vehicle is different from the direction of travel of the preset travel route, it is determined that the travel route of the vehicle does not belong to the preset travel route.

[0034] Alternatively, obtain the location of the vehicle and its direction of travel; determine whether the location and direction of travel of the vehicle can reach the destination of the preset travel route; if yes, determine that the travel route of the vehicle belongs to the preset travel route; if no, determine that the travel route of the vehicle does not belong to the preset travel route.

[0035] In conjunction with the first aspect, in one possible implementation, determining whether the vehicle's route is congested includes:

[0036] Collect the vehicle's speed;

[0037] Obtain the number of other vehicles within a preset range of the vehicle;

[0038] Whether the vehicle's route is congested is determined based on the vehicle's speed and the number of other vehicles within a preset range of the vehicle.

[0039] Secondly, this application provides a cockpit system including an intelligent cockpit domain controller, a camera, and a display screen. The intelligent cockpit domain controller is communicatively connected to the camera and display screen in the vehicle's cockpit. The intelligent cockpit domain controller is configured to perform the following steps:

[0040] The time when the vehicle was traveling is obtained, and it is determined whether the time when the vehicle was traveling is within a preset time period, which includes the preset time when the driver clocks in at work.

[0041] When the vehicle is traveling within a preset time period, the driving route of the vehicle is obtained, and it is determined whether the driving route of the vehicle belongs to a preset driving route, which is the preset commuting route of the driver.

[0042] When the vehicle's route is within the preset route, determine whether the route is congested.

[0043] If the vehicle is traveling on a congested route, the driver's gestures are captured by the camera and compared with pre-set gestures.

[0044] If the similarity between the captured driver's gesture and the preset gesture is greater than or equal to a first preset value, then the driver's eye focus area on the display screen is determined; and,

[0045] The driver's gaze focus area is compared with the target time display area of ​​the display screen. The target time display area is a preset display area that matches the driver's sitting posture in the current seat setting and has a display area larger than the preset area.

[0046] If the matching degree between the driver's gaze focus area and the target time display area is greater than or equal to a second preset value, the display screen is controlled to display time-related information in the target time display area until the matching degree between the driver's gaze focus area and the target time display area is less than the second preset value.

[0047] Thirdly, this application discloses an electronic device, which includes a memory and a processor, wherein the memory is used to store computer instructions and the processor is used to invoke the computer instructions to execute the method described above.

[0048] Fourthly, this application discloses a computer storage medium storing computer instructions that, when executed by a processor, implement the method described above.

[0049] In the embodiments provided in this application, when the vehicle's travel time is within a preset time period, the vehicle's travel route is within a preset travel route, and the vehicle is on a congested route, the driver's gestures can be used to determine that the driver has a need to view the real-time time. When the matching degree between the driver's gaze focus area and the target time display area of ​​the display screen is greater than or equal to a second preset value, the target time display area of ​​the display screen is controlled to display time-related information, so as to facilitate the driver to view the real-time time while driving the vehicle, thereby reducing the time the driver spends viewing the real-time time and reducing the driver's driving risk. Attached Figure Description

[0050] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0051] Figure 1 This is a flowchart illustrating a method for processing time information based on user status in a cockpit system, according to an embodiment of this application.

[0052] Figure 2 This is a schematic diagram of a display screen presenting a navigation interface according to an embodiment of this application;

[0053] Figure 3 This is a schematic diagram of a display screen showing a navigation interface and a target time display area according to an embodiment of this application;

[0054] Figure 4 This is a schematic diagram of the cockpit system provided in one embodiment of this application;

[0055] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0056] The embodiments of this application will now be described with reference to the accompanying drawings.

[0057] The terms "comprising" and "having," and any variations thereof, in the specification, claims, and accompanying drawings of this application are intended to cover a non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the steps or units listed, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to such process, method, product, or apparatus.

[0058] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0059] During rush hour, drivers often need to check the time. When the cockpit system's display screen is in sleep mode or displaying other applications such as navigation, music, or video, the screen may not show the real-time time or the area displaying the time may be too small. Therefore, drivers cannot easily access the real-time time directly from the screen and sometimes need to manually switch the display interface. This results in the driver focusing their attention on the screen for an extended period, posing a significant driving risk.

[0060] In view of this, this application discloses a method for processing time information based on user status in a cockpit system. The method is applied to a cockpit system 200 in a vehicle. The cockpit system 200 includes an intelligent cockpit domain controller 210, a camera 220, and a display screen 230. The intelligent cockpit domain controller 210 is communicatively connected to the camera 220 and the display screen 230. The camera 220 is used to collect the driver's status, and the display screen 230 is used to display a target time display area 232. The cockpit system 200 may include a vehicle-mounted system, a mobile phone, a tablet computer, etc. The display screen 230 can display time-related information in the target time display area 232. The target time display area 232 of the display screen 230 can display the real-time time in digital form, and can also display the real-time time in pointer form. The display screen 230 also has an application software display area, which can display the application interface. It should be noted that the application interface can be displayed full-screen on the display screen. The application interface displays the content of the application software. When the application interface is navigation interface 231, navigation interface 231 can display navigation routes. Navigation routes are used to guide drivers from the starting point to the destination. For example, if a driver drives a vehicle from point A to destination B, the driving route from point A to point B can be a navigation route.

[0061] Please see Figure 1 The method includes, but is not limited to, the following steps:

[0062] S101, obtain the time when the vehicle is in motion, and determine whether the time when the vehicle is in motion is within a preset time period, wherein the preset time period includes the preset time for the driver to clock in at work.

[0063] In the embodiments provided in this application, the preset time period can be a time period set manually by the driver. For example, the preset time period can be the driver's peak commuting time. Generally, drivers often need to check the time during peak commuting times to understand the time interval between the current time and the start of their commute. It is understood that by obtaining the vehicle's travel time, it can be determined whether the vehicle's travel time is within the peak commuting time.

[0064] In the embodiments provided in this application, if the driver's work start time is 9:00 AM, the preset time period can be set to 8:00 AM to 9:00 AM.

[0065] S102, when the vehicle is traveling within the preset time period, obtain the driving route of the vehicle and determine whether the driving route of the vehicle belongs to the preset driving route, the preset driving route being the preset commuting route of the driver.

[0066] In the embodiments provided in this application, the preset driving route can be a driving route set manually by the driver. For example, the preset driving route can be a driving route taken by the driver from their home to their workplace. The preset driving route can include multiple driving routes, each of which can take the driver from their home to their workplace.

[0067] The vehicle's route can be the road on which it travels. By determining the road on which the vehicle travels, it can be determined whether the vehicle's route belongs to a preset route. The preset route can be the route a driver takes from home to work. For example, if the driver's starting point (home) is A and the driver's destination (work) is B, the preset route is the route from starting point A to destination B.

[0068] S103, when the vehicle is on a route within a preset route, determine whether the route is congested.

[0069] In the embodiments provided in the application, the system determines that the vehicle's travel time falls within a preset time period, the vehicle's route falls within a preset route, and the vehicle's route is congested. In such scenarios, drivers often frequently check the real-time time. For example, if the preset time period coincides with the driver's usual peak commuting hours, such as 8:00-9:00 AM, and the preset route is the driver's route from home to work, then it can be determined that the driver is traveling during peak commuting hours. When the vehicle's route is congested, the driver has an incentive to check the real-time time to obtain the time interval between the current time and the commuting start time.

[0070] S104, if the vehicle is traveling on a congested route, the driver's gestures are captured by the camera and compared with pre-set gestures;

[0071] In the embodiments provided in this application, the driver's gestures can be either physical movements or static postures.

[0072] The preset gestures can be gestures set by the driver himself, specifically body movements set by the driver himself.

[0073] The collected driver gestures are compared with pre-set gestures to determine the similarity between the collected driver gestures and the pre-set driver gestures.

[0074] It should be noted that the camera is pointed at the driver's seat and can capture the driver's gestures.

[0075] In the embodiments provided in this application, the cockpit system can collect historical data on the driver's past driving experiences to determine under what circumstances the driver checks the real-time time more frequently. For example, drivers often check the real-time time more frequently during rush hour, when traffic is congested, and on their commute route.

[0076] In the embodiments provided in this application, when it is determined that the vehicle is traveling within a preset time, the vehicle's route is a preset route, and the vehicle's route is congested, it can be concluded that the vehicle is likely in the morning rush hour, and the driver has the motivation to check the real-time time.

[0077] S105, if the similarity between the collected driver's gesture and the preset gesture is greater than or equal to a first preset value, then the driver's eye focus area on the display screen is determined.

[0078] In the embodiments provided in this application, by collecting the driver's gestures, it is possible to determine that the driver has a need to view the real-time time. The driver's gaze focus area can be understood as the area the driver is viewing. For example, the display screen is divided into a first area, a second area, and a third area. If the driver is viewing the first area, then the driver's gaze focus area is the first area. If the driver is viewing the second area, then the driver's gaze focus area is the second area. The first preset value can be a set threshold.

[0079] S106, compare the collected driver's gaze focus area with the target time display area of ​​the display screen. The target time display area is a preset display area that matches the driver's sitting posture in the current seat setting and has a display area larger than the preset area.

[0080] The target time display area is used to display time-related information, and its size can be automatically adapted to the distance between the driver and the display screen. For example, before determining the size of the target time display area, the distance between the driver's eyes and the display screen can be obtained first, and the size of the target time display area can be adjusted based on this distance. Within a certain range, the greater the distance between the driver and the display screen, the larger the target time display area can be adjusted; conversely, the smaller the distance, the smaller the target time display area can be adjusted.

[0081] S107, if the matching degree between the driver's gaze focus area and the target time display area is greater than or equal to a second preset value, then control the display screen to display time-related information in the target time display area until the matching degree between the driver's gaze focus area and the target time display area is less than the second preset value.

[0082] In the embodiments provided in this application, the matching degree between the driver's gaze focus area and the target time display area can be understood as the degree of overlap between the driver's gaze focus area and the target time display area. The second preset value can be a set threshold.

[0083] The time-related information can be a specific real-time time, such as 8:00, 8:10, etc.

[0084] In the embodiments provided in this application, when the driver's gesture is acquired and it is determined that the similarity between the driver's gesture and a preset gesture is greater than or equal to a first preset value, it can be determined that the driver has a need to check the real-time time. However, since the driver is driving, sometimes the driver does not have time to check the display interface of the display screen 230 after making the gesture. For example, after the driver makes the gesture and controls the display screen 230 to display the target time display area 232, the driver may not check the real-time time in time. At this time, the target time display area 232 displayed by the display screen 230 is invalid. In order to enable the display screen 230 to effectively display the target time display area 232 for the driver, this application collects the driver's gaze focus area. When the matching degree between the driver's gaze focus area and the target time display area is greater than or equal to a second preset value, the display screen 230 displays the target time display area 232, so that the target time display area 232 displayed by the display screen 230 is valid every time.

[0085] In some embodiments, after the driver's gesture is found to be greater than or equal to a preset value, the cockpit system is triggered to acquire the driver's gaze focus area. Within a preset time interval, if the matching degree between the acquired driver's gaze focus area and the target time display area is greater than or equal to a second preset value, the target display area of ​​the screen is controlled to display time-related information. Within the preset time interval, if the matching degree between the acquired driver's gaze focus area and the target time display area is consistently less than the second preset value, the cockpit system can issue a prompt sound indicating that the acquired driver's gesture is invalid. The prompt sound informs the driver that the previously performed gesture is invalid and that the gesture needs to be re-verified if the driver wants to view the real-time time.

[0086] The preset time interval can be 5 minutes, 3 minutes, 1 minute, etc. This application does not impose specific restrictions on the value of the preset time interval.

[0087] In some embodiments, when determining the area of ​​focus of the driver's eyes on the display screen, the center positions of the driver's pupils and the center positions of the eyeballs are obtained.

[0088] The driver's line of sight angle is determined based on the center position of the driver's pupils and the center position of the driver's eyeballs.

[0089] The driver's gaze focus area is determined based on the driver's gaze angle and the distance between either of the driver's eyes and the display screen 230.

[0090] The center of the pupil refers to the geometric center of the eye's pupil.

[0091] The center of the eyeball is its geometric center. It's important to note that the pupil is located inside the eyeball and can dilate and constrict, moving with the eye. When the eyeball moves, the center of the eyeball remains relatively constant relative to the corner of the eye or other reference points. However, the center of the pupil may shift relative to the center of the eyeball as the eye moves. For example, when looking straight ahead or slightly to the left, the center of the eyeball remains constant relative to the corner of the eye or other reference points, but the pupil's position will change relative to those points.

[0092] The driver's line of sight angle is related to the movement of the driver's eyeballs. When the eyeballs move, the pupils move with the eyeballs, and the center position of the pupils will change relative to the center position of the eyeballs. By obtaining the center position of the driver's eyeballs and the center position of the pupils, the driver's line of sight angle can be determined.

[0093] In the embodiments provided in this application, after determining the driver's line of sight angle, the driver's eye focus direction can be determined, and the driver's eye focus area on the display screen 230 can be determined based on the driver's eye focus direction and the distance of the display screen 230.

[0094] It should be noted that the display screen 230 has an infrared receiving module. The display screen 230 can emit infrared rays to the driver's eyes through the infrared receiving module. The display screen 230 can receive the infrared rays reflected back from the driver's eyes through the infrared receiving module, and can calculate the distance between the driver's eyes and the display screen 230, as well as the center position of the driver's two eyeballs and the center position of the driver's two pupils.

[0095] In the embodiments provided in this application, the system determines that the vehicle's travel time is within a preset time period, the vehicle's route is within a preset route, and the route is congested. In this scenario, acquiring the driver's gestures can accurately determine whether the driver needs to check the real-time time. Furthermore, the preset gestures can be simpler, without needing to be complex. For example, a simple wave is sufficient. With a simple wave as the preset gesture, the cockpit system 200 will only collect the driver's gestures if the vehicle's travel time is within the preset time period, the vehicle's route is within the preset route, and the route is congested. It is understood that when the vehicle is not in the above-mentioned scenario (the vehicle's travel time is within the preset time period, the vehicle's route is within the preset route, and the route is congested), the cockpit system 200 will not collect the driver's gestures. Therefore, by setting the pre-set gestures to simple gestures such as waving, the system serves two purposes. First, when the driver is driving during rush hour (when the vehicle is traveling within a preset time period, on a preset route, or in a congested area), the driver can easily make the corresponding gesture (same as or similar to the pre-set gesture) to check the real-time time. Second, when the driver is not driving during rush hour, the cockpit system 200 will not collect the driver's gestures or, after collecting the gestures, obtain the driver's gaze focus area, causing the display screen 230 to display the target time display area 232, thus avoiding interference with the driver's driving.

[0096] In one possible implementation, the cockpit system 200 can first authenticate the driver. When the cockpit system 200 collects data from the mobile phone and the driver's gaze focus area to display the target time display area 232, it can first determine whether the gesture comes from the previously authenticated driver. Only if the gesture comes from the previously authenticated driver will the system further collect the driver's gaze focus area to display the target time display area 232 on the screen 230. This reduces the possibility that the cockpit system 200 might mistakenly identify anyone other than the driver in the vehicle as the driver.

[0097] In some embodiments, controlling the display screen to display time-related information in the target time display area includes:

[0098] Get the current time and the current location of the vehicle;

[0099] Query the pre-stored set of commuting events to obtain the reference clock-in time corresponding to the current time and the current location. The set of commuting events includes the correspondence between parameter groups and clock-in times. The parameter groups include time and location.

[0100] If it is determined that the reference clock-in time has exceeded the pre-stored latest clock-in time, then query the pre-stored set of late arrivals for this month to determine the number of times late arrivals have occurred this month.

[0101] If it is detected that the number of late arrivals this month can be offset by the pre-stored number of missed clock-in transactions and there is still a balance, then the display screen will show the current time and a prompt message that can be offset by missed clock-in transactions in the target time display area;

[0102] If it is detected that the number of late arrivals this month can be offset by the number of missed clock-in transactions and there is no balance, or if the number of late arrivals this month has exceeded the number of missed clock-in transactions, then the display screen will only display the current time in the target time display area.

[0103] If it is determined that the reference clock-in time does not exceed the pre-stored latest clock-in time, then the display screen will only display the current time in the target time display area.

[0104] In some embodiments, the time-related information may also include the driver's reference clock-in time, the driver's latest clock-in time, and the driver's missed clock-in balance for the current month.

[0105] In the embodiments provided in this application, the cockpit system can communicate with the time clock of the driver's workplace. When the vehicle travels to a preset distance from the time clock, the cockpit system can send a time clock request to the time clock to complete the time clock.

[0106] The cockpit system can record the number of times a driver clocks in and the number of times a driver misses clocking in. The cockpit system can pre-store the maximum limit for the number of times a driver misses clocking in at their workplace. The cockpit system can calculate the driver's monthly missed clocking-in balance based on the number of missed clocking-ins and the maximum limit for the number of missed clocking-ins at their workplace.

[0107] In the embodiments provided in this application, after the display screen displays time-related information in the target time display area, when it is detected that the matching degree between the driver's gaze focus area and the target time display area is less than the second preset value, the cockpit system can control the display screen to turn off the time-related information displayed in the target time display area.

[0108] It should be noted that the set of commuting driving events includes the vehicle's driving position and the correspondence between driving time and clock-in time; for example, if the vehicle's driving position is at position E and the vehicle's driving time is s1, the estimated clock-in time is s2; the set of commuting driving events includes the mapping relationship between the vehicle being at position E, the vehicle's driving time being s1, and the clock-in time being s2.

[0109] In one possible implementation, controlling the display interface of the display screen 230 to present the target time display area 232 includes:

[0110] Acquire the image displayed on the display screen 230;

[0111] Based on the image, it is determined whether the display screen 230 displays a running application interface, where the application interface is the image displayed on the display screen when the application software is executed.

[0112] If not, control the display screen 230 to display the time-related information in full screen;

[0113] If so, the display screen 230 is split into an application software display area and a target time display area, the application software display area is controlled to display the application interface, and the target time display area is controlled to only display the time-related information.

[0114] In the embodiments provided in this application, the application interface is the application interface for opening an app software, such as a video application interface, a music application interface, and a navigation application interface.

[0115] It should be noted that when the display screen 230 is not displaying an application interface, such as when the display screen 230 is in sleep mode or displaying the main menu interface, the display screen 230 can be controlled to directly display the target time display area 232 in full screen.

[0116] In the embodiments provided in this application, if the display screen 230 displays an application interface, since the application interface covers most of the display screen, the area on the display screen displaying the real-time time is relatively small. At this time, if the driver wants to view the real-time time, the driver's gaze will shift to the area on the display screen displaying the time. When the cockpit system 200 obtains that the overlap between the driver's focused gaze area and the area on the display screen displaying the real-time time is greater than or equal to a second preset value, it determines that the driver has a need to view the real-time time. Furthermore, if the driver's focused gaze area matches the target time display area with the second preset value, the cockpit system 200 controls the display screen 230 to split into two screens. The target time display area 232 only displays time-related information, while the application software display area displays the application interface. The split display screen displays both time-related information and the application interface, which not only facilitates the driver's viewing of the real-time time but also does not affect the display screen 230's display of the application interface.

[0117] In one possible implementation, when it is determined that the driver needs to check the real-time time, the cockpit system 200 can also announce the real-time time via voice. For example, when it is determined that the driver needs to check the real-time time, the cockpit system 200 announces, "The current time is 8:10 a.m., and we will arrive at our destination in 10 minutes."

[0118] In the embodiments provided in this application, after the display screen 230 is split into an application interface and a target time display area 232 for a preset time, the cockpit system 200 can control the target time display area 232 and the application interface of the display screen 230 to merge into one application interface. For example, 3 seconds after the display screen 230 is split into an application interface and a target time display area 232, the target time display area 232 and the application interface of the display screen 230 merge back into one application interface. This application does not specifically limit the preset time; the preset time can also be 2 seconds, 4 seconds, 5 seconds, etc.

[0119] In one possible implementation, upon recognizing the driver's need to view the real-time time, the display interface of the screen 230 is split into an application interface and a target time display area 232. After the driver's gaze leaves the target time display area 232, the target time display area 232 and the application interface of the screen 230 are merged into a single application interface.

[0120] In one possible implementation, obtaining the vehicle's travel route includes:

[0121] Detect whether the application interface displayed on the screen 230 is a navigation interface 231;

[0122] If so, the vehicle's driving route is determined based on the navigation interface 231;

[0123] If not, collect the vehicle's driving direction and location, and determine the vehicle's driving route based on the vehicle's driving direction and location.

[0124] In the embodiments provided in this application, taking the navigation interface 231 as an example, when the driver is not viewing the real-time time, see... Figure 2 The navigation interface 231 fills the entire display screen 230. The area occupied by the time displayed on the navigation interface 231 is relatively small, making it inconvenient for the driver to view. The navigation interface 231 displays the navigation route, directional markers, distance to the destination, and estimated time of arrival. While displaying the navigation interface 231, the display screen 230 provides real-time announcements to guide the driver. When it is determined that the driver needs to view the real-time time, see [link to relevant documentation]. Figure 3 The display screen 230 is divided into a navigation interface 231 and a target time display area 232. The navigation interface 231 and the target time display area 232 can be arranged vertically or horizontally. The target time display area 232 displays the real-time time for the driver to view, while the navigation interface 231 displays the navigation route for the driver to view. Generally, the target time display area 232 is positioned closer to the driver on the display screen 230. It should be noted that after the display screen 230 is divided into the navigation interface 231 and the target time display area 232, the navigation interface 231 displays the navigation route, driving direction guidance markers, distance to the destination, and estimated arrival time. The cockpit system 200 can also announce the real-time time via voice. For example, when it is determined that the driver needs to view the real-time time, the cockpit system 200 announces, "The current time is 8:10 AM, and we will arrive at our destination in 10 minutes."

[0125] In one possible implementation, determining whether the vehicle's current driving route belongs to a preset driving route includes:

[0126] Obtain the location of the vehicle and its direction of travel.

[0127] If the vehicle is located within the preset driving route and its driving direction is the same as the driving direction of the preset driving route, then the driving route in which the vehicle is located is determined to belong to the preset driving route. If the vehicle is not located within the preset driving route, or its driving direction is different from the driving direction of the preset driving route, then the driving route in which the vehicle is located is determined not to belong to the preset driving route.

[0128] In the embodiments provided in this application, when obtaining the vehicle's location, the vehicle's location and driving direction can be obtained from the navigation interface 231, or the vehicle can be located via satellite. By locating the vehicle at different time periods, the vehicle's location at different time periods can be obtained, and the vehicle's driving direction can be determined. It should be noted that the cockpit system 200 can be connected to satellite communication.

[0129] In the embodiments provided in this application, when determining the location and direction of travel of a vehicle, it can be determined whether the vehicle's travel route belongs to a preset travel route. For example, if the starting point of the preset travel route is A and the destination is B, and assuming the vehicle's location is C, where C is the location the vehicle needs to pass through from the starting point A to the destination B, if the vehicle's travel direction at location C is the same as the travel direction of the preset travel route, it can be determined that the vehicle's travel route belongs to the preset travel route.

[0130] In the embodiments provided in this application, when a driver drives from point A to point B, the driver may change routes to avoid traffic lights or congested areas.

[0131] When determining whether the vehicle's current route belongs to a preset route, this application includes:

[0132] Obtain the location of the vehicle and its direction of travel.

[0133] Determine whether the vehicle's location and direction of travel can reach the destination along the preset route;

[0134] If so, determine that the vehicle's current route belongs to the preset route;

[0135] If not, it is determined that the vehicle's current route does not belong to the preset route.

[0136] For example, if the vehicle's location is D, and location D is not a location the vehicle needs to pass through to get from origin A to destination B, but the vehicle can still reach destination B by passing through D, then if the vehicle's travel direction at location D can reach destination B from location D, then the vehicle's location is determined to be on a preset travel route.

[0137] In one possible implementation, determining whether the vehicle's route is congested includes:

[0138] Collect the vehicle's speed;

[0139] Obtain the number of other vehicles within a preset range of the vehicle;

[0140] Whether the vehicle's route is congested is determined based on the vehicle's speed and the number of other vehicles within a preset range of the vehicle.

[0141] When obtaining information about vehicle congestion, the cockpit system 200 can communicate with radar or camera equipment to obtain information about the road conditions on the road where the vehicle is located, thereby obtaining information about the congestion on the vehicle's route.

[0142] Specifically, when a vehicle's route is congested, the vehicle's speed will be relatively slow, and there will be many other vehicles around it. For example, when the route is congested, the vehicle's speed may be between v1 and v2, and the number of other vehicles around it may be between n1 and n2. Based on these two characteristics of vehicles traveling on congested roads, the congestion level of the route can be determined by the vehicle's speed range and the number of other vehicles within a preset distance from the vehicle.

[0143] In the embodiments provided in this application, the cockpit system 200 can communicate with satellites to achieve positioning. By using satellite positioning to determine the vehicle's position at different points in time, the vehicle's speed can be calculated. For example, if the vehicle is at position a at time t1 and at position b at time t2, the distance between positions a and b can be obtained. The time interval between time points t1 and t2 can be obtained. Based on the distance between positions a and b and the time interval between time points t1 and t2, the average speed of the vehicle from position a to position b can be calculated. It should be noted that when the time interval between time points t1 and t2 is sufficiently small (approaching zero), the instantaneous speed of the vehicle can be calculated.

[0144] The cockpit system 200 can communicate with radar or camera equipment, and can use radar or camera equipment to obtain the number of other vehicles around the vehicle.

[0145] When a vehicle's speed is between v1 and v2, and the number of other vehicles within a preset range of the vehicle is between n1 and n2, the vehicle's driving state can be determined to be a congested state.

[0146] The cockpit system 200's time information processing method based on user status also includes:

[0147] The time displayed in the target time display area 232 is controlled to gradually increase to a preset size;

[0148] The color of the time displayed in the target time display area 232 is different from the color of the background of the target time display area 232.

[0149] When displaying the target time display area 232, the time displayed on the display screen 230 can gradually increase to make it easier for the driver to view the real-time time.

[0150] In the embodiments provided in this application, when the display screen 230 is split into an application interface and a target time display area 232, the real-time time is displayed in a color different from that of the application interface. The color difference between the real-time time and the application interface is significant to facilitate the driver's viewing of the real-time time. For example, the application interface is predominantly dark black, while the target time display area 232 can display the time in colors such as orange, white, or green.

[0151] See Figure 4 This application also discloses a cockpit system 200, which includes an intelligent cockpit domain controller 210, a camera 220, and a display screen 230. The intelligent cockpit domain controller 210 is communicatively connected to the camera 220 and the display screen 230 in the vehicle's cockpit system 200. The intelligent cockpit domain controller 210 is configured to perform the following steps:

[0152] The time when the vehicle was traveling is obtained, and it is determined whether the time when the vehicle was traveling is within a preset time period, which includes the preset time when the driver clocks in at work.

[0153] When the vehicle is traveling within a preset time period, the driving route of the vehicle is obtained, and it is determined whether the driving route of the vehicle belongs to a preset driving route, which is the preset commuting route of the driver.

[0154] When the vehicle's route is within the preset route, determine whether the route is congested.

[0155] If the vehicle is traveling on a congested route, the driver's gestures are captured by the camera 220 and compared with pre-set gestures.

[0156] If the similarity between the captured driver's gesture and the preset gesture is greater than or equal to a first preset value, then the driver's eye focus area on the display screen is determined; and,

[0157] The driver's gaze focus area is compared with the target time display area of ​​the display screen. The target time display area is a preset display area that matches the driver's sitting posture in the current seat setting and has a display area larger than the preset area.

[0158] If the matching degree between the driver's gaze focus area and the target time display area is greater than or equal to a second preset value, the display screen is controlled to display time-related information in the target time display area until the matching degree between the driver's gaze focus area and the time display area is less than the second preset value.

[0159] For the concepts, explanations, detailed descriptions, and other steps related to the technical solutions provided in the embodiments of this application involved in the cockpit system 200, please refer to the description of the method steps performed by the cockpit system 200 in the foregoing method or other embodiments, which will not be repeated here.

[0160] Please see Figure 5 The electronic device 100 may include a processor 110, a memory 120, and a communication interface 130. The processor 110, the memory 120, and the communication interface 130 are connected via a bus 140. The memory 120 is used to store instructions, and the processor 110 is used to execute the instructions stored in the memory 120.

[0161] The processor 110 executes the instructions stored in the memory 120 to control the communication interface 130 to receive and send signals, thus completing the steps in the above method. The memory 120 may be integrated into the processor 110 or may be disposed separately from the processor 110.

[0162] In one possible implementation, the functionality of the communication interface 130 can be implemented using transceiver circuitry or a dedicated transceiver chip. The processor 110 can be implemented using a dedicated processing chip, processing circuitry, processor, or general-purpose chip.

[0163] In another possible implementation, the program code that implements the functions of processor 110 and communication interface 130 can be stored in memory 120, and the functions of processor 110 and communication interface 130 can be implemented by executing the code in memory 120.

[0164] For the concepts, explanations, detailed descriptions, and other steps related to the technical solutions provided in the embodiments of this application involved in the electronic device 100, please refer to the description of the method steps performed by the electronic device 100 in the foregoing method or other embodiments, which will not be repeated here.

[0165] As another implementation of this embodiment, a computer storage medium is provided for storing computer programs. The computer storage medium stores instructions that, when executed on a computer, perform the methods described in the above embodiment.

[0166] As another implementation of this embodiment, a computer program product containing instructions is provided, which, when executed, perform the method in the above method embodiment.

[0167] Those skilled in the art will understand that multiple processors and memories may exist in a real terminal or server. Memory may also be referred to as storage medium or storage device, etc., and the embodiments of this application do not limit this.

[0168] It should be understood that in the embodiments of this application, the processor may be a central processing unit (CPU), or it may be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.

[0169] It should also be understood that the memory mentioned in the embodiments of this application can be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. Non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDR SDRAM), Enhanced Synchronous DRAM (ESDRAM), Synchlink DRAM (SLDRAM), and Direct Rambus RAM (DR RAM).

[0170] It should be noted that when the processor is a general-purpose processor, DSP, ASIC, FPGA, or other programmable logic device, discrete gate or transistor logic device, or discrete hardware component, the memory is integrated into the processor.

[0171] It should be noted that the memories described herein are intended to include, but are not limited to, these and any other suitable types of memories.

[0172] In addition to the data bus, this bus may also include a power bus, a control bus, and a status signal bus. However, for clarity, all buses are labeled "bus" in the diagram.

[0173] It should also be understood that the first, second, third, fourth and various numerical designations used herein are merely for descriptive convenience and are not intended to limit the scope of this application.

[0174] It should be understood that the term "and / or" in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.

[0175] In implementation, each step of the above method can be completed by integrated logic circuits in the processor's hardware or by instructions in software. The steps of the method disclosed in the embodiments of this application can be directly implemented by a hardware processor, or by a combination of hardware and software modules in the processor. The software modules can reside in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. This storage medium is located in memory, and the processor reads information from the memory and, in conjunction with its hardware, completes the steps of the above method. To avoid repetition, detailed descriptions are omitted here.

[0176] In the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0177] Those skilled in the art will recognize that the various illustrative logical blocks (ILBs) and steps described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this application.

[0178] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or modules may be electrical, mechanical, or other forms.

[0179] The modules described as separate components may or may not be physically separate. Some or all of the modules can be selected to achieve the purpose of this embodiment, depending on actual needs.

[0180] In addition, the functional modules in the various embodiments of this application can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module.

[0181] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer storage medium or transmitted from one computer storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state drive), etc.

[0182] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for processing time information based on user status in a cockpit system, characterized in that, The method is applied to a cockpit system in a vehicle, the cockpit system including a smart cockpit domain controller, a camera, and a display screen, the smart cockpit domain controller being communicatively connected to the camera and display screen in the vehicle's cockpit system; the method includes: The time when the vehicle was traveling is obtained, and it is determined whether the time when the vehicle was traveling is within a preset time period, which includes the preset time when the driver clocks in at work. When the vehicle is traveling within the preset time period, the driving route of the vehicle is obtained, and it is determined whether the driving route of the vehicle belongs to the preset driving route, which is the preset commuting route of the driver. When the vehicle's route is within the preset route, determine whether the route is congested. If the vehicle is traveling on a congested route, the driver's gestures are captured by the camera and compared with pre-set gestures. If the similarity between the captured driver's gesture and the preset gesture is greater than or equal to a first preset value, then the driver's eye focus area on the display screen is determined; and, The driver's gaze focus area is compared with the target time display area of ​​the display screen. The target time display area is a preset display area that matches the driver's sitting posture in the current seat setting and has a display area larger than the preset area. If the matching degree between the driver's gaze focus area and the target time display area is greater than or equal to the second preset value, the display screen is controlled to display time-related information in the target time display area until the matching degree between the driver's gaze focus area and the target time display area is less than the second preset value. Determining the driver's eye focus area on the display screen includes: Obtain the center positions of the driver's pupils and the center positions of the driver's eyeballs; The driver's line of sight angle is determined based on the center position of the driver's pupils and the center position of the driver's eyeballs. The driver's gaze focus area is determined based on the driver's line of sight angle and the distance between either of the driver's eyes and the display screen; The control of the display screen to display time-related information in the target time display area includes: Acquire the image displayed on the screen; Based on the image, it is determined whether the display screen is displaying a running application interface, where the application interface is the image displayed on the display screen when the application software is executed; If not, control the display screen to present the time-related information in full screen; If so, the display screen is divided into an application software display area and a target time display area, the application software display area is controlled to display the application interface, and the target time display area is controlled to only display the time-related information; The step of obtaining the vehicle's driving route includes: Detect whether the application interface displayed on the screen is a navigation interface; If so, determine the vehicle's driving route based on the navigation interface; If not, collect the vehicle's driving direction and location, and determine the vehicle's driving route based on the vehicle's driving direction and location.

2. The method as described in claim 1, characterized in that, The control of the display screen to display time-related information in the target time display area includes: Get the current time and the current location of the vehicle; Query the pre-stored set of commuting events to obtain the reference clock-in time corresponding to the current time and the current location. The set of commuting events includes the correspondence between parameter groups and clock-in times. The parameter groups include time and location. If it is determined that the reference clock-in time has exceeded the pre-stored latest clock-in time, then query the pre-stored set of late arrivals for this month to determine the number of times late arrivals have occurred this month. If it is detected that the number of late arrivals this month can be offset by the pre-stored number of missed attendance transactions and there is still a balance, then the display screen will show the current time and a prompt message that it can be offset by the pre-stored missed attendance transactions in the target time display area. If it is detected that the number of late arrivals this month can be offset by the number of missed clock-in transactions stored in advance and there is no balance, or if the number of late arrivals this month has exceeded the number of missed clock-in transactions stored in advance, then the display screen will only display the current time in the target time display area. If it is determined that the reference clock-in time does not exceed the pre-stored latest clock-in time, then the display screen will only display the current time in the target time display area.

3. The method as described in claim 1, characterized in that, Determining whether the vehicle's current route belongs to the preset route includes: The location and direction of travel of the vehicle are obtained; if the location of the vehicle is within the preset travel route and the direction of travel of the vehicle is the same as the direction of travel of the preset travel route, it is determined that the travel route of the vehicle belongs to the preset travel route; if the location of the vehicle is not within the preset travel route, or the direction of travel of the vehicle is different from the direction of travel of the preset travel route, it is determined that the travel route of the vehicle does not belong to the preset travel route. Alternatively, obtain the location of the vehicle and its direction of travel; determine whether the location and direction of travel of the vehicle can reach the destination of the preset travel route; if yes, determine that the travel route of the vehicle belongs to the preset travel route; if no, determine that the travel route of the vehicle does not belong to the preset travel route.

4. The method as described in claim 1, characterized in that, The determination of whether the vehicle's route is congested includes: Collect the vehicle's speed; Obtain the number of other vehicles within a preset range of the vehicle; Whether the vehicle's route is congested is determined based on the vehicle's speed and the number of other vehicles within a preset range of the vehicle.

5. A cockpit system, characterized in that, The cockpit system includes a smart cockpit domain controller, a camera, and a display screen. The smart cockpit domain controller is communicatively connected to the camera and display screen in the vehicle's cockpit system. The smart cockpit domain controller is configured to perform the following steps: The time when the vehicle was traveling is obtained, and it is determined whether the time when the vehicle was traveling is within a preset time period, which includes the preset time when the driver clocks in at work. When the vehicle is traveling within a preset time period, the driving route of the vehicle is obtained, and it is determined whether the driving route of the vehicle belongs to a preset driving route, which is the preset commuting route of the driver. When the vehicle's route is within the preset route, determine whether the route is congested. If the vehicle is traveling on a congested route, the driver's gestures are captured by the camera and compared with pre-set gestures. If the similarity between the collected driver's gesture and the preset gesture is greater than or equal to a first preset value, then the driver's eye focus area on the display screen is determined. as well as, The driver's gaze focus area is compared with the target time display area of ​​the display screen. The target time display area is a preset display area that matches the driver's sitting posture in the current seat setting and has a display area larger than the preset area. If the matching degree between the driver's gaze focus area and the target time display area is greater than or equal to the second preset value, the display screen is controlled to display time-related information in the target time display area until the matching degree between the driver's gaze focus area and the target time display area is less than the second preset value. The control of the display screen to display time-related information in the target time display area includes: Acquire the image displayed on the screen; Based on the image, it is determined whether the display screen is displaying a running application interface, where the application interface is the image displayed on the display screen when the application software is executed; If not, control the display screen to present the time-related information in full screen; If so, the display screen is divided into an application software display area and a target time display area, the application software display area is controlled to display the application interface, and the target time display area is controlled to only display the time-related information; The step of obtaining the vehicle's driving route includes: Detect whether the application interface displayed on the screen is a navigation interface; If so, determine the vehicle's driving route based on the navigation interface; If not, collect the vehicle's driving direction and location, and determine the vehicle's driving route based on the vehicle's driving direction and location.

6. An electronic device, characterized in that, The electronic device includes a memory and a processor, the memory being used to store computer instructions, and the processor being used to invoke the computer instructions to perform the method as described in any one of claims 1-4.

7. A computer storage medium, characterized in that, The computer storage medium stores computer instructions, which, when executed by a processor, implement the method described in any one of claims 1-4.

Images