Attention alarm threshold updating method, device and equipment and storage medium

Abstract

The invention discloses an attention alarm threshold updating method, device and equipment and a storage medium, and the method comprises the steps: setting an attention deflection angle range based on an initial default attention deflection angle alarm threshold; judging whether the deflection angle of the sight of the user in the driving process falls into the angle range or not; and if the deflection angle of the sight line of the user in the driving process is judged to fall into the angle range, performing iterative calculation on the attention deflection angle alarm threshold value based on the deflection angle and the deflection stay time of the sight line of the user in the driving process so as to automatically update the alarm threshold value and generate alarm threshold values matched with different users. According to the method, the attention deflection angle alarm threshold value can be automatically learned and updated, so that different drivers and driving habits thereof can be better adapted and matched, the alarm threshold values matched with the different drivers are generated, and the monitoring result is more accurate.

Description

Technical Field

[0001] This invention relates to the field of vehicle driving technology, and in particular to a method, apparatus, device, and storage medium for updating attention alarm thresholds. Background Technology

[0002] To improve driving safety and protect the safety of drivers and passengers, an increasing number of vehicles on the market are equipped with driver attention monitoring systems. These systems detect when the driver is not paying attention, such as looking around for extended periods or looking down, and issue warnings to remind the driver to focus, thus significantly reducing the likelihood of accidents.

[0003] In existing technology, once the structural design of a particular vehicle model is fixed, different drivers will adjust their seating position based on their height, driving habits, and other factors. Consequently, when turning their heads to check the environment to the left or right of the vehicle during normal driving (such as checking for oncoming vehicles and pedestrians through the side mirrors), users with a more forward-facing seating position will experience a larger angle of deviation when looking at a specific location on the vehicle (such as the left or right side mirrors). Figure 1 As shown; for users sitting further back, the angle of deviation in their line of sight when looking at the same positions on the vehicle (such as the left and right side mirrors) is smaller. Figure 1 As shown, if the attention monitoring system uses the same alarm threshold for both of the above situations, users sitting closer to the front will easily trigger alarms or trigger alarms frequently, while users sitting further back will not easily trigger alarms, thus failing to meet the requirement of accurately alarming various users.

[0004] Therefore, ensuring the accuracy of driver attention detection is a technical problem that urgently needs to be solved. Summary of the Invention

[0005] The main objective of this invention is to provide a method, apparatus, device, and storage medium for updating attention alarm thresholds, which automatically learns and updates attention deflection angle alarm thresholds to better adapt to and match different drivers and their driving habits, generating alarm thresholds that match different drivers, thus making the monitoring results more accurate.

[0006] Firstly, this application provides a method for updating an attention alarm threshold, wherein the method includes the following steps: Based on the initial default attention deflection angle alarm threshold, set the attention deflection angle range; Determine whether the angle of the user's gaze during driving falls within the specified angle range; If it is determined that the angle of the user's gaze during driving falls within the specified angle range, then based on the angle of the user's gaze during driving and the duration of the gaze, the alarm threshold for the attention deflection angle is iteratively calculated to automatically update the alarm threshold and generate an alarm threshold that matches different users.

[0007] In conjunction with the first aspect mentioned above, as an optional implementation method, the user's line of sight deflection dwell time within the angle range and the product of the deflection dwell time and the deflection angle are accumulated. When the user's gaze deflection angle value is detected to be outside the angle range, the deflection dwell time and the accumulation of the product of the deflection dwell time and the deflection angle are stopped, and the result is stored in the created user data storage space. Using the deflection dwell time and the accumulated data of the product of deflection dwell time and deflection angle stored in the storage space, the updated attention deflection angle alarm threshold is calculated, and the angle range is updated based on the updated attention deflection angle alarm threshold to perform iterative calculation of the attention deflection angle alarm threshold.

[0008] In conjunction with the first aspect mentioned above, as an optional implementation method, According to the formula: Calculate the updated attention-shifted-to-the-left alarm threshold, where, For the user's line of sight to the left during driving, To examine the product of the angle of visual deflection and the duration of dwell time while observing the environment to the left of the vehicle, To observe the duration of eye contact with the environment on the left side of the vehicle; According to the formula: Calculate the updated attention-to-the-right alarm threshold, where, For the user's line of sight to the right during driving, To examine the product of the angle of visual deflection and the duration of dwell time while observing the environment on the right side of the vehicle, To observe the duration of eye contact with the environment on the right side of the vehicle.

[0009] In conjunction with the first aspect mentioned above, as an optional implementation, when the angle of the user's gaze deflection exceeds the updated attention alarm threshold and the duration is greater than a set time, an alarm signal is issued to the user. The alarm signal includes visual, auditory, or tactile alarm signals.

[0010] In conjunction with the first aspect mentioned above, as an optional implementation, based on the initial default attention deflection angle alarm threshold, the attention monitoring controller is used to set the angle range of gaze deflection when the user looks at the environment to the left and right of the vehicle during driving. The angle range is... The current user attention shift to the left alarm threshold. The current user attention shift to the right alarm threshold. The angle is set.

[0011] In conjunction with the first aspect mentioned above, as an optional implementation method, the center point of the driver's eyeball model is taken as the origin of the driver's line of sight; Draw lines connecting the origin to the outermost edges of the left and right side mirrors respectively. The two lines formed by these two lines and the vertical line passing through the origin create two angles. Use the angle values ​​of these two angles as the initial default values ​​for the left-biased alarm threshold and the right-biased alarm threshold, respectively.

[0012] In conjunction with the first aspect mentioned above, as an optional implementation method, an attention monitoring controller is used to create a data storage space for multiple users to store each user's identity characteristics and driving habits; When a user enters the vehicle, the camera captures the user's image and compares it with stored identity information to determine the user's identity and obtain corresponding driving habits.

[0013] Secondly, this application provides an attention alarm threshold update device, the device comprising: The setting module is used to set the range of attention deflection angle based on the initial default attention deflection angle alarm threshold; The judgment module is used to determine whether the angle of deflection of the user's line of sight during driving falls within the angle range; The processing module is used to iteratively calculate the attention deflection angle alarm threshold based on the user's gaze deflection angle and the deflection dwell time during driving if it is determined that the angle of the user's gaze deflection during driving falls within the angle range, so as to automatically update the alarm threshold and generate an alarm threshold that matches different users.

[0014] Thirdly, this application also provides an electronic device, the electronic device comprising: a processor; and a memory storing computer-readable instructions, which, when executed by the processor, implement the method described in any one of the first aspects.

[0015] Fourthly, this application also provides a computer-readable storage medium storing computer program instructions that, when executed by a computer, cause the computer to perform the method described in any of the first aspects.

[0016] This application provides a method, apparatus, device, and storage medium for updating attention alarm thresholds. The method includes the following steps: setting an attention deflection angle range based on an initial default attention deflection angle alarm threshold; determining whether the user's gaze deflection angle during driving falls within the stated angle range; if the user's gaze deflection angle falls within the stated angle range, then iteratively calculating the attention deflection angle alarm threshold based on the user's gaze deflection angle and deflection dwell time during driving to automatically update the alarm threshold and generate alarm thresholds that match different users. This application can automatically update and learn the attention deflection angle alarm threshold to better adapt to and match different drivers and their driving habits, generating alarm thresholds that match different drivers, making the monitoring results more accurate.

[0017] It should be understood that the above general description and the following detailed description are merely exemplary and do not limit the invention. Attached Figure Description

[0018] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0019] Figure 1 This is a flowchart of an attention alarm threshold update method provided in the embodiments of this application; Figure 2 This is a schematic diagram of an attention alarm threshold update device provided in the embodiments of this application; Figure 3 The default initial threshold for the line-of-sight alarm provided in this application embodiment; Figure 4 This is a schematic diagram of an electronic device provided in an embodiment of this application; Figure 5 This is a schematic diagram of a computer-readable program medium provided in an embodiment of this application. Detailed Implementation

[0020] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatuses and methods consistent with some aspects of the invention as detailed in the appended claims.

[0021] Furthermore, the accompanying drawings are merely illustrative of this disclosure and are not necessarily drawn to scale. Some of the block diagrams shown in the drawings represent functional entities and do not necessarily correspond to physically or logically independent entities.

[0022] The embodiments of this application will be further described in detail below with reference to the accompanying drawings.

[0023] Reference Figure 1 , Figure 1 The diagram shown is a flowchart of an attention alarm threshold update method provided by the present invention. Figure 1 As shown, the method includes the following steps: Step S101: Based on the initial default attention deflection angle alarm threshold, set the attention deflection angle range.

[0024] Specifically, the origin is connected to the outermost edge of the left and right side mirrors, respectively. These two lines form two angles with the perpendicular line passing through the origin. These angles are used as the initial default values ​​for the left-leaning and right-leaning attention warning thresholds, respectively. It should be explained that the method for determining the initial (default) thresholds for the driver's left / right attention warnings meets the basic needs of most users and provides a basic reference value for the learning and iteration of these warning thresholds in this system.

[0025] In other words, when a user uses the vehicle, the iteration is based on a set baseline value. It also needs to be explained that the current alarm threshold is set when the user gets into the vehicle. , That is, the current alarm threshold is equal to the initial threshold.

[0026] For ease of understanding, let's illustrate with an example. For a specific vehicle model, the initial (default) threshold for the driver's gaze deviation warning to the left / right is... Figure 3 The method is determined. The center point of the driver's eye model for this vehicle model is selected as the origin of the driver's line of sight. Lines are drawn from this origin to the outermost edges of the left and right side mirrors. The angles formed by these two lines and the perpendicular line passing through the origin are the initial (default) threshold for the leftward deviation warning. ), Rightward deviance alarm initial (default) threshold ( ).

[0027] Before the vehicle is delivered to the user, the controller creates several user data storage spaces to store each user's identity information and the default threshold for the left-eye deviation alarm. Rightward deviation alarm default threshold 100 data sets of leftward gaze deviation during driving --- denoted as ...... 100 sets of data on rightward gaze deviation ---- denoted as ...... The 100 left- and right-leaning data groups are for ease of description; in actual implementation, the number of these data groups can be adjusted.

[0028] Before the vehicle is delivered to the user, the controller assigns values ​​to the data storage space of each user. Specifically, the identity feature information is empty (invalid value), and all 100 data sets of left-leaning gaze during the driving process are assigned a value of (2 seconds, 2 seconds * ...). ), assign all 100 data sets of rightward gaze deviation to (2 seconds, 2 seconds * ) The above data is for ease of description; in actual implementation, the values ​​assigned to this data set can be adjusted.

[0029] Assign initial values ​​((2 seconds, 2 seconds * ...)) ) and (2 seconds, 2 seconds* After substituting into the formula, according to the formula... and It can be calculated , When a user uses the vehicle for the first time, the current alarm threshold is the default initial value, and updates are performed based on this initial value.

[0030] The specific setting range is as follows: based on the initial default attention deflection angle alarm threshold, the attention monitoring controller sets the angle range of the user's gaze deflection when looking at the environment to the left and right of the vehicle during driving. The angle range is... ( The current user attention shift to the left alarm threshold. The current user attention shift to the right alarm threshold. (The angle is set).

[0031] To facilitate understanding and illustration, the effective data range for the controller during user gaze deviation is defined. To prevent angle data from being mixed with valid data under abnormal driving conditions (such as large gaze deviations) and normal driving conditions (such as small gaze deviations), the controller limits the range of gaze deviation angle values ​​during the data acquisition process: the effective range for a gaze deviating to the left is set to (…). -15° +15°); the effective value range for rightward line of sight is set to ( -18° +18°), 15° and 18° are for ease of description. In actual implementation, the angle value can be adjusted by the user according to different vehicle models and ergonomics.

[0032] It should be explained that the controller sets the range of eye deflection angles during normal viewing of the left / right side of the vehicle by each user while driving. It can automatically filter out large eye deflection angles in abnormal situations and small eye deflection angles in normal situations from mixing into the user's normal data, ensuring the accuracy of each set of data collected and recorded, thereby ensuring the accuracy of the eye deflection angle alarm threshold.

[0033] In one embodiment, before setting the attention deflection angle range based on an initial default attention deflection angle alarm threshold, the following steps are included: The attention monitoring controller is used to create a data storage space for multiple users to store each user's identity information and driving habits; When a user enters the vehicle, the camera captures the user's image and compares it with stored identity information to determine the user's identity and obtain corresponding driving habits.

[0034] Specifically, when a vehicle is delivered to a user, upon the first user entering the driver's seat, the controller receives the image from the camera, performs facial recognition, extracts identity feature data, and stores the user's identity feature information in the first user's data storage space. When other users enter the driver's seat, the controller performs corresponding operations. When a user re-enters the vehicle, the controller performs facial recognition, extracts identity feature data, and compares it with the user's identity feature information already stored in the controller. If the comparison matches, the user's storage number in the controller is recorded; for simplicity, let's assume the number is n. It should be explained that the creation of multi-user storage spaces and user data allows the system to automatically identify each user and automatically bind each user's data to that user, achieving accurate matching between users and data. It can automatically retrieve the user's historical driving habit data to update and iterate the left and right gaze deviation alarm thresholds, ensuring the accuracy of the alarm thresholds, and also distinguishing it from other users' data to prevent confusion.

[0035] To illustrate this, when User 1 uses the vehicle, based on the initial alarm threshold, User 1's alarm threshold is iteratively updated to obtain the updated alarm threshold, which is then stored in User 1's database. Similarly, user actions are performed based on alarm thresholds. The alarm threshold is updated and then stored in the user's database. The database (storage is based on multiple user databases created).

[0036] Step S102: Determine whether the angle of the user's gaze during driving falls within the stated angle range.

[0037] The camera is installed in the cockpit, in front of the driver, to capture the driver's head image. During driving, the camera captures images of the driver in real time and sends them to the controller so that the controller can analyze and calculate the angle of the driver's gaze. Based on the obtained gaze deflection angle value, the controller determines whether the angle of the user's gaze during driving falls within the specified angle range.

[0038] Step S103: If it is determined that the angle of the user's gaze during driving falls within the angle range, then based on the angle of the user's gaze during driving and the time of gaze dwell, the attention deflection angle alarm threshold is iteratively calculated to automatically update the alarm threshold and generate an alarm threshold that matches different users.

[0039] Specifically, the time the user's line of sight deflects and lingers within the angle range, and the product of the deflection lingering time and the deflection angle are accumulated to obtain Σk; When the user's gaze deflection angle value is detected to be outside the specified angle range, the accumulation of the deflection dwell time and the product of the deflection dwell time and the deflection angle is stopped, and the result is stored in the created user data storage space. Using the accumulated data of the deflection dwell time and the product of the deflection dwell time and the deflection angle stored in the storage space, the updated attention deflection angle alarm threshold is calculated, and the angle range is updated based on the updated attention deflection angle alarm threshold to perform iterative calculation of the attention deflection angle alarm threshold.

[0040] According to the formula: Calculate the updated attention-shifted-to-the-left alarm threshold, where, For the user's line of sight to the left during driving, To examine the product of the angle of visual deflection and the duration of dwell time while observing the environment to the left of the vehicle, To observe the duration of eye contact with the environment on the left side of the vehicle; According to the formula: Calculate the updated attention-to-the-right alarm threshold, where, For the user's line of sight to the right during driving, To examine the product of the angle of visual deflection and the duration of dwell time while observing the environment on the right side of the vehicle, To observe the duration of eye contact with the environment on the right side of the vehicle.

[0041] When the user's gaze deflection angle exceeds the updated attention deflection alarm threshold and the duration exceeds the set time, an alarm signal is issued to the user. The alarm signal includes visual (such as text or symbols), auditory (such as sound), or tactile (such as vibration) alarm signals.

[0042] To illustrate this concept, we analyze, collect, and record the maximum average angle of a user's gaze deflection to the left or right during normal driving. Assume the controller recognizes the user's gaze. The vehicle is currently being driven. During the driving process, it was detected that the user's gaze shifted to the left, and the angle of the shift fell within ( ). -15° Within a range of +15°, the controller accumulates the time within this angular range, and the accumulated result is recorded as... The product of deflection time and deflection angle is accumulated, and the accumulated result is denoted as... When user n's line of sight deflects at an angle value away from ( -15° Within a range of +15°, the controller stops accumulating the above time and product, and then stores the accumulated time and product data. Deposit user In the first data point. Subsequently, the controller follows the formula. Calculate users Alarm threshold for angle of gaze to the left As the updated left-leaning alarm threshold At the same time, according to Update valid value range ( -15° +15° will be used as the range for the next valid data. If the user's gaze is again detected to the left during driving, and the deflection angle falls within (...), then... -15° Within a range of +15°, the controller accumulates the time within this angular range, and the accumulated result is recorded as... The product of deflection time and deflection angle is accumulated, and the accumulated result is denoted as... When the user The angle of the gaze deflection is away from ( -15° Within a range of +15°, the controller stops accumulating the above time and product data, and then records the accumulated time and product data. Deposit user In the second data point. Subsequently, the controller follows the formula. Calculate users Alarm threshold for leftward gaze As the updated alarm threshold for leftward gaze deviation. At the same time, according to Update valid value range ( -15° L+15°), serving as the range for the next valid data. User The same logic applies to subsequent cases where the user's gaze shifts to the left. During the driving process, the driver's gaze shifted to the left for the 101st time, and the angle of deviation fell within ( ). -15° Within a range of +15°, the controller accumulates the time and product using the method described above, and then accumulates this set of time and product data. Deposit user In the first data point. Subsequently, the controller follows the formula. Calculate users Alarm threshold for leftward gaze As the updated alarm threshold At the same time, according to Update valid value range ( -15° +15°) is used as the range for the next valid data. The user's 102nd instance is the same as the user's 2nd instance, and so on, allowing the controller to continuously collect and record user data. The user's line of sight is normally tilted to the left, and the angle data is iteratively calculated. The alarm threshold for leftward deviation of the line of sight. (User) Data acquisition and alarm threshold iteration calculation for right-angled vision are obtained using the same method as for left-angled vision.

[0043] For other different users, the above method is used to collect data and iteratively calculate alarm thresholds for each user whose line of sight is to the left or right.

[0044] Understandably, by analyzing, collecting, and recording the angle of each user's gaze during driving, the controller can quickly iterate and update the alarm thresholds for left and right gaze deviations. This allows the system to rapidly learn the user's left / right gaze deviation habits and quickly iterate new alarm thresholds when the user's habits change or their posture is adjusted. This makes the system highly adaptable to factors such as user habits and posture.

[0045] It should also be noted that the iteration begins when the user starts the vehicle and ends when the user gets out of the vehicle.

[0046] Reference Figure 2 , Figure 2 The diagram shown is a schematic of an attention alarm threshold update device provided by the present invention. Figure 2 As shown, the device includes: Setting module 201: It is used to set the range of attention deflection angle based on the initial default attention deflection angle alarm threshold.

[0047] Judgment module 202: It is used to determine whether the angle of deflection of the user's line of sight during driving falls within the angle range.

[0048] Processing module 203: If it is determined that the angle of deflection of the user's gaze during driving falls within the angle range, it iteratively calculates the attention deflection angle alarm threshold based on the angle of deflection and the time of deflection of the user's gaze during driving, so as to automatically update the alarm threshold and generate an alarm threshold that matches different users.

[0049] Furthermore, in one possible implementation, the processing module is also used to accumulate the user's line of sight deflection dwell time within the angle range and the product of the deflection dwell time and the deflection angle. When the user's gaze deflection angle value is detected to be outside the specified angle range, the accumulation of the deflection dwell time and the product of the deflection dwell time and the deflection angle is stopped, and the result is stored in the created user data storage space. Using the accumulated data of the deflection dwell time and the product of the deflection dwell time and the deflection angle stored in the storage space, the updated attention deflection angle alarm threshold is calculated, and the angle range is updated based on the updated attention deflection angle alarm threshold to perform iterative calculation of the attention deflection angle alarm threshold.

[0050] Furthermore, in one possible implementation, the processing module is also configured to process according to the formula: Calculate the updated attention-shifted-to-the-left alarm threshold, where, For the user's line of sight to the left during driving, To examine the product of the angle of visual deflection and the duration of dwell time while observing the environment to the left of the vehicle, To observe the duration of eye contact with the environment on the left side of the vehicle; According to the formula: Calculate the updated attention-to-the-right alarm threshold, where, For the user's line of sight to the right during driving, To examine the product of the angle of visual deflection and the duration of dwell time while observing the environment on the right side of the vehicle, To observe the duration of eye contact with the environment on the right side of the vehicle.

[0051] Furthermore, in one possible implementation, the processing module is also configured to issue an alarm signal to the user when it detects that the user's gaze deflection angle exceeds the updated attention deflection angle alarm threshold and the duration is greater than a set time. The alarm signal includes visual, auditory, or tactile alarm signals.

[0052] Furthermore, in one possible implementation, the setting module is also used to set, based on an initial default attention deflection angle alarm threshold, the angle range of the user's gaze deflection when looking at the environment to the left and right of the vehicle during driving, using the attention monitoring controller, wherein the angle range is... , The current user attention shift to the left alarm threshold. The current user attention shift to the right alarm threshold. The angle is set.

[0053] Furthermore, in one possible implementation, the processing module is also used to take the center point of the driver's eyeball model as the origin of the driver's line of sight; Draw lines connecting the origin to the outermost edges of the left and right side mirrors respectively. The two lines formed by these two lines and the vertical line passing through the origin create two angles. Use the angle values ​​of these two angles as the initial default values ​​for the left-biased alarm threshold and the right-biased alarm threshold, respectively.

[0054] Furthermore, in one possible implementation, the processing module is also used to create a data storage space for multiple users using the attention monitoring controller to store the identity feature information and driving habits of each user; When a user enters the vehicle, a camera captures their image and compares it with stored identity information to determine the user's identity and identify their driving habits. It should be noted that the judgment module can be a camera or other data acquisition device, while the processing module can be an attention monitoring controller.

[0055] Reference Figure 3 , Figure 3 The figure shows the default initial threshold for the line-of-sight alarm provided by this invention, such as... Figure 3 As shown: For a specific vehicle model, the initial (default) threshold for the driver's gaze deviation to the left / right warning is set below... Figure 3 The method is determined. The center point of the driver's eye model for this vehicle model is selected as the origin of the driver's line of sight. Lines are drawn from this origin to the outermost edges of the left and right side mirrors. The angles formed by these two lines and the perpendicular line passing through the origin are the initial (default) threshold for the leftward deviation warning. ), Rightward deviance alarm initial (default) threshold ( ).

[0056] In one embodiment, a camera is installed inside the cockpit, in front of the driver, to capture the driver's head image so that the image data can be sent to the controller for driver identification. At the same time, the camera captures images of the driver in real time during driving and sends them to the controller so that the controller can analyze and calculate the angle of the driver's gaze deflection.

[0057] The controller (attention monitoring controller) stores the identity information of different drivers and attention monitoring related data; it receives driver facial image data sent by the camera to identify the driver's identity; it analyzes and calculates the driver's gaze deflection angle in real time during driving, and sends an alarm message to the alarm device when the gaze deflection angle exceeds the threshold for a specified time.

[0058] After receiving an alarm signal, the alarm device provides the driver with visual (such as text or symbols), auditory (such as sound), or tactile (such as vibration) alarm signals.

[0059] Refer to the following Figure 4 To describe an electronic device 400 according to this embodiment of the present invention. Figure 4 The electronic device 400 shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of the present invention.

[0060] like Figure 4 As shown, the electronic device 400 is manifested in the form of a general-purpose computing device. The components of the electronic device 400 may include, but are not limited to: at least one processing unit 410, at least one storage unit 420, and a bus 430 connecting different system components (including storage unit 420 and processing unit 410).

[0061] The storage unit stores program code that can be executed by the processing unit 410, causing the processing unit 410 to perform the steps described in the "Embodiment Methods" section of this specification according to various exemplary embodiments of the present invention.

[0062] Storage unit 420 may include readable media in the form of volatile storage units, such as random access memory (RAM) 421 and / or cache memory 422, and may further include read-only memory (ROM) 423.

[0063] Storage unit 420 may also include a program / utility 424 having a set (at least one) of program modules 425, including but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of these examples may include an implementation of a network environment.

[0064] Bus 430 can represent one or more of several types of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local bus using any of the various bus structures.

[0065] Electronic device 400 can also communicate with one or more external devices (e.g., keyboard, pointing device, Bluetooth device, etc.), one or more devices that enable a user to interact with electronic device 400, and / or any device that enables electronic device 400 to communicate with one or more other computing devices (e.g., router, modem, etc.). This communication can be performed via input / output (I / O) interface 450. Furthermore, electronic device 400 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 460. As shown, network adapter 460 communicates with other modules of electronic device 400 via bus 430. It should be understood that, although not shown in the figures, other hardware and / or software modules can be used in conjunction with electronic device 400, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0066] From the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, terminal device, or network device, etc.) to execute the methods according to the embodiments of this disclosure.

[0067] According to the present disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the methods described above is stored. In some possible embodiments, various aspects of the present invention can also be implemented as a program product comprising program code that, when the program product is run on a terminal device, causes the terminal device to perform the steps of the various exemplary embodiments of the present invention described in the "Exemplary Methods" section above.

[0068] refer to Figure 5 As shown, a program product 500 for implementing the above-described method according to an embodiment of the present invention is described. It may employ a portable compact disc read-only memory (CD-ROM) and include program code, and may run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto. In this document, the readable storage medium may be any tangible medium containing or storing a program that may be used by or in conjunction with an instruction execution system, apparatus, or device.

[0069] The program product may employ any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A readable signal medium may also be any readable medium other than a readable storage medium, capable of sending, propagating, or transmitting programs for use by or in conjunction with an instruction execution system, apparatus, or device.

[0070] The program code contained on the readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination thereof.

[0071] Program code for performing the operations of this invention can be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java and C++, and conventional procedural programming languages ​​such as C or similar languages. The program code can execute entirely on the user's computing device, partially on the user's device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0072] Furthermore, the above figures are merely illustrative of the processes included in the method according to exemplary embodiments of the present invention, and are not intended to be limiting. It is readily understood that the processes shown in the above figures do not indicate or limit the temporal order of these processes. Additionally, it is readily understood that these processes may be executed synchronously or asynchronously, for example, in multiple modules.

[0073] The above description is merely a specific embodiment of this application, enabling those skilled in the art to understand or implement this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features claimed herein.

[0074] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

Claims

1. A method for updating an attention alarm threshold, characterized in that, include: Based on the initial default attention deflection angle alarm threshold, set the attention deflection angle range; Determine whether the angle of the user's gaze during driving falls within the specified angle range; If it is determined that the angle of the user's gaze during driving falls within the specified angle range, then based on the angle of the user's gaze during driving and the duration of the gaze, the alarm threshold for the attention deflection angle is iteratively calculated to automatically update the alarm threshold and generate an alarm threshold that matches different users.

2. The method according to claim 1, characterized in that, The iterative calculation of the attention deflection angle alarm threshold based on the user's gaze deflection angle and deflection dwell time during driving includes: The time the user's line of sight deflects and lingers within the angle range is accumulated, as well as the product of the deflection and lingering time and the deflection angle. When the user's gaze deflection angle value is detected to be outside the angle range, the deflection dwell time and the accumulation of the product of the deflection dwell time and the deflection angle are stopped, and the result is stored in the created user data storage space. Using the deflection dwell time and the accumulated data of the product of deflection dwell time and deflection angle stored in the storage space, the updated attention deflection angle alarm threshold is calculated, and the angle range is updated based on the updated attention deflection angle alarm threshold to perform iterative calculation of the attention deflection angle alarm threshold.

3. The method according to claim 2, characterized in that, Based on the aforementioned driving habits, calculate the alarm threshold for the user's attention deflection angle, including: According to the formula: Calculate the updated attention-shifted-to-the-left alarm threshold, where, For the user's line of sight to the left during driving, To examine the product of the angle of visual deflection and the duration of dwell time while observing the environment to the left of the vehicle, To observe the duration of eye contact with the environment on the left side of the vehicle; According to the formula: Calculate the updated attention-to-the-right alarm threshold, where, For the user's line of sight to the right during driving, To examine the product of the angle of visual deflection and the duration of dwell time while observing the environment on the right side of the vehicle, To observe the duration of eye contact with the environment on the right side of the vehicle.

4. The method according to claim 3, characterized in that, include: When the user's gaze deflection angle exceeds the updated attention deflection alarm threshold and the duration exceeds the set time, an alarm signal is issued to the user. The alarm signal includes visual, auditory, or tactile alarm signals.

5. The method according to claim 1, characterized in that, The process of setting the attention deflection angle range based on the initial default attention deflection angle alarm threshold includes: Based on the initial default attention deflection angle alarm threshold, the attention monitoring controller is used to set the angle range of gaze deflection when the user looks at the environment to the left and right of the vehicle while driving. This angle range is... , The current user attention shift to the left alarm threshold. The current user attention shift to the right alarm threshold. The angle is set.

6. The method according to claim 1, characterized in that, This includes the initial default attention deflection angle alarm threshold, which includes: The center point of the driver's eye model is taken as the origin of the driver's line of sight; Draw lines connecting the origin to the outermost edges of the left and right side mirrors respectively. The two lines form two angles with the vertical line passing through the origin. Use the angle values ​​of the two angles as the initial default values ​​for the left-biased alarm threshold and the right-biased alarm threshold respectively.

7. The method according to claim 1, characterized in that, Before setting the attention deflection angle range based on the initial default attention deflection angle alarm threshold, the following steps are included: The attention monitoring controller is used to create a data storage space for multiple users to store each user's identity information and driving habits; When a user enters the vehicle, the camera captures the user's image and compares it with stored identity information to determine the user's identity and obtain corresponding driving habits.

8. An attention alarm threshold update device, characterized in that, include: The setting module is used to set the range of attention deflection angle based on the initial default attention deflection angle alarm threshold; The judgment module is used to determine whether the angle of deflection of the user's line of sight during driving falls within the angle range; The processing module is used to iteratively calculate the attention deflection angle alarm threshold based on the user's gaze deflection angle and the deflection dwell time during driving if it is determined that the angle of the user's gaze deflection during driving falls within the angle range, so as to automatically update the alarm threshold and generate an alarm threshold that matches different users.

9. An electronic device, characterized in that, The electronic device includes: processor; A memory storing computer-readable instructions that, when executed by the processor, implement the method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, It stores computer program instructions that, when executed by a computer, cause the computer to perform the method according to any one of claims 1 to 7.

Images