Distraction driving judgment method and system, electronic equipment and storage medium

By using camera equipment in the vehicle to judge the user's line of sight towards the dashboard and time it, the problems of low accuracy and reduced safety factor of the DMS system when judging distracted driving behavior are solved, and more accurate distracted driving behavior detection and safety are achieved Driving reminder.

CN119058714APending Publication Date: 2024-12-03SHANGHAI PATEO ELECTRONIC EQUIPMENT MANUFACTURING CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310594540.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-24
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

The DMS system in existing vehicles has low accuracy when judging user distracted driving behavior, and incorrect judgments will cause instrument information to be blocked and reduce the safe driving coefficient.

Method used

The user's image is taken through the camera device, and it is determined whether the user's line of sight is facing the dashboard, and the judgment operation of distracted driving behavior is paused, and timing is started. When the timer reaches the set time and the user's line of sight is always facing the dashboard, determine that the user is distracted driving and perform the corresponding reminder operation.

Benefits of technology

It improves the accuracy of distracted driving behavior judgments, avoids occlusion of instrument information caused by wrong judgments, and improves the safe driving coefficient.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119058714A_ABST
    Figure CN119058714A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a distracted driving judgment method and system, electronic equipment and a storage medium. The method comprises the following steps: determining whether the sight of a user faces an instrument panel or not according to a user image shot by camera equipment in a target vehicle; in response to the situation that the sight line of the user faces the instrument panel, pausing the judgment operation of the distraction driving behavior, and starting timing; and determining that the user has the distracted driving behavior under the condition that the timing duration reaches the set duration and the sight line of the user faces the instrument panel all the time. According to the embodiment of the invention, the accuracy of distraction driving judgment can be improved, and the safe driving coefficient is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of driving technology, and in particular to a distracted driving judgment method, system, electronic device and storage medium. Background Art

[0002] With the development of technology, vehicles have more and more functions. At present, most vehicles have DMS (Driver Monitor Status, anti-fatigue warning system) function, which can detect the user's driving fatigue, distraction and other dangerous behaviors, etc. The LCD instrument panel in the vehicle can notify the user of the current fault / alarm information through a pop-up window when a vehicle fault / ADAS function alarm occurs.

[0003] In real life, when a user looks down at the dashboard, the DMS camera will judge that the user is drowsy and will pop up a window on the LCD instrument panel to remind the user not to drive distracted or tired. Not only does it misjudge the user's behavior, but it also blocks the instrument information that the user wants to see, reducing the safety factor of driving. Summary of the invention

[0004] The embodiments of the present application provide a distracted driving judgment method, system, electronic device and storage medium to solve the problem in the related art that the judgment accuracy of the user's distracted driving behavior is low and the safety factor is reduced.

[0005] In order to solve the above technical problems, the embodiment of the present application is implemented as follows:

[0006] In a first aspect, an embodiment of the present application provides a distracted driving judgment method, comprising the following steps:

[0007] Determining whether the user's sight is directed toward the dashboard based on an image of the user captured by a camera device in the target vehicle;

[0008] In response to the user's gaze being directed toward the instrument panel, pausing the distracted driving behavior determination operation and starting a timer;

[0009] When the timing duration reaches the set duration and the user's sight is always directed toward the dashboard, it is determined that the user has distracted driving behavior.

[0010] Optionally, the determining whether the user's sight line is directed toward the dashboard according to the user image captured by a camera device in the target vehicle comprises the following steps:

[0011] Acquire device position information of the camera device in the target vehicle, and instrument position information of the instrument panel in the target vehicle;

[0012] Parsing the user image to obtain head posture information and eye posture information of the user;

[0013] Based on the device posture information, the instrument posture information, the head posture information, and the eye posture information, it is determined whether the user's line of sight is directed toward the instrument panel.

[0014] Optionally, the determining whether the user's line of sight is toward the instrument panel based on the device posture information, the instrument posture information, the head posture information, and the eye posture information comprises the following steps:

[0015] Determine, based on the device posture information and the instrument posture information, reference head posture information and reference eye posture information of the user's line of sight toward the instrument panel;

[0016] Based on the reference head pose information, the reference eye pose information, the head pose information, and the eye pose information, it is determined whether the line of sight of the user is directed toward the instrument panel.

[0017] Optionally, after the judgment operation of suspending distracted driving behavior and starting the timing, the following steps are also included:

[0018] Obtaining obstacle information around the target vehicle;

[0019] The obstacle information is displayed on the instrument panel.

[0020] Optionally, after determining whether the user's sight line is toward the dashboard based on the user image captured by the camera device in the target vehicle, the following steps are further included:

[0021] In the case where it is determined that the user's sight line is not directed toward the dashboard, determining that the user has distracted driving behavior;

[0022] Output prompt information for prompting the user to restore the driving perspective.

[0023] Optionally, after determining that the user has distracted driving behavior, the following steps are further included:

[0024] Output prompt information for prompting the user to restore the driving perspective.

[0025] Optionally, the outputting of prompting information for prompting the user to restore the driving perspective comprises the following steps:

[0026] Outputting a voice prompting message for prompting the user to restore the driving perspective; and / or

[0027] Outputting seat vibration prompt information for prompting the user to restore the driving perspective; and / or

[0028] Outputting a steering wheel vibration prompt message for prompting the user to restore the driving perspective; and / or

[0029] Output flashing prompt information for prompting the user to restore the driving perspective.

[0030] In a second aspect, an embodiment of the present application provides a distracted driving judgment system, the system comprising: a camera device and a vehicle-mounted terminal in a target vehicle,

[0031] The camera device captures a user image and sends the user image to the vehicle-mounted terminal;

[0032] The vehicle-mounted terminal determines whether the user's line of sight is directed toward the dashboard based on the user image; in response to the user's line of sight being directed toward the dashboard, the judgment operation of distracted driving behavior is suspended and timing is started; when the timing time reaches a set time, and the user's line of sight is always directed toward the dashboard, it is determined that the user has engaged in distracted driving behavior.

[0033] In a third aspect, an embodiment of the present application provides an electronic device, including:

[0034] A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program implements any of the above-mentioned distracted driving judgment methods when executed by the processor.

[0035] In a fourth aspect, an embodiment of the present application provides a readable storage medium. When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute any of the distracted driving judgment methods described above.

[0036] In an embodiment of the present application, it is determined whether the user's line of sight is directed toward the dashboard based on the image of the user captured by the camera in the target vehicle. In response to the user's line of sight being directed toward the dashboard, the judgment operation of distracted driving behavior is suspended and timing is started. When the timing duration reaches a set duration and the user's line of sight is always directed toward the dashboard, it is determined that the user has engaged in distracted driving behavior. In an embodiment of the present application, when it is determined that the user is looking at the instrument, the judgment operation of distracted driving behavior is suspended and timing is started. When the timing duration reaches a set duration, it is determined that the user has engaged in distracted driving behavior and subsequent distracted driving reminder operations are performed. Therefore, the accuracy of misjudgment of distracted driving behavior can be improved, avoiding the problem of instrument information being blocked due to misjudgment, which affects the user's driving, and improving the safety factor of driving.

[0037] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments of the present application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0039] Figure 1 A flowchart of a method for determining distracted driving provided in an embodiment of the present application;

[0040] Figure 2 A flowchart of a method for determining a user's line of sight provided in an embodiment of the present application;

[0041] Figure 3 A flowchart of another method for determining a user's line of sight provided in an embodiment of the present application;

[0042] Figure 4 A flowchart of a method for displaying obstacle information provided by an embodiment of the present application;

[0043] Figure 5 A flowchart of a method for outputting prompt information provided in an embodiment of the present application;

[0044] Figure 6 A flowchart of another method for outputting prompt information provided in an embodiment of the present application;

[0045] Figure 7 A schematic diagram of a distracted driving judgment process provided in an embodiment of the present application;

[0046] Figure 8 A schematic diagram of the structure of a distracted driving judgment system provided in an embodiment of the present application;

[0047] Fig. 9 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0048] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0049] Reference Figure 1 , which shows a flowchart of a method for judging distracted driving provided by an embodiment of the present application, such as Figure 1 As shown, the distracted driving judgment method may include: step 101, step 102 and step 103.

[0050] Step 101: Determine whether the user's line of sight is directed toward the dashboard based on the user image captured by the camera device in the target vehicle.

[0051] The embodiments of the present application can be applied to the scenario of accurately determining whether the user has distracted driving behavior through timing.

[0052] The camera device refers to a device pre-installed in the target vehicle for capturing user images. In this example, the camera device may be a DMS camera or other camera, etc. Specifically, the embodiments of the present application do not limit the specific type of the camera device.

[0053] The instrument panel refers to a rigid flat plate or structural member used to mount instruments and related devices in the target vehicle. In this example, the instrument panel can be any of the following types: a screen-type instrument panel, a frame-type instrument panel, a channel-type instrument panel, and a cabinet-type instrument panel.

[0054] When the user is driving the target vehicle, an image of the user captured by a camera in the target vehicle may be obtained, and it may be determined whether the user's sight line is directed toward the dashboard based on the user image.

[0055] In a specific implementation, the position of the camera device and the dashboard in the target vehicle can be used, and then the user's head and eye position can be analyzed based on the user image to determine whether the user's line of sight is facing the dashboard. Figure 2 This is described in detail as follows.

[0056] Reference Figure 2 , shows a flowchart of the steps of a method for determining a user's line of sight provided by an embodiment of the present application. Figure 2 As shown, the method for determining the user's line of sight may include: step 201, step 202 and step 203.

[0057] Step 201: Acquire device position information of the camera device in the target vehicle, and instrument position information of the instrument panel in the target vehicle.

[0058] In this embodiment, the device posture information of the camera device in the target vehicle and the instrument posture information of the instrument panel in the target vehicle can be obtained. In this example, the device posture information may include: the installation position and installation angle of the camera device in the target vehicle. The instrument posture information may include: the installation position and installation angle of the instrument panel in the target vehicle.

[0059] After obtaining the device position information of the camera device in the target vehicle and the instrument position information of the instrument panel in the target vehicle, step 203 is executed.

[0060] Step 202: Analyze the user image to obtain the head pose information and eye pose information of the user.

[0061] After acquiring the user image, the user image can be parsed to obtain the user's head pose information and eye pose information. In this example, the head pose information may include information such as the position and orientation of the user's head, and the eye pose information may include information such as the position and orientation of the user's eyes.

[0062] After parsing the user image to obtain the user's head pose information and eye pose information, step 203 is executed.

[0063] Step 203: Based on the device posture information, the instrument posture information, the head posture information and the eye posture information, determine whether the user's line of sight is toward the instrument panel.

[0064] After obtaining the device posture information, instrument posture information, head posture information, and eye posture information through the above steps, it is possible to determine whether the user's line of sight is toward the instrument panel based on the device posture information, instrument posture information, head posture information, and fundus posture information. Specifically, the reference head posture information and reference eye posture information when the user's line of sight is toward the instrument panel can be determined based on the device posture information and instrument posture information, and then, it is determined whether the user's line of sight is toward the instrument panel based on the reference posture and the user posture obtained by analysis. This implementation process can be combined with Figure 3 This is described in detail as follows.

[0065] Reference Figure 3 , shows a flowchart of another method for determining user sight lines provided by an embodiment of the present application. Figure 3 As shown, the method for determining the user's line of sight may include: step 301 and step 302.

[0066] Step 301: Determine reference head pose information and reference eye pose information of a user's line of sight toward the instrument panel based on the device pose information and the instrument pose information.

[0067] In this embodiment, after obtaining the device posture information of the camera device and the instrument posture information of the instrument panel, the reference head posture information and the reference eye posture information of the user's sight line toward the instrument panel can be determined according to the device posture information and the instrument posture information. That is, according to the device posture and the instrument posture, the range of the head posture and the eye posture of the sight line toward the instrument panel is established.

[0068] After determining the reference head pose information and the reference eye pose information of the user's line of sight toward the instrument panel according to the device pose information and the instrument pose information, step 302 is executed.

[0069] Step 302: Determine whether the user's line of sight is toward the instrument panel based on the reference head pose information, the reference eye pose information, the head pose information, and the eye pose information.

[0070] After determining the baseline head posture information and baseline eye posture information of the user's line of sight towards the dashboard based on the device posture information and the instrument posture information, it is possible to judge whether the user's line of sight is towards the dashboard based on the baseline head posture information, the baseline eye posture information, the user's head posture information and the user's eye posture information.

[0071] It can be understood that the reference head posture information and the reference eye posture information are both within a range of positions and orientations, and it can be determined whether the user's head posture information and eye posture information are within the range of the reference postures. If so, it can be determined that the user's line of sight is toward the instrument panel. Otherwise, it can be determined that the user's line of sight is not toward the instrument panel.

[0072] The embodiment of the present application determines a reference posture according to the posture of the instrument and the posture of the camera device, and then judges whether the user's line of sight is facing the instrument panel based on the user's head posture and eye posture analyzed from the user image, thereby improving the accuracy of judging the direction of the user's line of sight.

[0073] After determining that the user's line of sight is directed toward the dashboard, step 102 is executed.

[0074] Step 102: In response to the user's gaze being directed toward the dashboard, the distracted driving behavior determination operation is suspended and timing is started.

[0075] After determining that the user's gaze is directed toward the dashboard, the distracted driving behavior determination operation may be paused and timing may be started in response to the user's gaze being directed toward the dashboard.

[0076] In a specific implementation, in order to avoid the problem of incorrectly judging that the user has distracted driving behavior when the user's gaze is directed toward the dashboard, when it is detected that the user's gaze is directed toward the dashboard, the judgment of the type of driving behavior is temporarily stopped and a timer is started to reduce the possibility of incorrect judgment of distracted driving behavior.

[0077] After the timing starts, the obstacle information around the target vehicle can be obtained and displayed on the dashboard. Figure 4 This is described in detail as follows.

[0078] Reference Figure 4 , shows a flowchart of a method for displaying obstacle information provided by an embodiment of the present application. Figure 4 As shown, the obstacle information display method may include: step 401 and step 402.

[0079] Step 401: Obtain obstacle information around the target vehicle.

[0080] In this embodiment, when the timing starts, obstacle information around the target vehicle can be obtained. For example, obstacle information such as vehicles and pedestrians around the target vehicle can be obtained through a vehicle-mounted camera.

[0081] After obtaining the obstacle information around the target vehicle, step 402 is executed.

[0082] Step 402: Display the obstacle information on the instrument panel.

[0083] After obtaining obstacle information around the target vehicle, the obstacle information can be displayed on the dashboard. In a specific implementation, when displaying obstacle information, corresponding obstacle icons can be generated for different obstacles to be displayed on the dashboard. At the same time, obstacles can be displayed on the dashboard according to their positions relative to the target vehicle.

[0084] It is understandable that when obstacle information is displayed on the instrument panel, other information displayed on the instrument panel, such as fault lights, etc., should also be avoided. Specifically, obstacle information, etc. can be displayed in an area of ​​the instrument panel where information such as fault lights, etc. are not displayed.

[0085] The embodiment of the present application displays obstacle information around the target vehicle on the dashboard after pausing the judgment operation of distracted driving behavior and starting timing, so that when the user obtains other information through the dashboard, the user can intuitively understand the obstacle information around the vehicle, thereby improving the safety factor of driving.

[0086] In this embodiment, when it is determined from the user image that the user's line of sight is not directed toward the dashboard, it can be determined that the user has distracted driving behavior, and a prompt message is output to the user. Figure 5 This is described in detail as follows.

[0087] Reference Figure 5 , shows a flowchart of a method for outputting prompt information provided by an embodiment of the present application. Figure 5 As shown, the prompt information output method may include: step 501 and step 502.

[0088] Step 501: When it is determined that the user's line of sight is not directed toward the dashboard, it is determined that the user has distracted driving behavior.

[0089] In this embodiment, when it is determined based on the user image that the user's line of sight is not directed toward the dashboard, it can be determined that the user has distracted driving behavior.

[0090] After determining that the user has a differentiated driving behavior, step 502 is executed.

[0091] Step 502: Output prompt information for prompting the user to restore the driving perspective.

[0092] After determining that the user has a split driving behavior, prompt information for prompting the user to restore the driving perspective may be output.

[0093] In this embodiment, the prompt information may include but is not limited to the following four types:

[0094] 1. Voice prompt information, such as voice prompt information such as "Please look straight ahead and drive carefully" through the car speaker.

[0095] 2. Seat vibration reminder information, that is, the seat vibrates to remind the user to concentrate on driving.

[0096] 3. Steering wheel vibration prompt information, that is, vibrating the steering wheel to remind the user to concentrate on driving.

[0097] 4. Flashing prompt information, such as flashing ambient lights or flashing lights set on the steering wheel.

[0098] The embodiment of the present application can improve the safety factor of driving by outputting a prompt message to prompt the user to concentrate on driving when it is determined that the user has distracted driving behavior because the user's line of sight is not directed towards the dashboard.

[0099] After the distracted driving behavior determination operation is suspended and the timing is started, step 103 is executed.

[0100] Step 103: When the timing duration reaches the set duration and the user's sight line is always directed toward the dashboard, it is determined that the user has distracted driving behavior.

[0101] The set time refers to the time set in advance for detecting whether the user has distracted driving behavior. In this example, the set time may be 1 minute, 2 minutes, etc. The specific value of the set time may be determined according to business requirements, and this embodiment does not limit this.

[0102] When the timing reaches the set time and the user's line of sight is always directed toward the dashboard, it can be determined that the user may be in a state of fatigue driving, etc. At this time, it can be determined that the user has distracted driving behavior.

[0103] The embodiment of the present application suspends the distracted driving behavior judgment operation when it is judged that the user is looking at the instrument, and starts timing. When the timing reaches the set time, it is determined that the user has distracted driving behavior, and the subsequent distracted driving reminder operation is performed. Therefore, the accuracy of misjudgment of distracted driving behavior can be improved, avoiding the problem of instrument information being blocked due to misjudgment, affecting the user's driving, and improving the safety factor of driving.

[0104] When the timer reaches the set time and the user's sight is always directed toward the dashboard, it is determined that the user has distracted driving behavior, and then a prompt message can be output. Figure 6 This is described in detail as follows.

[0105] Reference Figure 6 , shows a flowchart of another method for outputting prompt information provided by an embodiment of the present application. Figure 6 As shown, the prompt information output method may include: step 601.

[0106] Step 601: Output prompt information for prompting the user to restore the driving perspective.

[0107] When the timing reaches the set time and the user's line of sight is always directed toward the dashboard, it is determined that the user has distracted driving behavior, and then a prompt message can be output to prompt the user to restore the driving perspective.

[0108] In this embodiment, the prompt information may include but is not limited to the following four types:

[0109] 1. Voice prompt information, such as voice prompt information such as "Please look straight ahead and drive carefully" through the car speaker.

[0110] 2. Seat vibration reminder information, that is, the seat vibrates to remind the user to concentrate on driving.

[0111] 3. Steering wheel vibration prompt information, that is, vibrating the steering wheel to remind the user to concentrate on driving.

[0112] 4. Flashing prompt information, such as flashing ambient lights or flashing lights set on the steering wheel.

[0113] The embodiment of the present application can improve the safety factor of driving by outputting a prompt message to prompt the user to concentrate on driving when it is determined that the user has distracted driving behavior because the user's line of sight is always directed towards the dashboard within the timing period.

[0114] The above implementation process can be combined with Figure 7 This is described in detail as follows.

[0115] Reference Figure 7 , which shows a schematic diagram of a distracted driving judgment process provided by an embodiment of the present application. Figure 7 As shown, the distracted driving judgment process may include the following steps (the camera device takes a DMS camera as an example):

[0116] Step 701: The DMS detects the position / angle of the user's head / eyes, that is, the DMS camera captures the user's image, analyzes the user's image, and obtains the position / angle of the user's head / eyes.

[0117] Step 702: Determine the direction of the user's line of sight based on the user's actual head / eye position / angle. If it is toward the front of the vehicle, continue to step 701.

[0118] Step 703: If the user's line of sight is directed in other directions, it is determined that the user has distracted driving behavior, and prompt information such as distracted driving, alarm sound / pop-up window, etc. is output.

[0119] Step 704: If the user's line of sight is toward the instrument panel, determine whether the user is acquiring instrument information.

[0120] Step 705: Determine whether the time the user stares at the dashboard exceeds a preset time for staring at the dashboard. If yes, execute step 708; if no, execute step 706.

[0121] Step 706: If the time spent staring at the dashboard does not exceed the preset time, it is not determined as distracted driving, and step 707 is executed.

[0122] Step 707: Display surrounding obstacle information (such as surrounding vehicles, pedestrians, buildings, etc.) on the instrument.

[0123] Step 708: If the time spent staring at the dashboard exceeds the preset time, it can be determined that the user stares at the dashboard for too long, and the user is judged to have distracted driving behavior, and step 709 is executed.

[0124] Step 709: Prompt an alarm sound / steering wheel or seat vibration, etc. to prompt the user to restore the driving perspective.

[0125] The distracted driving judgment method provided in the embodiment of the present application determines whether the user's line of sight is directed toward the dashboard based on the image of the user captured by the camera device in the target vehicle. In response to the user's line of sight being directed toward the dashboard, the judgment operation of distracted driving behavior is suspended and timing is started. When the timing duration reaches the set duration and the user's line of sight is always directed toward the dashboard, it is determined that the user has engaged in distracted driving behavior. The embodiment of the present application suspends the judgment operation of distracted driving behavior when it is determined that the user is looking at the instrument, and instead starts timing. When the timing duration reaches the set duration, it is determined that the user has engaged in distracted driving behavior, and subsequent distracted driving reminder operations are performed. Therefore, the accuracy of misjudgment of distracted driving behavior can be improved, avoiding the problem of instrument information being blocked due to misjudgment, which affects the user's driving, and improving the safety factor of driving.

[0126] Reference Figure 8 , shows a schematic diagram of the structure of a distracted driving judgment system provided by an embodiment of the present application. Figure 8 As shown, the distracted driving judgment system 800 may include: a camera device 810 and a vehicle terminal 820 in a target vehicle,

[0127] The camera device 810 captures a user image and sends the user image to the vehicle terminal 820;

[0128] The vehicle-mounted terminal 820 determines whether the user's gaze is directed toward the dashboard based on the user image; in response to the user's gaze being directed toward the dashboard, the judgment operation of distracted driving behavior is suspended and timing is started; when the timing duration reaches a set duration and the user's gaze is always directed toward the dashboard, it is determined that the user has engaged in distracted driving behavior.

[0129] The distracted driving judgment system provided in the embodiment of the present application determines whether the user's line of sight is directed toward the dashboard based on the image of the user captured by the camera device in the target vehicle. In response to the user's line of sight being directed toward the dashboard, the judgment operation of distracted driving behavior is suspended and timing is started. When the timing duration reaches the set duration and the user's line of sight is always directed toward the dashboard, it is determined that the user has engaged in distracted driving behavior. The embodiment of the present application suspends the judgment operation of distracted driving behavior when it is determined that the user is looking at the instrument, and instead starts timing. When the timing duration reaches the set duration, it is determined that the user has engaged in distracted driving behavior, and subsequent distracted driving reminder operations are performed. Therefore, the accuracy of misjudgment of distracted driving behavior can be improved, avoiding the problem of instrument information being blocked due to misjudgment, which affects the user's driving, and improving the safety factor of driving.

[0130] In addition, an embodiment of the present application also provides an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program implements the above-mentioned distracted driving judgment method when executed by the processor.

[0131] Fig. 9 FIG. 1 is a schematic diagram showing the structure of an electronic device 900 according to an embodiment of the present invention. Fig. 9 As shown, the electronic device 900 includes a central processing unit (CPU) 901, which can perform various appropriate actions and processes according to computer program instructions stored in a read-only memory (ROM) 902 or computer program instructions loaded from a storage unit 908 into a random access memory (RAM) 903. In the RAM 903, various programs and data required for the operation of the electronic device 900 can also be stored. The CPU 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0132] Multiple components in the electronic device 900 are connected to the I / O interface 905, including: an input unit 906, such as a keyboard, a mouse, a microphone, etc.; an output unit 907, such as various types of displays, speakers, etc.; a storage unit 908, such as a disk, an optical disk, etc.; and a communication unit 909, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 909 allows the electronic device 900 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0133] The various processes and processing described above may be performed by the processing unit 901. For example, the method of any of the above embodiments may be implemented as a computer software program, which is tangibly contained in a computer-readable medium, such as the storage unit 908. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 900 via the ROM 902 and / or the communication unit 909. When the computer program is loaded into the RAM 903 and executed by the CPU 901, one or more actions in the method described above may be performed.

[0134] The embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, each process of the above-mentioned distracted driving judgment method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it is not repeated here. The computer-readable storage medium is, for example, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0135] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0136] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0137] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

[0138] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed in the present application can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0139] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0140] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0141] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0142] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0143] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard drives, ROM, RAM, magnetic disks, or optical disks.

[0144] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A distracted driving judgment method, characterized in that: The following steps are involved: Determining whether the user's sight is directed toward the dashboard based on an image of the user captured by a camera device in the target vehicle; In response to the user's gaze being directed toward the instrument panel, pausing the distracted driving behavior determination operation and starting a timer; When the timing duration reaches the set duration and the user's sight is always directed toward the dashboard, it is determined that the user has distracted driving behavior.

2. The method according to claim 1, wherein determining whether the user's line of sight is directed toward the dashboard based on the user image captured by the camera device in the target vehicle comprises the following steps: Acquire device position information of the camera device in the target vehicle, and instrument position information of the instrument panel in the target vehicle; Parsing the user image to obtain head posture information and eye posture information of the user; Based on the device posture information, the instrument posture information, the head posture information, and the eye posture information, it is determined whether the line of sight of the user is directed toward the instrument panel.

3. The method according to claim 2, wherein determining whether the user's line of sight is toward the instrument panel based on the device posture information, the instrument posture information, the head posture information, and the eye posture information comprises the following steps: Determine, based on the device posture information and the instrument posture information, reference head posture information and reference eye posture information of the user's line of sight toward the instrument panel; Based on the reference head pose information, the reference eye pose information, the head pose information, and the eye pose information, it is determined whether the line of sight of the user is directed toward the instrument panel.

4. The method according to claim 1, after suspending the distracted driving behavior judgment operation and starting the timing, further comprises the following steps: Obtaining obstacle information around the target vehicle; The obstacle information is displayed on the instrument panel.

5. The method according to claim 1, after determining whether the user's line of sight is toward the dashboard based on the user image captured by the camera device in the target vehicle, further comprises the following steps: In the case where it is determined that the user's sight line is not directed toward the dashboard, determining that the user has distracted driving behavior; Output prompt information for prompting the user to restore the driving perspective.

6. The method according to claim 1, after determining that the user has distracted driving behavior, further comprising the following steps: Output prompt information for prompting the user to restore the driving perspective.

7. The method according to claim 5 or 6, wherein the outputting of prompting information for prompting the user to restore the driving perspective comprises the following steps: Outputting a voice prompting message for prompting the user to restore the driving perspective; and / or Outputting seat vibration prompt information for prompting the user to restore the driving perspective; and / or Outputting steering wheel vibration prompt information for prompting the user to restore the driving perspective; and / or Output flashing prompt information for prompting the user to restore the driving perspective.

8. A distracted driving judgment system, characterized in that: The system comprises: a camera device and a vehicle-mounted terminal in a target vehicle, The camera device captures a user image and sends the user image to the vehicle-mounted terminal; The vehicle-mounted terminal determines whether the user's line of sight is directed toward the dashboard based on the user image; in response to the user's line of sight being directed toward the dashboard, the judgment operation of distracted driving behavior is suspended and timing is started; when the timing time reaches a set time, and the user's line of sight is always directed toward the dashboard, it is determined that the user has engaged in distracted driving behavior.

9. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the computer program is executed by the processor, the distracted driving judgment method according to any one of claims 1 to 7 is implemented.

10. A readable storage medium, characterized in that: When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the distracted driving judgment method according to any one of claims 1 to 7.