Computing system with driver distraction detection mechanism and method of operation thereof

Abstract

The invention relates to a computing system with driver distraction detection mechanism and a method of operation thereof. A method of operation of a computing system includes: monitoring a telephone sensor array to detect a trigger; calculating a location of the cellular telephone based on the trigger and the sensor data from the telephone sensor array; predicting a driver distraction event by analyzing the sensor data and the location of the cellular phone; compiling a driver distraction assessment based on the driver distraction event and the sensor data packet from the in-vehicle sensor array; and generating a distraction rating based on the driver distraction assessment for display on the device.

Description

Technical Field

[0001] Embodiments of the present invention generally relate to a computing system, and more particularly to a system having a driver distraction detection mechanism. Background Art

[0002] Modern driving is full of distractions. With increasing traffic congestion and drivers bombarded with cell phone calls, texts, and navigation instructions, distracted driving has become a leading cause of traffic accidents. When these events occur simultaneously, drivers become overwhelmed and distracted in a split second. Research and development in existing technologies can go in countless different directions.

[0003] Therefore, there remains a need for a computing system with a driver distraction detection mechanism to monitor and identify distracted driving. Finding answers to these questions is becoming increasingly critical given the increasing commercial competitive pressures, as well as growing consumer expectations and decreasing opportunities for meaningful product differentiation in the marketplace. Furthermore, the need to reduce costs, improve efficiency and performance, and meet competitive pressures adds even greater urgency to the urgent need to find answers to these questions.

[0004] Solutions to these problems have long been sought, but prior art developments have not taught or suggested any solutions, and thus, those skilled in the art have long been unable to solve these problems. Summary of the invention

[0005] One embodiment of the present invention provides a method for operating a computing system, including: monitoring a phone sensor array to detect a trigger; calculating a location of a cellular phone based on the trigger and sensor data from the phone sensor array; predicting a driver distraction event by analyzing the sensor data and the location of the cellular phone; compiling a driver distraction assessment based on the driver distraction event and sensor data groups from the on-board sensor array; and generating a distraction rating based on the driver distraction assessment for display on a device.

[0006] One embodiment of the present invention provides a computing system including a processor circuit configured to: monitor a phone sensor array to detect a trigger; calculate a location of a cellular phone based on the trigger and sensor data from the phone sensor array; predict a driver distraction event by analyzing the sensor data and the location of the cellular phone; compile a driver distraction assessment based on the driver distraction event and sensor data groups from the onboard sensor array; and generate a distraction rating based on the driver distraction assessment for display on a device.

[0007] One embodiment of the present invention provides a non-transitory computer-readable medium comprising instructions for a computing system, including: monitoring a phone sensor array to detect a trigger; calculating a location of a cellular phone based on the trigger and sensor data from the phone sensor array; predicting a driver distraction event by analyzing the sensor data and the location of the cellular phone; compiling a driver distraction assessment based on driver distraction events and sensor data groups from an onboard sensor array; and generating a distraction rating based on the driver distraction assessment for display on a device.

[0008] Certain embodiments of the present invention have other steps or elements in addition to or in place of those mentioned above. These steps or elements will become apparent to those skilled in the art by reading the following detailed description with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 A computing system with a driver distraction detection mechanism in an embodiment of the present invention.

[0010] Figure 2 is an example of a top schematic diagram of various devices used to implement a computing system.

[0011] Figure 3 is an exemplary flow chart of driver distraction artificial intelligence in an embodiment of the present invention.

[0012] Figure 4 is an example control flow of a driver distraction detection mechanism handled by a computer system.

[0013] Figure 5 is an exemplary block diagram of a computing system.

[0014] Figure 6 is a flow chart of an operating method of a computing system in an embodiment of the present invention. DETAILED DESCRIPTION

[0015] The following embodiments may utilize vehicle sensors, environmental sensors, and cell phone monitoring sensors to determine driver distraction detection while operating or controlling the physical movement of the vehicle. Vehicle movement control may be based on detection of vehicle use by the vehicle sensors and interaction with a cell phone as determined by the cell phone monitoring sensors.

[0016] Vehicle movement control may also be based on a cognitive load corresponding to a real-time state or status of a geographic area, including a representation, location, status, or combination thereof of one or more vehicles in the geographic area. Driver distraction of a driver may be based on vehicle data representing a status of a reporting vehicle or device, cellular telephone sensor data representing sensor data associated with an environment or surroundings of a reporting device, or a combination thereof.

[0017] The following embodiments are described in sufficient detail to enable those skilled in the art to make and use the invention. It should be understood that other embodiments will be apparent based on this disclosure, and that system, process or mechanical changes may be made without departing from the scope of the embodiments of the invention.

[0018] In the following description, many specific details are given to provide a thorough understanding of the present invention. However, it will be apparent that the present invention can be practiced without these specific details. In order to avoid obscuring the embodiments of the present invention, some well-known circuits, system configurations and process steps are not disclosed in detail.

[0019] The drawings showing embodiments of the system are semi-schematic and not drawn to scale, and in particular, some dimensions are for clarity of presentation and are shown exaggerated in the drawings. Similarly, although the views in the drawings generally show similar orientations for ease of description, such depictions in the drawings are arbitrary in most cases. In general, the present invention can be operated in any orientation.

[0020] Those skilled in the art will recognize that the format in which the cell phone information is presented is not limited to some embodiments of the present invention. For example, in some embodiments, the cell phone location information is presented in the format of (X, Y, Z); wherein X, Y, and Z are three coordinates defining a geographic location, i.e., the location of the user's cell phone.

[0021] The term "driver distraction" as referred to herein may include factors that affect the driver's attention during active periods, including executing planned maneuvers, handling non-call uses of a cellular phone, reacting to maneuvers detected by vehicle sensors, querying the in-vehicle infotainment system, and interacting with a cellular phone while the vehicle is in motion. Increased driver distraction may increase the likelihood that the driver will miss instructions or increase the risk of an accident. The term "infotainment system" may include circuits and systems that may provide navigation instructions, music, point of interest identification and support, cellular phone / text-to-speech interaction, vehicle alarm notifications, or a combination thereof.

[0022] Many of the embodiments described may take the form of computer executable or controller executable instructions, including routines executed by a programmable computer or controller. Embodiments may be practiced on a computer or controller system other than those shown and described. The technology described herein may be implemented in a special-purpose computer or data processor, which may be programmed, configured or implemented to execute one or more of the computer executable instructions described below. Thus, the terms "computer" and "controller" generally used herein refer to any processor, and may include Internet appliances and handheld devices, including palmtop computers, wearable computers, cellular or mobile phones, multiprocessor systems, processor-based or programmable consumer electronics, network computers, microcomputers, etc. The information handled by these computers and controllers may be presented on any suitable display medium. Instructions for executing computer or controller executable tasks may be stored in or on any computer-readable medium, including hardware, firmware, or a combination thereof. Instructions may be included in any memory device, including, for example, a flash drive or a USB device.

[0023] The terms "coupling" and "connection" and their derivatives can be used in this article to describe the structural relationship between components. It should be understood that these terms are not intended to be synonyms of each other. More specifically, in a particular embodiment, "connection" can be used to indicate that two or more elements are in direct contact with each other. Unless the context otherwise indicates, the term "coupling" can be used to indicate that two or more elements are in direct or indirect (with other elements in the middle) contact with each other, or two or more elements cooperate or interact with each other (for example, as a causal relationship, such as for signal transmission / reception or function call), or both.

[0024] The term "module" referred to herein may include or be implemented as or included in the software running on dedicated hardware, hardware, or a combination thereof in the present invention, depending on the context in which it is used. For example, software may be machine code, firmware, embedded code, and application software. Software may also include functions, calls to functions, code blocks, or a combination thereof. For another example, hardware may be a gate, a circuit system, a processor, a computer, an integrated circuit, an integrated circuit core, a pressure sensor, an inertial sensor, a micro-electromechanical system (MEMS), a passive device, a physical non-transitory memory medium, including instructions for executing software functions, a part thereof, or a combination thereof, to control one or more of the hardware units or circuits. In addition, if "module" or "unit" is written in the system claim section below, then for the purpose and scope of the system claim, "module" or "unit" is considered to include a hardware circuit system.

[0025] The modules or units in the description of the following embodiments may be coupled or attached to each other as described or shown. The coupling or attachment may be direct or indirect, and there may be an intermediate or no intermediate between the coupled or attached modules or units. The coupling or attachment may be physical contact, or may be through communication between the modules or units, such as wireless communication.

[0026] It should also be understood that the nouns or elements in the embodiments can be described as singular instances. It should also be understood that the usage of the singular is not limited to the singular, but the singular usage can be applied to multiple instances of any particular noun or element in the application. Multiple instances can be the same or similar, or can be different. It should also be understood that nouns or elements described as plural can also be used as singular, and are not limited to the singular.

[0027] Reference now Figure 1 , which shows a computing system 100 with a driver distraction detection mechanism in an embodiment of the present invention. The computing system 100 may include a first device 102 (such as a client or server) coupled to a second device 106 (such as a client or server). The first device 102 may monitor the speed 103 of the vehicle during operation of the first device 102.

[0028] Computing system 100 may include systems for analyzing information provided by vehicle sensor array 108, driver distraction monitor 110, phone sensor array 114, or a combination thereof. First device 102 may communicate with second device 106 over network 104, such as a wireless or wired network.

[0029] For example, the first device 102 can be any of a variety of computing devices, such as a cellular phone, a personal digital assistant, a notebook computer, a wearable device, an Internet of Things (IoT) device, an automotive telematics system, or other multi-function device. Also, for example, the first device 102 can include a device or subsystem, an autonomous or self-manipulated vehicle or object, a manually controlled vehicle, a remotely controlled vehicle or object, or a combination thereof.

[0030] The first device 102 may be coupled to the network 104 either directly or indirectly to communicate with the second device 106, or may be a standalone device. The first device 102 may also be standalone or integrated with a vehicle such as a car, truck, bus, or train.

[0031] For illustrative purposes, the computing system 100 is described with the first device 102 as a mobile computing device, but it is understood that the first device 102 can be different types of devices. For example, the first device 102 can also be a non-mobile computing device, such as a server, a server cluster, or a desktop computer.

[0032] The second device 106 can be various centralized or decentralized computing devices, or high-definition video processing devices. For example, the second device 106 can be a computer, a grid computing resource, a virtualized computer resource, a cloud computing resource, a router, a switch, a peer-to-peer distributed computing device, or a combination thereof.

[0033] The second device 106 can be centralized in a single room, distributed in different rooms, distributed in different geographical locations, embedded in a telecommunications network. The second device 106 can be coupled to the network 104 to communicate with the first device 102. The second device 106 can also be a client-type device, as described for the first device 102.

[0034] For purposes of illustration, the computing system 100 is described with the second device 106 as a non-mobile computing device, but it is understood that the second device 106 can be a different type of computing device. For example, the second device 106 can also be a mobile computing device, such as a laptop, another client device, a wearable device, or a different type of client device. The second device 106 can be a stand-alone device, or can be integrated with a vehicle, such as a car, truck, bus, or train.

[0035] Furthermore, for the purpose of illustration, the computing system 100 is described with the second device 106 as a computing device, but it is understood that the second device 106 can be a different type of device. Furthermore, for the purpose of illustration, the computing system 100 is shown with the second device 106 and the first device 102 as endpoints of the network 104, but it is understood that the computing system 100 can include different partitions between the first device 102, the second device 106, and the network 104. For example, the first device 102, the second device 106, or a combination thereof can also be used as part of the network 104.

[0036] The network 104 can span and represent various networks. For example, the network 104 can include wireless communication, wired communication, optical, ultrasonic, or a combination thereof. Satellite communication, cellular communication, Bluetooth, infrared data association standard (IrDA), wireless fidelity (WiFi), and world interoperability for microwave access (WiMAX) are examples of wireless communications that can be included in the communication path. Ethernet, digital subscriber line (DSL), fiber to the home (FTTH), and plain old telephone service (POTS) are examples of wired communications that can be included in the network 104. In addition, the network 104 can span a variety of network topologies and distances. For example, the network 104 can include a direct connection, a personal area network (PAN), a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), or a combination thereof.

[0037] The computing system 100 may provide additional features not available in prior art driver distraction detection systems. The first device 102 may include a driver distraction monitor 110 and an onboard sensor array 108. The driver distraction monitor 110 may be software executed on a specific hardware platform, software implemented in hardware, or a combination thereof to assess the timing of delivering and receiving information between the computing system 100 and the user 112 when the first device 102 is operated. The driver distraction monitor 110 may receive detailed information from the onboard sensor array 108 of the first device 102 in order to assess the degree of distraction that the user 112 is experiencing.

[0038] The onboard sensor array 108 provides detailed information about the operation of the first device 102 and obstacles or vehicles operating in the area of ​​the first device 102. For example, the onboard sensor array 108 can provide timely details about the operation and current status of the first device 102. The onboard sensor array 108 can be coupled to the driver distraction monitor 110 to access the sensor data group 111. For example, the sensor data group 111 can provide information captured by the onboard sensor array 108, including the wandering of the first device 102, the change in the speed 103 of the first device 102, the proximity to obstacles, and the time and location 107 of the information captured by the onboard sensor array 108 and recorded in the driver distraction monitor 110. The sensor data group 111 can include the current location of the first device 102, the current operating condition of the first device 102, and the conditions around the first device 102. The driver distraction monitor 110 can monitor the timing of the communication between the user 112 and the computing system 100 to detect the distraction rating 109 of the user 112.

[0039] The computing system 100 may be operated by a user 112. The user 112 may include a person or entity that accesses or uses the computing system 100 or a device therein. For example, the user 112 may include a person operating the first device 102 and designated as the driver 112. The computing system 100 may also monitor passengers 116 that may interact with the computing system 100, which may increase the distraction rating 109 of the driver 112.

[0040] The computing system 100 may also process a phone sensor array 114 from the user 112 or the passenger 116. The phone sensor array 114 may be a gravity sensor, a magnetometer, an accelerometer on a specific hardware platform, implemented in hardware and coordinated by software, or a combination thereof. The phone sensor array 114 may be configured to analyze interactions between the phone sensor array 114 and the user 112 or the passenger 116. The phone sensor array 114 may be accessed by the user 112 directly or indirectly on the first device 102. The phone sensor array 114 may process input or stimuli that are directly used for or related to corresponding software, applications, features, or a combination thereof.

[0041] The phone sensor array 114 can be managed by the driver distraction monitor 110 and transmit information to it in order to capture the timing of the audio interaction 124 between the user 112 and the computing system 100. The audio interaction 124 can be music requested by the user 112, navigation instructions 120, user responses 122, or other exchanges. As an example, the navigation instructions 120 can be other audio communications, including music, clarification of the requested service request, an alert or warning statement of the distraction rating 109 of the first device 102, or a warning of road conditions, speed limit changes, and instructions for navigating the first device 102. The user response 122 can include a request for information about points of interest, services, accommodation, and clarification of a previous call or non-call application request. For example, the audio interaction 124 can include a user 112 requesting a parking reservation, initiating a conference call, or accessing a podcast. Although the audio interaction 124 itself is harmless, if delivered during an increase in user 112 activity, they will increase the distraction rating of the user 112 and compromise the safety of the first device 102.

[0042] For example, the user 112 may request directions to a nearby gas station. The phone sensor array 114 may receive the request via the user response 122 and pass the request to the driver distraction monitor 110 for processing. When the driver distraction monitor 110 identifies a route to the nearby gas station, the navigation instructions 120 may be transmitted back to the phone sensor array 114 for publication to the user 112. During this process, the user 112 may focus on controlling the first device 102 and any obstacles that may force the first device 102 to take evasive maneuvers, thereby monitoring the user's 112 distraction and improving safety.

[0043] The second device 106 can support the driver distraction monitor 110 by analyzing the distraction rating 109. The second device 106 can receive the distraction rating 109 and the sensor data packet 111 from the first device 102 via the network 104. The second device 106 can process the distraction rating 109 and the sensor data packet 111 to generate a driver distraction assessment 117.

[0044] The second device 106 can process the distraction rating 109 and the sensor data packet 111 to generate a driver distraction assessment 117. For example, the second device 106 can verify the distraction rating 109 and the sensor data packet 111 by checking the time and location 107 information to identify that they represent a logged event 118. The combination of the navigation instruction 120 and the user response 122 is considered to be a physical contact 122 or an audio interaction 124 that can be monitored by the phone sensor array 114.

[0045] The driver distraction assessment 117 can assess the level of distraction that the driver 112 is experiencing. The distraction rating 109 indicates that the driver 112 is engaged in a distraction event that reduces the attention of the driver 112. By evaluating the sensor data packets 111, the driver distraction assessment 117 can determine changes in lane position, changes in the speed 103 of the vehicle 102, and proximity to obstacles while driving to assess the risk posed by the driver 112 being distracted.

[0046] The second device 106 can be coupled to a driver distraction AI 115, such as a trigger qualification that feeds a convolutional neural network for evaluating the level of driver distraction experienced during a trip while operating the first device 102. The driver distraction AI 115 can evaluate the distraction rating 109 to determine whether it is significant to the operation of the first device 102.

[0047] For example, the logged event 118 may be an indicator of the level of distraction experienced by the driver 112 during the trip. When the time period 107 for which the user 112 interacts with the phone sensor array 114 exceeds eight seconds, the driver distraction artificial intelligence 115 may predict a minor distraction, and when the time period 107 for which the user 112 interacts with the phone sensor array 114 exceeds 20 seconds, the driver distraction artificial intelligence 115 may log the event as a driver distraction and save the event to a second device 106, such as a cloud server 106.

[0048] It will be appreciated that passenger 116 may interact with phone sensor array 114 without increasing distraction rating 109 of user 112. In the event that passenger 116 does distract user 112, vehicle sensor array 108 may detect changes in speed 103, changes in lane position, proximity to obstacles, or a combination thereof.

[0049] Reference now Figure 2 , which shows the method for implementing Figure 1 2 is an example of a top view illustration of various devices of computing system 100. Computing system 100 may include or interact with vehicle 202.

[0050] Vehicle 202 is an object or machine used to transport people or goods, and people or goods can automatically manipulate or operate the object or machine. Vehicle 202 may include Figure 1 A vehicle accessible to a user 112 in the system for controlling, manipulating, operating, or a combination thereof. For example, the vehicle 202 may include a car, a truck, a cart, a drone, or a combination thereof.

[0051] Vehicle 202 can also be operated without Figure 1 The vehicle 202 may be controlled or manipulated in the presence of the phone sensor array 114 corresponding to the manipulation or movement. For example, the vehicle 202 may include automatic maneuvering features such as smart cruise control or preventive braking. The user 112 may operate the vehicle 202 using the phone sensor array 114 to provide monitoring of the usage of the cellular phone 203 during operation of the vehicle 202.

[0052] Figure 1 The on-board sensor array 108 can provide information about Figure 1 The onboard sensor array 108 may also provide information describing or representing the surroundings or environment of the first device 102 or the vehicle 202 during operation of the vehicle 202. For example, the onboard sensor array 108 may provide speed limit data, accessory or feature status, sensor data, traffic data, road condition data, Figure 1 The user responds to 122 options or combinations thereof.

[0053] Also, for example, the onboard sensor array 108 may provide an accessory status 226. The accessory status 226 may represent or describe a state of a circuit, function, feature, or combination thereof for the vehicle 202. As a more specific example, the accessory status 226 may include an on-off state, level, or magnitude, or a combination thereof, of lights, environmental settings, doors or trunks, windshield wipers, communication settings, braking systems, steering directions, signal indicators, or a combination thereof of the vehicle 202.

[0054] The vehicle 202 interfaced with the computing system 100 may include devices, circuits, one or more specific sensors (such as environmental sensors 210), or a combination thereof, for providing assistance or additional information to the user 112 controlling, manipulating, or operating the vehicle 202. The vehicle 202 or any other vehicle may include vehicle communication circuitry 204, vehicle control circuitry 206, vehicle storage circuitry 208, other interfaces, or a combination thereof.

[0055] The vehicle storage circuit 208 may include a functional unit or circuit integrated with the corresponding control vehicle and configured to store and recall information, including the distraction rating 109, vehicle status, Figure 1The vehicle storage circuit 208 may be a volatile memory, a non-volatile memory, an internal memory, an external memory, or a combination thereof. For example, the vehicle storage circuit 208 may be a non-volatile storage device such as a non-volatile random access memory (NVRAM), a flash memory, a disk storage device, or a volatile storage device such as a static random access memory (SRAM). The vehicle storage circuit 208 may record synchronized streams from the onboard sensor array 108, including visual sensors 214, such as a high-definition camera sensor 214, a radar sensor 216, an accessory sensor 218, or a combination thereof. The separate streams may be combined to generate the sensor data packet 111. The components of the onboard sensor array 108 will be discussed in further detail below.

[0056] Vehicle storage circuitry 208 may store vehicle software, other relevant data such as input information, information from sensors, processing results, information predetermined or preloaded by computing system 100 or a vehicle manufacturer, or a combination thereof. Vehicle storage circuitry 208 serves as primary storage for vehicle control circuitry 206 .

[0057] Vehicle control circuitry 206 may include functional units or circuits integrated into vehicle 202 and configured to execute or implement instructions. Vehicle control circuitry 206 may execute or implement vehicle software to provide intelligence for vehicle 202, computing system 100, or a combination thereof.

[0058] The vehicle control circuit 206 can be implemented in a variety of different ways. For example, the vehicle control circuit 206 can be a processor, an application specific integrated circuit (ASIC), an embedded processor, a microprocessor, hardware control logic, a hardware finite state machine (FSM), a digital signal processor (DSP), or a combination thereof. As a more specific example, the vehicle control circuit 206 can include an engine control unit, one or more central processing units, or a combination thereof. The vehicle control circuit 206 can communicate with other components or components of the vehicle 202 via the vehicle communication circuit 204. Figure 1 The second device 106 communicates with the second device 106.

[0059] The vehicle communication circuit 204 may include a functional unit or circuit integrated with the vehicle 202. The vehicle communication circuit 204 may be configured to enable external communication with the vehicle 202. For example, the vehicle communication circuit 204 may allow the vehicle 202 to communicate with the vehicle 202. Figure 1 The first device 102, the second device 106, or a combination thereof communicates with each other.

[0060] The vehicle communication circuit 204 may also function as a communication hub, allowing the vehicle 202 to function as part of the network 104 and not be limited to being an endpoint or terminal circuit for the network 104. The vehicle communication circuit 204 may include active and passive components, such as microelectronics, semiconductor devices, or antennas, for interacting with the network 104. For example, the vehicle communication circuit 204 may include a modem, a transmitter, a receiver, a port, a connector, or a combination thereof, for wired communication, wireless communication, or a combination thereof.

[0061] The vehicle communication circuit 204 can be coupled to the network 104 to directly send or receive information between the vehicle communication circuit 204 and the first device 102, the second device 106, or a combination thereof as communication endpoints, such as for direct line-of-sight communication or peer-to-peer communication. The vehicle communication circuit 204 can also be coupled to the network 104 to send or receive information through a server or another intermediate device between the communication endpoints.

[0062] The vehicle 202 or other vehicle may also include various interfaces. The vehicle 202 may include one or more interfaces for interaction or internal communication between functional units or circuits of the vehicle 202. For example, the vehicle 202 may include one or more interfaces (such as drivers, firmware, wired connections or buses, protocols, or combinations thereof) for the vehicle storage circuit 208, the vehicle control circuit 206, or a combination thereof.

[0063] The vehicle 202 may also include one or more interfaces and switches or actuators for physically controlling movable components of the vehicle 202. For example, the vehicle 202 may include one or more interfaces and controls to physically perform and control maneuvers of the vehicle 202, such as manual steering, smart cruise control, or steering features.

[0064] Functional units or circuits in the vehicle 202 can work individually and independently of other functional units or circuits. The vehicle 202 can work independently of the first device 102, the network 104, the second device 106, other devices or vehicles, or a combination thereof.

[0065] The above functional units or circuits may be implemented in hardware. For example, one or more of the functional units or circuits may be implemented using a gate, a circuit system, a processor, a computer, an integrated circuit, an integrated circuit core, a pressure sensor, an inertial sensor, a micro-electromechanical system (MEMS), a passive device, a physical non-transitory memory medium containing instructions for executing software functions, a portion thereof, or a combination thereof.

[0066] The environmental sensors 210 are each a device or circuit for detecting or identifying the environment of the corresponding vehicle. The environmental sensors 210 can detect, identify, determine, or a combination thereof, such as the condition, surroundings, or movement of the corresponding vehicle. The environmental sensors 210 can detect, identify, determine, or a combination thereof, the environment inside the cabin of the vehicle 202, the environment outside and around the vehicle 202, or a combination thereof. The environmental sensors 210 can be implemented for the vehicle 202, the cellular phone 203, the first device 102, or a combination thereof.

[0067] For example, the environmental sensor 210 may include a position-motion sensor 212, a visual sensor 214 (such as a high-definition camera sensor 214), a radar sensor 216, an accessory sensor 218, or a combination thereof. The position-motion sensor 212 may include a sensor for identifying or calculating the geographic location of the vehicle 202 or the first device 102, determining the location of the vehicle 202 or the first device 102, or determining the location of the vehicle 202 or the first device 102. Figure 1 The position-motion sensor 212 may include a sensor for the movement or speed 103 of the vehicle 202, the physical movement of the cellular phone 203, or a combination thereof. The position-motion sensor 212 may include an accelerometer, a speedometer, a global positioning system (GPS) receiver or device, a gyroscope, or a compass, or a combination thereof. In addition to or in addition to the position-motion sensor 212, which may provide lane information to help identify the location of the vehicle 202, the vehicle 202 may include an environmental sensor 210. The position-motion sensor 212 may monitor lane position and speed 103 during operation of the vehicle 202 as part of the distraction rating 109.

[0068] The visual sensor 214 may include a sensor for detecting or determining visual information representing the interior and exterior of the vehicle 202 and the surrounding environment, including a high-definition camera sensor 214. The visual sensor 214 may include a camera attached to or integrated with the vehicle 202 or the first device 102. For example, the visual sensor 214 may include a camera such as a forward-facing camera, a rear-view or reverse camera, a side-view or blind spot camera, an in-vehicle camera, or a combination thereof, for detecting obstacles near the vehicle. In addition, for example, the visual sensor 214 may include an infrared sensor or a night vision sensor.

[0069] The visual sensor 214 may also include a camera on the first device 102 or another user device of the user 112 that is connected to and interacting with the vehicle 202. The visual sensor 214 may also include an interior cabin camera for detecting or determining visual information within the vehicle 202 or a cabin of the vehicle 202. The visual sensor 214 operating as a cabin camera may monitor the stress level or attention of the user 112 while the vehicle 202 is operating. The visual sensor 214 may be a high-definition camera that supports the JPEG2000 standard or higher. The visual sensor 214 will have a minimum 4096 x 4096 pixel density for creating Figure 1 The sensor data is grouped 111.

[0070] The radar sensor 216 may include an object detection system, device, or circuit. The radar sensor 216 may determine or identify the presence of an object or target, such as an obstacle near the vehicle 202, an obstacle outside the first device 102 or the vehicle 202, a relative position or distance between the object or target and the first device 102 or the vehicle 202, or a combination thereof.

[0071] The radar sensor 216 can utilize radio waves to determine or identify the presence of an object or target, a relative position or distance from the vehicle 202 or the first device 102, or a combination thereof. For example, the radar sensor 216 can include a proximity sensor or warning system, such as for an area that is geographically or physically located in front of, behind, adjacent to, or to the side of the vehicle 202, or a combination thereof, relative to the vehicle 202.

[0072] The accessory sensor 218 may include a sensor for determining or detecting a condition of a subsystem or feature of the first device 102 or the vehicle 202. The accessory sensor 218 may determine or detect a condition or setting of the vehicle 202's windshield wipers, turn signals, gear settings, headlights, steering wheel direction, brake pressure, speed 103, acceleration, or a combination thereof.

[0073] The computing system 100 may use one or more environmental sensors 210 corresponding to one or more devices, one or more vehicles 202, or a combination thereof to generate route details 109 that describe or represent information about the environment within or around the corresponding device or vehicle 202. The route details 109 may be further processed using the vehicle control circuitry 206, stored in the vehicle storage circuitry 208, communicated to another device or vehicle via the vehicle communication circuitry 204, or a combination thereof.

[0074] As a more specific example, the vehicle communication circuit 204, the vehicle control circuit 206, the vehicle storage circuit 208, the environmental sensor 210, one or more interfaces, or a combination thereof, may be included in the first device 102 or constitute the first device 102, and the first device 102 is included in the vehicle 202 or is integrated with the vehicle 202. Also as a more specific example, the vehicle 202 may include the first device 102 or be integrated with the first device 102, including an embedded navigation system, an infotainment system, an intelligent driving or driver assistance system, a self-driving or manipulation system for the vehicle 202, or a combination thereof.

[0075] The computer system 100 can control, steer, generate corresponding signals or navigation instructions for the vehicle 202 based on the lane currently occupied or traveled, or a combination of the above operations. The computer system 100 can also generate or process vehicle movement control 228 based on manual input from the user 112.

[0076] The computer system 100 may process the vehicle movement control 228 to control or manipulate the vehicle 202. The vehicle movement control 228 is an instruction, signal, process, method, mechanism, or combination thereof for directing or controlling the physical movement or travel of the vehicle 202.

[0077] For example, the computer system 100 may monitor the vehicle movement control 228 to maneuver or control the vehicle 202 based on or in accordance with the lane of travel of the vehicle 202 and specifically with respect to the lane occupied by or being crossed by the vehicle 202 .

[0078] The computing system 100 can communicate the distraction rating 109 between the second device 106, the first device 102, the network 104, the vehicle 202, the cellular phone 203, or a combination thereof. For an illustrative example, the computing system 100 can include the first device 102 within a vehicle 202, the group of vehicles being located within a predetermined distance, being relatively positioned according to a predetermined arrangement, or a combination thereof.

[0079] Continuing with this example, computing system 100 can utilize distraction rating 109 to provide information, evaluate maneuvers, or a combination thereof to other vehicles, such as a separate vehicle including another instance of vehicle 202. Computing system 100 can transmit distraction rating 109 to vehicle 202 directly from second device 106 or through first device 102 for processing and storage.

[0080] Continuing with this example, computing system 100 can transmit distraction rating 109 to other devices or vehicles via second device 106, or directly to other devices or vehicles, such as for a peer-to-peer communication system. Computing system 100 can transmit distraction rating 109 to notify other devices about the performance of user 112 of vehicle 202, or a combination thereof.

[0081] Cell phone 203 can access Figure 1 The phone sensor array 114 in the vehicle 202 is used to identify the fixed position of the cell phone 203 during operation of the vehicle 202. For example, the position of the cell phone 203 can be calculated by a gravity sensor (not shown), which can be used to calculate the tilt angle θ230 with respect to the X axis 232. The gravity sensor for the X axis 232 will present a value of gSinθ, where g is gravity. The gravity sensor for the Z axis 234 will present a value of gCosθ. To calculate the tilt angle θ230:

[0082]

[0083] Among them G x is the reading of the gravity sensor of the X-axis 232 and g is the gravity constant.

[0084] The phone sensor array 113 may monitor changes in the tilt angle θ 230 to determine whether the cellular phone 203 is being accessed. Figure 1 The driver distraction artificial intelligence 115 can establish thresholds and trigger conditions to distinguish accidental vibrations from intentional contact with the cellular phone 203. Figure 1 The gravity sensor reading at time t107 can be defined as:

[0085]

[0086] in is a gravity sensor for the X-axis of the cellular phone 203; is a gravity sensor for the Y-axis of the cellular phone 203; and It is a gravity sensor for the Z axis of the cellular phone 203 .

[0087] The trigger for detecting movement of the cell phone 203 may be defined as follows:

[0088] G t , G t+Δt Deviation = 5, where Δt = 500ms

[0089] It should be understood that the trigger is composed of gravity sensors of all three axes, and the deviation = 5 is the combination of the three gravity sensors. Since the response of the gravity sensor has a slow time constant, the deviation of five will be detected before it becomes six.

[0090] Reference now Figure 3, which shows an exemplary block diagram of the driver distraction artificial intelligence 115 in an embodiment of the present invention. The exemplary block diagram of the driver distraction artificial intelligence 115 depicts a start block 302. The start block 302 can be an entry point for the driver distraction artificial intelligence 115. The start block 302 can be coupled to a trigger detection circuit 304, which can determine Figure 2 There is movement in the cellular phone 203. If no trigger is detected, the trigger detection circuit 304 continues to check.

[0091] If the trigger detection circuit 304 does detect a trigger, it activates the wait 2 seconds circuit 306 to eliminate false triggers. The wait 2 seconds circuit 306 can be coupled to the wait complete block 308 to determine whether two seconds have passed. When the wait 2 seconds circuit 306 determines that the two second wait has completed, the collect 6 seconds circuit 310 can be used to collect 6 seconds from the Figure 1 The phone sensor array 114 and Figure 1 The sensor data packets 111 of the sensor data packets 111 collect sensor data 311. While continuously collecting data from the phone sensor array 114 and the sensor data packets 111, the capture completion circuit 312 can count down six seconds of captured data.

[0092] When data capture is complete, a T=0 check circuit is activated to determine if this is the first time the driver distraction artificial intelligence 115 has been activated. Based on the first activation of the driver distraction artificial intelligence 115, a save signal to memory circuit is activated so that the phone sensor array 114 and sensor data packets 111 are stored in the vehicle storage circuit 208. The captured data 318 can be transferred from the vehicle storage circuit 208 to the signal injector circuit 320.

[0093] The captured data 318 may be transmitted to a signal smoother circuit 324 where it is combined with the output of the signal injector circuit 320. The combination of the signals adds a hysteresis 325 to the data transmitted to a convolutional neural network 326 that was previously trained to detect driver distraction events 327. The prediction stack 328 may be located in the vehicle storage circuit 208 for further processing. The driver distraction event 327 may be checked by the no-hangup 7 circuit 330, where the phone sensor array 114 may be scanned until there is a seven-second call completion indication. If the no-hangup 7 circuit 330 does not detect a call completion indication, then the collection 6 circuit 310 is reactivated to collect additional samples of sensor data 311 and sensor data packets 111 of the phone sensor array 114. If a call completion indication is detected, then the extraction and analysis event circuit 332 is activated. The extraction and analysis event circuit 332 may retrieve the driver distraction event 327 from the prediction stack 328 to determine if there is a call, non-call activity, or non-use of the cell phone 203 on the cell phone 203. For example, non-call activities may include text messaging, requesting navigation instructions verbally or via a touch screen, accessing the Internet, or a combination thereof.

[0094] The phone over 20 circuit may be activated to determine if the call on the cellular phone 203 lasts for more than twenty seconds. If the phone over 20 circuit 336 does recognize that a call has occurred, the send event to cloud circuit 338 may be activated to transmit the event as logged data 337 to the Figure 1 The second device 106.

[0095] The trip completion check circuit 340 can determine whether the vehicle 202 is still being operated in the trip. If the trip completion check circuit 340 determines that the vehicle 202 is still being operated, then the start square block 302 is reactivated and the process will restart. However, if the trip completion check circuit 340 determines that the vehicle 202 is no longer being operated, then the stop square block is activated.

[0096] It has been discovered that the computing system 100 can provide the driver distraction artificial intelligence 115 to monitor the phone sensor array 114 and the sensor data packets 111 to capture and identify driver distraction events 327. By analyzing the driver distraction events 327, the driver distraction artificial intelligence 115 can log calls on the cell phone 203, non-call activity on the cell phone 203, and non-use of the cell phone 203 during the trip. Analysis of the driver distraction events 327 can provide an indication of the level of distraction experienced by the driver 112 during the trip. This information can be used for driver 112 training or risk assessment for insurance purposes.

[0097] Reference now Figure 4, which shows an exemplary control flow of a driver distraction detection mechanism 401 processed by the computing system 100. The exemplary control flow of the driver distraction detection mechanism 401 depicts a driver process 402, wherein Figure 1 Driver 112 operation Figure 2 After the driver process 402 is completed, the trigger state 404 is entered. The trigger state 404 includes a trigger detector 406 coupled to a trigger verifier 408. The trigger detector 406 can be Figure 1 The phone sensor array 114 monitors Figure 2 The location of the cell phone 203 is determined by the trigger verifier 408. The change in the location of the cell phone 203 indicates a call, a non-call event, or a transient collision. The trigger verifier 408 can eliminate the transient collision and confirm either a call or a non-call event. Once the trigger verifier 408 confirms that the trigger is valid, the process will enter the wait 2 block 410, waiting for a two-second delay as a noise reduction delay for non-call and no phone use events.

[0098] When the wait 2 block 410 is complete, the process enters the machine learning classifier state 412. The machine learning classifier state 412 begins at the clock 6 block 414, which collects Figure 1 The sensor data packet 111 and the data from the phone sensor array 114 for a six second period. Figure 3 The sensor data 311 is applied to an adder 416, which adds the sensor data from Figure 1 The current data at time T 107 is combined with the old data from time T-1 107. The adder 416 may apply the lag 325 to the sensor data 311 submitted to the signal smoothing block 418.

[0099] The signal smoothing block 418 can be Figure 3 The sensor data 311 is processed by a convolutional neural network 326 in the embodiment of the present invention, which has been trained to detect call events, non-call events, non-use of the phone, or a combination thereof. For example, the identification of call events and non-call events can provide reasons for driver distraction, but the sensor data group 111 can be based on wandering in the lane, Figure 1 The degree of distraction is quantified by changes in speed 103 in the image, proximity to obstacles, or a combination thereof.

[0100] The signal smoothing block 418 may separate the events and then submit them to the neural network classifier 420 for accounting for the events. The signal smoothing block 418 also stores the time T event 422 in the vehicle storage circuit 208. The vehicle storage circuit 208 also provides a time T-1 event 424 that may be applied to the adder 416. The neural network classifier 420 may provide a time T prediction 426 that is stored in the prediction stack 328 for further analysis.

[0101] The prediction stack 328 may provide a prediction sequence 428 of the analyzed event types. The prediction sequence 428 may be submitted to a prediction activity monitoring state 430. The prediction activity monitoring state 430 includes a trigger 2 check 432 that monitors transitions of events. Transitions of events may include hang up the phone, end a non-call event, or never use the phone transition.

[0102] Trigger 2 check 432 may be implemented with the same trigger as detecting movement of the cellular telephone 203 .

[0103] Trigger 2 is defined as: G t , G t+Δt , deviation = 5, where Δt = 500ms

[0104]

[0105] The release of the cell phone 203 can be determined simply by monitoring the gravity sensor of the Z-axis, as shown above.

[0106] If the trigger 2 check 432 does not detect one of the transition events, then the flow returns to the clock 6 block 414 to collect another six seconds of sensor data packets 111 and sensor data 311 from the phone sensor array 114. If the trigger 2 check 432 identifies the detected event 434 as one of the transition events, then the flow returns to the trigger detector 406 to start the flow again. When the duration of the detected event 434 exceeds 20 seconds, the detected event 434 is sent to the cloud 436, such as Figure 1 The second device 106.

[0107] It has been discovered that the driver distraction detection mechanism 401 can monitor the sensor data packets 111 and the sensor data 311 from the phone sensor array 114 to determine Figure 1 The presence and degree of driver distraction experienced by the driver 112 can be determined by monitoring the movement of the cell phone 203. By monitoring the movement of the cell phone 203, it can be predicted whether the event is a call, a non-call event, or not using the cell phone 203. Once an event related to the cell phone 203 is detected, it can be predicted by monitoring Figure 2The degree of distraction can be determined by the lane position of the vehicle 202, the change in speed 103, and the proximity to any obstacles. The results can be used to educate the driver 112 or to assess the driver's ability to resist distraction for insurance purposes.

[0108] Reference now Figure 5 , which shows Figure 1 5. The computing system 100 may include a first device 102, a network 104, and a second device 106. The first device 102 may send information to the second device 106 via the network 104 in a first device transmission 508. The second device 106 may send information to the first device 102 via the network 104 in a second device transmission 510.

[0109] For illustrative purposes, the computing system 100 is shown with the first device 102 as a client device, but it is understood that the computing system 100 may include the first device 102 as different types of devices, including Figure 2 The first device 102 may be a server including a display interface.

[0110] Furthermore, for illustrative purposes, the computing system 100 is shown with the second device 106 as a server, but it is understood that the computing system 100 may include the second device 106 as a different type of device. For example, the second device 106 may be a client device.

[0111] Moreover, for illustrative purposes, the computing system 100 is shown with the interaction between the first device 102 and the second device 106. However, it is understood that the first device 102 can be similarly connected to the second device 106. Figure 2 Similarly, the second device 106 can interact with the vehicle 202 in a similar manner.

[0112] In this embodiment of the invention, for simplicity of description, the first device 102 will be described as a client device and the second device 106 will be described as a server device. Embodiments of the invention are not limited to this selection of device types. This selection is an example of an embodiment of the invention.

[0113] The first device 102 may include a first control circuit 512, a first storage circuit 514, a first communication circuit 516, a first user interface 518, and a first positioning circuit 520. The first control circuit 512 may include a first control interface 522. The first control circuit 512 may execute a first software 526 to provide intelligence of the computing system 100 to enable Figure 1 The vehicle sensor array 108 transmits the sensor data packet 111, and calculates Figure 1 The distraction rating is 109.

[0114] The first control circuit 512 can be implemented in a variety of different ways. For example, the first control circuit 512 can be a processor, an application specific integrated circuit (ASIC), an embedded processor, a microprocessor, a hardware control logic, a hardware finite state machine (FSM), a digital signal processor (DSP), or a combination thereof. The first control interface 522 can be used for communication between the first control circuit 512 and other functional units or circuits in the first device 102. The first control interface 522 can also be used for communication outside the first device 102.

[0115] The first control interface 522 can receive information from other functional units / circuits or from external sources, or can transmit information to other functional units / circuits or to external destinations. External sources and external destinations refer to sources and destinations external to the first device 102.

[0116] The first control interface 522 can be implemented in different ways and can include different implementations, depending on which functional units / circuits or external units / circuits are interfaced with the first control interface 322. For example, the first control interface 322 can be implemented with a pressure sensor, an inertial sensor, a micro-electromechanical system (MEMS), an optical circuit, a waveguide, a wireless circuit, a wired circuit, or a combination thereof.

[0117] The first storage circuit 514 may store the first software 526. The first storage circuit 514 may also store related information, such as Figure 3 The sensor data 311 indicates Figure 1 Phone sensor array 114, sensor data group 111, distraction rating 109, Figure 4 time T event 422, or a combination thereof.

[0118] The first storage circuit 514 may be a volatile memory, a non-volatile memory, an internal memory, an external memory, or a combination thereof. For example, the first storage circuit 514 may be a non-volatile memory such as a non-volatile random access memory (NVRAM), a flash memory, a disk storage device, or a volatile memory such as a static random access memory (SRAM).

[0119] The first storage circuit 514 may include a first storage interface 524. The first storage interface 524 may be used for communication between the first storage circuit 514 and other functional units or circuits in the first device 102 (such as the onboard sensor array 108, the first control circuit 512, the first communication circuit 516, or a combination thereof). The first storage interface 524 may also be used for communication outside the first device 102.

[0120] The first storage interface 524 can receive information from the other functional units / circuits or from external sources, or can transmit information to the other functional units / circuits or to external destinations. External sources and external destinations refer to sources and destinations external to the first device 102.

[0121] The first storage interface 524 can include different implementations depending on which functional units / circuits or external units / circuits are interfaced with the first storage circuit 514. The first storage interface 524 can be implemented with technologies and techniques similar to the implementations of the first control interface 522.

[0122] The first communication circuit 516 can enable external communications with the first device 102. For example, the first communication circuit 516 can allow the first device 102 to communicate with the second device 106, an accessory (such as a peripheral device or a desktop computer), and the network 104.

[0123] The first communication circuit 516 may also function as a communication hub, allowing the first device 102 to function as part of the network 104 and not be limited to an endpoint or terminal circuit of the network 104. The first communication circuit 516 may include active and passive components for interacting with the network 104, such as microelectronics or an antenna.

[0124] The first communication circuit 516 may include a first communication interface 528. The first communication interface 528 may be used for communication between the first communication circuit 516 and other functional units or circuits in the first device 102. For example, the first communication circuit 516 may retrieve the sensor data packet 111 from the onboard sensor array 108 via the first storage interface 524 for transmission to the second device 106 for further processing and analysis. The first communication interface 528 may receive information, including the distraction rating 109, from the second device 106 for distribution to other functional units / circuits, or may transmit the information to other functional units or circuits.

[0125] The first communication interface 528 can include different implementations, depending on which functional units or circuits are interfaced with the first communication circuit 516. The first communication interface 528 can be implemented with technologies and techniques similar to the implementations of the first control interface 522.

[0126] The first user interface 518 allows Figure 1 The user 112 interfaces and interacts with the first device 102 through the phone sensor array 114. The first user interface 518 may include input devices and output devices that can be operated through the phone sensor array 114. Examples of input devices of the first user interface 518 may include a keypad, a touch pad, soft keys, a keyboard, a microphone, an infrared sensor for receiving remote signals, or any combination thereof to provide data and communication input. For example, Figure 1 The driver distraction monitor 110 in the can be input to the first user interface 518 through the wireless audio connection. The first user interface 518 can pass input from the phone sensor array 114 to the first control circuit 112 for processing and storage.

[0127] The first user interface 518 can include a first display interface 530. The first display interface 530 can include an output device. The first display interface 530 can include a display, a projector, a video screen, a speaker, or any combination thereof.

[0128] The first control circuit 512 may operate the first user interface 518 to display information generated by the computing system 100, such as the distraction rating 109 of the driver 112, or to enable Figure 1 The first control circuit 512 may also execute the first software 526 for other functions of the computing system 100, including receiving location information from the first positioning circuit 520 and logging the current route 533. The first control circuit 512 may also execute the first software 526 to interact with the network 104 via the first communication circuit 516.

[0129] The first control circuit 512 can operate the first user interface 518 to collect data from the user 112 in the form of a user response 122, including a point of interest request, a service request, an accommodation request, a cellular phone activation request, or a combination thereof. The first control circuit 512 can also receive location information from the first positioning circuit 520. The first control circuit 512 can compile the sensor data packet 111, including the location data from the first positioning circuit 520, Figure 1 The first control circuit 512 may send the sensor data packet 111 and the sensor data 311 from the phone sensor array 114 to the second device 106 via the first communication circuit 516 for processing.

[0130] As an example, the first positioning circuit 520 can generate the location information, current heading, current acceleration and Figure 1 The first positioning circuit 520 can be implemented in many ways. For example, the first positioning circuit 520 can be used as at least a part of a global positioning system, an inertial navigation system, a cellular tower positioning system, a pressure positioning system, or any combination thereof. Moreover, for example, the first positioning circuit 520 can utilize components such as an accelerometer or a global positioning system (GPS) receiver. The first positioning circuit 520 can provide distance information to the first control circuit 512 to calculate a pseudorange for a global positioning system or a cellular tower positioning system.

[0131] The first positioning circuit 520 may include a first positioning interface 532. The first positioning interface 532 may be used for communication between the first positioning circuit 520 and other functional units or circuits in the first device 102. The first positioning interface 532 may also be used for communication outside the first device 102.

[0132] The first positioning interface 532 can receive information from other functional units / circuits or from external sources, or can transmit information to other functional units / circuits or to external destinations. External sources and external destinations refer to sources and destinations external to the first device 102.

[0133] The first positioning interface 532 may include different implementations, depending on which functional units / circuits or external units / circuits are interfaced with the first positioning circuit 520. The first positioning interface 532 may be implemented with similar techniques as the implementation of the first control circuit 512. It is understood that the first positioning circuit 520 and the first positioning interface 532 are part of the first device 102, the vehicle 202, or a combination thereof, or may be integrated into the first device 102, the vehicle 202, or a combination thereof.

[0134] The second device 106 may be optimized to implement embodiments of the present invention in a multi-device embodiment with the first device 102. The second device 106 may provide additional or higher performance processing capabilities compared to the first device 102. The second device 106 may include a second control circuit 534, a second communication circuit 536, a second user interface 538, and a second storage circuit 546.

[0135] The second user interface 538 allows a user (not shown) to interface and interact with the second device 106. The second user interface 538 may include an input device and an output device. Examples of the input devices of the second user interface 538 may include a keypad, a touch pad, soft keys, a keyboard, a microphone or any combination thereof to provide data and communication input. Examples of the output devices of the second user interface 538 may include a second display interface 540. The second display interface 540 may include a display, a projector, a video screen, a speaker or any combination thereof.

[0136] The second control circuit 534 can receive the sensor data packet 111 through the second communication circuit 536. The second control circuit can verify the contents of the sensor data packet 111 and the sensor data 311 from the phone sensor array 114 to generate the distraction rating 109. Once the distraction rating 109 is ready to be transmitted to the first device 102, the second communication circuit can transmit the distraction rating 109 through the second device transmission 510.

[0137] The second control circuit 534 can execute the second software 542 to provide the intelligence of the second device 106 of the computing system 100. The second software 542 can operate in conjunction with the first software 526. Compared to the first control circuit 512, the second control circuit 534 can provide additional capabilities.

[0138] The second control circuit 534 can operate the second user interface 538 to display information. The second control circuit 534 can also execute the second software 342 for other functions of the computing system 100, including operating the second communication circuit 536 to communicate with the first device 102 over the network 104.

[0139] The second control circuit 534 can be implemented in many different ways. For example, the second control circuit 534 can be a processor, an embedded processor, a microprocessor, a hardware control logic, a hardware finite state machine (FSM), a digital signal processor (DSP), or a combination thereof.

[0140] The second control circuit 534 may include a second control interface 544. The second control interface 544 may be used for communication between the second control circuit 534 and other functional units or circuits in the second device 106. The second control interface 544 may also be used for communication outside the second device 106.

[0141] The second control interface 544 can receive information from the other functional units / circuits or from external sources, or can transmit information to the other functional units / circuits or to external destinations. External sources and external destinations refer to sources and destinations external to the second device 106 .

[0142] The second control interface 544 can be implemented in different ways and can include different implementations depending on which functional units / circuits or external units / circuits are interfaced with the second control interface 544. For example, the second control interface 544 can be implemented with a pressure sensor, an inertial sensor, a micro-electromechanical system (MEMS), an optical circuit system, a waveguide, a wireless circuit system, a wired circuit system, or a combination thereof.

[0143] The second storage circuit 546 can store the second software 542. The second storage circuit 546 can also store data such as data representing incoming events, data representing Figure 2 The second storage circuit 546 may be sized to provide additional storage capacity to supplement the first storage circuit 514.

[0144] For purposes of illustration, the second storage circuit 546 is shown as a single element, but it is understood that the second storage circuit 546 can be a distribution of storage elements. Moreover, for purposes of illustration, the computing system 100 is shown with the second storage circuit 546 as a single hierarchical storage system, but it is understood that the computing system 100 can include the second storage circuit 546 in different configurations. For example, the second storage circuit 546 can be formed with different storage technologies to form a memory hierarchy system including different levels of cache, main memory, rotating media, or offline storage devices.

[0145] The second storage circuit 546 may be a volatile memory, a non-volatile memory, an internal memory, an external memory, or a combination thereof. For example, the second storage circuit 546 may be a non-volatile storage device such as a non-volatile random access memory (NVRAM), a flash memory, a disk memory, or a volatile memory such as a static random access memory (SRAM).

[0146] The second storage circuit 546 can include a second storage interface 548. The second storage interface 548 can be used for communication between the second storage circuit 546 and other functional units or circuits in the second device 106. The second storage interface 548 can also be used for communication outside the second device 106, such as the driver distraction artificial intelligence 115, which can perform the driver distraction assessment 117 and manage the logging events 118.

[0147] The second storage interface 548 can receive information from the other functional units / circuitry or from external sources, or can transmit information to the other functional units / circuitry or to external destinations. External sources and external destinations refer to sources and destinations external to the second device 106 .

[0148] The second storage interface 548 can include different implementations depending on which functional units / circuits or external units / circuits are interfaced with the second storage circuit 546. The second storage interface 548 can be implemented with technologies and techniques similar to the implementations of the second control interface 544.

[0149] The second communication circuit 536 can enable external communication with the second device 106. For example, the second communication circuit 536 can allow the second device 106 to communicate with the first device 102 via the network 104. For example, the second device 106 can respond to the user 112. Figure 3 The distraction rating 109 is provided to the first device 102 based on the driver distraction event 327 .

[0150] The second communication circuit 536 may also function as a communication hub, allowing the second device 106 to function as part of the communication path 104 and not be limited to an endpoint or terminal unit or circuit of the network 104. The second communication circuit 536 may include active and passive components for interacting with the network 104, such as microelectronics or an antenna.

[0151] The second communication circuit 536 may include a second communication interface 550. The second communication interface 550 may be used for communication between the second communication circuit 536 and other functional units or circuits in the second device 106. The second communication interface 550 may receive information from other functional units / circuits or may transmit information to other functional units or circuits.

[0152] The second communication interface 550 can include different implementations, depending on which functional units or circuits are interfaced with the second communication circuit 536. The second communication interface 550 can be implemented with technologies or techniques similar to the implementations of the second control interface 544.

[0153] First communication circuit 516 can be coupled to network 104 to send sensor data packet 111 including current route 113 in first device transmission 508 to second device 106. Second device 106 can receive information from first device transmission 508 of network 104 in second communication circuit 536.

[0154] The second communication circuit 536 can be coupled to the network 104 to send information to the first device 102 in the second device transmission 510. The first device 102 can receive information from the second device transmission 510 of the network 104 in the first communication circuit 516. The computing system 100 can be executed by the first control circuit 512, the second control circuit 534, or a combination thereof. For illustrative purposes, the second device 106 is shown as having a partition including a second user interface 538, a second storage circuit 546, a second control circuit 534, and a second communication circuit 536, but it is understood that the second device 106 can include different partitions. For example, the second software 342 can be partitioned differently so that some or all of its functions can be in the second control circuit 534 and the second communication circuit 536. Moreover, for clarity, the second device 106 can include Figure 5 Other functional units or circuits not shown.

[0155] The functional units or circuits in the first device 102 can work individually and independently of other functional units or circuits. The first device 102 can work individually and independently of the second device 106 and the network 104.

[0156] The functional units or circuits in the second device 106 can work individually and independently of other functional units or circuits. The second device 106 can work individually and independently of the first device 102 and the network 104.

[0157] The above functional units or circuits may be implemented in hardware. For example, one or more functional units or circuits may be implemented using gates, circuit systems, processors, computers, integrated circuits, integrated circuit cores, pressure sensors, inertial sensors, micro-electromechanical systems (MEMS), passive devices, physical non-transitory storage media containing instructions for executing software functions, a portion thereof, or a combination thereof.

[0158] For illustrative purposes, the computing system 100 is described through the operation of the first device 102 and the second device 106. It should be understood that the first device 102 and the second device 106 can operate any modules and functions of the computing system 100.

[0159] As another example, the first device 102 may be the vehicle 202. The first user interface 518 may receive a Figure 2 Position-motion sensor 212, Figure 2 Visual sensor 214 (such as Figure 2 High-definition camera sensor 214), Figure 2 Radar sensor 216, Figure 2 The sensor data packets 111 may be generated by the first control circuit 512 from the position-motion sensor 212, the visual sensor 214 (such as a high-definition camera sensor 214), the radar sensor 216, the accessory sensor 218, or a combination thereof. The sensor data packets 111 may be sent to the second device 106 via the first communication circuit 516 and the network 104 to be incorporated into the distraction rating 109.

[0160] It has been discovered that the first device 102 can transmit the sensor data group 111 and the sensor data 311 from the phone sensor array 114 to the second device 106 to evaluate the distraction rating 109. The first control unit 512 can operate the driver distraction monitor 110 to manage the sensor data 311 from the phone sensor array 114 in the communication between the user 112 and the computing system 100 through the audio interaction 124 or physical contact with the cellular phone 203. By monitoring the sensor data group 111 and the sensor data 311 from the phone sensor array 114 to derive the distraction rating 109, the user 112 can be alerted through the display and the alert through the audio interaction 124 of excessive distraction that may cause errors or accidents due to the distraction of the user 112.

[0161] Reference now Figure 6, which shows an embodiment of the present invention Figure 1 6. The method 600 includes: monitoring a phone sensor array to detect a trigger in block 602; calculating a location of a cellular phone based on the trigger and sensor data from the phone sensor array in block 604; predicting a driver distraction event by analyzing the sensor data and the location of the cellular phone in block 606; compiling a driver distraction assessment based on the driver distraction event and the sensor data group from the onboard sensor array in block 608; and generating a distraction rating based on the driver distraction assessment for display on the device in block 610.

[0162] The resulting method, process, apparatus, device, product and / or system is straightforward, cost-effective, uncomplicated, highly versatile, accurate, sensitive and effective, and can be implemented by adapting known components to readily available, efficient and economical manufacturing, application and utilization. Another important aspect of the embodiments of the present invention is that it valuable supports and serves the historical trend of reducing costs, simplifying systems and improving performance.

[0163] Accordingly, these and other valuable aspects of embodiments of the present invention further advance the state of the technology to at least the next level.

[0164] Although the present invention has been described in conjunction with a specific best mode, it should be understood that many alternatives, modifications and variations will be apparent to those skilled in the art from the foregoing description. Thus, it is intended to cover all such alternatives, modifications and variations that fall within the scope of the included claims. All matters set forth herein or shown in the accompanying drawings should be interpreted in an illustrative and non-restrictive sense.

Claims

1. A method for operating a computing system, comprising: monitoring the phone sensor array to detect triggers; calculating a location of the cellular telephone based on the trigger and sensor data from a sensor array of the telephone; Predicting driver distraction events by analyzing sensor data and the location of cellular phones; compiling a driver distraction assessment based on driver distraction events and sensor data packets from an onboard sensor array; as well as A distraction rating is generated based on the driver distraction assessment for display on the device. 2 . The method of claim 1 , wherein predicting a driver distraction event comprises detecting audio interaction or physical contact with a cellular telephone.

3. The method of claim 1 further comprising monitoring passengers via a phone sensor array to increase a driver distraction rating in response to a driver distraction event. 4 . The method of claim 1 , further comprising adding hysteresis to the sensor data by adding a time T-1 event to the time T sensor data. 5 . The method of claim 1 , further comprising monitoring the audio interactions to calculate driver distraction events by capturing the timing of the audio interactions. 6 . The method of claim 1 , wherein compiling the driver distraction assessment includes identifying from the sensor data packets a time of a driver distraction event having a device speed change.

7. The method of claim 1 , wherein predicting driver distraction events comprises smoothing captured data for analysis by a pre-trained driver distraction artificial intelligence.

8. A computing system comprising: The control circuit is configured as follows: monitoring the phone sensor array to detect triggers; calculating a location of the cellular telephone based on the trigger and sensor data from a sensor array of the telephone; Predicting driver distraction events by analyzing sensor data and the location of cellular phones; compiling a driver distraction assessment based on driver distraction events and sensor data packets from an onboard sensor array; as well as A distraction rating is generated based on the driver distraction assessment for display on the device.

9. The system of claim 8, wherein: To predict driver distraction events, the control circuit is configured to detect audio interaction or physical contact with the cellular telephone via the driver distraction monitor.

10. The system of claim 8, wherein the control circuit is further configured to monitor the passenger via the phone sensor array to increase the driver's distraction rating in response to the driver distraction event.

11. The system of claim 8, wherein the control circuit is configured to add hysteresis to the sensor data by adding the time T-1 event to the time T sensor data by an adder.

12. The system of claim 8, wherein the control circuit is further configured to monitor the audio interactions to calculate driver distraction events by timing when the audio interactions are captured by the driver distraction monitor.

13. The system of claim 8, wherein: To compile the driver distraction assessment, the control circuit is configured to identify, from the sensor data packets, times of driver distraction events with changes in device speed.

14. The system of claim 8, wherein: To predict driver distraction events, the control circuitry is configured to smooth the captured data for analysis by the pre-trained driver distraction AI.

15. A non-transitory computer readable medium comprising instructions for a navigation system, comprising instructions for: monitoring the phone sensor array to detect triggers; calculating a location of the cellular telephone based on the trigger and sensor data from a sensor array of the telephone; Predicting driver distraction events by analyzing sensor data and the location of cellular phones; compiling a driver distraction assessment based on driver distraction events and sensor data packets from an onboard sensor array; as well as A distraction rating is generated based on the driver distraction assessment for display on the device. 16 . The non-transitory computer readable medium of claim 15 , wherein the instructions for predicting a driver distraction event include instructions for detecting audio interaction or physical contact with a cellular telephone.

17. The non-transitory computer readable medium of claim 15, further comprising instructions for monitoring passengers via a phone sensor array to increase a driver's distraction rating in response to a driver distraction event.

18. The non-transitory computer readable medium of claim 15, further comprising instructions for adding hysteresis to the sensor data by adding a time T-1 event to the time T sensor data.

19. The non-transitory computer readable medium of claim 15, further comprising instructions for monitoring audio interactions to calculate driver distraction events by capturing the timing of the audio interactions.

20. The non-transitory computer readable medium of claim 15, wherein the instructions for compiling a driver distraction assessment include instructions for identifying a time of a driver distraction event with a device speed change from the sensor data packets.

Images