Business support system, business support program, business support method

The system addresses inefficiencies in driver instruction by analyzing vehicle behavior and cognitive functions to provide comprehensive support for instructors, improving the effectiveness of driver training.

JP7603346B2Active Publication Date: 2024-12-20OFA SUPPORT INC
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2023558862
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2022-05-31
Filing Date
2023-05-29
Publication Date
2024-12-20
Estimated Expiration
2043-05-29

AI Technical Summary

Technical Problem

Existing systems for driver instruction lack efficiency and effectiveness in identifying and presenting relevant driving abnormalities to instructors, making it difficult to support instructors' work effectively.

Method used

A business support system that acquires vehicle behavior information, including position data, to identify abnormal and deviant driving, generates evaluation tables, and provides training information to instructors through a terminal, utilizing cognitive function prediction models to enhance instruction efficiency.

Benefits of technology

Supports instructors by providing detailed analysis and targeted training based on identified driving abnormalities and cognitive functions, enhancing the effectiveness of driver instruction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007603346000001
    Figure 0007603346000001
  • Figure 0007603346000002
    Figure 0007603346000002
  • Figure 0007603346000003
    Figure 0007603346000003
Patent Text Reader

Abstract

[Problem] To provide a technology for assisting with teaching work of an instructor. [Solution] Provided is a work assistance system that assists with work of an instructor who teaches driving of a vehicle, said work assistance system being characterized by comprising: a vehicle behavior information acquisition unit that acquires vehicle behavior information which pertains to a vehicle behavior and which includes at least position information pertaining to the vehicle that a driver is driving; an abnormal driving storage unit that receives, from the instructor, input of information pertaining to abnormal driving of the vehicle and associates and stores the information with the position information pertaining to the vehicle at the time point when the input is received; and an abnormal driving presentation unit that presents, on an information terminal which the instructor uses, the abnormal driving in association with the position information pertaining to the vehicle at the time when the input is received.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a business support system, a business support program, and a business support method. [Background technology]

[0002] Systems have been proposed for providing driving guidance to drivers. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP2015-219497A Summary of the Invention [Problem to be solved by the invention]

[0004] Although Patent Document 1 claims that the driver can objectively grasp his / her own driving, the instructor needs to search for and find the relevant point in the video for instruction and show it to the driver, which does not make the instructor's work more efficient or effective.

[0005] The present invention has been made in view of the above background, and has an object to provide a technique for supporting instructors in their teaching work. [Means for solving the problem]

[0006] In order to achieve the above-mentioned object, a business support system is provided that supports the work of an instructor who provides instruction on vehicle driving, the business support system comprising: a vehicle behavior information acquisition unit that acquires vehicle behavior information regarding the vehicle behavior including at least location information of the vehicle driven by a driver; an abnormal driving memory unit that receives input of information regarding abnormal driving of the vehicle from the instructor and stores the information in association with the location information of the vehicle at the time the input was received; and an abnormal driving presentation unit that links the abnormal driving to the location information of the vehicle at the time the input was received and presents it on an information terminal used by the instructor.

[0007] Other problems and solutions disclosed in this application will be made clear in the description of the preferred embodiments of the invention and the drawings. Effect of the Invention

[0008] According to the present invention, it is possible to support the instructor's instruction work. [Brief description of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating an example of the overall configuration of a business support system according to an embodiment of the present invention. [Diagram 2] FIG. 2 illustrates an example of a hardware configuration of a management server 30. [Diagram 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of a control device 20. [Figure 4] FIG. 2 is a diagram illustrating an example of the software configuration of a control device 20. [Diagram 5] 13 is a diagram showing an example of a screen presented by an abnormal driving presentation unit 313 on an instructor terminal. FIG. [Figure 6] FIG. 13 is a diagram showing an example of a screen on which the abnormal driving acquisition unit 312 acquires details of the abnormal driving. [Figure 7] FIG. 13 is a diagram showing an example of a screen on which a deviation driving notification unit 318 acquires details of the deviation driving. [Figure 8] FIG. 13 is a diagram showing an example of a screen on which the cognitive function information presenting unit 323 presents the cognitive function. [Figure 9]FIG. 13 is a diagram showing an example of an evaluation table generated by an evaluation table generating unit 314. [Figure 10] 2 is a diagram showing an example of a processing flow of the control device 20 of the present embodiment. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] <Summary of the Invention> The present invention will be described below with reference to the preferred embodiments thereof. [Item 1] A business support system that supports a business of an instructor who teaches vehicle driving, a vehicle event information acquisition unit that acquires vehicle event information regarding a vehicle event including at least position information of a vehicle driven by a driver; an abnormal driving storage unit that receives an input of information regarding abnormal driving of the vehicle from the instructor and stores the information in association with position information of the vehicle at the time the input is received; an abnormal driving presentation unit that links the abnormal driving with location information of the vehicle at the time when the input is received and presents the information on an information terminal used by the instructor; A business support system comprising: [Item 2] the abnormal driving storage unit receives, from the instructor, an input of the occurrence of the abnormal driving and a content of the abnormal driving at different timings; 2. The business support system according to claim 1, [Item 3] an evaluation table generating unit that generates an evaluation table of the driver's driving based on the details of the abnormal driving; 3. The business support system according to item 2, comprising: [Item 4] a training presentation unit that presents a training required for the driver on the information terminal used by the instructor based on the content of the abnormal driving; 3. The business support system according to item 2, comprising: [Item 5] a deviation driving determination unit that acquires a good vehicle behavior, which is the behavior of a vehicle driven by a good driver having normal driving skills, compares the good vehicle behavior with the vehicle behavior of the driver, and determines that deviation driving has occurred when a predetermined deviation from the good vehicle behavior has occurred; a deviation driving presentation unit that links the deviation driving with position information of the vehicle at the time when the deviation occurred and presents the information on an information terminal used by the instructor; 5. The business support system according to item 3 or 4, comprising: [Item 6] An imaging unit that captures an image of a driving situation; a video playback unit that plays the video captured by the imaging unit from a frame at a time point when the abnormal driving or the deviation driving occurs in an information terminal used by the instructor; 6. The business support system according to item 5, further comprising: [Item 7] A cognitive function storage unit that acquires and stores cognitive function information related to the cognitive function of the driver; a model generation unit that uses the vehicle behavior information and the cognitive function information of the driver as teacher data, and generates a cognitive function prediction model having the vehicle behavior information as an input and the cognitive function information as an output; a cognitive function presentation unit that receives an input of the vehicle behavior information of the driver by using the cognitive function prediction model generated by the model generation unit, and outputs the cognitive function information; 7. The business support system according to any one of items 1 to 6, comprising: [Item 8] the cognitive function presentation unit divides a course driven by the driver into sections, and sets the vehicle behavior for each section as input information for the cognitive function prediction model; 8. The business support system according to claim 7, [Item 9] A business support program for supporting a business of an instructor who teaches vehicle driving, The processor: a vehicle behavior information acquisition step of acquiring vehicle behavior information regarding a vehicle behavior including at least position information of a vehicle driven by a driver; an abnormal driving storage step of receiving an input of information regarding abnormal driving of the vehicle from the instructor and storing the information in association with position information of the vehicle at the time when the input is received; an abnormal driving presentation step of linking the abnormal driving with position information of the vehicle at the time when the input is received and presenting the information on an information terminal used by the instructor; A business support program that enables the execution of the following: [Item 10] A method for supporting a task of an instructor who provides training on vehicle driving, comprising: The processor: a vehicle behavior information acquisition step of acquiring vehicle behavior information regarding a vehicle behavior including at least position information of a vehicle driven by a driver; an abnormal driving storage step of receiving an input of information regarding abnormal driving of the vehicle from the instructor and storing the information in association with position information of the vehicle at the time when the input is received; an abnormal driving presentation step of linking the abnormal driving with position information of the vehicle at the time when the input is received and presenting the information on an information terminal used by the instructor; A business support method for carrying out the above.

[0011] Fig. 1 is a diagram showing an example of the overall configuration of a business support system according to an embodiment of the present invention. The business support system of this embodiment is configured to include a management server 10. The management server 10 is communicably connected to a control device 30 via a communication network NW. The communication network NW is, for example, the Internet, and is constructed by a public telephone line network, a mobile phone line network, a wireless communication path, Ethernet (registered trademark), or the like. The control device 30 is connected to an in-vehicle device 20 via a wired or communication network NW, or a short-range communication interface such as Bluetooth (registered trademark) or BLE (Bluetooth Low Energy).

[0012] The business support system includes a management server 10, an in-vehicle device 20, a control device 30, and an instructor terminal 40.

[0013] The management server 10 may be, for example, a general-purpose computer such as a workstation or a personal computer, or may be logically realized by cloud computing. In this embodiment, one server is illustrated for convenience of explanation, but the present invention is not limited to this and may be multiple servers.

[0014] FIG. 2 is a diagram showing an example of the hardware configuration of the management server 10. Note that the illustrated configuration is an example, and other configurations may be used. The management server 10 includes a CPU 101, a memory 102, a storage device 103, a communication interface 104, an input device 105, and an output device 106. The storage device 103 is, for example, a hard disk drive, a solid state drive, or a flash memory that stores various data and programs. The communication interface 104 is an interface for connecting to a communication network NW, and is, for example, an adapter for connecting to Ethernet (registered trademark), a modem for connecting to a public telephone line network, a wireless communication device for wireless communication, a USB (Universal Serial Bus) connector or an RS232C connector for serial communication, etc. The input device 305 is, for example, a keyboard, a mouse, a touch panel, a button, a microphone, etc. that input data. The output device 306 is, for example, a display, a printer, a speaker, etc. that output data. Each functional unit of the management server 10 described below is realized by the CPU 101 reading a program stored in the storage device 103 into the memory 102 and executing it, and each storage unit of the management server 10 is realized as part of the storage area provided by the memory 102 and the storage device 103.

[0015] The in-vehicle device 20 is a device mounted on a vehicle driven by a driver. The in-vehicle device 20 includes sensors that acquire information on the behavior of the vehicle, and may include, for example, a gyro sensor, or may include, but is not limited to, a group of sensors mounted on the automobile acquired through a CAN (Controller Area Network) (for example, sensors for speed, acceleration, engine RPM, vibration, etc., and sensors for detecting accelerator pedal depression angle, brake pedal depression angle, and steering angle). The in-vehicle device 20 may include sensors that acquire position information, and may include, for example, a GPS, a LiDAR sensor, etc. The in-vehicle device 20 may include an imaging device that captures the inside or outside of the vehicle, and may include, for example, a camera, a video camera, etc.

[0016] The instructor terminal 40 is a computer used by a driving instructor. For example, it is a smartphone, a tablet computer, a personal computer, etc. A user can access the management server 10 or the control device 30 by, for example, an application or a web browser executed on the instructor terminal 40.

[0017] The control device 30 controls the operation of the in-vehicle device 20. In addition, the control device 30 acquires information acquired by the in-vehicle device 20, and stores it in a storage unit that the control device 30 has.

[0018] FIG. 3 is a diagram showing an example of the hardware configuration of the control device 30. Note that the illustrated configuration is an example, and other configurations may be used. The control device 30 includes a CPU 301, a memory 302, a storage device 303, a communication interface 304, an input device 305, and an output device 306. The storage device 303 is, for example, a hard disk drive, a solid state drive, or a flash memory that stores various data and programs. The communication interface 304 is an interface for connecting to a communication network NW, and is, for example, an adapter for connecting to Ethernet (registered trademark), a modem for connecting to a public telephone line network, a wireless communication device for wireless communication, a USB (Universal Serial Bus) connector or an RS232C connector for serial communication, etc. The input device 305 is, for example, a keyboard, a mouse, a touch panel, a button, a microphone, etc. that input data. The output device 306 is, for example, a display, a printer, a speaker, etc. that output data. Each functional unit of the control device 30 described below is realized by the CPU 301 reading a program stored in the storage device 303 into the memory 302 and executing it, and each storage unit of the control device 30 is realized as part of the storage area provided by the memory 302 and the storage device 303.

[0019] Fig. 4 shows a functional configuration of the control device 30. As shown in Fig. 4, the control device 30 includes processing units, namely, a vehicle behavior information acquisition unit 311, an abnormal driving acquisition unit 312, an abnormal driving presentation unit 313, an evaluation table generation unit 314, an evaluation table presentation unit 315, a training presentation unit 316, a deviation driving determination unit 317, a deviation driving presentation unit 318, an imaging unit 319, a video playback unit 320, a cognitive function information acquisition unit 321, a model generation unit 322, and a cognitive function information presentation unit 323, as well as storage units, namely, a vehicle behavior information storage unit 331, an abnormal driving storage unit 332, a deviation driving storage unit 333, and a cognitive function information storage unit 334.

[0020] In addition, some or all of the processing units and memory units of the control device 30 may be provided in the server device 10, in which case the information that the control device acquires from the in-vehicle device 20 or the instructor terminal 40 or that it accepts as input may be stored in the control device 30 and then transmitted to the server device 10 via the network NW, or may be transmitted directly from the in-vehicle device 20 or the instructor terminal 40 to the server device 10 via the network NW, but is not limited to these methods.

[0021] The vehicle behavior information acquisition unit 311 acquires information on the behavior of the vehicle driven by the driver from the in-vehicle device 20. The vehicle behavior information includes, but is not limited to, information such as speed, acceleration, angular velocity, and position.

[0022] The vehicle behavior information storage unit 331 stores information on the behavior of the vehicle acquired by the vehicle behavior information acquisition unit 311. Note that the vehicle behavior information may store information such as speed, acceleration, angular velocity, and position linked to time, or may store speed, acceleration, angular velocity, and the like linked to position.

[0023] The abnormal driving acquisition unit 312 accepts input of information related to abnormal driving of the vehicle from the instructor. The abnormal driving acquisition unit 312 presents a virtual button to the instructor terminal 40, and determines the time when the instructor taps the virtual button while the driver is driving as the time when abnormal driving occurs, acquires time and position information, and stores it in the abnormal driving storage unit 332. Instead of the virtual button, the time when a button on a device such as a controller connected to the instructor terminal 40 by wire or wirelessly is pressed may be determined as the time when abnormal driving occurs, or information on the instructor's voice acquired through a microphone provided in the instructor terminal 40 may be analyzed to identify the time when the instructor uttered a predetermined word such as "dangerous," "danger," or "caution," and determine that time as the time when abnormal driving occurred.

[0024] The abnormal driving presentation unit 313 presents, on the instructor terminal 40, a map including the vicinity of the place where the driver drives (if the driving school is a driving school, a map of the driving course may be used. The same applies below.) and the position where the abnormal driving occurred on the map, as shown in an example in FIG. 5. The abnormal driving presentation unit 313 may present a driving trajectory on the map based on vehicle behavior information of the vehicle driven by the driver. The abnormal driving presentation unit 313 reads out the position of the vehicle at the time when the abnormal driving acquisition unit 312 determined that the abnormal driving occurred from the vehicle behavior information storage unit 331, and displays a mark on the map (for example, 401, 402, 403 in FIG. 5). The control device 30 may plot the position of the vehicle driven by the driver on the map with a car-shaped icon or the like.

[0025] The abnormal driving acquisition unit 312 may receive an input of the abnormal driving details from the instructor. When the instructor taps a mark (e.g., 407 in FIG. 6) plotted on a map by the abnormal driving presentation unit 313 and indicating the vehicle's position at the time of abnormal driving, as shown in an example in FIG. 6, the abnormal driving acquisition unit 312 presents candidates for the abnormal driving details and receives a selection from the instructor. The selection may be received while the driver is driving, or may be received when the driver stops driving and the vehicle is stopped. Furthermore, the abnormal driving acquisition unit 312 may present candidates for the abnormal driving details when it is determined based on the vehicle behavior information that the driver has stopped driving and the vehicle is stopped.

[0026] Candidates for abnormal driving content may be, for example, content that is subject to deductions in driving skills training courses for seniors, and may be all or any of the following, but are not limited to: target speed, failure to stop (small), failure to stop (large), keeping to the right of the road (small), keeping to the right of the road (large), skidding, running a red light (small), running a red light (large), improper climbing, auxiliary braking, etc.

[0027] Candidates for abnormal driving details may be details associated with a location, for example. For example, if the location where abnormal driving occurred is an intersection, details of abnormal driving likely to occur at that location, such as failure to stop temporarily, keeping to the right, and ignoring traffic signals, and if it is a straight line, the details of abnormal driving that are likely to occur at that location, such as target speed, swaying, and auxiliary braking, may be stored in advance. The abnormal driving acquisition unit 312 may determine the location where abnormal driving occurred, read out the details of abnormal driving stored in association with the location, and present them to the instructor terminal 40.

[0028] The evaluation table generating unit 314 generates an evaluation table of the driver's driving based on the contents of the abnormal driving. FIG. 9 is an example of the evaluation table. The evaluation table generating unit 314 reads out the scores associated with the contents of the abnormal driving stored in the control device 30, and multiplies the scores by the number of times the abnormal driving of the contents occurred to calculate a score for each content. The evaluation table generating unit 314 may calculate a total score by subtracting the calculated score from 100 points, with 100 points being the maximum score. The evaluation table generating unit 314 stores the generated evaluation table in the control device 30 or the server device 10. The evaluation table generating unit 314 may also generate the evaluation table by treating the contents of the deviation driving described later in the same manner as the above-mentioned driving contents.

[0029] The evaluation table presenting unit 315 presents the evaluation table generated by the evaluation table generating unit 314 to the instructor terminal 40. The evaluation table presenting unit 315 may also transmit the evaluation table in PDF or image format to other information terminals (including, but not limited to, terminals used by drivers and terminals on which printer drivers are installed) via the network NW.

[0030] The training presentation unit 316 presents the training information required for the driver to the instructor terminal 40 based on the details of the abnormal driving. The training information may include not only training but also rehabilitation information. The training information may include training that can be performed by the driver himself or herself and training information that requires assistance from others. The training information may include the contents of the training, the intensity of the training, the number of training sessions, a video explaining the training, and the like.

[0031] The training information is stored in the control device 30 in association with the details of the abnormal driving, and the training presentation unit 316 reads out the training information corresponding to the details of the abnormal driving from the control device 30 and presents it on the instructor terminal 40.

[0032] The training presentation unit 316 may store the driver's health condition information (e.g., medical history, muscle strength, range of motion of joints, etc.) in advance in the control device, and present training information that the driver can perform based on the health condition and the details of the abnormal driving to the instructor terminal 40. The training information is stored in the control device 30 in association with the details of the abnormal driving and the health condition, and the training presentation unit 316 may read out the training information corresponding to the details of the abnormal driving from the control device 30 and present it to the instructor terminal 40.

[0033] The training presentation unit 316 may obtain information on effective training from the driver, use the driver's vehicle behavior information, details of the abnormal driving, and information on effective training as teacher data, generate a training prediction model in which the vehicle behavior information and details of the abnormal driving are used as inputs and the training is used as output, and output training information using the training prediction model.

[0034] The training presentation unit 316 may obtain information on effective training from the driver, use the driver's vehicle behavior information, details of abnormal driving, the health condition information, and information on effective training as teacher data, generate a training prediction model whose inputs are the vehicle behavior information, details of abnormal driving, and the health condition information, and whose output is training, and output training information using the training prediction model.

[0035] The deviation driving determination unit 317 determines that the behavior of the vehicle is deviation driving, which exceeds the range of normal driving and differs from the vehicle behavior pattern of normal driving by more than a predetermined range. The deviation driving determination unit 317 acquires the behavior (good vehicle behavior) of the vehicle driven by a driver (good driver) who is assumed to have normal driving skills, such as no violation history for the past few years (the average of the behavior of the vehicles driven by multiple good drivers may be acquired), compares the vehicle behavior, and determines that deviation driving has occurred when there is a predetermined deviation from the good vehicle behavior. The predetermined deviation is, for example, a state in which a good driver with normal driving skills applies the brakes several times to decelerate several tens of meters before the stop line, but stops with a single sudden brake, and when speed information is compared, the speed of a good driver gradually decreases, but when a driver suddenly decreases the speed in a nearby area, the deviation driving determination unit 317 determines that deviation has occurred, and the time and place of the deviation are recorded in the deviation driving storage unit 333.

[0036] The deviation driving determination unit 317 may analyze the vehicle behavior information to determine deviation driving. The deviation driving determination unit 317 determines deviation driving based on a change in a target value by a predetermined value or more within a predetermined time. For example, the deviation driving determination unit 317 may determine deviation driving such as sudden acceleration or sudden braking based on an increase (or decrease) in the speed, which is one of the target values, by a predetermined value (for example, 10 km / h or more) within a predetermined time (for example, 1 second). The deviation driving determination unit 317 may similarly determine abrupt steering (the steering angle of the steering wheel within a predetermined time) or wobbling (the number of times the steering wheel is turned within a predetermined time, etc.), but is not limited thereto. The deviation driving determination unit 317 may also determine deviation driving based on a change in a target value by a predetermined value or more. The deviation driving determination unit 317 may, for example, analyze vibration information included in the vehicle behavior information to determine deviation driving such as running off the road, but is not limited thereto.

[0037] The deviation driving presentation unit 318 presents to the instructor terminal 40 a map including the area around the place where the driver is driving and the location on the map where the deviation driving occurred, as shown in an example in Fig. 5. The deviation driving presentation unit 318 reads out the vehicle's location at the time when the deviation driving determination unit 317 determined that deviation driving occurred from the vehicle behavior information storage unit 331, and displays a mark on the map (for example, 404, 405, 406 in Fig. 5). The abnormal driving presentation unit 313 and the deviation driving presentation unit 318 may present the abnormal driving and the location where the deviation driving occurred in a distinguishable manner using different colors, marks, blinking patterns, serial numbers, etc.

[0038] The deviation driving presentation unit 318 may receive an input of the details of the deviation driving from the instructor. For example, as shown in an example in FIG. 7, when the instructor taps a mark plotted on a map by the deviation driving determination unit 317 and indicating the vehicle's position at the time of the deviation driving (e.g., 408 in FIG. 7), the deviation driving presentation unit 318 presents candidates for the details of the deviation driving and receives a selection from the instructor. The selection may be received while the driver is driving, or may be received when the driver stops driving and the vehicle stops. Furthermore, the deviation driving presentation unit 318 may present candidates for the details of the deviation driving when it is determined that the driver has stopped driving and the vehicle is stopped based on the vehicle behavior information.

[0039] Candidates for deviation driving may be, for example, the contents that are the starting points in driving skills training courses for seniors, and may be all or any of the following, but no points will be deducted: failure to maintain designated speed, failure to stop (small), failure to stop (large), keeping to the right of way (small), keeping to the right of way (large), keeping to the left of way (small), keeping to the left of way (large), running off the road, ignoring a traffic light (small), ignoring a traffic light (large), improper climbing, auxiliary braking, etc.

[0040] Candidates for the contents of deviation driving may be contents associated with a location, for example. For example, the location may be an intersection, a straight road, an S-curve, parking, a crank, a slope, etc. If the location where deviation driving has occurred is an intersection, the deviation driving determination unit 317 may store the contents of deviation driving likely to occur at that location in advance, such as failure to stop temporarily, keeping to the right, and ignoring traffic signals, and if it is a straight road, the deviation driving may store the contents of deviation driving likely to occur at that location in advance, such as task speed, swaying, and auxiliary braking. The deviation driving presentation unit 318 may determine the location where deviation driving has occurred, read out the contents of deviation driving stored in association with the location, and present them to the instructor terminal 40.

[0041] The imaging unit 319 controls the camera included in the in-vehicle device 20 to capture images of the inside or outside of the vehicle while the driver is driving. Note that there may be multiple cameras, and the camera may capture an image of the driver, or the camera may be installed in a location where it is possible to capture an image of the tires from above (for example, by pointing the camera downward from around the side mirror) and check whether the tires are running over the shoulder of the road. The camera may also capture an image of the bumper (front of the vehicle) from above, so that it is possible to check whether the vehicle has crossed the stop line.

[0042] The video replay unit 320 identifies and presents to the instructor terminal 40 a frame at the time when the abnormal driving or deviation driving occurred from the video captured by the imaging unit 319, accepts the instructor's selection from among the frames, and replays the video from the selected frame. The video replay unit 320 may present one or more videos at once to the instructor terminal 40, or, when presenting multiple videos, may enlarge the video for which the instructor's selection was accepted and present it to the instructor terminal 40. In addition, as shown in FIG. 7, for example, when the instructor taps a mark indicating the vehicle position at the time when the abnormal driving or deviation driving occurred (for example, 407 in FIG. 6 or 408 in FIG. 7), the video replay unit 320 may identify the frame at the time when the abnormal driving or deviation driving occurred and replay the video from the frame. In addition, the video replay unit 320 may present a time bar, plot the time when the abnormal driving or deviation driving occurred on the time bar, and accept the instructor's selection to replay the video from the frame associated with the time. Furthermore, the video playback unit 320 may start playing the video from the point in time when the instructor's selection is accepted from the time bar.

[0043] The cognitive function information acquisition unit 321 acquires cognitive function information related to the driver's cognitive function, and stores it in the cognitive function information storage unit 334.

[0044] The cognitive function information on the cognitive function is a numerical value obtained by evaluating the cognitive function, and may be, for example, a score on a paper test conducted in a senior citizen training course, or a cognitive function quantified by another evaluation method. The cognitive function method may be a category obtained by dividing the numerical value obtained by the above-mentioned method (for example, 0 to 50 points are category A, 51 to 75 points are category B, 76 to 100 points are category C, etc.). The cognitive function information acquisition unit 321 may receive an input of a score on a paper test for evaluating the cognitive function answered by the driver from a business operator conducting a driving instruction business or an instructor associated with the business operator, or may conduct a test for evaluating the cognitive function on an information terminal used by the driver and acquire the score through the network NW.

[0045] The model generation unit 322 uses the driver's vehicle behavior information and the cognitive function information acquired by the cognitive function information acquisition unit 321 as teacher data, and generates a cognitive function prediction model in which the input is the vehicle behavior information and the output is the cognitive function information. The model generation unit 322 uses the driver's vehicle behavior information, particularly the acceleration, and the cognitive function information acquired by the cognitive function information acquisition unit 321, particularly the cognitive function classification (first classification, second classification, etc.), as teacher data, and generates a cognitive function prediction model in which the input is the vehicle behavior information and the output is the cognitive function information.

[0046] The model generation unit 322 may divide the course on which the driver drives the vehicle into sections, use vehicle behavior information in each section and cognitive function information of the driver as teacher data, and generate a cognitive function prediction model in which the input is the vehicle behavior information and the output is the cognitive function information.

[0047] The sections may be equal sized squares or rectangles dividing a map including the course to be traveled.

[0048] The sections may be divided by the distance traveled by the vehicle driven by the driver (for example, every 10 m, etc.).

[0049] The area may be an area (called a functional area) where driving knowledge and skills are trained, such as an area on the driving course that has a straight line of more than a predetermined length (straight line), an intersection (with traffic lights), an intersection (without traffic lights), an intersection (with poor visibility), an S-curve, a crank, going over a step, a stop sign, a slope, parallel parking, a turn, a T-junction, an L-curve, or a railroad crossing.

[0050] The model generation unit 322 may divide the driver's vehicle behavior information into sections, and use the vehicle behavior information in each section, as well as the driver and cognitive function information as teacher data, to generate a cognitive function prediction model in which the input is the vehicle behavior information and the output is the cognitive function information.

[0051] The cognitive function information presentation unit 323 uses the cognitive function prediction model generated by the model generation unit to accept input of the vehicle behavior information of the driver, output the cognitive function information, and present it on the instructor terminal 40.

[0052] The cognitive function information presentation unit 323 may divide the vehicle behavior information into sections, input the information to the cognitive function prediction model, and output the cognitive function for each section. The cognitive function information presentation unit 323 may present the difference in the output cognitive function for each section by using a different color, a different mark, a different blinking pattern, or the like, as shown in an example in FIG.

[0053] The sections may be equal-sized squares or rectangles dividing a map including the driving course, and the cognitive function information presentation unit 323 may output the cognitive function for each section using vehicle behavior information in the sections as input information for the cognitive function prediction model.

[0054] The sections may be divided by the distance traveled by the vehicle driven by the driver (for example, every 10 m), and the cognitive function information presentation unit 323 may output the cognitive function for each section using vehicle behavior information in the section as input information for the cognitive function prediction model.

[0055] The sections may be sections (called functional sections) on the driving course where driving knowledge and skills are trained, such as areas (straight lines) where a straight line continues for a predetermined length or more, intersections (with traffic lights), intersections (without traffic lights), intersections (with poor visibility), S-curves, cranks, going over steps, stop signs, slopes, parallel parking, turning, T-junctions, L-curves, and railroad crossings, and the cognitive function information presentation unit 323 may output the cognitive function for each functional section using vehicle behavior information in the functional sections as input information for the cognitive function prediction model.

[0056] The training presentation unit 316 may present training information required for the driver to the instructor terminal 40 based on the cognitive function information. The training information is stored in the control device 30 in association with an area of ​​a road where the result of the cognitive function falls within a predetermined range, and the training presentation unit 316 may read out training information corresponding to the content of the abnormal driving from the control device 30 and present it to the instructor terminal 40. For example, when a cognitive function similar to that of a driver with reduced cognitive function is output on an S-curve, driving training for the S-curve and training for spatial cognitive function, which are stored in association with the S-curve, may be presented to the instructor terminal 40.

[0057] A typical process flow of the control device 30 of this embodiment will be described with reference to FIG. 10. The vehicle behavior information acquisition unit 311 acquires vehicle behavior information of the vehicle being driven (1001). The imaging unit 319 captures images of the outside of the vehicle being driven (1002). The abnormal driving acquisition unit 312 acquires information on the occurrence of abnormal driving from the instructor terminal (1003). The abnormal driving presentation unit 313 displays the location of the abnormal driving on a map (1004). The deviation driving determination unit 317 determines the occurrence of deviation driving (1005). The deviation driving presentation unit 318 displays the location of the deviation driving on a map (1006). The abnormal driving presentation unit 313 acquires the details of the abnormal driving, and the deviation driving presentation unit 318 acquires the details of the deviation driving from the instructor terminal 40 (1007). The evaluation table generating unit 314 generates an evaluation table based on the information on the abnormal driving or deviation driving, and the evaluation table presenting unit 315 presents the evaluation table generated by the evaluation table generating unit 314 to the instructor terminal 40 (1008). The training presenting unit 316 selects a training menu for the driver based on the information on the abnormal driving or deviation driving, and presents it to the instructor terminal 40 (1009). The video replay unit replays the video captured by the imaging unit through a display provided in the instructor terminal 40 (1010). The cognitive function information acquiring unit 321 acquires information on the driver's cognitive function, and the model generating unit 322 generates a prediction model of the cognitive function (1011). The cognitive function information presenting unit 323 outputs information on the cognitive function using the prediction model, and presents it to the instructor terminal 40 (1012). The training presenting unit 316 selects a training menu for the driver based on the output information on the cognitive function, and presents it to the instructor terminal 40 (1013).

[0058] Although the preferred embodiment of the present disclosure has been described in detail above with reference to the attached drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that a person having ordinary knowledge in the technical field of the present disclosure can conceive of various modified or amended examples within the scope of the technical ideas described in the claims, and it is understood that these also naturally belong to the technical scope of the present disclosure.

[0059] The device described in this specification may be realized as a single device, or may be realized by a plurality of devices (e.g., cloud servers) partially or entirely connected via a network. For example, the control device 30, the CPU and the storage device of the management server 10 may be realized by different servers connected to each other via a network.

[0060] The series of processes performed by the device described in this specification may be realized using any of software, hardware, and a combination of software and hardware. It is possible to create a computer program for realizing each function of the control device 30 and management server 10 according to this embodiment and to install it in a PC or the like. It is also possible to provide a computer-readable recording medium in which such a computer program is stored. The recording medium is, for example, a magnetic disk, an optical disk, a magneto-optical disk, a flash memory, etc. The above computer program may also be distributed, for example, via a network, without using a recording medium.

[0061] Additionally, the processes described herein do not necessarily have to be performed in the order described, some process steps may be performed in parallel, additional process steps may be employed, and some process steps may be omitted.

[0062] In addition, the effects described in this specification are merely descriptive or exemplary and are not limiting. In other words, the technology according to the present disclosure may achieve other effects that are apparent to a person skilled in the art from the description of this specification, in addition to or in place of the above effects. [Explanation of symbols]

[0063] 10 Management Server 20 Onboard equipment 30 Control device 40 Instructor terminal NW Network

Claims

1. A business support system that supports a business of an instructor who teaches vehicle driving, a vehicle event information acquisition unit that acquires vehicle event information regarding a vehicle event including at least position information of a vehicle driven by a driver; an abnormal driving storage unit that receives an input of information regarding abnormal driving of the vehicle from the instructor and stores the information in association with position information of the vehicle at the time the input is received; an abnormal driving presentation unit that links the abnormal driving with location information of the vehicle at the time when the input is received and presents the information on an information terminal used by the instructor; A business support system comprising:

2. the abnormal driving storage unit receives, from the instructor, an input of the occurrence of the abnormal driving and a content of the abnormal driving at different timings; The business support system according to claim 1 .

3. an evaluation table generating unit that generates an evaluation table of the driver's driving based on the details of the abnormal driving; The business support system according to claim 2 , further comprising:

4. a training presentation unit that presents a training required for the driver on the information terminal used by the instructor based on the content of the abnormal driving; The business support system according to claim 2 , further comprising:

5. a deviation driving determination unit that acquires a good vehicle behavior, which is the behavior of a vehicle driven by a good driver having normal driving skills, compares the good vehicle behavior with the vehicle behavior of the driver, and determines that deviation driving has occurred when a predetermined deviation from the good vehicle behavior has occurred; a deviation driving presentation unit that links the deviation driving with position information of the vehicle at the time when the deviation occurred and presents the information on an information terminal used by the instructor; The business support system according to claim 3 or 4, comprising:

6. An imaging unit that captures an image of a driving situation; a video playback unit that plays the video captured by the imaging unit from a frame at a time point at which the abnormal driving or the deviation driving occurs, in an information terminal used by the instructor; The business support system according to claim 5 , further comprising:

7. A cognitive function storage unit that acquires and stores cognitive function information related to the cognitive function of the driver; a model generation unit that uses the vehicle behavior information and the cognitive function information of the driver as teacher data, and generates a cognitive function prediction model having the vehicle behavior information as an input and the cognitive function information as an output; a cognitive function presentation unit that receives an input of the vehicle behavior information of the driver by using the cognitive function prediction model generated by the model generation unit, and outputs the cognitive function information; The business support system according to claim 1 or 2, comprising:

8. the cognitive function presentation unit divides a course driven by the driver into sections, and sets the vehicle behavior for each section as input information for the cognitive function prediction model; The business support system according to claim 7 .

9. A business support program for supporting a business of an instructor who teaches vehicle driving, The processor: a vehicle behavior information acquisition step of acquiring vehicle behavior information regarding a vehicle behavior including at least position information of a vehicle driven by a driver; an abnormal driving storage step of receiving an input of information regarding abnormal driving of the vehicle from the instructor and storing the information in association with position information of the vehicle at the time when the input is received; an abnormal driving presentation step of linking the abnormal driving with position information of the vehicle at the time when the input is received and presenting the information on an information terminal used by the instructor; A business support program that enables the execution of the following:

10. A method for supporting a task of an instructor who provides training on vehicle driving, comprising: The processor: a vehicle behavior information acquisition step of acquiring vehicle behavior information regarding a vehicle behavior including at least position information of a vehicle driven by a driver; an abnormal driving storage step of receiving an input of information regarding abnormal driving of the vehicle from the instructor and storing the information in association with position information of the vehicle at the time when the input is received; an abnormal driving presentation step of linking the abnormal driving with position information of the vehicle at the time when the input is received and presenting the information on an information terminal used by the instructor; A business support method for carrying out the above.

Citation Information

Patent Citations

  • Image display device, and image display program

    JP2010060784A

  • Drive hazard predictive learning support system

    JP2012155285A

  • Vehicle training system

    JP2015219497A

  • Wearable Sport Fishing System and Method

    US20180122269A1