Server device, control device, vehicle, and operation method for information processing system

By exchanging vehicle driving mode information between the server and the terminal device, identifying and verifying improper driving behavior, the problem of determining the accuracy of improper driving behavior in the prior art is solved, and the ability to identify improper driving factors is improved.

CN113746889BActive Publication Date: 2024-11-19TOYOTA JIDOSHA KK
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202110371947.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-05-29
Filing Date
2021-04-07
Publication Date
2024-11-19
Estimated Expiration
2041-04-07

AI Technical Summary

Technical Problem

The prior art has room for improvement when determining improper driving behavior, and it is difficult to accurately identify factors that lead to improper driving, which affects the accuracy of the judgment.

Method used

By exchanging information between the server device, the vehicle and the terminal device, the image and motion state information around the vehicle or inside the car is captured, the current driving mode is compared with the past driving mode, the changes in the driving mode are identified to determine improper driving behavior, and to The terminal device sends captured images to verify factors of improper driving.

Benefits of technology

Improves the accuracy of the determination of improper driving behavior and can identify specific factors that lead to improper driving, such as sudden braking or steering, to help evaluate the driver's tendency to drive.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113746889B_ABST
    Figure CN113746889B_ABST
Patent Text Reader

Abstract

A server device, a control device, a vehicle, and an operation method for an information processing system are provided. The server device includes a communication unit and a control unit, the control unit sending information to other devices and receiving information from other devices via the communication unit. The control unit sends a captured image of the surroundings or the interior of the vehicle when the driving mode of the vehicle is different from the past driving mode to a terminal device, so that the terminal device outputs the captured image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a server device, a control device, a vehicle, and an operating method for an information processing system. Background Art

[0002] Technology that supports prevention of dangerous driving of vehicles is well known. For example, Japanese Unexamined Patent Application Publication No. 2015-219736 (JP 2015-219736 A) discloses a system that predicts dangerous driving based on the position of a vehicle and encourages the driver to drive safely. Summary of the invention

[0003] There is room for improvement in the technology used to detect dangerous and other inappropriate driving.

[0004] Hereinafter, a server device and the like capable of improving determination of improper driving will be disclosed.

[0005] The server device according to the present disclosure includes a communication unit and a control unit, the control unit sends information to other devices and receives information from other devices via the communication unit. The control unit sends a captured image of the surroundings or the interior of the vehicle when the driving mode of the vehicle is different from the past driving mode to a terminal device, so that the terminal device outputs the captured image.

[0006] A control device for a vehicle according to the present disclosure includes a communication unit and a control unit, the control unit sends information to other devices and receives information from other devices via the communication unit, the control unit sends a captured image of the surroundings or the interior of the vehicle when the driving mode of the vehicle is different from the past driving mode to a server device, so that the server device sends the captured image to the terminal device.

[0007] In an operating method for an information processing system according to the present disclosure, the information processing system includes a server device and a vehicle that send and receive information to each other, the vehicle sends a captured image of the surroundings or interior of the vehicle when a driving mode of the vehicle is different from a past driving mode to the server device, and the server device sends the captured image to the terminal device so that the terminal device outputs the captured image.

[0008] With the server device and the like according to the present disclosure, determination of improper driving can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Features, advantages, and technical and industrial significance of exemplary embodiments of the present invention will be described below with reference to the accompanying drawings, in which like reference numerals represent like elements, and in which:

[0010] Figure 1 is a diagram showing a configuration example of an information processing system;

[0011] Figure 2 is a diagram showing a configuration example of a server device;

[0012] Figure 3 is a diagram showing a configuration example of a terminal device;

[0013] Figure 4 is a diagram showing a configuration example of a vehicle;

[0014] Figure 5 is a timing chart showing an example of the operation of the information processing system;

[0015] Figure 6 is a diagram showing an example of information stored in a storage unit;

[0016] Figure 7 is a flowchart showing an example of the operation of the server device;

[0017] Figure 8 is a diagram showing an output example of a terminal device; and

[0018] Fig. 9 is a sequence diagram illustrating an operation example of the information processing system. DETAILED DESCRIPTION

[0019] Various embodiments will be described hereinafter.

[0020] Figure 1 1 is a diagram showing a configuration example of an information processing system according to an embodiment. The information processing system 1 includes, for example, a server device 10, a terminal device 12, and a vehicle 13, which are connected to each other via a network 11 so as to be able to communicate with each other. The server device 10 is a computer. The terminal device 12 is, for example, a portable information terminal device such as a smartphone or a tablet terminal device, but may also be a personal computer. The vehicle 13 is a passenger car, a multi-purpose vehicle, or the like having a control / communication function. The network 11 is, for example, the Internet, but also includes an ad hoc network, a local area network (LAN), a metropolitan area network (MAN), other networks, or a combination thereof. The number of components in the information processing system 1 may be more than the number shown here.

[0021] The driver of the vehicle 13 has his / her own driving behavior tendency. For example, when evaluating automobile insurance, or when evaluating the performance of the driver in the case where the vehicle 13 is a taxi vehicle, the driving behavior tendency is the object of concern. Specifically, it is necessary to judge whether the driving behavior tendency is toward safe and proper driving (hereinafter collectively referred to as proper driving) or dangerous or improper driving (hereinafter collectively referred to as improper driving). Here, since the driving behavior tendency is reflected in the driving mode of the vehicle 13, the information about the driving mode of the vehicle 13 can be used to determine the driving behavior tendency of the driver. However, if a driver who usually practices proper driving happens to exhibit improper driving for some reason, it is necessary to identify the factors that lead to such driving in order to understand the original tendency of the driver. The information processing system 1 in the present embodiment supports the identification of factors that lead to improper driving, thereby helping to improve the determination of improper driving.

[0022] In the present embodiment, the vehicle 13 sends a captured image of the surroundings of the vehicle 13 when the driving mode of the vehicle 13 is different from the past driving mode to the server device 10. The driving mode includes, for example, acceleration / deceleration, the rate of change of the steering angle with respect to time, the selected route, etc. The driving mode corresponds to the driving behavior of the driver, such as pressing / releasing the accelerator pedal, steering, braking operation, and route selection. The past driving mode corresponds to the usual driving behavior of the driver of the vehicle 13 and reflects the driver's tendency. Therefore, when the driving mode of the vehicle 13 is different from the past driving mode, it is very likely that the driver has performed a driving behavior different from the original tendency for some reason. The server device 10 sends the captured image of the surroundings of the vehicle 13 to the terminal device 12 so that the terminal device 12 outputs the captured image. Therefore, for example, when the driver or a person responsible for assessing automobile insurance verifies the captured image output by the terminal device 12, the factors that cause the driver's improper driving can be identified. Examples of factors that cause improper driving (such as sudden braking or sudden steering) include road obstacles that must be avoided by sudden braking or sudden steering or pedestrians that suddenly jump out. In addition, examples of factors that lead to improper driving such as sudden acceleration include being chased from behind by other vehicles, road rage, etc., which must be avoided by sudden acceleration, or intimidation by passengers in the case where the vehicle 13 is a taxi vehicle. Alternatively, examples of factors that lead to improper driving such as taking a route different from the usual route include congestion and road closures on the usual route. As described above, according to the information processing system 1, the determination of improper driving can be improved.

[0023] Figure 2 1 shows a configuration example of a server device 10. The server device 10 has a communication unit 20, a storage unit 21, and a control unit 22. The server device 10 can perform the operation according to the present embodiment by communicating and cooperating with other server devices having an equivalent configuration.

[0024] The communication unit 20 has one or more communication modules corresponding to a wired or wireless LAN standard for connecting to the network 11. In the present embodiment, the server device 10 is connected to the network 11 via the communication unit 20, and performs information communication with other devices via the network 11.

[0025] The storage unit 21 has, for example, a semiconductor memory, a magnetic memory, an optical memory, etc. The storage unit 21 functions as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 21 stores information used for the operation of the server device 10, a control / processing program, etc.

[0026] The control unit 22 has, for example, one or more general-purpose processors, such as a central processing unit (CPU), or one or more dedicated processors specifically used for specific processing. Alternatively, the control unit 22 may have one or more dedicated circuits, such as a field programmable gate array (FPGA) and an application-specific integrated circuit (ASIC). The control unit 22 comprehensively controls the operation of the server device 10 by operating according to a control / processing program, or according to an operation process implemented as a circuit. Then, the control unit 22 sends and receives various information with the terminal device 12 and the vehicle 13 via the communication unit 20, and performs operations according to the present embodiment.

[0027] Figure 3 1 shows a configuration example of the terminal device 12. The terminal device 12 is an information terminal device such as a smartphone, a tablet terminal device, or a personal computer. The terminal device 12 has an input / output unit 30, a communication unit 31, a storage unit 32, and a control unit 33.

[0028] The input / output unit 30 has an input interface that detects the user's input and sends the input information to the control unit 33. The input interface is any input interface including, for example, a physical key, a capacitive key, a touch screen integrated with a flat display, various pointing devices, a microphone for receiving voice input, a camera for capturing a captured image or image code, etc. In addition, the input / output unit 30 has an output interface that outputs information generated by the control unit 33 or received from other devices to the user. The output interface is any output interface including, for example, an external or built-in display that outputs information as an image / video, a speaker that outputs information as audio, or a connection interface for an external output device.

[0029] The communication unit 31 has a communication module corresponding to a wired or wireless LAN standard, a module corresponding to a mobile communication standard such as the fourth generation (4G) and the fifth generation (5G), etc. The terminal device 12 is connected to the network 11 through the communication unit 31 via a nearby router device or a mobile communication base station, and performs information communication with other devices via the network 11.

[0030] The storage unit 32 has, for example, a semiconductor memory, a magnetic memory, an optical memory, etc. The storage unit 32 is used as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 32 stores information used for the operation of the terminal device 12, a control / processing program, etc.

[0031] The control unit 33 has, for example, one or more general-purpose processors (e.g., CPU, microprocessing unit (MPU)) or one or more dedicated processors specifically used for specific processing. Alternatively, the control unit 33 may also have one or more dedicated circuits, such as FPGA and ASIC. The control unit 33 comprehensively controls the operation of the terminal device 12 by operating according to the control / processing program or according to the operation of the operating process implemented as a circuit. Then, the control unit 33 sends and receives various types of information with the server device 10, etc. via the communication unit 31, and performs the operation of this embodiment.

[0032] Figure 4 An example of a configuration of a control device 40 mounted on a vehicle 13 is shown. The control device 40 includes a communication unit 41, a positioning unit 42, an input / output unit 43, an imaging unit 44, a detection unit 45, a storage unit 46, and a control unit 47. The control device 40 is, for example, a navigation device, a mobile phone, a smart phone, a tablet computer, or a personal computer (PC). The vehicle 13 can be driven by a driver, or the driving can be automated at a desired level. For example, the level of automation is one of level 1 to level 5 of the Society of Automotive Engineers (SAE) level.

[0033] The communication unit 41 includes one or more communication interfaces. The communication interface is, for example, an interface compatible with a mobile communication standard such as Long Term Evolution (LTE), 4G, or 5G. The communication unit 41 receives information for the operation of the control device 40 and transmits information obtained by the operation of the control device 40. The control device 40 is connected to the network 11 through the communication unit 41 via a mobile communication base station, and performs information communication with other devices via the network 11.

[0034] The positioning unit 42 includes one or more global navigation satellite system (GNSS) receivers. The GNSS includes, for example, at least one of the Global Positioning System (GPS), the Quasi-Zenith Satellite System (QZSS), the Global Navigation Satellite System (GLONASS), and Galileo. The positioning unit 42 acquires the position information of the vehicle 13.

[0035] The input / output unit 43 includes one or more input interfaces and one or more output interfaces. The input interface is, for example, a physical key, a capacitive key, a pointing device, a touch screen integrated with a display, or a microphone for receiving voice input. The output interface is, for example, a display or a speaker. The display is, for example, a liquid crystal display (LCD) or an organic electroluminescent (EL) display. The input / output unit 43 receives the operation of input information for the operation of the control device 40, sends the input information to the control unit 47, and outputs the information obtained by the operation of the control device 40.

[0036] The imaging unit 44 includes one or more cameras and control circuits therefor, and is disposed at a position capable of imaging the surroundings or the interior of the vehicle 13. The camera of the imaging unit 44 may be a monocular camera or a stereo camera. The imaging unit 44 images the surroundings or the interior of the vehicle 13 at predetermined time intervals, and transmits the captured images to the control unit 47. In addition, the captured images may also be associated with information on the surroundings of the vehicle 13 or the audio inside the vehicle cabin acquired from the input interface of the input / output unit 43.

[0037] The detection unit 45 has a sensor for detecting the motion state of the vehicle 13. The sensor includes, for example, a sensor for detecting the vehicle speed, acceleration, steering angle, tilt, brake operation, etc. of the vehicle 13. The detection unit 45 detects information indicating the motion state of the vehicle 13 through the sensor and sends the information to the control unit 47.

[0038] The storage unit 46 includes one or more semiconductor memories, one or more magnetic memories, one or more optical memories, or a combination of at least two of the above memory types. The semiconductor memory is, for example, a random access memory (RAM) or a read-only memory (ROM). The RAM is, for example, a static RAM (SRAM) or a dynamic RAM (DRAM). The ROM is, for example, an electrically erasable ROM (EEPROM). The storage unit 46 is used, for example, as a main storage device, an auxiliary storage device, or a cache memory. The storage unit 46 stores information used for the operation of the control device 40 and information obtained by the operation of the control device 40.

[0039] The control unit 47 has one or more general-purpose processors (such as a CPU and an MPU), or one or more dedicated processors specifically used for specific processing. Alternatively, the control unit 47 may have one or more dedicated circuits, such as an FPGA and an ASIC. The control unit 47 comprehensively controls the operation of the control device 40 and the vehicle 13 by operating according to a control / processing program or according to an operation process implemented as a circuit. The control unit 47 sends and receives various information with the server device 10 via the communication unit 41, and performs operations according to the present embodiment.

[0040] Figure 5 is a sequence diagram showing an operation example of the information processing system 1 . Figure 5 2 shows the operation process of the cooperative operation of the server device 10, the terminal device 12 and the vehicle 13. Figure 5 The process is executed from the time when the vehicle 13 is traveling to the time when the vehicle 13 is traveling.

[0041] In step S500, the vehicle 13 transmits the position information to the server device 10. The control unit 47 of the vehicle 13 transmits the current position of the vehicle 13 acquired from the positioning unit 42 to the server device 10 via the communication unit 41. The control unit 22 of the server device 10 receives the position information via the communication unit 20 and stores it in the storage unit 21. Step S500 is repeated at predetermined time intervals (e.g., intervals of several milliseconds to several seconds).

[0042] In step S502, the vehicle 13 sends state information indicating the motion state of the vehicle 13 to the server device 10. The state information is, for example, information indicating the motion state of the vehicle 13 such as vehicle speed, acceleration, and steering angle detected by the detection unit 45 of the vehicle 13. The control unit 47 of the vehicle 13 sends the state information to the server device 10 via the communication unit 41. The control unit 22 of the server device 10 receives the state information via the communication unit 20 and stores it in the storage unit 21.

[0043] In step S504, the vehicle 13 transmits the captured image to the server device 10. The control unit 47 of the vehicle 13 transmits the captured image of the surroundings or the interior of the vehicle compartment of the vehicle 13 captured by the imaging unit 44 to the server device 10 via the communication unit 41. The control unit 22 of the server device 10 receives the captured image via the communication unit 20. Step S504 is repeated at predetermined time intervals (e.g., intervals of several milliseconds to several seconds).

[0044] In step S506, the server device 10 determines whether to send the captured image, position information, etc. to the terminal device 12 based on the driving mode of the vehicle 13. For example, the control unit 22 of the server device 10 compares the driving mode corresponding to the position information and state information of the vehicle 13 with the past driving mode corresponding to the past position information and past state information stored in the storage unit 21. Then, the control unit 22 determines whether the current driving mode is different from the past driving mode. When the current driving mode is different from the past driving mode, the control unit 22 determines to send the captured image and position information to the terminal device 12. Here, reference will be made to Figure 6 and Figure 7 The details of step S506 are described.

[0045] Figure 6The position information and state information of the vehicle 13 stored in the storage unit 21 are schematically shown. For example, the storage unit 21 stores the position information, time, environment information and state information of the vehicle 13 collected periodically as the vehicle 13 moves. Such information is stored in association with each vehicle 13. The position information and time represent the position and time of the vehicle 13 when the position information is sent from the vehicle 13 to the server device 10. The time can be added to the position information as a timestamp by the control unit 47 of the vehicle 13, or the control unit 22 of the server device 10 can use its timing function to obtain the time when the position information is received. The environment information represents the environment attributes of the place corresponding to the position of the vehicle 13 obtained from the map information pre-stored in the storage unit 21. For example, the environment information includes the width of the road on which the vehicle 13 is traveling, the presence or absence of a corner, the presence or absence of an opposite lane, the presence or absence of obstacles on the road, the presence or absence of a sidewalk / crosswalk, good / poor visibility, etc. Alternatively, the environment information may include road traffic information obtained from other server devices, etc. The state information includes the vehicle speed, acceleration, steering angle, etc. of the vehicle 13. Each time step S506 is executed, the control unit 22 additionally stores the newly acquired position information and state information of the vehicle 13 in the storage unit 21 .

[0046] Figure 7 : is a flowchart showing a detailed procedure of the processing in step S506 executed by the control unit 22 of the server device 10 .

[0047] In step S700, the control unit 22 determines whether there is a speed violation. For example, the control unit 22 compares the past vehicle speed stored in the storage unit 21 with the acquired current vehicle speed of the vehicle 13. When the current vehicle speed shows an abnormal value, the control unit 22 determines that there is a speed violation. For the judgment of the abnormal value, an arbitrarily determined standard can be used. For example, a standard is set for the size of the deviation from the past average or median value. When the size of the deviation exceeds the standard, it can be determined as an abnormal value, and when the size of the deviation is equal to or less than the standard, it can be determined as a normal value. The size of the deviation can be an absolute value or a deviation value. In the following description, the judgment of the abnormal value is the same. When the control unit 22 determines that there is a speed violation ("Yes" in step S700), that is, when the driving mode of the vehicle 13 is different from the past driving mode, the process proceeds to step S708, and the control unit 22 determines to send the captured image received from the vehicle 13 to the terminal device 12. When the control unit 22 does not determine that there is a speed violation ("No" in step S700), the control unit 22 proceeds to step S702.

[0048] In step S702, the control unit 22 determines whether there is sudden acceleration or sudden braking. For example, the control unit 22 compares the absolute value of the past acceleration stored in the storage unit 21 with the absolute value of the current acceleration of the vehicle 13 obtained. When the current absolute value represents an abnormal value, the control unit 22 determines that there is sudden acceleration or sudden braking. When the control unit 22 determines that there is sudden acceleration or sudden braking ("Yes" in step S702), that is, when the driving mode of the vehicle 13 is different from the past driving mode, the processing proceeds to step S708, and the control unit 22 determines to send the captured image received from the vehicle 13 to the terminal device 12. When the control unit 22 does not determine that there is sudden acceleration or sudden braking ("No" in step S702), the control unit 22 proceeds to step S704.

[0049] In step S704, the control unit 22 determines whether there is a sudden turn. For example, the control unit 22 calculates the time change rate of the acquired current steering angle relative to the latest steering angle stored in the storage unit 21. Then, the control unit 22 compares the time change rate of the current steering angle with the time change rate of the past steering angle of the same unit time. When the time change rate of the current steering angle shows an abnormal value, the control unit 22 determines that there is a sudden turn. When the control unit 22 determines that there is a sudden turn ("Yes" in step S704), that is, when the driving mode of the vehicle 13 is different from the past driving mode, the processing proceeds to step S708, and the control unit 22 determines to send the captured image received from the vehicle 13 to the terminal device 12. When the control unit 22 does not determine that there is a sudden turn ("No" in step S704), the control unit 22 proceeds to step S706.

[0050] In step S706, the control unit 22 determines whether a different route is adopted. For example, the control unit 22 derives the road on which the vehicle 13 often travels from the transition history of the position information stored in the storage unit 21. For example, the control unit 22 derives the fact that the vehicle 13 often travels on a trunk road, a bypass road, a highway, etc. In addition, the control unit 22 derives the current driving route of the vehicle 13 based on the transition of the acquired position information from the latest position information. When the current route deviates from the past route, the control unit 22 determines that a different route is adopted. For example, when the current route has deviated from the past route by a driving distance greater than a predetermined reference distance, the control unit 22 determines that a different route is adopted, and when the driving distance is equal to or less than the reference distance, it is not determined that a different route is adopted. Examples of situations in which it is determined that a different route is adopted include situations in which the vehicle 13 used to travel on trunk roads, bypass roads, highways, etc., but is now traveling in a residential area or a narrow alley. When the control unit 22 determines that a different road is taken ("Yes" in step S706), that is, when the driving mode of the vehicle 13 is different from the past driving mode, the process proceeds to step S708, and the control unit 22 determines to transmit the captured image received from the vehicle 13 to the terminal device 12. When the control unit 22 does not determine that a different road is taken ("No" in step S706), the control unit 22 ends the process. Figure 7 process.

[0051] In step S700 or S706, the control unit 22 may perform a judgment process in consideration of the environmental information. For example, in step S700, when the environmental information indicates that the vehicle 13 is traveling on a trunk road, the standard for judging the presence of an abnormal value may be set relatively loosely at a predetermined ratio, and when the environmental information indicates that the vehicle 13 is traveling through a residential area, the standard for judging the presence of an abnormal value may be set relatively strictly. This enables appropriate judgment of speed violations in consideration of the environment. In addition, in step S706, when the environmental information indicates that there is congestion or road closure in the past route of the vehicle 13, the standard for judging the presence of an abnormal value is set relatively loosely, which enables appropriate judgment of different routes in consideration of the environment.

[0052] Furthermore, in steps S700 to S706, the control unit 22 may perform the judgment processing in consideration of the position information or the time. For example, the control unit 22 compares the past driving pattern at the same position as the current position of the vehicle 13 with the current driving pattern. Alternatively, the control unit 22 compares the past driving pattern at the same time of the day as the current time with the current driving pattern. By doing so, it is possible to eliminate the particularity caused by the position or the time, and to judge a driving pattern different from the past driving pattern.

[0053] exist Figure 5In the example of FIG. 1 , when the server device 10 determines to send the position information and the captured image in step S506, the server device 10 sends the captured image, position information, environmental information, and driving mode information when the driving mode of the vehicle 13 is different from the past driving mode to the terminal device 12 in step S508. The control unit 22 of the server device 10 sends the captured image, position information, environmental information, and driving mode information indicating the driving mode stored in the storage unit 21 to the terminal device 12 via the communication unit 20. The driving mode information is, for example, respectively related to Figure 7 The control unit 33 of the terminal device 12 receives the captured image, position information, environmental information, and driving mode information via the communication unit 31 and stores them in the storage unit 32.

[0054] After the driving of the vehicle 13 is completed, in step S510, the terminal device 12 outputs the captured image, position information, environmental information, and driving mode information of the vehicle 13. For example, after the driving of the vehicle 13 is completed, step S510 is performed when evaluating the driving behavior tendency of the driver. For example, in response to the operation input of the driver or the evaluator, the control unit 33 of the terminal device 12 outputs the captured image, position information, environmental information, and driving mode information through the input / output unit 30. For example, Figure 8 As shown, the terminal device 12 displays indications 82a, 82b indicating driving mode information and environmental information on the display screen 80 in association with the position information mapped on the map 81. For example, indication 82a includes environmental information indicating that the vehicle is driving on a bypass road and driving mode information indicating a sudden turn. Indication 82b includes environmental information indicating the presence of traffic congestion and driving mode information indicating sudden braking. In addition, the terminal device 12 displays captured images 83, 84 corresponding to the indications 82a, 82b, respectively, in response to, for example, a click operation on the indications 82a, 82b. For example, corresponding to sudden braking, a captured image 83 of other vehicles suddenly cutting in from the side is displayed, or corresponding to a sudden turn, a captured image 84 of a passenger who forces a sudden change in route is displayed.

[0055] The terminal device 12 presents the driver or the evaluator with the position information, environmental information, and captured images acquired when the vehicle 13 exhibits an abnormal driving pattern, which indicates a high possibility of improper driving. Thus, the driver or the evaluator can visually verify from the captured images whether there are factors that lead to improper driving. At the same time, the shape, layout, etc. of the road can be grasped from the position information, and the road environment, traffic conditions, etc. can be grasped from the environmental information, which can be used for verification / determination of improper driving.

[0056] exist Figure 5In the process of the present invention, step S508 may be performed each time the control unit 22 of the server device 10 detects a driving mode different from the past driving mode of the vehicle 13, or may be performed once after the driving of the vehicle 13 is completed, for example. Each time the control unit 22 detects a driving mode different from the past driving mode, the captured image and the position information are stored in the storage unit 21. When the terminal device 12 requests the server device 10 for a captured image or the like in response to an input to the terminal device 12 by the driver or the evaluator, one or more captured images or the like stored in the storage unit 21 may be sent to the terminal device 12.

[0057] Fig. 9 A procedure in a modified example of the present embodiment is shown. Fig. 9 The process and Figure 5 The process is different in that step S900 is performed instead of Figure 5 Step S506 is performed, and step S502 is omitted. The other steps are the same as Figure 5 The same as those in .

[0058] In step S900, before the control device 40 of the vehicle 13 sends the captured image and position information to the server device 10, the control device 40 determines whether to send the captured image and position information, etc. to the terminal device 12 via the server device 10 based on the driving mode of the vehicle 13. For example, the control unit 47 of the control device 40 compares the driving mode corresponding to the position information and state information of the vehicle 13 with the past driving mode corresponding to the past position information and past state information stored in the storage unit 46. Then, the control unit 47 determines whether the current driving mode is different from the past driving mode. When the current driving mode is different from the past driving mode, the control unit 47 determines to send the captured image and position information to the terminal device 12. When the control unit 47 determines to send the captured image and position information to the terminal device 12, the position information and the captured image are sent to the server device 10. In addition, for example, the control device 40 of the vehicle 13 may be configured to Figure 6 The information shown is stored in the storage unit 46, and in addition to the position information and the captured image transmitted from the vehicle 13 to the server device 10, the environmental information can also be transmitted. According to such a modification, since the processing load of the server device 10 is distributed in the vehicle 13, the processing load of the server device 10 can be reduced.

[0059] As described above, according to the present embodiment, the determination of improper driving can be improved.

[0060] In the above-described embodiment, the processing / control program that defines the operation of the terminal device 12 and the control device 40 may be stored in the storage unit 21 of the server device 10 or in the storage unit of another server device, and downloaded to the respective devices via the network 11. Alternatively, the processing / control program may be stored in a portable, non-transitory recording / storage medium that can be read by the respective devices, and may be read from the medium by the respective devices.

[0061] Although various embodiments have been described above based on the drawings and examples, it should be noted that those skilled in the art can easily make various modifications and changes based on the present disclosure. Therefore, it should be noted that these modifications and changes are also included in the scope of the present disclosure. For example, the functions included in each device, each step, etc. can be rearranged without causing logical contradictions, and multiple devices, steps, etc. can be combined into one or divided.

Claims

1. A server device, comprising: Communication unit; and a control unit that sends information to other devices and receives information from other devices via the communication unit, wherein the control unit compares a driving mode corresponding to the position information and the information on the motion state of the vehicle with a past driving mode corresponding to the past position information and the information on the motion state of the vehicle to determine whether the driving mode is different from the past driving mode, and when the driving mode is different from the past driving mode, sends a captured image of the surroundings or the interior of the vehicle when the driving mode is different from the past driving mode to a terminal device so that the terminal device outputs the captured image, In which, the control unit compares the past driving pattern at the same position as the current position of the vehicle with the current driving pattern, or compares the past driving pattern at the same time of the day as the current time with the current driving pattern to determine whether the driving pattern is different from the past driving pattern.

2. The server device according to claim 1, wherein: The control unit transmits, to the terminal device, position information indicating the position of the vehicle when the driving pattern of the vehicle is different from the past driving pattern.

3. The server device according to claim 1 or 2, wherein: The driving mode includes a motion state of the vehicle.

4. The server device according to claim 1 or 2, wherein: The travel pattern includes a route of the vehicle.

5. The server device according to claim 2, wherein: Whether the driving pattern of the vehicle is different from the past driving pattern is determined in consideration of environmental information indicating an environmental attribute of a spot corresponding to the position of the vehicle.

6. The server device according to claim 5, wherein: The control unit sends the environment information to the terminal device. 7 . An information processing system comprising the server device according to claim 1 and a vehicle.

8. A control device for a vehicle, the control device comprising a communication unit and a control unit, the control unit sending information to other devices and receiving information from other devices via the communication unit, wherein: the control unit compares a driving pattern corresponding to the position information and the information on the motion state of the vehicle with a past driving pattern corresponding to the past position information and the information on the past motion state to determine whether the driving pattern is different from the past driving pattern, and when the driving pattern is different from the past driving pattern, sends a captured image of the surroundings or the interior of the vehicle when the driving pattern is different from the past driving pattern to a server device, so that the server device sends the captured image to a terminal device, In which, the control unit compares the past driving pattern at the same position as the current position of the vehicle with the current driving pattern, or compares the past driving pattern at the same time of the day as the current time with the current driving pattern to determine whether the driving pattern is different from the past driving pattern.

9. The control device according to claim 8, wherein: The control unit transmits position information indicating the position of the vehicle when the driving pattern of the vehicle is different from the past driving pattern to the server device, so that the server device transmits the position information to the terminal device.

10. The control device according to claim 8 or 9, wherein: The driving mode includes a motion state of the vehicle.

11. The control device according to claim 8 or 9, wherein: The travel pattern includes a route of the vehicle.

12. The control device according to claim 8, wherein: Whether the driving pattern of the vehicle is different from the past driving pattern is determined in consideration of environmental information indicating an environmental attribute of a spot corresponding to the position of the vehicle.

13. The control device according to claim 12, wherein: The control unit sends the environment information to the server device, so that the server device sends the environment information to the terminal device.

14. A vehicle comprising a control device according to any one of claims 8 to 13.

15. An operating method for an information processing system, the information processing system comprising a server device and a vehicle that transmit and receive information to and from each other, wherein: the vehicle compares a driving pattern corresponding to position information and information on a motion state of the vehicle with past driving patterns corresponding to past position information and information on past motion states to determine whether the driving pattern is different from the past driving pattern, and when the driving pattern is different from the past driving pattern, transmits to the server device a captured image of the surroundings or interior of the vehicle when the driving pattern is different from the past driving pattern; and The server device sends the captured image to the terminal device so that the terminal device outputs the captured image. In which, the server device compares the past driving pattern at the same location as the current location of the vehicle with the current driving pattern, or compares the past driving pattern at the same time of the day as the current time with the current driving pattern to determine whether the driving pattern is different from the past driving pattern.

16. The operating method according to claim 15, wherein: the vehicle transmits, to the server device, position information indicating the position of the vehicle when the driving pattern of the vehicle is different from the past driving pattern; and The server device transmits the location information to the terminal device.

17. The operating method according to claim 15 or 16, wherein: The driving mode includes a motion state of the vehicle.

18. The operating method according to claim 15 or 16, wherein: The driving pattern includes a driving route of the vehicle.

19. The operation method according to claim 16, wherein the server device or the vehicle determines whether the driving pattern of the vehicle is different from the past driving pattern in consideration of environmental information indicating environmental attributes of a place corresponding to the position of the vehicle.

20. The operating method according to claim 19, wherein: The server device sends the environment information to the terminal device.