A vehicle terminal device, service server, method, computer program, and computer-readable recording medium that provide driving-related guidance services.

Abstract

To provide travel related guidance service of a service provision server.SOLUTION: A method for providing travel related guidance service comprises the steps of: receiving ADAS data of a vehicle, position data of the vehicle, travel data of the vehicle, and a travel video photographed during travel of the vehicle related to a specific travel situation of the vehicle from a terminal for the vehicle; analyzing the received data and the travel video to generate guidance information related to the specific travel situation of the vehicle; and providing the travel related guidance service to the vehicle by using the generated guidance information.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a vehicle terminal device, a service providing server, a method, a computer program, and a computer-readable recording medium that provide driving-related guidance services. More specifically, the present invention relates to a vehicle terminal device, a service providing server, a method, a computer program, and a computer-readable recording medium that provide driving-related guidance services based on video captured during vehicle driving and various data obtained during vehicle driving.

Background Art

[0002] The rapid development of automotive technology has led to a global increase in vehicles. Along with such an increase in vehicles, location-based services (LBS) related to vehicles have also been activated.

[0003] As a typical device using such location information services, there is a vehicle navigation that measures the current position of a vehicle or guides a moving route to a destination.

[0004] Furthermore, in recent years, in order to determine the percentage of fault based on the location of responsibility for accidents that occur during vehicle parking or operation, a vehicle black box that can provide objective materials has been used. Along with the improvement of performance, location information services are also provided from the vehicle black box.

[0005] As described above, the use of various vehicle terminal devices has become widespread. Along with this, consumers' needs for solutions that can enhance the driving stability of drivers and various additional services for the convenience of drivers are increasing more and more.

Summary of the Invention

Problems to be Solved by the Invention

[0006] The present invention has been made in response to the above-mentioned needs, and the object of the present invention is to provide a vehicle terminal device, a service provision server, a method, a computer program, and a computer-readable recording medium that provide an accident situation prediction guidance service and an accident legal guidance service when a specific driving situation is detected while the vehicle is in motion, using ADAS data, location data, driving data, and driving video related to the detected specific driving situation.

[0007] Furthermore, an object of the present invention is to provide a vehicle terminal device, a service provision server, a method, a computer program, and a computer-readable recording medium that provide driving-related guidance services to the driver of a vehicle using the driver's past driving history data and the past driving history data of other drivers. [Means for solving the problem]

[0008] A method for providing a driving-related guidance service for a vehicle terminal device according to one embodiment of the present invention for achieving the above-mentioned objectives includes the steps of: acquiring driving video footage taken while the vehicle is in motion; receiving ADAS (Advanced Driver Assistance System) data of the vehicle from an ADAS module that assists in driving the vehicle, and receiving driving data of the vehicle from an ECU (Electronic Control Unit) module of the vehicle; receiving location data of the vehicle; and, when a specific driving situation is detected while the vehicle is in motion, transmitting the ADAS data, location data, driving data, and driving video footage related to the detected specific driving situation to a service provider server.

[0009] Furthermore, the transmission step may include, if a first driving situation in which an accident is possible is detected, even though no accident has occurred while the vehicle is in motion, transmitting the ADAS data, location data, driving data, and driving video from before the time of the detected first driving situation to the service provider server.

[0010] Furthermore, if a second driving situation in which an accident occurs while the vehicle is in motion is detected, the system may further include the step of transmitting the ADAS data, location data, driving data, and driving video from a predetermined time before to a predetermined time after the detected second driving situation to the service provider server.

[0011] The step of acquiring driving video footage taken while the vehicle is in motion includes the step of acquiring forward driving video footage taken by a front camera and rear driving video footage taken by a rear camera, and further includes the step of combining the forward driving video and the rear driving video to generate a top view video in which the vehicle's position is positioned in the combined video, and the driving video transmitted to the service provider server may be the top view video.

[0012] Furthermore, the top-down view image can be in GIF (Graphics Interchange Format) format, which is formed by extracting multiple frames.

[0013] Furthermore, when the service provider server generates accident prediction information that could potentially occur in the vehicle based on the data received from the vehicle terminal device, the service provider server may further include the steps of receiving the generated accident prediction information and providing guidance based on the received accident prediction information.

[0014] Furthermore, when the service provider server generates accident legal assessment information based on the data received from the vehicle terminal device, the service provider server may further include the steps of receiving the generated accident legal assessment information and providing guidance based on the received accident legal assessment information.

[0015] The system may further include the steps of detecting an impact level, determining that an accident is likely to occur in a first driving situation if an impact exceeding a pre-set first impact level but below a pre-set second impact level is detected, and at least one of the following is detected based on the ADAS data before the impact is detected: lane departure warning, frontal collision, sharp curve warning, sudden stop warning, sudden rotation warning, and blind spot warning, and determining that an accident has occurred in a second driving situation if an impact exceeding a pre-set second impact level is detected.

[0016] On the other hand, a method for providing a driving-related guidance service by a service provision server according to one embodiment of the present invention for achieving the above-mentioned objectives includes the steps of: receiving ADAS data of the vehicle related to a specific driving situation of the vehicle, location data of the vehicle, driving data of the vehicle, and driving video taken while the vehicle is in motion from a vehicle terminal device; analyzing the received data and driving video to generate guidance information related to a specific driving situation of the vehicle; and providing a driving-related guidance service to the vehicle using the generated guidance information.

[0017] In the generation step, although no accident occurred while the vehicle was in motion, the ADAS data, location data, driving data, and driving video are analyzed from before the point in time of the first driving situation in which an accident was possible, and accident situation prediction information that could have occurred to the vehicle in the first driving situation is generated. In the provision step, an accident situation prediction guidance service can be provided using the generated accident situation prediction information.

[0018] Furthermore, in the generation step, ADAS data, location data, driving data, and driving video are analyzed from a predetermined time before to a predetermined time after the second driving situation in which the accident occurred to generate accident legal evaluation information, and in the provision step, an accident legal guidance service can be provided using the generated accident legal evaluation information.

[0019] Furthermore, the received driving video can be a top-view video in which the vehicle's body is positioned at the vehicle's location in the combined video, with the forward driving video and the rear driving video combined.

[0020] Furthermore, the step of generating the accident situation prediction information may include the steps of detecting vehicles around the vehicle from the top-view image and predicting accident situations that could have occurred to the vehicle in the first driving situation using at least one of the vehicle's ADAS data and driving data for the detected vehicle, and generating the accident situation prediction information.

[0021] The step of generating the accident legal assessment information may include the steps of detecting vehicles around the vehicle from the top-view image, analyzing the accident fault ratio using at least one of the vehicle's ADAS data and driving data for the detected vehicles, and generating the accident legal assessment information including the accident fault ratio obtained from the analysis.

[0022] The system may further include the steps of: storing a destination dataset for each parking location for the driver of the vehicle; when the vehicle changes from a parked state to a driving state, comparing the vehicle's location data with the previously stored destination dataset for each parking location to determine the driver's expected destination; and providing a destination prediction guidance service using the determined expected destination.

[0023] The system may further include the steps of: storing an ADAS dataset for each driving location for the driver of the vehicle; comparing the vehicle's location data with the already stored ADAS dataset for each driving location to detect ADAS data that matches the location of the vehicle's driver; and providing a driver's past driving history guidance service using the detected ADAS data.

[0024] Furthermore, it can further include steps of storing an ADAS data set for each driving position with respect to other drivers, comparing the vehicle's position data with the already stored ADAS data set for each driving position, detecting the ADAS data that matches the position of the driver of the vehicle, and providing a past driving history guidance service for other drivers using the detected ADAS data.

[0025] On the other hand, a vehicle terminal device according to an embodiment of the present invention for achieving the above object includes a communication unit, a video acquisition unit that acquires a driving video captured during the driving of the vehicle, an ADAS data acquisition unit that receives ADAS data from an ADAS (Advanced Driver Assistance System) module that assists in driving the vehicle, an ECU data acquisition unit that receives the driving data of the vehicle from the ECU (Electronic Control Unit) module of the vehicle, a position data acquisition unit that receives the position data of the vehicle, and a control unit that controls the communication unit to transmit the ADAS data, the position data, the driving data of the vehicle, and the driving video related to the detected specific driving situation to a service providing server when a specific driving situation is detected during the driving of the vehicle.

[0026] Also, a service providing server according to an embodiment of the present invention for achieving the above object includes a communication unit that receives, from a vehicle terminal device, the ADAS data of the vehicle, the position data of the vehicle, the driving data of the vehicle, and the driving video captured during the driving of the vehicle related to a specific driving situation of the vehicle, and a service providing unit that analyzes the received data and the driving video to generate guidance information related to the specific driving situation of the vehicle and provides a driving-related guidance service for the vehicle using the generated guidance information.

[0027] On the other hand, according to an embodiment of the present invention for achieving the above object, it can include a program stored in a recording medium to execute a method for providing a driving-related guidance service.

[0028] According to an embodiment of the present invention for achieving the above object, it can include a computer-readable recording medium on which program code for executing a method of providing a driving-related guidance service is recorded.

Advantages of the Invention

[0029] According to various embodiments of the present invention described above, in a first driving situation where a vehicle may have an accident, the accident situation that may have occurred in the vehicle is predicted, accident situation prediction information is generated, and an accident situation prediction service is provided, thereby reminding the driver of the danger and enabling the driver to drive safely.

[0030] Also, according to various embodiments of the present invention, in a second driving situation where a vehicle accident has occurred, the course of the accident is analyzed, accident legal evaluation information including the accident fault ratio obtained by the analysis is generated, and an accident legal guidance service is provided, thereby automatically assisting in legal services for financial elements such as vehicle repair costs and insurance-related consultations, and enhancing the convenience of the driver.

[0031] Also, according to various embodiments of the present invention, the convenience of the driver can be enhanced by a destination prediction guidance service, a driver's past driving history guidance service, a past driving history guidance service of other drivers, and the like.

Brief Description of the Drawings

[0032] [Figure 1] It is a block diagram showing a service providing system according to an embodiment of the present invention. [Figure 2] It is a timing diagram showing the operation of a service providing system according to an embodiment of the present invention. [Figure 3] It is a block diagram showing a vehicle terminal device according to an embodiment of the present invention. [Figure 4] It is a flowchart showing a method of providing a driving-related guidance service of a vehicle terminal device according to an embodiment of the present invention. [Figure 5]This is a flowchart showing a method for detecting the driving status of a vehicle terminal device according to one embodiment of the present invention. [Figure 6] This is a block diagram showing a service provider server related to one embodiment of the present invention. [Figure 7] This is a block diagram that more specifically shows the service provision unit related to one embodiment of the present invention. [Figure 8] This figure shows a top-down view of an embodiment of the present invention. [Figure 9] This figure shows a method for predicting accident conditions related to one embodiment of the present invention. [Figure 10] This figure shows a method for generating legal evaluation information related to one embodiment of the present invention. [Figure 11] This flowchart shows a method for providing an accident situation prediction and guidance service related to one embodiment of the present invention. [Figure 12] This flowchart shows the method for providing accident legal guidance services related to one embodiment of the present invention. [Modes for carrying out the invention]

[0033] The following is merely illustrative of the principles of the present invention. Therefore, those skilled in the art can implement the principles of the present invention and invent various devices that fall within the concept and scope of the present invention, even if they are not explicitly described or illustrated herein. Furthermore, it should be understood that all conditional terms and embodiments listed herein are, in principle, explicitly intended solely for the purpose of illustrating the concepts of the present invention and are not limited by such specifically listed embodiments and states.

[0034] Furthermore, it should be understood that all detailed descriptions listing specific embodiments, as well as the principles, viewpoints, and embodiments of the present invention, are intended to include structural and functional equivalents of such matters. Moreover, it should be understood that such equivalents include not only currently known equivalents, but also equivalents to be developed in the future, i.e., all elements invented to perform the same function, regardless of their structure.

[0035] Therefore, for example, the block diagrams herein should be understood as representing a conceptual view of an exemplary circuit embodying the principles of the present invention. Similarly, all flowcharts, state conversion diagrams, pseudocode, etc., can be substantially represented on a computer-readable medium and should be understood as representing various processes performed by a computer or processor, whether or not the computer or processor is explicitly depicted.

[0036] The functions of the various elements illustrated in the diagram, including a functional block represented as a processor or a similar concept, can be provided not only by dedicated hardware but also by the use of hardware capable of executing software in conjunction with appropriate software. When provided by a processor, the functions can be provided by a single dedicated processor, a single shared processor, or multiple individual processors, some of which can be shared.

[0037] Furthermore, the explicit use of terms presented as processor, control, or similar concepts should not be interpreted as exclusively referring to hardware capable of running software, but should be understood to implicitly include, without limitation, digital signal processor (DSP) hardware, ROM, RAM, and non-volatile memory for storing software. Other commonly used hardware may also be included.

[0038] In the claims of this specification, components expressed as means for performing the functions described in the detailed description are intended to include all methods for performing the functions, including, for example, combinations of circuit elements performing the above functions or all forms of software, including firmware / microcode, which are coupled with appropriate circuitry for executing the software to perform the functions. The present invention as defined by such claims is understood to be equivalent to any means that can provide the functions as understood herein, since the functions provided by the various enumerated means are combined and coupled to the manner required by the claims.

[0039] The above-mentioned objectives, features, and advantages will become clearer from the following detailed description in conjunction with the attached drawings, so that a person with ordinary skill in the art to which the present invention pertains should be able to easily implement the technical idea of ​​the present invention. Furthermore, in describing the present invention, if it is determined that a specific description of prior art related to the present invention may obscure the gist of the present invention, such detailed description will be omitted.

[0040] Various embodiments of the present invention will be described in detail below with reference to the attached drawings.

[0041] Figure 1 is a block diagram showing a service provision system according to one embodiment of the present invention. Figure 2 is a timing diagram showing the operation of a driving-related guidance system according to one embodiment of the present invention. Referring to Figures 1 and 2, the service provision system 1000 according to one embodiment of the present invention includes all or part of a vehicle terminal device 100, a user terminal device 200, and a service provision server 300.

[0042] The vehicle terminal device 100 is installed in a vehicle and can be a device that collects various data necessary to provide the driving-related guidance service according to the present invention, performs preprocessing and analysis of the collected data, transmits the collected data or processed data to the service provision server 300, and provides various driving-related guidance in cooperation with the service provision server 300.

[0043] Specifically, the vehicle terminal device 100 can acquire driving video footage taken while the vehicle is in motion (S11), receive ADAS (Advanced Driver Assistance System) data from an ADAS module that assists in driving the vehicle, receive driving data from the vehicle's ECU (Electronic Control Unit) OBD (On-Board Diagnostics) module, and receive location data acquired by the location data acquisition unit 150 (S12). Furthermore, when a specific driving situation is detected while the vehicle is in motion (S13:Y), the vehicle terminal device 100 can transmit ADAS data, location data, driving data, and driving video footage related to the detected specific driving situation to the service provision server 300 (S14).

[0044] Such a vehicle terminal device 100 can be implemented using various devices such as navigation systems, vehicle video recording devices such as car dash cameras or car video recorders. However, it is not limited to these, and the vehicle terminal device 100 may also be implemented using a communication dongle that relays ADAS data, driving data, location data, and driving video acquired by various vehicle devices to a service provision server 300.

[0045] Furthermore, the expression "vehicle in motion" as mentioned above refers to a state in which the vehicle is being driven by an autonomous driving system or by a human, and is a concept that includes various states such as the vehicle being stopped, the vehicle in motion, and the vehicle being parked.

[0046] Furthermore, the specific driving conditions of the vehicle described above may include a first driving condition in which no accident occurred while the vehicle was in motion, but an accident was possible, and a second driving condition in which an accident occurred while the vehicle was in motion.

[0047] Furthermore, the term "vehicle" is a concept that includes transport devices capable of moving living beings using power, and encompasses both railway vehicles that run on tracks and vehicles (cars), motorcycles, bicycles, and other transport machines that run on roads.

[0048] On the other hand, the service provider server 300 receives ADAS data, location data, driving data, and driving video related to a specific driving situation of the vehicle from the vehicle terminal device 100, analyzes the received data and driving video, and can generate guidance information related to the specific driving situation of the vehicle (S15). For example, the service provider server 300 can analyze the data and driving video received from the vehicle terminal device 100 and generate accident situation prediction information that could have occurred to the vehicle in the first driving situation. Alternatively, the service provider server 300 can analyze the data and driving video received from the vehicle terminal device 100 and generate accident legal evaluation information based on the circumstances of the vehicle accident.

[0049] The service provider server 300 can then use the generated guidance information to provide driving-related guidance services to the vehicle. Specifically, the service provider server 300 can provide driving-related guidance services to the vehicle terminal device 100 by transmitting the generated guidance information to the vehicle terminal device 100. In addition, the service provider server 300 can provide driving-related guidance services to the vehicle to the user terminal device 200 by transmitting the generated guidance information to the user terminal device 200.

[0050] In this case, the vehicle terminal device 100 and the user terminal device 200 can provide driving-related guidance via voice or screen using guidance information received from the service provision server 300.

[0051] Here, the user terminal device 200 is a device that is used by people who need driving-related guidance for a vehicle, such as the driver or passengers of a vehicle, and the user terminal device 200 can be implemented using various devices such as smartphones, tablet computers, notebook PCs, PDAs (personal digital assistants), PMPs (portable multimedia players), smart glasses, projector glasses, and navigation systems.

[0052] The driving-related guidance system 1000 according to the present invention can provide services related to the driving of a vehicle using at least one of ADAS data, location data, driving data, and driving video received from a vehicle terminal device 100.

[0053] In the following sections, with reference to the subsequent figures, each component module constituting the service provision system 1000 according to one embodiment of the present invention will be described in more detail.

[0054] Figure 3 is a block diagram showing a vehicle terminal device according to one embodiment of the present invention. Referring to Figure 3, the vehicle terminal device 100 according to one embodiment of the present invention includes all or part of a communication unit 110, an image acquisition unit 120, an ADAS data acquisition unit 130, an ECU data acquisition unit 140, a position data acquisition unit 150, an image processing unit 160, an output unit 170, a storage unit 180, an impact detection unit 190, and a control unit 195.

[0055] The communication unit 110 can communicate between the vehicle terminal device 100 and other devices. Specifically, the communication unit 110 can communicate with all or part of the service provision server 300, the user terminal device 200, and vehicle terminal devices installed in other vehicles, and perform the function of sending and receiving data.

[0056] In particular, the communication unit 110 can transmit driving video, ADAS data, driving data, and location data acquired while the vehicle is in motion to the service provision server 300, and the service provision server 300 can generate guidance information related to the vehicle's operation based on the data received from the vehicle terminal device 100. The communication unit 110 can then receive the guidance information related to the vehicle's operation generated by the service provision server 300.

[0057] Here, the communication unit 110 can be implemented using various communication methods, such as being connected wirelessly or wired via a local area network (LAN) and the internet, being connected via a USB (Universal Serial Bus) port, being connected via a mobile communication network such as 3G or 4G, or being connected via a wireless local area network method such as NFC (Near Field Communication), RFID (Radio Frequency Identification), or Wi-Fi.

[0058] The video acquisition unit 120 can acquire video footage taken while the vehicle is in motion. For example, if the vehicle terminal device 100 is a device equipped with a video recording function, the video acquisition unit 120 can be a camera that records video. As another example, if the vehicle terminal device 100 is a communication dongle, the video acquisition unit 120 can be implemented as a module that receives video footage taken by an external camera.

[0059] Thus, the vehicle driving video acquired by the video acquisition unit 120 may include numerous objects located in the real-world environment in which the vehicle is driving, such as other vehicles, people, animals, bridges, buildings, roadways, pedestrian walkways, road signs, crosswalks, intersections, traffic lights, median strips, bus stops, trees, and so on.

[0060] For example, roadway footage may include multiple roadways separated by lane markings, roadways composed of multiple roadways, and multiple vehicles traveling on the roadways. Depending on the roadway the vehicle is traveling on, the footage may also include roadway signs. Here, "lane" can refer to the lines on either side that form the roadway in which the vehicle is located. "Lane" can also refer to a roadway formed by lanes and on which vehicles travel, such as lane 1, lane 2, ..., lane N, etc.

[0061] Furthermore, the vehicle's driving footage may include forward-facing footage captured by a front-facing camera and rear-facing footage captured by a rear-facing camera. In addition, the vehicle's driving footage may further include left-side footage captured by a left-side camera and right-side footage captured by a right-side camera.

[0062] The vehicle driving video acquired by the video acquisition unit 120 can be transmitted to the video processing unit 160 for video processing.

[0063] The ADAS data acquisition unit 130 can receive ADAS data from the ADAS (Advanced Driver Assistance System) module. Here, ADAS may include a Forward Vehicle Start Alert (FVSA) that guides or warns of the departure of a vehicle located in front of the vehicle, a Forward Collision Warning System (FCWS) that guides or warns of the possibility of a collision with a vehicle located in front of the vehicle, a Lane Departure Warning System (LDWS) that guides or warns of the vehicle leaving its lane, a Curve Speed ​​Warning System (CSWS) that guides or warns of a sharp curve ahead of the vehicle, a sudden stop warning system that guides or warns of a sudden stop, a sudden turn warning system that guides or warns of a sudden turn, and a Blind Spot Detection (BSD) that guides or warns of the presence of another vehicle in the vehicle's blind spot. Furthermore, ADAS can include features such as guidance for speed limit enforcement, automatic emergency braking (AEB), lane keeping assist (LKAS) that adjusts the direction of travel to maintain the lane when drifting out, advanced smart cruise control (ASCC) that maintains an appropriate distance from the vehicle ahead while driving at a predetermined speed, around view monitor (AVM) that visually displays the surroundings of the vehicle, and driver attention warning (DAW) that analyzes the driver's driving pattern, including vehicle signals such as steering angle and steering torque, and the vehicle's position within the lane, and provides guidance when it is determined that the driving pattern is inattentive.However, the examples of ADAS are not limited to those described above, and the ADAS according to the present invention is a concept that includes any of the driver support functions that assist the driver in safe driving in a wide range of driving environments that a vehicle driver may encounter while driving.

[0064] On the other hand, if at least one of the numerous ADAS functions described above is executed while the vehicle is in motion, the ADAS data acquisition unit 130 can acquire the executed ADAS identification data and data detected during the execution process of the corresponding ADAS from the ADAS module. For example, if the forward collision warning system (FCWS) function is executed while the vehicle is in motion, the ADAS data acquisition unit 130 can acquire the executed ADAS identification data indicating that the executed function is FCWS, and data detected during the execution process of FCWS (for example, the distance to the vehicle in front).

[0065] The ECU data acquisition unit 140 can receive vehicle driving data from the vehicle's ECU (Electronic Control Unit) module. Here, ECU refers to an electronic control unit that uses a computer to control the status of the vehicle's engine, automatic transmission, ABS, etc. Specifically, the ECU data acquisition unit 140 can be connected to an OBD terminal connected to the vehicle's ECU, and in the connection between the ECU data acquisition unit 140 and the ECU via the OBD interface, the ECU can acquire vehicle driving data from the ECU by performing periodic polling using the OBD communication protocol.

[0066] Here, vehicle driving data can include data on changes in the vehicle's engine ON / OFF state, vehicle speed data, steering angle of the vehicle's steering system, steering torque data, and vehicle fuel data.

[0067] The location data acquisition unit 150 is a device that acquires location data using GNSS (Global Navigation Satellite System). GNSS refers to a navigation system that can calculate the position of a receiving terminal using radio signals received from artificial satellites. Specific examples of GNSS include GPS (Global Positioning System), Galileo, GLONASS (Global Orbiting Navigational Satellite System), COMPASS, IRNSS (Indian Regional Navigational Satellite System), and QZSS (Quasi-Zenith Satellite System), depending on the operating entity. The location data acquisition unit 150 according to one embodiment of the present invention can acquire location data by receiving GNSS signals serviced in the area where the vehicle terminal device 100 is used. Alternatively, the location data acquisition unit 150 can also acquire location data by communicating with a base station or AP (Access Point) in addition to GNSS.

[0068] The video processing unit 160 can process the vehicle driving video acquired by the video acquisition unit 120. Specifically, the video processing unit 160 can compress the video data. For example, the vehicle driving video acquired by the video acquisition unit 120 is a continuous video composed of multiple frames along the time axis. The capacity of such video is very large if not compressed, and storing it directly in memory is very inefficient. Therefore, the digitally converted video must be compressed. Accordingly, the video processing unit 160 can perform compression based on the correlation between frames, spatial correlation, and methods that utilize the characteristics of vision that are sensitive to low-frequency components.

[0069] Furthermore, the video processing unit 160 can combine the forward driving video and the rear driving video acquired by the video acquisition unit 120 and generate a top-view video in which the vehicle is positioned at the vehicle's location in the combined video. Such a top-view video can be transmitted to the service provision server 300, and the top-view video transmitted to the service provision server 300 can be analyzed together with at least one of ADAS data, driving data, and location data and used to generate accident situation prediction information, legal evaluation information, etc.

[0070] Here, the top-view video can be, for example, a GIF (Graphics Interchange Format) format formed by extracting multiple frames. That is, even if the driving video is compressed by the video acquisition unit 120, the data size is large when transmitting the moving image to the server. Therefore, according to the present invention, in order to include dynamic information such as accident situation prediction information and legal evaluation information, and to achieve the objective with the smallest possible data size, the video processing unit 160 can generate the driving video in GIF format and transmit it to the service provision server 300.

[0071] In the above example, the top-view video generation operation was described as being performed in the video processing unit 160 of the vehicle terminal device 100, but the invention is not limited to this. In another embodiment of the present invention, the vehicle terminal device 100 can transmit the captured driving video to the service provision server 300, and the service provision server 300 may recombine the driving video received from the vehicle terminal device 100 to generate the top-view video.

[0072] On the other hand, the output unit 170 is a device that outputs data from the vehicle terminal device 100 to the user in video and / or audio format. Here, the output unit 170 may include all or part of a display unit (not shown) and an audio output unit (not shown).

[0073] The display unit is a device that outputs data that can be visually recognized by the user. The display unit can be implemented as a display unit provided on the front of the housing of the vehicle terminal device 100. Alternatively, the display unit may be formed integrally with the vehicle terminal device 100 and output visual recognition data, or it may be provided separately from the system 100, such as a HUD (Head Up Display), and output visual recognition data.

[0074] The audio output unit is a device that outputs data that the vehicle terminal device 100 can perceive aurally. The audio output unit can be implemented using a speaker that expresses the data to be communicated to the user of the vehicle terminal device 100 in sound.

[0075] The storage unit 180 serves the function of storing various data and applications necessary for the operation of the vehicle terminal device 100. In particular, the storage unit 180 can store data necessary for the operation of the vehicle terminal device 100, such as the OS, route search applications, and map data. Furthermore, the storage unit 180 can classify and store driving video, ADAS data, driving data, and location data generated by the operation of the vehicle terminal device 100 by time or location.

[0076] Such storage unit 180 may be implemented using not only built-in storage elements such as RAM (Random Access Memory), fresh memory, ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electronically Erasable and Programmable ROM), registers, hard disks, removable disks, memory cards, and USIM (Universal Subscriber Identity Module), but also removable storage elements such as USB memory.

[0077] On the other hand, the impact detection unit 190 can detect impacts while the vehicle is in motion and output an impact level value corresponding to the detected impact to the control unit 195. Here, the impact detection unit 190 can be implemented as an acceleration sensor, for example.

[0078] The control unit 195 can control the overall operation of the vehicle terminal device 100. Specifically, the control unit 195 can control all or part of the communication unit 110, the video acquisition unit 120, the ADAS data acquisition unit 130, the ECU data acquisition unit 140, the position data acquisition unit 150, the video processing unit 160, the output unit 170, the storage unit 180, and the impact detection unit 190.

[0079] In particular, the control unit 195 can provide vehicle driving-related guidance services in cooperation with the service provision server 300. Here, the vehicle driving-related guidance services may include at least one of the following: accident situation prediction guidance services, accident law guidance services, vehicle driver destination prediction guidance services, vehicle driver past driving history guidance services, and other drivers past driving history guidance services.

[0080] Specifically, the control unit 195 can detect specific driving conditions while the vehicle is in motion and control the communication unit 110 to transmit ADAS data, location data, driving data, and driving video related to the detected specific driving conditions to the service provider server. Here, the specific driving conditions may include a first driving condition in which no accident has occurred while the vehicle is in motion but an accident is possible, and a second driving condition in which an accident has occurred while the vehicle is in motion.

[0081] Specifically, the control unit 195 receives an impact level value from the impact detection unit 190 while the vehicle is in motion. The control unit 195 can determine that a first driving situation with a possibility of an accident is occurring if an impact exceeding a previously set first impact level and below a previously set second impact level is detected, and if at least one of the following is detected before the impact is detected based on ADAS data: lane change notification, forward vehicle collision notification, sharp curve notification, sudden stop notification, sudden turn notification, and blind spot location notification (similarly BSD notification). Here, the second impact level is a threshold of impact levels that can be judged as a vehicle accident, and can be a value calculated by quantifying various experimental data.

[0082] In other words, if a driver, while driving, fails to detect another vehicle traveling in an adjacent lane and changes lanes, then spots the other vehicle and makes a sudden stop, the vehicle being driven by the driver is considered to be in a situation where an accident could have occurred, even though no accident actually occurred. In this case, since no accident actually occurred, the impact detection unit 190 detects an impact level that exceeds the first impact level but is below the previously set second impact level, and the ADAS data acquired by the ADAS data acquisition unit 130 can include lane change notification data, blind spot notification data, and sudden stop notification data.

[0083] Alternatively, if the driver is driving without recognizing the vehicle in front and then spots the vehicle and makes a sudden stop, the vehicle being driven by the driver is considered to be in a situation where an accident could have occurred, even though no accident actually occurred. In this case, since no accident actually occurred, the impact detection unit 190 detects an impact level that exceeds the first impact level but is below the previously set second impact level, and the ADAS data acquired by the ADAS data acquisition unit 130 can include data for a collision with the vehicle in front and data for sudden stopping.

[0084] Alternatively, if the driver fails to recognize a sharp curve and is driving at high speed when they discover the curve and decelerate suddenly, the vehicle being driven by the driver is considered to be in a situation where an accident could have occurred, even though no accident actually occurred. In this case, since no accident actually occurred, the impact detection unit 190 detects an impact level that exceeds the first impact level but is below the previously set second impact level, and the ADAS data acquired by the ADAS data acquisition unit 130 can include sharp curve notification data.

[0085] Thus, the control unit 195 can determine that an accident is likely to occur in a first driving situation when the impact detection unit 190 detects an impact level value within a predetermined range while the vehicle is in motion, and at least one of the following is detected based on ADAS data: lane change notification, front vehicle collision notification, sharp curve notification, sudden stop notification, sudden rotation notification, and blind spot notification.

[0086] However, if the impact detection unit 190 detects an impact exceeding the previously set second impact level, the control unit 195 can determine the vehicle's condition to be the second driving condition in which the accident occurred.

[0087] On the other hand, if no accident occurs while the vehicle is in motion, but a first driving situation in which an accident is possible is detected, the control unit 195 can control the communication unit 110 to transmit ADAS data, location data, driving data, and driving video from before the time of the detected first driving situation to the service provision server 300. At this time, the service provision server 300 can analyze the data and driving video received from the vehicle terminal device 100 during the first driving situation of the vehicle and generate accident prediction information that could have occurred to the vehicle during the first driving situation.

[0088] Furthermore, the service provider server 300 can collect driving video, driving data, ADAS data, location data, and accident data from each vehicle for each driving situation, and then build an accident probability prediction model by learning from the collected data using machine learning or deep learning. The service provider server 300 can then use the built accident probability prediction model to predict the probability of an accident for each vehicle driving situation and road section, and can generate and notify accident situation prediction information, including the probability of an accident, to vehicles that meet the predicted conditions (vehicle speed, driver's driving habits, driving information of surrounding vehicles, information on whether the vehicle is driving or the condition of the road located on the vehicle's driving path, etc.). As a result, the service provision server 300 according to the embodiment of the present invention can receive various driving-related data such as driving video, driving data, ADAS data, location data, accident data, and road condition information from vehicles traveling on all roads via V2V (Vehicle to Vehicle), V2I (Vehicle to infrastructure), V2X (Vehicle to Everything) communication, and then predict the likelihood of an accident through learning such as machine learning and deep learning, and provide information that there is a high probability of an accident to vehicles that are expected to meet certain conditions.

[0089] Here, the accident situation prediction information generated by the service provision server 300 can be used to provide an accident situation prediction guidance service. Specifically, the service provision server 300 can transmit the generated accident situation prediction information to the vehicle terminal device 100 or the user terminal device 200, and the vehicle terminal device 100 or the user terminal device 200 can provide guidance based on the accident situation prediction information. For example, if a driver, while driving, fails to detect another vehicle driving in the adjacent lane and changes lanes, then spots another vehicle and makes a sudden stop, the service provision server 300 can analyze the situation and generate accident situation prediction information such as, "A rear-end collision on the left side would have occurred approximately 3 seconds later," and the vehicle terminal device 100 or the user terminal device 200 can provide guidance based on the generated accident situation prediction information.

[0090] Furthermore, when a second driving situation in which an accident occurs while the vehicle is in motion is detected, the control unit 195 can control the communication unit 110 to transmit ADAS data, location data, driving data, and driving video from a predetermined time before to a predetermined time after the detected second driving situation to the service provision server 300. At this time, the service provision server 300 can analyze the data and driving video received from the vehicle terminal device 100 in the second driving situation of the vehicle and generate accident legal evaluation information based on the circumstances of the accident in the second driving situation of the vehicle.

[0091] Here, the accident legal assessment information generated by the service provider server 300 can be used to provide an accident legal guidance service. Specifically, the service provider server 300 can transmit the generated accident legal assessment information to the vehicle terminal device 100 or the user terminal device 200, and the vehicle terminal device 100 or the user terminal device 200 can provide guidance based on the accident legal assessment information. For example, when an accident occurs, the service provider server 300 can generate accident legal assessment information such as "The fault rate of your vehicle is 30%, and the fault rate of the other vehicle is 70%" through analysis, and the vehicle terminal device 100 or the user terminal device 200 can provide guidance based on the generated accident legal assessment information.

[0092] In other words, according to the present invention, by setting different data transmitted to the service provision server 300 depending on whether the vehicle's driving condition is a first driving condition where there is a risk of accident, or a second driving condition where an accident has occurred, it is possible to control the provision of driving-related guidance services corresponding to each condition.

[0093] On the other hand, a vehicle terminal device 100 according to one embodiment of the present invention can provide destination prediction guidance to the vehicle driver when the service provision server 300 determines the expected destination of the vehicle driver as the vehicle changes from a parked state to a driving state. For example, when the vehicle changes from a parked state to a driving state, the service provision server 300 can generate destination prediction information such as "The expected destination of the vehicle at the current parking location is the workplace" through analysis, and the vehicle terminal device 100 or user terminal device 200 can provide guidance based on the generated destination prediction information.

[0094] Furthermore, the vehicle terminal device 100 according to one embodiment of the present invention can compare the vehicle's location data with the ADAS dataset for each driving location already stored on the service provision server 300, and when ADAS data matching the location of the vehicle's driver is detected, it can provide guidance on the vehicle's driver's past driving history. For example, when ADAS data matching the location of the vehicle's driver is detected, the service provision server 300 can generate information on the driver's past driving history, such as "The current location is the location where blind spot notification was issued," through analysis, and the vehicle terminal device 100 or user terminal device 200 can provide guidance based on the generated information.

[0095] Furthermore, the vehicle terminal device 100 according to one embodiment of the present invention can compare the vehicle's location data with the ADAS dataset for each driving location of other drivers already stored on the service provision server 300, and when ADAS data of another driver that matches the vehicle driver's location is detected, it can provide guidance on the other driver's past driving history. For example, when ADAS data of another driver that matches the vehicle driver's location is detected, the service provision server 300 can generate past driving history information of the other driver through analysis, such as "The current location is the location where sharp curve warnings were issued by many drivers," and the vehicle terminal device 100 or user terminal device 200 can provide guidance based on the generated information.

[0096] The following will provide a more detailed explanation of how a vehicle terminal device 100 according to one embodiment of the present invention provides driving-related guidance services, with reference to Figures 4 and 5.

[0097] Figure 4 is a flowchart showing a method for providing driving-related guidance services for a vehicle terminal device according to one embodiment of the present invention. Referring to Figure 4, first, the vehicle terminal device 100 can acquire driving video footage taken while the vehicle is in motion (S110).

[0098] The vehicle terminal device 100 can receive vehicle ADAS (Advanced Driver Assistance System) data from the ADAS module that assists in driving the vehicle, vehicle driving data from the vehicle's ECU (Electronic Control Unit) module, and vehicle position data from the position data acquisition unit 150 (S120).

[0099] The vehicle terminal device 100 can then detect specific driving conditions while the vehicle is in motion (S130). If a first driving condition in which an accident is possible is detected, even if no accident has occurred while the vehicle is in motion, the vehicle terminal device 100 can transmit ADAS data, location data, driving data, and driving video from before the time of the detected first driving condition to the service provision server 300 (S140).

[0100] Then, when the service provider server 300 generates accident prediction information based on the data and driving video received from the vehicle terminal device 100, the accident prediction information can be received from the service provider server 300 (S150).

[0101] In this case, the vehicle terminal device 100 can provide guidance based on the received accident situation prediction information (S160).

[0102] However, if a second driving situation in which an accident occurs while the vehicle is in motion is detected, the vehicle terminal device 100 can transmit ADAS data, location data, driving data, and driving video from a predetermined time before to a predetermined time after the detected second driving situation to the service provision server 300 (S170).

[0103] Then, when the service provider server 300 generates accident legal evaluation information based on the circumstances of the accident, using the data and driving video received from the vehicle terminal device 100, the service provider server 300 can receive the accident legal evaluation information (S180).

[0104] In this case, the vehicle terminal device 100 can provide guidance based on the received accident legal evaluation information (S190).

[0105] On the other hand, the step of acquiring driving video (S110) may include the step of acquiring forward driving video captured by a front camera and rear driving video captured by a rear camera. In this case, the method according to one embodiment of the present invention may further include the step of combining the forward driving video and the rear driving video and generating a top-view video in which the vehicle is positioned at the vehicle's location in the combined video. The generated top-view video is transmitted to the service provision server 300 and can be used to generate accident situation prediction information and accident legal evaluation information. The top-view video may be in GIF (Graphics Interchange Format) format, which is formed by extracting multiple frames.

[0106] On the other hand, the method according to the above-described embodiment may further include the step of providing destination prediction guidance, guidance on the driver's past driving history, and guidance on the past driving history of other drivers in cooperation with the service provision server 300.

[0107] Figure 5 is a flowchart showing a method for detecting the driving status of a vehicle terminal device according to one embodiment of the present invention. Referring to Figure 5, the step (S130) of detecting a specific driving status while a vehicle is in motion according to one embodiment of the present invention can consist of the following steps.

[0108] First, the vehicle terminal device 100 can detect the impact level (S131).

[0109] The vehicle terminal device 100 can then determine whether the detected impact level exceeds a previously set first impact level and is less than a previously set second impact level (S132).

[0110] If the detected impact level exceeds the previously set second impact level (S132:N1), the vehicle terminal device 100 can determine that the accident occurred in the second driving situation (S133).

[0111] Furthermore, if the detected impact level is lower than the previously set first impact level (S132:N2), the vehicle terminal device 100 can determine that it is not a specific driving situation.

[0112] However, if the detected impact level exceeds the previously set first impact level but is less than the previously set second impact level (S132:Y), it can be determined, based on ADAS data, whether at least one of the following was detected before the impact was detected: lane departure warning, frontal collision warning, sharp curve warning, sudden stop warning, sudden turn warning, and blind spot warning (S134).

[0113] If, before an impact is detected, at least one of the following is detected based on ADAS data: lane departure warning, frontal collision, sharp curve warning, sudden stop warning, sudden turn warning, and blind spot warning (S134:Y), the vehicle terminal device 100 can determine that a first driving situation in which an accident is likely to occur is present (S135).

[0114] However, if at least one of the following is not detected based on ADAS data before an impact is detected (S134:N), the vehicle terminal device 100 can determine that it is not a first driving situation in which an accident is likely to occur (S136).

[0115] On the other hand, the vehicle terminal device 100 described above can provide driving-related guidance services in cooperation with the service provision server 300. Below, with reference to the following figures, the service provision server 300 according to one embodiment of the present invention will be described in more detail.

[0116] Figure 6 is a block diagram showing a service provision server according to one embodiment of the present invention. Figure 7 is a block diagram showing a service provision unit 330 according to one embodiment of the present invention in more detail. Referring to Figures 6 and 7, the service provision server 300 according to one embodiment of the present invention may include all or part of a communication unit 310, a storage unit 320, a service provision unit 330, and a control unit 340. The service provision unit 330 may include all or part of an accident situation prediction guidance service provision unit 331, an accident legal guidance service provision unit 332, a destination prediction guidance service provision unit 333, a driver past driving history guidance service provision unit 334, and another driver past driving history guidance service provision unit 335.

[0117] The communication unit 310 can communicate between the service provision server 300 and other devices. Specifically, the communication unit 310 can communicate with the vehicle terminal device 100 and the user terminal device 200 and perform the function of sending and receiving data.

[0118] In particular, the communication unit 310 can receive driving video, ADAS data, driving data, and location data acquired while the vehicle is in motion from the vehicle terminal device 100, and can generate guidance information related to the vehicle's operation based on the data received from the vehicle terminal device 100. The communication unit 310 can then transmit the generated guidance information related to the vehicle's operation to the vehicle terminal device 100 and / or the user terminal device 200.

[0119] Here, the communication unit 310 can be implemented using various communication methods, such as being connected wirelessly or wired via a local area network (LAN) and the internet, being connected via a USB (Universal Serial Bus) port, being connected via a mobile communication network such as 3G or 4G, or being connected via a wireless local area network method such as NFC (Near Field Communication), RFID (Radio Frequency Identification), or Wi-Fi.

[0120] The storage unit 320 functions to store various data and applications necessary for the operation of the service provision server 300. In particular, the storage unit 320 can classify and store various data and driving video received from the vehicle terminal device 100 according to the terminal device. The storage unit 320 can also store various programs for the operation of the service provision unit 330.

[0121] Here, the storage unit 320 may be implemented not only by built-in storage elements such as RAM (Random Access Memory), fresh memory, ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electronically Erasable and Programmable ROM), registers, hard disks, removable disks, memory cards, and USIM (Universal Subscriber Identity Module), but also by removable storage elements such as USB memory.

[0122] Such storage unit 320 may be implemented within the service provision server 300, or it may be implemented in the form of an external database (DB) server connected to the service provision server 300.

[0123] The service provision unit 330 can analyze data received from the vehicle terminal device 100 and driving video, and generate guidance information related to specific driving conditions of the vehicle. Specifically, the service provision unit 330 can use location data received via the communication unit 310 to analyze and record the location coordinates where specific driving conditions of the vehicle occurred. In addition, the accident situation prediction guidance service provision unit 331 can generate accident situation prediction information for service provision, the accident legal guidance service provision unit 332 can generate accident legal evaluation information for service provision, the destination prediction guidance service provision unit 333 can generate driver destination prediction information for service provision, the driver past driving history guidance service provision unit 334 can generate past driving history information of the vehicle driver for service provision, and the other driver past driving history guidance service provision unit 335 can generate past driving history information of other drivers for service provision.

[0124] The service provision unit 330 can then provide vehicle driving-related guidance services based on the generated guidance information. Specifically, the service provision unit 330 can provide vehicle driving-related guidance services by transmitting the generated guidance information to the vehicle terminal device 100 and the user terminal device 200. In this case, the vehicle terminal device 100 and the user terminal device 200 can provide driving-related guidance via voice or screen using the guidance information received from the service provision server 300.

[0125] Such service provision unit 330 may include all or part of the accident situation prediction guidance service provision unit 331, accident legal guidance service provision unit 332, destination prediction guidance service provision unit 333, driver past driving history guidance service provision unit 334, and other driver past driving history guidance service provision unit 335.

[0126] Specifically, the accident situation prediction guidance service provision unit 331 receives ADAS data, location data, driving data, and driving video from the vehicle terminal device 100 prior to the point in time of the first driving situation in which an accident is likely to occur. By analyzing the received data and driving video, it can generate accident situation prediction information that was likely to occur to the vehicle in the first driving situation.

[0127] Here, the driving footage can be a top-down view. Such driving footage will be explained in more detail with reference to Figure 8.

[0128] Figure 8 is a diagram showing a top-view image according to one embodiment of the present invention. Referring to Figure 8, the top-view image is an image produced from a viewpoint looking from the top to the bottom. Such a top-view image can be generated by changing the viewpoint of the camera of the forward driving image taken by the vehicle's front camera and the viewpoint of the camera of the rear image taken by the rear camera to a viewpoint looking from the top to the bottom, and then combining the changed front and rear images.

[0129] Furthermore, by combining the images captured by the vehicle's front and rear cameras with the left and right-side images captured by the left and right-side cameras, a highly accurate top-view image can be generated.

[0130] As another example, the camera viewpoint of the forward-driving footage captured by the vehicle's front camera and the rear-view footage captured by the rear camera can be changed to a top-down perspective, and the modified front and rear footage can be stitched together in chronological order to generate a top-down view.

[0131] In the top-down view, a passenger body 51 corresponding to the vehicle is placed at the position of the vehicle in the image, and passenger bodies 52 and 53 corresponding to other vehicles are placed at the positions of other vehicles in the image. Here, passenger bodies 51, 52 and 53 may be represented by actual photographic images of the vehicles, or they may be represented by images that represent the vehicles as animations or other graphic representations.

[0132] On the other hand, the accident situation prediction guidance service provider 331 can detect vehicles in front of, behind, and to the side of the vehicle from the driving video, and use at least one of the vehicle's ADAS data and driving data for the detected vehicles to predict accident situations that could have occurred to the vehicle in the first driving situation, and generate accident situation prediction information. Here, the ADAS data may include identification information of ADAS executed before the time of the first driving situation, and data detected during the execution of ADAS (for example, in the case of FCWS, the distance to the vehicle in front). The vehicle's driving data may include the vehicle's speed data before the time of the first driving situation, the steering angle of the vehicle's steering system, steering torque data, and vehicle fuel data. The operation of such an accident situation prediction guidance service provider 331 will be explained in more detail with reference to Figure 9.

[0133] Figure 9 is a diagram showing a method for predicting accident situations according to one embodiment of the present invention. Figure 9(a) shows a top-view image to explain a first driving situation according to one embodiment of the present invention, in which the driver of vehicle 51, while driving, fails to detect another vehicle 53 driving in the left lane and, in the process of changing lanes, spots the other vehicle 53 and makes a sudden stop. In this case, although no accident has actually occurred, the vehicle 51 driven by the driver is in a first driving situation where an accident is possible. In this case, the vehicle terminal device 100 can transmit ADAS data, location data, driving data, and a top-view image like that shown in Figure 9(a) to the service provision server 300 from the time of the first driving situation.

[0134] The accident situation prediction guidance service provider 331 then detects vehicles 52 and 53 around the vehicle 51 from the driving video and uses at least one of the ADAS data and driving data of the vehicle 51 for the detected vehicles 52 and 53 to predict the accident situation that could have occurred to the vehicle in the first driving situation. Specifically, in the situation shown in Figure 9(a), the ADAS data consists of identification information for the blind spot notification that was performed and data detected during the execution process of the blind spot notification (such as the distance to the vehicle on the left rear), and the driving data shows that the steering direction of the vehicle 51 is to the left. Therefore, the accident situation prediction guidance service provider 331 can determine that the vehicle that could have been involved in an accident with the vehicle 51 in the first driving situation is the vehicle 53 on the left.

[0135] The accident situation prediction and guidance service provider 331 can predict the accident situation that could have occurred between the vehicle 51 and the vehicle 53 on the left. Specifically, the accident situation prediction and guidance service provider 331 analyzes the speed and steering data of the vehicle 51 and the distance data to the vehicle on the left rear detected during the blind spot notification process, and can generate accident situation prediction information that predicts an accident if the vehicle 51 continues to drive as is. For example, in a situation like that shown in Figure 9(a), it can generate accident situation prediction information such as, "A rear-end collision on the left side would have occurred in approximately 3 seconds."

[0136] Figure 9(b) shows a top-view image to illustrate a first driving situation according to another embodiment of the present invention, in which the driver of vehicle 51, while driving without recognizing the vehicle 52 in front, spots the vehicle 52 in front and makes a sudden stop. In this first driving situation, although no accident has actually occurred, an accident is possible. In this case, the vehicle terminal device 100 can transmit ADAS data, location data, driving data, and a top-view image like that shown in Figure 9(b) to the service provision server 300 from the time of the first driving situation.

[0137] The accident situation prediction and guidance service provider 331 then detects vehicles 52 and 53 around the vehicle 51 from the driving video and uses at least one of the ADAS data and driving data of the vehicle 51 for the detected vehicles 52 and 53 to predict accident situations that could have occurred to the vehicles in the first driving situation. Specifically, in the situation shown in Figure 9(b), the ADAS data consists of the identification information of the executed FCWS and data detected during the execution process of the FCWS (such as the distance to the vehicle in front), and the driving data shows that the steering direction of the vehicle 51 is straight. Therefore, the accident situation prediction and guidance service provider 331 can determine that the vehicle that could have been involved in an accident with the vehicle 51 in the first driving situation was the vehicle in front 52.

[0138] The accident situation prediction and guidance service provider 331 can predict accident situations that could have occurred between the vehicle 51 and the vehicle 52 in front. Specifically, the accident situation prediction and guidance service provider 331 analyzes the speed and steering data of the vehicle 51, the distance data to the vehicle in front detected during the execution of the FCWS, and the speed of the vehicle in front, and can generate accident situation prediction information that predicts an accident if the vehicle 51 continues to drive as is. For example, in a situation like that shown in Figure 9(b), it can generate accident situation prediction information such as, "A frontal collision would have occurred in approximately 3 seconds."

[0139] On the other hand, the accident situation prediction and guidance service provider unit 331 can also use an artificial neural network to predict the likelihood of a vehicle being involved in an accident and provide information that a vehicle is likely to be involved in an accident if it is expected to meet certain conditions.

[0140] To this end, the accident situation prediction guidance service provision unit 331 may further include a learning data collection unit (not shown), a learning unit (not shown), and a memory (not shown) for storing the accident probability assessment model generated by the learning process.

[0141] The learning data collection unit can collect driving video, driving data, ADAS data, location data, and accident data from each vehicle for each driving situation. Specifically, the learning data collection unit can collect various driving-related data such as driving video, driving data, ADAS data, location data, accident data, and road condition information from vehicles traveling on all roads using vehicle communication infrastructure such as V2V (Vehicle to Vehicle), V2I (Vehicle to infrastructure), and V2X (Vehicle to Everything).

[0142] The learning unit uses various driving-related data collected by the learning data collection unit, such as driving video, driving data, ADAS data, location data, accident data, and road condition information, to perform learning and, as a result of learning, can generate an accident probability prediction model. Here, the accident probability prediction model is an algorithm or program that predicts whether or not there was a possibility of an accident occurring to the vehicle based on the collected data.

[0143] Such accident probability prediction models utilize data received while a vehicle is in motion as input and can output whether or not an accident is likely to occur, and if so, generate accident situation prediction information and a numerical value for the likelihood of an accident. Specifically, the accident probability prediction model can predict the likelihood of an accident for each vehicle's driving conditions and for each road section, and can also generate and notify accident situation prediction information, including the likelihood of an accident, to vehicles that meet the predicted conditions (vehicle speed, driver's driving habits, information on the driving of surrounding vehicles, whether the vehicle is in motion, information on the condition of the road located on the vehicle's driving path, etc.).

[0144] Furthermore, the learning unit can use the output values ​​to further train the accident probability prediction model. Also, if the output result is incorrect, the driver can input a response to the output result, and the learning unit can train the accident probability prediction model based on the driver's response.

[0145] In other words, according to the present invention, a model for predicting the likelihood of an accident can be generated by performing machine learning or deep learning, the generated model can be used to predict the likelihood of a vehicle accident, and the resulting value of the prediction can be provided to the driver. Here, the Convolutional Neural Network (CNN) algorithm, which is one of the neural network models, can be applied to deep learning. In this case, deep learning can be performed based on augmented data that assumes various conditions of the driving video. Here, the conditions are defined as conditions for transforming the video collected as training data in order to generate data for training the neural network model. Specifically, since various aspects can be shown by elements such as image shift, rotation, brightness change, and blur, the data can be augmented taking these into consideration.

[0146] Meanwhile, the accident legal guidance service provider 332 receives ADAS data, location data, driving data, and driving video from the vehicle terminal device 100 from a predetermined time before to a predetermined time after the second driving situation in which the accident occurred, and analyzes it to generate accident legal evaluation information based on the circumstances of the vehicle accident. Specifically, the accident legal guidance service provider 332 can detect vehicles in front of, behind, and to the sides of its own vehicle from the top-view video, analyze the circumstances of the accident using at least one of the ADAS data and driving data of the vehicle itself for the detected vehicles, and generate accident legal evaluation information including the accident fault ratio based on the analysis. Here, the driving video can be a top-view video.

[0147] Furthermore, the accident legal guidance service provider unit 332 can display the speed, distance, and time of vehicles surrounding the vehicle in the driving video, and clarify accident negligence based on factual evidence.

[0148] The operation of the accident legal guidance service provision unit 332 according to this embodiment of the present invention will be explained in more detail with reference to Figure 10.

[0149] Figure 10 is a diagram showing a method for generating legal evaluation information according to one embodiment of the present invention. Referring to Figure 10, Figure 10(a) shows a top-view image to explain a second driving situation according to one embodiment of the present invention, illustrating a second driving situation in which, because the driver of vehicle 51 was changing to the left lane, no blind spot notification was given, and an accident occurred when vehicle 53, located behind, collided with vehicle 51 just as the lane change was almost complete. In this case, the vehicle terminal device 100 can transmit ADAS data, location data, driving data, and a top-view image like that shown in Figure 10(a) from a predetermined time before to a predetermined time after the second driving situation to the service provision server 300.

[0150] The accident legal guidance service provider 332 then detects vehicles 52 and 53 surrounding vehicle 51 from the driving video and uses at least one of vehicle 51's ADAS data and driving data for the detected vehicles 52 and 53 to analyze the circumstances of the accident that occurred in the second driving situation. Specifically, in the situation shown in Figure 10(a), the accident legal guidance service provider 332 can detect the vehicle closest to vehicle 51 among the detected vehicles 52 and 53 as the accident vehicle 53. Then, in the situation shown in Figure 10(a), the accident legal guidance service provider 332 analyzes the data that no blind spot notification was performed before vehicle 51 changed lanes and that the speed of vehicle 51 did not decrease until the time of the accident, and can generate accident circumstances information indicating that the accident occurred due to the negligence of vehicle 53 while the driver of vehicle 51 was unaware of vehicle 53. Then, based on the accident circumstances information, the accident legal guidance service provider 332 can generate accident legal evaluation information including the percentage of fault in the accident.

[0151] Figure 10(b) shows a top-view image to illustrate a second driving situation according to another embodiment of the present invention, in which the driver of vehicle 51 attempts to change lanes to the left lane despite blind spot notification being performed, resulting in a collision between vehicle 53 located behind vehicle 51 and vehicle 51, causing an accident. In this case, the vehicle terminal device 100 can transmit ADAS data, location data, driving data, and a top-view image like that shown in Figure 10(b) to the service provider server 300 from a predetermined time before to a predetermined time after the second driving situation.

[0152] The accident legal guidance service provider 332 can then detect vehicles 52 and 53 surrounding vehicle 51 from the driving video and analyze the circumstances of the accident that occurred to the vehicles in the second driving situation using at least one of the ADAS data and driving data of vehicle 51 for the detected vehicles 52 and 53. Specifically, in the situation shown in Figure 10(b), the accident legal guidance service provider 332 can detect the vehicle closest to vehicle 51 among the detected vehicles 52 and 53 as the accident vehicle 53. Then, in the situation shown in Figure 10(b), the accident legal guidance service provider 332 can generate accident circumstances information, indicating that the driver of vehicle 51 should have been able to recognize vehicle 53 until the accident occurred between accident vehicles 51 and 53, but the accident occurred due to the negligence of vehicle 51, based on the data included in the ADAS data indicating that blind spot notification was performed, the distance data between the accident vehicles, the speed data of vehicle 51 up to the time of the accident, and the steering data. Furthermore, the accident legal guidance service provider unit 332 can generate accident legal evaluation information, including the percentage of fault in the accident, based on the information regarding the circumstances of the accident.

[0153] On the other hand, when the vehicle changes from a parked state to a driving state, the destination prediction service provider 333 compares the vehicle's location data with a previously stored destination dataset for each parking location to determine the driver's expected destination. The storage unit 320 can store a table that matches the parking location data for each driver with the destination data they traveled to from that parking location. In this case, when the vehicle changes from a parked state to a driving state, the destination prediction service provider 333 detects a group of candidate destinations corresponding to the vehicle's parking location from the storage unit 320 based on the vehicle's parking location data, and can determine the driver's expected destination from among the detected candidate destinations. As an example, the destination prediction service provider 333 can determine the driver's expected destination from among the candidate destinations by considering the time, weather, etc., at the time the vehicle changes from a parked state to a driving state.

[0154] The destination prediction guidance service provider unit 333 can then provide a destination prediction guidance service using the determined predicted destination. Specifically, the destination prediction guidance service provider unit 333 can generate destination prediction information such as "The predicted destination of the vehicle at its current parking location is the workplace," and transmit it to the vehicle terminal device 100 or the user terminal device 200. At this time, the vehicle terminal device 100 or the user terminal device 200 can provide guidance based on the received destination prediction information.

[0155] Furthermore, the driver's past driving history guidance service provider 334 stores ADAS datasets for each driving location for the vehicle's driver, compares the vehicle's location data with the already stored ADAS datasets for each driving location, and can detect ADAS data that matches the vehicle's driver's location. Specifically, the storage unit 320 can store ADAS data for each driving location of the vehicle's driver (for example, identification information of executed ADAS, detection information of executed ADAS). In this case, the driver's past driving history guidance service provider 334 can detect ADAS data corresponding to the vehicle's driving location from the storage unit 320 based on the vehicle's location data while it is driving.

[0156] In this case, the driver's past driving history guidance service provider 334 can provide a driver's past driving history guidance service using the detected ADAS data. Specifically, the driver's past driving history guidance service provider 334 can generate past ADAS history information such as "Your current location is the location where blind spot notification was issued," and transmit it to the vehicle terminal device 100 or the user terminal device 200. In this case, the vehicle terminal device 100 or the user terminal device 200 can provide guidance based on the received past ADAS history information.

[0157] The Other Driver Past Driving History Guidance Service Provider 335 stores ADAS datasets for each driving location for other drivers, compares the vehicle's location data with the already stored ADAS datasets for each driving location, and can detect ADAS data that matches the location of the vehicle's driver. Specifically, the storage unit 320 can store ADAS data for each driving location of other drivers (for example, identification information of executed ADAS, detection information of executed ADAS, and the number of times). In this case, the Other Driver Past Driving History Guidance Service Provider 335 can detect ADAS data for other drivers corresponding to the vehicle's driving location from the storage unit 320 based on the vehicle's location data while it is driving.

[0158] In this case, the Other Driver Past Driving History Guidance Service Provider Unit 335 can provide a past driving history guidance service for other drivers using the detected ADAS data. Specifically, the Driver Past Driving History Guidance Service Provider Unit 334 can generate past ADAS history information for other drivers, such as "Your current location is the location where multiple drivers have issued sharp curve warnings," and transmit it to the vehicle terminal device 100 or the user terminal device 200. In this case, the vehicle terminal device 100 or the user terminal device 200 can provide guidance based on the received past ADAS history information for other drivers.

[0159] The control unit 340 controls the overall operation of the service provision server 300. Specifically, the control unit 340 can control all or part of the communication unit 310, the storage unit 320, and the service provision unit 330.

[0160] In particular, the control unit 340 can provide vehicle driving-related guidance services in cooperation with the vehicle terminal device 100 and the user terminal device 200. Here, the vehicle driving-related guidance services may include at least one of the following: accident situation prediction guidance service, accident law guidance service, vehicle driver destination prediction guidance service, vehicle driver past driving history guidance service, and other driver past driving history guidance service.

[0161] The following describes in more detail how the service provider server 300 provides driving-related guidance services according to one embodiment of the present invention, with reference to Figures 11 and 12.

[0162] Figure 11 is a flowchart showing a method for providing an accident situation prediction guidance service according to one embodiment of the present invention. Referring to Figure 11, first, the service provision server 300 can receive ADAS data, location data, driving data, and driving video from before a first driving situation in which an accident has not occurred but there is a possibility of an accident occurring (S201). Here, the received driving video may be a top-view video in which the forward driving video and the rear driving video are combined and the vehicle is positioned at the vehicle's position in the combined video.

[0163] The service server 300 can then detect vehicles around its own vehicle from the driving video (S202).

[0164] The service provider server 300 can then use at least one of its own ADAS data and driving data to detect other vehicles that may have been involved in an accident (S203).

[0165] The service provider server 300 can then predict the accident situation using at least one of the ADAS data and driving data from other vehicles that were likely to be involved in an accident, and generate accident situation prediction information (S204).

[0166] The service provider server 300 can then provide accident situation prediction guidance services based on the generated accident situation prediction information (S205).

[0167] Figure 12 is a flowchart showing a method for providing an accident legal guidance service according to one embodiment of the present invention. Referring to Figure 12, first, the service provision server 300 can receive ADAS data, location data, driving data, and driving video from a predetermined time before to a predetermined time after the second driving situation in which an accident occurred to the vehicle (S301).

[0168] The service server 300 can then detect vehicles around its own vehicle from the driving video (S302).

[0169] The service provider server 300 can then use at least one of its own ADAS data and driving data to detect the other vehicle involved in the accident (S303).

[0170] The service provider server 300 can then analyze the circumstances of a vehicle accident using at least one of its own ADAS data and driving data for the detected vehicle, and generate accident legal evaluation information (S304).

[0171] The service provider server 300 can then provide accident legal guidance services based on accident legal evaluation information (S305).

[0172] On the other hand, a method for providing a service according to one embodiment of the present invention may further include the steps of: storing a destination dataset for each parking location for the driver of a vehicle; when the vehicle changes from a parked state to a driving state, comparing the vehicle's location data with the already stored destination dataset for each parking location to determine the driver's expected destination; and providing a destination prediction guidance service using the determined expected destination.

[0173] Furthermore, a method for providing a service according to one embodiment of the present invention may further include the steps of: storing an ADAS dataset for each driving location for the vehicle driver; comparing the vehicle's location data with the already stored ADAS dataset for each driving location to detect ADAS data that matches the vehicle driver's location; and providing a service that guides the driver through their past driving history using the detected ADAS data.

[0174] Furthermore, a method for providing a service according to one embodiment of the present invention may further include the steps of: storing ADAS datasets for each driving location for other drivers; comparing vehicle location data with the already stored ADAS datasets for each driving location to detect ADAS data that matches the location of the vehicle's driver; and providing a past driving history guidance service for other drivers using the detected ADAS data.

[0175] On the other hand, the functions according to the above-described embodiment can be implemented by a data processing device implemented in a single module. That is, the data processing device according to the present invention receives and analyzes ADAS data, driving data, location data, and driving video, and through analysis, can predict accident situations, evaluate accident laws, determine predicted destinations, determine the driver's past driving history, and determine the past driving history of other drivers.

[0176] Here, a data processing device can be implemented using software, hardware, or a combination thereof. For example, a hardware implementation can be implemented using at least one of the following: ASICs (application-specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays), processors, controllers, microcontrollers, microprocessors, or other electrical units that perform functions.

[0177] Such data processing devices can be installed in vehicle terminal devices 100, user terminal devices 200, and service provision servers 300, and can analyze various received data to perform tasks such as accident situation prediction, accident law evaluation, predicted destination determination, driver's past driving history determination, and other drivers' past driving history determination.

[0178] According to these various embodiments of the present invention, in a first driving situation in which a vehicle accident is likely to occur, the system can predict the accident situation that could have occurred to the vehicle, generate accident situation prediction information, and provide an accident situation prediction service, thereby reminding the driver of potential dangers and promoting safe driving by the driver.

[0179] Furthermore, according to various embodiments of the present invention, in a second driving situation in which a vehicle accident occurs, the circumstances of the accident are analyzed, and accident legal evaluation information including the percentage of fault in the accident is generated based on the analysis. By providing an accident legal guidance service, legal services for financial elements such as vehicle repair costs and insurance-related consultations can be automatically supported, thereby enhancing convenience for the driver.

[0180] Furthermore, according to various embodiments of the present invention, driver convenience can be enhanced through services such as destination prediction guidance, driver's past driving history guidance, and other drivers' past driving history guidance.

[0181] On the other hand, a method for providing a driving-related guidance service according to one embodiment of the present invention may further include the steps of: storing a destination dataset for each parking location for the driver of a vehicle; when the vehicle changes from a parked state to a driving state, comparing the vehicle's location data with the already stored destination dataset for each parking location to determine the driver's expected destination; and providing a destination prediction guidance service using the determined expected destination.

[0182] Furthermore, a method for providing a driving-related guidance service according to one embodiment of the present invention may further include the steps of: storing an ADAS dataset for each driving location for the vehicle driver; comparing the vehicle's location data with the already stored ADAS dataset for each driving location to detect ADAS data that matches the vehicle driver's location; and providing a driver's past driving history guidance service using the detected ADAS data.

[0183] Furthermore, a method for providing a driving-related guidance service according to one embodiment of the present invention may further include the steps of: storing ADAS datasets for each driving location for other drivers; comparing vehicle location data with the already stored ADAS datasets for each driving location to detect ADAS data that matches the location of the vehicle's driver; and providing a past driving history guidance service for other drivers using the detected ADAS data.

[0184] On the other hand, where terms such as “first,” “second,” “third,” and “fourth” are used in the specification and claims, they are used to distinguish similar components from each other, and not necessarily to describe a specific sequence or order of occurrence. Terms used in this manner should be understood to be interchangeable under appropriate circumstances so that the embodiments of the invention described herein may operate, for example, in other sequences not illustrated or described herein. Similarly, where a method is described herein as comprising a series of steps, the order of such steps presented herein is not necessarily the order in which such steps may be performed, optional steps may be omitted, and / or any other steps not described herein may be added to the method.

[0185] Furthermore, in the specification and claims, terms such as “left side,” “right side,” “front,” “rear,” “top,” “bottom,” “up,” and “down” are used for illustrative purposes only and are not necessarily intended to describe immutable relative positions. Terms used in this manner should be understood as being interchangeable under appropriate circumstances to operate in directions other than those illustrated or described herein, for example. The term “connected” as used herein is defined as being connected directly or indirectly by electrical or non-electrical means. Here, objects described as “adjacent” to each other may, appropriately in the context in which the sentence is used, be physically touching, close to each other, or occupy the same general range or area. Here, the phrase “in one embodiment” means the same embodiment, though not necessarily so.

[0186] Furthermore, in the specification and claims, various variations of expressions such as "connected," "linked," "concluded," "joined," and "joined" are used to mean that the connection is either directly linked to other components or indirectly linked through other components.

[0187] Furthermore, the suffixes "module" and "part" used in this specification for constituent elements are added or used interchangeably solely for the sake of ease in drafting the specification, and do not in themselves have a distinct meaning or role from one another.

[0188] Furthermore, the terms used herein are for illustrative purposes only and are not intended to limit the invention. In this specification, the singular form includes the plural form unless otherwise specified in the text. The terms “comprise” and / or “comprising” as used in this specification do not preclude the mention of any component, step, operation, and / or element mentioned from the components, steps, operations, and / or elements from being present or added from one or more other components, steps, operations, and / or elements.

[0189] The present invention has been described in part with regard to its preferred embodiments. All embodiments and conditional examples disclosed herein are written to facilitate the understanding of the principles and concepts of the invention by those skilled in the art, and those skilled in the art will understand that the present invention can be realized in modified forms without departing from the essential characteristics of the invention.

[0190] Therefore, the disclosed embodiments should be considered in an explanatory rather than restrictive manner. The scope of the present invention is defined in the claims, not in the foregoing description, and any differences within an equivalent scope should be interpreted as being included within the scope of the present invention.

[0191] On the other hand, the methods for providing driving-related guidance services according to the various embodiments of the present invention described above can be implemented as a program and provided to a server or device. This allows each device to connect to the server or device where the program is stored and download the program.

[0192] Furthermore, the methods according to the various embodiments of the present invention described above can be implemented in a program and provided stored on a variety of non-transitory computer-readable media. A non-transitory computer-readable medium refers to a medium that stores data semi-permanently and can be read by a device, rather than a medium that stores data for a short moment, such as a register, cache, or memory. Specifically, the various applications or programs described above can be provided stored on a non-transitory computer-readable medium such as a CD, DVD, hard disk, Blu-ray disc, USB, memory card, or ROM.

[0193] Furthermore, although preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and it goes without saying that various modifications can be made by persons with ordinary skill in the art to which the invention belongs without departing from the gist of the present invention as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospects of the present invention.

Claims

1. A method for providing driving-related guidance services for vehicle terminal devices, The steps include acquiring driving footage taken while the vehicle is in motion, The steps include receiving ADAS data of the vehicle from an ADAS (Advanced Driver Assistance System) module that assists in driving the vehicle, and receiving driving data of the vehicle from an ECU (Electronic Control Unit) module of the vehicle, Steps to detect the impact level, The steps include receiving location data of the vehicle, The process includes the step of, when a specific driving condition is detected while the vehicle is in motion, transmitting the ADAS data, location data, driving data, and driving video related to the detected specific driving condition to a service provider server. The aforementioned transmission step is, The system determines that a first driving situation is likely to occur if an impact exceeding a pre-set first impact level and below a pre-set second impact level is detected, and if at least one of the following is detected based on the ADAS data before the impact is detected: lane departure warning, frontal collision, sharp curve warning, sudden stop warning, sudden turn warning, and blind spot warning, then the system determines that a first driving situation is likely to occur. The system further includes the step of determining that an accident occurred in a second driving situation when an impact exceeding a previously set second impact level is detected, The method for providing the aforementioned driving-related guidance service is as follows: When the service provider server generates accident prediction information that could have occurred between the vehicle and other vehicles in the first driving situation using the ADAS data and the driving data, the service provider server receives the generated accident prediction information from the service provider server. The steps include providing guidance based on the accident situation prediction information received, Further including, Method of providing driving-related guidance services.

2. The method for providing a driving-related guidance service according to claim 1, characterized in that the transmission step includes, when a first driving situation in which an accident is possible, even though no accident has occurred while the vehicle is driving, is detected, the ADAS data, the location data, the driving data, and the driving video prior to the time of the detected first driving situation are transmitted to the service provision server.

3. A method for providing a driving-related guidance service according to claim 2, further comprising the step of transmitting the ADAS data, the location data, the driving data, and the driving video from a predetermined time before to a predetermined time after the detected second driving situation to the service provision server when a second driving situation in which an accident occurred while the vehicle was in motion is detected.

4. The step of acquiring driving images taken while the vehicle is in motion includes the step of acquiring forward driving images taken by a front camera and rear driving images taken by a rear camera. The process further includes the step of combining the forward-driving video and the rear-driving video, and generating a top-view video in which the vehicle's position is positioned in the combined video. The method for providing a driving-related guidance service according to claim 3, characterized in that the driving video transmitted to the service provider server is the top-view video.

5. The method for providing a driving-related guidance service according to claim 4, characterized in that the top-view image is in GIF (Graphics Interchange Format) format formed by extracting multiple frames.

6. When the service provider server generates accident prediction information based on the data received from the vehicle terminal device, the service provider server receives the generated accident prediction information. A method for providing a driving-related guidance service according to any one of claims 2 to 5, further comprising the step of providing guidance based on the accident situation prediction information received.

7. When the service provider server generates accident legal assessment information based on the data received from the vehicle terminal device, the service provider server receives the generated accident legal assessment information. A method for providing a driving-related guidance service according to any one of claims 3 to 6, further comprising the step of providing guidance based on the accident legal evaluation information received.

8. A method for providing driving-related guidance services on a service provider server, The steps include receiving ADAS data of the vehicle related to a specific driving condition of the vehicle, location data of the vehicle, driving data of the vehicle, and driving video captured while the vehicle is in motion from a vehicle terminal device, The steps include analyzing the received data and driving video to generate guidance information related to a specific driving situation of the vehicle, The step of providing driving-related guidance services to the vehicle using the generated guidance information is included, The aforementioned specific driving conditions include a first driving condition in which an accident is likely to occur for the vehicle and a second driving condition in which an accident occurred. If an impact exceeding a pre-set first impact level but below a pre-set second impact level is detected, and if at least one of the following is detected based on the ADAS data before the impact is detected, such as lane departure warning, frontal collision warning, sharp curve warning, sudden stop warning, sudden turn warning, and blind spot warning, then it is determined that a first driving situation with a possibility of accident occurring is present. If an impact exceeding the previously set second impact level is detected, it is determined to be the second driving situation in which the accident occurred. The step of generating the aforementioned guidance information is: The service provider server generates accident prediction information that could have occurred between the vehicle and other vehicles in the first driving conditions, using the ADAS data and the driving data. A method for providing a driving-related guidance service, characterized by transmitting the generated accident situation prediction information to the vehicle terminal device.

9. In the above generation step, Although no accident occurred while the vehicle was in motion, the ADAS data, position data, driving data, and driving video footage prior to the first driving situation in which an accident was possible were analyzed to generate accident prediction information for the vehicle in the first driving situation. In the steps provided above, A method for providing a driving-related guidance service according to claim 8, characterized in that it provides an accident situation prediction guidance service using the generated accident situation prediction information.

10. In the above generation step, Accident legal evaluation information is generated by analyzing the ADAS data, position data, driving data, and driving video from a predetermined time before to a predetermined time after the second driving situation in which the accident occurred to the vehicle. In the steps provided above, A method for providing a driving-related guidance service according to claim 9, characterized in that it provides an accident legal guidance service using the generated accident legal evaluation information.

11. The method for providing a driving-related guidance service according to claim 10, characterized in that the received driving video is a top-view video in which a forward driving video and a rear driving video are combined, and the vehicle's passenger is positioned at the vehicle's position in the combined video.

12. The step of generating the aforementioned accident situation prediction information is: The steps include detecting vehicles around the vehicle from the aforementioned top-view image, A method for providing a driving-related guidance service according to claim 11, characterized by comprising the step of predicting an accident situation that could have occurred to the vehicle in the first driving situation using at least one of the ADAS data and driving data of the vehicle for the detected vehicle, and generating the accident situation prediction information.

13. The step of generating the aforementioned accident legal assessment information is: The steps include detecting vehicles around the vehicle from the aforementioned top-view image, The steps include analyzing the accident fault ratio using at least one of the ADAS data and driving data of the vehicle detected, A method for providing a driving-related guidance service according to claim 11 or 12, characterized by comprising the step of generating accident legal evaluation information including the accident fault ratio based on the analysis.

14. The steps include storing a destination dataset for each parking location for the driver of the vehicle, When the vehicle changes from parked to moving, the vehicle's location data is compared with a previously stored destination dataset for each parking location to determine the driver's expected destination. A method for providing a driving-related guidance service according to any one of claims 10 to 13, further comprising the step of providing a destination prediction guidance service using the predicted destination determined above.

15. The steps include storing ADAS datasets for each driving location for the driver of the vehicle, The steps include comparing the vehicle's location data with previously stored ADAS datasets for each driving location, and detecting ADAS data that matches the location of the vehicle's driver, A method for providing a driving-related guidance service according to any one of claims 10 to 14, further comprising the step of providing a driver's past driving history guidance service using the detected ADAS data.

16. The steps include storing ADAS datasets for each driving location for other drivers, The steps include comparing the vehicle's location data with previously stored ADAS datasets for each driving location, and detecting ADAS data that matches the location of the vehicle's driver, A method for providing a driving-related guidance service according to any one of claims 10 to 15, further comprising the step of providing a guidance service for the past driving history of other drivers using the detected ADAS data.

17. A vehicle terminal device, Communications Department and, A video acquisition unit that acquires driving footage taken while the vehicle is in motion, An ADAS data acquisition unit that receives ADAS data from an ADAS (Advanced Driver Assistance System) module that assists in driving a vehicle, An ECU data acquisition unit that receives driving data of the vehicle from the ECU (Electronic Control Unit) module of the vehicle, A location data acquisition unit that receives location data of the aforementioned vehicle, An impact detection unit that detects the impact level, The system includes a control unit that controls the communication unit to transmit the ADAS data, location data, vehicle driving data, and driving video related to the detected specific driving condition to a service provider server when a specific driving condition is detected while the vehicle is in motion. The control unit, If an impact exceeding a pre-set first impact level but below a pre-set second impact level is detected, and if at least one of the following is detected based on the ADAS data before the impact is detected, such as lane departure warning, frontal collision warning, sharp curve warning, sudden stop warning, sudden turn warning, and blind spot warning, then it is determined that a first driving situation with a possibility of accident occurring is present. If an impact exceeding the previously set second impact level is detected, it is determined to be the second driving situation in which the accident occurred. The control unit, A vehicle terminal device characterized in that, when the service provision server generates accident prediction information that could potentially occur between the vehicle and other vehicles in the first driving conditions using the ADAS data and the driving data, the device receives the generated accident prediction information from the service provision server and provides guidance based on the received accident prediction information.

18. A service provider server, A communication unit that receives ADAS data of the vehicle related to specific driving conditions of the vehicle, location data of the vehicle, driving data of the vehicle, and driving video captured while the vehicle is in motion from a vehicle terminal device, A service provision unit that analyzes the received data and driving video to generate guidance information related to the specific driving conditions of the vehicle, and provides driving-related guidance services to the vehicle using the generated guidance information, The aforementioned specific driving conditions include a first driving condition in which an accident is likely to occur for the vehicle and a second driving condition in which an accident occurred. If an impact exceeding a pre-set first impact level but below a pre-set second impact level is detected, and if at least one of the following is detected based on the ADAS data before the impact is detected, such as lane departure warning, frontal collision warning, sharp curve warning, sudden stop warning, sudden turn warning, and blind spot warning, then it is determined that a first driving situation with a possibility of accident occurring is present. If an impact exceeding the previously set second impact level is detected, it is determined to be the second driving situation in which the accident occurred. The aforementioned service provision unit, A server characterized by generating accident prediction information that could potentially occur between the vehicle and other vehicles in the first driving conditions using the ADAS data and driving data received from the vehicle terminal device, and transmitting the generated accident prediction information to the vehicle terminal device.

19. A program stored on a recording medium for performing the method of providing a driving-related guidance service according to any one of claims 1 to 16.

20. A computer-readable recording medium on which program code for performing a method for providing a driving-related guidance service according to any one of claims 1 to 16 is recorded.

Images