Apparatus and method for providing driver-specific accident simulation information and predicted bodily damage information about two-wheeled vehicle driving

Abstract

The present invention relates to an apparatus and a method for providing driver-specific accident simulation information and predicted bodily damage information about two-wheeled vehicle driving. Specifically, the present invention relates to an apparatus and a method for providing, to an insurance company and a medical institution, driving information including mid-driving accident information about a driver identified on the basis of biometrics, wherein the accident information includes image information of a driving simulation in which a three-dimensional image of a two-wheeled vehicle is overlaid on a map for a time interval set before and after an accident time, and information about a predicted bodily damage part and a predicted extent of bodily damage of the driver.

Description

Device and method for providing driver-specific accident simulation information and expected bodily injury information for two-wheeled vehicle driving

[0001] The present invention relates to a device and method for providing driver-specific accident simulation information and expected bodily injury information for two-wheeled vehicle driving. Specifically, the present invention relates to a device and method for providing driving information including accident information during driving for a driver identified through biometrics to an insurance company and a medical institution, wherein the accident information includes image information of a driving simulation overlapping a three-dimensional image of a two-wheeled vehicle on a map for a set time interval before and after the accident, and information regarding the driver's expected bodily injury site and expected degree of bodily injury.

[0002]

[0003] With the recent growth of the delivery industry, fueled by the development of smartphone-based delivery apps, traffic safety issues involving two-wheeled vehicles used for delivery have become a growing social concern. Consumers demand shorter delivery times, and delivery operators and drivers strive to handle more deliveries within the same timeframe. This has led to a rise in motorcycle accidents caused by reckless driving, speeding, and violations of traffic laws. Because motorcycles are relatively less equipped with safety equipment than passenger cars, motorcycle accidents often result in fatalities, increasing the social cost.

[0004] To ensure social traffic safety and the stable operation of delivery businesses, insurance is necessary to ensure the safety of two-wheeled vehicles. However, in the typical delivery industry, multiple drivers, hired on short-term contracts, rotate the multiple two-wheeled vehicles owned by delivery companies. In other words, there is no single driver assigned to a specific two-wheeled vehicle. Because the drivers of two-wheeled vehicles used for delivery are not fixed, it is difficult to identify who is driving a specific two-wheeled vehicle. Furthermore, it is difficult to determine who is driving a specific two-wheeled vehicle, making it difficult to collect driving information on each driver. Consequently, the difficulty in obtaining driving information on the drivers of two-wheeled vehicles used for delivery makes it difficult to determine insurance premiums for two-wheeled vehicles owned by delivery companies.

[0005] Furthermore, from the insurance company's perspective, clearly identifying the motorcycle driver is crucial for fair handling of accidents, liability assessments, and compensation. Unlike four-wheeled vehicles, motorcycles lack a body structure designed to protect the driver's body, making even minor accidents potentially fatal. Therefore, technology and systems are needed to quickly identify the circumstances of an accident and the driver's suspected injuries, enabling them to be remotely and in real time shared with medical professionals. This means that even while transporting the motorcycle driver to a medical facility where treatment can be provided, medical professionals and medical institutions must be provided with information about the driver's suspected injuries and the circumstances of the accident. This information can be used to determine optimal, specialized treatment and facilitate an appropriate medical response.

[0006] Recently, the development of biometric identification technology, which extracts unique physical characteristics to verify an individual's identity, is actively underway. Biometric identification technology refers to a secure authentication technology that automatically measures an individual's unique biometric information, such as fingerprints, face, iris, veins, and voice, to verify their identity. Biometric identification technology can be used to verify the identity of individuals accessing biometric devices within a pool of individuals whose biometric information has been collected.

[0007] In situations where there are multiple registered motorcycles and multiple registered drivers, but it's not possible to know which driver is driving which motorcycle, biometric technology can be used to identify the driver of a specific motorcycle. Furthermore, if the identity of the motorcycle driver can be verified, unique driving information can be generated for that identified driver.

[0008] Therefore, there is a need for a device and method for performing driver-specific starting control and generating driving information for a two-wheeled vehicle based on biometrics.

[0009] Insurance companies want to know the exact time of the accident. Accurately determining which driver, which motorcycle, and how they were driving the motorcycle during the accident is crucial for accurately assessing insurance premiums. Accelerometers, gyroscopes, geomagnetic sensors, and global positioning system (GPS) sensors, widely used in smartphones, allow for the precise identification of the physical characteristics of the objects they are installed on. Furthermore, using recently developed 3D simulation technology, it is possible to visually recreate the motorcycle's driving experience through video by displaying it on a map image in 3D based on its physical characteristics. Furthermore, around-view technology, increasingly being installed in automobiles, allows for the visualization of surrounding objects in a motorcycle's driving experience.

[0010] Furthermore, driver safety and a prompt medical response are crucial in the event of a motorcycle accident. Using various sensors attached to the motorcycle and the driver's clothing, a 3D simulation can be created of the driver's situation during an accident. Based on this, the location and extent of the driver's injuries can be analyzed and transmitted to nearby medical institutions. This allows medical institutions to understand the circumstances of the accident and the extent of the injuries while the driver is being transported to the medical institution, providing time for them to prepare a response. By assessing the driver's condition immediately after the accident and relaying this information to nearby medical institutions, medical staff can understand the situation in advance and prepare appropriate treatment. Through sensor data and 3D simulation, medical staff can accurately identify the location and extent of the driver's injuries, enabling faster and more accurate treatment. The recreated 3D simulation can also be used to analyze the cause of the accident, contributing to the prevention of similar accidents and improving safety regulations. By accurately recording and reproducing the accident, disputes during insurance claims can be reduced and, if necessary, it can be used as legal evidence. It can dramatically improve the safety of motorcycle drivers, enable rapid and efficient medical response in the event of an accident, and ultimately contribute to improving traffic safety and the quality of medical services.

[0011] Accordingly, there is a need for a device and method that can provide insurance companies and medical institutions with graphic information that recreates a two-wheeled vehicle and surrounding objects of the two-wheeled vehicle in three dimensions on a map image at the time of an accident by a specific driver, and information on the expected body damage site and degree of the driver's body damage identified through various sensors attached to the two-wheeled vehicle and the driver's driving suit.

[0012]

[0013] Based on the discussion described above, the present invention provides a device and method for performing driver-specific starting control and driving information generation for a two-wheeled vehicle based on biometrics.

[0014] In addition, the present invention provides a device and method for providing information on whether an accident has occurred, an estimated injured area of ​​the driver at the time of an accident, and vital signs of the driver at the time of an accident to a remote medical institution based on whether the expected damaged area and expected damage information generated based on sensors mounted on a two-wheeled vehicle and a driver exceed a threshold value, while providing sensor data that can confirm changes in the physical condition of a two-wheeled vehicle at the time of an accident to an insurance company, so that the data can be utilized for determining the cause and result of an accident and liability and compensation for the accident.

[0015] In addition, the present invention provides a device and method capable of reproducing a two-wheeled vehicle and surrounding objects of the two-wheeled vehicle in three dimensions on a map image based on physical characteristics at the time when a specific driver caused an accident based on biometrics.

[0016] In addition, the present invention provides a device and method capable of reproducing surrounding objects of a two-wheeled vehicle together when reproducing the driving of the two-wheeled vehicle in a video using around view technology.

[0017] In addition, in the event of a motorcycle accident, a device and method are provided that can quickly estimate and identify the circumstances of the accident, the driver's presumed body damage area, the degree of body damage, etc., and provide the information to a medical institution so that optimal treatment can be provided.

[0018] Additionally, the present invention provides a device and method capable of providing information to support an insurance company's analysis of accident-related information for a specific driver and determination of insurance premiums.

[0019]

[0020] According to various embodiments of the present invention, there is provided an operating method of a two-wheeled vehicle management server including a transceiver, a memory, and a processor in a communication system, the method comprising: receiving driving data from a two-wheeled vehicle by the transceiver; wherein the driving data includes at least one of acceleration data, speed data, inclination data, direction data, and GPS (global positioning system) data of the two-wheeled vehicle while the two-wheeled vehicle is driving; wherein the driving data further includes photographing data of the front, rear, left side, and right side of the two-wheeled vehicle while the two-wheeled vehicle is driving; wherein the driving data further includes driving-related information for each body part of the driver while the two-wheeled vehicle is driving, measured from sensors attached to each body part on the driver's helmet and the driver's driving clothing; wherein the body parts include at least one of the chest, back, wrist, ankle, and knee, and the head; wherein the sensors attached to each body part on the driver's helmet and the driver's driving clothing are communicatively connected to the two-wheeled vehicle; A method is provided, comprising: a process for generating driving information of the driver for the two-wheeled vehicle based on the driving data by the processor; the driving information includes accident information about driving at the time of an accident; the accident information includes image information of a driving simulation that overlaps a three-dimensional image in which the tilt angle and tilted direction of the two-wheeled vehicle while driving, and the driver's relative position and posture with respect to the two-wheeled vehicle are reflected on a map image for a time interval set before and after the time of the accident; and the image information of the driving simulation is configured to reproduce the tilt and direction of the two-wheeled vehicle over time, the driver's relative position with respect to the two-wheeled vehicle over time, the driver's body posture over time, and the driver's impact situation as a three-dimensional image in the process in which the two-wheeled vehicle falls over at the time of the accident; and a process for transmitting the driving information to an insurance company server by the transceiver.

[0021] According to various embodiments of the present invention, a two-wheeled vehicle management server is provided, wherein the two-wheeled vehicle management server includes a transceiver, a memory, and a processor, the processor is operably coupled to the transceiver and the memory, and the processor is configured to perform an operating method of the two-wheeled vehicle management server in a communication system.

[0022] According to various embodiments of the present invention, one or more non-transitory, computer-readable media comprising instructions that when executed by one or more processors cause operations, wherein the operations are configured to include a method of operating a two-wheeled vehicle management server in a communication system, are provided.

[0023]

[0024] The present invention can provide a device and method for performing driver-specific starting control and generating driving information for a two-wheeled vehicle based on biometrics.

[0025] In addition, the present invention provides a device and method for providing information on whether an accident has occurred, the estimated injured area of ​​the driver at the time of the accident, and the vital signs of the driver at the time of the accident to a remote medical institution based on whether the expected damaged area and the expected damage information generated based on sensors mounted on the two-wheeled vehicle and the driver exceed a threshold value, while providing sensor data that can confirm changes in the physical condition of the two-wheeled vehicle at the time of the accident to an insurance company, so that the data can be used to determine the cause and result of the accident and the liability and compensation for the accident.

[0026] In addition, the present invention can provide a device and method that can reproduce a two-wheeled vehicle and surrounding objects of the two-wheeled vehicle as images on a map image in three dimensions based on physical characteristics at the time when a specific driver caused an accident based on biometrics.

[0027] In addition, the present invention can provide a device and method that can reproduce surrounding objects of a two-wheeled vehicle together when reproducing the driving of a two-wheeled vehicle in a video using around view technology.

[0028] In addition, in the event of a motorcycle accident, a device and method can be provided that can quickly estimate and identify the circumstances of the accident, the driver's presumed body damage area, the degree of body damage, etc., and provide the information to a medical institution so that optimal treatment can be provided.

[0029] In addition, the present invention can provide a device and method that can provide information to support analysis of accident-related information for a specific driver by an insurance company and determination of insurance premiums.

[0030] The effects that can be obtained from the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains from the description below.

[0031]

[0032] FIG. 1 illustrates a communication network system of a two-wheeled vehicle, a two-wheeled vehicle management server, and an insurance company server according to various embodiments of the present invention.

[0033] FIG. 2 illustrates a block diagram of a configuration of a two-wheeled vehicle according to various embodiments of the present invention.

[0034] FIG. 3 illustrates a block diagram of a configuration of a helmet and a driving suit according to various embodiments of the present invention.

[0035] FIG. 4 illustrates a block diagram of a configuration of a two-wheeled vehicle management server, an insurance company server, and a medical institution server according to various embodiments of the present invention.

[0036] FIG. 5 illustrates a flowchart of an operation method of a two-wheeled vehicle management server according to various embodiments of the present invention.

[0037] FIG. 6 illustrates a process of generating driver-specific driving information while driving a two-wheeled vehicle according to various embodiments of the present invention.

[0038] FIG. 7 illustrates a process of collecting physical characteristic information while driving a two-wheeled vehicle according to various embodiments of the present invention.

[0039] FIG. 8 illustrates a process of reproducing the driving of a two-wheeled vehicle into a three-dimensional image based on physical characteristic information during driving of the two-wheeled vehicle according to various embodiments of the present invention.

[0040] FIG. 9 illustrates a process for acquiring an around view image while driving a two-wheeled vehicle according to various embodiments of the present invention.

[0041] FIG. 10 illustrates an example of a three-dimensional reconstruction image of a two-wheeled vehicle accident point in time according to various embodiments of the present invention.

[0042] FIG. 11 illustrates an example of the operation process of a server after an accident of a two-wheeled vehicle according to various embodiments of the present invention.

[0043] FIG. 12 illustrates an example of an attachment location of a sensor on a driver's clothing of a two-wheeled vehicle according to various embodiments of the present invention.

[0044]

[0045] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings so that those skilled in the art can easily implement the invention. The present invention may be implemented in various different forms and is not limited to the embodiments described herein.

[0046] The various embodiments of the present disclosure described below illustrate a hardware-based approach as an example. However, since the various embodiments of the present disclosure include techniques utilizing both hardware and software, the various embodiments of the present disclosure do not exclude a software-based approach.

[0047]

[0048] FIG. 1 illustrates a communication network system of a two-wheeled vehicle, a two-wheeled vehicle management server, and an insurance company server according to various embodiments of the present invention.

[0049] Referring to FIG. 1, a communication system according to various embodiments of the present invention includes a two-wheeled vehicle (100), a two-wheeled vehicle management server (200), an insurance company server (300), a communication network (400), and a medical institution server (500). The two-wheeled vehicle (100) is connected to a helmet (110) and a driver's uniform (120) worn by the driver.

[0050] A two-wheeled vehicle (100) includes at least one biometric sensor, at least one driving information sensor, a transceiver, a memory, at least one processor, and at least one camera. The two-wheeled vehicle (100) acquires the driver's biometric information, controls the starting of the vehicle based on the biometric information, generates the driver's driving information while driving, and captures images of the surroundings of the two-wheeled vehicle while driving. The two-wheeled vehicle (100) is connected to a helmet (110) and a driver's clothing (120) worn by the driver through communication. The two-wheeled vehicle (100) receives driving information, location information, or biometric information about each body part of the driver from the helmet (110) and the driver's clothing (120) while driving. The body parts may include one or more of the chest, back, wrist, ankle, and knee, and the head. Sensors attached to each body part of the driver's helmet (110) and the driver's clothing (120) are connected to the two-wheeled vehicle through communication (100). A two-wheeled vehicle (100) can transmit driver identification information and driver driving information to a two-wheeled vehicle management server (200) via a communication network (400). The two-wheeled vehicle (100) can include an acceleration sensor, a gyro sensor, a geomagnetic sensor, and a GPS sensor. The driver's driving information can include acceleration data and speed data measured using the included acceleration sensor, inclination data measured by the gyro sensor, direction data measured by the geomagnetic sensor, and GPS data measured by the GPS sensor. The two-wheeled vehicle (100) can transmit a start-up authorization request message including the driver's biometric data to the two-wheeled vehicle management server (200) via the network (400), and can control the start when receiving a start-up authorization message for the driver from the two-wheeled vehicle management server (200). The two-wheeled vehicle (100) can receive previous driving information of the communicating driver from the two-wheeled vehicle management server (200).A two-wheeled vehicle (100) can transmit information about the GPS location of the two-wheeled vehicle (100) to a two-wheeled vehicle management server (200) through a communication network (400) and receive information about the regulated speed based on the GPS location of the two-wheeled vehicle (100) from the two-wheeled vehicle management server (200).

[0051] The two-wheeled vehicle management server (200) receives, from the two-wheeled vehicle (100) through the communication network (400), driver identification information, driving information generated for the driver, new driver identification information, information on the GPS location of the two-wheeled vehicle (100), etc., and can transmit to the two-wheeled vehicle (100) driver insurance subscription information, driver previous driving information, information on the speed limit based on the GPS location of the two-wheeled vehicle (100), etc. The two-wheeled vehicle management server (200) receives from the two-wheeled vehicle (100) a start authorization request message including the driver's biometric data, identifies the driver based on a comparison of the received biometric data with driver biometric data pre-stored in a memory of the two-wheeled vehicle management server (200), and if the driver is identified as included in a pre-stored driver list, can transmit to the two-wheeled vehicle (100) a start authorization message for the driver. The two-wheeled vehicle management server (200) can store the driver's driving information, new driver identification information, driver's insurance subscription information, etc. received from the two-wheeled vehicle (100). The two-wheeled vehicle management server (200) can generate driving information specific to the driver and the two-wheeled vehicle based on the driving data received from the two-wheeled vehicle (100). The two-wheeled vehicle management server (200) can transmit the generated driving information to the insurance company server (300) through the communication network (400). In addition, the two-wheeled vehicle management server (200) can transmit the generated driving information to the medical institution server (500) through the communication network (400). The insurance company server (300) receives driving information specific to which driver drove which two-wheeled vehicle from the two-wheeled vehicle management server (200). Since the driver and the two-wheeled vehicle are specific, the insurance company server (300) can perform insurance premium calculation for each driver and each two-wheeled vehicle.

[0052] The communication network (400) provides a communication path through which a two-wheeled vehicle (100), a two-wheeled vehicle management server (200), and an insurance company server (300) can transmit and receive signals and data to and from each other. The communication network (400) is not limited to a communication method according to a specific communication protocol, and an appropriate communication method may be used depending on an implementation example. For example, if the communication network (400) is configured as an Internet Protocol (IP)-based system, the communication network (400) may be implemented as an Internet network, and if the two-wheeled vehicle (100), the two-wheeled vehicle management server (200), and the insurance company server (300) are implemented as mobile communication terminals, the communication network (400) may be implemented as a wireless network such as a cellular network or a wireless local area network (WLAN) network.

[0053] The medical institution server (500) receives driving information from the motorcycle management server (200) that specifies which driver drove which motorcycle. The medical institution server (500) can receive information on the circumstances of an accident, the location of the driver's body damage due to the accident, and the extent of the body damage, for each driver and each motorcycle, and can transmit the information to a medical professional's terminal.

[0054]

[0055] FIG. 2 illustrates a block diagram of a configuration of a two-wheeled vehicle according to various embodiments of the present invention.

[0056] Referring to FIG. 2, a two-wheeled vehicle (100) according to various embodiments of the present invention includes at least one biometric recognition sensor (101), at least one driving information sensor (102), a transceiver (103), a memory (104), at least one processor (105), and at least one camera (106).

[0057] At least one biometric sensor (101) includes at least one of a vein recognition sensor, an iris recognition sensor, a facial recognition sensor, a voice recognition sensor, or a fingerprint recognition sensor. The at least one biometric sensor (101) is configured to generate biometric information of a driver of a two-wheeled vehicle (100). The biometric information includes at least one of vein information, iris information, facial information, voice information, or fingerprint information. According to various embodiments of the present invention, when a two-wheeled vehicle receives biometric information of a driver detected through at least one biometric sensor included in a terminal connected to the two-wheeled vehicle through communication with a terminal, the two-wheeled vehicle may not include a separate biometric sensor (101) because it is sufficient to use at least the biometric sensor included in the terminal to obtain the biometric information of the driver. Through biometric recognition of the driver through the at least one biometric sensor (101), the two-wheeled vehicle (100) can verify the identity information of the driver and obtain basic information of the driver, such as gender and age. A two-wheeled vehicle (100) can confirm the driver's identity information by communicating with a two-wheeled vehicle management server (200) based on biometric data, or by comparing the biometric data with pre-stored driver biometric data.

[0058] At least one driving information sensor (102) includes at least one of a global positioning system (GPS) sensor, a gyroscope sensor, a gyro sensor, a geomagnetic sensor, or an acceleration sensor. The at least one driving information sensor (102) is configured to generate driving information of a driver of a two-wheeled vehicle (100). The driving information may include at least one of a lateral inclination of the two-wheeled vehicle (100) while driving, a turning angle of the two-wheeled vehicle (100) while driving, an acceleration of the two-wheeled vehicle (100) while driving, a speed of the two-wheeled vehicle (100) while driving, whether an impact occurred while driving the two-wheeled vehicle (100), a direction of the two-wheeled vehicle (100) while driving, or a driving path of the two-wheeled vehicle (100). Additionally, the driving information may further include an image of the surroundings of the two-wheeled vehicle (100) captured by at least one camera (106) while the two-wheeled vehicle (100) is driving. According to one embodiment, the driving information may further include whether the two-wheeled vehicle (100) is in violation of the speed limit based on whether the speed of the two-wheeled vehicle (100) while driving is greater than the speed limit based on the GPS location of the two-wheeled vehicle (100).

[0059] The transceiver (103) is connected to at least one processor (105) and transmits and / or receives signals. All or part of the transceiver (103) may be referred to as a transmitter, a receiver, or a transceiver. The transceiver (103) may support at least one of various wireless communication standards, such as a wired access system and a wireless access system, such as the Institute of Electrical and Electronics Engineers (IEEE) 802.xx system, the IEEE Wi-Fi system, the 3rd generation partnership project (3GPP) system, the 3GPP LTE (long term evolution) system, the 3GPP 5G NR (new radio) system, the 3GPP2 system, and Bluetooth.

[0060] The memory (104) is connected to at least one biometric sensor (101), at least one driving information sensor (102), and at least one camera (106), and can store biometric information of the driver of the two-wheeled vehicle (100) generated by the at least one biometric sensor (101), driving information of the driver of the two-wheeled vehicle (100) generated by the at least one driving information sensor (102), and images of the surroundings of the two-wheeled vehicle (100) captured by the at least one camera (106). In addition, the memory (104) is connected to the transceiver (103) and can store images and information received through communication. In addition, the memory (104) is connected to at least one processor (105) and can store data such as a basic program for the operation of the at least one processor (105), an application program, setting information, and information generated by the operation of the at least one processor (105). The memory (104) may be composed of volatile memory, non-volatile memory, or a combination of volatile memory and non-volatile memory. In addition, the memory (104) may provide stored data upon request of at least one processor (105).

[0061] At least one processor (105) may be configured to implement the procedures and / or methods proposed in the present invention. The at least one processor (105) controls the overall operations of the two-wheeled vehicle (100) to perform driver-specific start control and generate driving information for the two-wheeled vehicle (100) based on biometrics. For example, the at least one processor (105) generates biometric information of the driver of the two-wheeled vehicle (100) through at least one biometric sensor (101). In addition, the at least one processor (105) generates driving information of the driver of the two-wheeled vehicle (100) through at least one driving information sensor (102). In addition, the at least one processor (105) captures an image of the surroundings of the two-wheeled vehicle (100) through at least one camera (106). In addition, the at least one processor (105) transmits or receives information, etc. through a transceiver (103). Additionally, at least one processor (105) writes and reads data to and from memory (104).

[0062] At least one camera (106) may be arranged in each direction surrounding the two-wheeled vehicle (100), such as the front, rear, left side, and rear side of the two-wheeled vehicle (100). Depending on the embodiment, the at least one camera (106) may be configured with four channels for the front side, rear side, left side, and right side, or six channels for the front side, rear side, front left side, front right side, rear left side, and rear right side. The above-described configuration is merely an example, and the arrangement of the at least one camera (106) may be configured in various ways. The at least one camera (106) may be configured to capture an image of the surroundings of the two-wheeled vehicle (100). Depending on the embodiment, unlike FIG. 2, the two-wheeled vehicle (100) may not include at least one camera (106). In this case, the two-wheeled vehicle (100) only transmits to the two-wheeled vehicle management server (200) at least one of the physical characteristics of the two-wheeled vehicle (100) while driving, i.e., the lateral inclination of the two-wheeled vehicle (100) while driving, the turning angle of the two-wheeled vehicle (100) while driving, the acceleration of the two-wheeled vehicle (100) while driving, the speed of the two-wheeled vehicle (100) while driving, whether an impact occurred while driving the two-wheeled vehicle (100), the direction of the two-wheeled vehicle (100) while driving, or the driving path of the two-wheeled vehicle (100). In this case, the two-wheeled vehicle management server (200) can generate a driving simulation image of the two-wheeled vehicle (100) based on the physical characteristics of the two-wheeled vehicle (100) while driving, excluding the surrounding image of the two-wheeled vehicle (100).

[0063] Additionally, the two-wheeled vehicle (100) may further include at least one display or speaker. At least one processor (105) may control at least one of the display or speaker to output a warning display or warning sound to the driver of the two-wheeled vehicle (100) when a specific condition for abnormal driving is satisfied.

[0064] Additionally, the two-wheeled vehicle (100) may include an input unit. The input unit is connected to at least one processor (105) and may input identification information, etc., for a new driver of the two-wheeled vehicle (100). According to one embodiment, the input unit may include a touch display, a keypad, etc.

[0065] Additionally, the two-wheeled vehicle (100) may include a start control button. The start control button may input the start of the engine when the engine is off, and may input the turn-off of the engine when the engine is on. According to various embodiments of the present invention, even if the start or turn-off of the engine is input through the start control button, the start or turn-off of the engine is not controlled immediately, but the start or turn-off of the engine may be controlled after determining whether the start control condition is satisfied through the processor (105).

[0066]

[0067] FIG. 3 illustrates a block diagram of a configuration of a helmet and a driving suit according to various embodiments of the present invention.

[0068] Referring to FIG. 3, a helmet (110) and a driving suit (120) worn by a driver of a two-wheeled vehicle (100) according to various embodiments of the present invention include at least one driving information sensor (111), a biometric information sensor (112), a transmitter / receiver (113), a memory (114), at least one processor (115), and at least one camera (116).

[0069] At least one driving information sensor (111) includes at least one of a global positioning system (GPS) sensor, a gyroscope sensor, a gyro sensor, a geomagnetic sensor, or an acceleration sensor. The at least one driving information sensor (111) is configured to generate driving information for each body part of the driver while the two-wheeled vehicle (100) is driving. The body parts may include one or more of the chest, back, wrist, ankle, knee, and head. The driving information may include at least one of a lateral inclination, a rotation angle, an acceleration, a speed, whether an impact occurred, a direction, or a relative position with respect to the two-wheeled vehicle (100) for each body part of the driver while the two-wheeled vehicle (100) is driving. In addition, the driving information may further include a surrounding image of each body part of the driver captured by at least one camera (116) while the two-wheeled vehicle (100) is driving.

[0070] At least one biometric information sensor (112) includes at least one of a pulse sensor for measuring the pulse of the driver, a body temperature sensor for detecting overheating or hypothermia of the driver, a blood oxygen saturation sensor for measuring the degree of oxygen supply to the driver, a conductivity sensor for detecting the stress or dehydration state of the driver based on the amount of sweat, and an electromyography sensor for detecting fatigue or tension of the driver. At least one biometric information sensor (112) is configured to generate biometric information for each body part of the driver while driving the two-wheeled vehicle (100). The body parts may include one or more of the chest, back, wrist, ankle, and knee, and the head. The biometric information may include at least one of the pulse, body temperature, blood oxygen saturation, amount of sweat, stress state, blood pressure, respiration rate, dehydration state, conductivity, and electromyography of the driver while driving the two-wheeled vehicle (100).

[0071] The transceiver (113) is connected to at least one processor (115) and transmits and / or receives signals. All or part of the transceiver (113) may be referred to as a transmitter, a receiver, or a transceiver. The transceiver (113) may support at least one of various wireless communication standards, such as a wired access system and a wireless access system, such as the Institute of Electrical and Electronics Engineers (IEEE) 802.xx system, the IEEE Wi-Fi system, the 3rd generation partnership project (3GPP) system, the 3GPP long term evolution (LTE) system, the 3GPP 5G NR (new radio) system, the 3GPP2 system, and Bluetooth.

[0072] The memory (114) is connected to at least one driving information sensor (111), at least one biometric information sensor (112), and at least one camera (116), and can store driving information of the driver of the two-wheeled vehicle (100) generated by the at least one driving information sensor (111), biometric information of the driver of the two-wheeled vehicle (100) generated by the at least one biometric information sensor (112), and images of the surrounding body parts of the driver of the two-wheeled vehicle (100) captured by the at least one camera (116), etc. In addition, the memory (114) is connected to the transceiver (113) and can store images and information received through communication, etc. In addition, the memory (114) is connected to at least one processor (115) and can store data such as a basic program for the operation of the at least one processor (115), an application program, setting information, and information generated by the operation of the at least one processor (115). The memory (114) may be composed of volatile memory, non-volatile memory, or a combination of volatile memory and non-volatile memory. In addition, the memory (114) may provide stored data upon request of at least one processor (115).

[0073] At least one processor (115) may be configured to implement the procedures and / or methods proposed in the present invention. At least one processor (115) controls the overall operations of the helmet (110) and the driver's clothing (120) for generating driving information and biometric information for the two-wheeled vehicle (100) based on biometric recognition. For example, at least one processor (115) generates driving information of the driver of the two-wheeled vehicle (100) through at least one driving information sensor (111). In addition, at least one processor (115) generates biometric information of the driver of the two-wheeled vehicle (100) through at least one biometric information sensor (112). In addition, at least one processor (115) captures an image of the surrounding body parts of the driver of the two-wheeled vehicle (100) through at least one camera (116). In addition, at least one processor (115) transmits or receives information, etc. through a transceiver (113). Additionally, at least one processor (115) writes and reads data to and from memory (114).

[0074] At least one camera (116) may be positioned in each direction surrounding a body part of a driver of a two-wheeled vehicle (100). The positioning of the at least one camera (116) may be configured in various ways. The at least one camera (116) may be configured to capture an image surrounding a body part of a driver of a two-wheeled vehicle (100). Depending on the embodiment, unlike FIG. 2, the helmet (110) and the driver's clothing (120) may not include at least one camera (116).

[0075]

[0076] FIG. 4 illustrates a block diagram of a configuration of a two-wheeled vehicle management server, an insurance company server, and a medical institution server according to various embodiments of the present invention.

[0077] Referring to FIG. 4, a server (200, 300, 500) according to various embodiments of the present invention includes a transceiver (212), a memory (220), and a processor (230).

[0078] The two-wheeled vehicle management server (200) refers to a server operated by a company that manages two-wheeled vehicles in a communication system. The two-wheeled vehicle management server (200) identifies the driver of the two-wheeled vehicle (100) based on driver biometric data received from the two-wheeled vehicle (100), authorizes the start of the two-wheeled vehicle (100), generates driver-specific driving information based on driving data received from the two-wheeled vehicle (100), and transmits the driver-specific driving information to an insurance company server (300) and a medical institution server (500).

[0079] The insurance company server (300) refers to a server operated by an insurance company in a communication system. The insurance company server (300) receives driver-specific driving information from the two-wheeled vehicle management server (300) and can calculate driver-specific insurance premiums based on the driver-specific driving information.

[0080] The medical institution server (500) refers to a server operated by a medical institution in a communication system. The medical institution server (500) can receive information on the circumstances of an accident (e.g., graphic information of a 3D simulation that reenacts the process of an accident, information on the driving speed at the time of the accident, amount of impact, direction of impact, and target of impact, etc.), the part of the driver's body damaged by the accident, and the degree of body damage from the motorcycle management server (300), and can transmit the information to a medical professional's terminal.

[0081] The transceiver (210) is connected to the processor (230) and transmits and / or receives signals. All or part of the transceiver (210) may be referred to as a transmitter or a receiver. The transceiver (210) may support at least one of various wireless communication standards, such as a wired connection system and a wireless connection system, such as the Institute of Electrical and Electronics Engineers (IEEE) 802.xx system, the IEEE Wi-Fi system, the 3rd generation partnership project (3GPP) system, the 3GPP long term evolution (LTE) system, the 3GPP 5G NR (new radio) system, the 3GPP2 system, and Bluetooth.

[0082] The memory (220) is connected to the transceiver (210) and can store information received through communication. In addition, the memory (220) is connected to the processor (230) and can store data such as basic programs for the operation of the processor (230), application programs, setting information, and information generated by operations of the processor (230). The memory (220) may be composed of volatile memory, nonvolatile memory, or a combination of volatile memory and nonvolatile memory. In addition, the memory (220) can provide stored data upon request of the processor (230).

[0083] The processor (230) may be configured to implement the procedures and / or methods proposed in the present invention. The processor (230) receives information using a communication system, generates new information based on the received information, stores the generated information, and controls the overall operations of the server (200, 300, 500) that transmits the received or generated information. For example, the processor (230) transmits or receives information, etc., via the transceiver (210). In addition, the processor (230) records and reads data in the memory (220). The processor (230) may include at least one processor.

[0084]

[0085] FIG. 5 illustrates a flowchart of an operation method of a two-wheeled vehicle management server according to various embodiments of the present invention.

[0086] In the embodiment of FIG. 5, the two-wheeled vehicle management server includes a transceiver, memory, and a processor.

[0087] In step S501, the motorcycle management server receives driving data from the motorcycle via the transceiver. According to various embodiments of the present invention, the driving data includes at least one of acceleration data, speed data, inclination data, direction data, and GPS (global positioning system) data of the motorcycle while the motorcycle is driving. The driving data further includes photographing data of the front, rear, left side, and right side of the motorcycle while the motorcycle is driving. The driving data further includes driving-related information for each body part of the driver while the motorcycle is driving, measured from sensors attached to each body part on the driver's helmet and the driver's driving clothing. The body parts include at least one of the chest, back, wrist, ankle, and knee, and the head. The sensors attached to each body part on the driver's helmet and the driver's driving clothing are communicatively connected to the motorcycle.

[0088] In step S502, the motorcycle management server generates driving information of the driver for the motorcycle by the processor based on the driving data. The driving information includes accident information about driving at the time of the accident. The accident information includes image information of a driving simulation that overlaps a three-dimensional image on a map image, in which the tilt angle and tilted direction of the motorcycle while driving, and the driver's relative position and posture with respect to the motorcycle are reflected for a set time section before and after the time of the accident. The image information of the driving simulation is configured to reproduce the inclination and direction of the motorcycle over time, the driver's relative position with respect to the motorcycle over time, the driver's physical posture over time, and the driver's impact situation as a three-dimensional image during the process in which the motorcycle falls over at the time of the accident.

[0089] At step S503, the two-wheeled vehicle management server transmits the driving information to the insurance company server via the transceiver.

[0090]

[0091] According to various embodiments of the present invention, the chest, back, wrist, ankle, and knee portions of the motorcycle, the helmet, and the driver's clothing may include one or more of an acceleration sensor, a gyroscope sensor, a geomagnetic sensor, and a GPS sensor. The acceleration data and the velocity data may be measured by the acceleration sensor. The inclination data may be measured by the gyro sensor. The direction data may be measured by the geomagnetic sensor. The GPS data may be measured by the GPS sensor. The time of the accident may be at least one of a time when the amount of impact measured using the acceleration sensor is greater than or equal to a threshold amount of impact, and a time when the speed of the motorcycle measured using the acceleration sensor exceeds a speed stipulated in the position of the motorcycle based on the GPS data.

[0092] According to various embodiments of the present invention, the three-dimensional image of the two-wheeled vehicle moves on the map image based on the acceleration data and the speed data,

[0093] The three-dimensional image of the two-wheeled vehicle can be located on the map image based on the GPS data. The two-wheeled vehicle may further include multiple cameras for the front, rear, left side, and right side of the two-wheeled vehicle. The three-dimensional image of the two-wheeled vehicle may be displayed against a background of an image of the surroundings of the two-wheeled vehicle based on the photographed data. Images of objects other than roads among the images of the surroundings of the two-wheeled vehicle may be displayed as three-dimensional images of objects surrounding the two-wheeled vehicle on the map.

[0094] According to various embodiments of the present invention, the accident information may include the amount of impact for each body part when the driver is ejected from the motorcycle and collides with the vehicle at the time of the accident. The accident information may include information on whether the object that impacted the driver was another vehicle, another object, or the road surface.

[0095] According to various embodiments of the present invention, the image information of the driving simulation may be configured to three-dimensionally implement the relative positions of each body part of the driver with respect to the two-wheeled vehicle and the object over time. The image information of the driving simulation may be configured to implement impact contacts of each body part of the driver over time.

[0096] According to various embodiments of the present invention, the accident information may further include expected damage information based on the amount of impact for each body part of the driver over time. The video information of the driving simulation may be configured to display the expected damage information for each body part of the driver over time. The expected damage information may include the expected type and degree of damage of the driver. The expected type of damage may include at least one of scratches, bruising, contusions, muscle and ligament ruptures, spinal damage, chest and lung damage, head damage, abdominal damage, pelvic and lower extremity damage.

[0097] According to various embodiments of the present invention, the helmet or the driving suit may include biometric information sensors for obtaining biometric information of the driver in real time. The biometric information sensors may include a pulse sensor for measuring the pulse of the driver, a body temperature sensor for detecting overheating or hypothermia of the driver, a blood oxygen saturation sensor for measuring the degree of oxygen supply to the driver, a conductivity sensor for detecting the driver's stress or dehydration state based on the amount of sweat, and an electromyography sensor for detecting the driver's fatigue or tension. The driving data further includes the biometric information of the driver, and the biometric information may include at least one of the driver's pulse, body temperature, blood oxygen saturation, sweat amount, stress state, blood pressure, respiration rate, dehydration state, conductivity, and electromyography. The above expected damage information can be determined based on the amount of impact for each body part, the body part where the impact occurred, the object that impacted the driver, the speed of the driver when the accident occurred, the driver's body posture when the accident occurred, and the driver's biometric information.

[0098] According to various embodiments of the present invention, the embodiment of FIG. 5 may further include a process of receiving an engine start authorization request message including biometric data of the driver from the two-wheeled vehicle by the transceiver, a process of identifying the driver by the processor based on a comparison of the biometric data with pre-stored driver biometric data, and a process of transmitting an engine start authorization message for the driver to the two-wheeled vehicle by the transceiver.

[0099] According to various embodiments of the present invention, the embodiment of FIG. 5 may further include a process of transmitting, by the transceiver, the accident information including the image information of the driving simulation, the expected damage information, and the biometric information of the driver, to a server of a medical institution within a certain range centered on the location of the two-wheeled vehicle, if the expected damage degree for the expected damage type of the driver exceeds a critical damage degree. The critical damage degree may be determined in advance for each of the expected damage types. The biometric information of the driver may include one or more of the driver's vital signs, i.e., blood pressure, respiratory rate, pulse, and body temperature.

[0100]

[0101] Various embodiments of the present invention provide a two-wheeled vehicle management server in a communication system. The two-wheeled vehicle management server includes a transceiver, a memory, and a processor, and the processor is configured to perform an operating method of the two-wheeled vehicle management server in a communication system according to various embodiments of the present invention.

[0102] Various embodiments of the present invention provide a computer program recorded on a computer-readable storage medium. The computer program is configured to perform a method of operating a two-wheeled vehicle management server in a communication system according to various embodiments of the present invention.

[0103]

[0104] FIG. 6 illustrates a process of generating driver-specific driving information while driving a two-wheeled vehicle according to various embodiments of the present invention.

[0105] Specifically, FIG. 6 illustrates examples of various driving information that can be generated by at least one driving information sensor included in a two-wheeled vehicle. The at least one driving information sensor illustrated in the embodiment of FIG. 6 can be applied not only to the two-wheeled vehicle (100), but also to the helmet (110) and driving clothing (120) worn by the driver of the two-wheeled vehicle (100). In addition, in the following description of the embodiment of FIG. 6, driving information related to driving of the two-wheeled vehicle can also be applied to driving information for each body part of the driver while driving the two-wheeled vehicle (100).

[0106] According to various embodiments of the present invention, at least one driving information sensor may include at least one of a global positioning system (GPS) sensor, a gyroscope sensor, a geomagnetic sensor, or an acceleration sensor.

[0107] According to various embodiments of the present invention, the driving information may include at least one of a lateral inclination of the two-wheeled vehicle while driving, a turning angle of the two-wheeled vehicle while driving, an acceleration of the two-wheeled vehicle while driving, a speed of the two-wheeled vehicle while driving, whether an impact occurred while driving the two-wheeled vehicle, whether an accident occurred while driving the two-wheeled vehicle, a GPS location of the two-wheeled vehicle, a gradient of a road on which the two-wheeled vehicle is driving, a road surface condition of a road on which the two-wheeled vehicle is driving, or a driving path of the two-wheeled vehicle.

[0108] According to various embodiments of the present invention, the driving information may further include at least one of: whether the two-wheeled vehicle is driving unstably based on whether a lateral slope is greater than a critical slope while driving; whether a sharp turn is made based on whether a turning angle is greater than a critical turning angle while driving; whether an accident has occurred based on whether a value of an impulse generated while driving the two-wheeled vehicle is greater than a critical impulse; road surface condition information based on whether a value of a shaking of the two-wheeled vehicle is driving is greater than a critical shaking value; whether a sudden acceleration / sudden stop is made based on whether an absolute value of an acceleration of the two-wheeled vehicle is driving is greater than a critical acceleration; or whether a speed is exceeded based on whether an absolute value of a speed of the two-wheeled vehicle exceeds a specified speed based on a location of the two-wheeled vehicle based on GPS data.

[0109] According to various embodiments of the present invention, the driving information may further include at least one of: the number of unstable driving events per unit driving distance, which is an average value for a predetermined unit driving distance in which a side slope while driving of the two-wheeled vehicle is greater than a critical slope; the average number of sharp turns per unit driving distance, which is an average value for a predetermined unit driving distance in which a turning angle while driving of the two-wheeled vehicle is greater than a critical turning angle; the number of sudden accelerations / sudden stops per unit driving distance, which is an average value for a predetermined unit driving distance in which an absolute value of an acceleration while driving of the two-wheeled vehicle is greater than a critical acceleration; or the number of speeding events in which an absolute value of a speed while driving of the two-wheeled vehicle exceeds a speed limit based on GPS data based on a location of the two-wheeled vehicle.

[0110] According to various embodiments of the present invention, the driving information may further include a number of violations of the speed limit per unit driving distance, which is an average value for a given unit driving distance of the number of times the speed is higher than the speed limit while driving the two-wheeled vehicle.

[0111]

[0112] FIG. 7 illustrates a process of collecting physical characteristic information while driving a two-wheeled vehicle according to various embodiments of the present invention.

[0113] Specifically, FIG. 7 illustrates examples of driving information based on various driving physical characteristics that can be generated by at least one driving information sensor included in a two-wheeled vehicle.

[0114] At least one driving information sensor related to the embodiment of FIG. 7 may be applied not only to the two-wheeled vehicle (100), but also to the helmet (110) and driving clothing (120) worn by the driver of the two-wheeled vehicle (100). In addition, in the following description of the embodiment of FIG. 7, driving information related to driving of the two-wheeled vehicle may also be applied to driving information for each body part of the driver while driving the two-wheeled vehicle (100).

[0115] According to various embodiments of the present invention, at least one driving information sensor may include at least one of a global positioning system (GPS) sensor, a gyroscope sensor, a geomagnetic sensor, or an acceleration sensor.

[0116] According to various embodiments of the present invention, driving information based on physical characteristics may include at least one of: a lateral inclination of the two-wheeled vehicle while driving, a turning angle of the two-wheeled vehicle while driving, an acceleration of the two-wheeled vehicle while driving, a speed of the two-wheeled vehicle while driving, whether an impact occurred while driving the two-wheeled vehicle, whether an accident occurred while driving the two-wheeled vehicle, a GPS location of the two-wheeled vehicle, a gradient of the road on which the two-wheeled vehicle is driving, a road surface condition of the road on which the two-wheeled vehicle is driving, or a driving path of the two-wheeled vehicle.

[0117] According to various embodiments of the present invention, the driving information may further include at least one of: whether the two-wheeled vehicle is driving unstably based on whether a lateral slope is greater than a critical slope while driving; whether a sharp turn is made based on whether a turning angle is greater than a critical turning angle while driving; whether an accident has occurred based on whether a value of an impulse generated while driving the two-wheeled vehicle is greater than a critical impulse; road surface condition information based on whether a value of a shaking of the two-wheeled vehicle is driving is greater than a critical shaking value; whether a sudden acceleration / sudden stop is made based on whether an absolute value of an acceleration of the two-wheeled vehicle is driving is greater than a critical acceleration; or whether a speed is exceeded based on whether an absolute value of a speed of the two-wheeled vehicle exceeds a specified speed based on a location of the two-wheeled vehicle based on GPS data.

[0118] According to various embodiments of the present invention, the driving information may further include the number of unstable driving times per unit driving distance, which is an average value for a predetermined unit driving distance in which a side slope while driving of the two-wheeled vehicle is greater than a threshold slope, the average number of sharp turns per unit driving distance, which is an average value for a predetermined unit driving distance in which a turning angle while driving of the two-wheeled vehicle is greater than a threshold turning angle, the number of sudden accelerations / sudden stops per unit driving distance, which is an average value for a predetermined unit driving distance in which an absolute value of acceleration while driving of the two-wheeled vehicle is greater than a threshold acceleration, or the number of speed violations per unit driving distance, which is an average value for a predetermined unit driving distance in which a speed while driving of the two-wheeled vehicle is greater than a speed limit based on GPS data.

[0119]

[0120] FIG. 8 illustrates a process of reproducing the driving of a two-wheeled vehicle into a three-dimensional image based on physical characteristic information during driving of the two-wheeled vehicle according to various embodiments of the present invention.

[0121] Specifically, FIG. 8 illustrates an example of a process in which a two-wheeled vehicle management server reproduces the driving of a two-wheeled vehicle as a three-dimensional image based on driving information received from the two-wheeled vehicle.

[0122] The three-dimensional image reproduction based on at least one driving information related to the embodiment of FIG. 8 can be applied not only to the three-dimensional image reproduction of a two-wheeled vehicle (100), but also to the three-dimensional image reproduction of a driver's shape based on the positions of each body part of the driver based on information obtained from the helmet (110) and driving clothing (120) worn by the driver of the two-wheeled vehicle (100).

[0123] The motorcycle management server can determine physical characteristics of the motorcycle, such as incline, heading, speed, and GPS location, based on driving information received from the motorcycle. While the motorcycle is in motion, this physical characteristic information is transmitted to the motorcycle management server in real time via a cellular network. Therefore, the motorcycle management server can determine the physical characteristics of the motorcycle in real time.

[0124] Using information about the physical characteristics of a motorcycle, an image of a moving motorcycle can be overlaid on a map image based on GPS location and speed. Furthermore, a 3D image of a moving motorcycle can be overlaid on a map image based on the motorcycle's inclination and orientation.

[0125] The motorcycle management server uses the driver's biometric information to authorize the motorcycle's start, so the driving of the motorcycle, recreated in 3D images, can be classified by driver.

[0126] The motorcycle management server can identify the point in time when a collision occurred during the entire driving process by detecting the point in time when the impact force measured using the acceleration sensor exceeds the threshold impact force. The motorcycle management server can also identify the point in time when the speed of the motorcycle, measured using the acceleration sensor, exceeds the speed limit based on GPS data.

[0127] The two-wheeled vehicle management server can identify the time at which a collision or speeding occurred as the time of the accident, and then create a driving simulation video of the two-wheeled vehicle at the time of the accident by overlapping a two-dimensional or three-dimensional image of the two-wheeled vehicle on a map image for a set time period before and after the time of the accident.

[0128]

[0129] FIG. 9 illustrates a process for acquiring an around view image while driving a two-wheeled vehicle according to various embodiments of the present invention.

[0130] Specifically, FIG. 9 illustrates a process in which a two-wheeled vehicle management server creates an around view image of a two-wheeled vehicle based on images of the front, rear, side, etc. of the two-wheeled vehicle captured using at least one camera included in the two-wheeled vehicle.

[0131] The three-dimensional image reproduction of a two-wheeled vehicle (100) based on a camera mounted on the two-wheeled vehicle (100) related to the embodiment of FIG. 9 can also be applied to three-dimensional image reproduction of a driver's form based on the location of each body part of the driver based on information acquired from cameras mounted on a helmet (110) and a driver's clothing (120) worn by the driver of the two-wheeled vehicle (100).

[0132] A two-wheeled vehicle may include at least one camera. The at least one camera included in the two-wheeled vehicle may be positioned in each direction surrounding the two-wheeled vehicle, such as the front, rear, left side, and rear side. According to an embodiment, the at least one camera may be configured with four channels, i.e., front side, rear side, left side, and right side, or six channels, i.e., front side, rear side, front left side, front right side, rear left side, and rear right side. The above-described configuration is merely an example, and the arrangement of the at least one camera may be configured in various ways. The at least one camera may be configured to capture an image of the surroundings of the two-wheeled vehicle.

[0133] The two-wheeled vehicle management server can receive, via a cellular network, images captured by at least one camera included in the two-wheeled vehicle while the two-wheeled vehicle is in motion. The two-wheeled vehicle management server can then generate an image of the surroundings of the two-wheeled vehicle while in motion based on the images captured by the at least one camera.

[0134] The two-wheeled vehicle management server can create a driving simulation video of a two-wheeled vehicle by overlapping a two-dimensional or three-dimensional image of the two-wheeled vehicle on a map image, and can display the surrounding image of the two-wheeled vehicle while it is being driven as the background of the two-wheeled vehicle.

[0135] The motorcycle management server can generate a 3D driving simulation video along with a 3D image of the motorcycle by displaying objects outside the road in 3D within a 2D image of the motorcycle's surroundings. This 3D driving simulation video is particularly effective in reproducing crashes involving motorcycles colliding with objects, providing a realistic representation of the crash.

[0136]

[0137] FIG. 10 illustrates an example of a three-dimensional reconstruction image of a two-wheeled vehicle accident point in time according to various embodiments of the present invention.

[0138] Specifically, Fig. 10 illustrates an example of an accident scene image of a two-wheeled vehicle reconstructed based on physical characteristic information.

[0139] The three-dimensional image reproduction related to the embodiment of Fig. 10 is characterized in that not only the two-wheeled vehicle (100) but also the driver of the two-wheeled vehicle (100) is reproduced in three dimensions based on information obtained from sensors and cameras mounted on the two-wheeled vehicle (100) as well as sensors and cameras mounted on the helmet (110) and driver's clothing (120) worn by the driver of the two-wheeled vehicle (100).

[0140] The two-wheeled vehicle management server can reproduce the accident scene of the two-wheeled vehicle in three dimensions on a map image based on the physical characteristic information of the two-wheeled vehicle's inclination, direction, speed, and GPS location while driving.

[0141] The insurance company server can easily and accurately determine the facts of a motorcycle accident by receiving a 3D reconstruction image of the accident time from the motorcycle management server.

[0142] In addition to the embodiment of FIG. 10, the motorcycle management server can also 3D-reproduce the object that collided with the motorcycle when the motorcycle caused a collision by adding the around-view image of FIG. 9. By receiving the 3D-reproduced image of the motorcycle and the object from the motorcycle management server, the insurance company server can easily and accurately determine the facts surrounding the collision.

[0143] The image information of the driving simulation according to the 3D reproduction image includes the image information of the driving simulation that overlaps the 3D image reflecting the tilt angle and tilted direction of the two-wheeled vehicle while driving, and the driver's relative position and posture with respect to the two-wheeled vehicle, for a set time section before and after the time of the accident on the map image. The image information of the driving simulation is configured to reproduce the inclination and direction of the two-wheeled vehicle over time, the driver's relative position with respect to the two-wheeled vehicle over time, the driver's physical posture over time, and the driver's impact situation as a 3D image during the process in which the two-wheeled vehicle falls over at the time of the accident.

[0144] According to various embodiments of the present invention, the image information of the driving simulation may be configured to three-dimensionally implement the relative positions of each body part of the driver with respect to the two-wheeled vehicle and surrounding objects of the two-wheeled vehicle over time. The image information of the driving simulation may be configured to implement impact contact with the ground or surrounding objects over time for each body part of the driver. The image information of the driving simulation may be configured to display information on whether the object of impact for each body part of the driver is another vehicle, another object, or the road surface.

[0145] According to various embodiments of the present invention, the video information of the driving simulation can be configured to display, by time, expected damage information for each body part of the driver based on the amount of impact to each body part of the driver over time. The expected damage information can include at least one of scratches, bruising, sprains, muscle and ligament tears, spinal injuries, chest and lung injuries, head injuries, abdominal injuries, pelvic and lower extremity injuries. The expected degree of damage can include predicted information on the degree of bone and internal organ damage estimated based on measurements of the direction and intensity of the impact to each body part. Through this, the driver can be provided with information on what body damage occurred during the process of which body part colliding with which object at which precise time.

[0146] Measurements of the body damage site and extent of body damage can be performed through the following methods:

[0147] (1) Sensor Data Analysis: Sensors attached to the motorcycle driver's clothing measure the force and pressure generated during an impact. Accelerometers and gyroscopes measure the direction and intensity of the impact on the driver's body, and this data can be analyzed to predict body parts most likely to sustain damage. This analysis can be continuously learned and its accuracy improved through comparison with past cases (sensor data from past accidents and actual physical damage information) using the artificial intelligence and machine learning system described in (4), described below.

[0148] (2) Biomechanical Model: Biomechanical models can be used to understand how various body parts are affected by impact during an accident. These models simulate how various body parts respond to impact, allowing for the estimation of the likelihood and extent of damage. Biomechanical models can be used to estimate the potential for damage to internal structures of the human body, particularly bones and internal organs. These models simulate the forces experienced during a collision and their effects on the internal structure of the body. Biomechanical models are mathematical and computer-based frameworks for understanding and simulating the structure and function of the human body. Biomechanical models can include the following elements: (2-1) Mathematical Model: This model mathematically represents the functions and movements of various body parts (bones, muscles, joints, etc.). These models are typically based on physics principles to reflect the mechanical properties of the human body. (2-2) Computer Simulation: Biomechanical models are implemented through computer simulations, allowing for the visualization and analysis of complex human movements and interactions. (2-3) Databases and Previous Research: Biomechanical modeling relies on existing research and databases. For example, models can be built based on previous research data on specific parts of the human body and applied to new scenarios. (2-4) Personalized and customized modeling: Biomechanical models can be customized to reflect individual human characteristics (size, body shape, muscle strength, etc.). Biomechanical models can be stored in the server's memory in the form of software. The server can estimate the risk of damage to bones and internal organs through the biomechanical model based on driving information measured from sensors attached to the motorcycle and the driver's clothing.

[0149] (3) 3D Simulation and Reenactment: By generating a 3D simulation based on sensor data from the moment of the accident, the driver's position and movements at the time of the accident can be accurately recreated. This allows for more accurate prediction of the location and extent of damage.

[0150] (4) Artificial Intelligence and Machine Learning: By integrating this data with artificial intelligence (AI) or machine learning algorithms and comparing and analyzing it with past accident data, the location and extent of damage can be more accurately predicted. This system continuously learns and improves, providing more accurate predictions over time.

[0151] The driver's helmet or suit includes biometric sensors for acquiring the driver's biometric information in real time. The biometric sensors include a pulse sensor for measuring the driver's pulse, a body temperature sensor for detecting overheating or hypothermia, a blood oxygen saturation sensor for measuring the driver's oxygen supply, a conductivity sensor for detecting the driver's stress or dehydration based on the amount of sweat, and an electromyography sensor for detecting the driver's fatigue or tension. According to various embodiments of the present invention, the video information of the driving simulation can be configured to display the driver's biometric information in a time-based manner during the accident process. For example, based on pulse information, information on the point in time before and after the accident when the driver reached a critical state, the exact point in time of death, etc. can be provided. In addition, the expected damage information can be generated by additionally referencing the biometric information acquired by the biometric sensors.

[0152]

[0153] FIG. 11 illustrates an example of the operation process of a server after an accident of a two-wheeled vehicle according to various embodiments of the present invention.

[0154] Referring to Fig. 11, based on a sensor mounted on a helmet or driver's clothing of a two-wheeled vehicle driver and a sensor mounted on the two-wheeled vehicle, while the two-wheeled vehicle is being driven, driving information of the two-wheeled vehicle, the driver's biometric information, and relative position information for each body part of the driver with respect to the two-wheeled vehicle are acquired in real time.

[0155] Based on operational information acquired from sensors, the occurrence of accidents such as collisions, rollovers, and falls of motorcycles can be determined. Specifically, the presence or absence of an accident can be determined by comparing the values ​​acquired from the 9-axis sensors with a predetermined threshold. For example, an accident can be determined if the angle at which the motorcycle overturned exceeds a certain angle and the motorcycle's speed falls within a certain range from 0.

[0156] When the occurrence of an accident is determined, based on the driver's biometric information and the relative position information of each body part of the driver with respect to the motorcycle, the position of the motorcycle per unit time during the accident, the relative speed and relative position of the motorcycle with respect to the collision target, the relative position of each body part of the driver with respect to the motorcycle, and the expected impact can be determined, and based on this, the injured part of the driver, the damaged part of the motorcycle, the degree of the driver's injury, and the degree of the damage to the motorcycle can be estimated.

[0157] Based on the estimated information on the driver's injured area, motorcycle damaged area, driver's injury degree, and motorcycle damage degree, the estimated driver's injured area, injury degree, and accident details can be transmitted to a medical institution's server and an insurance company's server located within a certain range from the accident scene. In relation to the accident details, the driver's collision process can be recreated and provided as a 3D simulation based on information acquired from sensors. The motorcycle damage process and the driver's injury process can be recreated at each unit of time before and after the accident. In particular, the angle at which the motorcycle falls, the direction in which the motorcycle falls, the relative positions of each driver's body part with respect to the motorcycle, the collision process for each driver's body part, and the severity of the collision for each driver's body part can be recreated as a 3D simulation.

[0158] Information generated from sensors installed on motorcycles can be used to estimate damage and other areas of the motorcycle in the event of an accident based on changes in the motorcycle's physical condition, and the information can be reported to the insurance company in real time. Based on data generated from sensors installed on the driver's clothing and helmet, the extent of the motorcycle driver's injuries can be estimated and transmitted in real time to medical institutions and medical professionals (e.g., information notifications via server-client communication-based smartphone applications), enabling them to be prepared for optimal emergency treatment. Sensor data can be transmitted to medical institutions immediately after an accident occurs, enabling them to estimate the extent of the injury in advance and quickly reconfigure the system to ensure optimal emergency treatment before the patient arrives at the medical institution. Various embodiments of the present invention can address the problem of fatalities during transport due to the lack of a system capable of objectively monitoring the patient's condition during the accident, ambulance dispatch, and transport to the hospital. Based on various embodiments of the present invention, it is possible to minimize the physical time required for transporting a patient from an accident to a medical institution and for medical staff to assess the patient's condition upon arrival at the medical institution and provide full-scale emergency treatment, as well as the risks involved in the process, thereby ensuring optimal emergency treatment readiness for motorcycle accidents.

[0159]

[0160] FIG. 12 illustrates an example of a sensor attachment location on a driver's clothing of a two-wheeled vehicle according to various embodiments of the present invention. The portions indicated by spheres or ovals in FIG. 12 represent exemplary locations where sensors are attached.

[0161] Referring to FIG. 12, for example, one or more of a driving information sensor and a biometric information sensor may be attached to each part of the driver's driving clothing (including a helmet worn on the head and clothing worn on the body).

[0162] For example, one or more driving information sensors or biometric information sensors may be attached to the driver's head, arms, chest, back, or knees.

[0163] FIG. 12 is merely an example, and according to various embodiments of the present invention, one or more of a driving information sensor and a biometric information sensor may be attached in various forms to each part of a driver's driving clothing (including a helmet worn on the head and clothing worn on the body).

[0164] The driving information sensor includes at least one of a global positioning system (GPS) sensor, a gyroscope sensor, a gyro sensor, a geomagnetic sensor, and an acceleration sensor.

[0165] The biometric information sensor includes at least one of a pulse sensor for measuring the pulse of the driver, a body temperature sensor for detecting overheating or hypothermia of the driver, a blood oxygen saturation sensor for measuring the level of oxygen supply to the driver, a conductivity sensor for detecting a stress or dehydration state of the driver based on the amount of sweat, and an electromyography sensor for detecting fatigue or tension of the driver.

[0166]

[0167] When implementing an embodiment of the present invention using hardware, ASICs (application specific integrated circuits) or DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays), etc. configured to perform the present invention may be provided in the processor of the present invention.

[0168] Meanwhile, the above-described method can be written as a program that can be executed on a computer, and can be implemented on a general-purpose digital computer that runs the program using a computer-readable medium. In addition, the structure of the data used in the above-described method can be recorded on a computer-readable storage medium through various means. It should be understood that the program storage devices that can be used to describe a storage device including executable computer code for performing various methods of the present invention do not include transient objects such as carrier waves or signals. The computer-readable storage medium includes storage media such as magnetic storage media (e.g., ROM, floppy disk, hard disk, etc.) and optical reading media (e.g., CD-ROM, DVD, etc.).

[0169] The embodiments described above are combinations of components and features of the present invention in a predetermined form. Each component or feature should be considered optional unless explicitly stated otherwise. Each component or feature may be implemented without being combined with other components or features. Furthermore, it is also possible to form an embodiment of the present invention by combining some components and / or features. The order of operations described in the embodiments of the invention may be changed. Some components or features of one embodiment may be included in another embodiment or may be replaced with corresponding components or features of another embodiment. It is self-evident that claims that are not explicitly cited in the scope of the patent may be combined to form an embodiment or may be incorporated as a new claim through a post-application amendment.

[0170] It will be apparent to those skilled in the art that the present invention can be embodied in other forms without departing from the technical spirit and essential characteristics of the present invention. Therefore, the above embodiments should be considered illustrative rather than restrictive in all respects. The scope of the present invention should be determined by a reasonable interpretation of the appended claims and all possible variations within the scope of equivalents of the present invention.

[0171]

[0172] The present invention relates to a device and method for providing driver-specific accident simulation information and expected bodily injury information for two-wheeled vehicle driving. Specifically, the present invention relates to a device and method for providing driving information including accident information during driving for a driver identified through biometrics to an insurance company and a medical institution, wherein the accident information includes image information of a driving simulation overlapping a three-dimensional image of a two-wheeled vehicle on a map for a set time interval before and after the accident, and information regarding the driver's expected bodily injury site and expected degree of bodily injury.

Claims

1. In a method for operating a two-wheeled vehicle management server including a transmitter / receiver, memory, and processor in a communication system, A process for receiving driving data from a two-wheeled vehicle by the transceiver, wherein the driving data includes at least one of acceleration data, speed data, inclination data, direction data, and GPS (global positioning system) data of the two-wheeled vehicle while the two-wheeled vehicle is driving, wherein the driving data further includes photographing data of the front, rear, left side, and right side of the two-wheeled vehicle while the two-wheeled vehicle is driving, wherein the driving data further includes driving-related information for each body part of the driver while the two-wheeled vehicle is driving, measured from sensors attached to each body part on the driver's helmet and the driver's driving clothing, wherein the body parts include at least one of the chest, back, wrist, ankle, and knee, and the head, wherein the sensors attached to each body part on the driver's helmet and the driver's driving clothing are communicatively connected to the two-wheeled vehicle; A process of generating driving information of the driver's two-wheeled vehicle based on the driving data by the processor, wherein the driving information includes accident information about driving at the time of the accident. The above accident information includes image information of a driving simulation that overlaps a three-dimensional image reflecting the tilt angle and tilted direction of the two-wheeled vehicle while driving, and the driver's relative position and posture with respect to the two-wheeled vehicle, on a map image for a time period set before and after the time of the accident. The image information of the above driving simulation is configured to reproduce the inclination and orientation of the two-wheeled vehicle over time, the driver's relative position to the two-wheeled vehicle over time, the driver's body posture over time, and the driver's impact situation as a three-dimensional image during the process in which the two-wheeled vehicle falls at the time of the accident; Including a process of transmitting the driving information to the insurance company server by the transceiver. method.

2. In paragraph 1, The parts corresponding to the chest, back, wrist, ankle and knee of the above two-wheeled vehicle, the above helmet and the above driving suit include at least one of an acceleration sensor, a gyroscope sensor, a geomagnetic sensor and a GPS sensor. The above acceleration data and the above velocity data are measured by the acceleration sensor, The above inclination data is measured by the gyro sensor, The above azimuth data is measured by the geomagnetic sensor, The above GPS data is measured by the GPS sensor, The above accident time is at least one of the time when the impact amount measured using the acceleration sensor exceeds the critical impact amount, and the time when the speed of the two-wheeled vehicle measured using the acceleration sensor exceeds the speed specified for the location of the two-wheeled vehicle based on the GPS data. method.

3. In paragraph 1, The three-dimensional image of the above two-wheeled vehicle moves on the map image based on the acceleration data and speed data, The three-dimensional image of the above two-wheeled vehicle is located on the map image based on the GPS data, The above two-wheeled vehicle further includes multiple cameras for the front, rear, left side, and right side of the two-wheeled vehicle, The three-dimensional image of the above two-wheeled vehicle is displayed as a background image of the surrounding image of the above two-wheeled vehicle based on the above shooting data, Among the surrounding images of the above two-wheeled vehicle, images of objects other than roads are displayed as three-dimensional images of objects surrounding the above two-wheeled vehicle on the above map. method.

4. In paragraph 3, The above accident information includes the amount of impact for each body part when the driver leaves the motorcycle and collides with the vehicle at the time of the accident. The above accident information includes information on whether the object that struck the driver was another vehicle, another object, or the road surface. method.

5. In paragraph 4, The image information of the above driving simulation is configured to implement the relative positions of each body part of the driver with respect to the two-wheeled vehicle and the object in three dimensions over time, The video information of the above driving simulation is configured to implement the impact contact of each body part of the driver over time. method.

6. In paragraph 5, The above accident information further includes expected damage information based on the amount of impact per body part of the driver over time, The video information of the above driving simulation is configured to display the expected damage information for each body part of the driver by time, The above expected damage information includes the expected damage type and expected damage degree of the driver, The above expected injury types include at least one of scratches, bruising, sprains, muscle and ligament tears, spinal injuries, chest and lung injuries, head injuries, abdominal injuries, pelvic and lower extremity injuries, The above expected degree of damage includes predicted information on the degree of damage to bones and internal organs based on measurements of the direction and intensity of impact to each body part. method.

7. In paragraph 6, The above helmet or the above driving suit includes biometric information sensors for obtaining the driver's biometric information in real time, The biometric information sensors include a pulse sensor for measuring the pulse of the driver, a body temperature sensor for detecting overheating or hypothermia of the driver, a blood oxygen saturation sensor for measuring the level of oxygen supply to the driver, a conductivity sensor for detecting the stress or dehydration state of the driver based on the amount of sweat, and an electromyography sensor for detecting fatigue or tension of the driver. The driving data further includes the driver's biometric information, and the biometric information includes at least one of the driver's pulse, body temperature, blood oxygen saturation, sweat amount, stress state, blood pressure, respiratory rate, dehydration state, conductivity, and electromyography. The above expected damage information is determined based on the amount of impact for each body part, the body part where the impact occurred, the object that impacted the driver, the speed of the driver at the time of the accident, the driver's body posture at the time of the accident, and the driver's biometric information. method.

8. In paragraph 6, If the expected degree of damage for the expected type of damage of the driver exceeds the critical degree of damage, the process of transmitting the accident information including the image information of the driving simulation, the expected damage information, and the biometric information of the driver to a server of a medical institution within a certain range centered on the location of the two-wheeled vehicle by the transceiver is further included. The critical damage level is determined in advance for each of the above expected damage types. method.

9. In the two-wheeled vehicle management server in the communication system, The above two-wheeled vehicle management server includes a transceiver, memory, and processor. The processor is operably coupled to the transceiver and the memory, The above processor is configured to perform the method, The above method, A process for receiving driving data from a two-wheeled vehicle by the transceiver, wherein the driving data includes at least one of acceleration data, speed data, inclination data, direction data, and GPS (global positioning system) data of the two-wheeled vehicle while the two-wheeled vehicle is driving, wherein the driving data further includes photographing data of the front, rear, left side, and right side of the two-wheeled vehicle while the two-wheeled vehicle is driving, wherein the driving data further includes driving-related information for each body part of the driver while the two-wheeled vehicle is driving, measured from sensors attached to each body part on the driver's helmet and the driver's driving clothing, wherein the body parts include at least one of the chest, back, wrist, ankle, and knee, and the head, wherein the sensors attached to each body part on the driver's helmet and the driver's driving clothing are communicatively connected to the two-wheeled vehicle; A process of generating driving information of the driver's two-wheeled vehicle based on the driving data by the processor, wherein the driving information includes accident information about driving at the time of the accident. The above accident information includes image information of a driving simulation that overlaps a three-dimensional image reflecting the tilt angle and tilted direction of the two-wheeled vehicle while driving, and the driver's relative position and posture with respect to the two-wheeled vehicle, on a map image for a time period set before and after the time of the accident. The image information of the above driving simulation is configured to reproduce the inclination and orientation of the two-wheeled vehicle over time, the driver's relative position to the two-wheeled vehicle over time, the driver's body posture over time, and the driver's impact situation as a three-dimensional image during the process in which the two-wheeled vehicle falls at the time of the accident; Including a process of transmitting the driving information to the insurance company server by the transceiver. Two-wheeled vehicle management server.

10. One or more non-transitory, computer-readable mediums comprising instructions that when executed by one or more processors cause operations, The above actions are, The process of receiving driving data from a two-wheeled vehicle, The driving data includes at least one of acceleration data, speed data, inclination data, direction data, and GPS (global positioning system) data of the two-wheeled vehicle while the two-wheeled vehicle is driving, the driving data further includes photographing data of the front, rear, left side, and right side of the two-wheeled vehicle while the two-wheeled vehicle is driving, the driving data further includes driving-related information of the driver's body parts while the two-wheeled vehicle is driving measured from sensors attached to the driver's helmet and the driver's driving clothing for each body part, the body parts including at least one of the chest, back, wrist, ankle, and knee, and the head, and the sensors attached to the driver's helmet and the driver's driving clothing for each body part are communicatively connected to the two-wheeled vehicle; A process for generating driving information for the two-wheeled vehicle of the driver based on the driving data; The above driving information includes accident information about driving at the time of the accident. The above accident information includes image information of a driving simulation that overlaps a three-dimensional image reflecting the tilt angle and tilted direction of the two-wheeled vehicle while driving, and the driver's relative position and posture with respect to the two-wheeled vehicle, on a map image for a time period set before and after the time of the accident. The image information of the above driving simulation is configured to reproduce the inclination and orientation of the two-wheeled vehicle over time, the driver's relative position to the two-wheeled vehicle over time, the driver's body posture over time, and the driver's impact situation as a three-dimensional image during the process in which the two-wheeled vehicle falls at the time of the accident; Including the process of transmitting the above driving information to the insurance company server, One or more non-transitory computer-readable media.

Images