Method, system and application for sudden acceleration confirmation of vehicle using mobile

Abstract

A method of operation of a mobile terminal comprises the steps of: pairing with at least one pedal-capturing camera installed in a vehicle to capture an accelerator pedal and a brake pedal operated by a user; receiving and storing pedal images from the at least one pedal-capturing camera; when a predefined event occurs, extracting images from the pedal images for a certain period of time before and after the occurrence of the predefined event, synchronizing the extracted images with the location information of the mobile terminal according to time to generate evidence of sudden acceleration; and transmitting the evidence of sudden acceleration to a cloud server.

Description

Technology Field

[0001] The present invention relates to a method for confirming sudden acceleration of a vehicle using a mobile terminal, a system, and an application. Background Technology

[0002] Sudden acceleration of a vehicle refers to a state in which a vehicle moves forward or backward on its own at a sudden and rapid speed without any operation of the accelerator pedal or gear shifting, that is, a state in which a vehicle accelerates rapidly beyond the driver's control and regardless of the driver's will.

[0003] It is known that in cases of sudden acceleration, the speed of the rapidly starting vehicle cannot be controlled even when the braking system is applied, and in some instances, the braking system may even fail to function properly. Because such sudden acceleration accidents occur very instantaneously, drivers are unable to respond appropriately, resulting in significant material and human casualties in most cases.

[0004] Hundreds of accidents suspected of being sudden acceleration have occurred in Korea. However, it is known that not a single accident has been officially recognized as sudden acceleration to date.

[0005] Currently, the only criterion for identifying sudden acceleration accidents in Korea is the Event Data Recorder (EDR). While the EDR is a device that records engine RPM and brake application just before a collision, EDR records from most suspected sudden acceleration incidents frequently indicate that the accelerator was operated while the brakes failed to engage.

[0006] Therefore, in order for a driver to prove in court that a vehicle has suddenly accelerated—that is, that the vehicle has suddenly accelerated due to a movement unrelated to the driver's operation (intention)—it is necessary to have evidence that can objectively prove that the vehicle moved forward or backward at a high speed even while the driver was pressing the brake. The problem to be solved

[0007] The present disclosure provides a method for confirming sudden acceleration, a system, and an application capable of establishing objective evidence data in the event of sudden acceleration of a vehicle by using a mobile terminal of a user riding in a vehicle to collect information inside the vehicle in real time, and when a sudden acceleration event occurs, generating evidence information of sudden acceleration based on the collected information inside the vehicle and registering it on a cloud server. means of solving the problem

[0008] According to one feature, a method of operating a mobile terminal comprises the steps of: pairing with at least one pedal-capturing camera installed in a vehicle to capture an accelerator pedal and a brake pedal operated by a user; receiving and storing pedal images from the at least one pedal-capturing camera; when a predefined event occurs, extracting images from the pedal images for a certain period of time before and after the occurrence of the predefined event, synchronizing the extracted images with the location information of the mobile terminal over time to generate evidence of sudden acceleration; and transmitting the evidence of sudden acceleration to a cloud server.

[0009] The pairing step includes broadcasting a pairing request signal and, upon receiving a pairing response signal from a near-field communication module of at least one pedal camera, connecting to the near-field communication module that transmitted the pairing response signal, and the near-field communication module can be activated when the vehicle's ignition is turned on.

[0010] Prior to the step of generating the above-mentioned sudden acceleration evidence information, the method further includes the step of receiving surrounding images from at least one vehicle surrounding camera installed at a predetermined location within the vehicle and capturing the surroundings including the front or rear of the vehicle, and the step of generating the above-mentioned sudden acceleration evidence information may generate sudden acceleration evidence information that additionally includes surrounding images synchronized according to the time.

[0011] At least one of the above-mentioned pedal recording camera or the above-mentioned vehicle surrounding recording camera is connected to the vehicle black box via wired or wireless connection, and the pedal video or the surrounding video can be received from the vehicle black box paired with the mobile terminal.

[0012] The step of generating the above-mentioned sudden acceleration evidence information can generate the above-mentioned sudden acceleration evidence information by detecting the occurrence of a sudden acceleration event when the accelerator pedal is not operated, the brake pedal is in an operating state, and the vehicle is not in a deceleration state.

[0013] The step of generating the above-mentioned evidence of sudden acceleration can verify the operating status of the accelerator pedal and the brake pedal by reading the pedal on which the driver's foot is raised and the position of the pedal through image recognition of the pedal image.

[0014] Prior to the step of generating the above-mentioned sudden acceleration evidence information, the method further includes the step of pairing with a pedal signal transmission device connected to an accelerator pedal sensor and a brake pedal sensor, and receiving an accelerator pedal signal corresponding to the operation of the accelerator pedal sensor and a brake pedal signal corresponding to the operation of the brake pedal sensor from the pedal signal transmission device, and the step of generating the above-mentioned sudden acceleration evidence information can verify the operating status of the accelerator pedal and the brake pedal based on the accelerator pedal signal and the brake pedal signal.

[0015] The step of generating the above-mentioned sudden acceleration evidence information can additionally determine whether the vehicle has been impacted, and if an impact occurs to the vehicle, it can detect the occurrence of the above-mentioned sudden acceleration event.

[0016] The step of generating the above-mentioned evidence of sudden acceleration can check the operating status of the accelerator pedal and brake pedal when the vehicle acceleration exceeds a predetermined regulated acceleration.

[0017] Prior to the above pairing step, a step of running a dedicated application for sudden acceleration verification may be further included.

[0018] According to another feature, the sudden acceleration verification system includes at least one pedal imaging camera installed in a vehicle to photograph an accelerator pedal and a brake pedal operated by a user, and a mobile terminal that stores pedal images received from said at least one pedal imaging camera, generates sudden acceleration evidence information by synchronizing images from said pedal images for a certain period before and after the time of occurrence of the said event with location information of said mobile terminal according to time when a predefined event occurs, and transmits said sudden acceleration evidence information to a cloud server.

[0019] The above sudden acceleration verification system further includes at least one vehicle surrounding camera installed at a predetermined location within the vehicle to photograph the surroundings including the front or rear of the vehicle, and the mobile terminal can generate the sudden acceleration evidence information, which additionally includes surrounding images synchronized according to the time.

[0020] The above pedal camera or the above vehicle surrounding camera can perform pairing with the mobile terminal using a short-range communication module that is activated when the vehicle's ignition is turned on.

[0021] The above pedal recording camera or the above vehicle surrounding recording camera is connected to a vehicle black box, and the above mobile terminal is paired with the vehicle black box so that it can receive pedal video or surrounding video through the vehicle black box.

[0022] The mobile terminal can detect that a sudden acceleration event has occurred when the accelerator pedal is not operated, the brake pedal is in an operating state, and the vehicle is not in a deceleration state, and generate the evidence information for the sudden acceleration.

[0023] The above sudden acceleration detection system further includes a pedal signal transmission device that receives pedal signals according to the pedal operation status from the accelerator pedal sensor and the brake pedal sensor, respectively, and transmits them to the paired mobile terminal, and the mobile terminal can check the operation status of the accelerator pedal and the brake pedal based on the pedal signals received from the pedal signal transmission device.

[0024] The mobile terminal can check the operating status of the accelerator pedal and the brake pedal by reading the pedal on which the driver's foot is raised and the position of the pedal through image recognition of the pedal image.

[0025] The mobile terminal can additionally determine whether there is an impact on the vehicle, and if an impact occurs on the vehicle, it can detect the occurrence of the sudden acceleration event.

[0026] The above mobile terminal can check the operating status of the accelerator pedal and brake pedal when the vehicle acceleration exceeds a predetermined regulated acceleration.

[0027] According to another feature, the application installed on a mobile terminal to provide a sudden acceleration verification service may include instructions for pairing with at least one pedal imaging camera installed in a vehicle to capture an accelerator pedal and a brake pedal operated by a user, storing pedal images received from the paired at least one pedal imaging camera, and, when a predefined event occurs, extracting images from the pedal images for a certain period of time before and after the occurrence of the predefined event, synchronizing the extracted images with the location information of the mobile terminal over time to generate sudden acceleration evidence information, and transmitting the sudden acceleration evidence information to a cloud server. Effects of the invention

[0028] According to the present disclosure, even in the case of sudden acceleration caused by a malfunction of a vehicle system such as an ECU (Electronic Control Unit), objective data can be provided using a mobile terminal separate from the vehicle system to prove that sudden acceleration occurred independently of the driver's operation at the time the sudden acceleration accident occurred. Brief explanation of the drawing

[0029] FIG. 1 is a schematic block diagram of a mobile terminal and its surrounding environment for confirming sudden acceleration according to one embodiment. FIG. 2 is a flowchart illustrating a procedure for confirming sudden acceleration using a mobile terminal according to one embodiment. FIG. 3 is an example of the configuration of evidence information for sudden acceleration according to one embodiment. Figure 4 is an example illustrating the time synchronization of the sudden acceleration evidence information of Figure 3. Figure 5 is an example diagram showing S113 of Figure 4 in detail. Figure 6 is a flowchart showing S208 of Figure 5 in detail. FIG. 7 is a schematic block diagram of a mobile terminal and its surrounding environment for confirming sudden acceleration according to another embodiment. FIG. 8 is a schematic block diagram of a mobile terminal and its surrounding environment for confirming sudden acceleration according to another embodiment. FIG. 9 is a schematic block diagram of a mobile terminal and its surrounding environment for confirming sudden acceleration according to another embodiment. FIG. 10 is a flowchart illustrating a sudden acceleration verification procedure according to the embodiment of FIG. 9. FIG. 11 is a block diagram showing the hardware configuration of a computing device according to one embodiment. Specific details for implementing the invention

[0030] Embodiments of the present disclosure are described below with reference to the attached drawings so that those skilled in the art can easily implement them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. Furthermore, in order to clearly explain the present disclosure in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the specification are denoted by similar reference numerals.

[0031] Throughout the specification, when a part is described as "including" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components.

[0032] Additionally, terms such as “…part,” “…unit,” and “…module” described in the specification refer to a unit that processes at least one function or operation, and this may be implemented in hardware, software, or a combination of hardware and software.

[0033] In this specification, "transmission or provision" may include not only direct transmission or provision but also indirect transmission or provision through another device or by using an alternative route.

[0034] Expressions described in the singular in this specification may be interpreted as singular or plural unless explicit expressions such as "one" or "single" are used.

[0035] In this specification, the same reference numeral refers to the same component regardless of the drawing, and "and / or" includes each of the mentioned components and all combinations of one or more.

[0036] In this specification, terms including ordinal numbers, such as first, second, etc., may be used to describe various components, but said components are not limited by said terms. Such terms are used solely for the purpose of distinguishing one component from another. For example, without departing from the scope of the present disclosure, the first component may be named the second component, and similarly, the second component may be named the first component.

[0037] In the flowchart described with reference to the drawings in this specification, the order of operations may be changed, several operations may be merged or some operations may be divided, and certain operations may not be performed.

[0039] FIG. 1 is a schematic block diagram of a mobile terminal and its surrounding environment for confirming sudden acceleration according to one embodiment.

[0040] Referring to FIG. 1, the mobile terminal (100) is paired with a pedal shooting camera (201) and a vehicle surrounding shooting camera (202), and is connected to a cloud server (400) via a network (300).

[0041] The mobile terminal (100) transmits the sudden acceleration evidence information generated based on the pedal image received from the pedal shooting camera (201) and the vehicle surrounding image received from the vehicle surrounding shooting camera (202) to the cloud server (400) when a predefined event occurs.

[0042] The mobile terminal (100) is a user terminal carried by the vehicle driver or a passenger in the vehicle. The mobile terminal (100) is a terminal that can be carried by the user, such as a smartphone or a tablet PC, and is capable of mobile communication and the download, installation, and execution of applications.

[0043] A mobile terminal (100) is equipped with a dedicated application for sudden acceleration, and the operation of the present disclosure can be performed while the dedicated application for sudden acceleration is running.

[0044] When a vehicle driver or a vehicle passenger boards the vehicle, they run a dedicated application for sudden acceleration. When the dedicated application for sudden acceleration is executed, the mobile terminal (100) can connect to a cloud server (400) through login authentication using a user account (e.g., ID / password) to prepare for the operation of the present disclosure.

[0045] The application dedicated to sudden acceleration can provide login / logout functions, camera search functions, save options, transfer options, and file management functions.

[0046] The login / logout function is a function for accessing the cloud server (400).

[0047] The camera search function is a function that searches for cameras (201, 202) capable of short-range wireless communication in order to pair with cameras (201, 202).

[0048] The save options function allows you to set resolution (compression rate) options for pedal footage and vehicle surroundings footage, as well as file size options for pedal footage, vehicle surroundings footage, and sudden acceleration evidence information.

[0049] The transmission option function is a feature that sets transmission options, such as near-real-time transmission or selective transmission of sudden acceleration evidence information.

[0050] The file management function is capable of managing files such as pedal video files, vehicle surroundings video files, and vehicle location / time information files, including saving and deleting them.

[0051] When the application dedicated to sudden acceleration is running, the mobile terminal (100) is paired with the pedal shooting camera (201) and the vehicle surrounding shooting camera (202).

[0052] A pedal camera (201) is installed facing the pedals in a position close to the driver's pedals inside the driver's seat, namely the accelerator pedal and the brake pedal, and photographs the pedals.

[0053] The pedal shooting camera (201) may be an infrared (IR, Infrared Radiation) camera.

[0054] The pedal camera (201) is installed in a position where it can photograph both the accelerator pedal and the brake pedal, so that it can photograph both the accelerator pedal and the brake pedal at once.

[0055] Alternatively, the pedal shooting camera (201) may be composed of a camera that shoots the accelerator pedal and a camera that shoots the brake pedal, and the accelerator pedal and the brake pedal may be shot separately with individual cameras.

[0056] Since the pedal recording camera (201) is basically equipped with a microphone, it can generate pedal video that includes not only video but also indoor voice and sound generated in the vehicle. This pedal video is transmitted in real time to a mobile terminal (100) paired with the pedal recording camera (201).

[0057] The vehicle surrounding camera (202) is installed facing the front and rear of the vehicle to capture images of the vehicle surroundings, namely images of the front and rear of the vehicle. Since the vehicle surrounding camera (202) also basically includes a microphone, it can generate images of the vehicle surroundings that include not only video but also indoor voice / sound and ambient sounds. These images of the vehicle surroundings are transmitted in real time to a mobile terminal (100) paired with the vehicle surrounding camera (202).

[0058] The pedal shooting camera (201) and the vehicle surrounding shooting camera (202) may be equipped with a vehicle power (e.g., DC 12 / 24V) connection terminal. The pedal shooting camera (201) and the vehicle surrounding shooting camera (202) may be connected to the vehicle's starting power through the vehicle power connection terminal to receive power. When the vehicle's starting power is turned on, the pedal shooting camera (201) and the vehicle surrounding shooting camera (202) may be operated to start shooting and may be paired with a mobile terminal (100).

[0059] At this time, the pedal camera (201) and the vehicle surrounding camera (202) may include a short-range communication module that is activated when the vehicle is started. When the vehicle is started, the short-range communication module is activated, and through the activated short-range communication module, the pedal camera (201) and the vehicle surrounding camera (202) can be paired with a mobile terminal (100).

[0060] Here, the short-range communication module may include a Bluetooth module, a Wi-Fi module, etc.

[0061] The pedal shooting camera (201) and the vehicle surrounding shooting camera (202) can support resolutions such as HD (High Definition), FHD (Full HD), and 4K.

[0062] The mobile terminal (100) measures the terminal location in real time using a GPS (Global Positioning System) positioning method or a cell positioning method, and sets the measured terminal location as the vehicle location. At this time, the time of the mobile terminal (100) is set as the reference time.

[0063] When a predefined event occurs, the mobile terminal (100) can extract video from the pedal video for a certain period of time before and after the occurrence of the predefined event, and generate sudden acceleration evidence information by synchronizing the extracted video with the location information of the mobile terminal over time. The sudden acceleration evidence information generated in this way can be stored in the mobile terminal (100) and transmitted to the cloud server (400).

[0064] At this time, sudden acceleration information can be transmitted automatically when an event occurs or manually based on user input.

[0065] The pedal video and vehicle surrounding video are transmitted to the mobile terminal (100) in real time and temporarily stored in a temporary memory space, and can be automatically deleted after a certain period of time if the vehicle engine is turned off without an event occurring.

[0066] At this time, if the mobile terminal (100) is not paired with the pedal shooting camera (201) and the vehicle surrounding shooting camera (202) and is not paired again even after a certain period of time has elapsed, it can recognize that the vehicle engine is turned off.

[0067] Predefined events may include sudden acceleration events. A sudden acceleration event may be defined to occur when a combination of at least one of the following conditions is met: vehicle acceleration, the operating state of the accelerator / brake pedal, and whether the vehicle is impacted.

[0068] Additionally, predefined events may include user input events. A dedicated application for sudden acceleration may display stored pedal footage and vehicle surrounding footage on the screen at unit intervals and provide an interface for user selection. User input events may be defined to occur when the user inputs or selects cloud transmission of the selected footage through this interface.

[0069] The network (300) may include mobile communication networks such as 3G, LTE (Long Term Evolution), and 5G.

[0070] The cloud server (400) can provide user management functions, user-specific storage space management functions, and video file download functions through a web UI.

[0071] For security purposes, the mobile terminal (100) encrypts the sudden acceleration evidence information to prevent distortion and transmits it to the cloud server (400), and the cloud server (400) decrypts the encrypted sudden acceleration evidence information and stores it in a secure storage that only authorized users can access.

[0072] According to the description above, when the driver starts the vehicle, power is supplied to the pedal camera (201) and the vehicle surrounding camera (202), and the short-range wireless communication module of the pedal camera (201) and the vehicle surrounding camera (202) can be activated.

[0073] A mobile terminal (100) executes a dedicated application for sudden acceleration based on user input from a driver or passenger to search for and pair cameras (201, 202) located in close proximity. At this time, the mobile terminal (100) displays the discovered cameras (201, 202) on the application screen and can perform pairing with a camera selected by the user or perform automatic pairing.

[0074] The mobile terminal (100) can display pedal video and vehicle surrounding video received from paired cameras (201, 202) on an application screen so that the user can view them.

[0075] The mobile terminal (100) can synchronize two channels to receive video from paired cameras (201, 202) and map the time and the vehicle location and vehicle speed at that time to the synchronized video and store them accumulated by time.

[0076] When a predefined event occurs, the mobile terminal (100) can generate evidence of sudden acceleration based on accumulated video and transmit it to a cloud server (400) according to a cloud file transfer option.

[0077] The mobile terminal (100) can automatically select a video accumulated from the time the event occurred up to a certain point in the past, or generate evidence information of sudden acceleration based on a video selected by the user.

[0078] The procedure for confirming sudden acceleration using a mobile terminal (100) will be explained in detail with reference to FIG. 2.

[0080] FIG. 2 is a flowchart showing a procedure for confirming sudden acceleration using a mobile terminal according to one embodiment, FIG. 3 is an example of the configuration of evidence information for sudden acceleration according to one embodiment, and FIG. 4 is an example explaining the time synchronization of the evidence information for sudden acceleration of FIG. 3.

[0081] At this time, the same reference numerals are used to describe the configuration in conjunction with Fig. 1.

[0082] Referring to FIG. 2, a mobile terminal (100) executes a sudden acceleration dedicated application (S101) and connects to a cloud server (400) (S102).

[0083] At this time, when a dedicated application for sudden acceleration is executed (S101) according to user input, the mobile terminal (100) can connect to the cloud server (400), go through procedures such as logging in, and then connect to the cloud server (400) (S102).

[0084] When the vehicle is started, the vehicle start power is applied, and the pedal shooting camera (201) and the vehicle surrounding shooting camera (202) have their short-range communication modules activated (S103).

[0085] The mobile terminal (100) broadcasts a discovery signal to search for cameras in close proximity (S104, S105).

[0086] The pedal shooting camera (201) and the vehicle surrounding shooting camera (202), with the short-range communication module activated, transmit a response signal to the discovery signal (S106, S107).

[0087] At this time, the application dedicated to sudden acceleration can register identifiers for the pedal camera (201) and the vehicle surrounding camera (202) prior to initial pairing. The registration of identifiers can be based on user input. That is, the user can input the identifiers for the pedal camera (201) and the vehicle surrounding camera (202) into the UI provided by the application dedicated to sudden acceleration.

[0088] In S104 and S105, a discovery signal containing a registered identifier can be broadcast. Each camera (201, 202) can transmit a response signal if the identifier included in the discovery signal is its own identifier (S106, S107).

[0089] Alternatively, even if each camera (201, 202) transmits a response signal for the discovery signal, the mobile terminal (100) may select only the response signal containing the same identifier as the identifier included in each discovery signal as the response signal for pairing.

[0090] The mobile terminal (100) is paired with a pedal shooting camera (201) and a vehicle surrounding shooting camera (202) (S108, S109).

[0091] The mobile terminal (100) synchronizes two channels with the pedal shooting camera (201) and the vehicle surrounding shooting camera (202) to collect pedal images and vehicle surrounding images in real time (S110). The pedal images and vehicle surrounding images can be received in fixed FPS (Frames Per Second) units.

[0092] The mobile terminal (100) sets the terminal location, terminal speed, and terminal time as the vehicle location, vehicle acceleration, and time (S111). Here, the terminal speed is calculated through the change in terminal location.

[0093] The mobile terminal (100) synchronizes the pedal image, vehicle surrounding image, vehicle location, and vehicle acceleration collected in S110 over time and stores them in chronological order (S112).

[0094] When a predefined event occurs, the mobile terminal (100) generates evidence of sudden acceleration based on information stored according to a cloud transmission option (S113). For example, if the predefined event is a sudden acceleration event, it can generate evidence of sudden acceleration including pedal video, vehicle surrounding video, vehicle location, and vehicle acceleration stored (S112) before and after the time of the sudden acceleration event (S113).

[0095] In addition, if the predefined event is a user input event, the user can generate evidence of sudden acceleration based on the image selected by the user from among the pedal image and the vehicle surrounding image displayed on the UI of the application dedicated to sudden acceleration, the vehicle position mapped at the same time as the image, and the vehicle acceleration (S113).

[0096] Referring to FIG. 3, the evidence of sudden acceleration may include a front view of the vehicle, a video of the vehicle's accelerator pedal, a video of the vehicle's brake pedal, audio recorded inside the vehicle, vehicle time information, vehicle location information, and vehicle acceleration information. The audio inside the vehicle may be recorded through a microphone activated when a dedicated application for sudden acceleration is executed on a mobile terminal (100). Additionally, the audio inside the vehicle may be recorded through a black box (500 in FIG. 7 and 8) paired with the mobile terminal (100) and transmitted to the mobile terminal (100).

[0097] The mapping relationship of the information in Fig. 3 is as shown in Fig. 4.

[0098] Referring to Fig. 4, the collected front video, pedal video, interior audio, location information, and speed are synchronized over time.

[0099] Multiple images of the vehicle's front view and acceleration / brake pedals are included in the sudden acceleration evidence information in predetermined frame units.

[0100] The indoor voice is recorded over a continuous entire time interval and included in the evidence information for sudden acceleration. It may be an audio signal input through the microphone of the mobile terminal (100).

[0101] The entire time interval can be set to the period extending from the time the event occurred to a certain point in the past.

[0102] Location information and speed information are set as location and speed values ​​for each predetermined peak point (e.g., 100km, 150km, 190km) and the point where the vehicle stopped (0km), and are synchronized with the time information of each point to be included in the evidence information for sudden acceleration.

[0103] Again, referring to FIG. 2, the mobile terminal (100) transmits the generated sudden acceleration evidence information to the cloud server (400) (S114). Here, the transmission may be manual transmission or automatic transmission depending on user input.

[0104] The cloud server (400) can store the received sudden acceleration evidence information in a secure storage (S115). At this time, the sudden acceleration evidence information is stored in the secure storage by matching it with the user account or mobile terminal identifier verified during the login process in S102, and access can be allowed to the authenticated user based on the user account or mobile terminal identifier.

[0106] Figure 5 is an example diagram showing S113 of Figure 4 in detail.

[0107] Referring to FIG. 5, when the vehicle is started and driving begins, the mobile terminal (100) monitors the vehicle acceleration (S201).

[0108] Here, the ignition of the vehicle can be confirmed based on whether it is paired with the pedal camera (201) and the vehicle surrounding camera (202). Since the pedal camera (201) and the vehicle surrounding camera (202) are driven by the vehicle ignition power and include a short-range wireless communication module that is activated when power is supplied, the fact that they are paired can be determined as the vehicle ignition being turned on.

[0109] In addition, driving status can be determined by whether the vehicle has started driving when the change in acceleration has a value greater than 0.

[0110] The mobile terminal (100) determines whether the vehicle acceleration exceeds the regulated speed by monitoring the vehicle acceleration (S202).

[0111] Here, the speed limit can be set based on the vehicle's location information, either as the speed limit set on the road where the vehicle is currently located or as a certain range above the speed limit set on the road.

[0112] In addition, the regulated speed may be a preset speed that triggers the sudden acceleration verification procedure. For example, the vehicle acceleration of accidents suspected of being sudden acceleration incidents may be set to the regulated speed.

[0113] If the mobile terminal (100) determines that the vehicle acceleration is below the regulated speed in S202, it returns to the state before S202. That is, the mobile terminal (100) continues to monitor whether the vehicle acceleration exceeds the regulated speed.

[0114] If the mobile terminal (100) determines in S202 that the vehicle acceleration exceeds the regulated speed, it determines whether the accelerator pedal is in an active state (S203).

[0115] If the mobile terminal (100) determines in S203 that the accelerator pedal is not in an operating state, it determines whether the brake pedal is in an operating state (S204).

[0116] In S204, the mobile terminal (100) can use image recognition technology to analyze the pedal image received from the pedal shooting camera (201) to determine whether the driver's foot is placed on the brake pedal or the accelerator pedal, or whether the brake pedal or the accelerator pedal is pressed, thereby confirming the operation state of the pedal.

[0117] If the mobile terminal (100) determines in S204 that the brake pedal is not in an operating state, it determines that it is a normal operation (S105). Here, a normal operation indicates that it is not a state requiring confirmation of sudden acceleration.

[0118] When the mobile terminal (100) determines that the accelerator pedal is in an operating state in S203, it determines that it is a normal operation (S205).

[0119] Meanwhile, if the mobile terminal (100) determines that the brake pedal is in an operating state in S204, it checks the change in vehicle acceleration through the change in the vehicle position at the current time (S206).

[0120] The mobile terminal (100) determines whether the vehicle is in a deceleration state based on the result of checking S206 (S207).

[0121] If the mobile terminal (100) is determined to be in a deceleration state at S207, it is determined to be in normal operation (S205).

[0122] If the mobile terminal (100) determines in S207 that it is not in a deceleration state, it detects the occurrence of a sudden acceleration event (S208).

[0123] The mobile terminal (100) generates sudden acceleration evidence information including front video, pedal video, sound including interior voice, location information, and speed information selected according to cloud transmission options (S209).

[0124] The mobile terminal (100) transmits the sudden acceleration evidence information generated in S209 to the cloud server (400) (S210).

[0126] Figure 6 is a flowchart showing S208 of Figure 5 in detail.

[0127] Referring to FIG. 6, when the mobile terminal (100) recognizes that the brake pedal is in an operating state but the speed is not decelerating (S301), it determines whether a collision of the vehicle has occurred (S302).

[0128] In S302, the mobile terminal (100) can detect whether a collision of a vehicle has occurred by detecting an impact applied to the mobile terminal (100) through a built-in impact detection sensor. Alternatively, the mobile terminal (100) can detect an impact applied to the mobile terminal (100) through a sudden change in speed and a change in attitude detected through a gyroscope sensor, etc. Since various known technologies are used for such impact detection by the mobile terminal (100), it is not limited to a specific method.

[0129] When the mobile terminal (100) is located in a vehicle, the mobile terminal (100) is set based on the amount of impact detected by the mobile terminal (100) when there is an impact on the vehicle, and the mobile terminal (100) can detect whether a collision has occurred in the vehicle according to the set standard.

[0130] If the mobile terminal (100) determines that no collision of the vehicle occurred in S302, it detects the occurrence of a sudden acceleration estimated event (S303).

[0131] When the mobile terminal (100) determines that a collision of vehicles has occurred in S302, it detects the occurrence of a sudden acceleration determination event (S304).

[0133] FIG. 7 is a schematic block diagram of a mobile terminal and its surrounding environment for confirming sudden acceleration according to another embodiment.

[0134] At this time, since the configuration of FIG. 7 is similar to the configuration / operation described in FIG. 1 to 6, it will be explained mainly in terms of other embodiments.

[0135] Referring to FIG. 7, the mobile terminal (100) is directly paired with the pedal recording camera (201). The mobile terminal (100) is paired with the vehicle surrounding recording camera (202) and the black box (500) which is wired or wirelessly connected. Accordingly, the vehicle surrounding video transmitted from the vehicle surrounding recording camera (202) is transmitted to the mobile terminal (100) through the black box (500).

[0136] A mobile terminal (100) can be paired with a black box (500) that transmits a response signal to a broadcasted discovery signal, as described in FIGS. 1 to 6.

[0137] At this time, the mobile terminal (100) transmits a discovery signal containing an initially entered black box identifier, and when a response signal containing a black box identifier is received, it can be paired with the corresponding black box (500).

[0138] Alternatively, the mobile terminal (100) may display black box information that has transmitted a response signal on the screen, and when a user selection is entered, it may be paired with the corresponding black box (500).

[0139] Additionally, since the mobile terminal (100) is connected to the black box (500), it can receive information from the black box (500), such as whether the vehicle is started, whether it is driving, the vehicle's location, the vehicle's acceleration, and whether a vehicle impact has occurred. Based on the information received from the black box (500), the mobile terminal (100) can detect the occurrence of a sudden acceleration event as described in FIGS. 5 and FIGS. 6.

[0140] Here, the black box (500) can detect whether the engine is on or off based on the type of power connection. Since the black box (500) must be operated at all times, when the vehicle's engine is off, it is connected to the vehicle's battery and receives battery power. And when the vehicle's engine is on, the black box (500) receives ACC power. Therefore, the power supply line of the black box (500) is a cable connected to the battery when the vehicle's engine is off, and switches to the vehicle's ACC power cable when the vehicle's engine is on. The black box (500) can determine the engine status of the vehicle by identifying the type of black box power connection, that is, the line to which power is supplied.

[0141] The black box (500) can detect whether the vehicle is driving by changing the vehicle's location / speed via GPS and transmit the driving detection information to the mobile terminal (100).

[0142] The black box (500) can be connected to an impact sensor installed in a suitable location in the vehicle or an impact sensor linked to the driver's seat airbag to check for impacts occurring in the vehicle body, but is not limited to this, and various technologies can be used for the black box (500) to detect impacts occurring in the vehicle.

[0143] Additionally, the black box (500) can be connected to the vehicle's OBD terminal using an OBD (On Board Diagnostics)-II communication line to check the vehicle's ignition on / off status from the vehicle's OBD terminal, and generate an ignition detection signal based on the checked ignition on / off status and transmit it to the mobile terminal (100). The black box (500) can detect whether the vehicle is driving through the vehicle's speed information or driving status information obtained from the vehicle's OBD terminal and transmit a driving detection signal to the mobile terminal (100). The black box (500) can check for an impact on the vehicle body from the vehicle's OBD terminal using an OBD-II communication line and transmit an impact detection signal to the mobile terminal (100).

[0144] Additionally, when the black box (500) is operating normally, it can derive the driver's speed pattern using an artificial intelligence model based on the driver's driving information obtained from the vehicle's OBD terminal or the vehicle's speed change information measured by the black box (500). The artificial intelligence model may be installed on an external server, and the black box (500) collects driving information or vehicle speed change information and transmits it to the external server whenever the vehicle's engine is turned off, and the external server can derive the driver's speed pattern through the collected information and transmit it to the black box (500). Furthermore, the regulated speed for detecting sudden acceleration events may be set to a speed that deviates from the driver's speed pattern.

[0146] FIG. 8 is a schematic block diagram of a mobile terminal and its surrounding environment for confirming sudden acceleration according to another embodiment.

[0147] At this time, descriptions that overlap with the embodiments of FIGS. 1 to 6 and FIG. 7 will be omitted, and descriptions will focus on other embodiments.

[0148] Referring to FIG. 8, both the pedal recording camera (201) and the vehicle surrounding recording camera (202) are connected to the black box (500) via wired or wireless connections, and the mobile terminal (100) is paired with the black box (500). The mobile terminal (100) receives pedal video and vehicle surrounding video through the black box (500).

[0149] In addition, as described in FIG. 7, the mobile terminal (100) can receive information from the black box (500), such as whether the vehicle is started, whether it is driving, the vehicle's location, the vehicle's acceleration, and whether a vehicle impact has occurred. Based on the information received from the black box (500), the mobile terminal (100) can detect the occurrence of a sudden acceleration event as described in FIG. 5 and FIG. 6.

[0151] FIG. 9 is a schematic block diagram of a mobile terminal and its surrounding environment for confirming sudden acceleration according to another embodiment.

[0152] At this time, descriptions that overlap with the embodiments of FIGS. 1 to 6 will be omitted, and descriptions will focus on other embodiments.

[0153] Referring to FIG. 9, the pedal shooting camera (201) and the vehicle surrounding shooting camera (202) are paired with the mobile terminal (100), so the operation of the mobile terminal (100) is the same as described in FIG. 1 to FIG. 6.

[0154] Additionally, the mobile terminal (100) is paired with a pedal signal transmission device (601), and the pedal signal transmission device (601) can be wired or wirelessly connected to the vehicle's accelerator pedal sensor (APS) (602) and brake pedal sensor (BPS) (603).

[0155] The pedal signal transmission device (601) can check the operating status of the brake pedal and the accelerator pedal based on pedal signals received from the brake pedal sensor (BPS) (603) and the accelerator pedal sensor (APS) (602). The pedal signal transmission device (601) can receive an accelerator pedal signal generated when the driver presses the accelerator pedal from the accelerator pedal sensor (602), and receive a brake pedal signal generated when the driver presses the brake pedal from the brake pedal sensor (603).

[0156] The pedal signal transmission device (601) transmits the received accelerator pedal signal and brake pedal signal to the mobile terminal (100). Based on the pedal signals received from the pedal signal transmission device (601), the mobile terminal (100) determines the pedal operation status and uses this to detect the occurrence of the sudden acceleration event described in FIGS. 5 and FIGS. 6.

[0157] Additionally, according to another embodiment, as in the embodiment of FIG. 7, the pedal shooting camera (201) may be directly paired with the mobile terminal (100), and the vehicle surrounding shooting camera (202) may be paired with the black box (500). At this time, the pedal operation status is determined based on the pedal signal received from the pedal signal transmission device (601), and the remaining configuration may be the same as described in FIG. 1 to 7.

[0158] Additionally, according to another embodiment, as in the embodiment of FIG. 8, the pedal recording camera (201) and the vehicle surrounding recording camera (202) can be paired with the black box (500). In this case, the pedal operation status is determined based on the pedal signal received from the pedal signal transmission device (601), and the remaining configuration may be the same as described in FIG. 1 to 8.

[0159] Additionally, the pedal recording camera (201), the vehicle surrounding recording camera (202), and the pedal signal transmission device (601) are all connected to the black box (500), and the mobile terminal (100) can be paired with the black box (500). At this time, the pedal operation status is determined based on the pedal signal received from the pedal signal transmission device (601), and the remaining configuration may be the same as described in FIGS. 1 to 8.

[0161] FIG. 10 is a flowchart illustrating a sudden acceleration verification procedure according to the embodiment of FIG. 9.

[0162] At this time, descriptions that overlap with the embodiments of FIGS. 1 to 8 will be briefly explained, and descriptions will focus on other embodiments.

[0163] Referring to FIG. 10, a mobile terminal (100) executes a sudden acceleration dedicated application (S401) and connects to a cloud server (400) (S402).

[0164] At this time, when a dedicated application for sudden acceleration is executed (S401) according to user input, the mobile terminal (100) can connect to the cloud server (400), go through procedures such as logging in, and then connect to the cloud server (400) (S402).

[0165] When the vehicle is started, the vehicle start power is applied, and the pedal shooting camera (201) and the vehicle surrounding shooting camera (202) have their short-range communication modules activated (S403).

[0166] The mobile terminal (100) is paired with the pedal shooting camera (201) and the vehicle surrounding shooting camera (202) through a procedure of searching for nearby devices (S404, S405).

[0167] In addition, when the pedal signal transmission device (601) also starts operating (S406) by applying vehicle ignition power, it is paired with the mobile terminal (100) through a procedure of searching for peripheral devices of the mobile terminal (100) (S407).

[0168] At this time, the pairing procedure (S404, S405, S407) is the same as the pairing procedure described in FIG. 2, so a detailed explanation is omitted.

[0169] The mobile terminal (100) is 2-channel synchronized with the pedal shooting camera (201) and the vehicle surrounding shooting camera (202) to collect pedal video and vehicle surrounding video in real time (S408). The collected videos can be received at a fixed FPS rate.

[0170] The pedal signal transmission device (601) can receive an acceleration pedal signal and a brake pedal signal according to the pedal state sensed from the acceleration pedal sensor (602) and the brake pedal sensor (603), respectively (S409, S410).

[0171] The pedal signal transmission device (601) transmits the received accelerator pedal signal and brake pedal signal (S409, S410) to the paired mobile terminal (100) (S411).

[0172] At this time, the accelerator pedal signal and the brake pedal signal may be transmitted upon request from the mobile terminal (100), or may be transmitted immediately to the mobile terminal (100) whenever S409 and S410 are performed.

[0173] The mobile terminal (100) sets the terminal location, terminal speed, and terminal time to the vehicle location, vehicle acceleration, and time (S412).

[0174] The mobile terminal (100) synchronizes the pedal image and vehicle surrounding image collected in S408 with the vehicle location and vehicle acceleration over time and stores them in chronological order (S413).

[0175] The mobile terminal (100) can detect the occurrence of a sudden acceleration event described in FIGS. 5 and FIGS. 6 based on the pedal video, vehicle surrounding video, vehicle location, vehicle acceleration, time, and pedal signals collected in S408 (S414).

[0176] The mobile terminal (100) generates evidence of sudden acceleration based on the information stored in S413 according to the cloud transmission option (S415) and transmits it to the cloud server (400) (S416).

[0177] Additionally, the mobile terminal (100) can generate evidence of sudden acceleration based on multiple viewpoint images (pedal images and vehicle surrounding images) selected by the user from among the images displayed on the UI of the sudden acceleration dedicated application according to the user input event in S414, and the vehicle position and vehicle acceleration synchronized with the images.

[0178] The cloud server (400) can store the sudden acceleration evidence information received from the mobile terminal (100) in a secure storage (S417).

[0180] Meanwhile, FIG. 11 is a block diagram showing the hardware configuration of a computing device according to one embodiment.

[0181] Referring to FIG. 11, the mobile terminal (100) described in FIG. 1 to FIG. 10 may be a computing device (700) operated by at least one processor.

[0182] A computing device (700) may include one or more processors (710), a memory (720) for loading a program executed by the processor (710), a storage device (730) for storing the program and various data, a communication interface (740), an external device (750), and a bus (760) connecting them. In addition, the computing device (700) may include various additional components. A program may include instructions that cause the processor (710) to perform a method / operation according to various embodiments of the present disclosure when loaded into the memory (720). That is, the processor (710) may perform a method / operation according to various embodiments of the present disclosure by executing instructions. An instruction refers to a series of computer-readable instructions grouped by function, which are components of a computer program and are executed by a processor.

[0183] The processor (710) controls the overall operation of each component of the computing device (700). The processor (710) may be configured to include at least one of a CPU (Central Processing Unit), MPU (Micro Processor Unit), MCU (Micro Controller Unit), GPU (Graphic Processing Unit), or any form of processor well known in the art of the present disclosure. Additionally, the processor (710) may perform operations for at least one application or program for executing a method / operation according to various embodiments of the present disclosure.

[0184] The memory (720) stores various data, commands and / or information. The memory (720) may load one or more programs from the storage device (730) to execute a method / operation according to various embodiments of the present disclosure. The memory (720) may be implemented as a volatile memory such as RAM, but the technical scope of the present disclosure is not limited thereto.

[0185] The storage device (730) may store a program non-temporarily. The storage device (730) may be configured to include non-volatile memory such as ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), flash memory, a hard disk, a removable disk, or any form of computer-readable recording medium well known in the art to which this disclosure belongs.

[0186] The communication interface (740) supports wired and wireless communication of the computing device (700). To this end, the communication interface (740) may be configured to include a communication module well known in the art of the present disclosure.

[0187] The external device (750) may include a short-range communication module that performs a procedure to discover and pair peripheral devices.

[0188] The bus (760) provides communication functions between components of the computing device (700). The bus (760) can be implemented as various types of buses, such as an address bus, a data bus, and a control bus.

[0190] As described above, when a sudden acceleration is determined, the sudden acceleration evidence information can be generated based on the information collected from the vehicle at that time and registered on the cloud server (400), so that it can be provided as objective data to prove the sudden acceleration accident in the future.

[0192] Although embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements by those skilled in the art using the basic concept of the present invention as defined in the following claims also fall within the scope of the present invention.

Claims

Claim 1 A method of operating a mobile terminal, comprising the steps of: receiving pedal images and surrounding images in real time from at least one pedal camera installed in a vehicle to photograph an accelerator pedal and a brake pedal operated by a user, and at least one vehicle surrounding camera installed at a predetermined location within the vehicle to photograph the surroundings including the front or rear of the vehicle; synchronizing the pedal images and surrounding images based on time to store them as synchronized images; setting location information and speed information of the mobile terminal calculated based on the change in location of the mobile terminal as vehicle location information and vehicle speed information; when a predefined event occurs, extracting a synchronized image corresponding to a certain period of time before and after the time of occurrence of the event from the stored synchronized images; generating sudden acceleration evidence information by synchronizing the extracted synchronized images and the vehicle location information and vehicle speed information corresponding to the time of the synchronized images according to time; and transmitting the sudden acceleration evidence information to a cloud server. Claim 2 A method according to claim 1, further comprising, prior to the receiving step, a step of broadcasting a pairing request signal and, upon receiving a pairing response signal from each of the pedal shooting camera and the vehicle surrounding shooting camera's short-range communication modules, connecting to each of the short-range communication modules that transmitted the pairing response signal, wherein each of the short-range communication modules is activated when the vehicle's ignition is turned on. Claim 3 delete Claim 4 A method according to paragraph 2, wherein at least one of the pedal recording camera or the vehicle surrounding recording camera is connected to the vehicle black box via wired or wireless connection, and the pedal video or the surrounding video is received from the vehicle black box paired with the mobile terminal. Claim 5 In paragraph 2, the step of generating the sudden acceleration evidence information is a method of generating the sudden acceleration evidence information by detecting that a sudden acceleration event has occurred when the accelerator pedal is not operated, the brake pedal is in an operating state, and the vehicle is not in a deceleration state. Claim 6 In paragraph 5, the step of generating the above-mentioned sudden acceleration evidence information is a method of confirming the operating status of the accelerator pedal and the brake pedal by reading the pedal on which the driver's foot is placed and the position of the pedal through image recognition of the above-mentioned pedal image. Claim 7 In claim 5, prior to the step of generating the sudden acceleration evidence information, the method further comprises the step of pairing with a pedal signal transmission device connected to an accelerator pedal sensor and a brake pedal sensor, and receiving an accelerator pedal signal according to the operation of the accelerator pedal sensor and a brake pedal signal according to the operation of the brake pedal sensor from the pedal signal transmission device, wherein the step of generating the sudden acceleration evidence information is to verify the operating state of the accelerator pedal and the brake pedal based on the accelerator pedal signal and the brake pedal signal. Claim 8 In paragraph 5, the step of generating the above-mentioned sudden acceleration evidence information is a method of additionally determining whether there is an impact on the vehicle and detecting the occurrence of the above-mentioned sudden acceleration event if an impact on the vehicle occurs. Claim 9 In paragraph 8, the step of generating the above-mentioned sudden acceleration evidence information is a method of checking the operating status of the accelerator pedal and the brake pedal when the vehicle acceleration exceeds a predetermined regulated acceleration. Claim 10 A method according to claim 9, further comprising the step of running a dedicated application for sudden acceleration verification prior to the above-mentioned connecting step. Claim 11 A sudden acceleration verification system comprising: at least one pedal camera installed in a vehicle to photograph an accelerator pedal and a brake pedal operated by a user; at least one vehicle surrounding camera installed at a predetermined location within the vehicle to photograph the surroundings including the front or rear of the vehicle; and a mobile terminal connected to the pedal camera and the vehicle surrounding camera; wherein the mobile terminal synchronizes pedal images and surrounding images received in real time from the pedal camera and the vehicle surrounding camera based on time to store them as synchronized images; sets location information and speed information of the mobile terminal calculated based on the position change of the mobile terminal as vehicle location information and vehicle speed information; when a predefined event occurs, extracts a synchronized image corresponding to a certain period of time before and after the time of occurrence of the event from the stored synchronized images; generates sudden acceleration evidence information by synchronizing the extracted synchronized images and the vehicle location information and vehicle speed information corresponding to the time of the synchronized images over time; and transmits the sudden acceleration evidence information to a cloud server. Claim 12 delete Claim 13 In claim 11, the pedal camera or the vehicle surrounding camera performs pairing with the mobile terminal using a short-range communication module that is activated when the vehicle's ignition is turned on, in a sudden acceleration confirmation system. Claim 14 In claim 11, the pedal recording camera or the vehicle surrounding recording camera is connected to a vehicle black box, and the mobile terminal is paired with the vehicle black box to receive pedal video or surrounding video through the vehicle black box, a sudden acceleration confirmation system. Claim 15 In claim 11, the mobile terminal detects that a sudden acceleration event has occurred when the accelerator pedal is not operated, the brake pedal is in an operating state, and the vehicle is not in a deceleration state, and generates the sudden acceleration evidence information, a sudden acceleration confirmation system. Claim 16 In claim 15, the sudden acceleration confirmation system further includes a pedal signal transmission device that receives pedal signals according to the pedal operation status from an accelerator pedal sensor and a brake pedal sensor, respectively, and transmits them to the paired mobile terminal, wherein the mobile terminal checks the operation status of the accelerator pedal and the brake pedal based on the pedal signals received from the pedal signal transmission device. Claim 17 In paragraph 15, the mobile terminal is a sudden acceleration confirmation system that checks the operating status of the accelerator pedal and the brake pedal by reading the pedal on which the driver's foot is raised and the position of the pedal through image recognition of the pedal image. Claim 18 In claim 17, the mobile terminal additionally determines whether there is an impact on the vehicle, and if an impact occurs on the vehicle, detects the occurrence of the sudden acceleration event, a sudden acceleration confirmation system. Claim 19 In paragraph 18, the mobile terminal is a sudden acceleration confirmation system that checks the operating status of the accelerator pedal and brake pedal when the vehicle acceleration exceeds a predetermined regulated acceleration. Claim 20 An application installed on a mobile terminal to provide a sudden acceleration verification service, comprising: at least one pedal camera installed in a vehicle to photograph an accelerator pedal and a brake pedal operated by a user; and at least one vehicle surrounding camera installed at a predetermined location within the vehicle to photograph the surroundings including the front or rear of the vehicle, each paired with; pedal images and surrounding images received in real-time from each paired camera based on time and stored as synchronized images; location information and speed information of the mobile terminal calculated based on the change in location of the mobile terminal are set as vehicle location information and vehicle speed information; and, when a predefined event occurs, a synchronized image corresponding to a certain period of time before and after the time of occurrence of the event is extracted from the stored synchronized images, and the vehicle location information and vehicle speed information corresponding to the time of the extracted synchronized images are synchronized over time to generate sudden acceleration evidence information and transmit the sudden acceleration evidence information to a cloud server.

Images