Apparatus and method for providing security information

Abstract

A system for providing security information includes an analysis server that receives image data and traffic signal information from an external device, recognizes a pedestrian from the image data, and analyzes pedestrian security associated with the recognition of the pedestrian according to the traffic signal information; and a navigation server that generates pedestrian safety information on the basis of the analysis of pedestrian safety output from the analysis server and transmits the safety analysis to the vehicle terminal.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the priority of Korean Patent Application No. 10-2023-0154838 filed in the Korean Intellectual Property Office on November 9, 2023, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present disclosure relates to a system and method for providing safety information. Background Art

[0004] The navigation system may verify the current location of the vehicle using a global positioning system (GPS), may navigate a route from the current location to a destination, and may guide the user to the destination along the navigation route.

[0005] When guiding the user to the destination, such a navigation system may provide real-time traffic information on the vehicle's direction of travel (e.g., congested roads, construction sites, road blockages, etc.), traffic disability protection areas (e.g., narrow strips or school zones), and traffic light display information (e.g., the remaining time for each signal). Summary of the invention

[0006] The present disclosure aims to solve the above-mentioned problems occurring in the prior art while maintaining the advantages of the prior art.

[0007] One aspect of the present disclosure provides a system and method for providing safety information to provide pedestrian safety information through pedestrian recognition based on image data obtained from a vehicle and roadside infrastructure.

[0008] Another aspect of the present disclosure provides a system and method for providing safety information, which provides pedestrian safety information by linking traffic signal information that takes into account the direction of vehicle travel. The technical problems to be solved by the present invention are not limited to the aforementioned problems, and any other technical problems not mentioned herein will be clearly understood from the following description by a technician in the field to which the present invention belongs. According to one aspect of the present invention, a system for providing safety information may include an analysis server and a navigation server, the analysis server receiving image data and traffic signal information from an external device, identifying pedestrians from the image data, and analyzing pedestrian safety associated with the result of identifying pedestrians in the traffic signal information, and the navigation server generating pedestrian safety information based on the pedestrian safety analysis result output from the analysis server and sending it to a vehicle terminal.

[0009] The navigation server may collect the front image data of the vehicle transmitted from the vehicle terminal, and may transmit the collected front image data to the analysis server. The vehicle terminal may obtain the front image data of the vehicle using a camera mounted on the vehicle.

[0010] The analysis server may receive image data obtained through infrastructure installed on the roadside, and may receive traffic signal information from a traffic signal operating system.

[0011] The analysis server may use a pedestrian recognition model to determine whether a pedestrian is present in the image data.

[0012] The pedestrian recognition model can be implemented as a Histogram of Oriented Gradients (HOG) algorithm.

[0013] The analysis server may determine whether a pedestrian warning is required based on the traffic signal information, and determine whether there are pedestrians at the intersection based on the vehicle's heading direction.

[0014] The analysis server may divide the time zone when vehicle traffic and pedestrian traffic conflict with each other based on the traffic signal information, and may determine whether a pedestrian warning is required based on whether a pedestrian exists in the image data collected in the divided time zone.

[0015] The navigation server may generate guidance information for providing vehicle behavior control guidance for pedestrian safety based on the pedestrian safety analysis result, and may send the generated guidance information to the vehicle terminal.

[0016] The navigation server may generate a route from a starting point to a destination according to a route navigation request sent by a vehicle terminal, may obtain traffic signal information in the route, and may send the route together with the traffic signal information in the route to the vehicle terminal.

[0017] The vehicle terminal can send pedestrian safety information to the output device.

[0018] According to another aspect of the present disclosure, a method for providing safety information may include: receiving image data and traffic signal information from an external device through an analysis server, identifying pedestrians from the image data through the analysis server, analyzing pedestrian safety associated with the identification of pedestrians based on the traffic signal information through the analysis server, sending the pedestrian safety analysis results to a navigation server through the analysis server, and sending pedestrian safety information to a vehicle terminal based on the pedestrian safety analysis results through the navigation server.

[0019] The receiving of the image data and the traffic signal information may include: sending the vehicle's front image data obtained by a camera mounted on the vehicle to the navigation server through the vehicle terminal, and receiving and sending the vehicle's front image data to the analysis server through the navigation server.

[0020] The receiving of the image data and the traffic signal information may include receiving, through the analysis server, the image data obtained by infrastructure installed on the roadside, and receiving, through the analysis server, the traffic signal information from a traffic signal operating system.

[0021] The identification of the pedestrian may include determining whether a pedestrian exists in the image data using a pedestrian recognition model by the analysis server.

[0022] The pedestrian safety analysis may include determining, by the analysis server, whether a pedestrian warning is required based on traffic signal information, and determining whether a pedestrian is present at the intersection based on the vehicle's heading direction.

[0023] The pedestrian safety analysis may include dividing, by the analysis server, time zones when vehicle traffic and pedestrian traffic conflict with each other based on traffic signal information, and determining, by the analysis server, whether a pedestrian warning is required based on whether pedestrians exist in image data collected in the divided time zones.

[0024] The sending of pedestrian safety information may include generating guidance information for vehicle behavior control guidance provided for pedestrian safety based on the pedestrian safety analysis result through the navigation server, and sending the generated guidance information to the vehicle terminal through the navigation server.

[0025] The method may also include generating a route for reaching a destination from a starting point according to a route navigation request sent from a vehicle terminal by a navigation server, obtaining traffic signal information in the route by the navigation server, and sending the route together with the traffic signal information in the route to the vehicle terminal by the navigation server.

[0026] The method may further include outputting the pedestrian safety information to an output device via the vehicle terminal. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The above and other purposes, features and advantages of the present invention will become more apparent through the following specific embodiments in conjunction with the accompanying drawings:

[0028] Figure 1 is a block diagram showing a configuration of a system for providing security information according to an embodiment of the present disclosure;

[0029] Figure 2 It is shown Figure 1 A block diagram of the configuration of the vehicle terminal shown;

[0030] Figure 3 It is shown Figure 1 A block diagram of the configuration of the traffic control server shown;

[0031] Figure 4 is a diagram for describing the operation of a system for providing safety information according to an embodiment of the present disclosure;

[0032] Figure 5 is a diagram for describing an example of providing security information according to an embodiment of the present disclosure;

[0033] Figure 6is a flowchart illustrating a method for providing security information according to an embodiment of the present disclosure; and

[0034] Figure 7 is a block diagram illustrating a computing system for executing a method for providing security information according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0035] Some embodiments of the present disclosure will be described in detail below with reference to the exemplary drawings. When adding reference numbers to the components of each drawing, it should be noted that the same components are designated by the same numbers even if the same components are shown on other drawings. In addition, detailed descriptions of well-known features or functions will be excluded so as not to unnecessarily obscure the main points of the present disclosure.

[0036] When describing the components of the exemplary embodiments of the present disclosure, the terms first, second, A, B, (a), (b), etc. may be used herein. These terms are only used to distinguish one component from another component, but do not limit the corresponding components, regardless of the order or priority of the corresponding components. In addition, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as those commonly understood by those skilled in the art to which the present disclosure belongs. Such terms are defined in general dictionaries and should be interpreted as having the same meaning as the contextual meaning of the relevant technical field, and should not be interpreted as having an idealized or overly formalized meaning, unless clearly defined in this application. Figure 1 is a block diagram showing a configuration of a system for providing security information according to an embodiment of the present disclosure.

[0037] The system 100 for providing safety information may include a navigation server 110 and an analysis server 120 connected via a network. The network may be implemented as a wired network, such as a local area network (LAN), a wide area network (WAN), Ethernet, and / or an integrated services digital network (ISDN), and / or a wireless network, such as a wireless LAN (WLAN) (Wi-Fi), wireless broadband (Wibro), Worldwide Interoperability for Microwave Access (WiMAX), and / or a fifth generation technology standard (5G) network.

[0038] The navigation server 110 may provide a route and pedestrian safety information to the vehicle terminal 200. The navigation server 110 may include a communication circuit 111, a memory 112, and a processor 113.

[0039] The communication circuit 111 may support the navigation server 110 to communicate with the analysis server 120 and / or the vehicle terminal 200. The communication circuit 111 may include a wireless communication circuit (e.g., a mobile communication circuit, a short-range wireless communication circuit, or a global navigation satellite system (GNSS) communication circuit) for supporting data transmission and reception via a wireless network and a wired communication circuit (e.g., a LAN communication circuit or a power line communication circuit) for supporting data transmission and reception via a wired network.

[0040] The memory 112 may store map data. In addition, the memory 112 may store data received through the communication circuit 111.

[0041] The memory 112 may be a non-transitory storage medium that stores instructions executed by the processor 113. The memory 112 may include a flash memory, a hard disk, a solid state disk (SSD), a secure digital (SD) card, a random access memory (RAM), a static RAM (SRAM), a read-only memory (ROM), a programmable ROM (PROM), an electrically erasable programmable ROM (EEPROM), an erasable programmable ROM (EPROM), etc.

[0042] The processor 113 may control the overall operation of the navigation server 110. The processor 113 may be implemented as at least one of a processing device such as an application specific integrated circuit (ASIC), a digital signal processor (DSP), a programmable logic device (PLD), a field programmable gate array (FPGA), a central processing unit (CPU), a microcontroller, or a microprocessor.

[0043] The processor 113 may receive a route navigation request sent from the vehicle terminal 200 through the communication circuit 111. The processor 113 may navigate (or generate) a route (or driving route) for reaching the destination from the starting point (e.g., the current position of the vehicle, a position specified by a user, etc.) based on the starting point information and the destination (or arrival point) information included in the route navigation request.

[0044] The processor 113 may generate a route using the map data stored in the memory 112. The processor 113 may reflect real-time traffic information to generate a route. The processor 113 may transmit the generated route to the vehicle terminal 200 using the communication circuit 111.

[0045] When generating a route, the processor 113 may interact with the traffic signal operating system to obtain traffic signal information in the generated route. The processor 113 may send the obtained traffic signal information together with the generated route to the vehicle terminal 200. The traffic signal information may include vehicle signal information indicating whether vehicle traffic is allowed and pedestrian signal information indicating whether pedestrian traffic is allowed.

[0046] The processor 113 may receive the front image data of the vehicle transmitted from the vehicle terminal 200 using the communication circuit 111. The processor 113 may transmit the received front image data of the vehicle to the analysis server 120. In the present embodiment, in order to help understand the present disclosure, it is described that the navigation server 110 receives the front image data of the vehicle from one vehicle terminal 200, but is not limited thereto. The navigation server 110 may receive the front image data of each of at least two vehicles from at least two vehicle terminals (i.e., at least two vehicles).

[0047] The processor 113 may receive the pedestrian safety analysis result transmitted from the analysis server 120 through the communication circuit 111. The processor 113 may generate pedestrian safety information (or pedestrian warning information) based on the received pedestrian safety analysis result. The processor 113 may transmit the generated pedestrian safety information to the vehicle terminal 200 using the communication circuit 111. The pedestrian safety information may include vehicle behavior control information (e.g., pause, deceleration, etc.) for pedestrian safety based on the Road Traffic Law, etc.

[0048] The analysis server 120 may perform pedestrian safety analysis based on image data and traffic signal information at the intersection approached by the vehicle. The analysis server 120 may include a communication circuit 121 , a memory 122 , and a processor 123 .

[0049] The communication circuit 121 may support the analysis server 120 to communicate with the navigation server 110 and / or the traffic control server 300. The communication circuit 121 may include a wireless communication circuit, a wired communication circuit, etc. The communication circuit 121 may receive the front image data (or the first image data) transmitted from the navigation server 110. In addition, the communication circuit 121 may receive the image data (or the second image data) and the traffic signal information transmitted from the traffic control server 300.

[0050] The memory 122 may store the first image data, the second image data, and the traffic signal information received through the communication circuit 121. The memory 122 may store a pedestrian discrimination model (or a pedestrian recognition model). The pedestrian discrimination model may be implemented as a Histogram of Directed Gradients (HOG) algorithm.

[0051] The memory 122 may be a non-transitory storage medium storing instructions executed by the processor 123. The memory 122 may include at least one of a storage medium such as a flash memory, a hard disk, an SSD, a RAM, a SRAM, a ROM, a PROM, an EEPROM, or an EPROM.

[0052] The processor 123 may control the overall operation of the analysis server 120. The processor 123 may be implemented as at least one of a processing device such as an ASIC, a DSP, a PLD, an FPGA, a CPU, a microcontroller, or a microprocessor.

[0053] The processor 123 may use the communication circuit 121 to collect image data sent from an external device (e.g., the navigation server 110, the traffic control server 300, etc.). As an example, the processor 123 may classify images of each intersection to collect image data. As another example, the processor 123 may interact with the traffic control server 300 to divide the time zone when vehicle traffic and pedestrian traffic conflict with each other based on the traffic signal information at the intersection. The processor 123 may collect image data in the divided time zone.

[0054] The processor 123 may use a pedestrian recognition model to recognize (or identify) pedestrians from the collected image data. When receiving image data, the pedestrian recognition model may output pedestrian information, including whether there are pedestrians, the location of pedestrians, etc., by identifying pedestrians in the image data.

[0055] The processor 123 may perform pedestrian safety analysis based on the traffic signal information and the pedestrian information. When the pedestrian safety analysis is completed, the processor 123 may send the analysis result to the navigation server 110. The pedestrian safety analysis may be used to determine whether attention needs to be paid to pedestrian safety.

[0056] Figure 2 It is shown Figure 1 Block diagram of the configuration of the vehicle terminal shown.

[0057] The vehicle terminal 200 may be a device installed in the vehicle, which may be an audio, video, navigation (AVN) terminal, an in-vehicle infotainment terminal, a telematics terminal, etc. Such a vehicle terminal 200 may include a camera 210 , a user interface 220 , a communication circuit 230 , a memory 240 , and a processor 250 .

[0058] The camera 210 may be mounted on the vehicle to capture the front and / or periphery (e.g., the side or rear) of the vehicle. The camera 210 may store captured image data, such as the front image data of the vehicle, in the memory 240. In addition, the camera 210 may send the captured image data directly to the processor 250.

[0059] The user interface 220 may be a device that helps the vehicle terminal 200 and the user communicate with each other. The user interface 220 may include an input device (e.g., a keyboard, a touch pad, a microphone, a touch screen, etc.) for generating data according to the user's manipulation, an output device (e.g., a display, a speaker, a tactile signal output device, etc.) for outputting information according to the operation of the vehicle system, and the like.

[0060] The communication circuit 230 may perform communication between the vehicle terminal 200 and the navigation server 110. The communication circuit 230 may include a wireless communication circuit and / or a wired communication circuit.

[0061] Memory 240 may be a non-transitory storage medium storing instructions executed by processor 250. Memory 240 may include at least one of a storage medium such as a flash memory, a hard disk, an SSD, a RAM, a SRAM, a ROM, a PROM, an EEPROM, or an EPROM.

[0062] The processor 250 may control the overall operation of the vehicle terminal 200. The processor 250 may be implemented as at least one of a processing device such as ASIC, DSP, PLD, FPGA, CPU, microcontroller, or microprocessor.

[0063] The processor 250 may generate the origin information and the destination information based on the input data received from the user interface 220. The processor 250 may generate a route navigation request using the generated origin information and the generated destination information. The processor 250 may send the generated route navigation request to the navigation server 110 using the communication circuit 230.

[0064] The processor 250 may transmit the vehicle front image data obtained using the camera 210 to the navigation server 110. When there is an intersection in front of the vehicle, the processor 250 may obtain the vehicle front image data using the camera 210.

[0065] The processor 250 may receive the route information transmitted from the navigation server 110. The processor 250 may output the route guide information to the user interface 220 according to the received route.

[0066] The processor 250 may receive the pedestrian safety information transmitted from the navigation server 110. The processor 250 may output the received pedestrian safety information to the user interface 220. The processor 250 may output the pedestrian safety information to the user interface 220 as a signal in a form that is recognized by the user using vision, hearing, etc.

[0067] Figure 3 It is shown Figure 1 A block diagram of the configuration of a traffic control server is shown.

[0068] The traffic control server 300 may include a communication circuit 310 , a memory 320 , and a processor 330 .

[0069] The communication circuit 310 may support the traffic control server 300 to communicate with external devices, such as the analysis server 120 , the infrastructure 10 , the traffic signal operating system 20 , etc. The communication circuit 310 may include a wireless communication circuit and / or a wired communication circuit.

[0070] The memory 320 may store data received through the communication circuit 310. The memory 320 may be a non-transitory storage medium storing instructions executed by the processor 330. The memory 320 may include at least one of a storage medium such as a flash memory, a hard disk, an SSD, a RAM, a SRAM, a ROM, a PROM, an EEPROM, or an EPROM.

[0071] The processor 330 may control the overall operation of the traffic control server 300. The processor 330 may be implemented as at least one of a processing device such as ASIC, DSP, PLD, FPGA, CPU, microcontroller, or microprocessor.

[0072] The processor 330 may receive image data transmitted from the infrastructure 10 using the communication circuit 310. The infrastructure 10 may be installed on the roadside to obtain image data around the road using a camera (or image sensor). The infrastructure 10 may be a closed-circuit television (CCTV), a traffic information collection device, or the like.

[0073] The processor 330 may receive traffic signal information from the traffic signal operating system 20 using the communication circuit 310. The traffic signal information may include traffic light identification information, signal display information, traffic light installation location, and the like.

[0074] The processor 330 may collect traffic information (eg, congested sections, construction sections, etc.) using sensors installed on the road, and may collect traffic information using sensors installed on the vehicle.

[0075] The processor 330 may transmit the collected image data, traffic signal information, traffic information, etc. to the analysis server 120 .

[0076] Figure 4 is a diagram for describing the operation of a system for providing security information according to an embodiment of the present disclosure.

[0077] The navigation server 110 may perform route generation and provision 410, vehicle front image data collection 420, and pedestrian safety information provision 430. The analysis server 120 may perform first image collection 440, second image data collection 450, pedestrian recognition model 460, traffic signal information collection 470, and pedestrian safety analysis 480.

[0078] The navigation server 110 may receive a route navigation request from the vehicle terminal 200. The navigation server 110 may generate a route (or a driving route) for reaching the destination from the starting point (e.g., the current position of the vehicle, the position specified by the user, etc.) based on the starting point information and the destination information included in the received route navigation request. When generating the route, the navigation server 110 may generate the route using previously stored map data. In addition, the navigation server 110 may obtain real-time traffic information through the traffic control server 300, and may reflect the acquired real-time traffic information to generate the route. The navigation server 110 may send the generated route to the vehicle terminal 200.

[0079] When providing a route to the vehicle terminal 200, the navigation server 110 may link the traffic signal information in the generated route to the generated route to provide the route to the vehicle terminal 200. In other words, the navigation server 110 may transmit the generated route information and the traffic signal information in the generated route to the vehicle terminal 200 together.

[0080] The navigation server 110 may collect the front image data of the vehicle. The vehicle terminal 200 may obtain the front image data of the vehicle using the camera 210 installed on the vehicle, and may transmit the obtained front image data of the vehicle to the navigation server 110. The navigation server 110 may receive the front image data of the vehicle transmitted from the vehicle terminal 200. The navigation server 110 may transmit the collected front image data of the vehicle to the analysis server 120.

[0081] The analysis server 120 may collect image data from external devices (e.g., the vehicle terminal 200, the traffic control server 300, the traffic signal operating system 20, etc.). The analysis server 120 may receive the front image data of the vehicle transmitted from the navigation server 110. The analysis server 120 may classify and collect the front image data received at each intersection. In other words, the analysis server 120 may collect the image data of each intersection obtained by the camera 210 mounted on the vehicle, i.e., the first image data.

[0082] In addition, the analysis server 120 may use the traffic control server 300 to collect roadside image data, i.e., second image data, through the infrastructure 10 installed on the roadside. The traffic control server 300 may be set up in a police station, a municipality, a signal operation center, etc., and may provide traffic information, surrounding infrastructure information (e.g., CCTV image data), etc.

[0083] The analysis server 120 may extract pedestrian information from the collected image data, namely the first image data and the second image data. The analysis server 120 may use the pedestrian recognition model 460 to recognize (or identify) pedestrians in the image data. The pedestrian recognition model 460 may determine whether there is a pedestrian by performing pedestrian recognition in the received image data.

[0084] The analysis server 120 may collect traffic signal information using the traffic control server 300. The analysis server 120 may analyze pedestrian safety based on the traffic signal information received from the traffic control server 300 and whether a pedestrian is present output from the pedestrian recognition model 460.

[0085] The analysis server 120 may determine a time zone where vehicle traffic and pedestrian traffic conflict with each other for each intersection based on the traffic signal information received from the traffic control server 300. The analysis server 120 may determine whether a pedestrian crosses a crosswalk at the intersection in the determined time zone. When it is determined that a pedestrian crosses a crosswalk at the intersection in the time zone where vehicle traffic and pedestrian traffic conflict with each other, the analysis server 120 may determine that a pedestrian warning is required.

[0086] The analysis server 120 may transmit the pedestrian safety analysis result to the navigation server 110. The navigation server 110 may receive the pedestrian safety analysis result transmitted from the analysis server 120. The navigation server 110 may generate pedestrian safety information (or pedestrian warning information) based on the received pedestrian safety analysis result, and may transmit the generated pedestrian safety information to the vehicle terminal 200.

[0087] Figure 5 is a diagram for describing an example of providing security information according to an embodiment of the present disclosure.

[0088] refer to Figure 5 , there is a situation where the vehicle 500 approaches an intersection. The vehicle 500 may go straight, turn left, or turn right according to the route guidance. The system 100 for providing safety information may generate pedestrian safety information based on traffic signal information and whether there is a pedestrian crossing the road, and may provide (or send) the generated pedestrian safety information to the vehicle 500.

[0089] For example, when the vehicle 500 turns right at an intersection, the system 100 for providing safety information may collect front image data of the vehicle 500 and front image data of another vehicle 510. The system 100 for providing safety information may collect image data captured by CCTV 520 installed on the roadside.

[0090] The system 100 for providing safety information may identify pedestrians from the image data using a Histogram of Oriented Gradients (HOG) algorithm, etc. The system 100 for providing safety information may determine whether a pedestrian exists through pedestrian recognition. At this time, the system 100 for providing safety information may extract pedestrian information, such as the number of recognized pedestrians and the position of each recognized pedestrian, from the image data.

[0091] The system 100 for providing safety information may verify the signal display information of the traffic signal information, i.e., the vehicle signal information and the pedestrian signal information about the vehicle advancing direction at the intersection. The system 100 for providing safety information may determine whether a pedestrian warning is required for the front vehicle signal VS of the vehicle 500, the front pedestrian signal PS1 of the vehicle 500, the pedestrian signal PS2 immediately after the right turn, and whether there is a pedestrian. The system 100 for providing safety information may generate safety information based on the front vehicle signal VS of the vehicle 500, the front pedestrian signal PS1 of the vehicle 500, the pedestrian signal PS2 immediately after the right turn, and whether there is a pedestrian, such as the following Table 1.

[0092] Table 1

[0093]

[0094] As another example, when the vehicle 500 turns left at an intersection, the system 100 for providing safety information may analyze the front image data collected by the vehicle 500 and another vehicle 530 to determine whether a pedestrian exists. The system 100 for providing safety information may verify the front vehicle signal VS of the vehicle 500, the front pedestrian signal PS1 of the vehicle 500, and the pedestrian signal PS3 that appears immediately after the left turn. The system 100 for providing safety information may generate safety information based on the front vehicle signal VS of the vehicle 500, the front pedestrian signal PS1 of the vehicle 500, the pedestrian signal PS3 immediately after the left turn, and whether there is a pedestrian. The system 100 for providing safety information may transmit the generated safety information to the vehicle 500. The vehicle 500 may receive the safety information transmitted from the system 100 for providing safety information, and may output the received safety information as a visual signal, an auditory signal, etc.

[0095] Figure 6 is a flowchart illustrating a method for providing security information according to an embodiment of the present disclosure.

[0096] In S100, the navigation server 110 may receive a route navigation request transmitted from the vehicle terminal 200. The vehicle terminal 200 may transmit the route navigation request including the starting point information and the destination information of the vehicle to the navigation server 110.

[0097] In S110, the navigation server 110 may generate a route from the starting point to the destination according to the received route navigation request, and may send the generated route. The navigation server 110 may generate a route for reaching the destination from the starting point based on the starting point information and the destination information included in the received route navigation request. When generating the route, the navigation server 110 may use previously stored map data to generate the route. In addition, the navigation server 110 may obtain real-time traffic information through the traffic control server 300, and may reflect the obtained real-time traffic information to generate the route. The navigation server 110 may send the generated route to the vehicle terminal 200. When providing the route to the vehicle terminal 200, the navigation server 110 may link the traffic signal information in the generated route to the generated route to provide the route to the vehicle terminal 200. In other words, the navigation server 110 may send the generated route information and the traffic signal information in the generated route to the vehicle terminal 200.

[0098] In S120, the navigation server 110 may transmit the front image data collected by the vehicle to the analysis server 120. The vehicle terminal 200 may obtain the front image data of the vehicle using the camera 210 installed on the vehicle, and may transmit the obtained front image data of the vehicle to the navigation server 110. The navigation server 110 may receive the front image data of the vehicle transmitted from the vehicle terminal 200. The navigation server 110 may transmit the collected front image data of the vehicle to the analysis server 120.

[0099] In S130, the analysis server 120 may collect image data and traffic signal information from external devices (e.g., the vehicle terminal 200, the traffic control server 300, etc.). The analysis server 120 may receive the front image data of the vehicle transmitted from the navigation server 110. The analysis server 120 may classify and collect the received front image data for each intersection. The analysis server 120 may collect image data and traffic signal information using the traffic control server 300. The traffic control server 300 may obtain roadside image data through the infrastructure 10 installed on the roadside, and may send the obtained roadside image data to the analysis server 120. The traffic control server 300 may interact with the traffic signal operating system 20 to obtain traffic signal information, and may send the obtained traffic signal information to the analysis server 120.

[0100] In S140, the analysis server 120 may extract pedestrian information from the collected image data. The analysis server 120 may use the pedestrian recognition model 460 to recognize (or identify) pedestrians in the image data. The pedestrian recognition model 460 may determine whether there is a pedestrian by performing pedestrian recognition in the received image data.

[0101] In S150, the analysis server 120 may analyze pedestrian safety based on pedestrian information and traffic signal information. The analysis server 120 may analyze pedestrian safety based on the traffic signal information received from the traffic control server 300 and whether there are pedestrians output from the pedestrian identification model 460. The analysis server 120 may determine, for each intersection, a time zone when vehicle traffic and pedestrian traffic conflict with each other based on the traffic signal information received from the traffic control server 300. The analysis server 120 may determine whether there are pedestrians crossing the crosswalk at the intersection in the determined time zone. When it is determined that there are pedestrians crossing the crosswalk at the intersection in the time zone when vehicle traffic and pedestrian traffic conflict with each other, the analysis server 120 may determine that a pedestrian warning is required.

[0102] In S160 , the analysis server 120 may send the pedestrian safety analysis result to the navigation server 110 .

[0103] In S170 , the navigation server 110 may generate pedestrian warning information (or pedestrian safety information) based on the received pedestrian safety analysis result, and may transmit the generated pedestrian safety information to the vehicle terminal 200 .

[0104] Figure 7 is a block diagram illustrating a computing system for executing a method for providing security information according to an embodiment of the present disclosure.

[0105] refer to Figure 7 , the computing system 1000 may include at least one processor 1100 , a memory 1300 , a user interface input device 1400 , a user interface output device 1500 , a storage device 1600 , and a network interface 1700 , which are interconnected via a bus 1200 .

[0106] The processor 1100 may be a central processing unit (CPU) or a semiconductor device that processes instructions stored in the memory 1300 and / or the storage device 1600. The memory 1300 and the storage device 1600 may include various types of volatile or non-volatile storage media. For example, the memory 1300 may include a read-only memory (ROM) 1310 and a random access memory (RAM) 1320.

[0107] Therefore, the operation of the method or algorithm described in conjunction with the embodiments disclosed in the specification may be implemented directly by a hardware module, a software module, or a combination of a hardware module and a software module executed by the processor 1100. The software module may reside on a storage medium (i.e., the memory 1300 and / or the storage device 1600) such as a RAM, a flash memory, a ROM, an EPROM, an EEPROM, a register, a hard disk, a removable disk, and a CD-ROM. An exemplary storage medium may be coupled to the processor 1100. The processor 1100 may read information from the storage medium and may write information to the storage medium. Alternatively, the storage medium may be integrated with the processor 1100. The processor 1100 and the storage medium may reside in an application specific integrated circuit (ASIC). The ASIC may reside in a user terminal. In another case, the processor 1100 and the storage medium may reside in a user terminal as separate components.

[0108] Embodiments of the present disclosure may identify pedestrians using image data obtained from vehicles and roadside infrastructure, and may link pedestrian identification results with traffic signal information that takes into account the vehicle's direction of travel to provide pedestrian safety information, thereby preventing traffic accidents and ensuring the safety of drivers and pedestrians.

[0109] Although the present disclosure has been described above with reference to exemplary embodiments and the accompanying drawings, the present disclosure is not limited thereto, but rather, without departing from the spirit and scope of the present disclosure as claimed in the following claims, a person skilled in the art to which the present disclosure belongs may make various modifications and changes to the present disclosure. Therefore, the embodiments of the present disclosure are not intended to limit the technical spirit of the present disclosure, but are provided for illustrative purposes only. The scope of the present disclosure should be interpreted based on the attached claims, and all technical ideas within the scope equivalent to the claims should be included within the scope of the present disclosure.

Claims

1. A system for providing security information, the system comprising: The analysis server is configured as follows: receiving image data and traffic signal information from an external device; identifying pedestrians from the image data; as well as analyzing pedestrian safety associated with the identification of the pedestrian in view of the traffic signal information; as well as The navigation server is configured as follows: Based on the analysis of the pedestrian safety, pedestrian safety information is generated and sent to a vehicle terminal, wherein the pedestrian safety information is output from the analysis server.

2. The system according to claim 1, wherein: The navigation server is configured to: collecting the front image data of the vehicle transmitted from the vehicle terminal; and sending the collected front image data to the analysis server; The vehicle terminal is configured to obtain front image data of the vehicle using a camera installed on the vehicle.

3. The system of claim 1, wherein the analysis server is configured to: receiving image data obtained by infrastructure installed on the roadside; and The traffic signal information is received from a traffic signal operating system.

4. The system of claim 1, wherein the analysis server is configured to: A pedestrian recognition model is used to determine whether a pedestrian exists in the image data. The system according to claim 4 , wherein the pedestrian identification model is a histogram of oriented gradients algorithm.

6. The system of claim 1, wherein the analysis server is configured to: determining whether a pedestrian warning is required based on traffic signal information, and The presence of a pedestrian at the intersection is determined based on the vehicle's heading.

7. The system of claim 1, wherein the analysis server is configured to: Based on the traffic signal information, dividing the time zone when vehicle traffic and pedestrian traffic conflict with each other; and Whether a pedestrian warning is required is determined based on whether a pedestrian exists in the image data collected in the divided time zones.

8. The system of claim 1, wherein the navigation server is configured to: Based on the analysis of the pedestrian safety, generating guidance information for providing vehicle behavior control guidance for the pedestrian safety; and The generated guidance information is sent to the vehicle terminal.

9. The system of claim 1, wherein the navigation server is configured to: generating a route for reaching a destination from a starting point according to a route navigation request sent from a vehicle terminal; Obtaining traffic signal information on the route; and The route is transmitted to the vehicle terminal together with traffic signal information in the route.

10. The system according to claim 1, wherein the vehicle terminal is configured to: send the pedestrian safety information to an output device.

11. A method for providing security information, the method comprising the steps of: receiving image data and traffic signal information from an external device via an analysis server; identifying pedestrians from the image data by the analysis server; analyzing, by the analysis server, pedestrian safety associated with identification of the pedestrian based on the traffic signal information; sending the pedestrian safety analysis to a navigation server via the analysis server; as well as Based on the analysis of the pedestrian safety, pedestrian safety information is sent to the vehicle terminal through the navigation server.

12. The method of claim 11, wherein the step of receiving the image data and the traffic signal information comprises: sending, via the vehicle terminal, front image data of the vehicle obtained by a camera mounted on the vehicle to the navigation server; as well as The front image data of the vehicle is received by the navigation server, and the front image data of the vehicle is sent to the analysis server.

13. The method of claim 11, wherein the step of receiving the image data and the traffic signal information comprises: receiving, by the analysis server, the image data obtained by infrastructure installed on the roadside; as well as The traffic signal information is received from a traffic signal operating system through the analysis server.

14. The method according to claim 11, wherein the step of identifying a pedestrian comprises: The analysis server uses a pedestrian recognition model to determine whether a pedestrian exists in the image data. The method according to claim 14 , wherein the pedestrian identification model is a histogram of oriented gradients algorithm.

16. The method of claim 11, wherein the step of analyzing pedestrian safety comprises: determining, by the analysis server, whether a pedestrian warning is required based on traffic signal information, and Based on the vehicle's heading, determine whether there are pedestrians at the intersection.

17. The method of claim 11, wherein the step of analyzing pedestrian safety comprises: dividing, by the analysis server based on the traffic signal information, a time zone when vehicle traffic and pedestrian traffic conflict with each other; as well as Whether a pedestrian warning is required is determined by the analysis server based on whether a pedestrian exists in the image data collected in the divided time zones.

18. The method according to claim 11, wherein the step of sending the pedestrian safety information comprises: generating, by the navigation server based on the analysis of the pedestrian safety, guidance information for providing vehicle behavior control guidance for the pedestrian safety; as well as The generated guidance information is sent to the vehicle terminal through the navigation server.

19. The method according to claim 11, further comprising the steps of: generating, by the navigation server, a route for reaching a destination from a starting point according to a route navigation request sent from a vehicle terminal; Obtaining traffic signal information on the route through the navigation server; as well as The route is transmitted to the vehicle terminal through the navigation server together with traffic signal information in the route.

20. The method according to claim 11, further comprising the steps of: The pedestrian safety information is output to an output device through a vehicle terminal.

Images