Mobility support method and mobility support system for mobile objects

Abstract

To provide a technique for ensuring traffic safety of a moving body such as a pedestrian moving on a road.SOLUTION: A moving body included in an image of an infrastructure camera is recognized. Supporting display for supporting movement of the moving body is output from a pavement lighting device on the basis of the recognition information on the moving body. When the recognition information on the moving body includes recognition information on first and second moving bodies, the relative speed of the second moving body in a movement direction of the first moving body and the distance between these moving bodies are calculated on the basis of the recognition information. When the relative speed is equal to or greater than the predetermined speed and the distance is equal to or less than the predetermined distance, approach notification information for notifying the first moving body of the approach of the second moving body is generated. When the approach notification information is generated, the supporting display corresponding to the approach notification information is output from the pavement lighting device.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present disclosure relates to a method and system for assisting the movement of a mobile object such as a pedestrian. [Background technology]

[0002] Japanese Patent Application Laid-Open Publication No. 2019-60088 discloses a road stud system including a light-emitting device and a controller that controls the light-emitting device. In this conventional system, the light-emitting device is installed at the center of an intersection and has multiple LEDs arranged on its surface. When a vehicle is detected around the intersection, the controller controls the light-emitting device to light up the LEDs arranged in the direction of the detected vehicle. The controller also controls the light-emitting device to shorten the intervals at which the LEDs light when the detected vehicle approaches the intersection. This control of the light-emitting device can alert pedestrians around the intersection to the presence of a vehicle approaching the intersection.

[0003] In addition to Publication No. 2019-60088, examples of documents that show the technical state of the art in the technical field related to the present disclosure include Patent Publication No. 2005-182256. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2019-60088 [Patent Document 2] Japanese Patent Application Laid-Open No. 2005-182256 Summary of the Invention [Problem to be solved by the invention]

[0005] Consider a situation where there is a pedestrian traveling on a road and a bicycle approaching the pedestrian from behind. In this situation, the pedestrian will become aware of the approach of the bicycle, for example, by the sound of the bicycle traveling or the horn. At night, the pedestrian will become aware of the approach of the bicycle by the road surface illuminated by the bicycle's headlights. In other words, the pedestrian will become aware of the approaching bicycle through visual or auditory information.

[0006] However, if a pedestrian is wearing a sound-reproducing device such as headphones or earphones, auditory information may be blocked. Furthermore, the illumination range of a bicycle's headlights is not very wide. Therefore, it is possible that a pedestrian may not notice the road surface illuminated by the bicycle's headlights. Therefore, there is room for improvement and development in technology to ensure pedestrian traffic safety in situations where a moving object such as a bicycle approaches a pedestrian, without relying on a warning device on the moving object.

[0007] One object of the present disclosure is to provide a technology for ensuring traffic safety for moving bodies such as pedestrians traveling on roads. [Means for solving the problem]

[0008] A first aspect of the present disclosure is a method for assisting movement of a moving object, which has the following features. The method includes a step of recognizing a moving object included in an image of an infrastructure camera, and a step of outputting an assistance display from a road surface lighting device to assist the movement of the moving object based on the recognition information of the moving object. The method further includes a step of calculating, when the recognition information of the moving body includes recognition information of a first and a second moving body, the relative speed of the second moving body in the direction of movement of the first moving body and the distance between these moving bodies based on the recognition information of the first and second moving bodies, and, when the relative speed is greater than or equal to a predetermined speed and the distance is less than or equal to a predetermined distance, generating approach notification information that notifies the first moving body of the approach of the second moving body. When the approach notification information is generated, in the step of outputting the assistance display, an assistance display corresponding to the approach notification information is output from the road surface lighting device.

[0009] A second aspect of the present disclosure is a system for assisting movement of a moving object, which has the following features. The system includes a road lighting device, an infrastructure camera, and a processor. The road lighting device illuminates a road surface. The infrastructure camera captures an image of the road surface. The processor is configured to perform various processes. The processor is configured to perform a process of recognizing a moving object included in an image of the infrastructure camera, and a process of causing the road surface lighting device to output an assistance display that assists the movement of the moving object based on the recognition information of the moving object. The processor is further configured to perform the following processes: when the recognition information of the moving body includes recognition information of a first and a second moving body, calculate the relative speed of the second moving body in the moving direction of the first moving body and the distance between these moving bodies based on the recognition information of the first and second moving bodies; and when the relative speed is greater than or equal to a predetermined speed and the distance is less than or equal to a predetermined distance, generate approach notification information that notifies the first moving body of the approach of the second moving body. When the approach notification information is generated, in the process of causing the road surface lighting device to output the assistance indication, the assistance indication corresponding to the approach notification information is output from the road surface lighting device. [Effects of the Invention]

[0010] According to the present disclosure, a road surface lighting device outputs an assistance display to assist the movement of a moving object based on recognition information of the moving object contained in an image captured by an infrastructure camera. Furthermore, when the object of movement assistance includes a first and a second moving object, the relative speed of the second moving object in the direction of movement of the first moving object and the distance between the first and second moving objects are calculated based on the recognition information of the first and second moving objects. If the relative speed is equal to or greater than a predetermined speed and the distance is equal to or less than a predetermined distance, approach notification information informing the first moving object of the approach of the second moving object is generated and output from the road surface lighting device. This makes it possible to alert the first moving object that the second moving object is approaching the first moving object. This makes it possible to ensure the traffic safety of the first moving object. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram illustrating an outline of an embodiment. [Figure 2] 10A and 10B are diagrams illustrating a first example of light emission of an LED stud. [Figure 3] 10A and 10B are diagrams illustrating a second example of light emission of the LED stud. [Figure 4] FIG. 10 is a diagram illustrating an example of a countermeasure when two arbitrary moving bodies selected from a plurality of moving bodies are close to each other when the plurality of moving bodies are recognized. [Figure 5] 1 is a diagram illustrating a configuration example of a travel assistance system according to an embodiment. [Figure 6] 10 is a flowchart illustrating a flow of processing that is performed in a server and that is particularly related to the embodiment. [Figure 7] 10 is a flowchart illustrating a flow of processing that is performed in a server and that is particularly related to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In each drawing, the same or corresponding parts are denoted by the same reference numerals, and the description thereof will be simplified or omitted.

[0013] 1. Overview Fig. 1 is a diagram for explaining an outline of an embodiment. Fig. 1 depicts a road 1. Examples of the road 1 include a road for pedestrians, and a road for pedestrians as well as moving objects that move at a slower speed than automobiles, such as wheelchairs, self-propelled robots, and bicycles. The shape and width of the road 1 are not particularly limited.

[0014] A plurality of LED studs 2 are installed on the road surface of the road 1. In the example shown in FIG. 1, these LED studs 2 are installed at equal intervals. However, the arrangement of these LED studs 2 is not limited to this example. Furthermore, there is no particular limitation on the number of these LED studs 2 installed per unit area. Each LED stud 2 brightens the area around its installation location, and corresponds to an example of a "road surface lighting device" of the present disclosure. Other examples of road surface lighting devices include a device that irradiates light onto the road surface of the road 1 to brighten the illumination range, and a device that projects an image onto the road surface of the road 1 to brighten the projection range.

[0015] 1, the coordinates (x, y) will be used to refer to a specific LED tack 2 (x, y). For example, the lower left LED tack 2 (x, y) will be referred to as LED tack 2 (1, 1), and the upper left LED tack 2 (x, y) will be referred to as LED tack 2 (6, 1). Furthermore, the lower left LED tack 2 (x, y) will be referred to as LED tack 2 (1, 13), and the upper left LED tack 2 (x, y) will be referred to as LED tack 2 (6, 13).

[0016] A plurality of infrastructure cameras 3 are installed around the road 1. Each infrastructure camera 3 is a camera installed on a structure around the road 1 (for example, a road structure, or a facility structure such as a ceiling, pillar, or wall of a parking lot or factory). Each infrastructure camera 3 also captures an image of a predetermined range set for each infrastructure camera 3. The predetermined image capturing range includes, for example, the road surface of the road 1. Part or all of the predetermined image capturing range of one infrastructure camera 3 may overlap with that of another infrastructure camera 3.

[0017] The server 4 manages the mobility assistance system. The server 4 communicates individually with multiple LED studs 2. In communication with each LED stud 2, the server 4 transmits to each LED stud 2 assistance display information LUM(x,y) that assists the movement of the mobile object. The assistance display information LUM(x,y) includes, for example, instruction information for the LED stud 2(x,y). Examples of the instruction information include light emission color information and brightness information. The LED stud 2(x,y) emits light based on the instruction information for the LED stud 2(x,y).

[0018] The server 4 also communicates individually with the multiple infrastructure cameras 3. In communication with each infrastructure camera 3, the server 4 receives camera information CAM from each infrastructure camera 3. The camera information CAM includes, for example, ID information of the infrastructure camera 3 that sent the camera information CAM and image information acquired by this infrastructure camera 3. The image information may be a video or a still image. When the infrastructure camera 3 performs object recognition processing (described below), information on the recognition results obtained by this object recognition processing may be included in the image information.

[0019] FIG. 2 is a diagram illustrating a first example of light emission of the LED stud 2(x, y). FIG. 2 depicts moving objects 5 and 6 (pedestrians) moving on a road 1. The moving objects 5 and 6 are recognized based on images acquired by an infrastructure camera 3. A trajectory TR5 is the future trajectory of the moving object 5 predicted based on the recognition information of the moving object 5. A trajectory TR6 is the future trajectory of the moving object 6 predicted based on the recognition information of the moving object 6. The lengths of the trajectories TR5 and TR6 correspond to the distances that the moving objects 5 and 6 are predicted to travel in a few seconds (2 to 4 seconds) from the current time. These lengths are calculated, for example, based on the moving speed and direction of the moving objects 5 and 6.

[0020] In the example shown in FIG. 2, before trajectories TR5 and TR6 are predicted, the LED tacks 2(x,y) emit light of the same color and at the same level of brightness. When trajectory TR5 is predicted, the LED tacks 2(x,y) located around this trajectory TR5 (i.e., (x,y)=(2,2) to (2,4) and (3,2) to (3,4)) emit light of a specific color and at a high level of brightness. This specific color may be the same as the color of trajectory TR5 before prediction, or it may be a different color. However, the brightness level of this specific color is set to a higher level than the brightness level of trajectory TR5 before prediction. For example, consider a case where brightness levels are expressed in five levels and the brightness level of trajectory TR5 before prediction is "Level 1 to 2." In this case, the brightness level of the specific color is set to "Level 3 to 4."

[0021] When the trajectory TR6 is predicted, the LED studs 2(x,y) located around this trajectory TR6 (i.e., (x,y)=(5,10) to (5,12) and (6,10) to (6,12)) emit light in a specific color with a high level of brightness. This specific color may be the same as the color of the trajectory TR6 before prediction, or may be a different color. However, this specific color is set to a color different from that of the LED studs 2 located around the trajectory TR5. Furthermore, the brightness level of this specific color is set to a level higher than the brightness level of the trajectory TR6 before prediction.

[0022] FIG. 3 is a diagram illustrating a second example of light emission of the LED stud 2(x, y). The example shown in FIG. 3 is taken at a time slightly later than the example shown in FIG. 2, and depicts a moving object 5. FIG. 3 also depicts a moving object 7 (bicycle). As with the example shown in FIG. 2, the moving object 5 is recognized based on an image acquired by the infrastructure camera 3. As with the moving object 5, the moving object 7 is also recognized based on an image acquired by the infrastructure camera 3. Trajectory TR7 is the future trajectory of the moving object 7 predicted based on the recognition information of the moving object 7. Trajectory TR7 is longer than TR5 because the moving speed of the moving object 7 is higher than that of the moving object 5.

[0023] In the example shown in FIG. 3, the LED studs 2(x,y) (i.e., (x,y)=(2,6) to (2,8) and (3,6) to (3,8)) located around the track TR5 emit light in a specific color with a high level of brightness. This specific color is the same as the specific color of the LED studs 2 located around the track TR5 described in FIG. 2. In addition, the brightness level of this specific color is the same as the specific color of the LED studs 2 located around the track TR5 described in FIG. 2.

[0024] In the example shown in FIG. 3, in accordance with the prediction of the trajectory TR7, the LED studs 2(x,y) (i.e., (x,y)=(3,1) to (3,5) and (4,1) to (4,5)) located around this trajectory TR7 emit light in a specific color with a high level of brightness. This specific color may be the same as the color of the trajectory TR7 before the prediction, or may be a different color. However, this specific color is set to a color different from that of the LED studs 2 located around the trajectory TR5.

[0025] As shown in FIGS. 2 and 3, in this embodiment, when a moving object is recognized in an image acquired by an infrastructure camera 3, the future trajectory of the moving object is predicted. Then, LED studs 2(x, y) located around this future trajectory are caused to emit light in a specific color with a high level of brightness. When a device that irradiates light onto the road surface of the road 1 is used, it is conceivable to irradiate the road surface with a strip of light extending along the future trajectory. Furthermore, when a device that projects an image onto the road surface of the road 1 is used, it is conceivable to project an image of any shape corresponding to the future trajectory onto the road surface.

[0026] Consider a situation where multiple moving bodies are traveling on road 1. In this case, the illumination of the LED studs 2(x,y) described in Figures 2 and 3 is thought to be useful in preventing collisions between these moving bodies (including excessive closeness; the same applies below). This is because the illumination of the LED studs 2(x,y) located around the future trajectory of each moving body makes it possible to recognize the approach of other moving bodies. However, in the example shown in Figure 3, moving body 7 approaches moving body 5 from behind. Therefore, from the perspective of moving body 5, it is difficult to notice the illumination of the LED studs 2(x,y) located around TR7.

[0027] Therefore, in the embodiment, when multiple moving objects are recognized, it is determined whether any two selected moving objects are approaching each other, based on the distance DS between the two moving objects and the relative speed RS of the moving objects.

[0028] For ease of explanation, any two moving bodies will be referred to as "moving body MA" and "moving body MB." The distance DS is calculated based on the position of moving body MA and the position of moving body MB. The relative speed RS is calculated, for example, based on the speed of moving body MA in the direction of movement of moving body MA and the speed of moving body MB in this direction. If the sign of the relative speed is positive, it means that moving body MB is approaching moving body MA. On the other hand, if the sign of the relative speed is negative, it means that moving body MB is moving away from moving body MA.

[0029] In the embodiment, if the distance DS is equal to or less than a predetermined distance THD and the relative speed RS is equal to or greater than a predetermined speed THS, it is determined that the moving object MB is approaching the moving object MA. The predetermined distance THD and the predetermined speed THS may be fixed values ​​or may vary depending on the speed of the moving object MA or the moving object MB. For example, the higher the speed of the moving object MB, the longer the predetermined distance THD may be set to. Also, the higher the speed of the moving object MB, the higher the predetermined speed THS may be set to. The predetermined distance THD and the predetermined speed THS may vary depending on the density of multiple moving objects present on the road 1. For example, the higher the density, the shorter the predetermined distance THD may be set to. Also, the higher the density, the lower the predetermined speed THS may be set to.

[0030] An example of a countermeasure when it is determined that a moving object MB is approaching a moving object MA will be described with reference to FIG. 4. FIG. 4 depicts a moving object 5 (pedestrian) and a moving object 7 (bicycle). FIG. 4 also depicts trajectories TR5 and TR7. In the example shown in FIG. 4, LED studs 2(x, y) located around trajectory TR5 and LED studs 2(x, y) located around trajectory TR7 emit light. Up to this point, it is the same as the example described in FIG. 3.

[0031] In the example shown in FIG. 4, consider a case where it is determined that a moving body 7 is approaching a moving body 5. In this case, in the embodiment, "approach notification information" is generated to notify the moving body 5 of the approach of the moving body 7. The approach notification information is information for making a specific LED stud 2(x,y) emit light in a specific color with a high level of brightness. In the example shown in FIG. 4, an LED stud 2(x,y) (i.e., (x,y)=(4,6) to (4,8)) positioned next to an LED stud 2(x,y) that emits light along the trajectory TR5 emits light.

[0032] The LED stud 2(x,y) that emits light based on the approach notification information is located to the left of the LED stud 2(x,y) that emits light along the trajectory TR5 (the direction is based on the moving direction of the moving body 5). By illuminating the LED stud 2(x,y) at such a position, it is possible to notify the moving body 5 of the relative position of the moving body 5 with the moving direction of the moving body 5 as the reference. The color (specific color) of the LED stud 2(x,y) that emits light based on the approach notification information is set to a color different from that of the LED stud 2 that emits light along the trajectory TR5. In addition, the brightness level of this specific color is set to the same brightness level as the specific color of the LED stud 2 that emits light along the trajectory TR5 described in FIG. 2.

[0033] As described above, according to the embodiment, when it is determined that a moving body MB is approaching a moving body MA, the LED stud 2(x, y) that emits light based on the approach notification information can alert the moving body MA to the approach of the moving body MB. Furthermore, by setting the color of the LED stud 2(x, y) that emits light based on the approach notification information to a color different from that of the LED stud 2 that emits light along the trajectory TR of the moving body MA, it is possible to make the moving body MA more aware of the approach of the moving body MB. Therefore, it is possible to ensure the traffic safety of the moving body MA. The embodiment will be described in more detail below.

[0034] 2. Mobility Support System 2-1. System configuration example Fig. 5 is a diagram showing an example of the configuration of a mobility assistance system according to an embodiment. In the example shown in Fig. 5, the mobility assistance system includes an LED stud group 2m, an infrastructure camera group 3n, and a server 4. The LED stud group 2m and the infrastructure camera group 3n communicate with the server 4 via a communication network 8. The communication network 8 is not particularly limited, and a wired or wireless network may be used.

[0035] The LED stud group 2m includes m LED studs 2 (m≧1). The installation locations of the m LED studs 2 are known. Each LED stud 2 operates according to the support display information LUM(x,y) received from the server 4, and illuminates the surroundings of its location. The support display information LUM(x,y) includes, for example, instruction information for the LED stud 2(x,y). Examples of instruction information include luminous color information and brightness information. The luminous color information is information indicating the color emitted by the light source of the LED stud 2(x,y), such as purple, blue, green, yellow, orange, or red. The brightness information is information indicating the brightness level of the light source of the LED stud 2(x,y).

[0036] The infrastructure camera group 3n includes n infrastructure cameras 3 (n≧1). The installation locations of the n infrastructure cameras 3 are known. Each infrastructure camera 3 captures an image of a predetermined range set for each infrastructure camera 3. The predetermined image capture range is also known. Each infrastructure camera 3 transmits camera information CAM to the server 4. The camera information CAM includes, for example, ID information of the infrastructure camera 3 that transmitted the camera information CAM and image information acquired by this infrastructure camera 3.

[0037] The server 4 includes an information processing device 41 and a database 42. The information processing device 41 includes at least one processor 43 and at least one memory 44. The processor 43 includes a CPU (Central Processing Unit). The memory 44 is a volatile memory such as a DDR memory, and expands various programs used in the various processes performed by the processor 43 and temporarily stores various information. The various information used by the processor 43 includes camera information CAM and map information MAP stored in the database 12.

[0038] The database 42 is formed in a predetermined storage device (for example, a hard disk or a flash memory). The database 42 stores map information MAP. The map information MAP includes data on the specifications of man-made objects such as buildings, roads, and railways (for example, type, size, central position or latitude, longitude, and height of one or more representative positions), as well as data on the specifications of natural objects such as rivers and lakes. The map information MAP also includes data on the installation positions of the LED stud group 2m and the infrastructure camera group 3n. The map information MAP further includes data on the specifications of each infrastructure camera 3 included in the infrastructure camera group 3n. The data on the specifications of each infrastructure camera 3 includes information on the angle of view of each infrastructure camera (i.e., information on a predetermined imaging range).

[0039] 2-2. Example of processing by the server 6 and 7 are flowcharts illustrating the flow of processing particularly related to the embodiment, which is performed in the server 4 (processor 43). The processing routines shown in Figs. 6 and 7 are repeatedly executed at predetermined intervals.

[0040] 6, first, the camera information CAM is acquired (step S11). As already explained, the camera information CAM includes the ID information of the infrastructure camera 3 that transmitted the camera information CAM and the image information acquired by the infrastructure camera 3. The image information may include information about the time when the image information was acquired.

[0041] Following the processing of step S11, object recognition processing is performed (step S12). In the object recognition processing, moving objects included in the image captured by the infrastructure camera 3 are recognized. The method for recognizing these moving objects is not particularly limited, and known methods can be applied. An example of a known method is an object recognition method using a machine learning model. When a moving object is recognized by the object recognition processing, identification information is assigned to the recognized moving object. Examples of this identification information include number information assigned to each moving object, type information of the recognized moving object (e.g., pedestrian, wheelchair, self-propelled robot, bicycle, etc.), and feature amount information of the recognized moving object.

[0042] Following the processing of step S12, it is determined whether or not a moving object has been recognized (step S13). If identification information has been generated in the processing of step S12, the determination result of step S13 is positive. If the determination result of step S13 is positive, a tracking process of the moving object is performed (step S14). This tracking process of the moving object is not particularly limited, and a known method can be applied. An example of a known method is a method (re-identification) of associating a moving object recognized in multiple frames based on feature amount information of the moving object.

[0043] By performing the tracking process, the moving speed and moving direction of the moving object recognized in the process of step S12 are calculated. Tracking information is generated for the moving object whose moving speed and moving direction have been calculated. This tracking information is stored in memory 44, for example, in combination with the identification information of the moving object.

[0044] 7, first, tracking information is acquired (step S21). Tracking information is generated for each moving object. Therefore, in the processing of step S21, tracking information for all moving objects present on the road 1 is acquired.

[0045] Following the processing of step S21, a trajectory TR is calculated (step S22). The calculation of the trajectory TR is performed for each moving object based on the tracking information (moving speed and moving direction) acquired in the processing of step S21. The length of the trajectory TR corresponds to the distance that the moving object is predicted to travel in a few seconds (2 to 4 seconds) from the current time.

[0046] Following the processing of step S22, it is determined whether or not there are any moving objects in a close relationship (step S23). For example, if only one trajectory TR is generated in the processing of step S22, the determination result of step S23 will be negative. On the other hand, if two or more trajectories TR are generated in the processing of step S22, the determination result of step S23 may be positive. That is, if the distance DS between two moving objects corresponding to any two trajectories TR selected from the two or more trajectories TR is equal to or less than a predetermined distance THD and the relative speed RS of the two moving objects is equal to or greater than a predetermined speed THS, the determination result of step S23 will be positive. If the determination result of step S23 is negative, the processing of step S24 is performed. On the other hand, if the determination result is positive, the processing of step S25 is performed.

[0047] In the process of step S24, support display information LUM(x, y) is generated based on at least one trajectory TR generated in the process of step S22. The support display information LUM(x, y) includes, for example, instruction information for the LED stud 2(x, y). Examples of the instruction information include luminous color information and brightness information. When two or more trajectories TR are generated in the process of step S22, luminous color information is generated so that the luminous color of the LED stud 2(x, y) located around one trajectory TR is different from that of the LED stud 2(x, y) located around another trajectory TR.

[0048] It is desirable that the color assigned as the luminous color of the LED studs 2(x, y) located around a certain track TR remains assigned without change until the moving object corresponding to this track TR is no longer recognized on the road 1. Therefore, when generating the luminous color information, it is desirable that colors such as purple, blue, green, yellow, orange, and red are assigned to each track TR in order according to the order in which the moving objects are recognized on the road 1.

[0049] Furthermore, the brightness level included in the brightness information is higher than the brightness level of the LED studs 2(x,y) that are not located around the track TR. Here, the brightness level of the LED studs 2(x,y) that are not located around the track TR is set, for example, according to the ambient illuminance of the road surface of the road 1. For example, consider a case where the brightness level is expressed in five levels and the ambient illuminance of the road surface of the road 1 is low (for example, at night). In this case, the brightness level of the LED studs 2(x,y) that are not located around the track TR is set to "Level 2-3." On the other hand, when the street lights installed on the road 1 are on even at night, the brightness level is set to "Level 1-2."

[0050] In the process of step S25, approach notification information is generated. The approach notification information is generated as information for the approached moving body (for example, moving body MA) of the two moving bodies (i.e., moving bodies MA and MB) determined to be in an approaching relationship in the process of step S23. The approach notification information is information for making the LED stud 2(x,y) located next to the LED stud 2(x,y) that emits light along the trajectory TR of the approached moving body emit light in a specific color with a high level of brightness.

[0051] The LED stud 2(x,y) located next to the LED stud 2(x,y) that emits light along the trajectory TR of the moving body is, for example, an LED stud 2(x,y) located on at least one of the left and right sides when the moving direction of the moving body is used as a reference. If the relative position (left or right) of the approaching moving body (e.g., moving body MB) is known, this LED stud 2(x,y) may be only the LED stud 2(x,y) on the relative position side. If the approaching moving body is located directly behind the approached moving body, this LED stud 2(x,y) is preferably an LED stud 2(x,y) located on the left and right sides. The LED stud 2(x,y) located in front or behind when the moving direction of the moving body is used as a reference may be combined with an LED stud 2(x,y) located on the left or right side to indicate the exact relative position (e.g., left front, right rear) of the approaching moving body.

[0052] Following the processing of step S25, support display information LUM(x, y) is generated (step S26). The support display information LUM(x, y) generated in the processing of step S26 is based on the trajectories TR of the two moving objects determined to be in a close relationship in the processing of step S23. The support display information LUM(x, y) generated in the processing of step S26 is also for the LED stud 2(x, y) identified by the approach notification information generated in the processing of step S25.

[0053] Following the processing of step S24 or S26, the support display information LUM(x, y) is transmitted to each LED stud 2 (step S27). Upon receiving the support display information LUM(x, y), the LED stud 2(x, y) emits light based on the instruction information contained in this information. [Explanation of symbols]

[0054] 1 Road 2 LED stud 2m LED stud group 3 Infrastructure camera 3n Infrastructure camera group 4 Server 5, 6, 7 Mobile body 41 Information processing device 42 Database 43 Processor 44 Memory TR5, TR6, TR7 Track CAM Camera information LUM(x, y) Support display information

Claims

1. A method for supporting movement of a mobile object, performed by a server, comprising: A step of recognizing a moving object included in an image of an infrastructure camera; outputting, from a road surface lighting device, an assistance display that assists movement of the moving object based on the recognition information of the moving object; Including, If the recognition information of the moving bodies includes recognition information of a first and a second moving body, calculating a relative speed of the second moving body in the moving direction of the first moving body and a distance between these moving bodies based on the recognition information of the first and the second moving bodies; generating approach notification information that notifies the first moving body of the approach of the second moving body when the relative speed is equal to or greater than a predetermined speed and the distance is equal to or less than a predetermined distance; Further comprising: When the approach notification information is generated, in the step of outputting the assistance display, an assistance display corresponding to the approach notification information is output from the road surface lighting device; The road surface lighting device includes a plurality of LED studs installed on the road surface, In the step of outputting the support display, the support display for supporting the movement of the moving object is output by illuminating a plurality of LED studs arranged along a future trajectory of the moving object predicted using the recognition information of the moving object, When the approach notification information is generated, a support display corresponding to the approach notification information is performed by illuminating a plurality of LED studs located next to a plurality of LED studs that emit light along a future trajectory of the first moving body; The light emitting color of the plurality of LED studs that emit light along the future trajectory of the first moving body is different from that of the plurality of LED studs that emit light based on the support display corresponding to the approach notification information. A method for supporting movement of a moving body, comprising:

2. A system for supporting movement of a moving body, Infrastructure cameras installed around the road, a road surface lighting device that illuminates the road surface; a processor configured to perform various processes; Equipped with the processor: A process of recognizing a moving object included in an image of the infrastructure camera; a process of causing the road surface lighting device to output an assistance display that assists the movement of the moving object based on the recognition information of the moving object; configured to: The processor further comprises: a process of calculating, when the recognition information of the moving bodies includes recognition information of a first and a second moving body, a relative speed of the second moving body in the moving direction of the first moving body and a distance between these moving bodies based on the recognition information of the first and the second moving bodies; a process of generating approach notification information that notifies the first moving body of the approach of the second moving body when the relative speed is equal to or greater than a predetermined speed and the distance is equal to or less than a predetermined distance; configured to: When the approach notification information is generated, in a process of causing the road surface lighting device to output the assistance indication, an assistance indication corresponding to the approach notification information is output from the road surface lighting device, The road surface lighting device includes a plurality of LED studs installed on the road surface, The processor is further configured to perform processing to predict a future trajectory of the moving object using the recognition information of the moving object; In the process of outputting the assistance display from the road surface lighting device, the output of the assistance display for assisting the movement of the moving object is performed by illuminating a plurality of LED studs positioned around a future trajectory of the moving object, When the approach notification information is generated, a support display corresponding to the approach notification information is performed by illuminating a plurality of LED studs located next to a plurality of LED studs that emit light along a future trajectory of the first moving body; The light emitting color of the plurality of LED studs that emit light along the future trajectory of the first moving body is different from that of the plurality of LED studs that emit light based on the support display corresponding to the approach notification information. A mobility support system for a mobile object.

Images