Information processing device and method of operating the system

The information processing system enhances pedestrian awareness of roadside device information by using a server-device-triggered notification system, improving the accuracy of walking assistance transmission.

JP7948168B2Active Publication Date: 2026-11-11TOYOTA JIDOSHA KK
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2023223215
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-12-28
Publication Date
2026-11-11
Estimated Expiration
2043-12-28

AI Technical Summary

Technical Problem

Existing systems fail to reliably transmit information to pedestrians due to their unawareness of roadside devices, leading to potential safety risks.

Method used

An information processing system comprising a server device, mobile terminal, and roadside device that communicates location information to trigger notification actions when the terminal is within a specific distance from the roadside device, enhancing pedestrian awareness of support information.

Benefits of technology

Improves the accuracy of transmitting walking assistance information to pedestrians by using notification actions on both roadside devices and mobile terminals.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007948168000001
    Figure 0007948168000001
  • Figure 0007948168000002
    Figure 0007948168000002
  • Figure 0007948168000003
    Figure 0007948168000003
Patent Text Reader

Abstract

To improve the accuracy for transmitting information for assisting in walking to a walker.SOLUTION: An information processing includes: a storage unit that stores information on a position of a roadside device which provides assistance information for assisting in walking to a walker; a communication unit; and a control unit that performs communications via the communication unit. The control unit transmits first instruction information to a portable terminal for causing the portable terminal to perform a notification action for alerting the walker carrying the portable terminal when the portable terminal is positioned at a first distance from the roadside device.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus and a method for operating a system.

Background Art

[0002] Roadside devices such as traffic signals that alert pedestrians by voice or the like to support the safe walking of pedestrians walking on roads are known. Patent Document 1 discloses a notification system that notifies other vehicles, pedestrians, and the like of permission to pass or alerts according to the behavior of an autonomous vehicle scheduled to pass through a predetermined traffic area.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] If a pedestrian, for example, does not notice that information is notified to them, or does not notice the existence of the roadside device itself, there is a risk that information for supporting walking will not be reliably transmitted to the pedestrian. Accordingly, there is room for improving the accuracy of transmitting information for supporting walking to pedestrians.

[0005] The present disclosure relates to an information processing apparatus and the like that can improve the accuracy of transmitting information for supporting walking to pedestrians.

Means for Solving the Problems

[0006] The information processing in this disclosure includes a storage unit that stores location information of a roadside device that presents support information to assist pedestrians in walking, a communication unit, and a control unit that communicates using the communication unit, wherein the control unit sends first instruction information to the mobile terminal to cause the mobile terminal to perform a notification operation to alert the pedestrian carrying the mobile terminal when the mobile terminal is located at a first distance from the roadside device.

[0007] The method of operating a system in this disclosure is a method of operating a system having an information processing device having location information of a roadside device that presents support information for assisting pedestrians to walk, and a mobile terminal, wherein the information processing device sends first instruction information to cause the mobile terminal to perform a notification operation to draw the attention of a pedestrian carrying the mobile terminal when the mobile terminal is located at a first distance from the roadside device, and the mobile terminal performs the notification operation based on the first instruction information. [Effects of the Invention]

[0008] The information processing device described in this disclosure makes it possible to improve the accuracy of transmitting information to pedestrians to assist them in walking. [Brief explanation of the drawing]

[0009] [Figure 1] This is a diagram showing an example of the configuration of an information processing system. [Figure 2] This figure shows an example of the operating procedure for an information processing system. [Figure 3] This figure shows an example of the operating procedure for an information processing device. [Figure 4] This diagram shows a modified example of the operating procedure of an information processing device. [Modes for carrying out the invention]

[0010] The embodiments will be described below with reference to the drawings.

[0011] Figure 1 shows an example of the configuration of an information processing system in one embodiment. The information processing system 1 has one or more server devices 10, mobile terminals 12, roadside devices 14, and vehicles 15, each connected to each other via a network 11 in a manner that enables information communication.

[0012] The server device 10 is, for example, a server computer belonging to a cloud computing system or other computing system, and functions as a server that implements various functions. The server device 10 may consist of two or more server computers that are connected and operate in cooperation with each other. The server device 10 corresponds to the "information processing device" in this embodiment.

[0013] Network 11 may be the Internet, for example, but may also include mobile communication networks, ad hoc networks, LANs (Local Area Networks), MANs (Metropolitan Area Networks), or other networks or any combination thereof.

[0014] The mobile terminal 12 is a terminal device carried by a pedestrian, having information communication functions that connect to the network 11 via mobile communication, and configured to perform various information processing and information output. The mobile terminal 12 has one or more GNSS receivers and is configured to detect its current location. The mobile terminal 12 is, for example, a smartphone, smartwatch, or wearable device.

[0015] The roadside device 14 is installed along the roadway 16, such as at the edge of the sidewalk closest to the roadway 16, and is equipped with a camera that photographs the sidewalk, a processor that performs information processing, a display that outputs information, a speaker, etc. The roadside device 14 may also have a communication function that allows it to communicate information with the server device 10 via the network 11. When the roadside device 14 captures an image that includes pedestrians 13 walking on the sidewalk, it displays or outputs various information to assist the pedestrians 13 in walking. The roadside device 14 can operate using a built-in battery, for example, without receiving power from an external source.

[0016] Vehicle 15 is a passenger car or commercial vehicle equipped with communication and information processing functions, and is connected to network 11 by mobile communication. Vehicle 15 also has one or more GNSS receivers and is configured to detect its current position. Vehicle 15 may be driven by a driver, or its operation may be automated at any level (for example, any of levels 1 to 5 in the SAE (Society of Automotive Engineers)). Vehicle 15 may also be an electric vehicle or a hybrid vehicle that uses battery power for at least a portion of the energy for driving.

[0017] In the information processing system 1, the server device 10 includes a communication unit 101, a storage unit 102, and a control unit 103. The storage unit 102 stores location information of the roadside device 14, which presents support information to assist pedestrians 13 in walking. The control unit 103 communicates with a mobile terminal 12, etc., via the communication unit 101. When the mobile terminal 12 is located at a predetermined distance from the roadside device 14, the control unit 103 sends instruction information to the mobile terminal 12 to perform a notification action to draw the attention of the pedestrian 13 carrying the mobile terminal 12. According to the operation of the server device 10, when the pedestrian 13 approaches the roadside device 14 within a predetermined distance, the mobile terminal performs the notification action. The notification action is an action to draw the attention of the pedestrian 13 to the roadside device 14 or the information presented by the roadside device 14, and includes, for example, the sound of a notification, the generation of vibration, the display of a notification message, etc. The notification action increases the likelihood that pedestrian 13 will pay attention to the roadside device 14 or the support information presented by the roadside device 14. When the roadside device 14 detects the approach of pedestrian 13 using captured images, it outputs support information to assist walking, such as the presence and location of a crosswalk or the approach of a vehicle 15, either by display or voice. In this way, the accuracy of transmitting information to assist walking from the roadside device 14 to pedestrian 13 can be improved.

[0018] The configurations of the server device 10 will be described in detail below. The server device 10 includes a communication unit 101, a storage unit 102, and a control unit 103. These configurations are appropriately arranged in two or more computers when the server device 10 is composed of two or more server computers.

[0019] The communication unit 101 includes one or more communication interfaces. These communication interfaces are, for example, LAN interfaces. The communication unit 101 receives information used in the operation of the server device 10 and transmits information obtained through the operation of the server device 10. The server device 10 is connected to the network 11 via the communication unit 101 and communicates information with mobile terminals 12 and the like via the network 11.

[0020] The storage unit 102 includes, for example, one or more semiconductor memories, one or more magnetic memories, one or more optical memories, or a combination of at least two types thereof, which function as a main storage device, an auxiliary storage device, or a cache memory. The semiconductor memory is, for example, a RAM (Random Access Memory) or a ROM (Read Only Memory). The RAM is, for example, an SRAM (Static RAM) or a DRAM (Dynamic RAM). The ROM is, for example, an EEPROM (Electrically Erasable Programmable ROM). The storage unit 102 stores information used for the operation of the server device 10 and information obtained by the operation of the server device 10.

[0021] The control unit 103 includes one or more processors, one or more dedicated circuits, or a combination thereof. The processor is, for example, a general-purpose processor such as a CPU (Central Processing Unit), or a dedicated processor such as a GPU (Graphics Processing Unit) specialized for specific processing. The dedicated circuit is, for example, an FPGA (Field-Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), or the like. The control unit 103 executes information processing related to the operation of the server device 10 while controlling each unit of the server device 10.

[0022] The functions of the server device 10 are realized by the processor included in the control unit 103 executing a control program. The control program is a program for causing a computer to function as the server device 10. Further, part or all of the functions of the server device 10 may be realized by a dedicated circuit included in the control unit 103. Further, the control program may be stored in a non-transitory recording and storage medium readable by the server device 10, and the server device 10 may read the program from the medium.

[0023] Figure 2 is a sequence diagram illustrating the operation procedure of the information processing system 1 in this embodiment. Figure 2 shows the procedure for the coordinated operation of the server device 10, the mobile terminal 12, the roadside device 14, and the vehicle 15.

[0024] In steps S20 and S21, the server device 10 acquires location information from the vehicle 15 and the mobile terminal 12, respectively. The vehicle 15 and the mobile terminal 12 send information about their current location, detected using a GNSS receiver, to the server device 10. Steps S20 and S21 are performed at arbitrary intervals, for example, every few seconds.

[0025] In step S22, the server device 10 generates instruction information using the location information of the mobile terminal 12 and the vehicle 15. The instruction information includes an information presentation instruction to cause the roadside device 14 to output information to support the walking of the pedestrian 13 (hereinafter referred to as support information), and a notification operation instruction to cause the mobile terminal 12 to perform a notification operation. A detailed example of the procedure in step S22 is shown in Figure 3.

[0026] Figure 3 shows an example of the procedure for generating instruction information by the server device 10. Each step in Figure 3 is executed by the control unit 103 of the server device 10.

[0027] In step S30, the control unit 103 acquires the location information of the roadside devices 14. The storage unit 102 has in advance stored the location information of one or more roadside devices 14 in any given block. The control unit 103 reads and acquires the location information of each roadside device 14 from the storage unit 102.

[0028] In step S31, the control unit 103 acquires the location information of the vehicle 15. The memory unit 102 stores a history of location information periodically sent from the vehicle 15 operating within any given city block. The control unit 103 reads and acquires the most recent location information of each vehicle 15 from the memory unit 102.

[0029] In step S32, the control unit 103 determines whether a vehicle 15 is approaching each roadside device 14. Since the roadside devices 14 are installed on the roadside of the roadway 16, the control unit 103 determines whether one or more vehicles 15 are located within an arbitrary reference distance range from the roadside device 14 on the roadway 16 that the roadside device 14 faces. The reference distance is, for example, the distance at which it is desirable to notify pedestrians of the approach of a vehicle 15 when a pedestrian is expected to cross the roadway 16 at the location where the roadside device 14 is installed, and is, for example, 30m to 100m. Using the position information of the roadside device 14 and the vehicles 15, the control unit 103 derives the distance to the nearest vehicle 15 for each roadside device 14, and determines that a vehicle 15 is approaching the roadside device 14 if that distance is smaller than the reference distance, and determines that a vehicle 15 is not approaching the roadside device 14 otherwise. The control unit 103 proceeds to step S33 if the vehicle 15 is approaching the roadside device 14 (Yes), and to step S35 if the vehicle 15 is not approaching the roadside device 14 (No).

[0030] In step S33, the control unit 103 generates instruction information for issuing a warning for each roadside device 14 that it has determined is approaching a vehicle 15. The instruction information for issuing a warning is information that instructs the roadside device 14 to issue warning support information. The warning support information may be text information such as "A vehicle is approaching, please be careful," or audio information.

[0031] Meanwhile, in step S35, the control unit 103 generates instruction information for normal assistance for each roadside device 14 that it has determined is not approaching a vehicle 15. The instruction information for normal assistance is information that instructs the roadside device 14 to display normal assistance information. Normal assistance information includes, for example, text information such as "There is a pedestrian crossing in 5 meters," and audio information.

[0032] In step S36, the control unit 103 determines whether a pedestrian 13 is approaching each roadside device 14. Since the roadside devices 14 are installed on the roadside of the roadway, the control unit 103 determines whether one or more pedestrians 13 are located within an arbitrary reference distance range from the roadside device 14 on the sidewalk where the roadside device 14 is installed. The reference distance is, for example, a distance at which it is desirable to draw the attention of the pedestrian 13 to the support information output by the roadside device 14, for example, 3m to 10m. The control unit 103 uses the location information of the roadside device 14 and the mobile terminal 12 carried by the pedestrian 13 to determine the distance to the nearest mobile terminal 12 for each roadside device 14. If this distance is smaller than the reference distance, the control unit 103 determines that the pedestrian 13 is approaching the roadside device 14; otherwise, the control unit 103 determines that the pedestrian 13 is not approaching the roadside device 14. If the pedestrian 13 is approaching the roadside device 14 (Yes), the control unit 103 proceeds to step S37, and if the pedestrian 13 is not approaching the roadside device 14 (No), it skips step S37 and terminates the procedure shown in Figure 3.

[0033] In step S37, the control unit 103 generates instruction information for notification operation for each roadside device 14 that it has determined is approaching a pedestrian 13. The instruction information for notification operation is information to instruct the roadside device 14 to perform a notification operation.

[0034] Then, the control unit 103 completes the procedure shown in Figure 3.

[0035] Returning to Figure 2, in step S23, the server device 10 sends instruction information to the roadside device 14, instructing the display of warning or normal support information generated in step S22. The control unit 103 sends instruction information via the communication unit 101 to each roadside device 14 corresponding to the instruction information. When each roadside device 14 receives the instruction information via its communication module, it stores the instruction information in its built-in storage device.

[0036] In step S25, the roadside device 14 detects a pedestrian 13. The processor of the roadside device 14 performs arbitrary image processing, such as pattern recognition, on the captured image of the sidewalk and detects an image indicating a person, thereby detecting the pedestrian 13.

[0037] If pedestrian 13 is detected, in step S26, the roadside device 14 presents support information to pedestrian 13. The processor of the roadside device 14 outputs support information for warnings or normal assistance according to the instruction information received from the server device 10. For example, in the case of support information for warnings, the roadside device 14 displays text information such as "A car is approaching, please be careful" or outputs it as an audible message. Alternatively, in the case of support information for normal assistance, the roadside device 14 outputs an audible message such as "There is a crosswalk in 5 meters." If pedestrian 13 is not detected, step S26 is omitted.

[0038] Meanwhile, in step S24, the server device 10 sends instruction information to the mobile terminal 12 to instruct the notification operation generated in step S22. The control unit 103 sends the instruction information to each mobile terminal 12 corresponding to the instruction information via the communication unit 101. When each mobile terminal 12 receives the instruction information via its communication module, it stores the instruction information in its built-in storage device.

[0039] In step S27, the mobile terminal 12 performs a notification action. The processor of the mobile terminal 12 performs an arbitrary notification action in accordance with the instruction information received from the server device 10. For example, the processor performs a notification action by outputting a notification sound from the speaker, generating vibrations with an actuator, flashing the display, or displaying a message. Through such a notification action, the mobile terminal 12 can stimulate the pedestrian 13 and draw their attention to the support information output by the roadside device 14.

[0040] According to the procedure described above, it becomes possible to improve the accuracy of transmitting information to the pedestrian 13 for the purpose of assisting walking by the roadside device 14.

[0041] Figure 4 shows the procedure for a modified version of Figure 3. The procedure in Figure 4 differs from that in Figure 3 in that, if the vehicle 15 is not approaching the roadside device 14 in step S32 (No), the procedure in Figure 3 is terminated instead of proceeding to step S36. According to the procedure in Figure 4, if the vehicle 15 is not approaching the roadside device 14, instruction information for executing a notification operation to the mobile terminal 12 is not generated. Therefore, the transmission of instruction information from the server device 10 in step S24 of Figure 2 is omitted. This avoids unnecessarily bothering pedestrians 13 when the vehicle 15 is not approaching.

[0042] In the above-described embodiment, the server device 10 causes the roadside device 14 to present different support information depending on the distance between the roadside device 14 and the vehicle 15. However, this embodiment also applies when the roadside device 14 presents support information upon detecting a pedestrian 13 without receiving instructions from the server device 10. When a pedestrian 13 approaches the roadside device 14 carrying a mobile terminal 12, the mobile terminal 12 can perform a notification action, stimulating the pedestrian 13 and drawing their attention to the support information output by the roadside device 14.

[0043] In a further modification, the server device 10 may send the location information of each roadside device 14 as instruction information to the mobile terminal 12. In that case, each roadside device 12 may determine its approach to the roadside device 14 based on its own location information and the location information of the roadside device 14, and perform a notification operation.

[0044] In the above embodiment, the processing and control program that causes the mobile terminal 12 to execute an instruction operation is stored in the server device 10 or the storage unit of another server device and can be downloaded to the mobile terminal 12 via the network 11.

[0045] As described above, embodiments have been explained based on various drawings and examples, but it should be noted that those skilled in the art will find it easy to make various modifications and alterations based on this disclosure. Therefore, it should be noted that these modifications and alterations are within the scope of this disclosure. For example, the functions, etc., included in each means, each step, etc., can be rearranged in a logically consistent manner, and multiple means, steps, etc., can be combined into one or divided. [Explanation of symbols]

[0046] 1. Information Processing System 10 Server devices 11 Network 12 Mobile devices 13 Pedestrians 14 Roadside equipment 15 vehicles 101 Communications Department 102 Storage section 103 Control Unit

Claims

1. A storage unit that stores location information of a roadside device that presents support information to pedestrians to assist them in walking, Communications Department and, The system includes a control unit that performs communication using the aforementioned communication unit, If the control unit determines, based on the location information of the roadside device and the location information of the mobile terminal, that the mobile terminal is located within a first distance from the roadside device, it sends first instruction information to the mobile terminal to cause the mobile terminal to perform a notification operation to draw the attention of the pedestrian carrying the mobile terminal to the roadside device or the support information presented by the roadside device when the mobile terminal is located within the first distance from the roadside device. An information processing device having

2. In claim 1, The control unit sends a second instruction to the roadside device to cause the roadside device to present the support information when the vehicle is located at a second distance from the roadside device. Information processing device.

3. In claim 2, The control unit sends the first instruction information on the condition that the vehicle is located at the second distance from the roadside device. Information processing device.

4. In claim 1, The control unit generates a third instruction information that causes the roadside device to present different support information depending on the distance from the roadside device to the vehicle. Information processing device.

5. A method for operating a system having an information processing device and a portable terminal that have location information of a roadside device that presents support information to pedestrians to assist them in walking, If the information processing device determines, based on the location information of the roadside device and the location information of the mobile terminal, that the mobile terminal is located within a first distance from the roadside device, it sends first instruction information to cause the mobile terminal to perform a notification operation to draw the attention of the pedestrian carrying the mobile terminal to the roadside device or the support information presented by the roadside device when the mobile terminal is located within the first distance from the roadside device. The mobile terminal performs the notification operation based on the first instruction information. How it works.

Citation Information

Patent Citations

  • Information processing method, information processing apparatus, program and information processing system

    JP2021144539A

  • Notification system

    JP2023050629A