Information processing apparatus and operation method of system

Abstract

The invention relates to an information processing apparatus and an operation method of a system. The information processing apparatus includes: a storage unit that stores information on a position of a roadside device that presents assistance information for assisting walking to a pedestrian; a communication unit; and a control unit that performs communication via the communication unit, the control unit transmitting, to a portable terminal, first instruction information for causing the portable terminal to execute a notification operation for alerting a pedestrian carrying the portable terminal when the portable terminal is located at a first distance from the roadside device.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus and a method for operating a system. Background Art

[0002] In order to assist a pedestrian walking on a road in safe walking, there are known roadside devices such as signal lights that give attention reminders to pedestrians using sounds or the like. Patent Document 1 discloses a reporting system that reports to other vehicles, pedestrians, etc. whether passage is possible, gives attention reminders, etc. based on the behavior of an autonomous driving vehicle that passes through a predetermined traffic area.

[0003] Patent Document 1: Japanese Unexamined Patent Application Publication No. 2023 - 50629

[0004] There is a concern that if a pedestrian, for example, does not notice the information notified to himself / herself or does not notice the existence of the roadside device itself, the information for assisting walking cannot be reliably transmitted to the pedestrian. Therefore, there is room for improving the accuracy of transmitting the information for assisting walking to the pedestrian. Summary of the Invention

[0005] The present disclosure relates to an information processing apparatus and the like that can improve the accuracy of transmitting information for assisting walking to a pedestrian.

[0006] The information processing apparatus in the present disclosure includes: a storage unit that stores information on the positions of roadside devices that present auxiliary information for assisting a pedestrian in walking; a communication unit; and a control unit that communicates through the communication unit, and the control unit sends first instruction information for causing the portable terminal to perform a notification action, the notification action being for reminding a pedestrian carrying the portable terminal to pay attention when the portable terminal is at a first distance from the roadside device.

[0007] The method for operating a system in the present disclosure is a method for operating a system including an information processing apparatus and a portable terminal, the information processing apparatus having information on the positions of roadside devices that present auxiliary information for assisting a pedestrian in walking, wherein the information processing apparatus sends first instruction information for causing the portable terminal to perform a notification action, the notification action being for reminding a pedestrian carrying the portable terminal to pay attention when the portable terminal is at a first distance from the roadside device, and the portable terminal performs the notification action based on the first instruction information.

[0008] According to the information processing apparatus and the like in the present disclosure, the accuracy of transmitting information for assisting walking to a pedestrian can be improved. Brief Description of the Drawings

[0009] Figure 1 It is a diagram showing a configuration example of an information processing system.

[0010] Figure 2 It is a diagram showing an example of the operation steps of an information processing system.

[0011] Figure 3 It is a diagram showing an example of the operation steps of an information processing device.

[0012] Figure 4 It is a diagram showing a modified example of the operation steps of an information processing device. Detailed implementation

[0013] Hereinafter, the implementation will be described with reference to the accompanying drawings.

[0014] Figure 1 It is a diagram showing a configuration example of an information processing system in one implementation. The information processing system 1 has one or more server devices 10, portable terminals 12, roadside devices 14, and vehicles 15 that are connected to each other via a network 11 so as to be able to communicate information.

[0015] The server device 10 belongs to, for example, a cloud computing system or other computing systems, and is a server computer that functions as a server for installing various functions. The server device 10 may also be composed of two or more server computers that are connected to be able to communicate information and cooperate. The server device 10 corresponds to the "information processing device" in the present implementation.

[0016] The network 11 is, for example, the Internet, but includes a mobile communication network, an ad hoc network, a LAN (Local Area Network), a MAN (Metropolitan Area Network), or other networks or any combination thereof.

[0017] The portable terminal 12 is a terminal device carried by a pedestrian that has an information communication function connected to the network 11 via mobile communication and is configured to be able to execute various information processing and information output. The portable terminal 12 has one or more GNSS receivers and is configured to be able to detect the current position. The portable terminal 12 is, for example, a smart phone, a smart watch, a wearable terminal, etc.

[0018] The roadside device 14 is a device provided along the lane 16 in the sidewalk near the end of the lane 16, etc., equipped with a camera for photographing the sidewalk side, a processor for information processing, a display for information output, a speaker, etc. The roadside device 14 may have a communication function capable of communicating information with the server device 10 via the network 11. If the roadside device 14 captures a captured image including a pedestrian 13 walking on the sidewalk, it outputs various information for assisting the walking of the pedestrian 13 through display or sound. Among them, the roadside device 14 can operate, for example, by an internal battery without receiving power supply from the outside.

[0019] The vehicle 15 is a passenger vehicle or a commercial vehicle equipped with a communication function and an information processing function, and is connected to the network 11 through mobile communication. In addition, the vehicle 15 is configured to have one or more GNSS receivers and can detect the current position. The vehicle 15 can be driven by a driver or the driving can be automated at any level (for example, any level from level 1 to level 5 in SAE (Society of Automotive Engineers)). In addition, the vehicle 15 can be an electric vehicle or a hybrid vehicle that uses electric power of a battery for at least a part of the energy for traveling.

[0020] In the information processing system 1, the server device 10 includes a communication unit 101, a storage unit 102, and a control unit 103. The storage unit 102 stores information on the positions of the roadside devices 14 that prompt auxiliary information for assisting walking to the pedestrians 13. The control unit 103 communicates with the portable terminal 12 and the like through the communication unit 101. The control unit 103 transmits instruction information for causing the portable terminal 12 to perform a notification action for reminding the pedestrian 13 carrying the portable terminal 12 when the portable terminal 12 is at a specified distance from the roadside device 14. According to the operation of the server device 10, when the pedestrian 13 approaches to a specified distance from the roadside device 14, the portable terminal performs the notification action. The notification action is an action for reminding the pedestrian 13 to pay attention to the roadside device 14 or the information prompted by the roadside device 14, and includes, for example, sounding a notification sound, generating vibration, displaying a notification message, and the like. Through the notification action, the possibility that the pedestrian 13 notices the roadside device 14 or the auxiliary information prompted by the roadside device 14 becomes higher. If the approach of the pedestrian 13 is detected by capturing an image, the roadside device 14 outputs auxiliary information for assisting walking, such as information for notifying the pedestrian 13 of the existence, position, and approach of the vehicle 15 of the crosswalk, by display or sound. In this way, the accuracy of transmitting the information for assisting walking performed by the roadside device 14 to the pedestrian 13 can be improved.

[0021] Each component of the server device 10 will be described in detail. The server device 10 includes a communication unit 101, a storage unit 102, and a control unit 103. In the case where the server device 10 is composed of two or more server computers, these components are appropriately arranged in two or more computers.

[0022] The communication unit 101 includes one or more communication interfaces. The communication interface is, for example, a LAN interface. The communication unit 101 receives information used in the operation of the server device 10 and also transmits information obtained through the operation of the server device 10. The server device 10 is connected to the network 11 through the communication unit 101 and performs information communication with the portable terminal 12 and the like via the network 11.

[0023] The storage unit 102 includes, for example, one or more semiconductor memories, one or more magnetic memories, one or more optical memories, or a combination of at least two of them that function as a main storage device, an auxiliary storage device, or a cache memory. The semiconductor memory is, for example, a RAM (Random Access Memory) or a ROM (Read Only Memory). The RAM is, for example, an SRAM (Static RAM) or a DRAM (Dynamic RAM). The ROM is, for example, an EEPROM (Electrically Erasable Programmable ROM). The storage unit 102 stores information used in the operation of the server device 10 and information obtained through the operation of the server device 10.

[0024] The control unit 103 includes one or more processors, one or more dedicated circuits, or a combination of them. The processor is, for example, a general-purpose processor such as a CPU (Central Processing Unit), or a dedicated processor such as a GPU (Graphics Processing Unit) customized for specific processing. The dedicated circuit is, for example, an FPGA (Field-Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), etc. The control unit 103 controls each part of the server device 10 to perform information processing related to the operation of the server device 10.

[0025] The functions of the server device 10 are realized by the processor included in the control unit 103 executing a control program. The control program is a program for causing a computer to function as the server device 10. In addition, some or all of the functions of the server device 10 can be realized by the dedicated circuit included in the control unit 103. In addition, the control program can be stored in a non-transitory recording / storage medium readable by the server device 10 and read by the server device 10 from the medium.

[0026] Figure 2 It is a timing chart for explaining the operation steps of the information processing system 1 in the present embodiment. Figure 2 It shows the steps related to the associated operations of the server device 10, the portable terminal 12, the roadside device 14, and the vehicle 15.

[0027] In steps S20 and S21, the server device 10 acquires the respective location information from the vehicle 15 and the portable terminal 12. The vehicle 15 and the portable terminal 12 respectively transmit the information on the current location detected by using the GNSS receiver to the server device 10. Steps S20 and S21 are executed at an arbitrary cycle, for example, at a cycle of several seconds.

[0028] In step S22, the server device 10 generates indication information by using the location information of the portable terminal 12 and the vehicle 15. The indication information includes an information prompt indication for causing the roadside device 14 to output information for assisting the walking of the pedestrian 13 (hereinafter referred to as assistance information), and a notification action indication for causing the portable terminal 12 to execute a notification action. A detailed step example of step S22 will be shown in Figure 3 is shown.

[0029] Figure 3 represents an order example for the server device 10 to generate indication information. Figure 3 Each step of is executed by the control unit 103 of the server device 10.

[0030] In step S30, the control unit 103 acquires the location information of the roadside device 14. The location information of each of one or more roadside devices 14 in an arbitrary block is stored in advance in the storage unit 102. The control unit 103 reads and acquires the location information of each roadside device 14 from the storage unit 102.

[0031] In step S31, the control unit 103 acquires the location information of the vehicle 15. A history of the location information periodically transmitted from the vehicle 15 operating in an arbitrary block is stored in the storage unit 102. The control unit 103 reads and acquires the most recent location information of each vehicle 15 from the storage unit 102.

[0032] In step S32, the control unit 103 determines for each roadside device 14 whether the vehicle 15 has approached the roadside device 14. Since the roadside device 14 is provided on the roadside of the lane 16, the control unit 103 determines whether one or more vehicles 15 are within an arbitrary reference distance range from the roadside device 14 on the lane 16 facing the roadside device 14. The reference distance is, for example, a distance at which it is desired to notify a pedestrian of the approach of the vehicle 15 when it is assumed that a pedestrian wants to cross the lane 16 at the position where the roadside device 14 is provided, and is, for example, 30 m to 100 m. The control unit 103 uses the position information of the roadside device 14 and the vehicle 15 to derive the distance to the closest vehicle 15 for each roadside device 14. If this distance is less than the reference distance, it is determined that the vehicle 15 is approaching the roadside device 14, and if not, it is determined that the vehicle 15 is not approaching the roadside device 14. When the vehicle 15 is approaching the roadside device 14 (yes), the control unit 103 proceeds to step S33, and when the vehicle 15 is not approaching the roadside device 14 (no), it proceeds to step S35.

[0033] In step S33, the control unit 103 generates indication information for warning prompts for each roadside device 14 determined to have the vehicle 15 approaching. The indication information for warning prompts is information for instructing the roadside device 14 to prompt auxiliary information for warning. The auxiliary information for warning is, for example, text information such as "A vehicle is approaching, so please be careful", voice information, etc.

[0034] On the other hand, in step S35, the control unit 103 generates indication information for normal auxiliary prompts for each roadside device 14 determined to have the vehicle 15 not approaching. The indication information for normal auxiliary information prompts is information for instructing the roadside device 14 to prompt normal auxiliary information. The normal auxiliary information is, for example, text information such as "There is a crosswalk 5 meters ahead", voice information, etc.

[0035] In step S36, the control unit 103 determines for each roadside device 14 whether a pedestrian 13 is approaching the roadside device 14. Since the roadside device 14 is installed at the roadside of the lane, the control unit 103 determines whether one or more pedestrians 13 are within an arbitrary reference distance range from the roadside device 14 on the sidewalk where the roadside device 14 is installed. The reference distance is, for example, the distance at which it is desired to alert the pedestrian 13 to the auxiliary information output by the roadside device 14, for example, 3 m to 10 m. The control unit 103 uses the position information of the roadside device 14 and the portable terminal 12 carried by the pedestrian 13 to derive the distance to the closest portable terminal 12 for each roadside device 14. If this distance is less than the reference distance, it is determined that the pedestrian 13 is approaching the roadside device 14; otherwise, it is determined that the pedestrian 13 is not approaching the roadside device 14. When the pedestrian 13 is approaching the roadside device 14 (yes), the control unit 103 proceeds to step S37; when the pedestrian 13 is not approaching the roadside device 14 (no), step S37 is omitted and the process ends. Figure 3 of the step.

[0036] In step S37, the control unit 103 generates instruction information for notifying the operation for each roadside device 14 determined to have a pedestrian 13 approaching. The instruction information for notifying the operation is information for instructing the roadside device 14 to execute the notification operation.

[0037] Then, the control unit 103 ends Figure 3 of the step.

[0038] If returning to Figure 2 , then in step S23, the server device 10 transmits the instruction information for indicating a warning or for prompting information for normal assistance generated in step S22 to the roadside device 14. The control unit 103 transmits the instruction information for each roadside device 14 corresponding to the instruction information through the communication unit 101. If each roadside device 14 receives the instruction information through the communication module, it stores the instruction information in the built-in storage device.

[0039] In step S25, the roadside device 14 detects the pedestrian 13. The processor of the roadside device 14 detects the pedestrian 13 by performing arbitrary image processing such as pattern recognition on the captured image of the sidewalk to detect an image representing a person.

[0040] On the condition of detecting the pedestrian 13, in step S26, the roadside device 14 prompts auxiliary information towards the pedestrian 13. The processor of the roadside device 14 outputs auxiliary information for warning or normal assistance according to the instruction information received from the server device 10. For example, in the case of auxiliary information for warning, the roadside device 14 displays text information such as "A vehicle is approaching, so please pay attention", or outputs it by voice. Or, in the case of auxiliary information for normal assistance, the roadside device 14 outputs a voice such as "There is a crosswalk 5 meters ahead". In addition, in the case where the pedestrian 13 is not detected, step S26 is omitted.

[0041] On the other hand, in step S24, the server device 10 conveys the instruction information for instructing the notification action generated in step S22 to the portable terminal 12. The control unit 103 conveys the instruction information to each portable terminal 12 corresponding to the instruction information through the communication unit 101. If each portable terminal 12 receives the instruction information through the communication module, it stores the instruction information in the built-in storage device.

[0042] In step S27, the portable terminal 12 executes the notification action. The processor of the portable terminal 12 executes an arbitrary notification action according to the instruction information received from the server device 10. For example, the processor executes the notification action through the output of a notification sound based on the speaker, the generation of vibration based on the actuator, the flashing of the display, or the display of a message. Through this notification action, the portable terminal 12 can stimulate the pedestrian 13 to remind the pedestrian to pay attention to the auxiliary information output by the roadside device 14.

[0043] According to the above steps, the accuracy of transmitting the information for assisting walking based on the roadside device 14 to the pedestrian 13 can be improved.

[0044] Figure 4 Indicates Figure 3 The steps of a modified example. When the vehicle 15 is not approaching the roadside device 14 in step S32 (No), Figure 4 The steps of end by replacing entering step S36 Figure 3 The point of the steps is different from Figure 3 The case of Figure 4 According to the steps of Figure 2 When the vehicle 15 is not approaching the roadside device 14, the instruction information for executing the notification action to the portable terminal 12 is not generated. Therefore,

[0045] In the above-described embodiment, the server device 10 causes the roadside device 14 to present auxiliary information of different contents according to the distance between the roadside device 14 and the vehicle 15. However, this embodiment can also be applied in a case where the roadside device 14 does not receive an instruction from the server device 10 and presents auxiliary information when a pedestrian 13 is detected. By having the portable terminal 12 perform a notification action when the pedestrian 13 approaches the roadside device 14 while carrying the portable terminal 12, it is possible to stimulate the pedestrian 13 to draw attention to the auxiliary information output by the roadside device 14.

[0046] In a further modification, the position information of each roadside device 14 can be transmitted from the server device 10 to the portable terminal 12 as instruction information. In this case, each portable terminal 12 can determine the approach to the roadside device 14 based on its own position information and the position information of the roadside device 14, and perform a notification action.

[0047] In addition, in the above-described embodiment, the processing / control program for causing the portable terminal 12 to perform an instruction action is stored in the storage unit of the server device 10 or another server device and can be downloaded to the portable terminal 12 via the network 11.

[0048] In the above, the embodiments have been described based on the respective drawings and examples, but it should be noted that those skilled in the art can easily make various modifications and corrections based on this disclosure. Therefore, it should be noted that these modifications and corrections are included within the scope of this disclosure. For example, the functions included in each mechanism, each step, etc. can be reconfigured in a logically consistent manner, and multiple mechanisms, steps, etc. can be combined into one or divided.

[0049] Reference Numeral Explanation:

[0050] 1... Information processing system; 10... Server device; 11... Network; 12... Portable terminal; 13... Pedestrian; 14... Roadside device; 15... Vehicle; 101... Communication unit; 102... Storage unit; 103... Control unit.

Claims

1. An information processing device, wherein: have: a storage unit storing information on a location of a roadside device that provides pedestrians with auxiliary information for assisting walking; Department of Communications; as well as a control unit, communicating through the communication unit, The control unit transmits first instruction information to the portable terminal for causing the portable terminal to perform a notification action, wherein the notification action is used to alert a pedestrian carrying the portable terminal when the portable terminal is located at a first distance from the roadside device.

2. The information processing device according to claim 1, wherein: The control unit transmits second instruction information to the roadside device, the second instruction information being used to cause the roadside device to present the auxiliary information when the vehicle is located at a second distance from the roadside device.

3. The information processing device according to claim 2, wherein: The control unit sends the first instruction information on the condition that the vehicle is located at the second distance from the roadside device.

4. The information processing device according to claim 1, wherein: The control unit generates third instruction information causing the roadside device to present different auxiliary information according to the distance from the roadside device to the vehicle.

5. An operating method of a system comprising an information processing device and a portable terminal, wherein the information processing device has information on the location of a roadside device that presents auxiliary information for assisting walking to pedestrians, wherein: The information processing device sends a first instruction information for causing the portable terminal to execute a notification action, wherein the notification action is used to alert a pedestrian carrying the portable terminal when the portable terminal is located at a first distance from the roadside device. The portable terminal performs the notification operation based on the first instruction information.

Images