Information processing apparatus and information processing method

Abstract

The invention relates to an information processing apparatus and an information processing method. On the basis of position information of a plurality of vehicles, the information processing device detects the presence of a fleet in which a number of vehicles greater than or equal to a first threshold value are traveling or stopped continuously at a speed lower than a first speed on a first lane of a road including a plurality of lanes. When the fleet is within a predetermined range from a first facility located on the first lane side of the road, and no matter how the lighting color of a signal lamp arranged at a first intersection is, the number of vehicles which are about to turn to the first facility side is greater than or equal to a second threshold value within the predetermined range. The information processing device determines that the fleet is a first fleet caused by entry into the first facility. The information processing device causes a first vehicle traveling in front of a first fleet on a first lane to display a first object related to the first fleet on a display device so as to overlap with a real space.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to an information processing apparatus and an information processing method. BACKGROUND

[0002] Disclosed is an advanced driver assistance system that detects a congestion queue to be entered into a warehouse, and causes a display unit to display guidance information that contains information related to a moving body having a characteristic attribute of a congestion queue to be entered into a warehouse in a case where the congestion queue to be entered into a warehouse exists on a travel lane (for example, Patent Literature 1).

[0003] PRIOR ART DOCUMENTS

[0004] PATENT LITERATURE

[0005] Patent Literature 1: Japanese Patent Application Publication No. 2018-146462 SUMMARY

[0006] One of the problems to be solved by an aspect of the present disclosure is to provide an information processing apparatus and method that suppress misrecognition of a vehicle fleet to be entered into a prescribed facility and a vehicle fleet to be turned left or right at an intersection.

[0007] One of the aspects of the present disclosure is an information processing apparatus including a control section that performs the following actions: detects, based on position information of a plurality of vehicles, presence of a vehicle fleet in which a number of vehicles that is greater than or equal to a first threshold value are continuously traveling or stopping at a speed that is less than a first speed on a first lane of a road that includes a plurality of lanes, the first lane being connected to a left-turn lane or a right-turn lane; in a case where the vehicle fleet is present within a prescribed range from a first facility located on the first lane side of the road, and regardless of a light color of a signal lamp of a first intersection that is present first at a position that is ahead of the first facility in a travel direction of the vehicle fleet, a number of vehicles that are to turn to the first facility side is greater than or equal to a second threshold value within the prescribed range, determines that the vehicle fleet is a first vehicle fleet that is due to entry into the first facility; and causes a first vehicle that is traveling at a position closer to the first vehicle fleet than the first vehicle fleet on the first lane to display a first object related to the first vehicle fleet on a display device mounted on the first vehicle so as to overlap the first object with a real space.

[0008] One other aspect of this disclosure is a method in which a computer performs the following actions: based on the location information of multiple vehicles, detecting the presence of a convoy of vehicles, in a first lane of a road comprising multiple lanes connected to a left-turn or right-turn lane, having a number of vehicles greater than or equal to a first threshold continuously traveling or stopped at a speed less than a first speed; determining that the convoy is a first convoy originating from entering the first facility if, within a predetermined range from a first facility located on the side of the first lane of the road, there are vehicles within the predetermined range having a number of vehicles turning toward the first facility that are greater than or equal to a second threshold, regardless of the illumination color of the traffic light at the first intersection located ahead of the first facility in the direction of travel of the convoy; and displaying a first object associated with the first convoy on a display device mounted on the first vehicle, superimposed on the real space, on the first vehicle traveling in the first lane closer to the first convoy.

[0009] Invention Effects

[0010] According to one of the solutions disclosed herein, it is possible to suppress the misidentification of convoys waiting to enter designated facilities with convoys waiting to make left or right turns at intersections. Attached Figure Description

[0011] Figure 1 This is a diagram illustrating an example of the processing of the driving assistance system according to the first embodiment.

[0012] Figure 2 This is a diagram illustrating an example of the hardware configuration of a server and a vehicle.

[0013] Figure 3 This is a diagram illustrating an example of the functional configuration of a server and a vehicle.

[0014] Figure 4 This is an example of a flowchart illustrating the notification process for fleet information on the server.

[0015] Figure 5 This is an example of a flowchart illustrating the process of updating fleet information on the server.

[0016] Figure 6 This is an example of a flowchart for receiving and processing vehicle fleet information.

[0017] Explanation of reference numerals in the attached figures

[0018] 1: Server; 2: Vehicle; 11: Control unit; 12: Map information database; 13: Road information database; 21: Control unit; 22: Gesture detection unit; 101, 211: Processor; 102, 212: Memory; 103, 213: Auxiliary storage device; 104: Communication unit; 210: Vehicle-mounted device. Detailed Implementation

[0019] One of the solutions disclosed herein is an information processing device with a control unit. This control unit detects the presence of a convoy of vehicles, where a number of vehicles exceeding a first threshold are continuously traveling or stopped at a speed less than a first speed, in a first lane connected to a left-turn or right-turn lane on a road comprising multiple lanes. If the convoy exists within a predetermined range from a first facility located on the side of the first lane of the road, and regardless of the illuminated color of the traffic light at the first intersection located ahead of the first facility in the convoy's direction of travel, there are at least a second threshold number of vehicles within this predetermined range attempting to turn towards the first facility, the control unit determines that the convoy is the first convoy originating from an entry towards the first facility. The control unit then causes a first vehicle traveling closer to the first convoy in the first lane to display a first object associated with the first convoy, superimposed on the real space, on a display device mounted on the first vehicle.

[0020] Information processing devices can be, for example, servers capable of communicating with vehicles. Alternatively, information processing devices can also be data communication modules, navigation devices, and dashcams mounted on vehicles. The information processing device is not limited to these; for example, it can be a computer mounted on a mobile body other than a vehicle, or a mobile terminal such as a smartphone, tablet, PC (Personal Computer), or gaming console. This information processing device is not limited to being mounted on a vehicle; it can also be mounted on a mobile body other than a vehicle. Mobile bodies include, for example, cars, motorcycles, bicycles, and trams. Furthermore, mobile bodies are not limited to vehicles traveling on land; for example, they can include mobile bodies moving at sea such as ships, and mobile bodies moving in the air such as aircraft and drones.

[0021] The control unit can be a processor such as a CPU (Central Processing Unit), GPU (Graphics Processing Unit), or DSP (Digital Signal Processor). However, the control unit is not limited to a processor; it can also be a circuit such as an FPGA (Field Programmable Gate Array), an integrated circuit (IC), or a CPLD (Complex Programmable Logic Device).

[0022] Vehicle-mounted displays include, for example, organic EL (Electro-Luminescent) displays attached to the windshield and displays in vehicle navigation systems. Overlaying objects onto real-world space is also known as AR (Augmented Reality) display. Objects can be, for example, graphic objects containing messages, illustrations, markers, etc. Objects can also be dynamic image data.

[0023] The first facility includes, for example, commercial facilities such as shopping malls, amusement parks, and supermarkets; tourist facilities such as temples; and public facilities such as hospitals and libraries. It should be noted that in this specification, the term "facility" is used to refer to the entire site including buildings and parking lots. The first object is, for example, a graphic object such as an arrow-shaped graphic, message, or illustration indicating that the first convoy is a convoy waiting to enter the first facility. Alternatively, the first object is a graphic object such as an arrow-shaped graphic, message, or illustration that prompts a lane change from the first lane to travel alongside the first convoy waiting to enter the first facility located ahead of the first vehicle in the direction of travel of the first vehicle.

[0024] According to one of the solutions disclosed herein, when there is a first convoy of vehicles waiting to enter a first facility ahead of the first vehicle in the direction of travel in the first lane, a first object associated with the first convoy is displayed on the display device of the first vehicle, overlapping with the real space. This clearly shows the driver of the first vehicle the first convoy waiting to enter the first facility, and suppresses the misidentification of the first convoy waiting to enter the first facility with a convoy waiting to turn left or right at an intersection.

[0025] As one of the alternatives, this disclosure may define a method for a computer to perform the processing performed by the aforementioned information processing apparatus, a program for causing the computer to perform the method, and a non-transitory and computer-readable recording medium containing the program.

[0026] Hereinafter, embodiments of the present disclosure will be described based on the accompanying drawings. The configurations of the following embodiments are illustrative, and the present disclosure is not limited to the configurations of the embodiments.

[0027] <First Implementation>

[0028] Figure 1 This diagram illustrates an example of the processing of the driving assistance system 100 according to the first embodiment. The driving assistance system 100 is a system that notifies vehicles of a convoy waiting to enter a designated facility. The driving assistance system 100 includes a server 1 and multiple vehicles 2. Each vehicle 2 is a vehicle equipped with communication capabilities. Each vehicle 2 can communicate with the server 1 via a network N1. The network N1 is, for example, a public internet or other public landline network.

[0029] Each vehicle 2 sends its driving information to server 1 at predetermined intervals. This driving information includes, for example, the location, speed, direction of travel, and steering information of each vehicle 2. Server 1 uses this driving information to detect the convoy of vehicles waiting to enter the first facility. The first facility could be, for example, a shopping mall, supermarket, restaurant, amusement park, museum, art gallery, or hospital. The convoy waiting to enter the first facility is an example of a "first convoy."

[0030] Server 1 detects a first vehicle 2A traveling in the same lane as the convoy of vehicles 2 that is less than a predetermined distance behind them. Server 1 sends the first vehicle 2A an instruction indicating a first object related to the convoy and its AR display. The first object is, for example, a... Figure 1 The object shown, G1, is an arrow-shaped graphic object indicating the direction of travel of the first vehicle 2A, used to prompt a lane change so that it passes beside the first convoy. However, it is not limited to this; for example, the first object could also be a graphic object containing a message indicating that the convoy is a convoy waiting to enter the first facility.

[0031] Upon receiving a first object and an AR display instruction from server 1, the first vehicle 2A displays the first object on the display device, overlapping it with real space. Hereinafter, the image data displayed overlapping with real space will be referred to as AR display. Figure 1 The image shows an example of a display screen on vehicle 2A containing an AR object within a speech bubble. By displaying a first object representing information related to a convoy waiting to enter the first facility using AR, the driver of vehicle 2A can identify the convoy ahead as part of the convoy waiting to enter the first facility. This prevents situations where the driver of vehicle 2A, despite not intending to enter the first facility, mistakenly believes the convoy is part of a queue waiting to turn left or right at an intersection and joins the queue.

[0032] In the first embodiment, in addition to generating the first object, server 1 also generates a cause object representing the cause of the convoy, a vehicle pointer representing the position of the lead vehicle in the convoy to enter the first facility, and a confidence object representing the confidence level. These objects are then sent to the first vehicle 2A for AR display. The confidence level indicates the reliability of the convoy to enter the first facility. Furthermore, the vehicle pointer can be changed by the driver of the first vehicle 2A moving their hand back and forth to indicate the vehicle in the convoy.

[0033] Figure 2 This diagram illustrates an example of the hardware configuration of server 1 and vehicle 2. Server 1 comprises a processor 101, a memory 102, an auxiliary storage device 103, and a communication unit 104. The memory 102 and the auxiliary storage device 103 are computer-readable recording media. The auxiliary storage device 103 is, for example, an EPROM (Erasable Programmable ROM), a hard disk drive, or an SSD (Solid State Drive). Programs stored in the auxiliary storage device 103 include, for example, an operating system (OS) and driver assistance control programs. The memory 102 includes, for example, semiconductor memories such as ROM (Read Only Memory) and RAM (Random Access Memory).

[0034] Processor 101 may be, for example, a CPU, GPU, or DSP (Digital Signal Processor). There may be multiple processors 101, and processor 101 may be included. Processor 101 is an example of a "control unit". Communication unit 104 is a communication circuit connected to a wired network such as an optical fiber or a LAN (Local Area Network) line. Communication unit 104 may also be a wireless communication circuit connected to a wireless network using a defined wireless communication method.

[0035] Next, vehicle 2 includes an onboard device 210, a display 220, an external camera 230, a speedometer 240, a position information acquisition sensor 250, a direction sensor 260, and an internal camera 270. Figure 2 In this document, the hardware components involved in the processing of the first embodiment of vehicle 2 are extracted and shown as part of the hardware configuration of vehicle 2. The hardware configuration of vehicle 2 is not limited to... Figure 2 The configuration is shown. The vehicle-mounted device 210 is, for example, a data communication module, a vehicle navigation system, or a dashcam.

[0036] The vehicle-mounted device 210 is configured with a processor 211, a memory 212, an auxiliary storage device 213, a wireless communication unit 214, and an interface 216. The processor 211, memory 212, and auxiliary storage device 213 are the same as those of the processor 101, memory 102, and auxiliary storage device 103. However, the auxiliary storage device 213 stores, for example, driver assistance control programs and image recognition programs.

[0037] The wireless communication unit 214 is, for example, a wireless communication circuit compatible with cellular communication methods such as 5G (5th Generation), 4G (4th Generation), or 6G (6th Generation). Interface 216 is an interface for connecting to an in-vehicle network to which other devices are connected. The in-vehicle network is, for example, an Ethernet-based network or a CAN (Controller Area Network).

[0038] Display 220, exterior camera 230, speedometer 240, position information acquisition sensor 250, direction sensor 260, and interior camera 270 are connected to the vehicle network connected to interface 216. Exterior camera 230 is positioned above the windshield, for example, facing outwards from the vehicle 2. However, it is not limited to this; multiple exterior cameras 230 may be provided, each facing a different direction, positioned on the outside of the vehicle 2. Speedometer 240 is a sensor that senses the speed of vehicle 2. Position information acquisition sensor 250 acquires the position information of vehicle 2, for example, based on GPS (Global Positioning System) signals or GNSS (Global Navigation Satellite System) signals. Direction sensor 260 is, for example, an accelerometer or other sensor that senses the direction of travel of vehicle 2. Interior camera 270 is positioned above the windshield, for example, facing inwards from the vehicle 2 so that the driver is within the camera's field of view.

[0039] Display 220 may be, for example, a display used in a vehicle navigation system, or an organic EL display installed on the windshield of vehicle 2, displaying the entire surface of the windshield. However, display 220 is not limited to these. It should be noted that the hardware configuration of server 1 and vehicle 2 is not limited to these. Figure 2 The hardware configuration is shown.

[0040] Figure 3This diagram illustrates an example of the functional configuration of server 1 and vehicle 2. Server 1 includes a control unit 11, a map information database (DB) 12, and road information DB 13 as functional components. The control unit 11 is a functional component that performs processing by executing a predetermined program through the processor 101 of server 1.

[0041] The control unit 11 acquires driving information from each vehicle 2 at predetermined intervals. The driving information includes, for example, vehicle 2 identification information, timestamps, location information, speed, direction of travel, turn signal information, steering information, and images captured by the external camera 230. The turn signal information includes whether the left turn signal is ON or OFF, and whether the right turn signal is ON or OFF.

[0042] The control unit 11 detects, for example, a convoy formed on a first lane of a road comprising multiple lanes, based on the driving information of each vehicle 2, map information DB12, and road information DB13, wherein the first lane is connected to a left-turn lane or a right-turn lane. The road comprising multiple lanes may also be a road comprising two or more lanes on one side. A convoy is, for example, a queue of vehicles that are moving or stopped at a speed less than a first speed and are connected at intervals less than a predetermined distance, and the number of vehicles is greater than or equal to a first threshold. The first speed is, for example, a speed considered slow. The interval between vehicles considered as a convoy is, for example, a distance in the range of 1m to 5m. The convoy can be detected, for example, based on the position information contained in the driving information of the multiple vehicles 2, or by image recognition of images captured by the external camera 230 contained in the driving information of the multiple vehicles 2.

[0043] The control unit 11 determines whether the detected convoy is a convoy waiting to enter the first facility. In the first embodiment, the control unit 11 determines a convoy waiting to enter the first facility as one that: (1) exists within a predetermined range from the first facility located on the lane side of the road where the convoy was generated; and (2) regardless of the color of the traffic light at the intersection located ahead of the first facility in the direction of travel of the convoy, there are at least a second threshold number of vehicles waiting to turn toward the first facility within a predetermined range from the first facility. By using the determination conditions (1) and (2) above, the convoy waiting to enter the first facility can be determined more accurately.

[0044] The defined range from the first facility is, for example, tens of meters to one kilometer from the first facility. The second threshold for the number of vehicles in the convoy is a value less than the first threshold. Vehicles turning towards the first facility can be determined, for example, based on the directional indicator information included in the driving information of vehicle 2, or by image recognition processing of images of vehicles 2 in the convoy or surrounding vehicles 2. The first intersection ahead of the first facility in the convoy's direction of travel and the presence or absence of traffic lights at that intersection are determined, for example, based on map information DB12. The illuminated color of the traffic lights at that intersection can be determined, for example, based on images of vehicles 2 present around the intersection, or obtained from designated agencies such as traffic control centers.

[0045] The control unit 11, for example, determines, based on the driving information of vehicle 2 and road information DB13, the first vehicle 2A that is in the same lane as the convoy to enter the first facility and is traveling less than a predetermined distance behind the last vehicle in the convoy, i.e., that is, approaching the convoy to enter the first facility. Multiple first vehicles 2A can also be detected.

[0046] Control unit 11 acquires a first object related to the convoy to enter the first facility, a cause object indicating the reason for the convoy, a vehicle pointer indicating the position of the lead vehicle in the convoy, and a confidence object indicating the confidence level. It then sends these objects as convoy information along with an AR display instruction to the first vehicle 2A. The confidence level indicates the reliability of the convoy entering the first facility. The AR display instruction may also include, for example, information about the configuration positions of each object in a virtual space corresponding to the real space. The vehicle pointer is an example of a "second object." The confidence object is an example of a "third object."

[0047] The first object could be, for example, a graphical object containing a message indicating that the convoy is a convoy waiting to enter the first facility. If the destination set in the vehicle navigation system is obtained as one of the driving information for the first vehicle 2A, and the destination is not the first facility corresponding to the convoy, the first object could also be, for example, an arrow-shaped graphical object used to prompt the vehicle to travel in a way that allows it to change lanes to avoid the convoy waiting to enter the first facility.

[0048] The cause object, representing the reason for the convoy, is the object indicating the existence of the first facility that serves as the reason for the convoy's entry into its destination. For example, the cause object might contain messages such as "○○ Shopping Center is ahead." Information related to the first facility can be obtained, for example, from map information DB12.

[0049] In the first embodiment, the lead vehicle in a convoy to enter the first facility is the first vehicle in the convoy whose front is not facing the first facility. The orientation of vehicle 2 can be determined, for example, based on steering information included in the driving information. It should be noted that the definition of the lead vehicle in a convoy to enter the first facility is not limited to this.

[0050] This represents the confidence level of the reliability of a convoy awaiting entry into the first facility. It is calculated, for example, based on past convoy generation history at the location where the convoy originated, the type of the first facility, the operating hours of the first facility, and the current time period, using a prescribed algorithm. This confidence level can be obtained, for example, using a machine learning model.

[0051] Furthermore, upon receiving gesture information from the first vehicle 2A, the control unit 11 generates updated platoon information based on the gesture information and sends this updated information to the first vehicle. The gesture information includes, for example, information indicating either a gesture by which a passenger in the first vehicle 2A pushes their hand forward or pulls their hand back to their side, and the number of times that gesture occurs. If a gesture of pushing the hand forward occurs, the control unit 11 generates updated information indicating that the vehicle pointer's position in the virtual space is changed from the vehicle currently indicated by the pointer in the platoon to the position corresponding to the number of vehicles preceding the first vehicle in the platoon based on the number of times that gesture has occurred. However, the vehicle pointer does not move further once it reaches the lead vehicle in the platoon.

[0052] When a hand gesture occurs, pulling the hand back towards the body, the control unit 11 generates update information indicating that the vehicle pointer's virtual position is changed from the vehicle currently indicated by the pointer in the convoy to the position corresponding to the number of vehicles following the gesture. However, the vehicle pointer does not move further once it reaches the last vehicle in the convoy. The last vehicle in the convoy is, for example, a vehicle whose distance from the vehicle behind it is greater than or equal to a predetermined distance, or a vehicle immediately preceding the first vehicle. By moving the vehicle pointer according to the hand gestures of the occupants of the first vehicle 2A, the occupants of the first vehicle 2A can visually identify the length of the convoy entering the first facility.

[0053] Map Information DB12 maintains map information. This includes information related to facilities, intersections, traffic lights, etc. Road Information DB13 maintains road information. This includes information such as road type, number of lanes, and number of lanes per side.

[0054] Next, vehicle 2 is equipped with a control unit 21 and a gesture detection unit 22 as functional components. The control unit 21 is a functional component that performs its processing by executing a predetermined program through the processor 211 of the on-board unit 210.

[0055] The control unit 21 acquires sensing values ​​from, for example, the external camera 230, speedometer 240, position information acquisition sensor 250, and direction sensor 260 at predetermined intervals, generates driving information, and sends the driving information to the server 1. When it receives fleet information and AR display instructions from the server 1, the control unit 21 configures each object included in the fleet information at a designated position in the virtual space and AR displays the virtual space and the real space on the display 220 in an overlapping manner. Hereinafter, the objects included in the AR display of the fleet information will be referred to as "display of fleet information" or "AR display of fleet information".

[0056] If, during the display of convoy information on the display 220, the gesture detection unit 22 receives a notification that a passenger has pushed their hand forward or pulled their hand back to their side, the control unit 21 generates gesture information and sends it to the server 1. Upon receiving updated convoy information from the server 1, the control unit 21 updates the vehicle pointer display accordingly. When a termination condition is met, the control unit 21 terminates the display of the convoy information. Termination conditions include, for example, the elapsed of a predetermined time, the first vehicle 2A moving away from the convoy and thus exiting a predetermined area from the first facility, or the first vehicle 2A joining the convoy and entering the grounds of the first facility.

[0057] The gesture detection unit 22 performs prescribed image recognition processing on the images captured by the in-vehicle camera 270, detecting gestures such as pushing the hand forward or pulling the hand back to the side by the occupant. The gesture detection performed by the gesture detection unit 22 begins and ends, for example, according to instructions from the control unit 21. Alternatively, when the display of fleet information begins, the control unit 21 instructs the gesture detection unit 22 to begin gesture detection, and when the display of fleet information ends, the control unit 21 instructs the gesture detection unit 22 to end gesture detection. It should be noted that the functional configuration of the server 1 and the vehicle 2 is not limited to... Figure 3 The functional components are shown.

[0058] Figure 4 This is an example of a flowchart for the notification processing of fleet information on server 1. Figure 4 The process shown is repeatedly executed at a predetermined cycle in the operation of server 1. Figure 4 The processor 101 of server 1 is the main body executing the processing shown, but for convenience, the description will focus on the functional components.

[0059] In OP101, the control unit 11 determines whether a convoy has formed on a road with multiple lanes based on the driving information from each vehicle 2, map information DB12, and road information DB13. The driving information of the vehicle 2 used for determination is the latest driving information. If a convoy has formed on a road with multiple lanes (OP101: Yes), the process proceeds to OP102. If no convoy has formed on a road with multiple lanes (OP101: No), Figure 4 The processing shown has ended.

[0060] In OP102, the control unit 11 determines, based on map information DB12 and road information DB13, whether the convoy detected in OP101 is a convoy awaiting entry into the first facility. The determination method for OP102 is as described above. If the convoy detected in OP101 is a convoy awaiting entry into the first facility (OP102: Yes), the process proceeds to OP103. If the convoy detected in OP101 is not a convoy awaiting entry into the first facility (OP102: No), Figure 4 The processing shown has ended.

[0061] In OP103, the control unit 11, based on the driving information of each vehicle 2 and road information DB13, detects a first vehicle that is in the same lane as the convoy to be entered into the first facility and is approaching from behind. In OP104, the control unit 11 generates convoy information. Specifically, the control unit 11 acquires a first object related to the convoy to be entered into the first facility, a cause object indicating the cause of the convoy, a vehicle pointer indicating the position of the lead vehicle in the convoy to be entered into the first facility, and a confidence object indicating the confidence level, wherein the confidence level represents the reliability of the convoy to be entered into the first facility.

[0062] In OP105, the control unit 11 sends platoon information and AR display instructions to the first vehicle 2A. In OP103, if multiple first vehicles 2A are detected, platoon information and AR display instructions are sent to each first vehicle 2A.

[0063] In OP106, the control unit 11 determines whether the convoy waiting to enter the first facility is being maintained. For example, if the number of vehicles in the convoy waiting to enter the first facility is less than a first threshold or less than a third threshold smaller than the first threshold, the control unit 11 determines that the convoy waiting to enter the first facility is not being maintained. If the convoy waiting to enter the first facility is being maintained (OP106: Yes), the process proceeds to OP103, and a new first vehicle is detected. If the convoy waiting to enter the first facility is not being maintained (OP106: No), Figure 4 The processing shown has ended.

[0064] Figure 5This is an example of a flowchart illustrating the fleet information update process on server 1. The fleet information update process involves changing the vehicle indicated by the pointer in the fleet entering the first facility based on the hand gestures of the occupants of the first vehicle 2A. For example, when in... Figure 4 When the convoy information notification processing shown was sent to the first vehicle 2A (OP105), Figure 5 The process shown has begun.

[0065] In OP201, the control unit 11 determines whether it has received gesture information from the first vehicle 2A. If gesture information has been received from the first vehicle 2A (OP201: Yes), the process proceeds to OP202. If no gesture information has been received from the first vehicle 2A (OP201: No), the process proceeds to OP204.

[0066] In OP202, the control unit 11 generates updated fleet information. Specifically, the updated fleet information includes the new configuration position of the vehicle pointer in virtual space, obtained based on the change in the vehicles in the fleet indicated by the vehicle pointer, corresponding to the hand gesture of the passenger of the first vehicle 2A contained in the gesture information. In OP203, the control unit 11 sends the updated fleet information to the first vehicle 2A.

[0067] In OP204, control unit 11 determines whether an end notification has been received from first vehicle 2A. An end notification is a notification indicating that the display of convoy information in first vehicle 2A has ended. If an end notification has been received from first vehicle 2A (OP204: Yes), Figure 5 The process shown has ended. If no end notification is received from the first vehicle 2A (OP204: No), the process proceeds to OP201.

[0068] Figure 6 This is an example of a flowchart for receiving and processing fleet information for vehicle 2. Figure 6 The process shown is repeatedly performed during the operation of vehicle 2. Figure 6 The processor 211 of the vehicle-mounted device 210 is the main body that performs the processing shown, but for convenience, the description will focus on the functional components.

[0069] In OP301, the control unit 21 determines whether fleet information has been received from server 1. If fleet information has been received from server 1 (OP301: Yes), the process proceeds to OP302. In OP302, the control unit 21 displays the fleet information AR on the display 220. If no fleet information has been received (OP301: No), Figure 6 The processing shown is complete. Upon receiving the fleet information, vehicle 2 is designated as vehicle 2A, the first vehicle. The following will...Figure 6 The executing entity is designated as the first vehicle 2A.

[0070] In OP303, the control unit 21 determines whether it has received a notification from the gesture detection unit 22 that a gesture of pushing or pulling back the hand of a passenger in the first vehicle 2A has been detected. If a notification of a detected gesture is received from the gesture detection unit 22 (OP303: Yes), the process proceeds to OP304. If a notification of a detected gesture is not received from the gesture detection unit 22 (OP303: No), the process proceeds to OP307.

[0071] In OP304, control unit 21 sends gesture information to server 1. In OP305, control unit 21 receives updated fleet information from server 1. In OP306, control unit 21 updates the AR display of fleet information according to the updated fleet information.

[0072] In OP307, control unit 21 determines whether the display of fleet information has ended based on whether the end condition for displaying fleet information has been met. If the display of fleet information has ended (OP307: Yes), the process proceeds to OP308. If the display of fleet information has not ended (OP307: No), the process proceeds to OP303.

[0073] In OP308, control unit 21 sends a termination notification to server 1. Afterwards, Figure 6 The processing shown is now complete. It should be noted that... Figures 4 to 6 The process shown is an example and can be modified appropriately according to the implementation method.

[0074] <Effects of the First Embodiment>

[0075] In the first embodiment, a first object associated with the convoy awaiting entry into the first facility is displayed by AR on the display device of a first vehicle 2A traveling behind the convoy in the same lane as the convoy. This prevents the driver of the first vehicle 2A from mistaking the convoy awaiting entry into the first facility for a convoy waiting to turn left or right at an intersection.

[0076] Furthermore, in the first embodiment, in addition to displaying the first object, a cause object indicating the reason for the convoy, a vehicle pointer indicating the position of the lead vehicle, and a confidence level that the convoy is a convoy waiting to enter the first facility are also displayed. Thus, the driver of the first vehicle 2A can obtain more information about the convoy waiting to enter the first facility, further suppressing the misidentification of it as a convoy waiting to turn left or right at the intersection.

[0077] <Other Implementation Methods>

[0078] The above-described implementation is merely an example, and this disclosure may be implemented with appropriate modifications without departing from its spirit.

[0079] In the first embodiment, the fleet information is generated or updated by server 1. Alternatively, the fleet information can be generated or updated by the vehicle-mounted device 210 as described in the first embodiment, instead of server 1. However, the vehicle-mounted device 210 cannot obtain the driving information of other vehicles 2, so fleet detection and the like are performed based on images captured by the external camera 230 of the vehicle 2. In this case, the vehicle-mounted device 210 is an example of an "information processing device".

[0080] In the first embodiment, in response to a hand gesture by the occupant of the first vehicle 2A, the vehicle pointer on the display screen moves between vehicles within the convoy. Alternatively, the convoy information may also include a vehicle information object that presents information related to the vehicle 2 indicated by the vehicle pointer. In this case, in response to a hand gesture by the occupant of the first vehicle 2A, the configuration position of the vehicle pointer in virtual space is updated, and the vehicle information object is also updated to present information related to the vehicle 2 now indicated by the vehicle pointer. In this case, the vehicle information object is also an example of a "second object".

[0081] As long as no technical contradictions arise, the processing and units described in this disclosure can be freely combined and implemented.

[0082] Furthermore, processes described as being performed by one device can also be performed by multiple devices. Alternatively, processes described as being performed by different devices can also be performed by one device. In a computer system, the hardware configuration (server configuration) used to implement each function can be flexibly changed.

[0083] This disclosure can also be implemented by supplying a computer program that implements the functions described in the above embodiments to a computer, which then reads and executes the program using one or more processors. Such a computer program can be provided to the computer either via a non-transitory computer-readable storage medium that can be connected to the computer's system bus or via a network. Non-transitory computer-readable storage media include, for example, any type of disk such as a hard disk (floppy disk, hard disk drive (HDD), etc.), an optical disk (CD-ROM (Compact Disc Read Only Memory), a DVD (Digital Versatile Disc), Blu-ray disc, etc.), read-only memory (ROM), random access memory (RAM), EPROM, EEPROM (Electrically Erasable Programmable Read Only Memory), magnetic cards, flash memory, optical cards, and any type of medium suitable for storing electronic instructions.

Claims

1.An information processing apparatus including a control section that performs the following actions: detecting, based on position information of a plurality of vehicles, presence of a vehicle group in which a number of vehicles equal to or greater than a first threshold value are continuously traveling or stopping at a speed less than a first speed on a first lane of a road including a plurality of lanes connected to a left-turn lane or a right-turn lane; determining that the vehicle group is a first vehicle group that is caused by entry to a first facility when the vehicle group is present within a prescribed range from the first facility located on the first lane side of the road, and a number of vehicles equal to or greater than a second threshold value that are to turn to the first facility side are present within the prescribed range regardless of a lighting color of a signal lamp of a first intersection that is first present at a position further forward than the first facility in a traveling direction of the vehicle group; and causing a first vehicle traveling at a position closer to the first vehicle group than the first vehicle group on the first lane to display a first object related to the first vehicle group superimposed on a real space on a display device mounted on the first vehicle. 2.The information processing apparatus according to claim 1, wherein the control section is configured to: determine a second vehicle located at a prescribed position within the first vehicle group based on the position information of the plurality of vehicles; and cause the first vehicle to display a second object superimposed on the prescribed position within the real space corresponding to the second vehicle on the display device, the second object being an object that presents information related to the second vehicle in the first vehicle group. 3.The information processing apparatus according to claim 2, wherein the control section is configured to: obtain information indicating a gesture of an occupant of the first vehicle; in a case where the information indicating the gesture indicates that the occupant has performed a gesture of pushing a hand out, set a vehicle located a prescribed number of vehicles before the second vehicle in the first vehicle group as a new second vehicle, and cause the first vehicle to display the second object superimposed on a prescribed position within the real space corresponding to the new second vehicle on the display device; and in a case where the information indicating the gesture indicates that the occupant has performed a gesture of pulling the hand back, set a vehicle located a prescribed number of vehicles after the second vehicle in the first vehicle group as a new second vehicle, and cause the first vehicle to display the second object superimposed on a prescribed position within the real space corresponding to the new second vehicle on the display device. 4.The information processing apparatus according to claim 1, wherein the control section is configured to: obtain a third object indicating a numerical value, the numerical value indicating a degree of reliability that the vehicle group is the first vehicle group; and cause the first vehicle to display the third object superimposed on the real space on the display device. 5.An information processing method performed by a computer, the method comprising the following actions: ​ ​ detecting, based on position information of a plurality of vehicles, presence of a vehicle group in which a number of vehicles equal to or greater than a first threshold value are continuously traveling or stopping at a speed less than a first speed on a first lane of a road including a plurality of lanes connected to a left-turn lane or a right-turn lane; determining that the vehicle group is a first vehicle group due to entry to the first facility, in a case where the vehicle group is present within a prescribed range from a first facility located on the first lane side of the road, and a number of vehicles equal to or greater than a second threshold value that are to turn to the first facility side are present within the prescribed range regardless of a lighting color of a signal of a first intersection that is present first at a position further forward in a travel direction of the vehicle group than the first facility; and causing a first vehicle traveling at a position closer to the first vehicle group than the first vehicle group on the first lane to display a first object related to the first vehicle group superimposed on a real space on a display device mounted on the first vehicle.

Images