Information processing system, server device, server device control method, program, and storage medium

Abstract

To provide a technique for reporting appropriate information according to the kind of a vehicle.SOLUTION: A server device communicable with a portable terminal device, a first vehicle and a second vehicle of a different kind from the first vehicle comprises: reception means for receiving position information of the portable terminal device from the portable terminal device, receiving information of the position and orientation of the first vehicle from the first vehicle and receiving information of the position and orientation of the second vehicle from the second vehicle; first transmission means for transmitting first information to the first vehicle based on the position information of the portable terminal device and the information of the position and orientation of the first vehicle; and second transmission means for transmitting second information to the second vehicle based on the position information of the portable terminal device and the information of the position and orientation of the second vehicle. The first vehicle and the second vehicle respectively perform notifications based on information received from the server device.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to an information processing system, a server device, a control method for a server device, a program, and a storage medium. [Background technology]

[0002] Patent document 1 discloses an alarm output device that includes a sensor unit that detects a first obstacle behind the vehicle, and an alarm output unit that outputs an alarm to notify the occupants of the presence of the first obstacle based on information from the sensor unit when the shift position is in the R range. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2018-106429 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in Patent Document 1, the content of the notification is not controlled depending on the type of vehicle. For example, because a four-wheeled vehicle can move backward, it is necessary to issue a notification to warn the driver if there is a person (especially a child) behind the vehicle. On the other hand, because a two-wheeled vehicle does not move backward (does not back up), there is no need to issue a notification even if there is a person behind the vehicle.

[0005] The present invention has been made in view of the above-mentioned problems, and has an object to provide a technique for notifying appropriate information depending on the type of vehicle. [Means for solving the problem]

[0006] An information processing system according to the present invention that achieves the above object comprises: An information processing system including a mobile terminal device, a first vehicle, a second vehicle of a different type from the first vehicle, and a server device, The mobile terminal device terminal information acquisition means for acquiring location information of the mobile terminal device; a transmitting means for transmitting the location information to the server device, The first vehicle is a vehicle information acquisition means for acquiring information on the position and orientation of the first vehicle; a transmitting means for transmitting information on the position and orientation of the first vehicle to the server device; a notification means for notifying a driver based on the first information received from the server device, The second vehicle is a vehicle information acquisition means for acquiring information on the position and orientation of the second vehicle; a transmitting means for transmitting information on the position and orientation of the second vehicle to the server device; a notification means for notifying a driver based on the second information received from the server device, The server device a first transmitting means for transmitting the first information to the first vehicle based on location information of the mobile terminal device and information on the location and orientation of the first vehicle; and a second transmitting means for transmitting the second information to the second vehicle based on the position information of the mobile terminal device and the position and orientation information of the second vehicle. 、 the first vehicle is a four-wheeled vehicle and the second vehicle is a two-wheeled vehicle; the first information is information about the mobile terminal device that is located within a predetermined range from the first vehicle and in a travelable direction of the first vehicle, the second information is information about the mobile terminal device that is located within a predetermined range from the second vehicle and in a travelable direction of the second vehicle, The number of directions in which the second vehicle can travel is less than the number of directions in which the first vehicle can travel. It is characterized by: [Effects of the Invention]

[0007] According to the present invention, it is possible to notify appropriate information depending on the type of vehicle. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to an embodiment. [Figure 2] FIG. 2A is a diagram showing an example of the configuration of a server device according to an embodiment, and FIG. 2B is a diagram showing an example of the configuration of a mobile terminal device according to an embodiment. [Figure 3] FIG. 1A is a diagram showing an example of the configuration of a first vehicle (four-wheeled vehicle) according to one embodiment, and FIG. 1B is a diagram showing an example of the configuration of a second vehicle (two-wheeled vehicle) according to one embodiment. [Figure 4] FIG. 2 is a diagram illustrating a processing sequence of an information processing system according to an embodiment. [Figure 5] 10 is a flowchart illustrating a procedure of a process performed by a server device according to an embodiment. [Figure 6] FIG. 10 is a diagram showing an example of notification in the case of a first vehicle (four-wheeled vehicle) according to one embodiment. [Figure 7] FIG. 10 is a diagram showing an example of notification in the case of a second vehicle (two-wheeled vehicle) according to one embodiment. [Figure 8] FIG. 1A is a diagram showing an example of a notification mode in a first vehicle (four-wheeled vehicle) according to one embodiment, and FIG. 1B is a diagram showing an example of a notification mode in a second vehicle (two-wheeled vehicle) according to one embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. Note that each drawing is merely a schematic diagram for explaining the embodiments, and for example, the dimensions of each element in the drawing do not necessarily reflect the actual dimensions. Furthermore, the same elements in the drawings are given the same reference numerals, and explanations of overlapping content will be omitted in this specification.

[0010] <Summary> In this embodiment, an application for a child monitoring service will be described as an example. Each child carries a mobile terminal device associated with the child when going to and from school. When a child carrying a mobile information terminal is present near the vehicle while the vehicle is stopped or parked, information indicating the presence of the child is notified to alert the driver of the vehicle.

[0011] When making this notification, the system controls the system so that appropriate information is provided depending on the type of vehicle. For example, if the vehicle type is a four-wheeled vehicle, the four-wheeled vehicle's possible travel directions are forward and backward. Therefore, information indicating the presence of a child is notified to the driver both when the child is in front of the vehicle and when the child is behind the vehicle. On the other hand, if the vehicle type is a two-wheeled vehicle, the two-wheeled vehicle's possible travel direction is forward, and as a general rule, it does not move backward. Therefore, there is little need to provide a notification even when a child is behind the vehicle. Therefore, the system controls the system so that information indicating the presence of a child is provided to the driver when a child is in front of the vehicle. In this way, the system takes into consideration the type of vehicle and does not provide a notification when a warning is not necessary, thereby preventing excessive notification of information.

[0012] <System configuration> FIG. 1 is a diagram illustrating the configuration of an information processing system according to one embodiment. The information processing system includes a server device 10, one or more first vehicles 21, one or more second vehicles 22, and one or more mobile terminal devices 30, which are configured to be able to communicate with each other via a network 40. The network 40 is, for example, the Internet and / or a local area network (LAN). The one or more first vehicles 21 are, for example, four-wheeled vehicles. The one or more second vehicles 22 are, for example, two-wheeled vehicles. The one or more mobile terminal devices 30 are, for example, communication devices such as smartphones carried by one or more children.

[0013] <Device configuration> Next, with reference to FIGS. 2 and 3, a configuration example of a vehicle and devices that constitute an information processing system according to an embodiment will be described.

[0014] 2(a) is a diagram showing an example of the configuration of a server device of an information processing system according to an embodiment. The server device 10 includes a CPU 101, a storage device 102, and a communication unit 103. The CPU 101 controls the operation of the server device 10 by reading and executing programs stored in the storage device 102. The storage device 102 stores various types of information. The storage device 102 stores programs to be read and executed by the CPU 101, and can also store information acquired from one or more first vehicles 21, one or more second vehicles 22, and mobile terminal devices 30 via the communication unit 103, as well as processing results of the acquired information. The communication unit 103 transmits and receives various types of information via wired or wireless communication.

[0015] 2(b) is a diagram showing an example of the configuration of a mobile terminal device in an information processing system according to an embodiment. The mobile terminal device 30 is a mobile information terminal such as a smartphone, and is carried by a child who is registered for the monitoring service provided by the information processing system according to this embodiment. The mobile terminal device 30 includes a CPU 301, a storage device 302, a communication unit 303, a display unit 304, an operation input unit 305, a GPS sensor 306, and a gyro sensor 307. The CPU 301 controls the operation of the mobile terminal device 30 by reading and executing a program stored in the storage device 302.

[0016] The storage device 302 stores programs to be read and executed by the CPU 301, and also stores various information input to the mobile terminal device 30 via the operation input unit 305. The communication unit 303 communicates with the server device 10 via the network 40, and can transmit and receive various information via wired or wireless communication.

[0017] The display unit 304 is a liquid crystal display or the like and can display various types of information. The operation input unit 305 is a physical button, a touch panel button, or the like. A child who is the owner of the mobile terminal device 30 or his / her guardian can input various types of information by operating the operation input unit 305. If the display unit 304 is a touch panel, the display unit 304 may also function as the operation input unit 305.

[0018] The GPS sensor 306 receives radio waves generated by artificial satellites to detect the current position of the mobile terminal device 30 on the Earth and the current time.

[0019] 3(a) is a diagram showing an example of the configuration of a first vehicle according to one embodiment. The first vehicle 21 is, for example, a four-wheeled vehicle. The first vehicle 21 includes an ECU (electronic control unit) 211, a storage device 212, a communication unit 213, an in-vehicle navigation device 214, an external camera 215, and a speaker 216.

[0020] The ECU 211 includes a CPU, a memory, and a communication interface. The CPU performs predetermined processing based on information (data or electrical signals) received via the communication interface, and stores the processing results in the memory or storage device 212, or outputs them to other elements via the communication interface. The ECU 211 controls the drive mechanism based on the amount of operation of an acceleration operator (accelerator pedal) by the driver. The ECU 211 also controls the braking mechanism based on the amount of operation of a braking operator (brake pedal) by the driver. The braking mechanism is, for example, a disc brake provided on each wheel of the first vehicle 21. The ECU 211 also controls the steering mechanism based on the amount of operation of a steering operator (steering wheel) by the driver. The steering mechanism includes power steering.

[0021] The storage device 212 stores various information such as image data captured by the external camera 215. It also stores information such as the departure point and destination input via the in-vehicle navigation device 214. The communication unit 213 communicates with the server device 10 via the network 40, and can transmit and receive various information via wired or wireless communication.

[0022] The in-vehicle navigation device 214 includes a display unit 2141 and an operation input unit 2142. The display unit 2141 is a liquid crystal display or the like, and displays various types of navigation information such as route information from a departure point (or current location) to a destination (or an intermediate location), and displays various types of information based on information received from the server device 10. The operation input unit 2142 is a physical button, a rotary mechanism, or the like, and the driver (user) can operate the operation input unit 2142 to input various types of navigation information such as a departure point and a destination. Note that if the display unit 2141 is a touch panel, the display unit 2141 may also function as the operation input unit 2142.

[0023] The exterior camera 215 captures images of the surroundings of the first vehicle 21. For example, the images may be captured in front of, behind, and / or to the sides of the first vehicle 21. An around-view of the first vehicle 21 may also be captured. The speaker 216 outputs information by voice to the occupants of the first vehicle 21. The GPS sensor 217 receives radio waves generated by artificial satellites to detect the current position of the first vehicle 21 on Earth and the current time. The orientation sensor 218 detects the current orientation (direction) of the first vehicle 21.

[0024] 3(b) is a diagram showing an example of the configuration of a second vehicle according to one embodiment. The second vehicle 22 is, for example, a motorcycle. The first vehicle 22 includes an ECU (electronic control unit) 221, a storage device 222, a communication unit 223, an on-board navigation device 224, an external camera 225, and a speaker 226.

[0025] The ECU 221 includes a CPU, memory, and a communication interface. The CPU performs predetermined processing based on information (data or electrical signals) received via the communication interface, and stores the processing results in the memory or storage device 222, or outputs them to other elements via the communication interface. The ECU 221 controls the drive mechanism based on the amount of operation of an acceleration operator (accelerator) by the driver. The ECU 221 also controls the braking mechanism based on the amount of operation of a braking operator (e.g., brake) by the driver. The braking mechanism is, for example, a disc brake provided on each wheel of the second vehicle 22.

[0026] The storage device 222 stores various information such as image data captured by the external camera 225. It also stores information such as the departure point and destination input via the in-vehicle navigation device 224. The communication unit 223 communicates with the server device 10 via the network 40, and can transmit and receive various information via wired or wireless communication.

[0027] The in-vehicle navigation device 224 includes a display unit 2241 and an operation input unit 2242. The display unit 2241 is a liquid crystal display or the like, and displays various types of navigation information such as route information from a departure point (or current location) to a destination (or an intermediate location), and displays various types of information based on information received from the server device 10. The operation input unit 2242 is a physical button, a rotary mechanism, or the like, and the driver (user) can operate the operation input unit 2242 to input various types of navigation information such as a departure point and a destination. Note that if the display unit 2241 is a touch panel, the display unit 2241 may also function as the operation input unit 2242.

[0028] The exterior camera 225 captures images of the surroundings of the second vehicle 22, such as the front and / or rear of the second vehicle 22. The speaker 226 outputs audio information to the occupants of the second vehicle 22. The GPS sensor 227 receives radio waves generated by artificial satellites to detect the current position and current time of the second vehicle 22 on Earth. The orientation sensor 228 detects the current orientation (direction) of the second vehicle 22.

[0029] <Processing> Next, an example of a processing sequence executed in an information processing system according to an embodiment will be described with reference to Fig. 4. It is assumed that a child or his / her guardian has previously registered with an application that provides a child monitoring service using the child's mobile terminal device 30.

[0030] In F401, the mobile terminal device 30 carried by the child acquires location information of the mobile terminal device 30, for example, via the GPS sensor 306. This process is performed continuously at predetermined intervals. In F402, the first vehicle 21 acquires location information of the first vehicle 21, for example, via the GPS sensor 217, and acquires information on the orientation of the first vehicle 21 via the orientation sensor 218. This process is performed continuously at predetermined intervals. In F403, the second vehicle 22 acquires location information of the second vehicle 22, for example, via the GPS sensor 227, and acquires information on the orientation of the second vehicle 22 via the orientation sensor 228. This process is performed continuously at predetermined intervals.

[0031] In F404, the mobile terminal device 30 transmits the position information of the mobile terminal device 30 acquired in F401 to the server device 10. This process is performed continuously at predetermined intervals. In F405, the first vehicle 21 transmits the position and orientation information of the first vehicle 21 acquired in F402 to the server device 10. This process is performed continuously at predetermined intervals. In F406, the first vehicle 22 transmits the position and orientation information of the second vehicle 22 acquired in F403 to the server device 10. This process is performed continuously at predetermined intervals.

[0032] In this way, the server device 10 periodically receives location information of the mobile terminal device 30 of the registered child from the mobile terminal device 30. In addition, the server device 10 periodically receives information indicating the location and orientation of each first vehicle from each first vehicle, and periodically receives information indicating the location and orientation of each second vehicle from each second vehicle.

[0033] In F407, the server device 10 determines whether or not the situation requires notification of the presence of a child, based on the information received in F404 to F406.

[0034] In F408, the server device 10 transmits first information to the first vehicle 21 based on the location information of the mobile terminal device 30 and the location and orientation information of the first vehicle 21. Here, the first information is information about the mobile terminal device 30 that is present within a predetermined range from the first vehicle 21 and in a possible traveling direction (e.g., ahead and / or behind) of the first vehicle 21. If the mobile terminal device 30 is present within a predetermined range from the first vehicle 21 and in a possible traveling direction (e.g., ahead and / or behind) of the first vehicle 21, it can be determined that a situation requires notification of the presence of a child. At this time, the server device 10 transmits information including the positional relationship between the first vehicle 21 and the child (mobile terminal device 30), such as information indicating the presence of a child in front of the first vehicle 21, information indicating the presence of a child behind the first vehicle 21, or information indicating the presence of a child both in front and behind the first vehicle 21.

[0035] FIG. 6 is an explanatory diagram of the positional relationship between the first vehicle 21 and a child carrying a mobile terminal device 30 according to one embodiment, and the necessity of notification. In this embodiment, the first vehicle 21 is a four-wheeled vehicle that can travel in two directions: forward and backward. Therefore, as shown in FIG. 6, within a predetermined range 601 from the first vehicle 21 (for example, within a distance of 50 m from the vehicle), it is necessary to notify the presence of the child in both cases: when a child carrying a mobile terminal device 30a is in front of the vehicle, and when a child carrying a mobile terminal device 30b is behind the vehicle. Note that when notification is not necessary, the server device 10 does not transmit the first information to the first vehicle 21.

[0036] In F409, the server device 10 transmits second information to the second vehicle 22 based on the position information of the mobile terminal device 30 and the information on the position and orientation of the second vehicle 22. Here, the second information is information related to the mobile terminal device 30 that is present within a predetermined range from the second vehicle 22 and in a direction (for example, ahead) that the second vehicle 22 can travel. At this time, information including the positional relationship between the second vehicle 22 and the child (mobile terminal device 30), such as information indicating that a child is present ahead of the second vehicle 22, is transmitted.

[0037] FIG. 7 is an explanatory diagram illustrating the positional relationship between the second vehicle 22 and a child carrying a mobile terminal device 30 according to one embodiment, and the necessity of notification. In this embodiment, the second vehicle 21 is a two-wheeled vehicle that can travel in one direction: forward. Therefore, as shown in FIG. 7, if a child carrying a mobile terminal device 30a is present in front of the second vehicle 22 within a predetermined range 701 from the vehicle (for example, within a distance of 50 m from the vehicle), notification is required. On the other hand, if a child carrying a mobile terminal device 30b is present behind the vehicle, the second vehicle 22 is not expected to move backward (reverse), and therefore notification of the presence of the child is unlikely to be necessary, and therefore notification is not performed. Note that, in a situation where notification is not required, the server device 10 does not transmit the second information to the second vehicle 22.

[0038] In F410, the first vehicle 21 issues warning information indicating that caution is required for the presence of a child based on the first information received from the server device 10. At this time, the notification includes information about the relative positions of the first vehicle 21 and the child (mobile terminal device 30), such as "There is a child ahead. Be careful," "There is a child behind. Be careful," or "There are children ahead and behind. Be careful." FIG. 8(a) shows an example of a display on the display unit 2141 of the first vehicle 21 according to one embodiment. In the illustrated example, a text message is displayed, warning the driver that caution is required because there are children ahead and behind the first vehicle 21. Alternatively, or in addition to this, the first vehicle 21 may issue an audio notification via the speaker 216. Furthermore, as in the illustrated example, an icon indicating the relative positions of the vehicle and the child may be displayed to visually alert the driver. In the illustrated example, because children are present both ahead and behind the vehicle, the icons both ahead and behind the vehicle are lit (or flashing). Instead of sending a text message or a voice message, the notification may be made by flashing an icon and sounding an alarm.

[0039] In F411, the second vehicle 22 issues warning information indicating that caution is required for the presence of a child based on the second information received from the server device 10. At this time, the notification includes the positional relationship between the second vehicle 22 and the child (mobile terminal device 30), such as "There is a child ahead. Please be careful." FIG. 8(b) shows an example of a display on the display unit 2241 of the second vehicle 22 according to one embodiment. In the illustrated example, a text message is displayed warning that caution is required because a child is ahead of the second vehicle 22. Alternatively, or in addition to this, the second vehicle 22 may issue an audio notification via the speaker 226. Furthermore, as in the illustrated example, an icon indicating the positional relationship between the vehicle and the child may be displayed to visually alert the driver. In the illustrated example, the icon in front of the vehicle is lit (or flashes) because a child is ahead of the vehicle. Notification may be made by flashing the icon and sounding an alarm instead of a text or audio message. In the case of the second vehicle 22, the travelable direction is forward, so the notification is made only when there is a child in the front. In this way, the notification is not made when there is a child in the rear, so it is possible to prevent unnecessary (excessive) information from being notified to the occupants.

[0040] This completes the series of processing sequences in Fig. 4. In actual implementation, the series of processing sequences in Fig. 4 will be repeated. Note that the order of each process is an example, and the order may be changed. Specifically, the order of processing F401 to F406 is not limited to the example shown in the figure. Furthermore, the order of processing F408 to F411 is not limited to the example shown in the figure.

[0041] <Server device processing> Next, the procedure of the process performed by the server device 10 according to an embodiment will be described with reference to the flowchart of FIG.

[0042] In S501, the server device 10 acquires location information of each mobile terminal device 30 from the mobile terminal device 30 carried by each child. That is, the server device 10 collects location information of one or more mobile terminal devices 30 registered with the child monitoring service. In S502, the server device 10 acquires location and orientation information of each first vehicle 21 from one or more first vehicles 21. In S503, the server device 10 acquires location and orientation information of each second vehicle 22 from one or more second vehicles 22.

[0043] In S504, the server device 10 determines whether or not the mobile terminal device 30 is present within a predetermined range from the first vehicle 21 and in the possible traveling direction of the first vehicle 21. This process is executed for each of one or more first vehicles 21. If this step is Yes, proceed to S505. On the other hand, if this step is No, proceed to S506.

[0044] In S505, the server device 10 transmits first information to the first vehicle 21 based on the position information of the mobile terminal device 30 and the position and orientation information of the first vehicle 21. Here, the first information is information about the mobile terminal device 30 that is present within a predetermined range from the first vehicle 21 and in a direction in which the first vehicle 21 can travel (for example, ahead and / or behind). At this time, information including the positional relationship between the first vehicle 21 and the child (mobile terminal device 30), such as information indicating that a child is present in front of the first vehicle 21, information indicating that a child is present behind the first vehicle 21, or information indicating that a child is present both in front and behind, is transmitted. This makes it possible for the first vehicle 21 to issue warning information that also includes the positional relationship between the vehicle and the child.

[0045] In S506, the server device 10 determines whether or not the mobile terminal device 30 is present within a predetermined range from the second vehicle 22 and in the possible traveling direction of the second vehicle 22. This process is executed for each of one or more second vehicles 22. If this step is Yes, the process proceeds to S507. On the other hand, if this step is No, the process ends.

[0046] In S507, the server device 10 transmits second information to the second vehicle 22 based on the position information of the mobile terminal device 30 and the information on the position and orientation of the second vehicle 22. Here, the second information is information related to the mobile terminal device 30 that is present within a predetermined range from the second vehicle 22 and in a direction in which the second vehicle 22 can travel (for example, ahead). At this time, information including the positional relationship between the second vehicle 22 and the child (mobile terminal device 30), such as information indicating that a child is present ahead of the second vehicle 22, is transmitted. This makes it possible for the second vehicle 22 to issue warning information that also includes the positional relationship between the vehicle and the child.

[0047] As described above, in this embodiment, control is performed so that appropriate information is provided to the vehicle depending on the type of vehicle. For example, if the vehicle is a four-wheeled vehicle, the four-wheeled vehicle's possible travel directions are forward and backward. Therefore, information indicating the presence of a child is provided to the driver both when the child is in front of the vehicle and when the child is behind the vehicle. On the other hand, if the vehicle is a two-wheeled vehicle, the two-wheeled vehicle's possible travel direction is forward, and as a general rule, the two-wheeled vehicle does not move backward. Therefore, there is little need to provide a notification when a child is behind the vehicle. Therefore, control is performed so that information indicating the presence of a child is provided to the driver when a child is in front of the vehicle. In this way, by taking the type of vehicle into consideration and not providing a warning when it is not necessary, excessive information provision can be prevented.

[0048] Therefore, it is possible to prevent excessive notification of information to vehicle occupants while improving the safety of children registered with the monitoring service. In addition, since information is not transmitted from the server device to the second vehicle when notification is not necessary, data communication volume can be reduced.

[0049] The processing order in Figure 5 is an example and can be modified in various ways. For example, the processing of S501 to S503 can be performed in a different order. The order of the determination processing of S504 and S506 can also be reversed. Furthermore, the transmission processing of S505 and S507 can be performed after the determination processing of S504 and S506.

[0050] [Variations] In the above embodiment, an example has been described in which the criteria for whether to notify the driver of the presence of a child around the vehicle are changed depending on the type of vehicle (possible traveling direction). In addition, an example has been described in which a notification is given when a child is present in front of and / or behind the vehicle if the vehicle is a four-wheeled vehicle, and when a child is present in front of the vehicle if the vehicle is a two-wheeled vehicle. In this case, the distance between the vehicle and the mobile terminal device 30 carried by the child may also be notified. For example, the notification may be configured to include information such as, "There is a child 30 meters ahead of the vehicle. Please be careful."

[0051] In addition, the server device 10 may monitor the movement history of the mobile terminal device 30 carried by the child, determine information indicating whether the child is approaching or moving away from the vehicle, and transmit such information to the first vehicle 21 and the second vehicle 22. In this case, when a child is approaching the vehicle, the first vehicle 21 and the second vehicle 22 may issue a warning including information indicating the child's movement status, such as "A child is approaching from the front. Please be careful." Furthermore, when a child is moving away from the vehicle, when a notification of the child's presence is issued when a child is within a predetermined range of the vehicle, information such as "There is a child behind the vehicle. He is moving away from the vehicle. Please be careful." may be issued. This makes it possible to alert the vehicle occupants with more specific information, making it easier for them to understand the surrounding situation.

[0052] The first vehicle 21 may also control the notification taking into consideration information obtained by analyzing an image captured by the exterior camera 215. For example, when the first vehicle 21 receives information from the server device 10 indicating that a child is present in front of the first vehicle 21, the first vehicle 21 may analyze the image captured by the exterior camera 215, and if a person (child) is detected from the image, the first vehicle 21 may display an image (or video) of the person on the display unit 2141 together with warning information. Similarly, the second vehicle 22 may also control the notification taking into consideration information obtained by analyzing an image captured by the exterior camera 225. For example, when the second vehicle 22 receives information from the server device 10 indicating that a child is present in front of the second vehicle 22, the first vehicle 21 may analyze the image captured by the exterior camera 225, and if a person (child) is detected from the image, the second vehicle 22 may display an image (or video) of the person on the display unit 2241 together with warning information. This allows the actual surrounding situation to be grasped early.

[0053] In the case of a four-wheeled vehicle, the control may be performed by further taking into consideration the gear range. For example, when the gear is in reverse, the system may be configured to only notify the presence of a child located behind the vehicle. In other words, when the gear is in reverse, the system may be configured not to notify the presence of a child in front of the vehicle.

[0054] (Other embodiments) Furthermore, a program for realizing one or more functions described in each embodiment can be supplied to a system or device via a network or a storage medium, and one or more processors in the computer of the system or device can read and execute the program. The present invention can also be realized in such an embodiment.

[0055] The invention is not limited to the above-described embodiment, and various modifications and variations are possible within the scope of the gist of the invention.

[0056] <Summary of the embodiment> 1. An information processing system according to a first aspect, An information processing system including a mobile terminal device (e.g., 30), a first vehicle (e.g., 21), a second vehicle (e.g., 22) of a type different from the first vehicle, and a server device (e.g., 10), The mobile terminal device terminal information acquisition means for acquiring location information of the mobile terminal device; a transmitting means for transmitting the location information to the server device, The first vehicle is a vehicle information acquisition means for acquiring information on the position and orientation of the first vehicle; a transmitting means for transmitting information on the position and orientation of the first vehicle to the server device; a notification means for notifying a driver based on the first information received from the server device, The second vehicle is a vehicle information acquisition means for acquiring information on the position and orientation of the second vehicle; a transmitting means for transmitting information on the position and orientation of the second vehicle to the server device; a notification means for notifying a driver based on the second information received from the server device, The server device a first transmitting means for transmitting the first information to the first vehicle based on location information of the mobile terminal device and information on the location and orientation of the first vehicle; and second transmitting means for transmitting the second information to the second vehicle based on the position information of the mobile terminal device and information on the position and orientation of the second vehicle.

[0057] This makes it possible to notify appropriate information depending on the type of vehicle.

[0058] 2. In the information processing system according to the second aspect, the notification means of the first vehicle, when receiving the first information from the server device, notifies information indicating that the mobile terminal device is present in a travelable direction (for example, ahead or behind) of the first vehicle; When the notification means of the second vehicle receives the second information from the server device, it notifies information indicating that the mobile terminal device is present in a direction in which the second vehicle can travel (for example, ahead).

[0059] This allows different information to be notified depending on the direction in which the vehicle can travel, making it possible to notify appropriate information.

[0060] 3. An information processing system according to a third aspect, the first transmitting means of the server device transmits, as the first information, information about the mobile terminal device that is present within a predetermined range from the first vehicle and in a travelable direction of the first vehicle; The second transmitting means of the server device transmits, as the second information, information relating to the mobile terminal device that is present within a predetermined range from the second vehicle and in a travelable direction of the second vehicle.

[0061] This allows information about children who are near the vehicle and in the direction in which the vehicle may move to be reported, thereby reducing the reporting of unnecessary information, such as information about children who are in the direction in which the vehicle will not move.

[0062] 4. An information processing system according to a fourth aspect, the first information is information about the mobile terminal device that is located within a predetermined range from the first vehicle and in a travelable direction of the first vehicle, the second information is information about the mobile terminal device that is located within a predetermined range from the second vehicle and in a travelable direction of the second vehicle, The number of directions in which the second vehicle can travel is smaller than the number of directions in which the first vehicle can travel.

[0063] This reduces the frequency of notifications in the second vehicle, making it possible to prevent excessive notification of information.

[0064] 5. An information processing system according to a fifth aspect, the number of directions in which the second vehicle can travel is one, i.e., forward of the vehicle; The number of directions in which the first vehicle can travel is two, that is, forward and backward.

[0065] As a result, the second vehicle will only issue an alert if there is a child carrying a mobile terminal device in front of the vehicle, which reduces the frequency of alerts in the second vehicle and makes it possible to prevent excessive information from being alerted.

[0066] 6. An information processing system according to a sixth aspect, The first vehicle is a four-wheeled vehicle, and the second vehicle is a two-wheeled vehicle.

[0067] This makes it possible to provide appropriate information according to the type of vehicle, i.e., distinguishing between four-wheeled vehicles and two-wheeled vehicles.

[0068] 7. An information processing system according to a seventh aspect, the first transmitting means of the server device transmits the first information to the first vehicle based on the position information of the mobile terminal device and the position and orientation information of the first vehicle when the speed of the first vehicle is equal to or less than a threshold; The second transmitting means of the server device transmits the second information to the second vehicle based on the position information of the mobile terminal device and the position and orientation information of the second vehicle when the speed of the second vehicle is below a threshold.

[0069] In this way, when the vehicle is traveling at a certain speed, it is unlikely that the vehicle's direction of travel will change immediately from that state. In such a situation, there is little need to change whether or not to notify depending on the vehicle's possible traveling direction. For example, it is considered unlikely that the vehicle will suddenly start reversing when traveling forward at a certain speed. Therefore, there is little need to distinguish between different types of vehicles. More specifically, there is little need to distinguish between four-wheeled vehicles and two-wheeled vehicles. Therefore, it is possible to provide appropriate information depending on the type of vehicle in necessary situations, such as when the vehicle is stopped, parked, or traveling at a low speed.

[0070] 8. A server device according to an eighth aspect, A server device (e.g., 10) capable of communicating with a mobile terminal device (e.g., 30), a first vehicle (e.g., 21), and a second vehicle (e.g., 22) of a type different from the first vehicle, receiving means for receiving position information of the mobile terminal device from the mobile terminal device, for receiving information on the position and orientation of the first vehicle from the first vehicle, and for receiving information on the position and orientation of the second vehicle from the second vehicle; a first transmitting means for transmitting first information to the first vehicle based on location information of the mobile terminal device and information on the location and orientation of the first vehicle; a second transmitting means for transmitting second information to the second vehicle based on the position information of the mobile terminal device and the position and orientation information of the second vehicle; Equipped with.

[0071] This makes it possible to provide appropriate information to the vehicle depending on the type of vehicle.

[0072] 9. A method for controlling a server device according to a ninth aspect, A control method for a server device (e.g., 10) capable of communicating with a mobile terminal device (e.g., 30), a first vehicle (e.g., 21), and a second vehicle (e.g., 22) of a type different from the first vehicle, comprising: a receiving step (e.g., F404 to F406, S501 to S503) of receiving position information of the mobile terminal device from the mobile terminal device, receiving information on the position and orientation of the first vehicle from the first vehicle, and receiving information on the position and orientation of the second vehicle from the second vehicle; a first transmission step (e.g., F407, F408, S504 to S505) of transmitting first information to the first vehicle based on location information of the mobile terminal device and information on the location and orientation of the first vehicle; a second transmission step (e.g., F407, F409, S506 to S507) of transmitting second information to the second vehicle based on the position information of the mobile terminal device and the position and orientation information of the second vehicle; It has.

[0073] This makes it possible to provide appropriate information to the vehicle depending on the type of vehicle.

[0074] A program according to a tenth aspect comprises: 13 is a program for causing a computer to execute the server device control method according to the ninth aspect.

[0075] This allows the processing of the control method to be implemented by a computer.

[0076] A storage medium according to an eleventh aspect includes: A storage medium storing a program for causing a computer to execute the server device control method according to the ninth aspect.

[0077] This allows the processing of the control method to be implemented by a computer. [Explanation of symbols]

[0078] 10: Server device, 21: First vehicle, 22: Second vehicle, 30: Portable terminal device, 40: Network

Claims

1. An information processing system including a mobile terminal device, a first vehicle, a second vehicle of a different type from the first vehicle, and a server device, The mobile terminal device terminal information acquisition means for acquiring location information of the mobile terminal device; a transmitting means for transmitting the location information to the server device, The first vehicle is a vehicle information acquisition means for acquiring information on the position and orientation of the first vehicle; a transmitting means for transmitting information on the position and orientation of the first vehicle to the server device; a notification means for notifying a driver based on the first information received from the server device, The second vehicle is a vehicle information acquisition means for acquiring information on the position and orientation of the second vehicle; a transmitting means for transmitting information on the position and orientation of the second vehicle to the server device; a notification means for notifying a driver based on the second information received from the server device, The server device a first transmitting means for transmitting the first information to the first vehicle based on position information of the mobile terminal device and information on the position and orientation of the first vehicle; a second transmitting means for transmitting the second information to the second vehicle based on the position information of the mobile terminal device and the position and orientation information of the second vehicle, the first vehicle is a four-wheeled vehicle and the second vehicle is a two-wheeled vehicle; the first information is information about the mobile terminal device that is located within a predetermined range from the first vehicle and in a travelable direction of the first vehicle, the second information is information about the mobile terminal device that is located within a predetermined range from the second vehicle and in a travelable direction of the second vehicle, The number of directions in which the second vehicle can travel is smaller than the number of directions in which the first vehicle can travel. An information processing system comprising:

2. the notification means of the first vehicle, when receiving the first information from the server device, notifies information indicating that the mobile terminal device is present in a travelable direction of the first vehicle; The information processing system according to claim 1, characterized in that, when the second vehicle receives the second information from the server device, the notification means of the second vehicle notifies information indicating that the mobile terminal device is present in the second vehicle's possible direction of travel.

3. the first transmitting means of the server device transmits, as the first information, information about the mobile terminal device that is present within a predetermined range from the first vehicle and in a travelable direction of the first vehicle; The information processing system according to claim 1 or 2, characterized in that the second transmitting means of the server device transmits information regarding the mobile terminal device that is located within a predetermined range from the second vehicle and in the direction in which the second vehicle can travel as the second information.

4. the number of directions in which the second vehicle can travel is one, i.e., forward of the vehicle; 2. The information processing system according to claim 1, wherein the number of directions in which the first vehicle can travel is two, that is, forward and backward.

5. the first transmitting means of the server device transmits the first information to the first vehicle based on the position information of the mobile terminal device and the position and orientation information of the first vehicle when the speed of the first vehicle is equal to or less than a threshold; The information processing system according to any one of claims 1 to 4, characterized in that the second transmitting means of the server device transmits the second information to the second vehicle based on the position information of the mobile terminal device and the position and orientation information of the second vehicle when the speed of the second vehicle is below a threshold.

6. A server device capable of communicating with a mobile terminal device, a first vehicle, and a second vehicle of a different type from the first vehicle, a receiving means for receiving position information of the mobile terminal device from the mobile terminal device, receiving information on the position and orientation of the first vehicle from the first vehicle, and receiving information on the position and orientation of the second vehicle from the second vehicle; a first transmitting means for transmitting first information to the first vehicle based on the position information of the mobile terminal device and the position and orientation information of the first vehicle; a second transmitting means for transmitting second information to the second vehicle based on the position information of the mobile terminal device and the position and orientation information of the second vehicle; Equipped with the first vehicle is a four-wheeled vehicle and the second vehicle is a two-wheeled vehicle; the first information is information about the mobile terminal device that is located within a predetermined range from the first vehicle and in a travelable direction of the first vehicle, the second information is information about the mobile terminal device that is located within a predetermined range from the second vehicle and in a travelable direction of the second vehicle, A server device, characterized in that the number of directions in which the second vehicle can travel is smaller than the number of directions in which the first vehicle can travel.

7. A method for controlling a server device capable of communicating with a mobile terminal device, a first vehicle, and a second vehicle of a different type from the first vehicle, the method comprising: a receiving step of receiving position information of the mobile terminal device from the mobile terminal device, receiving position and orientation information of the first vehicle from the first vehicle, and receiving position and orientation information of the second vehicle from the second vehicle; a first transmitting step of transmitting first information to the first vehicle based on position information of the mobile terminal device and information on the position and orientation of the first vehicle; a second transmission step of transmitting second information to the second vehicle based on the position information of the mobile terminal device and the position and orientation information of the second vehicle; and the first vehicle is a four-wheeled vehicle and the second vehicle is a two-wheeled vehicle; the first information is information about the mobile terminal device that is located within a predetermined range from the first vehicle and in a travelable direction of the first vehicle, the second information is information about the mobile terminal device that is located within a predetermined range from the second vehicle and in a travelable direction of the second vehicle, A method for controlling a server device, wherein the number of directions in which the second vehicle can travel is smaller than the number of directions in which the first vehicle can travel.

8. A program for causing a computer to execute the server device control method according to claim 7.

9. A storage medium storing a program for causing a computer to execute the server device control method according to claim 7.

Images