Information processing device and information processing method

The information processing device and method improve convenience by identifying potential collisions among pedestrians, cyclists, and drivers, focusing alerts on the most dangerous user to reduce unnecessary warnings and enhance safety support system participation.

JP7818879B2Active Publication Date: 2026-02-24PANASONIC AUTOMOTIVE SYST CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2022169166
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-10-21
Publication Date
2026-02-24
Estimated Expiration
2042-10-21

AI Technical Summary

Technical Problem

Conventional devices lack convenience in preventing mobile device owners from coming too close to vehicles, particularly in determining potential collision scenarios among pedestrians, cyclists, motorcycle drivers, and car drivers.

Method used

An information processing device and method that collects movement state information of multiple users, determines potential dangerous states, and activates alerts on terminal devices based on attribute information, prioritizing the most dangerous user to reduce unnecessary warnings.

Benefits of technology

Enhances convenience by minimizing frequent and annoying alerts, particularly for vulnerable road users, thereby increasing participation in safety support systems and reducing traffic accidents.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007818879000001
    Figure 0007818879000001
  • Figure 0007818879000002
    Figure 0007818879000002
  • Figure 0007818879000003
    Figure 0007818879000003
Patent Text Reader

Abstract

To provide an information processing device which further enhances convenience, and an information processing method.SOLUTION: An information processing device collects moving state information of each of a plurality of users and determines the presence / absence of a possibility of a dangerous state on the basis of the moving state information. The information processing device comprises: an acquisition unit for acquiring attribute information of each of the plurality of users; and a control unit for, based on the attribute information of each of the users with the possibility of the dangerous state, which terminal device among the terminal devices of the corresponding users is used for executing an attention calling operation.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device and an information processing method. [Background technology]

[0002] Conventionally, there are known devices that support either the owner of a mobile device or the driver of a vehicle to prevent the owner of the mobile device from coming too close to the vehicle. For example, Patent Document 1 discloses a device that determines whether the owner of a mobile device is riding a bicycle, and issues a warning in different ways depending on the result. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-251758 Summary of the Invention [Problem to be solved by the invention]

[0004] However, conventional devices have room for improvement in terms of convenience.

[0005] An object of the present disclosure is to provide an information processing device and an information processing method with further improved convenience. [Means for solving the problem]

[0006] An information processing device according to one aspect of the present disclosure is an information processing device that collects movement state information of each of a plurality of users and determines whether or not there is a possibility of a dangerous state based on the movement state information, and includes: an acquisition unit that acquires attribute information of each of the plurality of users; and a control unit that determines, based on the attribute information of each of the plurality of users who may be in the dangerous state, a first terminal device that will execute an alert activation action from among the terminal devices carried by each of the users. The attribute information indicates one of a pedestrian, a bicycle driver, a motorcycle driver, and a car driver, and when the user who may be in a dangerous state is a user who may collide with another user, the control unit compares the attribute information of the other user and the user who may collide with each other, and determines the terminal device of the user who is relatively more dangerous as the first terminal device. .

[0007] An information processing method according to one aspect of the present disclosure is an information processing method executed by an information processing device that collects movement state information of each of a plurality of users and determines whether or not there is a possibility of a dangerous state based on the movement state information, the information processing method comprising: acquiring attribute information of each of the plurality of users; and determining, from among the terminal devices carried by each of the plurality of users, a first terminal device that will execute an alert activation action based on the attribute information of each of the plurality of users who are likely to be in the dangerous state. The attribute information indicates one of a pedestrian, a bicycle driver, a motorcycle driver, and a car driver, and when the user who may be in a dangerous state is a user who may collide with another user, the first terminal device compares the attribute information of the other user and the user who may collide with each other, and determines whether the user is a terminal device of a user who is relatively more dangerous than the other user. . [Effects of the Invention]

[0008] According to the present disclosure, it is possible to provide an information processing device and an information processing method with further improved convenience. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram illustrating a configuration example of a safety support system according to an embodiment of the present disclosure. [Figure 2] FIG. 1 is a diagram illustrating an example of the hardware configuration of a computer included in a mobile terminal or a server according to an embodiment of the present disclosure. [Figure 3] 1 is a flowchart illustrating an example of an attribute determination process according to an embodiment of the present disclosure. [Figure 4] FIG. 10 is a diagram showing a list of risk targets and protection targets for each attribute according to an embodiment of the present disclosure. [Figure 5] FIG. 1 is a schematic diagram illustrating an example of a movement state of a plurality of users as viewed from directly above according to an embodiment of the present disclosure; [Figure 6] 1 is a sequence chart illustrating an example of the operation of a mobile terminal and a server according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings.

[0011] An example of the configuration of a safety support system 1 according to this embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing an example of the configuration of the safety support system 1.

[0012] 1, the safety support system 1 includes a mobile terminal 100 and a server 200. The mobile terminal 100 and the server 200 together correspond to an example of the "information processing device" of the present disclosure.

[0013] As shown in FIG. 2, the mobile terminal 100 and the server 200 each have, as hardware, for example, a CPU (Central Processing Unit) 10, a main memory device 20 such as a ROM (Read Only Memory) or a RAM (Random Access Memory), a hard disk storing computer programs, an auxiliary memory device 30 such as a flash memory, and a bus 40 connecting them.

[0014] The functions of the mobile terminal 100 and the server 200 described below are realized by the CPU 10 reading a computer program from the auxiliary storage device 30, expanding it into the RAM of the main storage device 20, and executing it. Note that the computer program may be provided to a user or the like by being recorded on a predetermined recording medium or distributed over a network.

[0015] First, the mobile terminal 100 will be described.

[0016] The mobile terminal 100 is a terminal device that is carried (carried) by a mobile user. Examples of the mobile terminal 100 include, but are not limited to, a smartphone, a tablet, a smart watch, etc. Note that the functions of the mobile terminal 100 described below may be implemented by an edge server between a cloud computing server and the user terminal.

[0017] For convenience, only one mobile terminal 100 is shown in FIG. 1, but in reality, a plurality of mobile terminals 100 are assumed to exist.

[0018] As shown in FIG. 1, the mobile terminal 100 includes a communication unit 110, an acquisition unit 120, a control unit 130, and an output unit 140.

[0019] The communication unit 110 is a communication device that performs network communication such as internet communication and cellular communication (communication using a mobile communication network).

[0020] For example, the communication unit 110 transmits moving state information and attribute information, which will be described later, to the server 200, and receives determination result information, which will be described later, from the server 200.

[0021] The communication unit 110 also includes a communication device that performs wireless communication such as RFID (Radio Frequency Identification), Bluetooth (registered trademark), or Wi-Fi (registered trademark).

[0022] That is, communication unit 110 in this embodiment is a concept that includes both a device that realizes Internet communication and a device that realizes wireless communication (not meaning that both communication functions are realized by one device).

[0023] The acquisition unit 120 is an acquisition device that acquires various types of information. Here, "acquisition" includes the meanings of "detection" and "estimation."

[0024] For example, the acquisition unit 120 periodically acquires movement state information indicating the movement state of a user (hereinafter simply referred to as the user) who possesses the mobile terminal 100. The movement state information includes, for example, information indicating the current position, direction of travel, movement speed, tilt, etc. of the user (which may also be referred to as the mobile terminal 100). In this case, the acquisition unit 120 may include, for example, a GPS (Global Positioning System) receiver that receives GPS signals, a processor that measures the current position, etc. based on the GPS signals, an acceleration sensor, etc. Note that the movement state information is sufficient as long as it includes at least current position information, and may additionally include movement direction information, speed information, tilt information, etc.

[0025] Furthermore, for example, the acquiring unit 120 acquires attribute information indicating the attributes of the user. Examples of the attributes include pedestrian, cyclist (bicycle driver), rider (motorcycle driver), and driver (car driver). In this case, the acquiring unit 120 may be, for example, a processor that performs attribute determination processing (described in detail later).

[0026] Here, the flow of the attribute determination process performed by the mobile terminal 100 will be described with reference to Fig. 3. Fig. 3 is a flowchart showing an example of the attribute determination process. At the start of the flow in Fig. 3, the user's attribute is assumed to be a pedestrian. Furthermore, since the user's attribute may change, the flow in Fig. 3 is performed periodically.

[0027] First, the acquisition unit 120 determines whether or not the user is present within a predetermined distance from the roadway (step S1).

[0028] For example, the acquisition unit 120 compares the current location measured based on the GPS signal with the location of the road indicated in the map information, and determines whether the user is located within a predetermined distance from the road. The map information here is, for example, stored in a storage unit (not shown) of the mobile terminal 100.

[0029] If the user is not present within a predetermined distance from the roadway (step S1 / NO), the acquisition unit 120 determines that the user is not a target for safety support (step S2).

[0030] In other words, a person who is not a target of safety support is a person who does not need a warning, which will be described later. If the user is not within a predetermined distance from the roadway, the user is considered to be in a location where the possibility of being involved in a traffic accident is low, and therefore the user is determined to be not a target of safety support.

[0031] If it is determined that the user is not eligible for safety support, the terminal transmits to the server a notice that the user is not eligible. If it is determined that the user is not eligible, the user's movement state information and attribute information do not need to be transmitted to the server 200. This makes it possible to reduce power consumption related to communication in the mobile terminal 100.

[0032] On the other hand, if the user is present within a predetermined distance from the roadway (step S1 / YES), the acquisition unit 120 determines whether the CN (Carrier to Noise Ratio) value of the GPS signal is equal to or greater than a predetermined threshold (step S3).

[0033] If the CN value of the GPS signal is not equal to or greater than the threshold value (step S3 / NO), the acquisition unit 120 determines that the user is not a target for safety support (step S2).

[0034] If the CN value is not above the threshold, it is assumed that the user is indoors or in an environment where the accuracy of the current location is insufficient, and therefore it is determined that safety support is not necessary or that appropriate support cannot be provided, and the user is therefore determined not to be eligible for support.

[0035] On the other hand, if the CN value of the GPS signal is equal to or greater than the threshold value (step S3 / YES), the acquisition unit 120 determines whether or not walking has been detected within a certain period of time based on the detection result of, for example, an acceleration sensor (step S4).

[0036] This determination process takes into consideration the time when the user stops walking, for example, while waiting at a traffic light.

[0037] If walking is detected within a certain period of time (step S4: YES), the acquisition unit 120 determines that the user is a pedestrian (step S5).

[0038] On the other hand, if no walking is detected within the certain time period (step S4: NO), the acquisition unit 120 determines whether the mobile terminal 100 is attached to a holder (step S6).

[0039] The holder is a device that is attached to, for example, the body of a bicycle or motorcycle, and that can accommodate (store) the mobile terminal 100. This holder is provided with, for example, a contactless IC tag (which may be a sensor). When the mobile terminal 100 is attached to the holder, the communication unit 110 receives pre-registered motorcycle type information from the contactless IC tag. This motorcycle type information indicates whether the motorcycle to which the holder is attached is a bicycle or a motorcycle. If the motorcycle type information is received, the acquisition unit 120 determines that the mobile terminal 100 is attached to the holder, and if the motorcycle type information is not received, the acquisition unit 120 determines that the mobile terminal 100 is not attached to the holder.

[0040] If the mobile terminal 100 is attached to the holder (step S6 / YES), the acquisition unit 120 determines whether the two-wheeled vehicle type information indicates a motorcycle or a bicycle (step S7).

[0041] If the two-wheeled vehicle type information indicates a motorcycle (step S7 / motorcycle), the acquisition unit 120 determines that the user is a rider (step S8).

[0042] If the two-wheeled vehicle type information indicates a bicycle (step S7 / bicycle), the acquisition unit 120 determines that the user is a cyclist (step S9).

[0043] If the mobile terminal 100 is not attached to the holder (step S6 / NO), the acquisition unit 120 determines whether authentication has been performed between the mobile terminal 100 and the in-car device (step S10).

[0044] The authentication here includes, but is not limited to, Bluetooth (registered trademark) pairing, and the in-vehicle device includes, but is not limited to, a car navigation system equipped with a Bluetooth (registered trademark) communication function.

[0045] If authentication is performed between the mobile terminal 100 and the in-vehicle device (step S10 / YES), the acquisition unit 120 determines that the user is the driver (step S11).

[0046] If authentication is not performed between the mobile terminal 100 and the in-vehicle device (step S10 / NO), the acquisition unit 120 determines that the user is not a target for safety support (step S2).

[0047] The attribute determination process has been described above. Note that the flow in FIG. 3 is an example, and attributes may be determined using other known methods. Also, although the attribute determination process has been described here as being performed by the mobile terminal 100, it may also be performed by the server 200. In this case, the server 200 acquires information necessary for the attribute determination process from the mobile terminal 100 or another device. Below, we return to the description of the acquisition unit 120.

[0048] The acquisition unit 120 acquires (generates) attribute information indicating that the user is a pedestrian, a cyclist, a rider, or a driver, based on the result of the attribute determination process described above.

[0049] In the present embodiment, the acquiring unit 120 acquires attribute information by executing an attribute determination process, but the present invention is not limited to this. For example, the acquiring unit 120 may acquire attribute information by accepting an attribute input operation by a user.

[0050] In addition, the user's attributes may change. For example, if a user leaves home, walks to a parking lot, and then gets into a car, the acquisition unit 120 changes the attribute from pedestrian to driver. When the attribute is changed in this way, the changed attribute information is transmitted to the server 200 together with the movement state information at the time of the change.

[0051] The control unit 130 is a control device that executes various controls.

[0052] For example, the control unit 130 controls the communication unit 110 to transmit the above-mentioned moving state information and attribute information to the server 200. The moving state information and attribute information to be transmitted include identification information of the mobile terminal 100 (or the user). The moving state information is transmitted at any time.

[0053] Furthermore, for example, the control unit 130 causes the output unit 140 to execute a warning activation action (details will be described later) based on the determination result information (details will be described later) received by the communication unit 110 from the server 200.

[0054] The output unit 140 is an output device that performs an attention-calling operation.

[0055] The attention-calling activation action is an action that calls the attention of the user of the mobile terminal 100 when there is a possibility that the user of the mobile terminal 100 will collide with another user (hereinafter referred to as a collision possibility, or may be called a collision risk).

[0056] For example, when the output unit 140 is a display of the mobile terminal 100, an image indicating that there is a possibility of a collision is displayed as an attention-calling activation action.

[0057] Furthermore, for example, if the output unit 140 is a speaker of the mobile terminal 100, a sound (which may be a simple warning sound) indicating the possibility of a collision is output as the attention-calling activation action.

[0058] Furthermore, for example, if the output unit 140 is a vibrator of the mobile terminal 100, the mobile terminal 100 vibrates as the attention-calling activation action.

[0059] The above-mentioned various attention-calling actions may be performed in combination.

[0060] Furthermore, in the present embodiment, the case where the output unit 140 is provided in the mobile terminal 100 has been exemplified, but the present invention is not limited to this. For example, the output unit 140 may be an output device that is provided outside the mobile terminal 100 and is capable of wireless communication with the mobile terminal 100. Examples of such output devices include speakers and head-up displays built into helmets used by cyclists and riders, displays, speakers, and vibrators that vibrate the steering wheel or seat mounted in the interior of an automobile. In this case, the control unit 130 instructs the external output unit 140 to issue an alert by wireless communication via the communication unit 110.

[0061] Next, the server 200 will be described.

[0062] The server 200 is an information processing device that collects movement state information of each of multiple users (which may also be referred to as mobile terminals 100) and determines whether or not there is a possibility of collision between the users based on the movement state information. Although the server 200 is illustrated as a single device in Fig. 1, the server 200 may be a collection of multiple servers in which the units described below are distributed.

[0063] As shown in FIG. 1, the server 200 includes a communication unit 210, a storage unit 220, a determination unit 230, and a control unit 240.

[0064] The communication unit 210 is a communication device that performs network communication such as Internet communication.

[0065] For example, the communication unit 210 receives the above-mentioned moving state information and attribute information from the mobile terminal 100, and transmits the determination result information described below to the mobile terminal 100. The communication unit 210 corresponds to an example of an "acquisition unit that acquires attribute information."

[0066] The storage unit 220 is a storage device that stores various types of information.

[0067] For example, the storage unit 220 stores the movement state information and attribute information collected from each of the multiple mobile terminals 100 for each user (identification information).

[0068] Furthermore, for example, the storage unit 220 stores map information indicating sidewalks, roads, buildings, and the like.

[0069] The determination unit 230 is a determination device that determines (predicts) whether or not there is a possibility of a collision between users who are close to each other, based on the movement state information of each user and map information. In this embodiment, the case where the possibility of a dangerous state determined by the determination unit 230 is the possibility of a collision between users will be described as an example; other examples of the possibility of a dangerous state will be described in modified examples described later.

[0070] Specifically, first, the determination unit 230 sets a risk target and a protection target for each user based on the attribute information.

[0071] Risk targets are those with attributes that make it more likely that they will become the perpetrators of traffic accidents. Protected targets are those with attributes that make it more likely that they will become the victims of traffic accidents.

[0072] Here, examples of risk objects and protection objects will be described with reference to Fig. 4. Fig. 4 is a diagram showing a list of risk objects and protection objects for each attribute.

[0073] For example, if the user's attribute is a pedestrian, drivers, riders, and cyclists are set as dangerous targets, and no protected targets are set.

[0074] For example, if the user's attribute is a cyclist, drivers, riders, and cyclists are set as dangerous targets, and pedestrians are set as targets to be protected.

[0075] For example, if the user's attribute is a rider, drivers and riders are set as dangerous targets, and pedestrians and cyclists are set as targets to be protected.

[0076] For example, if the user's attribute is a driver, the driver is set as a dangerous target, and pedestrians, cyclists, and riders are set as targets to be protected.

[0077] In this way, for a certain attribute, an attribute that makes a person relatively vulnerable to traffic is set as a risk target, and an attribute that makes a person relatively vulnerable to traffic is set as a protection target.

[0078] The purpose of classifying into dangerous objects and protected objects in this way is, for example, to increase the flexibility of safety support services, such as encouraging only the dangerous objects to avoid danger, so that the protected objects do not feel bothered by notifications and are guided to safety without the dangerous objects knowing.

[0079] The above describes examples of dangerous objects and protected objects. Now, we return to the description of the determination unit 230.

[0080] Next, the determining unit 230 sets a safe area and a dangerous area for each user based on the attribute information.

[0081] The safe area is an area where the user is unlikely to have a traffic accident, and the dangerous area is an area where the user is likely to have a traffic accident.

[0082] For example, if the user's attribute is a pedestrian or a cyclist, the sidewalk is set as the safe area, and the roadway is set as the dangerous area.

[0083] For example, if the user's attribute is a rider or a driver, the roadway is set as the dangerous area, and the safe area is not set.

[0084] Next, the determination unit 230 determines whether or not there is a possibility of collision based on the above settings, the movement state information, and the map information. This collision possibility determination process is performed for users who are in the dangerous area, but may not be performed for users who are in the safe area.

[0085] An example of the collision possibility determination process will now be described with reference to Fig. 5. Fig. 5 is a schematic diagram showing an example of a movement situation of a plurality of users as seen from directly above.

[0086] As shown in Figure 5, roadway R has two vehicle lanes (a left lane and a right lane) running in the same direction. Arrow a in the figure indicates the direction of travel of bicycle B and automobiles V1 and V2. In the left lane, automobile V2 is stopped in front of bicycle B, which is traveling. Automobile V1, traveling in the right lane, is approaching bicycle B from behind.

[0087] First, the determination unit 230 compares the current positions indicated in the movement status information of the user (cyclist) riding bicycle B, the user (driver) riding automobile V1, and the user (driver) riding automobile V2 with the map information, thereby determining that each user is in a dangerous area and determining that each user is a target for collision possibility determination processing. All three users here are assumed to be users of the mobile terminal 100. Note that if the occupant of automobile V2, which is a parked vehicle, is not the user of the mobile terminal 100, the movement status information may be acquired by a camera installed on the road, etc.

[0088] Next, the determination unit 230 recognizes the relative positions (for example, the relative positions shown in FIG. 5), the direction of travel, and the speed of travel of the bicycle B and the automobiles V1 and V2 based on the travel state information and map information.

[0089] For example, if the judgment unit 230 recognizes that automobile V2 is stopped in the left lane (vehicle speed is zero), that bicycle B is traveling in the direction of arrow a in the left lane behind automobile V2, and that automobile V1 is traveling in the direction of arrow a in the right lane behind bicycle B at a faster speed than bicycle B, it predicts that bicycle B will change lanes from the left lane to the right lane and judges that there is a possibility of a collision between bicycle B and automobile V1.

[0090] If the movement status information includes information indicating, for example, the inclination of bicycle B to the right, the determination unit 230 may predict that bicycle B will change course from the left lane to the right lane. Using the inclination information enables more accurate prediction.

[0091] On the other hand, for example, if the judgment unit 230 recognizes that automobile V2 is stopped in the left lane (vehicle speed is zero), that bicycle B is stopped in the left lane behind automobile V2, and that automobile V1 is traveling in the direction of arrow a in the right lane behind bicycle B, it predicts that automobile V1 will overtake stopped bicycle B and determines that there is no possibility of a collision between bicycle B and automobile V1.

[0092] The above-described collision possibility determination process is merely an example, and the determination unit 230 may determine whether or not there is a collision possibility using other known methods.

[0093] An example of the collision possibility determination process has been described above. Now, we return to the description of the determination unit 230.

[0094] If the determination unit 230 determines that there is no possibility of collision, it again performs the above-mentioned setting process of the dangerous object, the protected object, the safe area, and the dangerous area, and the collision possibility determination process, based on the newly received movement status information and attribute information from each mobile terminal 100.

[0095] On the other hand, if the determination unit 230 determines that there is a possibility of collision, the control unit 240 performs processing (details of which will be described later).

[0096] The control unit 240 is a control device that determines which of the mobile terminals 100 of each user with whom there is a possibility of collision will issue a warning, and controls the communication unit 210 to issue a notification to that mobile terminal 100.

[0097] Specifically, first, the control unit 240 compares the attribute information of each user with whom there is a possibility of collision, and determines the mobile terminal 100 of the user who is relatively more aggressive as the terminal device that will execute the attention-calling operation.

[0098] For example, in the case where there is a possibility of a collision between bicycle B and automobile V1 shown in Figure 5, since the driver is a dangerous object (a traffic hazard) from the cyclist's perspective as shown in Figure 4, the control unit 240 determines that, of the mobile terminal 100 of the user of bicycle B and the mobile terminal 100 of the user of automobile V1, the mobile terminal 100 of the user of automobile V1 is the terminal device that will execute the warning activation operation.

[0099] Next, the control unit 240 controls the communication unit 210 to transmit determination result information indicating a possibility of collision to the mobile terminal 100 determined as the terminal device that will execute the attention-call activation action. As a result, the determination result information is transmitted from the communication unit 210 to the mobile terminal 100.

[0100] The determination result information may simply be information indicating that there is a possibility of collision, or may include attribute information and current location information of the user who is at risk of collision. For example, the determination result information transmitted to automobile V1 shown in Fig. 5 may include information indicating that there is a risk of collision with bicycle B traveling in front of and to the left of automobile V1.

[0101] As described above, when the mobile terminal 100 (specifically, the communication unit 110) receives the determination result information, the control unit 130 causes the output unit 140 to execute an alert activation action based on the determination result information.

[0102] For example, if the determination result information simply indicates that there is a possibility of a collision, the control unit 130 causes the output unit 140 to display an image indicating that fact, output a sound, and vibrate the mobile terminal 100. Furthermore, for example, if the determination result information includes attribute information and current location information of a user with a risk of collision, the control unit 130 causes the output unit 140 to display an image indicating the attribute information and current location information and output a sound, in addition to indicating that there is a possibility of collision. Note that the attention call activation action performed based on the determination result information may be performed based on the settings of the mobile terminal 100, regardless of the content of the determination result information.

[0103] The control unit 130 of the mobile terminal 100 may cause the output unit 140 to execute an attention alert activation operation based on the determination result information received from the server 200 and information indicating the rightward inclination of bicycle B. For example, if the determination unit 230 recognizes that automobile V2 is stopped in the left-hand traffic lane, that bicycle B is traveling in the direction of arrow a in the left-hand traffic lane behind automobile V2, and that automobile V1 is traveling in the direction of arrow a at a faster speed than bicycle B in the right-hand traffic lane behind bicycle B, the server 200 transmits the determination result information to the mobile terminal 100 that has been determined as the terminal device that will execute the attention alert activation operation. The mobile terminal 100 receives the determination result information from the server 200, but does not execute the attention alert activation operation at the time of receiving the determination result information, and waits for the execution of the attention alert activation operation. Thereafter, if a sensor provided in the mobile terminal 100 detects tilt of the mobile terminal 100 while waiting for the attention activation action (for example, when the user tilts bicycle B to the right to avoid automobile V2), the mobile terminal 100 executes the attention activation action. In other words, the detection of tilt of the mobile terminal 100 while waiting for the attention activation action can be used as a trigger to notify the user. Therefore, the mobile terminal 100 can recognize changes in the user's behavior and notify the user when there is a possibility of a dangerous situation, and not notify the user when there is no possibility of a dangerous situation, thereby reducing unnecessary and bothersome notifications for the user.

[0104] An example of the configuration of the safety support system 1 (mobile terminal 100 and server 200) according to this embodiment has been described above.

[0105] Next, an example of the operation of the mobile terminal 100 and the server 200 of this embodiment will be described with reference to Fig. 6. Fig. 6 is a sequence chart showing an example of the operation of the mobile terminal 100 and the server 200. Note that Fig. 6 illustrates the processing between one mobile terminal 100 and the server 200, but the flow shown in Fig. 6 is executed between each of a plurality of mobile terminals 100 and the server 200. Therefore, the server 200 manages each mobile terminal 100 by identification information (ID), and information transmitted from each mobile terminal 100 to the server 200 includes the identification information. This allows the server 200 to recognize which mobile terminal 100 the information was received from.

[0106] First, each mobile terminal 100 acquires the movement state information and attribute information, associates them with the ID of the mobile terminal 100 itself, and transmits them to the server 200 (step S20).

[0107] Next, the server 200 receives, from each mobile terminal 100, the movement state information and attribute information linked to the ID (step S21).

[0108] Next, the server 200 sets attributes for each ID and maps them on a map (step S22).

[0109] Next, the server 200 sets a dangerous object and a protected object based on the attribute information (step S23).

[0110] Next, the server 200 sets a safe area and a dangerous area based on the attribute information (step S24).

[0111] Next, the server 200 determines whether or not there is a possibility of a dangerous state based on the movement state information and the map information (step S25). In this embodiment, the possibility of a dangerous state is, for example, the possibility of a collision between users.

[0112] If there is no possibility of a dangerous state (step S26 / NO), the flow returns to step S21. In this case, the server 200 executes steps S22 to S25 again based on the movement state information and attribute information newly received from the mobile terminal 100 in step S21.

[0113] On the other hand, if there is a possibility of a dangerous state (step S26 / YES), the server 200 determines the terminal device that should execute the attention-calling activation action among the mobile terminals 100 of the possible users (step S27).

[0114] The server 200 transmits the determination result information to the mobile terminal 100 that has been determined as the terminal device that should execute the alert activation action (step S28).

[0115] The mobile terminal 100 receives the determination result information from the server 200 (step S29).

[0116] The mobile terminal 100 causes a predetermined output unit to execute an alert activation action (step S30).

[0117] An example of the operation of the mobile terminal 100 and the server 200 according to the embodiment has been described above.

[0118] The server 200 of the present embodiment described above is an information processing device that collects movement state information of each of a plurality of users and determines whether or not there is a possibility of a dangerous situation based on the movement state information, an acquisition unit (e.g., a communication unit 210) that acquires attribute information of each of a plurality of users; The system is characterized by having a control unit 240 that determines which of the terminal devices (e.g., mobile terminals 100) of each user who may be in a dangerous situation will execute the warning activation action based on the attribute information of the user.

[0119] With this feature, attention is called only for one of the users who may be involved in a collision, so that attention is not called frequently and the annoyance felt by the user can be reduced. That is, the server 200 of this embodiment can further improve the convenience of the safety support system 1. As a result, the number of participants in the safety support system 1 can be increased, which can contribute to the prevention of traffic accidents.

[0120] In particular, the server 200 of this embodiment is characterized by comparing the attribute information of each user with whom there is a possibility of collision, and determining the terminal device of the user who is relatively more aggressive as the terminal device that will execute the warning activation action.

[0121] This feature makes it possible to avoid frequent warnings to vulnerable road users (e.g., pedestrians and cyclists), thereby reducing the annoyance caused to vulnerable road users who tend to receive frequent warnings.

[0122] The above-described embodiments are merely examples of specific embodiments for carrying out the present disclosure, and the technical scope of the present disclosure should not be interpreted as being limited by these embodiments. In other words, the present disclosure can be carried out in various forms without departing from the gist or main features thereof.

[0123] Modifications that can be applied to the embodiment will be described below.

[0124] [Variation 1] In the embodiment, an example has been described in which the server 200 collects movement status information and attribute information from multiple mobile terminals 100, and each of multiple users becomes a target for determining the possibility of collision, but this is not limited to this.

[0125] For example, a mobile terminal 100 (hereinafter referred to as its own terminal) may receive movement status information and attribute information of a user of another terminal (a mobile terminal 100 other than its own terminal), and determine the possibility of a collision between the user of its own terminal and the other user based on that information.

[0126] In this case, the terminal itself may include the storage unit 220 and the determination unit 230 of the server 200 in addition to the units shown in Fig. 1. The flow of operations in this case will be briefly described below.

[0127] First, the acquisition unit 120 acquires attribute information and movement state information of the user of the terminal itself, as in the embodiment.

[0128] Furthermore, the communication unit 110 receives attribute information and movement state information of the user of the other terminal. At this time, the communication unit 110 may receive the attribute information and movement state information of the user of the other terminal directly from the other terminal, or may receive them from a distribution server (not shown).

[0129] Next, the determination unit 230 performs the same processing as in the embodiment (for example, setting dangerous objects and protected objects, setting safe areas and dangerous areas, and collision possibility determination processing) based on the attribute information and movement state information acquired by the acquisition unit 120 and the communication unit 110, and the map information stored in the storage unit 220. However, the collision possibility determination processing is targeted at the user of the own terminal (conversely, collision possibility determination processing between users of other terminals is not executed).

[0130] When the determination unit 230 determines that there is a possibility of collision, the control unit 130 determines the terminal device that will execute the attention-call activation action, similar to the control unit 240 described in the embodiment.

[0131] When the control unit 140 determines that the terminal device that executes the attention-call activation action is its own terminal, the control unit 140 causes the output unit 140 to execute a predetermined attention-call activation action.

[0132] On the other hand, when the control unit 140 determines that the terminal device that will execute the attention-calling operation is the other terminal, it controls the communication unit 110 to transmit the same determination result information as in the embodiment to the other terminal. As a result, the determination result information is transmitted to the other terminal directly or via a distribution server (not shown). Then, upon receiving the determination result information, the control unit 130 of the other terminal controls the output unit 140 to execute a predetermined attention-calling operation.

[0133] In this way, the mobile terminal 100 of this modified example is an information processing device that collects movement status information of each of multiple users and determines whether or not there is a possibility of a collision between the users based on the movement status information, and is characterized by having an acquisition unit (e.g., communication unit 110 and acquisition unit 120) that acquires attribute information of each of the multiple users, and a control unit 130 that determines which of the terminal devices (e.g., mobile terminal 100) of each user with whom there is a possibility of collision will execute the warning activation action based on the attribute information of each user.

[0134] Due to this feature, the mobile terminal 100 of this modification can obtain the same effects as those of the above-described embodiment.

[0135] [Variation 2] In this embodiment, the sidewalk is set as a safe area for pedestrians, so pedestrians on the sidewalk are not subject to the collision possibility determination process. However, bicycles may also ride on the sidewalk, and in such cases, there is a possibility of a collision between a pedestrian and a cyclist.

[0136] Therefore, the determination unit 230 may determine whether a cyclist is present on the sidewalk where a pedestrian is present. If a pedestrian and a cyclist are present on the same sidewalk, the control unit 240 transmits notification information to the mobile terminal 100 of the pedestrian notifying the cyclist of the presence of the cyclist, and also transmits prompting information to the mobile terminal 100 of the cyclist to change lanes.

[0137] Based on the received notification information, the control unit 130 of the pedestrian's mobile terminal 100 causes the output unit 140 to execute operations such as displaying an image or outputting a sound notifying the pedestrian of the presence of a cyclist.

[0138] Based on the received prompting information, the control unit 130 of the cyclist portable terminal 100 causes the output unit 140 to display an image or output a sound prompting the cyclist to change lane.

[0139] This operation reduces the possibility of collisions between pedestrians and cyclists on the sidewalk.

[0140] [Variation 3] When the user attribute is a driver, an in-vehicle device (not shown, for example, a car navigation system, a V2X communication unit, etc.) may be used instead of the mobile terminal 100. That is, the communication unit 110, the acquisition unit 120, the control unit 130, and the output unit 140 shown in FIG. 1 may be provided in the in-vehicle device.

[0141] In this case, the moving state information transmitted to the server 200 may include information indicating a steering operation or a direction indication operation detected by an in-vehicle sensor, etc. This allows the server 200 (specifically, the determination unit 230) to improve the accuracy of predicting the path of the driver (car).

[0142] As described in the embodiment, for example, the user's attribute may change from pedestrian to driver. In this case, when a user carrying the mobile terminal 100 gets into a vehicle, authentication processing may be performed between the mobile terminal 100 and the in-vehicle device via wireless communication, so that the in-vehicle device can take over the functions of each unit of the mobile terminal 100. This makes it possible to prevent conflicts in operation between the mobile terminal 100 and the in-vehicle device. Note that when the user gets out of the vehicle and the user's attribute changes from driver to pedestrian, the in-vehicle device ends the takeover of operation, and the operations of each unit are re-executed in the mobile terminal 100.

[0143] For example, in the attribute determination process, when the user's attribute is updated from pedestrian to driver, the mobile terminal 100 determines whether there is an in-vehicle device that can take over the functions of each unit of the mobile terminal 100. Here, the in-vehicle device that can take over may be a dashboard, an operating system for car navigation, or a V2X communication unit. Furthermore, in determining whether there is an in-vehicle device that can take over, if the in-vehicle device is a dashboard or an operating system for car navigation, it may be determined that there is an in-vehicle device that can take over by establishing a connection (cable connection) with the mobile terminal 100. Furthermore, if the in-vehicle device is a V2X communication unit, it may be determined that there is an in-vehicle device that can take over by authenticating the mobile terminal 100 and the in-vehicle device via a server. Then, if there is an in-vehicle device that can take over, the in-vehicle device takes over and executes the functions of each unit of the mobile terminal 100, and the mobile terminal 100 only performs attribute determination. On the other hand, if there is no in-vehicle device that can take over, the mobile terminal 100 continues to execute the functions of each unit. For example, if the in-vehicle device is a dashboard or an operating system for car navigation, the attention-calling activation operation is executed via the display panel of the car navigation or via audio output. If the in-vehicle device is a V2X communication unit, the attention-calling activation operation is executed via the display panel of a head-up display (HUD) or a liquid crystal meter or via audio output. This prevents the mobile terminal 100 and the in-vehicle device from competing in their operations, resulting in annoyance to the user due to alerts being issued from both sides. Note that if both an operating system for a dashboard or car navigation and a V2X communication unit are present, the in-vehicle device to take over may be determined based on the number of users per unit area based on map information. Specifically, the mobile terminal 100 receives the number of surrounding users per unit area (Nvx) confirmed by the V2X communication unit. Furthermore, the mobile terminal 100 inquires about the number of surrounding users per unit area (Nc) confirmed by the server 200 and receives the number of users (Nc).The mobile terminal 100 then compares the number of users (Nvx) with the number of users (Nc), and if the number of users (Nvx) is greater, it determines the V2X communication unit as the takeover destination, whereas if the number of users (Nc) is greater, it determines the operating system for the dashboard or car navigation system as the takeover destination. Note that the number of users (Nc) plus or minus a correction coefficient α may be compared with the number of users (Nvx). This allows priority to be given to in-vehicle devices that can be seen by more users in the surrounding area, enabling more accurate attention-calling activation.

[0144] [Variation 4] In the embodiment, an example has been given in which, if the user's attribute is pedestrian, the attention-call activation action is not executed on the user's mobile terminal 100 as long as the user is on the sidewalk (in other words, as long as the user does not step onto the roadway), but the user may set the mobile terminal 100 he or she owns so that the attention-call activation action is not executed. As a result, no attention is issued to pedestrians, which does not cause the user to feel bothered, and this promotes the expansion of the use of the safety support service. As a result, it becomes easier for many users to participate, and a highly reliable safety support service is realized overall.

[0145] [Variation 5] In the embodiment, the case where the possibility of a dangerous situation is the possibility of a collision between users has been described as an example, but the present invention is not limited to this. Other examples will be described below. In each of the following examples, steps S20 to S23 and S27 to S29 in FIG. 6 are the same as those in the embodiment, and therefore will not be described here.

[0146] <Example 1> For example, the likelihood of a dangerous condition may be determined based on the vehicle speeding.

[0147] In this case, the travel status information includes information on the travel speed (i.e., the speed of the bicycle, motorcycle, or automobile) of the user whose attribute is cyclist (bicycle driver), rider (motorcycle driver), or driver (automobile driver). The travel speed may be a value calculated based on, for example, the Doppler effect of GPS signals.

[0148] The determination unit 230 determines whether the user (bicycle, motorcycle, or automobile) is speeding based on the current location and movement speed indicated in the movement state information and the speed limit of the road indicated in the map information. If it is determined that the user is speeding, the control unit 240 determines that the user's mobile terminal 100 is the terminal device that should execute the alert activation action. Note that the speeding determination may be performed by the mobile terminal 100, or may be made by receiving the speed limit of the road indicated in the map information from the server 200 and comparing the speed limit and the movement speed in the control unit 130.

[0149] <Example 2> For example, the likelihood of a dangerous condition may be determined based on whether the bicycle is riding on a sidewalk.

[0150] The determination unit 230 determines whether the user (bicycle) is on the sidewalk and riding on the sidewalk based on the current location indicated in the movement state information of the user whose attribute is cyclist and the map information. If it is determined that the user is riding on the sidewalk on the bicycle, the control unit 240 determines that the mobile terminal 100 of the user is the terminal device that should execute the attention-calling operation (for example, a notification based on the prompt information described in Modification 2).

[0151] <Example 3> For example, the likelihood of a dangerous situation may be determined based on the likelihood of a rear-end collision with a parked vehicle.

[0152] The determination unit 230 determines whether the user (bicycle or automobile) is likely to crash into a parked vehicle based on the current location indicated in the movement state information of the user whose attribute is cyclist, rider, or driver and detection information acquired from an external device (for example, detection information results from a camera installed at a non-line-of-sight intersection). If it is determined that the user is likely to crash into a parked vehicle, the control unit 240 selects the mobile terminal 100 of the user as the terminal device that should execute an attention-calling operation. Note that, as a method of detecting parked vehicles, if the coordinates of the position where the attribute of the mobile terminal 100 switches from driver to pedestrian are on a roadway in the attribute determination of the mobile terminal 100, the server 200 may determine that the vehicle driven by the user of the mobile terminal 100 (a vehicle linked to the mobile terminal 100 by location information or communication authentication) is a parked vehicle.

[0153] <Example 4> For example, the possibility of a dangerous situation may be determined based on whether or not a predetermined number or more of users whose attribute is pedestrian are present within a predetermined range.

[0154] The determination unit 230 determines whether there are a predetermined number or more pedestrians within a predetermined range in the traveling direction of the second user, based on the current location indicated in the movement status information of a user whose attribute is pedestrian (hereinafter referred to as the first user) and the current location indicated in the movement status information of a user whose attribute is either cyclist, rider, or driver (hereinafter referred to as the second user) (if the user is a driver, the travel route registered in the car navigation system may be included). For example, the predetermined range is set to 10 m. 2It is sufficient to determine whether there are a predetermined number of pedestrians, 20 or more, within the predetermined range. If it is determined that there are a predetermined number of pedestrians or more within the predetermined range, the control unit 240 determines the mobile terminal 100 of the second user as the terminal device that should execute the attention alert activation action. Furthermore, the control unit 240 may search for a driving route that can avoid places where there are many pedestrians based on map information, etc., and transmit guidance information indicating the driving route to the mobile terminal 100 of the second user. As a result, the mobile terminal 100 of the second user is notified of the driving route (an example of an attention alert activation action). This allows the second user to easily drive a safe route. Furthermore, the second user can prevent delays in arriving at the destination.

[0155] The above-described modified examples may be combined as appropriate. [Industrial Applicability]

[0156] The information processing device and information processing method of the present disclosure are useful for technology that supports the safety of users while traveling. [Explanation of symbols]

[0157] 1 Safety Support System 100 mobile devices 110 Communications Department 120 Acquisition Department 130 Control Unit 140 Output section 200 servers 210 Communications Department 220 Storage section 230 Judgment section 240 Control Unit

Claims

1. An information processing device that collects movement state information of each of a plurality of users and determines whether or not there is a possibility of a dangerous state based on the movement state information, an acquisition unit that acquires attribute information of each of the plurality of users; a control unit that determines, based on attribute information of each of the users who may be in the dangerous state among the plurality of users, a first terminal device that will execute an alert activation action from among the terminal devices carried by each of the users; the attribute information indicates one of a pedestrian, a bicycle driver, a motorcycle driver, and a car driver; The control unit If the user who is likely to be in a dangerous state is a user who is likely to collide with another user, the attribute information of the other user and the user who is likely to collide is compared, and the terminal device of the user who is relatively more dangerous is determined to be the first terminal device. Information processing device.

2. The user who may be in a dangerous state is a user who is detected to be speeding. The information processing device according to claim 1 .

3. The user who may be in a dangerous situation is a user who is riding a bicycle on a sidewalk. The information processing device according to claim 1 .

4. The warning activation is a notification to prompt a change of driving route. The information processing device according to claim 3 .

5. The user who may be in a dangerous state is a user who may be in a rear-end collision with a parked vehicle. The information processing device according to claim 1 .

6. The user who is likely to be in a dangerous situation is a user who is in a traveling direction of the user and there are a predetermined number of pedestrians within a predetermined range. The information processing device according to claim 1 .

7. The warning activation action is notification of a driving route that can avoid a location where a predetermined number of pedestrians or more are present. The information processing device according to claim 6 .

8. the information processing device is a server, The server transmitting, to the first terminal device, determination result information indicating that there is a possibility of the dangerous state; The first terminal device causing a predetermined output unit to execute the alert activation action based on the determination result information. The information processing device according to claim 1 .

9. the information processing device is a second terminal device among terminal devices carried by each of the plurality of users, The control unit When the second terminal device is determined to be the first terminal device, an output unit of the second terminal device is caused to execute the alert activation action. The information processing device according to claim 1 .

10. 1. An information processing method executed by an information processing device that collects movement state information of each of a plurality of users and determines whether or not there is a possibility of a dangerous state based on the movement state information, acquiring attribute information of each of the plurality of users; determining, based on attribute information of each of the users who may be in the dangerous state among the plurality of users, a first terminal device that will execute an alert activation action from among the terminal devices carried by each of the users; the attribute information indicates one of a pedestrian, a bicycle driver, a motorcycle driver, and a car driver; When the user who is likely to be in a dangerous state is a user who is likely to collide with another user, the first terminal device compares the attribute information of the other user with the attribute information of the user who is likely to collide with the other user, and determines whether the first terminal device is a terminal device of a user who is relatively more dangerous than the other user. Information processing methods.

11. The user who may be in a dangerous state is a user who is detected to be speeding. The information processing method according to claim 10.

12. The user who may be in a dangerous situation is a user who is riding a bicycle on a sidewalk. The information processing method according to claim 10.

13. The user who may be in a dangerous state is a user who may be in a rear-end collision with a parked vehicle. The information processing method according to claim 10.

14. The user who is likely to be in a dangerous situation is a user who is in a traveling direction of the user and there are a predetermined number of pedestrians within a predetermined range. The information processing method according to claim 10.

15. the information processing device is a server, the server transmits to the first terminal device determination result information indicating that there is a possibility of the dangerous state; The alert activation action is executed by the output unit of the first terminal device based on the determination result information. The information processing method according to claim 10.

16. the information processing device is a second terminal device among terminal devices carried by each of the plurality of users, When the second terminal device is determined to be the first terminal device, an output unit of the second terminal device is caused to execute the alert activation action. The information processing method according to claim 10.

Citation Information

Patent Citations

  • Road crossing pedestrian announcing system

    JP2004157847A

  • Pedestrian-to-vehicle communication device and mobile terminal

    JP2009251758A

  • Terminal device, driving assistance method, and driving assistance program

    JP2018013847A

  • Display device and method for display

    JP2021117089A

  • Pedestrian terminal device, vehicle-mounted terminal device, pedestrian-to-vehicle communication control device, pedestrian-to-vehicle communication system, and pedestrian-to-vehicle communication method

    WO2017104093A1