Auxiliary control device, auxiliary control method and computer readable storage medium

Abstract

The invention provides an assist control apparatus, an assist control method, and a computer readable storage medium. An assist control device is provided with: an information acquisition unit that acquires information indicating the distance or time of movement of a user, which is a traffic participant, from the time when a user terminal associated with the user outputs an alarm until the movement of the user is stopped; a storage control unit that, on the basis of the information acquired by the information acquisition unit, performs control for storing movement information indicating the distance or time at which the user moves from the time when the user terminal outputs an alarm until the movement of the user stops; and an alarm control unit that causes the user terminal to output an alarm, the alarm control unit adjusting the timing at which the user terminal outputs the alarm on the basis of the movement information stored by the control of the storage control unit.

Description

Technical Field

[0001] The invention relates to an auxiliary control device, an auxiliary control method and a computer-readable storage medium. Background Art

[0002] In recent years, efforts to provide access to sustainable transportation systems for people in vulnerable situations among traffic participants have become increasingly active. To achieve this goal, research and development efforts have been made to further improve the safety and convenience of traffic through research and development related to preventive safety technologies. Patent Documents 1 to 4 describe technologies related to pedestrians crossing the road and running off the road.

[0003] Patent Document 1: Japanese Patent Application Publication No. 2017-49687

[0004] Patent Document 2: Japanese Patent Application Publication No. 2019-204241

[0005] Patent Document 3: Japanese Patent Application Publication No. 2008-310376

[0006] Patent Document 4: Japanese Patent Application Publication No. 2018-151712 Summary of the invention

[0007] However, in preventive safety technology, the timing of outputting an alarm to traffic participants is a problem. In order to solve the above problem, the present application aims to output an alarm to each person at an appropriate timing. In addition, it also contributes to the development of a sustainable transportation system.

[0008] In a first aspect of the present invention, an auxiliary control device is provided. The auxiliary control device includes an information acquisition unit that acquires information indicating the distance or time that the user has moved from the time a user terminal associated with the user as a traffic participant outputs an alarm until the user's movement stops. The auxiliary control device includes a storage control unit that controls the storage of movement information indicating the distance or time that the user has moved from the time the user terminal outputs an alarm until the user's movement stops based on the information acquired by the information acquisition unit. The auxiliary control device includes an alarm control unit that causes the user terminal to output an alarm. The alarm control unit adjusts the timing of causing the user terminal to output an alarm based on the movement information stored under the control of the storage control unit.

[0009] In any of the above-mentioned auxiliary control devices, the information acquisition unit can obtain information obtained by the user terminal after the alarm control unit causes the user terminal to output an alarm, indicating the distance or time of the user's movement from the time the user terminal outputs the alarm until the user's movement stops.

[0010] In any of the above-mentioned auxiliary control devices, the information acquisition unit can obtain the user's step count information counted by the user terminal during the period from the user terminal outputting the alarm until the user terminal stops moving, which is obtained by the user terminal after the alarm control unit causes the user terminal to output an alarm.

[0011] Any of the above-mentioned auxiliary control devices may also include a user state acquisition unit that acquires state information indicating whether the user is in a walking state or a driving state. The information acquisition unit may acquire, for each of the walking state and the driving state, information indicating the distance or time that the user has moved from the time the user terminal outputs an alarm until the user stops moving. The storage control unit may perform control for storing movement information based on the information acquired by the information acquisition unit in correspondence with the state information acquired by the user state acquisition unit. The alarm control unit may adjust the timing for causing the user terminal to output an alarm based on the movement information stored in correspondence with the state information acquired by the user state acquisition unit.

[0012] Any of the above auxiliary control devices may further include a user state acquisition unit that acquires state information indicating whether the user is riding a bicycle. When the user is riding a bicycle, the information acquisition unit may acquire information indicating the distance or time the user has moved from when the user terminal outputs an alarm until the user stops moving. The storage control unit may perform control for storing movement information based on the information acquired by the information acquisition unit in correspondence with the state information acquired by the user state acquisition unit. The alarm control unit may adjust the timing for causing the user terminal to output an alarm based on the information stored in correspondence with the state information acquired by the user state acquisition unit.

[0013] Any of the above-mentioned auxiliary control devices may further include a deceleration information collection unit that collects information indicating the deceleration from the state in which the user is riding the bicycle until the bicycle stops by braking. The information acquisition unit may acquire information indicating the distance or time that the user has moved from the output of the alarm from the user terminal until the movement of the user stops, based on the deceleration exceeding a predetermined reference value among the decelerations collected by the deceleration information collection unit.

[0014] In any of the above-mentioned auxiliary control devices, a user status acquisition unit for acquiring status information indicating the physical or psychological status of the user may also be provided. The information acquisition unit may acquire, for each status information acquired by the user status acquisition unit, information indicating the distance or time the user has moved from the time the user terminal outputs an alarm until the user stops moving. The storage control unit may perform control for storing movement information based on the information acquired by the information acquisition unit in correspondence with the status information acquired by the user status acquisition unit. The alarm control unit may adjust the timing for causing the user terminal to output an alarm based on the movement information stored in correspondence with the status information acquired by the user status acquisition unit.

[0015] In any of the above-mentioned assistance control devices, the storage control unit may perform control for increasing the distance indicated by the already stored movement information as the age of the user increases.

[0016] In any of the above auxiliary control devices, a walking pattern acquisition unit may be provided, which acquires dynamic image information of the user's walking. The auxiliary control device may also include a walking style determination unit, which determines the walking style of the user determined based on the dynamic image information acquired by the walking pattern acquisition unit. The information acquisition unit may acquire a distance or time corresponding to the walking style of the user determined by the walking style determination unit as information representing the distance or time.

[0017] In a second aspect of the present invention, an auxiliary control method is provided. The auxiliary control method includes a step of acquiring information indicating the distance or time that the user has moved from when a user terminal associated with the user as a traffic participant outputs an alarm until the user's movement stops. The auxiliary control method includes a step of performing control for storing movement information indicating the distance or time that the user has moved from when the user terminal outputs an alarm until the user's movement stops based on the information acquired in the step of acquiring information. The auxiliary control method includes a step of adjusting the timing of causing the user terminal to output an alarm based on the movement information.

[0018] In a third aspect of the present invention, there is provided a program that causes a computer to function as any one of the above-mentioned auxiliary control devices.

[0019] In addition, the above summary of the invention does not list all the features of the present invention. In addition, a sub-combination of these feature groups may also be an invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 A usage scenario of the assistance system 10 is schematically shown.

[0021] Figure 2 The functional structure of the auxiliary device 60 is shown.

[0022] Figure 3 An example of a data structure of stop recording information for each user measured by a user terminal is shown.

[0023] Figure 4 An example of the data structure of bicycle deceleration record information is shown.

[0024] Figure 5 An example of the data structure of the stop required time information is shown.

[0025] Figure 6 An example of the data structure of the correction time information for the stop required time is shown.

[0026] Figure 7 A diagram for explaining an example of the timing of transmitting the alarm information to the user terminal 82 .

[0027] Figure 8 An example of the execution flow of processing performed by the imaging device 70 , the user terminal 82 , the in-vehicle processing device 40 included in the vehicle 20 , and the support device 60 is shown.

[0028] Fig. 9 An example of a computer 2000 is shown. DETAILED DESCRIPTION

[0029] Hereinafter, the present invention will be described by way of the embodiments of the invention, but the following embodiments do not limit the claimed invention. In addition, not all combinations of features described in the embodiments are essential to the solution means of the invention.

[0030] Figure 1 The following schematically shows a usage scenario of the support system 10 . The support system 10 includes a vehicle 20 , a user terminal 82 , a support device 60 , and a camera 70 .

[0031] The vehicle 20 includes the vehicle-mounted processing device 40. The user terminal 82 is a terminal held by the user 80. In the present embodiment, the user 80 is a pedestrian.

[0032] The vehicle 20 is a vehicle traveling on the road 90. The vehicle 20 is an example of a mobile body. The vehicle-mounted processing device 40 has a function of communicating with the outside using mobile communication. The vehicle-mounted processing device 40 includes sensors such as a position sensor including a global navigation satellite system (GNSS) receiver, a speed sensor such as a vehicle speed sensor, and a distance sensor that measures the distance from the vehicle 20 to surrounding objects. The vehicle-mounted processing device 40 has a function of processing information obtained by various sensors provided in the vehicle-mounted processing device 40, and a function of communicating with the auxiliary device 60. The vehicle-mounted processing device 40 provides an advanced driving assistance system (ADAS) function provided by the vehicle 20.

[0033] The user terminal 82 is a portable terminal such as a smartphone, for example. The user terminal 82 is an example of a mobile object. The user terminal 82 periodically transmits the current position information of the user terminal 82 detected by a position sensor including a GNSS receiver to the assistance device 60.

[0034] The camera 70 is a camera installed on a traffic infrastructure, and acquires the positions of the vehicle 20 and the user 80 within the camera range of the camera 70 by analyzing the captured images, and transmits the acquired positions of the vehicle 20 and the user 80 to the assisting device 60 .

[0035] The assistance device 60 receives information sent from the vehicle-mounted processing device 40, the user terminal 82, and the camera 70 through mobile communication. The assistance device 60 can receive information sent from the vehicle-mounted processing device 40, the user terminal 82, and the camera 70 through any combination of communication lines such as mobile communication, the Internet, and dedicated lines. The assistance device 60 performs traffic assistance for traffic participants based on the information received from the vehicle-mounted processing device 40, the user terminal 82, and the camera 70.

[0036] In the present embodiment, it can be assumed that the user 80 exists within a predetermined range from the position of the user terminal 82. For example, the position of the user terminal 82 can be regarded as the position of the user 80.

[0037] For example, in the case where it is determined that the user terminal 82 is moving toward the road 90 based on the road information including the history of the location information of the user terminal 82 and the location information of the road 90, the support device 60 predicts the positions of the user terminal 82 and the vehicle 20 at the time point when the user terminal 82 arrives at the road 90 based on the history of the location information of the user terminal 82 and the vehicle 20 and the map information. When the distance between the position of the user terminal 82 and the position of the vehicle 20 at the time point when the user terminal 82 arrives at the road 90 is less than a predetermined distance, the support device 60 determines that the user terminal 82 is close to the vehicle 20, and transmits alarm information to the user terminal 82 to instruct the user terminal 82 to output an alarm.

[0038] The auxiliary device 60 obtains the time required from the output of the alarm from the user terminal 82 to the stop of the user 80. The time taken from the output of the alarm from the user terminal 82 to the stop of the user 80 is sometimes referred to as the time required to stop. The auxiliary device 60 can obtain the time required to stop from the user terminal 82. The auxiliary device 60 can obtain the time required to stop estimated from the history of the location information of the user terminal 82. The auxiliary device 60 can obtain the time required to stop corresponding to the age of the user 80. The auxiliary device 60 adjusts the timing of sending the alarm information to the user terminal 82 in consideration of the time required to stop of the user terminal 82. For example, the longer the time required to stop, the earlier the timing of sending the alarm information to the user terminal 82. Thus, according to the auxiliary system 10, it is possible to consider the time required to stop of each user 80 and adjust the timing of sending the alarm information so that the user 80 can stop safely.

[0039] Figure 2 The following is a functional configuration of the support device 60. The support device 60 includes a support control device 200, a communication device 290, and a storage device 280.

[0040] The communication device 290 is responsible for the communication between the vehicle-mounted processing device 40, the user terminal 82 and the camera 70 and the auxiliary device 60, respectively, based on the control of the auxiliary control device 200. The auxiliary control device 200 is implemented by a circuit including, for example, a calculation processing device including a processor. The auxiliary control device 200 can be implemented by a microcomputer including a CPU, ROM, RAM, I / O, bus, etc. The storage device 280 is implemented by having a non-volatile storage medium. The auxiliary control device 200 uses the information stored in the storage device 280 for processing. The storage device 280 can store map information. The map information stored in the storage device 280 can be used by the auxiliary control device 200.

[0041] The auxiliary control device 200 includes a user state acquisition unit 210, an information acquisition unit 250, a storage control unit 240, a deceleration information collection unit 230, a walking pattern information acquisition unit 220, a walking style determination unit 270, and an alarm control unit 260. Figure 2 The functional form of a part of the functional structure shown.

[0042] The information acquisition unit 250 acquires information indicating the distance or time that the user 80 has moved from the time when the user terminal 82 associated with the user 80 as a traffic participant outputs an alarm until the user 80 stops moving. Based on the information acquired by the information acquisition unit 250, the storage control unit 240 performs control for storing movement information indicating the distance or time that the user 80 has moved from the time when the user terminal 82 outputs an alarm until the user 80 stops moving. The alarm control unit 260 causes the user terminal 82 to output an alarm. The alarm control unit 260 adjusts the timing for causing the user terminal 82 to output an alarm based on the movement information stored under the control of the storage control unit 240.

[0043] The information acquisition unit 250 can acquire information indicating the distance or time that the user 80 has moved from the time the user terminal 82 outputs the alarm until the user 80 stops moving, which is acquired by the user terminal 82 after the alarm control unit 260 causes the user terminal 82 to output the alarm. The information acquisition unit 250 can acquire information indicating the number of steps of the user 80 counted by the user terminal 82 during the period from the time the user terminal 82 outputs the alarm until the user terminal 82 stops moving, which is acquired by the user terminal 82 after the alarm control unit 260 causes the user terminal 82 to output the alarm.

[0044] The user state acquisition unit 210 may acquire state information indicating whether the user 80 is in a walking state or a driving state. The information acquisition unit 250 may acquire information indicating the distance or time that the user 80 has moved from when the user terminal 82 outputs an alarm until the user 80 stops moving, for each of the walking state and the driving state. The storage control unit 240 may perform control for storing movement information based on the information acquired by the information acquisition unit 250 in correspondence with the state information acquired by the user state acquisition unit 210. The alarm control unit 260 may adjust the timing for causing the user terminal 82 to output an alarm, based on the movement information stored in correspondence with the state information acquired by the user state acquisition unit 210.

[0045] The user state acquisition unit 210 may acquire state information indicating whether the user 80 is in a state of riding a bicycle. When the user 80 is in a state of riding a bicycle, the information acquisition unit 250 may acquire information indicating the distance or time that the user 80 has moved from when the user terminal 82 outputs an alarm until the movement of the user 80 stops. The storage control unit 240 may perform control for storing movement information based on the information acquired by the information acquisition unit 250 in correspondence with the state information acquired by the user state acquisition unit 210. The alarm control unit 260 may adjust the timing of causing the user terminal 82 to output an alarm based on the information stored in correspondence with the state information acquired by the user state acquisition unit 210.

[0046] The deceleration information collecting unit 230 may collect information indicating the deceleration from when the user 80 is riding the bicycle until the bicycle stops by applying the brakes. The information acquiring unit 250 may acquire information indicating the distance or time that the user 80 has moved from when the user terminal 82 outputs an alarm until the user 80 stops moving, based on the deceleration exceeding a predetermined reference value among the decelerations collected by the deceleration information collecting unit 230.

[0047] The user state acquisition unit 210 may acquire state information indicating the physical or mental state of the user 80. For each of the state information acquired by the user state acquisition unit 210, the information acquisition unit 250 may acquire information indicating the distance or time that the user 80 has moved from when the user terminal 82 outputs the alarm until the movement of the user 80 stops. The storage control unit 240 may perform control for storing movement information based on the information acquired by the information acquisition unit 250 in correspondence with the state information acquired by the user state acquisition unit 210. The alarm control unit 260 may adjust the timing for causing the user terminal 82 to output the alarm based on the movement information stored in correspondence with the state information acquired by the user state acquisition unit 210.

[0048] The storage control unit 240 may perform control for lengthening the distance indicated by the already stored movement information as the age of the user 80 increases.

[0049] The walking pattern information acquisition unit 220 may acquire the dynamic image information of the walking of the user 80. The walking style determination unit 270 may determine the walking style of the user 80 determined based on the dynamic image information acquired by the walking pattern information acquisition unit 220. The information acquisition unit 250 may acquire the distance or time associated with the walking style of the user 80 determined by the walking style determination unit 270 as information indicating the distance or time.

[0050] Figure 3 An example of the data structure of the stop record information of each user measured by the user terminal is shown. The stop record information is, for example, information indicating the time measured by the user terminal 82 from when the user terminal 82 outputs an alarm until the user 80 stops walking. The support device 60 stores the information sent from the user terminal 82 in the storage device 280 as the stop record information.

[0051] The stop record information contains ID, exercise state, physical and mental state, stop required time and acquisition date as data items. ID is identification information of the user terminal 82. Exercise state is information indicating whether the user 80 is walking, running or riding a bicycle.

[0052] For example, the physical and mental state generally includes information indicating physical discomfort, normal, drunkenness, and anxiety. The physical and mental state is information indicating a psychological or physical state. The time required to stop is the time measured at the user terminal 82 from when the user terminal 82 outputs an alarm until the user 80 stops.

[0053] The acquisition date may be information indicating the date on which the support device 60 acquires the data of the stop recording information. The information acquisition unit 250 may acquire data of the ID, the exercise state, the physical and mental state, and the stop required time.

[0054] The motion state may be determined by the user terminal 82. The motion state of the user 80 may be determined based on the acceleration, angular velocity, and position information possessed by the user terminal 82. At least a portion of the motion state may be determined by analyzing an image acquired from the photographing device 70, and may be sent to the auxiliary device 60 together with the position information of the user 80 acquired by analyzing the image. The auxiliary device 60 may determine which user terminal 82 the motion state of the user 80 sent from the photographing device 70 is the motion state of the user by matching the position information of the user terminal 82 sent from the photographing device 70 with the position information of the user terminal 82.

[0055] The physical and mental state is determined by the user terminal 82. At least a part of the physical and mental state can be determined in the user terminal 82 based on the information obtained by the biosensor that detects the biometric information of the user 80. At least a part of the physical and mental state can be determined by analyzing the image obtained from the camera 70 and based on the expression, posture, etc. of the user 80, and can be sent to the auxiliary device 60 together with the position information of the user 80.

[0056] Figure 4 An example of the data structure of bicycle deceleration record information is shown. The bicycle deceleration record information is information obtained when the user 80 brakes and stops while the user 80 is riding the bicycle and no alarm is output from the user terminal 82. The auxiliary device 60 acquires the information sent from the user terminal 82 as the bicycle deceleration record information to the storage device 280.

[0057] The bicycle deceleration record information contains ID, deceleration related information, physical and mental state, stop required time and acquisition date as data items. ID is identification information of the user terminal 82.

[0058] The deceleration-related information is information related to deceleration based on the braking operation. For example, the user terminal 82 can obtain the braking operation information detected by the grip force sensor provided on the bicycle handlebars through wireless communication based on a communication standard such as Bluetooth (registered trademark) or ANT+ (registered trademark), and send the obtained information as the deceleration-related information to the auxiliary device 60.

[0059] When the information of the grip force sensor and the like is not obtained, the user terminal 82 sends the deceleration information as the deceleration related information to the auxiliary device 60. The deceleration information may be time series information of the speed detected by the speed sensor, time series information of the deceleration detected by the acceleration sensor, and / or at least one of the speed and stop time at the deceleration start time point.

[0060] For example, the physical and mental state generally includes information indicating physical discomfort, drunkenness, and anxiety. The physical and mental state is information indicating a psychological or physical state. The time required to stop is the time required from the start of deceleration to the stop of the bicycle when it is running, measured at the user terminal 82. The time required to stop can be measured based on the position information detected by the user terminal 82 and the information detected by the acceleration sensor provided by the user terminal 82. The user terminal 82 can obtain information detected by a sensor (e.g., a speed sensor) that detects the rotation of the bicycle wheel through wireless communication, and measure the time required to stop based on the obtained information.

[0061] The acquisition date may be information indicating the date on which the assist device 60 acquires the bicycle deceleration record information. The information acquisition unit 250 may acquire the data of the ID, deceleration-related information, physical and mental state, and stop time.

[0062] Figure 5 An example of the data structure of the stop required time information is shown. The stop required time information is stored in the storage device 280. The stop required time information is an example of movement information indicating the distance or time that the user 80 moves from when the user terminal 82 outputs an alarm until the movement of the user 80 stops.

[0063] The information on the time required to stop is combined by summarizing Figure 3 and Figure 4 The information generated by the stop record information and bicycle deceleration record information described above is stored in the storage control unit 240. The information on the time required to stop contains the ID and the movement state, the physical and mental states of "normal", "discomfort", "drunk" and "anxious", and the update date as data items.

[0064] ID is identification information of the user terminal 82. Exercise status is information indicating whether the user 80 is walking, running, or riding a bicycle. "Normal", "Unwell", "Drunk", and "Anxious" are information indicating physical and mental states, respectively. Update date may be information indicating the date when the auxiliary device 60 updates each data of the required stop time.

[0065] The storage control unit 240 refers to the stop record information and, for each ID, averages the stop required time corresponding to the combination of the movement state "walking" and the physical and mental state "normal", thereby calculating the stop required time corresponding to the combination of the movement state "walking" and the physical and mental state "normal" for each ID. For the combination of "physical discomfort", "drunk" and "anxiety" as other physical and mental states and the movement state "walking", the storage control unit 240 also refers to the stop record information and, for each ID, averages the stop required time corresponding to each combination of the movement state "walking" and the physical and mental state, thereby calculating the stop required time corresponding to each combination. Thus, the storage control unit 240 calculates the stop required time corresponding to each combination of the ID, the movement state "walking" and the physical and mental state, and stores it as data of the stop required time information.

[0066] The storage control unit 240 calculates the required stop time corresponding to each combination of the ID, the exercise state “running”, and the physical and mental state by performing the same process on the exercise state “running”, and stores it as data of the required stop time information.

[0067] The storage control unit 240 may calculate the required stop time corresponding to the exercise state “bicycle” and each physical and mental state by the same method as the method of calculating the required stop time corresponding to the exercise state “walking”.

[0068] Next, a method for calculating the required stopping time corresponding to the motion state "bicycle" based on the deceleration record information is described. The required stopping time in this embodiment is the time from when the alarm is output until the movement of the user 80 stops. Since it is assumed that emergency braking is performed when the alarm is output, it is preferable to determine the required stopping time corresponding to the motion state "bicycle" based on the time until the movement of the user 80 stops in the case of emergency braking.

[0069] Therefore, the storage control unit 240 extracts the stop time when it is determined that emergency braking has been performed from the stop time included in the deceleration record information, and determines the required stop time corresponding to the sports state "bicycle" based on the extracted stop time.

[0070] It is possible to determine whether emergency braking has been performed based on the deceleration-related information. For example, in the case where the deceleration-related information includes brake operation information, statistical processing can be performed on the data of the combination of grip force and stop time detected by the grip force sensor to classify the data into a data group of average combination and a data group corresponding to the combination of grip force exceeding a predetermined value and stop time shorter than a predetermined value, and the data belonging to the latter data group is set as the data obtained in the case of determining that emergency braking has been performed.

[0071] When the deceleration-related information does not include the braking operation information, it is possible to determine whether emergency braking has been performed based on the deceleration-related information. For example, by statistically processing the data of the combination of deceleration and stop time, the data can be classified into a data group of average combination and a data group corresponding to the combination of deceleration higher than a predetermined value and stop time shorter than a predetermined value, and the data belonging to the latter data group is set as the data obtained when it is determined that emergency braking has been performed.

[0072] The storage control unit 240 extracts the stop time when it is determined that emergency braking has been performed, and uses the extracted stop time to average the stop time corresponding to each physical and mental state for each ID, thereby calculating the stop time required corresponding to each combination of ID, movement state "bicycle" and physical and mental state, and storing it as data of stop time required information.

[0073] As described above, the required stop time associated with the motion state "bicycle" in the required stop time information can be calculated based on the stop record information and the deceleration record information. The required stop time associated with the motion state "bicycle" in the required stop time information can be calculated using both the required stop time calculated based on the stop record information and the required stop time calculated based on the deceleration record information. The required stop time calculated based on the deceleration record information can be used to supplement the required stop time calculated based on the stop record information.

[0074] The alarm control unit 260 refers to the stop required time information to adjust the timing of sending the alarm information to the user terminal 82. For example, when the identification information of the user terminal 82 is "ID1", the user 80 is in a walking state, and the physical and mental state of the user 80 is "normal", "2 seconds" is determined as the stop required time for the user 80. This means that it takes about 2 seconds from the output of the alarm to the user terminal 82 until the user 80 stops. Therefore, the alarm control unit 260 advances the timing of sending the alarm information to the user terminal 82 by "2 seconds".

[0075] The storage control unit 240 may update the required stop time each time a predetermined time has passed and / or each time new data is added to the stop record information and / or the deceleration record information. Each time a predetermined time has passed, the storage control unit 240 may lengthen the required stop time stored in the required stop time information according to the increase in the age of the user 80. Thus, the required stop time can be extended according to the increase in the age of the user 80. The amount of extension of the required stop time may be determined based on the required stop time and date of the user 80 stored in the stop record information, taking into account the amount of change in the required stop time over time. The amount of extension of the required stop time may be determined based on the required stop time and date of the multiple users stored in the stop record information, taking into account the amount of change in the required stop time of the multiple users over time. The amount of extension of the required stop time may be set based on the age of the user 80 registered via the user terminal 82.

[0076] As combined Figures 3 to 5 As described, the stop time required to establish a corresponding state "walking" in the stop time required information can be calculated based on the stop record information. The stop time required to establish a corresponding state "walking" in the stop time required information can be obtained based on the dynamic image information of the user 80 walking. For example, the walking pattern information acquisition unit 220 acquires the dynamic image information of the user 80 walking captured by the user terminal 82 or the camera 70. The walking mode determination unit 270 determines the walking mode of the user 80 determined according to the dynamic image information acquired by the walking pattern information acquisition unit 220. The walking mode can be a posture, a stride, a step speed, a gait, etc. The stop time required can be established in advance with the walking mode. For example, when the user's walking posture is classified as a forward leaning posture, the stop time required to establish a corresponding state with the forward leaning posture as the user's walking posture can be set to a longer time than the stop time required to establish a corresponding state with the normal posture. The information acquisition unit 250 can acquire information indicating the time corresponding to the walking mode of the user 80 determined by the walking mode determination unit 270 as the stop time information. In the same way, the required stopping time associated with the exercise state “running” in the required stopping time information can be acquired based on the moving picture information of the user 80 running.

[0077] Figure 6 An example of the data structure of the corrected time information for the stop required time is shown. The corrected time information is stored in the storage device 280.

[0078] The correction time information includes an ID and a correction time as data items. The ID is identification information of the user terminal 82. The correction time is a correction value for correcting the time required for the stop. The correction time can be set by the user 80. The storage control unit 240 changes the correction time corresponding to the identification information of the user terminal 82 based on the instruction from the user terminal 82.

[0079] For example, when the identification information of the user terminal 82 is "ID1", the alarm control unit 260 determines "1 second" as the correction time for the stop required time. In this case, the alarm control unit 260 will Figure 5 The stop required time (for example, "2 seconds") specified in the moving information shown is added by 1 second. Therefore, the alarm control unit 260 advances the timing of transmitting the alarm information by (stop required time + 1 second).

[0080] Figure 7 2 is a diagram for explaining an example of the timing of sending alarm information to the user terminal 82. When it is determined based on the history of the position information of the user terminal 82 that the user terminal 82 is moving toward the road 90, the alarm control unit 260 predicts the time t until the user terminal 82 reaches the road 90. For example, the alarm control unit 260 predicts the time t based on the moving speed v of the user terminal 82 estimated from the history of the position information of the user terminal 82 and the distance d1 from the current position of the user terminal 82 to the road 90.

[0081] The alarm control unit 260 predicts the position Q of the vehicle 20 at a timing after the current time t based on the speed of the vehicle 20 estimated from the history of the position information of the vehicle 20 and the current position of the vehicle 20. The alarm control unit 260 calculates the distance d2 between the position of the user terminal 82 in the moving direction of the vehicle 20 at the timing after the time t and the position Q of the vehicle 20. When d2 is less than a predetermined value, the alarm control unit 260 determines that the vehicle 20 and the user terminal 82 are close, and determines to send alarm information to the user terminal 82.

[0082] The alarm control unit 260 uses the combination Figure 5 and Figure 6 The method described above determines the stopping time T of the user 80. At this time, the alarm control unit 260 can determine the motion state and physical and mental state of the user 80 based on the information detected or set in the user terminal 82 and / or the information detected in the camera 70. Figure 5 The stopping time required for user 80 determined by the stopping time required information in is 2 seconds, and according to Figure 6 When the correction time of the user 80 specified by the correction time information in is 1 second, the alarm control unit 260 sets the stop required time T to 3 seconds.

[0083] In this case, the alarm control unit 260 determines to cause the user terminal 82 to transmit the alarm information at a timing when the position of the user terminal 82 reaches a position at least v×T ahead of the road 90. In practice, a margin of distance set in consideration of the detection accuracy of the position of the user terminal 82 is set to D, and the user terminal 82 is caused to transmit the alarm information at a timing when the distance from the current position of the user terminal 82 to the road 90 becomes D+v×T.

[0084] Thus, the alarm can be sent to the user 80 at a timing with a margin of the distance (v×T) that the user 80 travels after noticing the alarm until the user 80 stops. Therefore, the alarm information can be sent while ensuring the safety of the user 80.

[0085] Figure 8 An example of the execution flow of processing performed by the imaging device 70 , the user terminal 82 , the in-vehicle processing device 40 included in the vehicle 20 , and the support device 60 is shown.

[0086] In S700, the in-vehicle processing device 40 transmits the position information of the vehicle 20 to the support device 60. The position information is transmitted from the in-vehicle processing device 40 to the support device 60 periodically.

[0087] In S720, the user terminal 82 transmits location information indicating the current location of the user terminal 82 based on the signal received from the GNSS satellite to the auxiliary device 60. The location information is periodically transmitted from the user terminal 82 to the auxiliary device 60. The user terminal 82 may transmit the motion state and / or physical and mental state of the user 80 detected or set by the user terminal 82 to the auxiliary device 60.

[0088] In S730, the photographing device 70 transmits position information indicating the position of the user 80 obtained by analyzing the image photographed by the photographing device 70 to the auxiliary device 60. The position information is periodically transmitted from the photographing device 70 to the auxiliary device 60. The photographing device 70 may also transmit information indicating the motion state and / or physical and mental state of the user 80 obtained by analyzing the image to the auxiliary device 60.

[0089] In S714, the control unit 260 of the support device 60 determines whether to cause the user terminal 82 to output an alarm. For example, the alarm control unit 260 determines whether to cause the user terminal 82 to output an alarm. Figure 7 The described method determines whether to cause the user terminal 82 to output an alarm.

[0090] When it is determined that the user terminal 82 is to output an alarm, in S716, the alarm control unit 260 controls the communication device 290 to send alarm information indicating that the user terminal 82 should output an alarm to the user terminal 82. In addition, in S718, the alarm control unit 260 controls the communication device 290 to send alarm information indicating that the vehicle-mounted processing device 40 should output an alarm to the vehicle-mounted processing device 40.

[0091] When the vehicle-mounted processing device 40 receives the alarm information from the auxiliary device 60, in S704, the vehicle-mounted processing device 40 outputs an alarm indicating the presence of a user approaching the vehicle 20 through the HMI (Human Machine Interface) function, and notifies the passengers of the vehicle 20. The vehicle-mounted processing device 40 can notify the passengers of the vehicle 20 of the presence of a vehicle approaching the vehicle 20 through sound and display on a display device provided in the vehicle 20.

[0092] When the user terminal 82 receives the alarm information from the support device 60, in S724, the user terminal 82 outputs an alarm indicating that there is a vehicle 20 approaching the user 80 through the HMI function of the user terminal 82, thereby notifying the user 80. The user terminal 82 can output the alarm information indicating that there is a vehicle approaching the user 80 through sound.

[0093] In S726, the user terminal 82 measures the stop time from the output of the alarm in S724 until the movement of the user terminal 82 stops. In S728, the stop time measured in S726 is transmitted to the support device 60.

[0094] In S718, the alarm control unit 260 adds data indicating the stop time acquired in S728 to the stop record information. In S720, the alarm control unit 260 updates the stop required time information.

[0095] refer to Figures 3 to 8, mainly describes a method for calculating the time from when the user terminal 82 outputs an alarm until the movement of the user 80 stops, and a method for using the time to send an alarm message. Since the distance moved by the user 80 can be calculated based on the speed and time of the user 80, the same method can be applied to the method for calculating the distance moved by the user 80 from when the user terminal 82 outputs an alarm until the movement of the user 80 stops, and the same method can also be applied to the method for using the distance to send an alarm message. In addition, since the distance moved by the user 80 can be calculated based on the number of steps and stride of the user 80, if it is assumed that the stride of the user 80 is known or the stride of the user 80 is a specified value, the same method can be applied to the method for calculating the number of steps of the user 80 from when the user terminal 82 outputs an alarm until the movement of the user 80 stops, and can also be applied to the method for using the number of steps to send an alarm message.

[0096] According to the assistance system 10 described above, the timing of sending the alarm information to each user can be adjusted for each user in consideration of the distance or time that the user moves from the alarm output until the movement of each user stops. Furthermore, it can be said that the timing of sending the alarm information to each user can be delayed within the range that can ensure safety. By delaying the timing of sending the alarm information, the user's movements can be clearly seen, so the possibility of sending unnecessary alarm information can be reduced, and the accuracy of the alarm can be improved.

[0097] Fig. 9 An example of a computer 2000 that can fully or partially embody multiple embodiments of the present invention is shown. The program installed in the computer 2000 can cause the computer 2000 to function as a device such as the auxiliary device 60 or each unit of the device involved in the embodiment, perform operations associated with the device or each unit of the device, and / or perform a process involved in the embodiment or steps of the process. Such a program can be executed by the CPU 2012 in order to cause the computer 2000 to perform the processing flow described in this specification and specific operations associated with some or all of the functional blocks in the block diagram.

[0098] The computer 2000 according to the present embodiment includes a CPU 2012 and a RAM 2014, which are connected to each other via a main controller 2010. The computer 2000 further includes a ROM 2026, a flash memory 2024, a communication interface 2022, and an input / output chip 2040. The ROM 2026, the flash memory 2024, the communication interface 2022, and the input / output chip 2040 are connected to the main controller 2010 via the input / output controller 2020.

[0099] The CPU 2012 operates according to the programs stored in the ROM 2026 and the RAM 2014 , thereby controlling each unit.

[0100] The communication interface 2022 communicates with other electronic devices via a network. The flash memory 2024 stores programs and data used by the CPU 2012 in the computer 2000. The ROM 2026 stores a startup program executed by the computer 2000 when activated, and / or a program dependent on the hardware of the computer 2000. The input / output chip 2040 can also connect various input / output units such as a keyboard, a mouse, and a monitor to the input / output controller 2020 via an input / output port such as a serial port, a parallel port, a keyboard port, a mouse port, a monitor port, a USB port, and an HDMI (registered trademark) port.

[0101] The program is provided via a computer-readable storage medium such as a CD-ROM, DVD-ROM, or a USB flash drive, or a network. RAM 2014, ROM 2026, or flash memory 2024 is an example of a computer-readable storage medium. The program is installed in flash memory 2024, RAM 2014, or ROM 2026 and executed by CPU 2012. The information processing described in these programs is read by computer 2000, and the cooperation between the program and the various types of hardware resources described above is realized. The device or method can be constructed by implementing the operation or processing of information in accordance with the use of computer 2000.

[0102] For example, when the computer 2000 communicates with an external device, the CPU 2012 may execute a communication program loaded into the RAM 2014, and based on the processing described in the communication program, instruct the communication interface 2022 to perform communication processing. Under the control of the CPU 2012, the communication interface 2022 reads the transmission data stored in the transmission buffer processing area provided in the RAM 2014 and the recording medium such as the flash memory 2024, transmits the read transmission data to the network, and writes the reception data received from the network to the reception buffer processing area provided on the recording medium.

[0103] In addition, the CPU 2012 can read all or a necessary part of a file or database stored in a recording medium such as the flash memory 2024 to the RAM 2014, and execute various processes on the data in the RAM 2014. The CPU 2012 then writes the processed data back to the recording medium.

[0104] Various types of information such as programs, data, tables, and databases can be saved to a recording medium and applied to information processing. CPU2012 can perform various operations, information processing, conditional judgment, conditional branching, unconditional branching, information retrieval / replacement, etc., which are specified by the instruction sequence of the program, on the data read from RAM2014, and write the results back to RAM2014. In addition, CPU2012 can retrieve information in files, databases, etc. in the recording medium. For example, when multiple items having attribute values ​​of the first attribute associated with the attribute value of the second attribute are stored in the recording medium, CPU2012 can retrieve an item that specifies the attribute value of the first attribute and is consistent with the condition from the multiple items, read the attribute value of the second attribute stored in the item, and thereby obtain the attribute value of the second attribute associated with the first attribute that meets the pre-set condition.

[0105] The program or software module described above can be stored in a computer-readable storage medium on or near the computer 2000. A recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium. The program stored in the computer-readable storage medium can be provided to the computer 2000 via a network.

[0106] The program installed in the computer 2000 and causing the computer 2000 to function as the auxiliary device 60 can be run in the CPU 2012 or the like, thereby causing the computer 2000 to function as each unit of the auxiliary device 60 (e.g., the auxiliary control device 200, etc.). The information processing described in these programs is read into the computer 2000, thereby functioning as a specific unit in which software and the various hardware resources described above cooperate, that is, each unit of the auxiliary device 60. And, by using these specific units to realize the calculation or processing of information corresponding to the purpose of use of the computer 2000 in this embodiment, a unique auxiliary device 60 corresponding to the purpose of use is constructed.

[0107] Various embodiments are described with reference to block diagrams, etc. In the block diagram, each functional block may represent (1) a step of a process for performing an operation or (2) each unit of a device having the function of performing an operation. Specific steps and each unit may be implemented by a dedicated circuit, a programmable circuit supplied together with computer-readable instructions stored on a computer-readable storage medium, and / or a processor supplied together with computer-readable instructions stored on a computer-readable storage medium. The dedicated circuit may include digital and / or analog hardware circuits, and may also include integrated circuits (ICs) and / or discrete circuits. The programmable circuit may include reconfigurable hardware circuits including logical AND, logical OR, logical XOR, logical NAND, logical NOR, and other logical operations, flip-flops, registers, field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), etc., including memory elements.

[0108] The computer-readable storage medium may include any tangible device capable of storing instructions to be executed by an appropriate device, and as a result, the computer-readable storage medium having the instructions stored therein constitutes at least a part of a product containing instructions executable to implement a unit for performing the operations specified in the process flow or block diagram. As examples of computer-readable storage media, electrical storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, etc. may be included. As more specific examples of computer-readable storage media, floppy disks (registered trademark), floppy disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), electrically erasable programmable read-only memories (EEPROM), static random access memories (SRAM), compact disk read-only memories (CD-ROM), digital versatile disks (DVD), Blu-ray (registered trademark) optical disks, memory sticks, integrated circuit cards, etc. may be included.

[0109] Computer-readable instructions may include assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine delegate instructions, microcode, firmware instructions, state setting data, or any source code or object code described in any combination of one or more programming languages ​​including object-oriented programming languages ​​such as Smalltalk (registered trademark), JAVA (registered trademark), C++, and conventional procedural programming languages ​​such as the "C" programming language or similar programming languages.

[0110] Computer readable instructions are provided to a processor or programmable circuit of a general-purpose computer, a special-purpose computer, or other programmable data processing device via a local or local area network (LAN), a wide area network (WAN) such as the Internet, and the computer readable instructions can be executed to implement a unit for performing the operations specified in the described processing flow or block diagram. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, etc.

[0111] The present invention has been described above using the embodiments, but the technical scope of the present invention is not limited to the scope described in the above embodiments. It is obvious to those skilled in the art that various changes or improvements can be made to the above embodiments. It is obvious from the description of the claims that such changes or improvements can also be included in the technical scope of the present invention.

[0112] Regarding the execution order of each process of actions, processes, steps, and steps in the devices, systems, programs, and methods shown in the claims, specifications, and drawings, it should be noted that there is no special indication of "before", "preceding", etc., and in addition, as long as the output of the previous process is not used in the subsequent process, it can be implemented in any order. For the action flow in the claims, specifications, and drawings, even if "first", "next", etc. are used for convenience, it does not mean that it must be implemented in such an order.

[0113] [Description of Reference Numerals]

[0114] 10Assistance Systems

[0115] 20 vehicles

[0116] 40 On-board processing device

[0117] 60 auxiliary devices

[0118] 70 Camera

[0119] 80 users

[0120] 82 user terminals

[0121] 90 Road

[0122] 200 Auxiliary Control Devices

[0123] 210 User status acquisition unit

[0124] 220-step action map information acquisition department

[0125] 270 Walking style determination unit

[0126] 230 Speed ​​reduction information collection department

[0127] 240 Storage Control Unit

[0128] 250 Information Acquisition Department

[0129] 260 Alarm Control Department

[0130] 280 storage devices

[0131] 290 communication device

[0132] 2000 Computer

[0133] 2010 Main Controller

[0134] 2012CPU

[0135] 2014 RAM

[0136] 2020 Input / Output Controller

[0137] 2022 Communication Interface

[0138] 2024 Flash

[0139] 2026ROM

[0140] 2040 input / output chips.

Claims

1. An auxiliary control device, characterized in that: have: an information acquisition unit that acquires information indicating a distance or time that the user has moved from when a user terminal associated with the user as a traffic participant outputs an alarm until when the user's movement stops; a storage control unit that performs control for storing movement information indicating a distance or time that the user has moved from when the user terminal outputs an alarm until when the user's movement stops, based on the information acquired by the information acquisition unit; as well as an alarm control unit that causes the user terminal to output an alarm, The alarm control unit adjusts a timing for causing the user terminal to output an alarm based on the movement information stored under the control of the storage control unit.

2. The auxiliary control device according to claim 1, wherein: The information acquisition unit acquires information indicating a distance or time that the user moved from when the user terminal outputs the alarm until the user stops moving, which is acquired by the user terminal after the alarm control unit causes the user terminal to output the alarm.

3. The auxiliary control device according to claim 2, wherein: The information acquisition unit acquires the number of steps of the user counted by the user terminal during a period from when the user terminal outputs the alarm until movement of the user terminal stops, which is acquired by the user terminal after the alarm control unit causes the user terminal to output the alarm.

4. The auxiliary control device according to claim 1 or 2, wherein: The device further comprises a user state acquisition unit for acquiring state information indicating whether the user is in a walking state or a driving state. The information acquisition unit acquires information indicating a distance or time that the user has moved from when the user terminal outputs an alarm until when the user stops moving, for each of the walking state and the driving state. The storage control unit performs control for storing movement information based on the information acquired by the information acquisition unit in association with the status information acquired by the user status acquisition unit. The alarm control unit adjusts a timing for causing the user terminal to output an alarm based on the movement information stored in association with the status information acquired by the user status acquisition unit.

5. The auxiliary control device according to claim 1 or 2, wherein: The device further comprises a user state acquisition unit for acquiring state information indicating whether the user is riding a bicycle. The information acquisition unit acquires information indicating a distance or time that the user has traveled from when the user terminal outputs an alarm until when the user stops traveling by bicycle, when the user is riding a bicycle. The storage control unit performs control for storing movement information based on the information acquired by the information acquisition unit in association with the status information acquired by the user status acquisition unit. The alarm control unit adjusts a timing for causing the user terminal to output an alarm based on information stored in association with the state information acquired by the user state acquisition unit.

6. The auxiliary control device according to claim 5, wherein: The system further comprises a deceleration information collecting unit for collecting information indicating a deceleration rate from when the user is riding the bicycle to when the bicycle stops due to braking. The information acquisition unit acquires information indicating a distance or time that the user has moved from when the user terminal outputs an alarm until the user stops moving, based on a deceleration exceeding a predetermined reference value among the decelerations collected by the deceleration information collection unit.

7. The auxiliary control device according to claim 1 or 2, wherein: further comprising a user state acquisition unit for acquiring state information indicating a physical or mental state of the user, the information acquisition unit acquires information indicating a distance or time that the user has moved from when the user terminal outputs an alarm until when the user stops moving, for each piece of status information acquired by the user status acquisition unit; The storage control unit performs control for storing movement information based on the information acquired by the information acquisition unit in association with the status information acquired by the user status acquisition unit. The alarm control unit adjusts a timing for causing the user terminal to output an alarm based on the movement information stored in association with the status information acquired by the user status acquisition unit.

8. The auxiliary control device according to claim 1 or 2, wherein: The storage control unit performs control for increasing the distance indicated by the already stored movement information as the age of the user increases.

9. The auxiliary control device according to claim 1 or 2, wherein: Also available: a walking motion image acquisition unit, which acquires the walking motion image information of the user; and a walking pattern determination unit that determines the walking pattern of the user based on the dynamic image information acquired by the walking pattern acquisition unit, The information acquisition unit acquires, as information indicating the distance or time, a distance or time associated with the walking style of the user determined by the walking style determination unit.

10. An auxiliary control method, characterized in that: have: A step of acquiring information indicating a distance or time that the user has moved from when a user terminal associated with the user as a traffic participant outputs an alarm until when the user's movement stops; a step of performing control for storing movement information indicating a distance or time that the user has moved from when the user terminal outputs an alarm until when the user's movement stops, based on the information acquired in the step of acquiring information; as well as A step of adjusting a timing for causing the user terminal to output an alarm based on the movement information.

11. A computer-readable storage medium, characterized in that: A program for causing a computer to function as the auxiliary control device according to any one of claims 1 to 9 is stored.

Images