Support control device, support control method, and program
Patent Information
- Application Number
- JP2023124518
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-07-31
- Publication Date
- 2025-02-13
Smart Images
Figure 2025020889000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an assistance control device, an assistance control method, and a program. [Background technology]
[0002] In recent years, efforts to provide access to sustainable transportation systems that take into consideration vulnerable people among transportation participants have been gaining momentum. To achieve this, we are focusing on research and development to further improve the safety and convenience of transportation through research and development of preventive safety technology. Patent documents 1-4 describe technologies related to pedestrians crossing roads and jumping out into the street. [Prior art document] [Patent documents] Patent Document 1: JP 2017-49687 A Patent Document 2: JP 2019-204241 A Patent Document 3: JP 2008-310376 A Patent Document 4: JP 2018-151712 A Summary of the Invention [Problem to be solved by the invention]
[0003] However, in preventive safety technology, the timing of issuing a warning to traffic participants is an issue. In order to solve the above issue, the present application aims to issue a warning at an appropriate timing for each individual. This will ultimately contribute to the development of a sustainable transportation system. [Means for solving the problem]
[0004] In a first aspect of the present invention, there is provided an assistance control device. The assistance control device includes an information acquisition unit that acquires information indicating a distance or time traveled by a user, who is a traffic participant, from when a user terminal associated with the user outputs an alert until the user stops moving. The assistance control device includes a storage control unit that performs control to store movement information indicating a distance or time traveled by the user from when the user terminal outputs an alert until the user stops moving, based on the information acquired by the information acquisition unit. The assistance control device includes an alert control unit that causes the user terminal to output an alert. The alert control unit adjusts a timing for causing the user terminal to output an alert, based on the movement information stored under the control of the storage control unit.
[0005] In any of the above-mentioned assistance control devices, the information acquisition unit may acquire information acquired by the user terminal after the alarm control unit causes the user terminal to output an alarm, the information indicating the distance or time traveled by the user from when the user terminal outputs an alarm to when the user stops moving.
[0006] In any of the above-mentioned assistance control devices, the information acquisition unit may acquire step count information of the user, which is acquired by the user terminal after the alarm control unit causes the user terminal to output an alarm, and is counted by the user terminal from when the user terminal outputs an alarm to when the user terminal stops moving.
[0007] Any of the above assistance control devices may further include a user state acquisition unit that acquires state information indicating whether the user is in a walking state or a running state. The information acquisition unit may acquire information indicating a distance or time traveled by the user from when the user terminal outputs an alarm until the user stops moving, for each of the walking state and the running state. The storage control unit may perform control for storing movement information based on the information acquired by the information acquisition unit in association with the state information acquired by the user state acquisition unit. The alarm control unit may adjust a timing for causing the user terminal to output an alarm, based on the movement information stored in association with the state information acquired by the user state acquisition unit.
[0008] Any of the above assistance control devices may further include a user status acquisition unit that acquires status information indicating whether the user is riding a bicycle. The information acquisition unit may acquire information indicating a distance or time traveled by the user from when the user terminal outputs an alarm until the user stops moving when the user is riding a bicycle. The storage control unit may perform control to store movement information based on the information acquired by the information acquisition unit in association with the status information acquired by the user status acquisition unit. The alarm control unit may adjust the timing of outputting an alarm to the user terminal based on the information stored in association with the status information acquired by the user status acquisition unit.
[0009] Any of the above-mentioned assistance control devices may further include a deceleration information collection unit that collects information indicating a deceleration of the bicycle from a state in which the user is traveling until the bicycle is stopped by applying the brakes. The information acquisition unit may acquire information indicating a distance or time traveled by the user from when the user terminal outputs a warning until the user stops moving, based on a deceleration exceeding a predetermined reference value among the decelerations collected by the deceleration information collection unit.
[0010] Any of the above assistance control devices may further include a user status acquisition unit that acquires status information indicating the physical or mental status of the user. The information acquisition unit may acquire information indicating a distance or time traveled by the user from when the user terminal outputs an alarm until the user stops moving, for each piece of status information acquired by the user status acquisition unit. The storage control unit may perform control for storing movement information based on the information acquired by the information acquisition unit in association with the status information acquired by the user status acquisition unit. The alarm control unit may adjust the timing of outputting an alarm to the user terminal, based on the movement information stored in association with the status information acquired by the user status acquisition unit.
[0011] In any of the assistance control devices described above, the memory control unit may perform control to increase a distance indicated by the movement information that has already been stored in accordance with an increase in age of the user.
[0012] Any of the above-mentioned assistance control devices may include a walking video information acquisition unit that acquires video information of the user walking. The assistance control device may include a walking style identification unit that identifies the walking style of the user identified from the video information acquired by the walking video information acquisition unit. The information acquisition unit may acquire a distance or time associated with the walking style of the user identified by the walking style identification unit as information indicating the distance.
[0013] In a second aspect of the present invention, there is provided an assistance control method. The assistance control method includes a step of acquiring information indicating a distance or time traveled by a user who is a traffic participant from when a user terminal associated with the user outputs an alert until the user stops moving. The assistance control method includes a step of performing control for storing movement information indicating a distance or time traveled by the user from when the user terminal outputs an alert until the user stops moving, based on the information acquired in the step of acquiring information. The assistance control method includes a step of adjusting a timing for causing the user terminal to output an alert, based on the movement information.
[0014] In a third aspect of the present invention, there is provided a program for causing a computer to function as any one of the above-mentioned assistance control devices.
[0015] The above summary of the invention does not list all of the features of the present invention. Also, subcombinations of these features may also be inventions. [Brief description of the drawings]
[0016] [Figure 1] 1 illustrates a schematic diagram of a scenario in which the support system 10 is used. [Diagram 2] 2 shows the functional configuration of the support device 60. [Diagram 3] 13 shows an example of a data structure of stop performance information for each user measured by a user terminal. [Figure 4] 4 shows an example of a data structure of bicycle deceleration record information. [Diagram 5] 13 shows an example of a data structure of required stop time information. [Figure 6] 13 shows an example of a data structure of correction time information for a required stop time. [Figure 7] 13 is a diagram for explaining an example of the timing at which alert information is transmitted to a user terminal 82. FIG. [Figure 8] An example of an execution sequence of processes performed in the imaging device 70, the user terminal 82, the on-board processing device 40 provided in the vehicle 20, and the assistance device 60 is shown. [Figure 9] An example of a computer 2000 is shown. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0017] The present invention will be described below through embodiments of the invention, but the following embodiments do not limit the scope of the invention according to the claims. Furthermore, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention.
[0018] 1 shows a schematic diagram of a usage scenario of the assistance system 10. The assistance system 10 includes a vehicle 20, a user terminal 82, an assistance device 60, and an imaging device .
[0019] The vehicle 20 includes an on-board processing device 40. The user terminal 82 is a terminal carried by a user 80. In this embodiment, the user 80 is a pedestrian.
[0020] The vehicle 20 is a vehicle traveling on a road 90. The vehicle 20 is an example of a moving body. The on-board processing device 40 has a function of communicating with the outside using mobile communication. The on-board processing device 40 includes sensors such as a position sensor including a Global Navigation Satellite System (GNSS) receiver, a speed sensor such as a vehicle speed sensor, and a distance measurement sensor that measures the distance from the vehicle 20 to surrounding objects. The on-board processing device 40 has a function of processing information acquired by various sensors equipped in the on-board processing device 40, and a function of communicating with the assistance device 60. The on-board processing device 40 provides an advanced driver assistance system (ADAS) function equipped in the vehicle 20.
[0021] The user terminal 82 is, for example, a mobile terminal such as a smartphone. The user terminal 82 is an example of a moving body. The user terminal 82 periodically transmits current position information of the user terminal 82 detected by a position sensor including a GNSS receiver to the assistance device 60.
[0022] The imaging device 70 is an imaging device installed on a traffic infrastructure. The imaging device 70 acquires the positions of the vehicle 20 and the user 80 that are present within the imaging range of the imaging device 70 by analyzing the captured image, and transmits the acquired positions of the vehicle 20 and the user 80 to the assistance device 60.
[0023] The assistance device 60 receives information transmitted from the in-vehicle processing device 40, the user terminal 82, and the imaging device 70 via mobile communication. The assistance device 60 may receive information transmitted from the in-vehicle processing device 40, the user terminal 82, and the imaging device 70 via any combination of mobile communication, the Internet, and communication lines such as a dedicated line. The assistance device 60 provides traffic assistance to traffic participants based on the information received from the in-vehicle processing device 40, the user terminal 82, and the imaging device 70.
[0024] In this embodiment, it may be assumed that the user 80 is present within a predetermined range from the location of the user terminal 82. For example, the location of the user terminal 82 may be regarded as the location of the user 80.
[0025] For example, when the assistance device 60 determines that the user terminal 82 is moving toward the road 90 based on the history of the position information of the user terminal 82 and road information including the position information of the road 90, the assistance device 60 predicts the positions of the user terminal 82 and the vehicle 20 at the time when the user terminal 82 reaches the road 90 based on the history of the position information of the user terminal 82 and the vehicle 20 and map information. When the distance between the position of the user terminal 82 and the position of the vehicle 20 at the time when the user terminal 82 reaches the road 90 is shorter than a predetermined distance, the assistance device 60 determines that the user terminal 82 and the vehicle 20 are approaching each other, and transmits warning information to the user terminal 82 instructing the user terminal 82 to output a warning.
[0026] The support device 60 acquires the time required for the user 80 to stop after the user terminal 82 outputs the warning. The time required for the user 80 to stop after the user terminal 82 outputs the warning may be called the time required to stop. The support device 60 may acquire the time required to stop from the user terminal 82. The support device 60 may acquire the time required to stop estimated from the history of the position information of the user terminal 82. The support device 60 may acquire the time required to stop according to the age of the user 80. The support device 60 adjusts the timing of transmitting the warning information to the user terminal 82 in consideration of the time required to stop of the user terminal 82. For example, the longer the time required to stop, the earlier the timing of transmitting the warning information to the user terminal 82. As a result, according to the support system 10, the timing of transmitting the warning information can be adjusted in consideration of the individual time required to stop of the user 80 so that the user 80 can stop safely.
[0027] 2 shows a functional configuration of the assistance device 60. The assistance device 60 includes a assistance control device 200, a communication device 290, and a storage device 280.
[0028] The communication device 290 is responsible for communication between the in-vehicle processing device 40, the user terminal 82, and the imaging device 70 and the assistance device 60 under the control of the assistance control device 200. The assistance control device 200 is realized by including a circuit such as an arithmetic processing device including a processor. The assistance control device 200 may be realized by a microcomputer including a CPU, a ROM, a RAM, an I / O, a bus, and the like. The storage device 280 is realized by including a non-volatile storage medium. The assistance control device 200 performs processing using information stored in the storage device 280. The storage device 280 may store map information. The map information stored in the storage device 280 may be used by the assistance control device 200.
[0029] The assistance control device 200 includes a user state acquisition unit 210, an information acquisition unit 250, a memory control unit 240, a deceleration information collection unit 230, a walking video information acquisition unit 220, a walking style identification unit 270, and an alarm control unit 260. Note that a configuration may be adopted in which the assistance device 60 does not have some of the functions of the functional configuration shown in FIG.
[0030] The information acquisition unit 250 acquires information indicating the distance or time traveled by the user 80 from when the user terminal 82 associated with the user 80, who is a traffic participant, outputs an alert until the user 80 stops moving. The storage control unit 240 performs control to store movement information indicating the distance or time traveled by the user 80 from when the user terminal 82 outputs an alert until the user 80 stops moving, based on the information acquired by the information acquisition unit 250. The alarm control unit 260 causes the user terminal 82 to output an alert. The alarm control unit 260 adjusts the timing to cause the user terminal 82 to output an alert, based on the movement information stored under the control of the storage control unit 240.
[0031] The information acquiring unit 250 may acquire information indicating a distance or time traveled by the user 80 from when the user terminal 82 outputs an alarm to when the movement of the user 80 stops, which is acquired by the user terminal 82 after the alarm control unit 260 causes the user terminal 82 to output an alarm. The information acquiring unit 250 may acquire information on the number of steps of the user 80 counted by the user terminal 82 from when the user terminal 82 outputs an alarm to when the movement of the user terminal 82 stops, which is acquired by the user terminal 82 after the alarm control unit 260 causes the user terminal 82 to output an alarm.
[0032] The user state acquisition unit 210 may acquire state information indicating whether the user 80 is in a walking state or a running state. The information acquisition unit 250 may acquire information indicating a distance or time traveled by the user 80 from when the user terminal 82 outputs an alarm until the user 80 stops moving, for each of the walking state and the running state. The storage control unit 240 may perform control for storing movement information based on the information acquired by the information acquisition unit 250 in association with the state information acquired by the user state acquisition unit 210. The alarm control unit 260 may adjust the timing for causing the user terminal 82 to output an alarm, based on the movement information stored in association with the state information acquired by the user state acquisition unit 210.
[0033] The user state acquisition unit 210 may acquire state information indicating whether the user 80 is riding a bicycle. The information acquisition unit 250 may acquire information indicating a distance or time traveled by the user 80 from when the user terminal 82 outputs an alarm until the user 80 stops moving, when the user 80 is riding a bicycle. The storage control unit 240 may perform control for storing movement information based on the information acquired by the information acquisition unit 250 in association with the state information acquired by the user state acquisition unit 210. The alarm control unit 260 may adjust the timing for causing the user terminal 82 to output an alarm, based on the information stored in association with the state information acquired by the user state acquisition unit 210.
[0034] The deceleration information collecting unit 230 may collect information indicating the deceleration of the bicycle from a state in which the user 80 is traveling until the bicycle is stopped by braking. The information acquiring unit 250 may acquire information indicating the distance or time traveled by the user 80 from when the user terminal 82 outputs a warning until the user 80 stops moving, based on the deceleration exceeding a predetermined reference value among the decelerations collected by the deceleration information collecting unit 230.
[0035] The user state acquisition unit 210 may acquire state information indicating the physical or mental state of the user 80. The information acquisition unit 250 may acquire information indicating the distance or time the user 80 moves from when the user terminal 82 outputs an alarm until the user 80 stops moving, for each piece of state information acquired by the user state acquisition unit 210. The storage control unit 240 may perform control for storing movement information based on the information acquired by the information acquisition unit 250 in association with the state information acquired by the user state acquisition unit 210. The alarm control unit 260 may adjust the timing of outputting an alarm to the user terminal 82, based on the movement information stored in association with the state information acquired by the user state acquisition unit 210.
[0036] The storage control unit 240 may perform control to increase the distance indicated by the already stored movement information as the user 80 ages.
[0037] The walking video information acquisition unit 220 may acquire video information of the user 80 walking. The walking style identification unit 270 may identify a walking style of the user 80 identified from the video information acquired by the walking style information acquisition unit 220. The information acquisition unit 250 may acquire a distance or time associated with the walking style of the user 80 identified by the walking style identification unit 270 as information indicating the distance or time.
[0038] 3 shows an example of a data structure of stop record information for each user measured by the user terminal. The stop record information is, for example, information indicating the time measured by the user terminal 82 from when the user terminal 82 outputs an alarm to when the user 80 stops walking. The support device 60 acquires the information transmitted from the user terminal 82 into the storage device 280 as stop record time information.
[0039] The stop record information includes, as data items, an ID, an exercise state, a mental and physical state, a required time for stopping, and an acquisition date. The ID is identification information of the user terminal 82. The exercise state is information indicating whether the user 80 is walking, running, or riding a bicycle.
[0040] The mental and physical state includes, for example, information indicating normal, poor health, normal, drunk, and impatient. The mental and physical state is information indicating the state of the mind or body. The time required to stop is the time measured by the user terminal 82 from when the user terminal 82 outputs an alarm until the user 80 stops.
[0041] The acquisition date may be information indicating the date on which the stop record information data was acquired by the support device 60. The ID, the exercise state, the mental and physical state, and the data on the required stop time may be acquired by the information acquisition unit 250.
[0042] The motion state may be determined by the user terminal 82. The motion state of the user 80 may be determined based on acceleration, angular velocity, and position information provided by the user terminal 82. At least a part of the motion state may be determined by analyzing an image acquired from the imaging device 70, and may be transmitted to the support device 60 together with position information of the user 80 acquired by analyzing the image. The support device 60 may identify which user terminal 82 the motion state of the user 80 transmitted from the imaging device 70 corresponds to by matching the position information of the user terminal 82 transmitted from the imaging device 70 with the position information of the user terminal 82.
[0043] The mental and physical state is determined by the user terminal 82. At least a part of the mental and physical state may be determined in the user terminal 82 based on information acquired by a biosensor that detects bioinformation of the user 80. At least a part of the mental and physical state may be determined from the facial expression, posture, and the like of the user 80 by analyzing an image acquired from the imaging device 70, and may be transmitted to the support device 60 together with position information of the user 80.
[0044] 4 shows an example of the data structure of bicycle deceleration record information. Bicycle deceleration record information is information acquired when the user 80 brakes to stop while riding a bicycle and no warning is being output from the user terminal 82. The support device 60 acquires the information transmitted from the user terminal 82 into the storage device 280 as bicycle deceleration record information.
[0045] The bicycle deceleration record information includes, as data items, an ID, deceleration-related information, a physical and mental state, a stop time, and an acquisition date. The ID is identification information of the user terminal 82.
[0046] The deceleration-related information is information related to deceleration caused by braking. For example, the user terminal 82 may obtain brake operation information detected by a grip sensor installed on the handlebars of the bicycle through wireless communication based on a communication standard such as Bluetooth (registered trademark) or ANT+ (registered trademark), and transmit the obtained information to the support device 60 as the deceleration-related information.
[0047] When information from the grip force sensor or the like is not acquired, the user terminal 82 transmits deceleration information as deceleration-related information to the assistance device 60. The deceleration information may be at least any one of time series information of the speed detected by the speed sensor, time series information of the deceleration detected by the acceleration sensor, and / or the speed at the start of deceleration and the stopping time.
[0048] The mental and physical state includes information indicating, for example, normal, poor health, normal, drunk, and impatient. The mental and physical state is information indicating the state of the mind or body. The stopping time is the time taken from when deceleration begins to occur while riding a bicycle until the bicycle stops, as measured by the user terminal 82. The stopping time may be measured based on position information detected by the user terminal 82 and information detected by an acceleration sensor provided in the user terminal 82. The user terminal 82 may obtain, via wireless communication, information detected by a sensor (e.g., a speed sensor) that detects the rotation of the bicycle wheels, and measure the stopping time based on the obtained information.
[0049] The acquisition date may be information indicating the date on which the bicycle deceleration performance information data was acquired by the support device 60. The ID, deceleration related information, mental and physical state, and stop time data may be acquired by the information acquisition unit 250.
[0050] 5 shows an example of a data structure of the stop required time information. The stop required time information is stored in the storage device 280. The stop required time information is an example of movement information indicating a distance or time traveled by the user 80 from when the user terminal 82 outputs an alarm until the user 80 stops moving.
[0051] The stopping time information is information generated by aggregating the stopping record information and the bicycle deceleration record information described in relation to Figures 3 and 4. The stopping time information is stored in the memory control unit 240. The stopping time information includes, as data items, an ID, an exercise state, a mental and physical state of "normal", "poor physical condition", "drunk" or "impatient", and an update date.
[0052] The ID is identification information of the user terminal 82. The exercise state is information indicating whether the user 80 is walking, running, or riding a bicycle. "Normal", "poor physical condition", "drunk" and "impatient" are information indicating the mental and physical states, respectively. The update date may be information indicating the date on which the support device 60 updated each data of the required stopping time.
[0053] The memory control unit 240 refers to the stop record information and calculates the required stop time corresponding to the combination of the motion state "walking" and the mental and physical state "normal" for each ID by averaging the required stop time corresponding to the combination of the motion state "walking" and the mental and physical state "normal" for each ID. Similarly, for combinations of the motion state "walking" and the other mental and physical states "poor physical condition", "drunk", and "impatient", the memory control unit 240 refers to the stop record information and calculates the required stop time corresponding to each combination by averaging the required stop time corresponding to each combination of the motion state "walking" and the mental and physical state for each ID. In this way, the memory control unit 240 calculates the required stop time corresponding to each combination of ID, motion state "walking", and mental and physical state, and stores it as data of the required stop time information.
[0054] The memory control unit 240 performs similar processing for the exercise state "running" to calculate the required stop time corresponding to each combination of ID, exercise state "running", and mind-body state, and stores the calculated required stop time information data.
[0055] The memory control unit 240 can calculate the required stopping time corresponding to the driving state "bicycle" and each mental and physical state in the same manner as the calculation method of the required stopping time corresponding to the driving state "walking".
[0056] Next, a method for calculating the required stopping time corresponding to the driving state "bicycle" based on the deceleration record information will be described. The required stopping time in this embodiment is the time from when an alarm is output until the movement of the user 80 stops. Since it is assumed that sudden braking will be performed when an alarm is output, it is desirable to determine the required stopping time corresponding to the driving state "bicycle" based on the time it will take for the movement of the user 80 to stop when sudden braking is performed.
[0057] Therefore, the memory control unit 240 extracts the stopping time when it is determined that sudden braking has been applied from the stopping time included in the deceleration performance information, and determines the stopping required time corresponding to the driving state "bicycle" based on the extracted stopping time.
[0058] Whether or not the brakes have been applied suddenly may be determined based on the deceleration-related information. For example, when the deceleration-related information includes brake operation information, data of a combination of grip force and stopping time detected by a grip force sensor may be statistically processed to classify the data into a data group of an average combination and a data group associated with a combination of a grip force higher than a predetermined value and a stopping time shorter than a predetermined value, and data belonging to the latter data group may be regarded as data obtained when it is determined that the brakes have been applied suddenly.
[0059] If the deceleration-related information does not include brake operation information, whether or not sudden braking has occurred may be determined based on the deceleration-related information. For example, by statistically processing data on combinations of deceleration and stopping time, the data may be classified into a data group of average combinations and a data group associated with combinations of deceleration higher than a predetermined value and stopping time shorter than a predetermined value, and data belonging to the latter data group may be regarded as data obtained when it is determined that sudden braking has occurred.
[0060] The memory control unit 240 extracts the stopping time when it is determined that sudden braking has occurred, and uses the extracted stopping time to average the stopping times corresponding to each mental and physical state for each ID, to calculate the stopping time required for each combination of ID, exercise state "bicycle", and mental and physical state, and stores the calculated stopping time required information data.
[0061] In this way, the required stopping time associated with the driving state "bicycle" in the required stopping time information can be calculated from the actual stopping information and the actual deceleration information. The required stopping time associated with the driving state "bicycle" in the required stopping time information may be calculated using both the required stopping time calculated from the actual stopping information and the required stopping time calculated from the actual deceleration information. The required stopping time calculated from the actual deceleration information may be used to complement the required stopping time calculated from the actual stopping information.
[0062] The alarm control unit 260 adjusts the timing of transmitting alarm information to the user terminal 82 by referring to the information on the time required to stop. For example, when the identification information of the user terminal 82 is "ID1", the user 80 is walking, and the mental and physical condition of the user 80 is "normal", "2 seconds" is determined as the time required to stop for the user 80. This means that it takes about 2 seconds from when an alarm is output to the user terminal 82 until the user 80 stops. Therefore, the alarm control unit 260 advances the timing of transmitting alarm information to the user terminal 82 by "2 seconds".
[0063] The storage control unit 240 may update the required stop time each time a predetermined time has elapsed and / or each time new data is added to the stop record information and / or the deceleration record information. The storage control unit 240 may lengthen the required stop time stored in the required stop time information in accordance with an increase in the age of the user 80 each time a predetermined time has elapsed. This allows the required stop time to be lengthened in accordance with an increase in the age of the user 80. The amount by which the required stop time is to be lengthened may be determined based on the required stop time and date of the user 80 stored in the stop record information, taking into consideration the amount of change in the required stop time over time of the user 80. The amount by which the required stop time is to be lengthened may be determined based on the required stop time and date of the user 80 stored in the stop record information, taking into consideration the amount of change in the required stop time of the multiple users over time. The amount by which the required stop time is to be lengthened may be set in accordance with the age of the user 80 registered through the user terminal 82.
[0064] As described in relation to FIG. 3 to FIG. 5, the stopping time required associated with the driving state "walking" in the stopping time required information may be calculated from the stopping record information. The stopping time required associated with the driving state "walking" in the stopping time required information may be acquired based on video information of the user 80 walking. For example, the walking video information acquisition unit 220 acquires video information of the user 80 walking captured by the user terminal 82 or the imaging device 70. The walking style identification unit 270 identifies the walking style of the user 80 identified from the video information acquired by the walking video information acquisition unit 220. The walking style may be posture, stride length, foot speed, foot movement, etc. The stopping time required may be associated in advance with the walking style. For example, when the walking posture of the user is classified as a forward leaning posture, the stopping time required associated with the forward leaning posture as the walking posture of the user may be set to be longer than the stopping time required associated with the normal posture. The information acquisition unit 250 may acquire, as stop time information, information indicating a time associated with the walking style of the user 80 identified by the walking style identification unit 270. In a similar manner, the stop required time associated with the driving state “running” in the stop required time information may be acquired based on video information capturing an image of the user 80 running.
[0065] 6 shows an example of a data structure of the correction time information for the required stop time. The correction time information is stored in the storage device 280.
[0066] The correction time information includes an ID and a correction time as data items. The ID is identification information of the user terminal 82. The correction time is a correction value for correcting the required stop time. The correction time can be set by the user 80. The memory control unit 240 changes the correction time associated with the identification information of the user terminal 82 based on an instruction from the user terminal 82.
[0067] For example, when the identification information of the user terminal 82 is "ID1", the warning control unit 260 determines "1 second" as the correction time for the required stop time. In this case, the warning control unit 260 adds 1 second to the required stop time (for example, "2 seconds") determined from the moving time information shown in Fig. 5. Therefore, the warning control unit 260 advances the timing of transmitting the warning information by (required stop time + 1 second).
[0068] 7 is a diagram for explaining an example of the timing of transmitting warning information to the user terminal 82. When the warning control unit 260 determines that the user terminal 82 is moving toward the road 90 based on the history of the position information of the user terminal 82, it predicts the time t until the user terminal 82 reaches the road 90. For example, the warning control unit 260 predicts the time t based on the movement speed v of the user terminal 82 estimated based on the history of the position information of the user terminal 82 and the distance d1 from the current position of the user terminal 82 to the road 90.
[0069] The warning control unit 260 predicts the position Q of the vehicle 20 at a timing a time t from the present, based on the speed of the vehicle 20 estimated from the history of position information of the vehicle 20 and the current position of the vehicle 20. The warning control unit 260 calculates a distance d2 between the position of the user terminal 82 in the moving direction of the vehicle 20 and the position Q of the vehicle 20 at a timing a time t from the present. If d2 is shorter than a predetermined value, the warning control unit 260 determines that the vehicle 20 and the user terminal 82 are approaching each other, and determines to transmit warning information to the user terminal 82.
[0070] The warning control unit 260 specifies the time required to stop T of the user 80 by the method described in relation to Fig. 5, Fig. 6, etc. At this time, the warning control unit 260 may specify the motion state and mental and physical state of the user 80 based on information detected or set in the user terminal 82 and / or information detected in the imaging device 70. For example, when the time required to stop of the user 80 specified from the required time to stop information in Fig. 5 is 2 seconds and the corrected time of the user 80 specified from the corrected time information in Fig. 6 is 1 second, the warning control unit 260 sets the time required to stop T to 3 seconds.
[0071] In this case, the warning control unit 260 decides to cause the user terminal 82 to transmit warning information at the timing when the position of the user terminal 82 reaches a position at least v×T away from the road 90. In practice, the warning control unit 260 causes the user terminal 82 to transmit warning information at the timing when the distance from the current position of the user terminal 82 to the road 90 becomes D+v×T, where D is a distance margin determined in consideration of the detection accuracy of the position of the user terminal 82, etc.
[0072] This allows the warning to be transmitted to the user 80 with a margin of time corresponding to the distance (v×T) traveled by the user 80 from when the user 80 notices the warning until the user 80 stops. Therefore, the safety of the user 80 can be ensured while transmitting warning information.
[0073] FIG. 8 shows an example of an execution sequence of processes performed by the imaging device 70, the user terminal 82, the in-vehicle processing device 40 provided in the vehicle 20, and the assistance device 60.
[0074] In S700, the in-vehicle processing device 40 transmits the position information of the vehicle 20 to the support device 60. The transmission of the position information from the in-vehicle processing device 40 to the support device 60 is performed periodically.
[0075] In S720, the user terminal 82 transmits location information indicating the current location of the user terminal 82 based on signals received from GNSS satellites to the support device 60. The location information is periodically transmitted from the user terminal 82 to the support device 60. The user terminal 82 may transmit to the support device 60 the motion state and / or mental and physical state of the user 80 detected or set by the user terminal 82.
[0076] In S730, the imaging device 70 transmits to the support device 60 position information indicating the position of the user 80 obtained by analyzing the image captured by the imaging device 70. The position information is periodically transmitted from the imaging device 70 to the support device 60. The imaging device 70 may further transmit to the support device 60 information indicating the motion state and / or mental and physical state of the user 80 obtained by analyzing the image.
[0077] In S714, the control unit 260 of the support device 60 determines whether or not to output an alarm to the user terminal 82. For example, the alarm control unit 260 determines whether or not to output an alarm to the user terminal 82 by the method described in relation to FIG.
[0078] If it is determined that an alert should be output to the user terminal 82, then in S716 the alert control unit 260 controls the communication device 290 to transmit alert information to the user terminal 82 instructing the user terminal 82 to output an alert. Furthermore, in S718 the alert control unit 260 controls the communication device 290 to transmit alert information to the in-vehicle processing device 40 instructing the in-vehicle processing device 40 to output an alert.
[0079] When the on-board processing device 40 receives the warning information from the assistance device 60, in S704, an HMI (Human Machine Interface) function of the on-board processing device 40 outputs a warning that a user is approaching the vehicle 20, thereby notifying the passengers of the vehicle 20. The on-board processing device 40 may notify the passengers of the vehicle 20 of the presence of a vehicle approaching the vehicle 20 by voice and by displaying on a display device provided in the vehicle 20.
[0080] When the user terminal 82 receives the warning information from the assistance device 60, in S724, an HMI function of the user terminal 82 outputs a warning that a vehicle 20 is approaching the user 80, thereby notifying the user 80. The user terminal 82 may output the warning information that a vehicle is approaching the user 80 by voice.
[0081] In S726, the user terminal 82 measures the stop time from when the warning is output in S724 to when the movement of the user terminal 82 stops. In S728, the stop time measured in S726 is transmitted to the support device 60.
[0082] In S718, the warning control unit 260 adds the data indicating the stop time acquired in S728 to the actual stop information. In S720, the warning control unit 260 updates the required stop time information.
[0083] 3 to 8, a method for calculating the time from when the user terminal 82 outputs an alarm until the user 80 stops moving, and a method for using the time to transmit alarm information have been mainly described. Since the distance traveled by the user 80 can be calculated from the speed and time of the user 80, a similar method can be applied to a method for calculating the distance from when the user terminal 82 outputs an alarm until the user 80 stops moving, and can also be applied to a method for using the distance to transmit alarm information. Furthermore, since the distance traveled by the user 80 can be calculated from the number of steps and stride length of the user 80, if it is assumed that the stride length of the user 80 is known or the stride length of the user 80 is a specified value, a similar method can be applied to a method for calculating the number of steps of the user 80 from when the user terminal 82 outputs an alarm until the user 80 stops moving, and can also be applied to a method for using the number of steps to transmit alarm information.
[0084] According to the support system 10 described above, the timing of transmitting warning information to each user can be adjusted for each user, taking into consideration the distance or time that each user moves from when a warning is output until the user stops moving. In other words, it can be said that the timing of transmitting warning information to each user can be delayed for each user within a range that ensures safety. By delaying the timing of transmitting warning information, the user's movement can be ascertained, so that the possibility of transmitting unnecessary warning information can be reduced and the accuracy of the warning can be improved.
[0085] 9 shows an example of a computer 2000 in which multiple embodiments of the present invention may be embodied in whole or in part. A program installed in the computer 2000 may cause the computer 2000 to function as an apparatus such as the support device 60 according to an embodiment or each part of the apparatus, to execute operations associated with the apparatus or each part of the apparatus, and / or to execute a process or steps of the process according to an embodiment. Such a program may be executed by the CPU 2012 to cause the computer 2000 to execute specific operations associated with some or all of the blocks of the process steps and block diagrams described herein.
[0086] The computer 2000 according to this embodiment includes a CPU 2012 and a RAM 2014, which are connected to each other by a host controller 2010. The computer 2000 also includes a ROM 2026, a flash memory 2024, a communication interface 2022, and an input / output chip 2040. The ROM 2026, the flash memory 2024, the communication interface 2022, and the input / output chip 2040 are connected to the host controller 2010 via the input / output controller 2020.
[0087] The CPU 2012 operates according to programs stored in the ROM 2026 and RAM 2014, thereby controlling each unit.
[0088] The communication interface 2022 communicates with other electronic devices via a network. The flash memory 2024 stores programs and data used by the CPU 2012 in the computer 2000. The ROM 2026 stores a boot program and the like executed by the computer 2000 upon activation, and / or a program that depends on the hardware of the computer 2000. The input / output chip 2040 may also connect various input / output units, such as a keyboard, mouse, and monitor, to the input / output controller 2020 via input / output ports, such as a serial port, a parallel port, a keyboard port, a mouse port, a monitor port, a USB port, an HDMI port, and the like.
[0089] The programs are provided via a computer-readable storage medium such as a CD-ROM, a DVD-ROM, or a memory card, or a network. The RAM 2014, the ROM 2026, or the flash memory 2024 are examples of computer-readable storage media. The programs are installed in the flash memory 2024, the RAM 2014, or the ROM 2026, and executed by the CPU 2012. Information processing described in these programs is read by the computer 2000, and brings about cooperation between the programs and the various types of hardware resources described above. An apparatus or method may be constructed by implementing an operation or processing of information according to the use of the computer 2000.
[0090] For example, when communication is performed between the computer 2000 and an external device, the CPU 2012 may execute a communication program loaded in the RAM 2014 and instruct the communication interface 2022 to perform communication processing based on the processing described in the communication program. Under the control of the CPU 2012, the communication interface 2022 reads transmission data stored in a transmission buffer processing area provided in a recording medium such as the RAM 2014 and the flash memory 2024, transmits the read transmission data to a network, and writes reception data received from the network to a reception buffer processing area or the like provided on the recording medium.
[0091] Furthermore, the CPU 2012 may cause all or a necessary portion of a file or database stored on a recording medium such as the flash memory 2024 to be read into the RAM 2014, and perform various types of processing on the data on the RAM 2014. The CPU 2012 then writes back the processed data to the recording medium.
[0092] Various types of information, such as various types of programs, data, tables, and databases, may be stored in the recording medium and subjected to information processing. The CPU 2012 may execute various types of processing, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search / replacement, etc., described herein and specified by the instruction sequence of the program, on the data read from the RAM 2014, and write back the results to the RAM 2014. The CPU 2012 may also search for information in a file, database, etc. in the recording medium. For example, when a plurality of entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 2012 may search for an entry that matches a condition in which an attribute value of the first attribute is specified from among the plurality of entries, read the attribute value of the second attribute stored in the entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.
[0093] The above-described programs or software modules may be stored in a computer-readable storage medium on the computer 2000 or in the vicinity of the computer 2000. A recording medium such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet can be used as the computer-readable storage medium. The programs stored in the computer-readable storage medium may be provided to the computer 2000 via a network.
[0094] A program installed in the computer 2000 and causing the computer 2000 to function as the support device 60 may act on the CPU 2012, etc., to cause the computer 2000 to function as each part of the support device 60 (e.g., the support control device 200, etc.). When the information processing described in these programs is read into the computer 2000, it functions as each part of the support device 60, which is a specific means in which the software and the various hardware resources described above work together. These specific means then realize calculation or processing of information according to the intended use of the computer 2000 in this embodiment, thereby constructing a specific support device 60 according to the intended use.
[0095] Various embodiments have been described with reference to block diagrams or the like. In the block diagrams, each block may represent (1) a stage of a process where an operation is performed or (2) a portion of an apparatus responsible for performing an operation. Particular stages and portions may be implemented by dedicated circuitry, programmable circuitry provided with computer-readable instructions stored on a computer-readable storage medium, and / or a processor provided with computer-readable instructions stored on a computer-readable storage medium. The dedicated circuitry may include digital and / or analog hardware circuitry and may include integrated circuits (ICs) and / or discrete circuits. The programmable circuitry may include reconfigurable hardware circuitry including logical AND, logical OR, logical XOR, logical NAND, logical NOR, and other logical operations, memory elements such as flip-flops, registers, field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), and the like.
[0096] A computer-readable storage medium may include any tangible device capable of storing instructions that are executed by a suitable device, such that a computer-readable storage medium having instructions stored thereon constitutes at least a portion of a product that includes instructions that can be executed to provide a means for performing the operations specified in a process or block diagram. Examples of computer-readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, etc. More specific examples of computer-readable storage media may include floppy disks, diskettes, hard disks, random access memories (RAMs), read-only memories (ROMs), erasable programmable read-only memories (EPROMs or flash memories), electrically erasable programmable read-only memories (EEPROMs), static random access memories (SRAMs), compact disk read-only memories (CD-ROMs), digital versatile disks (DVDs), Blu-ray (RTM) disks, memory sticks, integrated circuit cards, etc.
[0097] The computer readable instructions may include either assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including object-oriented programming languages such as Smalltalk®, JAVA®, C++, etc., and conventional procedural programming languages such as the “C” programming language or similar programming languages.
[0098] The computer readable instructions may be provided to a processor or programmable circuitry of a general purpose computer, special purpose computer, or other programmable data processing apparatus, either locally or over a wide area network (WAN) such as a local area network (LAN), the Internet, etc., to cause the computer readable instructions to execute means for performing operations specified in the process steps or block diagrams described. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, etc.
[0099] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is clear to those skilled in the art that various modifications and improvements can be made to the above embodiments. It is clear from the description of the claims that such modifications and improvements can also be included in the technical scope of the present invention.
[0100] It should be noted that the order of execution of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically indicated as "before," "prior to," etc., and may be realized in any order unless the output of a previous process is used in a subsequent process. Even if the operational flow in the claims, specifications, and drawings is described using "first," "next," etc. for convenience, it does not mean that it is essential to perform the process in this order. [Explanation of symbols]
[0101] 10 Support System 20 Vehicles 40 On-board processing device 60 Support equipment 70 Imaging Device 80 users 82 User terminal 90 road 200 Assistance control device 210 User status acquisition unit 220 Walking video information acquisition unit 270 Walking Style Specific Section 230 Deceleration Information Collection Department 240 Memory control unit 250 Information Acquisition Department 260 Alarm control section 280 Storage device 290 Communication Equipment 2000 Computer 2010 Host Controller 2012 CPU 2014 RAM 2020 Input / Output Controller 2022 Communication Interface 2024 Flash Memory 2026 ROM 2040 Input / Output Chip
Claims
1. an information acquisition unit that acquires information indicating a distance or time traveled by a user who is a traffic participant from when a user terminal associated with the user outputs a warning until the user stops moving; a storage control unit that performs control to store movement information indicating a distance or time traveled by the user from when the user terminal outputs a warning until when the user stops moving, based on the information acquired by the information acquisition unit; and an alarm control unit that causes the user terminal to output an alarm; Equipped with The warning control unit adjusts a timing for causing the user terminal to output a warning based on the movement information stored under the control of the memory control unit. Assistive control device.
2. The information acquisition unit acquires information indicating a distance or time moved by the user from when the user terminal outputs a warning until when the user stops moving, the information being acquired by the user terminal after the warning control unit causes the user terminal to output a warning. The assistance control device according to claim 1 .
3. The information acquisition unit acquires information on the number of steps of the user that is acquired by the user terminal after the alarm control unit causes the user terminal to output an alarm, the information being counted by the user terminal from when the user terminal outputs an alarm until when the movement of the user terminal stops. The assistance control device according to claim 2 .
4. a user state acquisition unit that acquires state information indicating whether the user is walking or running; Further equipped with the information acquisition unit acquires, for each of the walking state and the running state, information indicating a distance or a time traveled by the user from when the user terminal outputs an alarm until when the user stops moving; the storage control unit performs control to store movement information based on the information acquired by the information acquisition unit in association with the status information acquired by the user status acquisition unit; The warning control unit adjusts a timing for causing the user terminal to output a warning based on the movement information stored in association with the state information acquired by the user state acquisition unit. The assistance control device according to claim 1 or 2.
5. a user state acquisition unit that acquires state information indicating whether the user is riding a bicycle; Further equipped with the information acquisition unit acquires, when the user is riding a bicycle, information indicating a distance or time traveled by the user from when the user terminal outputs a warning until when the user stops moving, and the storage control unit performs control to store movement information based on the information acquired by the information acquisition unit in association with the status information acquired by the user status acquisition unit; The warning control unit adjusts a timing for causing the user terminal to output a warning based on information stored in association with the status information acquired by the user status acquisition unit. The assistance control device according to claim 1 or 2.
6. A deceleration information collecting unit that collects information indicating the deceleration from when the user is traveling on the bicycle until the bicycle stops when the user applies the brakes Further equipped with The information acquisition unit acquires information indicating a distance or time traveled by the user from when the user terminal outputs a warning until when the user stops moving, based on a deceleration exceeding a predetermined reference value among the decelerations collected by the deceleration information collection unit. The assistance control device according to claim 5.
7. A user state acquisition unit that acquires state information indicating a physical or mental state of the user. Further equipped with the information acquisition unit acquires, for each piece of state information acquired by the user state acquisition unit, information indicating a distance or time moved by the user from when the user terminal outputs an alarm until when the user stops moving; the storage control unit performs control to store movement information based on the information acquired by the information acquisition unit in association with the status information acquired by the user status acquisition unit; The warning control unit adjusts a timing for causing the user terminal to output a warning based on the movement information stored in association with the state information acquired by the user state acquisition unit. The assistance control device according to claim 1 or 2.
8. The storage control unit performs control to increase the distance indicated by the already stored movement information in accordance with the increase in age of the user. The assistance control device according to claim 1 or 2.
9. A walking video information acquisition unit that acquires video information of the user walking; a walking style identification unit that identifies a walking style of the user identified from the video information acquired by the walking video information acquisition unit; Further equipped with The information acquisition unit acquires a distance or a time associated with the walking style of the user identified by the walking style identification unit as information indicating the distance. The assistance control device according to claim 1 or 2.
10. acquiring information indicating a distance or time traveled by a user who is a traffic participant from when a user terminal associated with the user outputs a warning until the user stops moving; performing control to store movement information indicating a distance or time traveled by the user from when the user terminal outputs a warning until when the user stops moving, based on the information acquired in the information acquiring step; adjusting a timing for causing the user terminal to output an alert based on the movement information; The assistance control method includes:
11. A program for causing a computer to function as the assistance control device according to claim 1 or 2.
Citation Information
Patent Citations
Driving support apparatus
JP2009054111A