Information processing apparatus, information processing method, and storage medium
Patent Information
- Application Number
- CN202310071496.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2022-03-11
- Filing Date
- 2023-01-13
- Publication Date
- 2026-08-28
- Estimated Expiration
- 2043-01-13
Smart Images

Figure CN116739848B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to information processing apparatus, information processing method, and storage medium. Background Technology
[0002] Previously, technologies related to traffic safety education were known. For example, International Publication No. 2019 / 240070 discloses a technology for determining whether a prescribed action has been performed based on the movement of a pedestrian.
[0003] There is room for improvement in technologies related to traffic safety education. Summary of the Invention
[0004] The purpose of this disclosure, which was made in view of such circumstances, is to improve the technology related to traffic safety education.
[0005] One embodiment of the information processing apparatus disclosed herein is an information processing apparatus having a control unit, wherein the control unit is configured to: determine the movement mode of a first user; output a first instruction to present a first notification urging the first user to take safe action if both a first condition and a second condition are satisfied; and not output the first instruction if at least one of the first condition and the second condition is not satisfied, wherein the first condition is that the first user is not currently riding in a passenger vehicle.
[0006] One embodiment of the information processing method disclosed herein is a method performed by an information processing apparatus, wherein the information processing method includes: determining the movement mode of a first user; outputting a first instruction to present a first notification urging the first user to take safe action if both a first condition and a second condition are satisfied; and not outputting the first instruction if at least one of the first condition and the second condition is not satisfied, wherein the first condition is that the first user is not currently riding in a passenger vehicle.
[0007] In one embodiment of this disclosure, a storage medium storing a program causes an information processing device to perform the following steps: determining the mode of movement of a first user; outputting a first instruction to present a first notification urging the first user to take safe action if both a first condition and a second condition are satisfied; and not outputting the first instruction if at least one of the first condition and the second condition is not satisfied, wherein the first condition is that the first user is not currently riding in a passenger vehicle.
[0008] According to one embodiment of this disclosure, the technology related to traffic safety education is improved. Attached Figure Description
[0009] Hereinafter, with reference to the accompanying drawings, the features, advantages, and technical and industrial significance of exemplary embodiments of the present invention will be described, wherein the same reference numerals denote the same elements, wherein:
[0010] Figure 1 This is a block diagram illustrating the general configuration of a system according to one embodiment of the present disclosure.
[0011] Figure 2 It is a block diagram showing the general structure of the terminal device.
[0012] Figure 3 It is a block diagram showing the general structure of the arithmetic unit.
[0013] Figure 4 This is a flowchart illustrating the operation of the system according to the first embodiment.
[0014] Figure 5 This is a flowchart illustrating a specific example of how to determine the type of vehicle.
[0015] Figure 6 This is a flowchart illustrating a specific example of bicycle identification.
[0016] Figure 7 This is a flowchart illustrating the operation of the system in the second embodiment.
[0017] Figure 8 This is a flowchart illustrating the operation of the system in the third embodiment.
[0018] Figure 9 It is a flowchart representing the actions of a system in a variant example. Detailed Implementation
[0019] The embodiments of this disclosure will now be described.
[0020] (Summary of the implementation method)
[0021] Reference Figure 1 The general outline of System 1 according to the embodiments of the present disclosure will be described. System 1 includes a terminal device 10 and a computing device 20. The terminal device 10 and the computing device 20 are connected in a communicable manner, for example, via a network 30 including the Internet and mobile communication networks.
[0022] Terminal device 10 is any information processing device that a user can use. For example, a wearable device, smartphone, or PC (Personal Computer) can be used as terminal device 10. Specifically, "wearable device" is a mobile device that can be worn on any part of a user's clothing or body, such as a badge-type, watch-type, or clothing-type device. In this embodiment, terminal device 10 is a badge-type wearable device worn on the side of the head when worn on a hat worn by the user, but it is not limited to these examples, and any general-purpose device can be worn in any position. In this embodiment, the user of terminal device 10 is typically a child (e.g., a 7-year-old child), but it is not limited to this.
[0023] The computing device 20 is any information processing device, such as one or more server devices that can communicate with each other.
[0024] First, a general overview of this embodiment will be given, with details to follow later. The information processing device in this embodiment is a terminal device 10. The terminal device 10 determines the mode of movement of the first user. If both a first condition and a second condition are met, the terminal device 10 outputs a first instruction presenting a first notification urging the first user to take safe action. "Safe action" refers to actions that protect the first user, such as the first user checking left and right before crossing a road. If at least one of the first and second conditions is not met, the terminal device 10 does not output the first instruction. In this embodiment, the first condition is that the first user is not currently riding in a passenger vehicle. "Passenger vehicle" refers to vehicles intended for passenger transport, such as rail vehicles, trams, dedicated buses, and taxis. In this specification, passenger vehicles do not include light vehicles such as bicycles and electric scooters used as the first user's mode of movement. Hereinafter, a bicycle will be used as a representative example of a light vehicle, but this is not intended to exclude other light vehicles. In this specification, passenger vehicles and bicycles are collectively referred to as "vehicles." In this embodiment, the second condition is that the first user has approached at least one of the more than one checkpoints. A "checkpoint" refers to a location that, from a traffic safety perspective, could pose a danger to the first user; for example, an intersection or an accident-prone area. In other words, a checkpoint is a location where some safety action is required to ensure the safety of the first user. The terminal device 10 acquires the location information of the first user. Based on the location information, the terminal device 10 determines whether the first user has approached at least one of the more than one checkpoints.
[0025] Thus, according to this embodiment, a first instruction to present a first notification urging a first user to take safe action is output only when both the first condition and the second condition are met. Specifically, when a first user who is walking or cycling approaches a checkpoint, a first notification, which is a sound urging safe action, is presented. Hereinafter, the presentation of the notification urging safe action will also be referred to as a "report." Here, for example, it can be considered that when a first user approaches a checkpoint while riding in a passenger vehicle, it is not necessarily necessary for the first user to take safe action. However, conventionally, whether to report is determined solely based on location information such as approaching a checkpoint. Therefore, even when the first user is riding in a passenger vehicle, a report is made and a first notification is presented when approaching a checkpoint is detected. That is, the first notification may be presented at a time when it is not needed. Therefore, it is easy to cause inconvenience to the first user. On the other hand, according to this embodiment, no report is made when the first user is riding in a passenger vehicle, so it is easy to avoid presenting the first notification at an unnecessary time. Therefore, the technology related to traffic safety education is improved in terms of reducing the inconvenience to the first user and making it easier to maintain the effectiveness of the report.
[0026] Next, the components of System 1 will be described in detail.
[0027] (Composition of the terminal device)
[0028] like Figure 2 As shown, the terminal device 10 includes a communication unit 11, an acquisition unit 12, an output unit 13, an input unit 14, a storage unit 15, and a control unit 16.
[0029] The communication unit 11 may include one or more communication interfaces connected to the network 30. This communication interface may correspond to mobile communication standards such as 4G (4th Generation) and 5G (5th Generation), wired LAN (Local Area Network) standards, or wireless LAN standards, but is not limited to these; it may correspond to any communication standard. In this embodiment, the terminal device 10 is connected to the network 30 via the communication unit 11. It should be noted that the terminal device 10 may also communicate via the communication unit 11 and the network 30 with common devices such as smartphones or PCs held by users different from the user of the terminal device 10 (the first user described later).
[0030] The acquisition unit 12 includes one or more devices for acquiring the location information of the user of the terminal device 10. Specifically, the acquisition unit 12 includes, for example, a receiver corresponding to GPS (Global Positioning System), but is not limited thereto, and may also include a receiver corresponding to any satellite positioning system. Furthermore, the acquisition unit 12 also includes any sensor module capable of acquiring information representing the behavior of the user maintaining the terminal device 10. "User behavior" refers to, for example, confirming left or right, temporarily stopping, walking forward in the direction of travel, walking backward in the direction of travel, or running. Specifically, the sensor module includes a camera, an infrared sensor, a speed sensor, an angular velocity sensor, an acceleration sensor, a geomagnetic sensor, or a combination thereof.
[0031] The output unit 13 includes one or more output devices that output information to notify the user. Such output devices may be, for example, a speaker that outputs information through sound, a display that outputs information through images, or a drive device that applies haptic stimulation such as vibration to the user, but are not limited thereto.
[0032] The input unit 14 includes one or more input devices for detecting user input. These input devices may be, for example, physical keys, electrostatic capacitive keys, a touch screen integrated with the display of the output unit 13, a microphone or camera for receiving sound input, etc., but are not limited to these.
[0033] Storage unit 15 includes one or more memories. These memories may be, for example, semiconductor memories, magnetic memories, or optical memories, but are not limited to these. Each memory included in storage unit 15 may function as a main storage device, an auxiliary storage device, or flash memory. Storage unit 15 stores any information used for the operation of terminal device 10. For example, storage unit 15 may store system programs, application programs, embedded software, databases, and map information. Alternatively, the information stored in storage unit 15 may be updated using information obtained from network 30 via communication unit 11.
[0034] In this embodiment, the storage unit 15 stores the user database and the notification database.
[0035] The user database includes user data with "location information", "vehicle sign" and "bicycle sign" for each user.
[0036] "Location information" refers to information indicating the user's location on the map.
[0037] The "Transportation indicator" tells you whether the user is currently using transportation. ON indicates the user is using transportation, and OFF indicates the user is not using transportation.
[0038] The "bicycle icon" indicates whether the user is currently cycling. Enabling it means the user is cycling, while disabling it means the user is not.
[0039] The notification database includes notification data with "First Notification" and "First Notification ID". Alternatively, the notification database may also include notification data with "Second Notification", "Second Notification ID", "Third Notification", and "Third Notification ID".
[0040] "First notification" is data equivalent to a report.
[0041] The "First Notification ID" is information that uniquely identifies the first notification.
[0042] "Secondary notification" is data used to present users with a positive judgment result.
[0043] The "Second Notification ID" is information that uniquely identifies the second notification.
[0044] "Third notification" is data used to present users with a negative judgment result.
[0045] The "Third Notification ID" is information that uniquely identifies a third notification.
[0046] The control unit 16 includes one or more processors, one or more programmable circuits, one or more dedicated circuits, or combinations thereof. The processor may be a general-purpose processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), or a dedicated processor specifically designed for particular processing, but is not limited thereto. The programmable circuit may be, for example, a FPGA (Field-Programmable Gate Array), but is not limited thereto. The dedicated circuit may be, for example, an ASIC (Application Specific Integrated Circuit), but is not limited thereto. The control unit 16 controls the overall operation of the terminal device 10. Details regarding the operation of the terminal device 10 controlled by the control unit 16 will be described later.
[0047] (Structure of the computing device)
[0048] like Figure 3 As shown, the computing device 20 includes a communication unit 21, a storage unit 22, and a control unit 23.
[0049] The communication unit 21 includes one or more communication interfaces connected to the network 30. These communication interfaces may correspond to, for example, mobile communication standards, wired LAN standards, or wireless LAN standards, but are not limited to these; they may correspond to any communication standard. In this embodiment, the computing device 20 communicates with the terminal device 10 via the communication unit 21 and the network 30. It should be noted that the computing device 20 may also communicate via the communication unit 21 and the network 30 with, for example, a common device such as a smartphone or PC held by a user different from the user of the terminal device 10 (the first user described later).
[0050] Storage unit 22 includes one or more memory units. Each memory unit included in storage unit 22 can function as a main storage device, an auxiliary storage device, or flash memory. Storage unit 22 stores any information used for the operation of computing device 20. For example, storage unit 22 can store system programs, application programs, embedded software, databases, and map information. Alternatively, the information stored in storage unit 22 can be updated, for example, using information obtained from network 30 via communication unit 21.
[0051] The control unit 23 includes one or more processors, one or more programmable circuits, one or more dedicated circuits, or combinations thereof. The control unit 23 controls the overall operation of the arithmetic unit 20.
[0052] (System's action flow)
[0053] Reference Figure 4 The operation of system 1 according to the first embodiment will be described. Figure 4 The action is equivalent to the method of this embodiment. Figure 4 The action indicates the action of the terminal device 10. Figure 4 The action is, for example, to be performed repeatedly according to a predetermined cycle. The predetermined cycle can be set arbitrarily.
[0054] Step S100: The control unit 16 of the terminal device 10 determines the movement mode of the first user who is the user of the terminal device 10.
[0055] Any method can be used to determine the mode of movement. For example, the control unit 16 can execute... Figure 5 The action shown (hereinafter also referred to as "vehicle determination") is used to determine the first user's mode of transportation. Vehicle determination refers to the process of determining whether the first user is currently using a vehicle. Vehicle determination is performed repeatedly, for example, at a predetermined period. The predetermined period can be arbitrarily set. See below for details. Figure 5 Explanation of the determination of means of transportation.
[0056] Step S200: Control unit 16 determines whether the speed S of the first user exceeds 0 km / h. If the speed S exceeds 0 km / h (step S200 - "Yes"), the process proceeds to step S201. On the other hand, if the speed S does not exceed 0 km / h, that is, the speed S equals 0 km / h (for example, the first user is stopping) (step S200 - "No"), the process ends.
[0057] Any method can be used to determine whether the speed S exceeds 0 km / h. For example, the control unit 16 can acquire information representing the speed S of the first user via the acquisition unit 12, and determine that the speed S exceeds 0 km / h when it detects that the speed S exceeds 0 km / h.
[0058] Step S201: Control unit 16 determines whether the vehicle sign is enabled. If the vehicle sign is enabled (step S201 - "Yes"), the process proceeds to step S207. On the other hand, if the vehicle sign is disabled (step S201 - "No"), the process proceeds to step S202.
[0059] Specifically, the control unit 16 refers to the user database stored in the storage unit 15 to determine whether the first user's vehicle sign is enabled.
[0060] Step S202: The control unit 16 determines whether the speed S exceeds the threshold Sth1 and whether the acceleration A of the first user is less than the threshold Ath1. If it is determined that the speed S exceeds the threshold Sth1 and the acceleration A is less than the threshold Ath1 (step S202 - "Yes"), the process proceeds to step S204. On the other hand, if it is determined that the speed S is below the threshold Sth1 and the acceleration A is above the threshold Ath1 (step S202 - "No"), the process proceeds to step S203.
[0061] Specifically, the control unit 16 acquires information representing the speed S of the first user via the acquisition unit 12. The control unit 16 determines whether the speed S exceeds a threshold Sth1. The threshold Sth1 can be set to any speed (e.g., 10 km / h or higher) that presumes the first user is riding in a vehicle rather than walking. Hereinafter, speeds below the threshold Sth1 are also referred to as "speeds in the walking range". Furthermore, the control unit 16 acquires information representing acceleration in at least one of the following directions via the acquisition unit 12: the X-axis (the first user's forward / backward direction), the Y-axis (the first user's left / right direction), or the Z-axis (the first user's up / down direction), as acceleration A. Here, it is known that a pedestrian typically experiences a rapid acceleration in the positive Z-axis direction (i.e., the first user's upward direction) immediately after their heel touches the ground due to the reaction force. This acceleration is unique to pedestrians and is not typically generated by passengers in vehicles. Therefore, the control unit 16 can acquire the acceleration in the positive Z-axis direction as acceleration A. Then, the control unit 16 determines whether acceleration A is less than the threshold Ath1. It is possible to set any acceleration that can be presumed to indicate that the first user is walking (e.g., 1 m / s² in the positive Z-axis direction). 2 The above values are used as the threshold Ath1. Hereinafter, accelerations above the threshold Ath1 are also referred to as "accelerations in the walking domain". It should be noted that, for ease of explanation, although it is stated that acceleration A is obtained after velocity S, velocity S and acceleration A can also be obtained in reverse order or in parallel.
[0062] Here, we will explain why the determination in step S202 considers not only the first user's speed S but also the acceleration A. If the determination in step S202 is based solely on the first user's speed S, the following problem arises. For example, suppose that when the passenger vehicle the first user is riding decelerates or stops, speed S is detected as falling within the walking range. In this case, even if the first user is actually riding in the vehicle, it might be immediately determined that they are walking. That is, a false determination might occur. On the other hand, if acceleration A is considered in addition to speed S, even when speed S is detected as falling within the walking range, as long as no pedestrian-specific acceleration is detected, it will not be immediately determined that the first user is walking. As a result, false determinations are more easily avoided. Therefore, the accuracy of determining whether the first user is riding in the vehicle can be improved.
[0063] It should be noted that the velocity S and acceleration A are not limited to measurements taken at a single point in time, but can also be representative values (e.g., average values) of measurements taken over a specified period of time. Any time period can be set as the specified time. Measurements can be taken continuously or at specified intervals. For example, acceleration in the positive Z-axis direction can be detected when a dedicated bus, as a mode of transportation, runs over an obstacle. In this case, if the acceleration measurement at a single point in time is used as acceleration A, a false judgment might occur, such as the first user who is actually riding in the vehicle being mistaken for walking. Therefore, if a representative value of the acceleration obtained by measuring the first user's acceleration over a specified period of time is used as acceleration A, it is easier to further avoid such false judgments. Thus, the accuracy of determining whether the first user is riding in the vehicle can be further improved.
[0064] Furthermore, the action of the first user boarding the vehicle (hereinafter also referred to as "boarding action") can be detected based on acceleration A. Boarding action refers to any action that can be presumed to indicate that the first user has boarded the vehicle. For example, if the determination of whether the first user is boarding the vehicle is based solely on speed S, the determination will not be made until the vehicle has started moving and a predetermined time has elapsed. Therefore, if an approach to the checkpoint is detected after the vehicle has just started moving, a report will be made. On the other hand, if the determination of whether the user is boarding the vehicle is based on the boarding action while also considering acceleration A, then even if an approach to the checkpoint is detected after the vehicle has just started moving, no report will be made. Therefore, the inconvenience to the first user can be further reduced, and it is easier to maintain the effectiveness of the reporting.
[0065] Any method can be used to detect boarding actions. For example, the control unit 16 can obtain the location information of the first user by referring to the user database stored in the storage unit 15. The control unit 16 can analyze the movement path of the first user on the map represented by map information based on the obtained location information, and determine whether a boarding action has occurred based on the analysis result. For example, the control unit 16 can presume that a boarding action to a rail vehicle has occurred when the first user's position is detected to have moved from the platform of the train station to the track, and will not report it. Furthermore, for example, the control unit 16 can also presume that a boarding action to a passenger vehicle such as a bus or taxi has occurred when the first user's position on the sidewalk is detected to have moved to the side of the road with a change in acceleration in the Z-axis direction, and will not report it. In addition, the control unit 16 can also obtain information indicating that the first user has passed through the automatic ticket gate of the train station or bus from the first user's smartphone or other device via the network 30. In this case, the control unit 16 can also presume, upon receiving the information, that a passenger vehicle boarding action has occurred by the first user, and refrain from reporting it. This makes it easier to further avoid false judgments. Therefore, the accuracy of determining whether the first user has boarded a vehicle can be further improved.
[0066] For this reason, in this embodiment, not only the speed S of the first user but also the acceleration A are considered in the determination of step S202.
[0067] Step S203: If it is determined that the speed S is below the threshold Sth1 and the acceleration A is above the threshold Ath1 (step S202 - "No"), the control unit 16 keeps the vehicle sign closed. After that, the process ends.
[0068] Specifically, when the speed S is below the threshold Sth1 and the acceleration A is above the threshold Ath1, the control unit 16 assumes that the first user is currently walking and keeps the vehicle flag stored in the user database of the storage unit 15 off. For example, a typical case of step S203 is equivalent to the case where the first user is walking at the time of step S201, does not take a vehicle afterward, and is still walking at the time of step S202.
[0069] Step S204: If it is determined that the speed S exceeds the threshold Sth1 and the acceleration A is less than the threshold Ath1 (step S202 - "Yes"), the control unit 16 determines whether the first user's movement time MT1 exceeds the threshold MTth1. If it is determined that the movement time MT1 exceeds the threshold MTth1 (step S204 - "Yes"), the process proceeds to step S206. On the other hand, if it is determined that the movement time MT1 is below the threshold MTth1 (step S204 - "No"), the process proceeds to step S205.
[0070] Specifically, the control unit 16 measures the cumulative movement time of the first user within a specified time period, under conditions where the speed exceeds the threshold Sth1 and the acceleration is less than the threshold Ath1, and calculates the measured cumulative movement time as movement time MT1. Any time period can be set as the specified time. For example, the specified time period can be the cumulative movement time of the first user from the determination time point of step S202 to the determination time point of step S204, under conditions where the speed exceeds the threshold Sth1 and the acceleration is less than the threshold Ath1. Then, the control unit 16 determines whether the calculated movement time MT1 exceeds the threshold MTth1. Any time period (e.g., 3 seconds) can be set as the threshold MTth1.
[0071] Step S205: If the travel time MT1 is determined to be below the threshold MTth1 (step S204 - "No"), the control unit 16 keeps the vehicle sign closed. Afterwards, the process ends.
[0072] Specifically, if the travel time MT1 is below the threshold MTth1, the control unit 16 assumes that the first user is not currently using a vehicle and keeps the vehicle flag stored in the user database of the storage unit 15 off. For example, a typical case of step S205 is equivalent to the first user being using a vehicle at the time of step S202, but then getting off and being walking at the time of step S204.
[0073] Step S206: If it is determined that the travel time MT1 exceeds the threshold MTth1 (step S204 - "Yes"), the control unit 16 switches the vehicle sign from off to on. After that, the process ends.
[0074] Specifically, if the travel time MT1 exceeds the threshold MTth1, the control unit 16 presumes that the first user is currently using a vehicle and, referring to the user database stored in the storage unit 15, switches the first user's vehicle flag from off to on. For example, a typical case of step S206 is equivalent to the first user using a vehicle at the time of step S202 and also using a vehicle at the time of step S204.
[0075] Step S207: If the vehicle indicator is determined to be enabled (Step S201 - "Yes"), the control unit 16 determines whether the first user's walking duration WT1 exceeds the threshold WTth1. If the walking duration WT1 exceeds the threshold WTth1 (Step S207 - "Yes"), the process proceeds to step S209. On the other hand, if the walking duration WT1 is determined to be below the threshold WTth1 (Step S207 - "No"), the process proceeds to step S208.
[0076] Specifically, the control unit 16 measures the cumulative walking time of the first user within a specified time period and calculates the measured cumulative walking time as the walking duration WT1. Any time period (e.g., 3 minutes) from the determination time point of step S201 to the determination time point of step S207 can be set as the specified time period. Any method can be used to measure the cumulative walking time. For example, the control unit 16 acquires information representing the speed of the first user and information representing the acceleration in the positive Z-axis direction via the acquisition unit 12 over the specified time period. The control unit 16 determines whether the speed and acceleration represented by the acquired information are respectively the speed and acceleration of the walking domain as described in step S202. If it is determined that the speed and acceleration represented by the acquired information are respectively the speed and acceleration of the walking domain, the control unit 16 determines that the first user is walking. The control unit 16 calculates the cumulative time within the specified time period for which the speed S and acceleration A represented by the acquired information are respectively the speed and acceleration of the walking domain. The control unit 16 calculates this cumulative time as the walking duration WT1. Then, the control unit 16 determines whether the calculated walking duration WT1 exceeds the threshold WTth1. Any time (e.g., 1 minute) can be set as the threshold WTth1.
[0077] Step S208: If the walking duration WT1 is determined to be below the threshold WTth1 (step S207 - "No"), the control unit 16 keeps the vehicle sign enabled. Afterwards, the process ends.
[0078] Specifically, if the walking duration WT1 is below the threshold WTth1, the control unit 16 assumes that the first user is currently using a vehicle and keeps the first user's vehicle flag stored in the user database of the storage unit 15 enabled. For example, a typical case of step S208 is equivalent to the first user using a vehicle at the time of step S201 and also using a vehicle at the time of step S207.
[0079] Step S209: If it is determined that the walking duration WT1 exceeds the threshold WTth1 (step S207 - "Yes"), the control unit 16 switches the vehicle sign from enabled to disabled. After that, the process ends.
[0080] Specifically, if the walking duration WT1 exceeds the threshold WTth1, the control unit 16 presumes that the first user is currently walking and switches the first user's vehicle flag from enabled to disabled by referring to the user database stored in the storage unit 15. For example, a typical case of step S209 is equivalent to the first user being on a vehicle at the time of step S201, but then getting off and being walking at the time of step S207.
[0081] After determining the means of transportation as described above, the control unit 16 determines whether the first user is currently using a means of transportation.
[0082] In this embodiment, the control unit 16 further determines whether the first user, who was determined to be riding a vehicle based on the vehicle determination, is currently riding a bicycle. Any method can be used to determine whether the first user is riding a bicycle. For example, the control unit 16 can execute... Figure 6 The action shown (hereinafter also referred to as "bicycle determination") is used to determine whether the first user is riding a bicycle. Bicycle determination refers to the process of determining whether the first user is riding a bicycle. In this embodiment, bicycle determination is performed when the speed of the first user exceeds 0 km / h after the above-mentioned vehicle determination, but it is not limited to this, and any method can be used. Hereinafter, refer to Figure 6 Explanation of bicycle identification.
[0083] Step S300: Control unit 16 determines whether the speed S of the first user is less than the threshold Sth1 and whether the acceleration A of the first user exceeds the threshold Ath1. If it is determined that the speed S is less than the threshold Sth1 and the acceleration A exceeds the threshold Ath1 (step S300 - "Yes"), the process proceeds to step S309. On the other hand, if it is determined that the speed S is above the threshold Sth1 and the acceleration A is below the threshold Ath1 (step S300 - "No"), the process proceeds to step S301. It should be noted that the specific processing of step S300 is the same as that of step S202 described above, so the explanation is omitted.
[0084] Step S301: Control unit 16 determines whether the bicycle indicator is enabled. If the bicycle indicator is enabled (step S301 - "Yes"), the process proceeds to step S307. On the other hand, if the bicycle indicator is disabled (step S301 - "No"), the process proceeds to step S302.
[0085] Specifically, the control unit 16 refers to the user database stored in the storage unit 15 to determine whether the bicycle icon of the first user is enabled.
[0086] Step S302: The control unit 16 determines whether the speed S of the first user is less than the threshold Sth2 and whether the acceleration A of the first user is less than the threshold Ath2. If it is determined that the speed S is less than the threshold Sth2 and the acceleration A is less than the threshold Ath2 (step S302 - "Yes"), the process proceeds to step S304. On the other hand, if it is determined that the speed S is greater than or equal to the threshold Sth2 and the acceleration A is greater than or equal to the threshold Ath2 (step S302 - "No"), the process proceeds to step S303.
[0087] Specifically, the control unit 16 determines whether the speed S obtained in step S300 is less than a threshold Sth2. The threshold Sth2 can be set to any speed (e.g., 25 km / h or higher) that can be used to presume the first user is riding a passenger vehicle rather than a bicycle. Hereinafter, speeds above the threshold Sth2 are also referred to as "speeds in the passenger vehicle domain". Furthermore, the control unit 16 determines whether the acceleration A obtained in step S300 is less than a threshold Ath2. The threshold Ath2 can be set to any acceleration that can be used to presume the first user is riding a passenger vehicle rather than a bicycle. For example, an arbitrary acceleration in at least one of the X-axis, Y-axis, or Z-axis directions, which is not typically generated in a bicycle, and is specific to passenger vehicles, can be set as the threshold Ath2. Hereinafter, accelerations above the threshold Ath2 are also referred to as "accelerations in the passenger vehicle domain". It should be noted that, for ease of explanation, it is described that the determination of speed S is performed after the determination of acceleration A, but the determination of speed S and acceleration A can also be performed in reverse order or in parallel.
[0088] Here, we will explain why the determination in step S302 considers not only the first user's speed S but also the acceleration A. If the determination in step S302 is based solely on the first user's speed S, the following problem arises. For example, suppose the first user is riding a bicycle, and speed S is detected as falling within the passenger vehicle range. In this case, even if the first user is actually riding a bicycle, it might be immediately determined that they are riding a passenger vehicle. That is, a false determination might occur. On the other hand, if acceleration A is considered in addition to speed S, even if speed S is detected as falling within the passenger vehicle range, as long as the acceleration specific to passenger vehicles is not detected, it will not be immediately determined that the first user is riding a passenger vehicle. As a result, false determinations are more easily avoided. Therefore, the accuracy of determining whether the first user is riding a bicycle can be further improved.
[0089] It should be noted that, as described in step S202, the velocity S and acceleration A are not limited to measurements at a single point in time, but can also be representative values obtained over a specified period of time. This makes it easier to further avoid misjudging a first user riding a bicycle as someone riding in a passenger vehicle. Therefore, the accuracy of determining whether the first user is riding a bicycle can be further improved.
[0090] For this reason, in this embodiment, not only the speed S of the first user but also the acceleration A are considered in the determination of step S302.
[0091] Step S303: If it is determined that the speed S is greater than or equal to the threshold Sth2 and the acceleration A is greater than or equal to the threshold Ath2 (step S302 - "No"), the control unit 16 keeps the bicycle sign closed. After that, the process ends.
[0092] Specifically, when the speed S is above threshold Sth2 and the acceleration A is above threshold Ath2, the control unit 16 presumes that the first user is currently riding a passenger vehicle rather than a bicycle, and keeps the first user's bicycle flag off by referring to the user database stored in the storage unit 15. For example, a typical case of step S303 is equivalent to the first user riding a passenger vehicle at the time of step S301 and also riding a passenger vehicle at the time of step S302.
[0093] Step S304: If it is determined that the speed S is less than the threshold Sth2 and the acceleration A is less than the threshold Ath2 (step S302 - "Yes"), the control unit 16 determines whether the first user's movement time MT2 exceeds the threshold MTth2. If it is determined that the movement time MT2 exceeds the threshold MTth2 (step S304 - "Yes"), the process proceeds to step S306. On the other hand, if it is determined that the movement time MT2 is less than the threshold MTth2 (step S304 - "No"), the process proceeds to step S305.
[0094] Specifically, the control unit 16 measures the cumulative movement time of the first user within a specified time period, where the speed is less than threshold Sth2 and the acceleration is less than threshold Ath2, and calculates the measured cumulative movement time as movement time MT2. Any time period (e.g., 3 minutes) from the determination time point of step S302 to the determination time point of step S304 can be set as the specified time. Any method can be used to measure the cumulative movement time. For example, the control unit 16 acquires information representing the speed of the first user and information representing the acceleration in the positive Z-axis direction over the specified time period via the acquisition unit 12. The control unit 16 calculates the cumulative time within the specified time period where the speed and acceleration represented by the acquired information are less than threshold Sth2 and threshold Ath2, respectively. The control unit 16 calculates this cumulative time as movement time MT2. Then, the control unit 16 determines whether the calculated movement time MT2 exceeds the threshold MTth2. Any time period (e.g., 1 minute) can be set as the threshold MTth2.
[0095] Step S305: If the movement time MT2 is determined to be below the threshold MTth2 (step S304 - "No"), the control unit 16 keeps the bicycle sign off. Afterwards, the process ends.
[0096] Specifically, if the travel time MT2 is below the threshold MTth2, the control unit 16 assumes that the first user is not currently riding a bicycle and keeps the bicycle flag of the first user stored in the user database of the storage unit 15 turned off. For example, a typical case of step S305 is equivalent to the first user being on a passenger vehicle at the time of step S301, getting off the passenger vehicle and riding a bicycle at the time of step S302, and getting off the bicycle and walking at the time of step S304.
[0097] Step S306: If it is determined that the movement time MT2 exceeds the threshold MTth2 (step S304 - "Yes"), the control unit 16 switches the bicycle icon from off to on. After that, the process ends.
[0098] Specifically, if the travel time MT2 exceeds the threshold MTth2, the control unit 16 presumes that the first user is currently riding a bicycle and switches the first user's bicycle flag from off to on, referring to the user database stored in the storage unit 15. For example, a typical case of step S306 is equivalent to the first user being on a passenger vehicle at the time of step S301, getting off the passenger vehicle and riding a bicycle at the time of step S302, and still riding a bicycle at the time of step S304.
[0099] Step S307: If the bicycle icon is determined to be enabled (Step S301 - "Yes"), the control unit 16 determines whether the first user's walking duration WT2 exceeds the threshold WTth2. If the walking duration WT2 exceeds the threshold WTth2 (Step S307 - "Yes"), the process proceeds to step S309. On the other hand, if the walking duration WT2 is determined to be below the threshold WTth2 (Step S307 - "No"), the process proceeds to step S308.
[0100] Specifically, the control unit 16 measures the cumulative walking time of the first user within a specified time period and calculates the measured cumulative walking time as the walking duration WT2. Any time period (e.g., 5 minutes) from the determination time point of step S301 to the determination time point of step S307 can be set as the specified time period. Any method can be used to measure the cumulative walking time. For example, the control unit 16 acquires information representing the speed of the first user and information representing the acceleration in the positive Z-axis direction throughout the specified time period via the acquisition unit 12. The control unit 16 determines whether the speed and acceleration represented by the acquired information are respectively the speed and acceleration of the walking domain described in step S202. If it is determined that the speed and acceleration represented by the acquired information are respectively the speed and acceleration of the walking domain, the control unit 16 determines that the first user is walking. The control unit 16 calculates the cumulative time within the specified time period for which the speed and acceleration represented by the acquired information are determined to be the speed and acceleration of the walking domain. The control unit 16 calculates this cumulative time as the walking duration WT2. Then, the control unit 16 determines whether the calculated walking duration WT2 exceeds the threshold WTth2. Any time (e.g., 3 minutes) can be set as the threshold WTth2. The threshold WTth2 can be the same as or different from the threshold WTth1 described above.
[0101] Step S308: If the walking duration WT2 is determined to be below the threshold WTth2 (step S307 - "No"), the control unit 16 keeps the bicycle icon enabled. Afterwards, the process ends.
[0102] Specifically, if the walking duration WT2 is below the threshold WTth2, the control unit 16 assumes that the first user is currently cycling and keeps the first user's bicycle flag stored in the user database of the storage unit 15 enabled. For example, a typical case of step S308 is equivalent to the first user being cycling at the time of step S301 and also cycling at the time of step S307.
[0103] Step S309: If it is determined that the walking duration WT2 exceeds the threshold WTth2 (step S307 - "Yes"), the control unit 16 switches the bicycle icon from enabled to disabled. After that, the process ends.
[0104] Specifically, if the walking duration WT2 exceeds the threshold WTth2, the control unit 16 presumes that the first user is not currently riding a bicycle and switches the first user's bicycle flag from enabled to disabled, referring to the user database stored in the storage unit 15. For example, a typical case of step S309 is equivalent to the first user being riding a bicycle at the time of step S301, but then getting off and being walking at the time of step S307.
[0105] Based on the above bicycle determination, the control unit 16 determines whether the first user is riding a bicycle.
[0106] Step S101: Control unit 16 determines whether the first user is currently riding a passenger vehicle. If it is determined that the first user is currently riding a passenger vehicle (Step S101 - "Yes"), the process ends. On the other hand, if it is determined that the first user is not currently riding a passenger vehicle (Step S101 - "No"), the process proceeds to step S102.
[0107] Specifically, after determining the mode of transport and the bicycle as described above, the control unit 16 refers to the user database stored in the storage unit 15. If the first user's mode of transport indicator is enabled and the bicycle indicator is disabled, the control unit 16 determines that the first user is riding a passenger vehicle. On the other hand, if the first user's mode of transport indicator is disabled, or if both the first user's mode of transport indicator and the bicycle indicator are enabled, the control unit 16 determines that the first user is not riding a passenger vehicle. When it is determined that the first user is not riding a passenger vehicle, the condition that the first user is not riding a passenger vehicle is met, that is, the first condition of this embodiment is met.
[0108] Next, the control unit 16 determines whether the second condition of this embodiment is met. As described below, the second condition of this embodiment is that the first user approaches at least one of the more than one checkpoints. Specifically, the control unit 16 determines whether the second condition is met by executing the following steps S102 to S103.
[0109] Step S102: Control unit 16 calculates distance D.
[0110] Specifically, the control unit 16 retrieves the location information of the first user from the user database stored in the storage unit 15. Based on the retrieved location information, the control unit 16 calculates the distance between the first user's location on the map (represented by map information) and each of one or more checkpoints on the map. The storage unit 15 stores map information containing the location information of each of one or more checkpoints. The one or more checkpoints include at least one of a first checkpoint and a second checkpoint, wherein the first checkpoint is set based on input from a second user (e.g., the first user's parents) who is not the first user, and the second checkpoint is set based on input from the second user. In this embodiment, the first checkpoint is set based on information such as traffic volume, accident information, or vehicle driving data, but is not limited to these and can be set based on any information. Traffic volume or accident information may be, for example, data related to traffic information provided from the Japan Road Traffic Information Center via network 30, but is not limited to these and can be any data. Vehicle driving data can be, for example, data generated from DCM (Data Communication Module) data collected via network 30 from vehicles traveling from locations on a map, in order to determine locations prone to dangerous driving such as sudden braking or failing to yield, but it can be any data. Any method can be used to set the second checkpoint. For example, a second user can display map information on the screen of their smartphone and operate the touch panel to set any location (e.g., a location on the first user's route to or from school) that is different from the first checkpoint shown on the map (e.g., a location on the first user's route to or from school) as the second checkpoint. The second user can also send information indicating the set second checkpoint to the computing device 20 via the smartphone's communication unit. The computing device 20 can also send data corresponding to the received information indicating the second checkpoint and the map information stored in the storage unit 22 to the terminal device 10. The terminal device 10 can also use the received data to update the map information stored in the storage unit 15. Then, the control unit 16 calculates the distance between the first user's location on the map shown by the map information and each of the more than one checkpoints on the map. The control unit 16 calculates the distance D between the at least one checkpoint with the smallest calculated distance and the first user. However, the calculation of distance D is not limited to these examples and any method can be used.
[0111] Step S103: The control unit 16 determines whether the distance D calculated in step S102 is less than the threshold Dth. If it is determined that the distance D is less than the threshold Dth (step S103 - "Yes"), the process proceeds to step S104. On the other hand, if it is determined that the distance D is greater than or equal to the threshold Dth (step S103 - "No"), the process returns to step S102.
[0112] Specifically, the control unit 16 determines at least one checkpoint where the distance D is less than the threshold Dth by comparing the distance D with the threshold Dth. If the distance D is less than the threshold Dth, the control unit 16 determines that the first user has approached the at least one checkpoint. When it is determined that the first user has approached the at least one checkpoint, the condition that the first user has approached at least one of more than one checkpoints is met, i.e., the second condition of this embodiment is met. Any distance (e.g., a radius of 5m) can be set as the threshold Dth. However, the determination of whether the first user has approached at least one of more than one checkpoints is not limited to these examples, and any method can be used. Hereinafter, this determination will also be referred to as "proximity determination".
[0113] In this embodiment, the control unit 16 sets the threshold Dth to be longer when the first user's mode of movement is bicycle than when the first user's mode of movement is walking. This is because bicycles move faster than walking; therefore, if the same criteria are used to determine whether the first user is approaching at least one of more checkpoints while walking and cycling, the timing of the report may be delayed, and the effectiveness of the report may be reduced. Therefore, by setting the threshold Dth to be longer when the first user's mode of movement is bicycle than when the first user's mode of movement is walking, the timing of the report can be advanced when the user is cycling, thereby suppressing the timing delay of the report.
[0114] Step S104: The control unit 16 outputs a first instruction to present a first notification used to urge the first user to take security action.
[0115] Specifically, in this embodiment, if both the first condition and the second condition are met (step S101 – “No”, and step S103 – “Yes”), the control unit 16 sends a first instruction to the output unit 13, instructing the presentation of a first notification to urge the first user to take security action. The first notification may be sound, text message, image, vibration, or a combination thereof, but in this embodiment it is presented in the form of a sound equivalent to a report (hereinafter also referred to as “first sound”). The first sound may be any sound, such as a synthesized sound or a recorded sound. On the other hand, if at least one of the first condition and the second condition is not met, the control unit 16 does not output the first instruction. In step S104, as described above, both the first condition and the second condition are met. Therefore, the control unit 16 sends the first instruction to the output unit 13. The first notification may have one option set for each security action or multiple options set for each security action. Any method may be used in setting the options for the first notification. For example, the storage unit 15 may store the first sound equivalent to the first notification and one or more checkpoints in a notification database for each security action. For example, storage unit 15 can store a first sound, such as "Check left / right," which is equivalent to a first notification, in a notification database, corresponding to checkpoints set at intersections. This allows for prompting of security actions appropriate for one or more checkpoints. Furthermore, if multiple options for the first notification are set for each security action, the first notification to be presented can be randomly selected each time. This prevents user boredom caused by presenting the same notification repeatedly, thus facilitating the maintenance of reporting effectiveness. Then, control unit 16 retrieves the notification database based on the first notification ID and selects a first notification from one or more options. However, the selection of the first notification is not limited to these examples, and any method can be used. Control unit 16 sends a first instruction to present the selected first notification to output unit 13.
[0116] Step S105: The control unit 16 presents the first notification via the output unit 13.
[0117] Specifically, the control unit 16 plays a first sound equivalent to the first notification selected in step S104 to the first user via the output unit 13. Afterward, the process ends.
[0118] Next, refer to Figure 7 The operation of system 1 in the second embodiment will be described. Figure 7 The action is equivalent to the method of this embodiment. Figure 7 The actions represent the actions of the terminal device 10 and the computing device 20. Figure 7The action is performed repeatedly according to a predetermined cycle. The predetermined cycle can be set arbitrarily. The processing of steps S400 to S405 is the same as that of steps S100 to S105 described in the first embodiment, so the description is omitted. Hereinafter, the processing after step S406, which is performed after the first notification is presented in step S405, will be described as a difference from the first embodiment.
[0119] Step S406: Control unit 16 determines whether a security action of the first user is detected in the area surrounding at least one checkpoint. If it is determined that a security action of the first user has been detected (step S406 - "Yes"), the process proceeds to step S407. On the other hand, if it is determined that no security action of the first user has been detected (step S406 - "No"), the process proceeds to step S409.
[0120] Specifically, in addition to acquiring the location information of the first user via the acquisition unit 12, the control unit 16 also acquires information indicating the behavior of the first user via the acquisition unit 12. Any method can be used to acquire the information indicating the first user's behavior. For example, the control unit 16 can acquire information indicating the first user's behavior (e.g., whether the first user's head is swaying left and right) by analyzing the signals from the angular velocity sensor and / or geomagnetic sensor of the acquisition unit 12. The control unit 16 determines whether a safe action (e.g., left and right check) of the first user is detected in the surrounding area of at least one checkpoint by analyzing the acquired location information of the first user and the information indicating the first user's behavior. Hereinafter, this determination will also be referred to as "action determination". In this embodiment, "surrounding area" refers to an area where the distance D is less than a threshold Dth. That is, in this embodiment, the surrounding area is defined based on the threshold Dth, which serves as a reference for proximity determination. In this embodiment, if the distance D is less than the threshold Dth, the control unit 16 presumes that the first user is located within the surrounding area. However, any method can be used in defining the surrounding area. For example, the surrounding area can be defined using a value larger than the threshold Dth (e.g., radius 6m) or a value smaller than the threshold Dth (e.g., radius 2m). That is, the surrounding area can also be defined independently of the threshold Dth.
[0121] In this embodiment, location information and information indicating whether a security action was detected, along with the time, are stored in storage unit 15. However, they can also be stored in an external storage device, such as storage unit 22 of computing device 20. Furthermore, control unit 16 can transmit the location information stored in storage unit 15, information indicating the presence or absence of a security action, and the time to communication unit 21 of computing device 20 via communication unit 11. In this case, control unit 23 of computing device 20 stores the location information, information indicating the presence or absence of a security action, and the time received via communication unit 21 in storage unit 22. Control unit 23 can also use the location information, information indicating the presence or absence of a security action, and the time to generate data (hereinafter also referred to as "history data") representing the movement path and security action history of the first user on a map represented by map information. In this case, control unit 23 can, for example, send this data to the second user's smartphone upon request from the second user's smartphone. On the second user's side, by reflecting the received history data on the map displayed on the smartphone's screen, the second user can confirm the first user's movement path and security action history. Furthermore, from the perspective of ensuring the safety of the first user, the second user can add or delete a second checkpoint as needed.
[0122] Step S407: If it is determined that a security action of the first user has been detected (step S406 - "Yes"), the control unit 16 outputs a second instruction to present a second notification that is different from the first notification.
[0123] Specifically, after the first instruction is output in step S404, if a safety action by the first user is detected in step S406, the control unit 16 sends a second instruction to the output unit 13 to present a second notification that is different from the first notification. The second notification can be sound, text message, image, vibration, or a combination thereof, but in this embodiment, it is presented to the first user in the form of a sound indicating a positive judgment result (hereinafter also referred to as "second sound"). The second sound can be any sound, such as a synthesized sound or a recorded sound. For example, the second sound could be a sound like "Well done." This makes it easier to maintain the first user's motivation for the safety action. The second notification can have one or multiple options. Any method can be used to set the options for the second notification. For example, the storage unit 15 can store corresponding options for the second sound and the first sound of the first notification in the notification database. This allows the first user to be presented with second notifications that correspond to the options of the first notification. Furthermore, if multiple options for the second notification are set, it is also possible to randomly select which second notification should be presented each time. This prevents the first user from becoming bored due to presenting the same notification every time, thus making it easier to maintain the effectiveness of the report. Then, the control unit 16 retrieves a notification from the notification database based on the second notification ID and selects a second notification from one or more options. However, the selection of the second notification is not limited to these examples, and any method can be used. The control unit 16 sends a second instruction to the output unit 13 to present the selected second notification.
[0124] Step S408: Control unit 16 presents a second notification.
[0125] Specifically, the control unit 16 plays a second sound, equivalent to the second notification selected in step S407, to the first user via the output unit 13. Afterward, the process ends.
[0126] Step S409: If it is determined that no security action of the first user was detected (step S406 - "No"), the control unit 16 calculates the distance D. The method for calculating the distance D is the same as that for steps S102 and S402 described above, so the explanation is omitted.
[0127] Step S410: Control unit 16 determines whether the distance D is above or below the threshold Dth. If the distance D is determined to be above or below the threshold Dth (step S410 - "Yes"), the process proceeds to step S411. On the other hand, if the distance D is determined to be below the threshold Dth (step S410 - "No"), the process returns to step S406.
[0128] Specifically, if the distance D is greater than or equal to the threshold Dth, the control unit 16 presumes that after the first indication output in step S404, the first user left the perimeter area of at least one checkpoint without any security action being detected. On the other hand, if the distance D is less than the threshold Dth, the control unit 16 presumes that the first user remains within the perimeter area and executes the determination in step S406 again.
[0129] Step S411: If it is determined that the distance D is greater than or equal to the threshold Dth (step S410 - "Yes"), the control unit 16 outputs a third instruction to present a third notification that is different from the first notification and the second notification.
[0130] Specifically, after the determination in step S410, if the control unit 16 presumes that the first user has left the perimeter area of at least one checkpoint without being detected during the first instruction output in step S404, then the control unit 16 sends a third instruction to the output unit 13 to present a third notification. The third notification can be sound, text message, image, vibration, or a combination thereof, but in this embodiment, it is presented to the first user in the form of a sound (hereinafter also referred to as "third sound") used to present a negative determination result. The third sound can be any sound, such as a synthesized sound or a recorded sound. The third notification can have one or multiple options. Any method can be used to set the options for the third notification. For example, the storage unit 15 stores corresponding options for the third sound and the first sound of the first notification in the notification database. For example, the storage unit 15 stores corresponding options for the third notification, such as "Check left and right next time," and the first sound of the first notification, such as "Check left and right," in the notification database. Thus, a third notification corresponding to the options of the first notification can be presented to the first user. Furthermore, when multiple options for third notifications are provided, the third notification to be presented can be randomly selected each time. This prevents the first user from becoming bored due to presenting the same notification every time, thus making it easier to maintain the effectiveness of the report. Then, the control unit 16 retrieves a notification from the notification database based on the third notification ID and selects a third notification from one or more options. However, the selection of the third notification is not limited to these examples, and any method can be used. The control unit 16 sends a third instruction to the output unit 13 to present the selected third notification.
[0131] Step S412: Control unit 16 presents a third notification.
[0132] Specifically, the control unit 16 plays a third sound, equivalent to the third notification selected in step S411, to the first user via the output unit 13. Afterward, the process ends.
[0133] Next, refer to Figure 8 The operation of system 1 in the third embodiment will be explained. Figure 8 The action is equivalent to the method of this embodiment. Figure 8 The actions represent the actions of the terminal device 10 and the computing device 20. Figure 8 The action is performed repeatedly according to a predetermined cycle. The predetermined cycle can be arbitrarily set. The third embodiment differs from the second embodiment only in that the processing of step S511 is added. The processing of steps S500 to S505 is the same as the processing of steps S100 to S105 described in the first embodiment. The processing of steps S506 to S510 is the same as the processing of steps S406 to S410 described in the second embodiment, and the processing of steps S512 and S513 is the same as the processing of steps S411 and S412 described in the second embodiment. Therefore, the description of these processes is omitted. Hereinafter, the processing of step S511, which is performed when the distance D becomes a threshold Dth or higher after the determination in step S510, will be mainly described as a difference from the second embodiment.
[0134] Step S511: Control unit 16 determines whether a road crossing by the first user exists. If it is determined that a road crossing by the first user exists (step S511 - "Yes"), the process proceeds to step S512. On the other hand, if it is determined that no road crossing by the first user exists (step S511 - "No"), the process ends.
[0135] Specifically, if the distance D is greater than or equal to the threshold Dth determined in step S510, the control unit 16 presumes that after the first instruction was output in step S504, the first user left the area surrounding at least one checkpoint without any detected safety action. In this embodiment, further, in step S511, the control unit 16 determines whether there is a road crossing by the first user within the surrounding area. Any method can be used to determine whether a road crossing has occurred. As an example, suppose at least one checkpoint is an intersection without traffic lights, the first notification is "Check left and right," and the third notification is "Check left and right next time." In this case, the control unit 16 can refer to the user database stored in the storage unit 15 to obtain the first user's location information. The control unit 16 can analyze the first user's movement path on the map represented by map information based on the obtained location information and determine whether there is a road crossing by the first user at at least one checkpoint. The control unit 16 can decide whether to output a third instruction to present the third notification based on the determination result.
[0136] In this example, when the first user crosses the road at the intersection, the crossing is considered a safe action if the first user confirms left and right and that no vehicles are approaching. Therefore, if the first user leaves the surrounding area after the first instruction is output, and a road crossing by the first user occurs in the surrounding area, a third notification needs to be output. In this case, the control unit 16 proceeds to step S512 and outputs the third instruction as described in step S411. On the other hand, if the first user only turns at the intersection without crossing the road, the first user does not need to confirm left and right and that no vehicles are approaching. Even if the first user leaves the surrounding area without a safe action being detected, presenting a third notification before a road crossing by the first user occurs in the surrounding area could cause inconvenience for the first user. Therefore, if the first user leaves the surrounding area after the first instruction is output, and a road crossing by the first user does not occur in the surrounding area, a third notification does not need to be output. In this case, the control unit 16 does not output a third instruction.
[0137] Thus, after the first instruction is output in step S504, if the first user leaves the surrounding area without any detected safety action, and there is a road crossing by the first user within the surrounding area, the control unit 16 outputs a third instruction as described in step S411. Conversely, if after the first instruction is output, the first user leaves the surrounding area without any detected safety action, and there is no road crossing by the first user within the surrounding area, the control unit 16 does not output a third instruction. Therefore, it is possible to determine whether to output a third instruction based on whether or not a road crossing was conducted by the first user. As a result, it is easy to avoid presenting a third notification unnecessarily. Therefore, it is possible to further reduce the inconvenience for the first user and to further maintain the effectiveness of the reporting.
[0138] As described above, the terminal device 10, as an information processing apparatus in the above embodiment, determines the movement mode of the first user. If both the first condition and the second condition are satisfied, the terminal device 10 outputs a first instruction presenting a first notification urging the first user to take safe action. If at least one of the first and second conditions is not satisfied, the terminal device 10 does not output the first instruction. In the above embodiment, the first condition is that the first user is not currently traveling in a passenger vehicle. In the above embodiment, the second condition is that the first user has approached at least one of more than one checkpoints. The terminal device 10 acquires the location information of the first user. Based on the location information, the terminal device 10 determines whether the first user has approached at least one of more than one checkpoints.
[0139] According to this configuration, a first instruction to present a first notification urging the first user to take safe action is output only when both the first condition and the second condition are met. Unlike conventional methods, this embodiment does not report when the first user is traveling in a passenger vehicle, thus easily avoiding the situation of presenting the first notification at unnecessary intervals. Therefore, this improves the technology related to traffic safety education in terms of reducing inconvenience for the first user and easily maintaining the effectiveness of the report.
[0140] This disclosure has been described based on the accompanying drawings and embodiments. However, those skilled in the art should note that various modifications and alterations can be made based on this disclosure. Therefore, it should be understood that these modifications and alterations are included within the scope of this disclosure. For example, the functions included in each component or step can be reconfigured in a theoretically consistent manner, and multiple components or steps can be combined into one or divided.
[0141] In a variation of the above-described embodiment, the second condition may also be that the first user is moving in a direction different from the first user's orientation. In this variation, the first user's orientation and direction of travel are analyzed to detect behaviors that may pose a danger to the first user (hereinafter also referred to as "unsafe actions"). If an unsafe action is detected, the first user's safety can be easily ensured by presenting a first notification urging safe action to the first user. In this variation, the unsafe action is "the first user is moving in a direction different from the first user's orientation," typically the first user is walking while looking around or walking backwards, but is not limited to these. Any method can be used to determine the first user's orientation. For example, the control unit 16 of the terminal device 10 can execute Figure 9 The orientation of the first user is determined by the action shown (hereinafter also referred to as "orientation determination"). The orientation determination is performed repeatedly, for example, at a predetermined period. The predetermined period can be set arbitrarily. The processing of steps S600 and S601 is the same as that of steps S100 and S101 described in the first embodiment, so the description is omitted. Hereinafter, the processing after step S602, which is different from the first embodiment, will be described in detail.
[0142] Step S602: Control unit 16 acquires orientation information indicating the orientation of the first user.
[0143] Specifically, the control unit 16 acquires orientation information representing the orientation of the first user by analyzing the signals from the angular velocity sensor and / or geomagnetic sensor of the acquisition unit 12. Simultaneously with acquiring the orientation information, the control unit 16 also acquires the position information of the first user. The control unit 16 determines the direction of travel of the first user based on the movement path of the first user on the map obtained by analyzing the acquired position information. Alternatively, the control unit 16 may also determine the direction of travel of the first user by analyzing the signals from the accelerometer sensor of the acquisition unit 12. However, the acquisition of orientation information and the determination of the direction of travel are not limited to these examples, and any method can be used.
[0144] Step S603: Control unit 16 determines whether the first user is moving in a direction different from the first user's orientation. If it is determined that the first user is moving in a direction different from the first user's orientation (step S603 - "Yes"), the process proceeds to step S604. On the other hand, if it is determined that the first user is not moving in a direction different from the first user's orientation (step S603 - "No"), the process returns to step S602.
[0145] Specifically, the control unit 16 compares the orientation of the first user, as indicated by the orientation information obtained in step S602, with the determined direction of travel of the first user. If the comparison results in a situation where the first user's orientation and direction of travel are determined to be substantially different, the control unit 16 determines that the first user is moving in a direction different from the first user's orientation. In this case, the condition that the first user is moving in a direction different from the first user's orientation is met, i.e., the second condition of this modified example is met. On the other hand, if the first user's orientation and direction of travel are determined to be substantially the same, the control unit 16 determines that the first user is not moving in a direction different from the first user's orientation. "The first user's orientation and direction of travel are substantially the same" means that the first user's orientation and direction of travel are at or below a predetermined angle difference (e.g., 90° or less). The predetermined angle difference can be arbitrarily set according to the mounting position of the terminal device 10. However, the determination of whether the first user is moving in a direction different from the first user's orientation is not limited to these examples, and any method can be used.
[0146] Step S604: If it is determined that the first user is moving in a direction different from the direction the first user is moving (step S603 - "Yes"), the control unit 16 outputs a first instruction to present a first notification to urge the first user to take a safety action.
[0147] Specifically, if both the first and second conditions of this variation are met (step S601 – “No”, and step S603 – “Yes”), the control unit 16 sends a first instruction to the output unit 13, instructing the presentation of a first notification to urge the first user to take safe action. On the other hand, if at least one of the first and second conditions is not met, the control unit 16 does not output the first instruction. In step S604, as described above, both the first and second conditions are met. Therefore, the control unit 16 sends the first instruction to the output unit 13. The first notification of this variation refers to the sound of a report presented from the output unit 13 when an unsafe action is detected. The first notification of this variation can have one option set for each unsafe action or multiple options set for each unsafe action. Any method can be used to set the options for the first notification of this variation. For example, the storage unit 15 can store the sound corresponding to the first notification and the unsafe action in a notification database respectively. For example, the unsafe action in this variation is typically walking while looking around or walking backwards. In this case, the storage unit 15 can also store a sound equivalent to a first notification, such as "walk forward," in the notification database, corresponding to the unsafe action. This allows for prompting appropriate safe actions for each unsafe action. Furthermore, if multiple options for the first notification are provided for each unsafe action, the first notification to be presented can be randomly selected each time. This prevents user boredom caused by presenting the same notification repeatedly, thus facilitating the maintenance of the reporting effect. Then, the control unit 16 retrieves the notification database based on the first notification ID and selects a first notification from one or more options. However, the selection of the first notification is not limited to these examples, and any method can be used. The control unit 16 sends a first instruction to present the selected first notification to the output unit 13.
[0148] Step S605: Control unit 16 presents a first notification via output unit 13.
[0149] Specifically, the control unit 16 plays the sound equivalent to the first notification selected in step S604 to the first user via the output unit 13. Afterward, the process ends.
[0150] According to this variation, unsafe actions can be detected by determining whether the second condition of this variation is met. Upon detecting an unsafe action, the safety of the first user can be easily ensured by presenting a first notification to the first user urging the safe action to be taken.
[0151] In this variation, the unsafe action as the second condition is "the first user is moving in a direction different from the first user's orientation," but it is not limited to this; for example, it could also be "the first user is running near the road." In this case, in step S602, in addition to acquiring orientation and position information via the acquisition unit 12, the control unit 16 may also acquire information representing the first user's speed and acceleration via the acquisition unit 12. Alternatively, in step S603, the control unit 16 may determine whether the first user has started running based on the acquired information. The storage unit 15 can store a sound equivalent to a first notification, such as "Do not run near the road," in the notification database for this unsafe action.
[0152] Furthermore, for example, in the above-described embodiment, the first, second, and third notifications are all presented in the form of sound, but it is also possible to present at least one of these notifications in other forms, such as vibration. In this case, data representing the intensity or vibration pattern of the vibration output from the output unit 13 can be stored in the notification data of the notification database as the notification data. The intensity or vibration pattern of the vibration can be set to vary according to the distance D or the duration of the unsafe action. For example, it can be set that the smaller the distance D or the longer the duration of the unsafe action, the stronger the vibration. Furthermore, when two or more of the first, second, and third notifications are presented in the form of vibration, the two or more notifications can be distinguished by changing the intensity or vibration pattern of the vibration output from the output unit 13 for each notification. This setting that allows for variations in the notification presentation scheme is not limited to notifications implemented through vibration, and can also be appropriately applied to other notification forms. As a result, the first user can perceive changes in the level of danger and / or distinguish between two or more notifications, and it is easy to ensure the safety of the first user.
[0153] Furthermore, for example, the control unit 16 of the terminal device 10 can also send the history data to the second user's smartphone via a local network such as a wireless LAN, without going through the network 30, based on a request from the second user's smartphone. In this case, by directly sending and receiving data between the first user's terminal device 10 and the second user's smartphone, the second user can confirm the first user's movement path and security activity history.
[0154] Furthermore, for example, in the above-described embodiments, it is also possible to implement an embodiment in which the configuration and operation of the terminal device 10 are distributed among multiple computers that can communicate with each other.
[0155] Furthermore, for example, it is also possible to implement an embodiment in which some or all of the components of the terminal device 10 are located in the computing device 20. For example, it is also possible to implement an embodiment in which the computing device 20 performs some or all of the actions performed by the terminal device 10. In this case, the information processing apparatus of this embodiment is the computing device 20. For example, it is also possible that the computing device 20 further includes a component corresponding to the acquisition unit 12 of the terminal device 10, and the control unit 23 of the computing device 20 performs some or all of the actions of the control unit 16 of the terminal device 10. The control unit 23 of the computing device 20 may also perform actions other than the action of presenting the first notification, the second notification, or the third notification via the output unit 13 of the terminal device 10 (i.e., steps S105, S405, S408, S412, S505, S508, S513, or S605). In this case, during steps S104, S404, S407, S411, S504, S507, S512, or S604, the control unit 23 of the computing device 20 may also send the first instruction, the second instruction, or the third instruction to the communication unit 11 of the terminal device 10 via the network 30. The control unit 16 of the terminal device 10 may also send the first instruction, the second instruction, or the third instruction received via the communication unit 11 to the output unit 13.
[0156] Furthermore, for example, an implementation can also be implemented that enables a general-purpose computer to function as the terminal device 10 of the above-described embodiments. Specifically, a program describing the processing content of each function of the terminal device 10 implementing the above-described embodiments is stored in the memory of a general-purpose computer, and the program is read and executed by a processor. Therefore, this disclosure can also be implemented as a program that can be executed by a processor, or as a non-transitory computer-readable medium (storage medium) storing the program.
Claims
1. An information processing device comprising a control unit, wherein, The control unit is configured to: Determine the first user's movement method; Obtain the location information of the first user; Based on the location information, determine whether the first user is close to at least one of the more than one checkpoints; If both the first and second conditions are met, output a first instruction to present the first notification used to urge the first user to take security action; If at least one of the first condition and the second condition is not met, the first instruction will not be output; If, after the first instruction is output, the security action performed by the first user is detected, a second instruction is output to present a second notification that is different from the first notification; After the first instruction is output, if the first user leaves the area surrounding the at least one checkpoint while the security action is not detected, and if there is a road crossing by the first user in the surrounding area, a third instruction is output to present a third notification that is different from the first notification and the second notification. as well as After the first instruction is output, if the first user leaves the surrounding area while the safety action is not detected, and if there is no road crossing by the first user within the surrounding area, the third instruction is not output. The first condition is that the first user is not currently riding in a passenger vehicle. The second condition is that the first user approaches at least one of the more than one checkpoints.
2. The information processing apparatus according to claim 1, wherein, The more than one checkpoint includes at least one of a first checkpoint and a second checkpoint, wherein the first checkpoint is a checkpoint set not based on the input of a second user different from the first user, and the second checkpoint is a checkpoint set based on the input of the second user.
3. The information processing apparatus according to claim 1 or 2, wherein, The control unit is configured to: If the distance D between the first user and the at least one checkpoint is less than a threshold Dth, it is determined that the first user has approached the at least one checkpoint. as well as The threshold Dth is set such that the threshold Dth when the first user's mode of movement is bicycle is longer than the threshold Dth when the first user's mode of movement is walking.
4. An information processing method, executed by an information processing device, wherein, The information processing method includes: Determine the first user's movement method; Obtain the location information of the first user; Based on the location information, determine whether the first user is close to at least one of the more than one checkpoints; If both the first and second conditions are met, output a first instruction to present the first notification used to urge the first user to take security action; If at least one of the first condition and the second condition is not met, the first instruction will not be output; If, after the first instruction is output, the security action performed by the first user is detected, a second instruction is output to present a second notification that is different from the first notification; After the first instruction is output, if the first user leaves the area surrounding the at least one checkpoint while the security action is undetected, and if a road crossing by the first user occurs within the surrounding area, a third instruction is output presenting a third notification different from the first and second notifications; and After the first instruction is output, if the first user leaves the surrounding area while the safety action is not detected, and if there is no road crossing by the first user within the surrounding area, the third instruction is not output. The first condition is that the first user is not currently riding in a passenger vehicle. The second condition is that the first user approaches at least one of the more than one checkpoints.
5. The information processing method according to claim 4, wherein, The more than one checkpoint includes at least one of a first checkpoint and a second checkpoint, wherein the first checkpoint is a checkpoint set not based on the input of a second user different from the first user, and the second checkpoint is a checkpoint set based on the input of the second user.
6. The information processing method according to claim 4 or 5 further includes: If the distance D between the first user and the at least one checkpoint is less than a threshold Dth, it is determined that the first user has approached the at least one checkpoint. as well as The threshold Dth is set such that the threshold Dth when the first user's mode of movement is bicycle is longer than the threshold Dth when the first user's mode of movement is walking.
7. A storage medium storing a program that causes an information processing device to perform the following steps: Determine the first user's movement method; Obtain the location information of the first user; Based on the location information, determine whether the first user is close to at least one of the more than one checkpoints; If both the first and second conditions are met, output a first instruction to present the first notification used to urge the first user to take security action; If at least one of the first condition and the second condition is not met, the first instruction will not be output; If, after the first instruction is output, the security action performed by the first user is detected, a second instruction is output to present a second notification that is different from the first notification; After the first instruction is output, if the first user leaves the area surrounding the at least one checkpoint while the security action is not detected, and if there is a road crossing by the first user in the surrounding area, a third instruction is output to present a third notification that is different from the first notification and the second notification. as well as After the first instruction is output, if the first user leaves the surrounding area while the safety action is not detected, and if there is no road crossing by the first user within the surrounding area, the third instruction is not output. The first condition is that the first user is not currently riding in a passenger vehicle. The second condition is that the first user approaches at least one of the more than one checkpoints.
8. The storage medium according to claim 7, wherein, The more than one checkpoint includes at least one of a first checkpoint and a second checkpoint, wherein the first checkpoint is a checkpoint set not based on the input of a second user different from the first user, and the second checkpoint is a checkpoint set based on the input of the second user.
9. The storage medium according to claim 7 or 8, wherein, The program causes the information processing device to further perform the following steps: If the distance D between the first user and the at least one checkpoint is less than a threshold Dth, it is determined that the first user has approached the at least one checkpoint. as well as The threshold Dth is set such that the threshold Dth when the first user's mode of movement is bicycle is longer than the threshold Dth when the first user's mode of movement is walking.
Citation Information
Patent Citations
Pedestrian warning system
US20150109149A1
Electronic device, control method, and non-transitory computer-readable medium
US20190103018A1
Action verifying system
WO2019240070A1