Information providing method, information providing system, and program

Abstract

In an information providing method according to the present invention, a computer acquires first information pertaining to a user (person) B1 present in a first area A1 of an escalator E1 (S101), acquires second information pertaining to the user B1 present in a second area A2 of the escalator E1 (S102), acquires third information pertaining to a vehicle C1 present on the escalator E1 and relating to at least one of the first information and the second information (S103), discerns a change in the state of the vehicle C1 on the basis of the third information (S104), and outputs notification information indicating notification content determined on the basis of the discerned change in the state of the vehicle C1 (S105, S106).

Description

Information provision method, information provision system, and program

[0001] The present disclosure relates to a method of providing information to escalator users.

[0002] Patent Document 1 discloses an escalator monitoring system that installs at least two cameras in a location that can monitor the entire escalator, detects passenger behavior, and issues warnings by voice or display depending on the passenger behavior.

[0003] Patent document 2 discloses an escalator warning device that uses image recognition means and heat detection means to detect users who are about to board an escalator with a baby in a stroller and sounds a specified warning message.

[0004] JP 2010-64821 A JP 2010-215317 A

[0005] The present disclosure provides an information provision method and the like that can easily provide warnings tailored to the usage patterns of vehicle users using escalators.

[0006] An information providing method according to one aspect of the present disclosure is a method in which a computer acquires first information about a person present in a first area of ​​an escalator, acquires second information about the person present in a second area of ​​the escalator, acquires third information about a vehicle present on the escalator that is related to at least one of the first information or the second information, determines a change in the state of the vehicle based on the third information, and outputs notification information indicating notification content determined based on the determined change in the state of the vehicle.

[0007] This comprehensive or specific aspect may be realized as an apparatus, a method, a system, an integrated circuit, a computer program, or a computer-readable recording medium, or as any combination of an apparatus, a system, a method, an integrated circuit, a computer program, and a computer-readable recording medium. The computer-readable recording medium includes a non-volatile recording medium such as a CD-ROM (Compact Disc-Read Only Memory).

[0008] According to the present disclosure, it is possible to easily issue warnings to users of vehicles using escalators in accordance with their usage patterns.

[0009] FIG. 1 is a schematic diagram showing an example of a usage environment of an information provision system according to embodiment 1. FIG. 2 is a block diagram showing an example of a functional configuration of the information provision system according to embodiment 1. FIG. 3A is a schematic diagram showing an example of erroneous detection of a vehicle. FIG. 3B is a schematic diagram showing an example of overlooking a vehicle. FIG. 4 is a schematic diagram showing an example of overlooking a vehicle when an IC tag is used. FIG. 5 is a schematic diagram showing an example of determination by a determination unit according to embodiment 1. FIG. 6 is a diagram showing an example of a notification content database according to embodiment 1. FIG. 7 is a flowchart showing an example of an overall flow of processing of the information provision system according to embodiment 1. FIG. 8A is a schematic diagram showing a first installation example of a first sensor and a second sensor according to embodiment 1. FIG. 8B is a schematic diagram showing a second installation example of a first sensor and a second sensor according to embodiment 1. FIG. 8C is a schematic diagram showing a third installation example of a first sensor and a second sensor according to embodiment 1. FIG. 8D is a schematic diagram showing a fourth installation example of a first sensor and a second sensor according to embodiment 1. FIG. 9 is a schematic diagram showing an example of a change in the shape of a vehicle according to embodiment 2. FIG. 10 is a block diagram showing an example of a configuration for detecting a change in the state of a vehicle using an IC tag according to the second embodiment. FIG. 11 is a schematic diagram showing an example of determination by a determination unit according to the second embodiment. FIG. 12 is a diagram showing an example of a notification content database according to the second embodiment. FIG. 13 is a flowchart showing an example of a partial process of the information provision system according to the second embodiment. FIG. 14 is a diagram showing an example of feature information according to a first example of the third embodiment. FIG. 15A is a diagram showing an example of a notification content database according to the first example of the third embodiment. FIG. 15B is a diagram showing an example of a call content database according to the first example of the third embodiment. FIG. 16 is a diagram showing an example of a notification content database according to the second example of the third embodiment. FIG. 17 is a flowchart showing an example of a partial process of the information provision system according to the first and second examples of the third embodiment. FIG. 18 is a diagram showing an example of a notification content database according to the third example of the third embodiment. FIG. 19 is a flowchart showing an example of a partial process of the information provision system according to the third example of the third embodiment. FIG. 20 is a schematic diagram showing an example of a vehicle rental area according to the fourth embodiment.FIG. 21 is a schematic diagram showing an example of a usage environment of an information provision system according to Embodiment 4. FIG. 22 is a block diagram showing an example of the functional configuration of an information provision system and an operation terminal according to Embodiment 4. FIG. 23A is a diagram showing an example of a notification content database according to Embodiment 4. FIG. 23B is a diagram showing an example of a message sentence database according to Embodiment 4. FIG. 23C is a diagram showing an example of a nationality-language database according to Embodiment 4. FIG. 23D is a diagram showing an example of a rental database according to Embodiment 4. FIG. 23E is a diagram showing an example of a user database according to Embodiment 4. FIG. 23F is a diagram showing an example of a vehicle database according to Embodiment 4. FIG. 24 is a flowchart showing an example of processing of the information provision system according to Embodiment 4. FIG. 25 is a block diagram showing an example of the functional configuration of an information provision system and an information terminal according to Embodiment 5. FIG. 26 is a diagram showing an example of a display of an information terminal according to Embodiment 5. FIG. 27 is a schematic diagram showing an example of a usage environment of an information provision system according to Embodiment 6. FIG. 28A is a diagram showing an example of a notification content database for a first escalator according to Embodiment 6. FIG. 28B is a diagram showing an example of a notification content database for a second escalator according to Embodiment 6. Fig. 29 is a block diagram showing an example of a functional configuration of an information providing system according to Embodiment 7. Fig. 30 is a schematic diagram showing an example of an operation of the information providing system according to Embodiment 7. Fig. 31 is a flowchart showing an example of a process of the information providing system according to Embodiment 7.

[0010] (Knowledge forming the basis of the present disclosure) In recent years, there have been a number of accidents involving users of vehicles such as strollers or wheelchairs falling off escalators. One cause of these accidents is that users of vehicles such as strollers use the escalator with people or luggage inside the vehicle.

[0011] For example, many escalators installed in public facilities and other facilities issue warning announcements, but some users do not notice or ignore the announcements. There are several reasons for this. First, warnings are issued even when a vehicle user passing by the escalator but not actually using the escalator is mistakenly detected. In this case, the announcement is made to people other than the vehicle user, reducing the effectiveness of the announcement and potentially leading to users not noticing or ignoring the announcement. Second, if a vehicle is blocked by other users during a crowded period and overlooked, no warning is issued even to a user who is using the escalator with people or luggage on board. In this case, the vehicle user does not even notice that a warning announcement is being made.

[0012] Third, users of strollers or wheelchairs can use the escalator by removing passengers or luggage from the stroller or wheelchair and folding it up. If such users are given the same warning as users who use the escalator with passengers or luggage in their strollers or wheelchairs, they may feel uncomfortable. In this case, users may no longer trust the warning.

[0013] Therefore, it is necessary to improve the accuracy of detecting vehicle users using escalators, for example, by distinguishing between users who are using escalators with people or luggage in their vehicles and good users, and to provide warnings that are tailored to the vehicle users' usage patterns.

[0014] In Patent Document 1, a user with a baby in a stroller entering an escalator is detected and a predetermined warning is issued. In Patent Document 1, if a baby is detected in a stroller, the user is always subject to a warning. In other words, no consideration is given to the case where a user of a vehicle passing near the escalator but not actually using the escalator is mistakenly detected, or the case where a vehicle is overlooked because it is blocked by other users during congestion. No consideration is given to the case where a baby is detected in a stroller, but in reality, the user of the vehicle has removed people or luggage from the vehicle and folded the vehicle up and used it immediately before using the escalator.

[0015] In Patent Document 2, warnings are given to escalator users with varying degrees of intensity, but no consideration is given to the behavior of users of vehicles such as strollers or wheelchairs when using the escalator.

[0016] As such, further improvements are needed in terms of warning people who use escalators with people or luggage on board.

[0017] In order to solve such problems, an information providing method according to one aspect of the present disclosure is a method in which a computer acquires first information about a person present in a first area of ​​an escalator, acquires second information about the person present in a second area of ​​the escalator, acquires third information about a vehicle present on the escalator that is related to at least one of the first information or the second information, determines a change in the state of the vehicle based on the third information, and outputs notification information indicating notification content determined based on the determined change in the state of the vehicle.

[0018] This makes it easier to provide warnings tailored to the vehicle user's usage patterns.

[0019] The state of the vehicle may include the presence or absence of the vehicle. For example, the vehicle may be at least one of a cart, a pushchair, or a stroller.

[0020] This allows for warnings that take into account the possibility that a vehicle user passing near the escalator but not actually using the escalator may have been mistakenly detected, or that the vehicle may have been overlooked because it was blocked by other users during congestion.

[0021] The computer may acquire the first information and the third information from an image captured by a first camera that captures the first area, and may acquire the second information and the third information from an image captured by a second camera that captures the second area.

[0022] This makes it possible to distinguish between a case where a user of a vehicle is mistakenly detected passing near an escalator but is not actually using the escalator, and a case where a vehicle is overlooked because it is blocked by other users during congestion, and to issue a warning accordingly.

[0023] The vehicle may have an IC tag that records information about the vehicle's state, and the computer may obtain the third information by reading the information from the IC tag with a tag reader.

[0024] This makes it easier to obtain higher accuracy of the third information compared to when the third information is obtained from an image captured by a camera.

[0025] The computer may acquire the third information by detecting the first area from a first direction, and may acquire the third information by detecting the second area from a second direction, and the first direction and the second direction may be different directions.

[0026] This reduces the probability of missing a vehicle. For example, suppose there is another user in front of a vehicle user. When detecting the first area from a first direction during congestion, the vehicle may be difficult to detect due to obstruction by the other user in front of the vehicle, resulting in the vehicle being overlooked. However, with this configuration, the first area is detected from a first direction and the second area is detected from a second direction different from the first direction. Therefore, even if the vehicle is overlooked in the first area due to obstruction by the other user, it is possible to detect the vehicle in the second area because it is not obstructed by the other user.

[0027] The change in the state of the vehicle may include a change in the shape of the vehicle.

[0028] This makes it easier to provide warnings tailored to the vehicle user's usage patterns based on changes in the vehicle's shape.

[0029] The change in the shape of the vehicle may be a change in shape due to folding of the vehicle.

[0030] This allows the degree of warning to be reduced for users of vehicles with the vehicle folded up, making it less likely that users of better vehicles will feel uncomfortable.

[0031] The third information may include fourth information indicating a shape of the vehicle at a time when the first information is acquired, and fifth information indicating a shape of the vehicle at a time when the second information is acquired. The computer may identify a change in the shape of the vehicle based on the fourth information and the fifth information.

[0032] This makes it possible to issue a warning in consideration of the case where a vehicle user unloads people or luggage from the vehicle immediately before using the escalator and then folds up the vehicle for use.

[0033] For example, suppose the first area is near the entrance to an escalator, and the second area is after the midpoint of the escalator. Suppose a vehicle user changes the shape of the vehicle just before getting on the escalator. In this case, in the first area, the vehicle is likely to be detected in a shape that is undesirable for using the escalator, such as an open state. However, in the second area, the vehicle is likely to be detected in a shape that is desirable for using the escalator, such as a folded state. Thus, by using the fourth information acquired in the first area and the fifth information acquired in the second area, it can be determined whether the vehicle's body shape has changed to a shape that is desirable for using the escalator.

[0034] The computer may further acquire characteristic information indicating characteristics of at least one of the person and the vehicle. The notification content may be determined based on the characteristic information.

[0035] This allows the warning message to include a sentence that describes the characteristics of the vehicle user, which makes it easier for the vehicle user to recognize that the warning message is directed to them. In other words, the effectiveness of the warning message can be improved.

[0036] The characteristic information may include at least one of information about clothing of the person and information about the type of the vehicle.

[0037] This allows the warning message to include a sentence describing the clothing of the vehicle user or the type of vehicle, which makes it easier for the vehicle user to recognize that the warning message is directed at them. In other words, the effectiveness of the warning message can be further improved.

[0038] The characteristic information may include language information about a language that can be understood by the human, and the notification content may be determined based on the language information.

[0039] This allows the warning message to include a sentence written in a language that the vehicle user can understand, which makes it easier for the vehicle user to recognize that the warning message is directed to them, thereby further improving the effectiveness of the warning.

[0040] The characteristic information may include related party information about related parties of the person, and the notification content may be determined based on the related party information.

[0041] This allows a warning message to be sent according to the number of vehicle users and related parties, thereby increasing the effectiveness of the warning.

[0042] In general, even when a vehicle is transformed into a desired shape to use an escalator, the greater the number of people involved in the vehicle, including the vehicle user, the higher the safety when using the escalator. Therefore, when the number of people involved, including the vehicle user, is small, the level of warning may be increased.

[0043] The feature information may further include status information indicating a status of the person. The notification information may be output from at least one of a speaker and a display based on the status information.

[0044] This makes it possible to output a warning message from an appropriate device depending on, for example, the state of the vehicle user, related parties, or people riding in the vehicle, etc. This makes it easier for the vehicle user to notice that the warning message is directed at them, thereby increasing the effectiveness of the warning.

[0045] The status information may include at least one of information indicating a wakefulness or sleep state of a person riding in the vehicle, or information indicating a visual or auditory state of the person.

[0046] This makes it possible to output a warning message from an appropriate device depending on the condition of the vehicle user or the person riding in the vehicle.

[0047] For example, even if a vehicle user cannot hear a warning message from a speaker using earphones, etc., the user can still notice the warning message displayed on the display. On the other hand, even if the vehicle user is looking at a smartphone, etc. and cannot see the display, the user can still notice the warning message from the speaker.

[0048] When a child or other person riding in a vehicle is asleep, a warning message is displayed on the display to alert the vehicle user without waking the child.

[0049] The vehicle may be a rental vehicle, the characteristic information may include an identifier of the rental vehicle, and the notification content may be determined based on user information about the person renting the rental vehicle that corresponds to the identifier of the rental vehicle. For example, the user information may include at least one of passport information about the person including nationality, or rental registration information about the person registered when the rental vehicle was rented.

[0050] This allows a temporary user of the vehicle to be alerted even if the vehicle is a rental vehicle.

[0051] The computer may transmit the notification information to an information terminal owned by the person or a related person of the person.

[0052] This makes it easier for, for example, vehicle users or other relevant parties to notice the warning message.

[0053] The escalators may include a first escalator and a second escalator installed continuously with the first escalator ahead in the direction of travel of the person. The computer may determine the notification content for the second escalator based on the notification content determined for the first escalator.

[0054] This allows the system to determine the new notification content for the second escalator after taking into consideration whether the warning message for the first escalator was effective. For example, in high-rise buildings, escalators leading to each floor are often installed in succession. In this case, if a warning message was issued for the first escalator but the change in vehicle status on the second escalator is undesirable, the system can strengthen the warning.

[0055] When the computer acquires the third information indicating the presence of the vehicle at a first time point when the first information is acquired, it may store the first information in a first memory unit linked to the third information, and store the second information acquired a predetermined time after the first time point linked to the third information in a second memory unit; when the computer acquires the third information indicating the presence of the vehicle at a second time point when the second information is acquired, it may store the second information in the second memory unit linked to the third information, and store the first information acquired a predetermined time before the first time point linked to the third information in the first memory unit.

[0056] This allows data collection to improve vehicle detection accuracy. For example, a vehicle detected in the first area may also be present in the second area after a certain period of time. Therefore, regardless of whether a vehicle is detected in the second area, the second information at that time may contain information indicating the vehicle, such as an image of the vehicle. Therefore, if such data is accumulated and used as training data for a detection system using machine learning, for example, it is expected that vehicle detection accuracy will improve.

[0057] The predetermined time may be determined based on the operating speed of the escalator.

[0058] As a result, even if the speed of the escalator changes dynamically, for example, when a vehicle is detected in the first area but not in the second area, the second information and the third information at the time when the vehicle user reaches the second area can be recorded in the second storage unit at an appropriate time. Similarly, when a vehicle is not detected in the first area but is detected in the second area, the first information and the third information at the time when the vehicle user reaches the first area can be recorded in the first storage unit at an appropriate time.

[0059] An information provision system according to one aspect of the present disclosure includes a first information acquisition unit that acquires first information about a person present in a first area of ​​an escalator, a second information acquisition unit that acquires second information about the person present in a second area of ​​the escalator, a third information acquisition unit that acquires third information about a vehicle present on the escalator that is related to at least one of the first information or the second information, a discrimination unit that determines a change in the state of the vehicle based on the third information, a notification content determination unit that determines notification content based on the determined change in the state of the vehicle, and an output unit that outputs notification information indicating the determined notification content.

[0060] This makes it easier to provide warnings tailored to the vehicle user's usage patterns.

[0061] A program according to one aspect of the present disclosure causes a computer to acquire first information about a person present in a first area of ​​an escalator, acquire second information about the person present in a second area of ​​the escalator, acquire third information about a vehicle present on the escalator related to at least one of the first information or the second information, determine a change in the state of the vehicle based on the third information, and output notification information indicating notification content determined based on the determined change in the state of the vehicle.

[0062] This makes it easier to provide warnings tailored to the vehicle user's usage patterns.

[0063] The information providing method of the present disclosure can also be realized as a computer program that causes a computer to execute the characteristic processes included in the method, and it goes without saying that such a computer program can be distributed on a computer-readable non-transitory recording medium such as a CD-ROM or via a communication network such as the Internet.

[0064] Hereinafter, the embodiments will be specifically described with reference to the drawings.

[0065] Note that the embodiments described below all show comprehensive or specific examples of the present disclosure. The numerical values, shapes, components, steps, step orders, etc. shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Among the components in the following embodiments, components that are not described in the independent claims that represent the highest concepts are described as optional components. In all embodiments, the respective contents can also be combined. Each figure is a schematic diagram and is not necessarily an exact illustration. In each figure, the same components are assigned the same reference numerals.

[0066] The information providing system according to the embodiment of the present disclosure may be configured so that all components are included in one computer, or may be configured as a system in which multiple components are distributed across multiple computers.

[0067] In the specification, claims, abstract, and drawings of this application, "at least one of A and B" means "A, or B, or A and B."

[0068] (Embodiment 1) [1. Overview] Fig. 1 is a schematic diagram showing an example of a usage environment of an information provision system 100 according to embodiment 1. The information provision system 100 is a system for issuing a warning to a user (person) B1 of a vehicle C1 when the user B1 uses an escalator E1, in accordance with the usage pattern of the user B1.

[0069] In the example shown in Fig. 1, the escalator E1 is an upward escalator. In the following description, the escalator E1 is assumed to be an upward escalator, but the escalator E1 may also be a downward escalator, a horizontal escalator (moving walkway), or the like. Furthermore, the escalator E1 may be an escalator that combines an upward (or downward) escalator with a horizontal escalator.

[0070] In the example shown in Fig. 1 , the vehicle C1 is a stroller. In the following description, unless otherwise specified, the vehicle C1 will be described as a stroller; however, the vehicle C1 may also be, for example, a cart, a pushcart, or the like. In other words, the vehicle C1 is at least one of a cart, a pushcart, or a stroller. Pushcarts may include, for example, a wheelchair, a carrier cart, a shopping cart, or a dolly.

[0071] The user B1 of the vehicle C1 includes not only a person who has ownership of the vehicle C1 by purchasing the vehicle C1, etc., but also a person who is temporarily using the vehicle C1 by renting the vehicle C1, etc. In the following, unless otherwise specified, the user B1 of the vehicle C1 will be described as a person who has ownership of the vehicle C1.

[0072] The attention of user B1 can be given through the sense of hearing of user B1, for example, by outputting notification information urging the attention by voice. The attention of user B1 can be given through the sense of sight of user B1, for example, by outputting notification information urging the attention on a display device. In the first embodiment, a speaker 3 and a display 4 are installed near the exit of the escalator E1, and the attention of user B1 is given by outputting notification information via the speaker 3 or the display 4. In other words, the attention of user B1 is given after user B1 has used the escalator E1. Note that the attention of user B1 may also be given while user B1 is using the escalator E1.

[0073] [2. Configuration of Information Providing System] The information providing system 100 according to the first embodiment will be described below mainly with reference to Figs. 1 and 2. Fig. 2 is a block diagram showing an example of the functional configuration of the information providing system 100 according to the first embodiment. The information providing system 100 is configured as a computer such as a personal computer or a server. As shown in Fig. 2, the information providing system 100 includes a first information acquiring unit 11, a second information acquiring unit 12, a third information acquiring unit 13, a determining unit 14, a notification content determining unit 15, and an output unit 16.

[0074] The information providing system 100 further includes a notification content database DB1. The notification content database DB1 is stored on a recording medium such as a hard disk drive, a RAM (Random Access Memory), a ROM (Read Only Memory), or a semiconductor memory. Note that such a recording medium may be volatile or non-volatile. The other databases mentioned below are also stored on the same or different recording media.

[0075] The first information acquisition unit 11 acquires first information about a user B1 present in the first area A1 of the escalator E1. The first information includes information indicating whether the user B1 is present in the first area A1.

[0076] 1, the first area A1 is an area including the entrance to the escalator E1. In the following description, the first area A1 is an area including the entrance to the escalator E1, but the first area A1 may also be an area including the midpoint of the escalator E1.

[0077] The first information acquisition unit 11 acquires the first information by acquiring the detection result of the first sensor 21 through wired or wireless communication with the first sensor 21, whose detection range is the first area A1. Hereinafter, unless otherwise specified, the first sensor 21 will be described as a first camera 210 (see FIG. 5 ) whose imaging range is the first area A1. That is, the first information acquisition unit 11 acquires first information indicating the presence or absence of user B1 in the first area A1 by performing appropriate image analysis processing on an image captured by the first camera 210. The image analysis processing is performed, for example, by a trained model that has completed machine learning so as to output a result indicating the presence or absence of user B1 for an input image.

[0078] The information providing system 100 may include a plurality of computers. The plurality of computers may include a computer A. The first information acquisition unit 11 may acquire the first information through the following processes (p1) to (p4).

[0079] (p1) The first information acquisition unit 11 receives an image captured by the first camera 210.

[0080] (p2) The first information acquisition unit 11 sends the image captured by the first camera 210 to the computer A.

[0081] (p3) Computer A executes the image analysis process described above and determines the first information.

[0082] (p4) Computer A sends the determined first information to the first information acquisition unit 11.

[0083] The second information acquisition unit 12 acquires second information about the user B1 present in the second area A2 of the escalator E1. The second information includes information indicating whether the user B1 is present in the second area A2.

[0084] In the example shown in Fig. 1, the second area A2 is an area including the exit of the escalator E1. The second area A2 is an area that user B1 reaches after passing through the first area A1 in the direction of travel of the user B1. In the following description, the second area A2 is described as an area including the exit of the escalator E1, but the second area A2 may also be an area including the midpoint of the escalator E1.

[0085] The second information acquisition unit 12 acquires the second information by acquiring the detection result of the second sensor 22 through wired or wireless communication with the second sensor 22, whose detection range is the second area A2. Hereinafter, unless otherwise specified, the second sensor 22 will be described as a second camera 220 (see FIG. 5 ) whose imaging range is the second area A2. That is, the second information acquisition unit 12 acquires second information indicating the presence or absence of user B1 in the second area A2 by performing appropriate image analysis processing on the image captured by the second camera 220. The image analysis processing is performed, for example, by a trained model that has completed machine learning so as to output a result indicating the presence or absence of user B1 for an input image.

[0086] The information providing system 100 may include a plurality of computers. The plurality of computers may include a computer B. The computer B may be the same as the computer A. The second information acquisition unit 12 may acquire the second information through the processes (q1) to (q4) shown below.

[0087] (q1) The second information acquisition unit 12 receives the image captured by the second camera 220.

[0088] (q2) The second information acquisition unit 12 sends the image captured by the second camera 220 to the computer B.

[0089] (q3) Computer B executes the image analysis process described above to determine the second information.

[0090] (q4) Computer B sends the determined second information to the second information acquisition unit 12.

[0091] The third information acquisition unit 13 acquires third information about a vehicle C1 present on an escalator E1 related to at least one of the first information or the second information. The third information includes information indicating the presence or absence of the vehicle C1 in the first area A1 or information indicating the presence or absence of the vehicle C1 in the second area A2.

[0092] The third information acquisition unit 13 acquires the third information by acquiring the detection result of the first sensor 21 through wired or wireless communication with the first sensor 21. Here, the third information acquisition unit 13 acquires the third information indicating the presence or absence of the vehicle C1 in the first area A1 by performing appropriate image analysis processing on the image captured by the first camera 210. Similarly, the third information acquisition unit 13 acquires the detection result of the second sensor 22 through wired or wireless communication with the second sensor 22, thereby acquiring the third information. Here, the third information acquisition unit 13 acquires the third information by performing appropriate image analysis processing on the image captured by the second camera 220. The image analysis processing is performed, for example, by a trained model that has completed machine learning so as to output a result indicating the presence or absence of the vehicle C1 for an input image.

[0093] The information providing system 100 may include multiple computers. The multiple computers may include computer C. Computer C may be the same as computer B. Computer C may be the same as computer A. The third information acquisition unit 13 may acquire third information indicating the presence or absence of vehicle C1 in the first area A1 through the processes (r1) to (r4) shown below. "Third information indicating the presence or absence of vehicle C1 in the first area A1" may mean "third information indicating whether or not the first area A1 includes vehicle C1."

[0094] (r1) The third information acquisition unit 13 receives the image captured by the first camera 210.

[0095] (r2) The third information acquisition unit 13 sends the image captured by the first camera 210 to the computer C.

[0096] (r3) The computer C performs the image analysis process described above on the image captured by the first camera 210, and determines third information indicating whether or not the vehicle C1 is present in the first area A1.

[0097] (r4) The computer C sends the third information indicating whether the vehicle C1 is present in the determined first area A1 to the third information acquisition unit 13.

[0098] The information providing system 100 may include multiple computers. The multiple computers may include computer D. Computer D may be the same as computer C. Computer D may be the same as computer B. Computer D may be the same as computer A. The third information acquisition unit 13 may acquire third information indicating the presence or absence of vehicle C1 in the second area A2 through the processes (s1) to (s4) shown below. "Third information indicating the presence or absence of vehicle C1 in the second area A2" may mean "third information indicating whether or not the second area A2 includes vehicle C1."

[0099] (s1) The third information acquisition unit 13 receives the image captured by the second camera 220.

[0100] (s2) The third information acquisition unit 13 sends the image captured by the second camera 220 to the computer D.

[0101] (s3) The computer D performs the image analysis process described above on the image captured by the second camera 220, and determines third information indicating whether or not the vehicle C1 is present in the second area A2.

[0102] (s4) The computer C sends the third information indicating whether the vehicle C1 is present in the determined second area A2 to the third information acquisition unit 13.

[0103] In the first embodiment, the computer (first information acquisition unit 11 and third information acquisition unit 13) acquires the first information and the third information from an image captured by first camera 210 that captures first area A1. In the first embodiment, the computer (second information acquisition unit 12 and third information acquisition unit 13) acquires the second information and the third information from an image captured by second camera 220 that captures second area A2.

[0104] As described above, the third information is related to at least one of the first information and the second information. For example, if the first information indicates that user B1 is in the first area A1, and third information indicating that vehicle C1 is in the first area A1 is acquired simultaneously or almost simultaneously with the acquisition of the first information, the third information is related to the first information. Similarly, if the second information indicates that user B1 is in the second area A2, and third information indicating that vehicle C1 is in the second area A2 is acquired simultaneously or almost simultaneously with the acquisition of the second information, the third information is related to the second information.

[0105] For example, if the image captured by the first camera 210 shows that user B1 is holding a part of vehicle C1 or that user B1 is located near vehicle C1, the third information is related to the first information. Similarly, if the image captured by the second camera 220 shows that user B1 is holding a part of vehicle C1 or that user B1 is located near vehicle C1, the third information is related to the second information. In this way, whether the third information is related to the first information or the second information is determined by the timing of acquiring the information or the positional relationship between user B1 and vehicle C1.

[0106] The first sensor 21 and the second sensor 22 may each be, for example, a tag reader. The tag reader is a device that acquires information stored in an IC (Integrated Circuit) tag, which is a type of RFID (Radio Frequency Identification) tag, by wirelessly communicating with the IC tag.

[0107] The IC tag for the first information or the second information is held by user B1, for example, by being placed in a pocket of user B1's clothes, a bag, etc. The information stored in the IC tag for the first information or the second information does not have to be information that can individually identify user B1, and may simply be information that can be read by a tag reader to identify the person.

[0108] The IC tag T1 for the third information (see FIG. 4) is attached to the handle (grip) of the vehicle C1, for example, and is thereby retained on the vehicle C1. Note that the information stored in the IC tag T1 for the third information does not have to be information that can individually identify the vehicle C1, as long as it can be read by a tag reader to identify the vehicle C1.

[0109] In other words, if the vehicle C1 has an IC tag T1 that records information about the condition of the vehicle C1, the computer (third information acquisition unit 13) acquires the third information by reading information from the IC tag T1 using a tag reader (first tag reader 211 or second tag reader 221 (see Figure 4)).

[0110] Alternatively, the first sensor 21 and the second sensor 22 may each be a sensor that wirelessly communicates with a device such as a smartphone or a wristwatch carried by the user B1. In this case, the first sensor 21 and the second sensor 22 communicate with the device to acquire the identifier of the user B1 stored in the device, thereby detecting the presence or absence of the user B1.

[0111] The determination unit 14 determines a change in the state of the vehicle C1 based on the third information. In the first embodiment, the state of the vehicle C1 includes the presence or absence of the vehicle C1. The determination unit 14 determines a change in the state of the vehicle C1 based on the third information related to the first information and the third information related to the second information.

[0112] Here, the reason why the discrimination unit 14 discriminates a change in the state of the vehicle C1 will be explained using Fig. 3A, Fig. 3B, and Fig. 4. Fig. 3A is a schematic diagram showing an example of erroneous detection of the vehicle C1. Fig. 3B is a schematic diagram showing an example of overlooking the vehicle C1. Fig. 4 is a schematic diagram showing an example of overlooking the vehicle C1 when an IC tag T1 is used.

[0113] 3A, for example, a user B1 of a vehicle C1 may pass near the entrance to the escalator E1 without using the escalator E1. In this case, the first camera 210 (first sensor 21) detects the vehicle C1 passing through the first area A1, but the second camera 220 (second sensor 22) does not detect the vehicle C1 in the second area A2. In other words, the vehicle C1 of the user B1 who does not use the escalator E1 may be mistakenly detected.

[0114] 3B , for example, if another user B2 is present in front of user B1 in vehicle C1, vehicle C1 may be blocked by the other user B2 and enter the blind spot of first camera 210 (first sensor 21). In this case, first camera 210 does not detect vehicle C1 in first area A1, but second camera 220 (second sensor 22) detects vehicle C1 in second area A2. In other words, vehicle C1 of user B1 using escalator E1 will be overlooked in first area A1.

[0115] As shown in FIG. 4 , for example, a vehicle C1 may carry an IC tag T1 and a metal baggage C11. In this case, if a first tag reader 211 (first sensor 21) is installed under the floor in the first area A1, wireless communication between the first tag reader 211 and the IC tag T1 is blocked by the baggage C11, and the first tag reader 211 does not detect the vehicle C1 in the first area A1. On the other hand, if a second tag reader 221 (second sensor 22) is installed on the ceiling in the second area A2, wireless communication between the second tag reader 221 and the IC tag T1 is not blocked by the baggage C11, and the second tag reader 221 detects the vehicle C1 in the second area A2. In other words, the vehicle C1 of user B1 using the escalator E1 will be overlooked in the first area A1.

[0116] The discrimination unit 14 determines a change in the state of the vehicle C1 in consideration of the possibility of the above-described situation occurring. Specifically, the discrimination unit 14 determines the change in the state of the vehicle C1 as one of the following first to fourth discrimination results. In any case, it is assumed that the first information indicates that the user B1 is present in the first area A1, and the second information indicates that the user B1 is present in the second area A2.

[0117] FIG. 5 is a schematic diagram showing an example of discrimination by the discrimination unit 14 according to the first embodiment. As shown in FIG. 5( a), the first discrimination result indicates that the vehicle C1 is detected in the first area A1 but not in the second area A2. As shown in FIG. 5( b), the second discrimination result indicates that the vehicle C1 is not detected in the first area A1 but is detected in the second area A2. As shown in FIG. 5( c), the third discrimination result indicates that the vehicle C1 is detected in both the first area A1 and the second area A2. Although not shown, the fourth discrimination result indicates that the vehicle C1 is not detected in either the first area A1 or the second area A2.

[0118] The notification content determination unit 15 determines the notification content based on the change in the state of the vehicle C1 determined by the determination unit 14. Specifically, the notification content determination unit 15 determines the notification content by comparing the determination result by the determination unit 14 with the notification content database DB1.

[0119] Fig. 6 is a diagram showing an example of the notification content database DB1 according to the first embodiment. As shown in Fig. 6, in the notification content database DB1, the presence or absence of the vehicle C1 in each of the first area A1 and the second area A2 (i.e., the determination result by the determination unit 14) is associated with a notification message, a warning sound, and the number of announcements. The notification message is a message output as sound from the speaker 3 or a message displayed as a character string or the like on the display 4. The warning sound is a sound emitted together with the notification message. The number of announcements is the number of times the notification message is output.

[0120] In the example shown in Fig. 6, "First area: vehicle present, second area: no vehicle" in the second line corresponds to the first determination result, "first area: no vehicle, second area: vehicle present" in the third line corresponds to the second determination result, and "first area: vehicle present, second area: vehicle present" in the fourth line corresponds to the third determination result. Note that if the determination result by the determination unit 14 is the fourth determination result, user B1 of vehicle C1 is not present, and therefore no attention is given to user B1. In other words, the notification content determination unit 15 determines the notification content to be no notification.

[0121] For example, when the determination result by the determination unit 14 is the first determination result, the notification content determination unit 15 determines the notification content to output a notification message stating "Using wheelchairs and strollers on escalators is extremely dangerous," to emit a low-volume (weak) warning sound, and to output the notification message one or more times. When the determination result by the determination unit 14 is the second determination result, the notification content determination unit 15 determines the notification content to be more alert than when the determination result is the first determination result. Furthermore, when the determination result by the determination unit 14 is the third determination result, the notification content determination unit 15 determines the notification content to be more alert than when the determination result is the second determination result. In this way, the higher the probability that a vehicle C1 is present on the escalator E1, the more the notification content determination unit 15 determines the notification content to be more alert.

[0122] The output unit 16 outputs notification information indicating the notification content determined by the notification content determination unit 15. In the first embodiment, the output unit 16 outputs the notification information by outputting a notification message having the content determined by the notification content determination unit 15 as sound via the speaker 3 and displaying it on the display 4. The output unit 16 outputs the notification information by outputting a warning sound having an intensity determined by the notification content determination unit 15 via the speaker 3. The output of the warning sound may be simultaneous with the output of the notification message, or may be before or after the output of the notification message. The output unit 16 outputs the notification information by outputting the notification message and the warning sound the number of times determined by the notification content determination unit 15.

[0123] For example, when the output unit 16 detects a user B1 in the first area A1, the output unit 16 calculates the timing at which the user B1 will reach the second area A2 from the operating speed of the escalator E1, and outputs notification information at the calculated timing. Additionally, when the output unit 16 detects the same user B1 in the second area A2 as the user B1 detected in the first area A1, the output unit 16 may output notification information at the timing of detection in the second area A2.

[0124] The output unit 16 may display an image of the user B1, who is the target of the notification message, captured by the first camera 210 (or the second camera 220) along with the character string of the notification message on the display 4. In this case, the user B1 can more easily notice that notification information has been output to him / her, and the effect of the alert can be further enhanced.

[0125] If a speaker 3 is installed near the exit of the escalator E1, the output unit 16 may output the notification information through the speaker 3. Similarly, if a display 4 is installed near the exit of the escalator E1, the output unit 16 may output the notification information through the display 4. The output unit 16 may also display a warning light on the display 4.

[0126] 3. Operation An example of operation of the information providing system 100 according to the first embodiment will be described below with reference to Fig. 7. Fig. 7 is a flowchart showing an example of the overall flow of processing of the information providing system 100 according to the first embodiment.

[0127] First, the first information acquisition unit 11 acquires the first information by acquiring the detection result of the first sensor 21 (step S101). Here, the first information acquisition unit 11 acquires the first information indicating that the user B1 is present in the first area A1 of the escalator E1.

[0128] The second information acquisition unit 12 acquires the second information by acquiring the detection result of the second sensor 22 (step S102). Here, the second information acquisition unit 12 acquires the second information indicating that the user B1 is present in the second area A2 of the escalator E1.

[0129] The third information acquisition unit 13 acquires the third information when the first information acquisition unit 11 acquires the first information, and acquires the third information when the second information acquisition unit 12 acquires the second information (step S103). Here, the third information acquisition unit 13 acquires the third information including information indicating the presence or absence of the vehicle C1 in the first area A1 of the escalator E1 and information indicating the presence or absence of the vehicle C1 in the second area A2 of the escalator E1.

[0130] Next, the determination unit 14 determines a change in the state of the vehicle C1 based on the third information (step S104). Here, the determination unit 14 determines the change in the state of the vehicle C1 as one of the first to fourth determination results based on the presence or absence of the vehicle C1 in the first area A1 of the escalator E1 and the presence or absence of the vehicle C1 in the second area A2 of the escalator E1.

[0131] Next, the notification content determination unit 15 determines the notification content based on the change in the state of the vehicle C1 determined by the determination unit 14 (step S105). Here, the notification content determination unit 15 determines the notification content according to the first to third determination results by referring to the notification content database DB1. Note that when the determination result by the determination unit 14 is the fourth determination result, the notification content determination unit 15 determines the notification content to be no notification.

[0132] Then, the output unit 16 outputs notification information indicating the notification content determined by the notification content determination unit 15 (step S106). Here, the output unit 16 outputs the notification information by outputting the notification message of the content determined by the notification content determination unit 15 as voice together with a warning sound via the speaker 3 and displaying it on the display 4.

[0133] In this way, in the first embodiment, when user B1 uses the escalator E1, it is possible to notify user B1 in accordance with changes in the state of vehicle C1. Therefore, in the first embodiment, it is possible to easily issue a warning that is tailored to the manner in which user B1 uses vehicle C1. Specifically, when user B1 uses the escalator E1, the higher the probability that vehicle C1 is on the escalator E1, the more urging the warning that can be issued to user B1.

[0134] For example, if user B1 is simply passing by the entrance of escalator E1 but is not actually using escalator E1, limiting the notification content to a general warning will reduce the discomfort to other users B2. For example, even if vehicle C1 is missed at the entrance of escalator E1, if vehicle C1 is detected at the exit of escalator E1, a warning can be issued to user B1 of vehicle C1. Furthermore, if vehicle C1 is detected at both the entrance and exit of escalator E1, a warning equivalent to a warning can be issued to user B1 of vehicle C1.

[0135] Incidentally, in order to detect the vehicle C1 without missing it in at least one of the first area A1 or the second area A2 of the escalator E1, the first sensor 21 and the second sensor 22 may be installed as shown in Figures 8A to 8D, for example.

[0136] 8A is a schematic diagram showing a first installation example of the first sensor 21 and the second sensor 22 according to embodiment 1. In the first installation example, the first sensor 21 and the second sensor 22 are both installed on the ceiling. The first sensor 21 is installed in an orientation that captures user B1 and vehicle C1 present in the first area A1 of the escalator E1 from the front, and the second sensor 22 is installed in an orientation that captures user B1 and vehicle C1 present in the second area A2 of the escalator E1 from the back.

[0137] 8B is a schematic diagram showing a second installation example of the first sensor 21 and the second sensor 22 according to embodiment 1. In the second installation example, the first sensor 21 and the second sensor 22 are both installed on the ceiling. The first sensor 21 is installed in an orientation that captures user B1 and vehicle C1 present in the first area A1 of the escalator E1 from behind, and the second sensor 22 is installed in an orientation that captures user B1 and vehicle C1 present in the second area A2 of the escalator E1 from the front.

[0138] 8C is a schematic diagram showing a third installation example of the first sensor 21 and the second sensor 22 according to embodiment 1. In the third installation example, both the first sensor 21 and the second sensor 22 are installed on the ceiling. When looking vertically down at the escalator E1 from the ceiling, the first sensor 21 is installed so that the angle between the traveling direction D1 of the escalator E1 and the detection direction of the first sensor 21 is θ, and the second sensor 22 is installed so that the angle between the traveling direction D1 and the detection direction of the second sensor 22 is θ+180 degrees.

[0139] 8D is a schematic diagram showing a fourth installation example of the first sensor 21 and the second sensor 22 according to embodiment 1. In the fourth installation example, the first sensor 21 is installed under the floor, and the second sensor 22 is installed on the ceiling. When the escalator E1 is viewed horizontally from the side, the first sensor 21 is installed so that the angle between the floor surface and the detection direction of the first sensor 21 is θ, and the second sensor 22 is installed so that the angle between the floor surface and the detection direction of the second sensor 22 is θ+180 degrees.

[0140] In this way, the computer (third information acquisition unit 13) may acquire the third information by detecting the first area A1 from a first direction using the first sensor 21, and may acquire the third information by detecting the second area A2 from a second direction using the second sensor 22. The first direction and the second direction are different directions. This increases the probability of detecting the vehicle C1 in the other area even if the vehicle C1 cannot be detected in either the first area A1 or the second area A2, thereby reducing the probability of overlooking the vehicle C1.

[0141] (Embodiment 2) The information provision system 100 according to embodiment 2 differs from the information provision system 100 according to embodiment 1 in that the determination unit 14 determines a change in the state of the vehicle C1, including a change in the shape of the vehicle C1. That is, in embodiment 2, the change in the state of the vehicle C1 includes a change in the shape of the vehicle C1. In particular, in embodiment 2, the change in the shape of the vehicle C1 is a change in the shape due to the vehicle C1 being folded.

[0142] 9 is a schematic diagram showing an example of changes in the shape of the vehicle C1 according to embodiment 2. As shown in FIG. 9, the vehicle C1 (here, a stroller) can be in two states: an "open" state before being folded, and a "closed" state after being folded.

[0143] For example, when user B1 is not using escalator E1, he basically places baby B11 or luggage C11 in vehicle C1 by keeping vehicle C1 in the "open" position. When using escalator E1, user B1 (here, a well-behaved user B1) holds baby B11 or luggage C11 in his hands, folds vehicle C1 to the "closed" position, and then uses escalator E1.

[0144] In the second embodiment, the third information acquisition unit 13 acquires, as the third information, information indicating whether the vehicle C1 in the first area A1 is in the "open" state or the "closed" state by performing an appropriate image analysis process on the image captured by the first camera 210 that captures the first area A1. The third information acquisition unit 13 acquires, as the third information, information indicating whether the vehicle C1 in the second area A2 is in the "open" state or the "closed" state by performing an appropriate image analysis process on the image captured by the second camera 220 that captures the second area A2. In other words, the third information includes fourth information indicating the shape of the vehicle C1 at the time when the first information was acquired and fifth information indicating the shape of the vehicle C1 at the time when the second information was acquired.

[0145] The information providing system 100 may include multiple computers. The multiple computers may include computer E. Computer E may be the same as computer B. Computer E may be the same as computer A. The third information acquisition unit 13 may acquire third information indicating whether the vehicle C1 in the first area A1 is in the "open" state or the "closed" state through the processes (t1) to (t4) described below.

[0146] (t1) The third information acquisition unit 13 receives the image captured by the first camera 210.

[0147] (t2) The third information acquisition unit 13 sends the image captured by the first camera 210 to the computer E.

[0148] (t3) Computer E performs the above-mentioned image analysis processing on the image captured by the first camera 210 and determines third information indicating whether the vehicle C1 in the first area A1 is in the "open" state or the "closed" state.

[0149] (t4) The computer E sends the third information indicating whether the vehicle C1 in the determined first area A1 is in the "open" state or the "closed" state to the third information acquisition unit 13.

[0150] The information providing system 100 may include multiple computers. The multiple computers may include computer F. Computer F may be the same as computer E. Computer F may be the same as computer B. Computer E may be the same as computer A. The third information acquisition unit 13 may acquire third information indicating whether the vehicle C1 in the second area A2 is in the "open" state or the "closed" state through the processes (u1) to (u4) described below.

[0151] (u1) The third information acquisition unit 13 receives the image captured by the second camera 220.

[0152] (u2) The third information acquisition unit 13 sends the image captured by the second camera 220 to the computer E.

[0153] (u3) The computer F performs the above-mentioned image analysis processing on the image captured by the second camera 220 and determines third information indicating whether the vehicle C1 in the second area A2 is in the "open" state or the "closed" state.

[0154] (u4) The computer F sends the third information indicating whether the vehicle C1 in the determined second area A2 is in the "open" state or the "closed" state to the third information acquisition unit 13.

[0155] Here, there may be cases where the vehicle C1 is not completely folded and it is difficult to determine whether the vehicle C1 is in the "open" state or the "closed" state. In this case, the third information acquisition unit 13 may acquire the fourth information or the fifth information as information indicating that the vehicle C1 is in the "closed" state if the baby B11 and the luggage C11 are not loaded in the vehicle C1. In this case, the third information acquisition unit 13 may acquire the fourth information or the fifth information as information indicating that the vehicle C1 is in the "closed" state if the distance between the front and rear wheels of the vehicle C1 is smaller than the width of the step of the escalator E1 and the front and rear wheels of the vehicle C1 are in contact with one step of the escalator E1.

[0156] The third information acquisition unit 13 may acquire the fourth information and the fifth information by reading information from the IC tag T1 attached to the vehicle C1 using a tag reader (the first tag reader 211 or the second tag reader 221). In this case, the fourth information and the fifth information need to be stored in the IC tag T1 using, for example, a configuration such as that shown in FIG. 10 .

[0157] 10 is a block diagram showing an example of a configuration for detecting a change in the state of a vehicle C1 using an IC tag T1 according to the second embodiment. As shown in FIG. 10, the vehicle C1 is provided with a detection circuit C12 electrically connected to the IC tag T1. The detection circuit C12 has, for example, a microswitch that turns on / off depending on whether the vehicle C1 is in an "open" state or a "closed" state. The detection result of the microswitch by the detection circuit C12, i.e., information (fourth information and fifth information) indicating whether the vehicle C1 is in an "open" state or a "closed" state, is written to the IC tag T1.

[0158] In the second embodiment, when the discrimination result is the third discrimination result, the discrimination unit 14 further discriminates the change in the state of the vehicle C1 into the following fifth to eighth discrimination results. FIG. 11 is a schematic diagram showing an example of discrimination by the discrimination unit 14 according to the second embodiment. The fifth discrimination result, not shown, is a result indicating that the vehicle C1 is in the "closed" state in both the first area A1 and the second area A2. The sixth discrimination result, as shown in FIG. 11( a), is a result indicating that the vehicle C1 is in the "open" state in the first area A1 and the "closed" state in the second area A2. The seventh discrimination result, as shown in FIG. 11( b), is a result indicating that the vehicle C1 is in the "closed" state in the first area A1 and the "open" state in the second area A2. The eighth discrimination result, as shown in FIG. 11( c), is a result indicating that the vehicle C1 is in the "open" state in both the first area A1 and the second area A2.

[0159] In the second embodiment, when the discrimination result by the discrimination unit 14 is any one of the fifth to eighth discrimination results, the notification content determination unit 15 determines the notification content by comparing it with the notification content database DB1 shown in FIG. 12 .

[0160] Fig. 12 is a diagram illustrating an example of a notification content database DB1 according to Embodiment 2. In the notification content database DB1 illustrated in Fig. 12, the shape of the vehicle C1 in each of the first area A1 and the second area A2 is associated with a notification message, a warning sound, and the number of announcements.

[0161] 12, "first area: closed, second area: closed" in the second line corresponds to the fifth discrimination result, "first area: open, second area: closed" in the third line corresponds to the sixth discrimination result, "first area: closed, second area: open" in the fourth line corresponds to the seventh discrimination result, and "first area: open, second area: open" in the fifth line corresponds to the eighth discrimination result.

[0162] For example, when the determination result by the determination unit 14 is the fifth determination result, the notification content determination unit 15 determines the notification content to output a notification message thanking the user for observing manners, saying, "Thank you for your cooperation in ensuring safe use," to emit a low (weak) warning sound, and to output the notification message one or more times. When the determination result by the determination unit 14 is the sixth determination result, the notification content determination unit 15 determines the notification content to alert the user B1. When the determination result by the determination unit 14 is the seventh determination result, the notification content determination unit 15 determines the notification content to alert the user B1 more strongly than when the determination result is the sixth determination result. Furthermore, when the determination result by the determination unit 14 is the eighth determination result, the notification content determination unit 15 determines the notification content to alert the user B1 more strongly than when the determination result is the seventh determination result. In this way, the notification content determination unit 15 determines the notification content to alert the user B1 more strongly as the probability that the vehicle C1 is in the "open" state when the escalator E1 is used increases.

[0163] An example of the operation of the information provision system 100 according to the second embodiment will be described below with reference to Fig. 13. Fig. 13 is a flowchart showing an example of a part of the processing of the information provision system 100 according to the second embodiment. Here, the description will be made assuming that the third information acquisition unit 13 has acquired third information indicating that the vehicle C1 is present in both the first area A1 and the second area A2.

[0164] The third information acquisition unit 13 acquires the fourth information by acquiring the detection result of the first sensor 21 (step S201).The third information acquisition unit 13 acquires the fifth information by acquiring the detection result of the second sensor 22 (step S202).

[0165] Next, the discrimination unit 14 discriminates a change in the state of the vehicle C1 based on the fourth information and the fifth information (step S203). Here, the discrimination unit 14 discriminates the change in the state of the vehicle C1 as one of the fifth to eighth discrimination results based on the shape of the vehicle C1 in the first area A1 of the escalator E1 and the shape of the vehicle C1 in the second area A2 of the escalator E1.

[0166] Next, the notification content determination unit 15 determines the notification content based on the change in the state of the vehicle C1 determined by the determination unit 14 (step S204). Here, the notification content determination unit 15 determines the notification content according to the fifth to eighth determination results by referring to the notification content database DB1 shown in FIG.

[0167] Then, the output unit 16 outputs notification information indicating the notification content determined by the notification content determination unit 15 (step S205). Here, the output unit 16 outputs the notification information by outputting the notification message of the content determined by the notification content determination unit 15 as voice together with a warning sound via the speaker 3 and displaying it on the display 4.

[0168] In this way, in the second embodiment, when user B1 uses the escalator E1, it is possible to notify user B1 in accordance with changes in the shape of the vehicle C1. Therefore, in the second embodiment, it is possible to more easily issue a warning tailored to the manner in which user B1 uses the vehicle C1. Specifically, when user B1 uses the escalator E1, the higher the probability that the vehicle C1 will be in the "open" state, the more rigorous the warning that can be issued to user B1.

[0169] Note that even if vehicle C1 is not detected in the first area A1 but is detected in the second area A2, it is possible to alert user B1 based on the shape of vehicle C1. For example, assume that the third information acquisition unit 13 acquires the fifth information by acquiring the detection result of the second sensor 22. In this case, if the fifth information indicates that vehicle C1 is in the "open" state, the notification content determination unit 15 determines the notification content to alert user B1, assuming that there is a high probability that vehicle C1 will be in the "open" state when using the escalator E1. On the other hand, if the fifth information indicates that vehicle C1 is in the "closed" state, the notification content determination unit 15 determines the notification content to thank user B1 for observing proper etiquette.

[0170] (Embodiment 3) The information providing system 100 according to embodiment 3 differs from the information providing system 100 according to embodiment 1 in that the notification content determination unit 15 determines the notification content according to the characteristics of the user B1 or the vehicle C1. That is, the computer (information providing system 100) further acquires characteristic information indicating the characteristics of at least one of the user (person) B1 or the vehicle C1. Then, the notification content is determined based on the characteristic information.

[0171] First to fourth examples of the characteristic information are listed below. The first to fourth examples shown below may be combined as appropriate.

[0172] In the first example, the feature information includes at least one of information about the clothing of the user (person) B1 and information about the type of vehicle C1. FIG. 14 is a diagram illustrating an example of feature information according to the first example of embodiment 3. In the example illustrated in FIG. 14, the feature information includes information indicating that the color of the clothing of the user B1 is yellow (clothes_color: yellow) and information indicating that the type of vehicle C1 is a stroller (cart_type: stroller). The feature information illustrated in the first example can be acquired, for example, by performing appropriate image analysis processing on an image captured by the first camera 210 or the second camera 220. In the example illustrated in FIG. 14, the output unit 16 outputs from the speaker 3 a voice message with the notification content, "The person over there pushing the stroller wearing yellow clothing."

[0173] The notification content is determined as follows. That is, in a first example, when the determination result by the determination unit 14 is any one of the first to third determination results, the notification content determination unit 15 determines the notification content by comparing the result with the notification content database DB1 shown in Fig. 15A. Fig. 15A is a diagram showing an example of the notification content database DB1 according to a first example of embodiment 3. The notification content database DB1 shown in Fig. 15A is the same as the notification content database DB1 shown in Fig. 6 except that the notification message further includes a call-out message.

[0174] The notification content determination unit 15 determines the content of the call message by comparing the acquired status information with the call content database shown in FIG. 15B . FIG. 15B is a diagram showing an example of the call content database according to the first example of embodiment 3. As shown in FIG. 15B , in the call content database, status information (the color of user B1's clothing or the type of vehicle C1) is associated with the call message. For example, if acquired status information indicates that user B1's clothing is blue and the type of vehicle C1 is a wheelchair, the notification content determination unit 15 determines the content of the call message to be a message reading, "Hey, the person over there wearing blue clothes pushing the wheelchair."

[0175] The characteristic information may include information about the gender or race of the user B1. In this case, the notification content determination unit 15 may determine the content of the call message based on the gender or race of the user B1.

[0176] In the second example, the characteristic information includes related person information about related persons of the user (person) B1. The notification content is determined based on the related person information. The related person here is, for example, the spouse, parent, relative, or friend of the user B1, who is accompanying the user B1.

[0177] The related person information can be acquired, for example, by performing appropriate image analysis processing on the image captured by the first camera 210 or the second camera 220. More specifically, if a person standing near user B1, talking to user B1, facing toward user B1, holding baby B11, or exchanging something with user B1 is recognized in the captured image, for example, by pattern matching, the computer (information provision system 100) acquires related person information indicating that the person is a related person. Note that if there are no people in front of or behind user B1 in the captured image, the computer (information provision system 100) acquires related person information indicating that no related person exists.

[0178] The notification content is determined as follows. That is, in the second example, when the determination result by the determination unit 14 is any one of the first to third determination results, the notification content determination unit 15 determines the content of the notification message by comparing the acquired related person information with the notification content database DB1 shown in FIG. 16. FIG. 16 is a diagram showing an example of the notification content database DB1 according to the second example of the third embodiment. The notification content database DB1 shown in FIG. 16 is the same as the notification content database DB1 shown in FIG. 6 except that the number of user B1 and related people is associated with the notification message. Note that the example shown in FIG. 16 illustrates a notification message corresponding to the first determination result.

[0179] For example, if the related party information indicates that there are no related parties, that is, if the number of user B1 and related parties is one, the notification content determination unit 15 determines the content of the notification message to be a message that includes a message urging assistance, such as "If you need assistance, please call an attendant." On the other hand, if the related party information indicates that there are related parties, that is, if the number of user B1 and related parties is two or more, the notification content determination unit 15 determines the content of the notification message to be a message that excludes the message urging assistance.

[0180] An example of the operation of the information providing system 100 when acquiring feature information of the first or second example will be described below with reference to Fig. 17. Fig. 17 is a flowchart showing an example of a part of the processing of the information providing system 100 according to the first and second examples of embodiment 3. Note that the processing that is the same as that of the information providing system 100 according to embodiment 1 will not be described here.

[0181] The computer (information providing system 100) acquires feature information by performing appropriate image analysis processing on the image captured by the first camera 210 or the second camera 220 (step S301).

[0182] Next, the notification content determination unit 15 determines the notification content based on the characteristic information (step S302). Here, when the characteristic information shown in the first example is acquired, the notification content determination unit 15 determines the notification content by referring to the notification content database DB1 shown in Fig. 15A and the call content database shown in Fig. 15B. When the characteristic information (related person information) shown in the second example is acquired, the notification content determination unit 15 determines the notification content by referring to the notification content database DB1 shown in Fig. 16.

[0183] Then, the output unit 16 outputs notification information indicating the notification content determined by the notification content determination unit 15 (step S303). Here, the output unit 16 outputs the notification information by outputting the notification message of the content determined by the notification content determination unit 15 as voice together with a warning sound via the speaker 3 and displaying it on the display 4.

[0184] In this way, in the first example of the third embodiment, by providing a notification according to the characteristics of the user B1 or the vehicle C1, the user B1 can easily notice the warning, and the effectiveness of the warning can be further enhanced. In the second example of the third embodiment, by providing a warning according to the number of the user B1 and related persons, the effectiveness of the warning can be further enhanced.

[0185] In addition, if user B1 possesses an IC tag and characteristic information is stored in the IC tag, the computer (information provision system 100) can obtain the characteristic information by communicating with the IC tag using a tag reader (first tag reader 211 or second tag reader 221).

[0186] In this case, for example, if the IC tag contains information indicating the name of user B1, the notification content determination unit 15 may determine the content of the call message to be a message including the name of user B1. Specifically, if user B1's name is "Suzuki," the notification content determination unit 15 determines the content of the call message to be a message saying "Mr. Suzuki." For example, if the IC tag contains information indicating user B1's address, the notification content determination unit 15 may determine the content of the call message to be a message including user B1's address. Specifically, if user B1's address is in Koto Ward, Tokyo, the notification content determination unit 15 determines the content of the call message to be a message saying "Calling from Koto Ward, Tokyo."

[0187] In the third example, the characteristic information further includes status information indicating the status of user (person) B1. Then, the notification information is output from at least one of the speaker 3 and the display 4 based on the status information. Here, the status of user B1 may include not only the status of user B1 himself / herself but also the status of people riding in the vehicle C1 used by user B1.

[0188] For example, the status information includes at least one of information indicating the wakefulness or sleep state of a person riding in the vehicle C1, or information indicating the visual or auditory state of the user B1. That is, the status information may include information indicating whether a person riding in the vehicle C1 (e.g., baby B11) is awake or asleep. The status information may include information indicating that the user B1 is not paying attention to the road ahead, for example, by looking at a smartphone, or information indicating that the user B1 is not paying attention to surrounding sounds, for example, by wearing headphones. The status information can be obtained, for example, by performing appropriate image analysis processing on images captured by the first camera 210 or the second camera 220.

[0189] The notification content is determined as follows. That is, in the third example, the notification content determination unit 15 determines the output destination of the notification information by comparing the acquired status information with the notification content database DB1 shown in Fig. 18. The notification content database DB1 shown in Fig. 18 is the same as the notification content database DB1 shown in Fig. 6 except that the status information and the output destination of the notification information are associated with each other. Note that the example shown in Fig. 18 illustrates the correspondence relationship between the status information and the output destination of the notification information.

[0190] For example, if the status information indicates that a passenger in the vehicle C1 (baby B11) is sleeping, the notification content determination unit 15 determines the output destination of the notification information to be the display 4. This is to avoid waking up the baby B11 by outputting sound from the speaker 3. For example, if the status information indicates that a passenger in the vehicle C1 is awake and that the user B1 is wearing headphones, the notification content determination unit 15 determines the output destination of the notification information to be the display 4. This is because it is considered that the user B1 is not aware of surrounding sounds. For example, if the status information indicates that a passenger in the vehicle C1 is awake and that the user B1 is looking at his / her smartphone, the notification content determination unit 15 determines the output destination of the notification information to be the speaker 3. This is because it is considered that the user B1 is not paying attention to the road ahead.

[0191] An example of the operation of the information providing system 100 when acquiring feature information (status information) of the third example will be described below with reference to Fig. 19. Fig. 19 is a flowchart showing an example of a part of the processing of the information providing system 100 according to the third example of embodiment 3. Note that the processing that is the same as that of the information providing system 100 according to embodiment 1 will not be described here.

[0192] The computer (information providing system 100) acquires status information by performing appropriate image analysis processing on the image captured by the first camera 210 or the second camera 220 (step S311).

[0193] Next, the notification content determination unit 15 determines the output destination of the notification information based on the status information (step S312). Here, the notification content determination unit 15 determines the output destination of the notification information by referring to the notification content database DB1 shown in FIG.

[0194] Then, the output unit 16 outputs the notification information from the output destination determined by the notification content determination unit 15 (step S313). Here, if the output destination determined by the notification content determination unit 15 includes the speaker 3, the output unit 16 outputs the notification information by outputting a notification message of the content determined by the notification content determination unit 15 as audio together with a warning sound via the speaker 3. If the output destination determined by the notification content determination unit 15 includes the display 4, the output unit 16 outputs the notification information by displaying the notification message of the content determined by the notification content determination unit 15 on the display 4.

[0195] In this way, in the third example of the third embodiment, by providing a notification according to the state of user B1, user B1 is more likely to notice the warning, and the effectiveness of the warning can be further enhanced.

[0196] In the fourth example, the characteristic information includes language information about a language that user (person) B1 can understand. The notification content is determined based on the language information. In the fourth example, the language information is stored, for example, in an IC tag carried by user B1. The computer (information providing system 100) can acquire the language information by communicating with the IC tag using a tag reader (first tag reader 211 or second tag reader 221).

[0197] The notification content is determined as follows. That is, in the fourth example, the notification content determination unit 15 determines the notification content to be a notification message expressed in a language that user B1 can understand, based on the acquired language information. For example, if the language information indicates English, the notification content determination unit 15 determines the notification content to be a notification message expressed in English. Details will be described in embodiment 4.

[0198] In this way, in the fourth example of the embodiment, by providing notifications in a language that user B1 can understand, user B1 is more likely to notice the warning, and the effectiveness of the warning can be further enhanced.

[0199] (Embodiment 4) An information provision system 100 according to embodiment 4 is a system for issuing warnings to a user B1 (a tourist) in cooperation with a rental service that rents wheelchairs or strollers mainly to tourists from overseas, for example, at an airport, etc. Specifically, when a user B1 of a vehicle C1, such as a wheelchair or stroller with an IC tag, rented in a rental area operated by the rental service, uses an escalator E1, the information provision system 100 issues a warning in a language that the user B1 can understand.

[0200] In other words, vehicle C1 is a rental vehicle, and the characteristic information includes the rental vehicle's identifier (here, vehicle ID). The notification content is determined based on user information about user B1 who is renting the rental vehicle corresponding to the rental vehicle's identifier. In embodiment 4, the user information includes at least one of passport information about user B1, including nationality, and rental registration information about user B1 that was registered when the rental vehicle was rented.

[0201] FIG. 20 is a schematic diagram illustrating an example of a rental area for a vehicle C1 according to the fourth embodiment. In the example shown in FIG. 20 , one wheelchair serving as the vehicle C1 and two strollers serving as the vehicle C1 are secured in the rental area by chains with locks K1. A user B1 can unlock the lock K1 of the vehicle C1 he or she wishes to use by operating an operation terminal 5 installed in the rental area. Specifically, for example, the user B1 can unlock the lock K1 of the vehicle C1 by inputting a four-digit vehicle ID, which is the identification number of the vehicle C1, into the touch panel 51 of the operation terminal 5 and having the passport carried by the user B1 read by the passport reader 52. This allows the user B1 to take the vehicle C1, whose lock K1 has been unlocked, out of the rental area and temporarily use the vehicle C1.

[0202] 21 is a schematic diagram showing an example of a usage environment of information provision system 100 according to embodiment 4. In embodiment 4, a first tag reader 211 having a detection range covering a first area A1 of escalator E1 is further installed as first sensor 21. A second tag reader 221 having a detection range covering a second area A2 of escalator E1 is further installed as second sensor 22. Both first tag reader 211 and second tag reader 221 wirelessly communicate with an IC tag C1 attached to vehicle C1 to read information stored in the IC tag C1.

[0203] 22 is a block diagram showing an example of the functional configuration of an information provision system 100 and an operation terminal 5 according to embodiment 4. In embodiment 4, the information provision system 100 further includes a communication unit 17 that performs wired or wireless communication with the communication unit 53 of the operation terminal 5. In addition to the notification content database DB1, the information provision system 100 further includes a message text database DB2 and a nationality-language database DB3. The operation terminal 5 includes the above-mentioned communication unit 53, a rental database DB4, a user database DB5, and a vehicle database DB6.

[0204] Fig. 23A is a diagram showing an example of a notification content database DB1 according to embodiment 4. In embodiment 4, notification content database DB1 differs from notification content database DB1 shown in Fig. 6 of embodiment 1 in that notification message IDs are stored in place of notification messages. The notification content determination unit 15 obtains the notification message ID by comparing the determination result by the determination unit 14 with the notification content database DB1.

[0205] 23B is a diagram showing an example of a message text database DB2 according to embodiment 4. Message text database DB2 stores messages with the same content written in various languages ​​for each notification message ID. The notification content determination unit 15 compares the notification message ID and language information with the message text database DB2 to determine the message text expressed in the language included in the language information.

[0206] 23C is a diagram showing an example of the nationality-language database DB3 according to Embodiment 4. The nationality-language database DB3 stores nationalities in association with language information about languages ​​that people of that nationality can understand.

[0207] 23D is a diagram showing an example of a rental database DB4 according to embodiment 4. The rental database DB4 stores the passport ID attached to the passport held by user B1 and the vehicle ID attached to the rented vehicle C1 in association with each other. In other words, the rental database DB4 stores rental registration information.

[0208] 23E is a diagram showing an example of user database DB5 according to embodiment 4. User database DB5 stores information read from a passport by passport reader 52 of operation terminal 5, namely, a passport ID, the name and nationality of user B1, and a file of a facial photograph of user B1, in association with each other. In other words, user database DB5 stores passport information.

[0209] 23F is a diagram showing an example of a vehicle database DB6 according to embodiment 4. The vehicle database DB6 stores a vehicle ID, a type of the vehicle C1, and a model number of the vehicle C1 in association with each other.

[0210] An example of the operation of the information providing system 100 according to the fourth embodiment will be described below with reference to Fig. 24. Fig. 24 is a flowchart showing an example of the processing of the information providing system 100 according to the fourth embodiment.

[0211] First, the computer (information provision system 100) acquires the vehicle ID by communicating with the IC tag T1 attached to the vehicle C1 used by user B1 using a tag reader (first tag reader 211 or second tag reader 221) (step S401).

[0212] Next, the notification content determination unit 15 checks whether the acquired vehicle ID is included in the rental database DB4 by comparing the acquired vehicle ID with the rental database DB4 (step S402). If the vehicle ID is included in the rental database DB4 (step S402: Yes), the notification content determination unit 15 acquires a passport ID corresponding to the vehicle ID, and further checks the acquired passport ID with the user database DB5 to acquire nationality information regarding the nationality of user B1 (step S403).

[0213] Next, the notification content determination unit 15 compares the acquired nationality information with the nationality-language database DB3 to acquire language information related to a language that the user B1 can understand (step S404). If the vehicle ID is not included in the rental database DB4 (step S402: No), the notification content determination unit 15 acquires the language information as "Japanese" (step S405).

[0214] Next, the notification content determination unit 15 acquires a notification message ID by comparing the determination result by the determination unit 14 with the notification content database DB1 (step S406).The notification content determination unit 15 then acquires a notification message ID and language information by comparing the acquired notification message ID and language information with the message text database DB2, thereby determining a message text expressed in the language included in the language information (step S407).

[0215] Then, the output unit 16 outputs notification information indicating the notification content determined by the notification content determination unit 15 (step S303). Here, the output unit 16 outputs the notification information by outputting the message text of the content determined by the notification content determination unit 15 as voice together with a warning sound via the speaker 3 and displaying it on the display 4.

[0216] In this way, in the fourth embodiment, by providing notifications in a language that user B1 can understand, user B1 is more likely to notice the warning, and the effectiveness of the warning can be further enhanced.

[0217] In the fourth embodiment, an example has been described in which the rental database DB4 is included in the operation terminal 5 of the rental area, but this is not limited to this. For example, if the operation terminal 5 has a function for writing information to the IC tag T1, the vehicle ID and nationality information regarding the nationality of the user B1 may be recorded on the IC tag T1 attached to the vehicle C1 to be rented, based on the passport information read by the passport reading unit 52. In this case, the information providing system 100 may directly acquire the nationality information of the user B1 from the IC tag T1 by communicating with the IC tag T1 using a tag reader (the first tag reader 211 or the second tag reader 221).

[0218] In the fourth embodiment, the flow of acquiring the vehicle ID from the IC tag T1 and acquiring the nationality information using the vehicle ID has been described, but the present invention is not limited to this. For example, the notification content determination unit 15 may acquire the nationality information of the user B1 by identifying the user B1 by comparing the facial image of the user B1 included in the first information or the second information with a facial photograph of the user B1 registered in the user database DB5.

[0219] In the fourth embodiment, the message text may reflect the type or model number of the vehicle C1. For example, instead of the message text "Wheelchairs and strollers may be used on escalators..." in the message text database DB2, the message text may be "Strollers may be used on escalators..." using the type of vehicle C1 (e.g., stroller) identified by comparing the acquired vehicle ID with the vehicle database DB6.

[0220] Furthermore, in the fourth embodiment, the nationality information obtained from the passport is registered in the rental database DB4, and the nationality information is used to determine a message written in a language that user B1 can understand. However, this is not limited to this. For example, the nationality of user B1 may be estimated by performing appropriate image analysis processing on an external image of user B1 taken by the first camera 210 or the second camera 220, and a language that user B1 can understand may be estimated from the estimated nationality. Alternatively, the speech of user B1 may be recorded using a microphone installed on escalator E1, and a language that user B1 can understand may be estimated from the recorded data.

[0221] In the fourth embodiment, an example is shown in which the rental area for the vehicle C1 is one location and the rental database DB4, the user database DB5, and the vehicle database DB6 are included in the operation terminal 5 of the rental area, but there may be multiple rental areas and multiple operation terminals 5. In this case, the above three databases may be included in a computer that is provided separately from the multiple operation terminals 5 and controls each operation terminal 5.

[0222] (Embodiment 5) An information providing system 100 according to embodiment 5 differs from the information providing system 100 according to embodiment 1 in that it further includes a communication unit 17 that wirelessly communicates with an information terminal 6 owned by user B1 or a person related to user B1, as shown in Fig. 25. Fig. 25 is a block diagram showing an example of the functional configuration of the information providing system 100 and the information terminal 6 according to embodiment 5. The information terminal 6 is a portable terminal such as a smartphone or a tablet terminal.

[0223] The communication unit 17 broadcasts a notification signal including notification information indicating the notification content determined by the notification content determination unit 15 from a communication device installed near the second area A2 of the escalator E1 via short-range wireless communication conforming to a communication standard such as Bluetooth (registered trademark). If user B1 or a related person is present near the second area A2, the information terminal 6 receives the notification signal from the communication device. That is, in the fifth embodiment, the computer (communication unit 17) transmits the notification information to the information terminal 6 owned by user (person) B1 or a related person of user B1.

[0224] Upon receiving the notification signal, the information terminal 6 displays the notification content indicated by the notification information included in the notification signal on the display 61. At this time, the information terminal 6 may display the notification content on the display 61 and also output an alarm sound from a built-in speaker. Fig. 26 is a diagram showing an example of a display of the information terminal 6 according to embodiment 5. In the example shown in Fig. 26, the display 61 of the information terminal 6 displays a message M1 indicating an alarm, a message M2 indicating that a vehicle C1 (here, a stroller) has been detected to have entered the escalator E1, a message M3 calling attention, and a message M4 indicating the date, time, and location of the detection.

[0225] In this way, in embodiment 5, by sending a notification via an information terminal 6 owned by user B1 or a person related to user B1, user B1 becomes more likely to notice the warning, and the effectiveness of the warning can be further enhanced.

[0226] Note that the user B1 or the related person and the information terminal 6 owned by the user B1 or the related person may be identified by performing an appropriate image analysis process on the image of the user B1 or the related person captured by the first camera 210 or the second camera 220. In this case, the communication unit 17 may transmit a notification signal to the identified information terminal 6.

[0227] (Embodiment 6) The information provision system 100 according to embodiment 6 differs from the information provision system 100 according to embodiment 1 in that there are two target escalators E1, as shown in Fig. 27. Fig. 27 is a diagram showing an example of a usage environment of the information provision system 100 according to embodiment 6. As shown in Fig. 27, both of the two escalators E1 are upward escalators, and the second area A2 of one first escalator E11 and the first area A1 of the other second escalator E12 are located on the same floor.

[0228] As in the first embodiment, a first sensor 21, a second sensor 22, a speaker 3, and a display 4 are provided for the first escalator E11. A first sensor 21', a second sensor 22', a speaker 3', and a display 4' are provided for the second escalator E12. The first sensor 21', the second sensor 22', the speaker 3', and the display 4' have the same configurations as the first sensor 21, the second sensor 22, the speaker 3, and the display 4, respectively.

[0229] That is, in the sixth embodiment, the escalator E1 includes a first escalator E11 and a second escalator E12 that is installed continuously with the first escalator E11 ahead in the traveling direction of the user (person) B1. The computer (notification content determination unit 15) determines the notification content for the second escalator E12 based on the notification content determined for the first escalator E11.

[0230] In the sixth embodiment, the notification content determination unit 15 determines the notification content for the first escalator E11 by comparing the determination result by the determination unit 14 with the notification content database DB1 for the first escalator E11 shown in Fig. 28A. The notification content determination unit 15 determines the notification content for the second escalator E12 by comparing the determination result by the determination unit 14 with the notification content database DB1 shown in Fig. 28B.

[0231] Fig. 28A is a diagram showing an example of a notification content database for a first escalator according to embodiment 6. The example shown in Fig. 28A illustrates data corresponding to a third discrimination result, which is the discrimination result of discrimination unit 14. Fig. 28B is a diagram showing an example of a notification content database for a second escalator according to embodiment 6. The example shown in Fig. 28B illustrates data corresponding to a first to third discrimination results, which are the discrimination results of discrimination unit 14.

[0232] For example, in the case of the first escalator E11, when the discrimination unit 14 determines the third discrimination result, the notification content determination unit 15 determines the notification content to output a notification message saying, "A wheelchair or stroller has been detected entering the escalator. If you continue to use the escalator, an attendant will come. Please stop," to emit a loud (strong) warning sound, and to output the notification message two or more times, as shown in Fig. 28A. Then, when, for example, user B1 reaches the second area A2 of the first escalator E11, the output unit 16 outputs notification information indicating the above notification content via the speaker 3 and the display 4.

[0233] Thereafter, at the second escalator E12, if the determination result of the determination unit 14 is one of the first to third determination results, the notification content determination unit 15 determines notification content that is even more urging than the warning given at the first escalator E11, as shown in Fig. 28B. Then, the output unit 16 outputs notification information indicating the notification content via the speaker 3' and the display 4', for example, when the user B1 reaches the second area A2 of the second escalator E12.

[0234] In this way, in embodiment 6, by sending a notification on the escalator E1 that user B1 uses later based on the notification on the escalator E1 that user B1 used earlier, user B1 is more likely to notice the warning, and the effectiveness of the warning can be further enhanced.

[0235] The information provision system 100 according to the sixth embodiment can also be applied to a case where three or more escalators E1 are installed in succession. In this case, one of two consecutive escalators E1 among the plurality of escalators E1 is a first escalator E11, and the other is a second escalator E12.

[0236] (Seventh Embodiment) An information provision system 100 according to a seventh embodiment differs from the information provision system 100 according to the first embodiment in that learning data is collected in order to improve the accuracy of detecting a vehicle C1. Fig. 29 is a block diagram showing an example of the functional configuration of the information provision system 100 according to the seventh embodiment. As shown in Fig. 29, the information provision system 100 according to the seventh embodiment includes a first storage unit 71 and a second storage unit 72.

[0237] The first storage unit 71 stores data of the detection results of the first sensor 21 (here, images captured by the first camera 210) when the first sensor 21 is unable to detect the vehicle C1. A correct answer label indicating that the vehicle C1 is present is attached to the data. The second storage unit 72 stores data of the detection results of the second sensor 22 (here, images captured by the second camera 220) when the second sensor 22 is unable to detect the vehicle C1. A correct answer label indicating that the vehicle C1 is present is attached to the data.

[0238] In other words, data that should be a detection result indicating the presence of vehicle C1 but that could not detect vehicle C1 due to insufficient accuracy in the image analysis process by the trained model for which machine learning has been completed is stored as learning data in the first storage unit 71 and the second storage unit 72. The trained model here is a model for which machine learning has been completed so as to output a result indicating the presence or absence of vehicle C1 for an input image.

[0239] Therefore, by re-learning the trained model using the learning data stored in each of the first memory unit 71 and the second memory unit 72, it is expected that the accuracy of image analysis processing using the trained model will be improved.

[0240] An example of operation of the information provision system 100 according to the seventh embodiment will be described below with reference to Fig. 30 and Fig. 31. Fig. 30 is a schematic diagram showing an example of operation of the information provision system 100 according to the seventh embodiment. Fig. 31 is a flowchart showing an example of processing of the information provision system 100 according to the seventh embodiment. Note that, in the following description, it is assumed that data when the vehicle C1 is detected is also stored in the first storage unit 71 and the second storage unit 72.

[0241] First, as shown in Figures 30(b) and 31, a case will be described in which vehicle C1 cannot be detected at the first time point when the first information is acquired (step S701: No) but vehicle C1 can be detected at the second time point when the second information is acquired (step S704: Yes). The first time point is the time point when user B1 is detected in the first area A1 of escalator E1. The second time point is the time point when user B1 is detected in the second area A2 of escalator E1.

[0242] In this case, the computer (information provision system 100) associates the third information indicating the presence of vehicle C1 with the second information and stores the third information in the second storage unit 72 (step S705).The computer (information provision system 100) associates the first information acquired a predetermined time before the second time point with the third information indicating the presence of vehicle C1 and stores the first information in the first storage unit 71 (step S706).

[0243] In the seventh embodiment, the predetermined time is determined based on the operating speed of the escalator E1. For example, the predetermined time can be calculated by dividing the length of the escalator E1 in the traveling direction by the operating speed of the escalator E1.

[0244] Next, as shown in Figures 30(a) and 31, we will explain the case where vehicle C1 can be detected at the first time point when the first information is acquired (step S701: Yes), but vehicle C1 cannot be detected at the second time point when the second information is acquired.

[0245] In this case, the computer (information provision system 100) associates the third information indicating the presence of vehicle C1 with the first information and stores it in the first storage unit 71 (step S702).The computer (information provision system 100) associates the second information acquired a predetermined time after the first time point with the third information indicating the presence of vehicle C1 and stores it in the second storage unit 72 (step S703).

[0246] As described above, in the seventh embodiment, when the computer (information provision system 100) acquires third information indicating the presence of vehicle C1 at the first time point when the first information is acquired, the computer (information provision system 100) stores the first information in the first storage unit 71 in association with the third information, and stores second information acquired a predetermined time after the first time point in the second storage unit 72 in association with the third information. When the computer (information provision system 100) acquires third information indicating the presence of vehicle C1 at the second time point when the second information is acquired, the computer (information provision system 100) stores the second information in the second storage unit 72 in association with the third information, and stores the first information acquired a predetermined time before the first time point in association with the third information in the first storage unit 71. Note that, if user B1 can be detected separately, the computer (information provision system 100) may store the second information, which is obtained when user B1 detected at the first time point was detected in the second area A2, in the second storage unit 72 in association with the third information. Similarly, the computer (information providing system 100) may associate the second information of the time when user B1, who was detected at the second time point, was detected in the first area A1 with the third information and store the second information in the first storage unit 71. In this case, calculation of the predetermined time is not necessary.

[0247] In the seventh embodiment, the first information (or the second information) is linked to the third information and stored in the first storage unit 71 (or the second storage unit 72), but this is not limited to this. For example, the acquisition date and time of the first information (or the second information), output notification information, or an identifier unique to the escalator E1 may be linked to the third information and stored in the first storage unit 71 (or the second storage unit 72). Furthermore, without being limited to this, the third information may be linked to the number of visitors to the entire building (e.g., a store) in which the escalator E1 is installed, the brightness around the escalator E1, the weather including the season, event information, or the like and stored in the first storage unit 71 (or the second storage unit 72).

[0248] (Modifications) In each of the above embodiments, each component may be configured with dedicated hardware, or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU (Central Processing Unit) or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory. Here, the software program realizing the information provision system (information provision method) of each of the above embodiments causes a computer to execute each step of the flowcharts shown in Figures 7, 13, 17, 19, 24, and 31.

[0249] The following cases are also included in this disclosure:

[0250] (1) The at least one system is specifically a computer system comprising a microprocessor, ROM, RAM, hard disk unit, display unit, keyboard, mouse, etc. A computer program is stored in the RAM or hard disk unit. The at least one system achieves its functions by the microprocessor operating in accordance with the computer program. Here, the computer program is composed of a combination of multiple instruction codes that indicate commands to a computer to achieve a predetermined function.

[0251] (2) Some or all of the components constituting at least one of the above systems may be configured as a single system LSI (Large Scale Integration). A system LSI is an ultra-multifunctional LSI manufactured by integrating multiple components on a single chip, and specifically, is a computer system configured to include a microprocessor, ROM, RAM, etc. A computer program is stored in the RAM. The system LSI achieves its functions by the microprocessor operating in accordance with the computer program.

[0252] (3) Some or all of the components constituting at least one of the above systems may be configured as an IC card or a standalone module that can be attached to or detached from the device. The IC card or module is a computer system configured with a microprocessor, ROM, RAM, etc. The IC card or module may include the above-mentioned ultra-multifunctional LSI. The IC card or module achieves its functions when the microprocessor operates in accordance with a computer program. This IC card or module may be tamper-resistant.

[0253] (4) The present disclosure may be embodied as the methods described above, a computer program for implementing these methods on a computer, or a digital signal comprising the computer program.

[0254] The present disclosure may be a computer program or a digital signal recorded on a computer-readable recording medium, such as a flexible disk, a hard disk, a CD (Compact Disc)-ROM, a DVD, a DVD-ROM, a DVD-RAM, a BD (Blu-ray (registered trademark) Disc), a semiconductor memory, etc. It may also be a digital signal recorded on such a recording medium.

[0255] The present disclosure may involve transmitting a computer program or a digital signal via a telecommunications line, a wireless or wired communication line, a network such as the Internet, data broadcasting, or the like.

[0256] The program or digital signal may be recorded on a recording medium and transferred, or the program or digital signal may be transferred via a network or the like, so that the program or digital signal can be implemented by another independent computer system.

[0257] (Other) The method according to one embodiment of the present disclosure may be a method as described below.

[0258] A method executed by one or more computers, the method including: (a-1) acquiring a first image output by a first camera that images a first area; (a-2) acquiring a second image output by a second camera that images a second area; (a-3) determining information a based on the first image, the information a being information b indicating that the first area includes a first vehicle or information c indicating that the first area does not include the first vehicle; (a-4) determining information d based on the second image, the information d being information e indicating that the second area includes a second vehicle or information f indicating that the second area does not include the second vehicle; and (a-5) outputting a first notification corresponding to the information b and the information e, a second notification corresponding to the information b and the information f, or a third notification corresponding to the information c and the information e; wherein all or a part of an escalator is located between the first area and the second area, and the first notification, the second notification, and the third notification are different from each other.

[0259] The description in (a-1) is based on, for example, the explanation of the first information acquisition unit 11. The first region is, for example, the first area A1, and the first camera is, for example, the first camera 210.

[0260] The description of (a-2) is based on, for example, the description of the second information acquisition unit 12. The second region is, for example, the second area A2, and the second camera is, for example, the second camera 220.

[0261] The descriptions in (a-3) and (a-4) are based on the explanation of the third information acquisition unit 13, for example.

[0262] The description of (a-5) is based on the descriptions of, for example, S104, S105, S106, and FIG.

[0263] The phrase "the whole or part of the escalator is located between the first area and the second area" is based on the description of FIG. 5, for example.

[0264] The fact that "the first notification, the second notification, and the third notification are different from each other" is based on the description of FIG. 6, for example.

[0265] A method according to one aspect of the present disclosure may be a method as described below.

[0266] A method executed by one or more computers, the method including: (a-1) acquiring a first image output by a first camera that images a first area; (a-2) acquiring a second image output by a second camera that images a second area; (a-3) determining information a based on the first image, the information a being information b indicating that a first vehicle included in the first area is folded or information c indicating that the first vehicle is not folded; (a-4) determining information d based on the second image, the information d being information e indicating that a second vehicle included in the second area is folded or information f indicating that the second vehicle is not folded; and (a-5) outputting a first notification corresponding to the information b and the information e, a second notification corresponding to the information b and the information f, a third notification corresponding to the information c and the information e, or a fourth notification corresponding to the information c and the information f; wherein all or a part of an escalator is located between the first area and the second area; The first notification, the second notification, the third notification, and the fourth notification are different from each other.

[0267] The description in (a-1) is based on, for example, the explanation of the first information acquisition unit 21. The first region is, for example, the first area A1, and the first camera is, for example, the first camera 210.

[0268] The description of (a-2) is based on, for example, the description of the second information acquisition unit 22. The first area is, for example, the second area A2, and the second camera is, for example, the second camera 220.

[0269] The descriptions in (a-3) and (a-4) are based on the explanation of the third information acquisition unit 13, for example.

[0270] The description of (a-5) is based on, for example, S203, S204, S205, and the description of FIG.

[0271] The phrase "the whole or part of the escalator is located between the first area and the second area" is based on the description of FIG. 11, for example.

[0272] "The first notification, the second notification, and the third notification are different from each other" is based on the description of FIG. 12, for example.

[0273] The information provision method, information provision system, and program disclosed herein can be used to adjust the strength of the warning depending on the likelihood that a vehicle such as a stroller has been driven onto an escalator.

[0274] 100 Information provision system 11 First information acquisition unit 12 Second information acquisition unit 13 Third information acquisition unit 14 Discrimination unit 15 Notification content determination unit 16 Output unit 17 Communication unit 21 First sensor 22 Second sensor 210 First camera 220 Second camera 211 First tag reader 221 Second tag reader 3, 3' Speaker 4, 4' Display 5 Operation terminal 51 Touch panel 52 Passport reading unit 53 Communication unit 6 Information terminal 61 Display 71 First memory unit 72 Second memory unit A1 First area A2 Second area B1 Person B11 Baby B2 Other user C1 Vehicle C11 Baggage C12 Detection circuit E1 Escalator E11 First escalator E12 Second escalator DB1 Notification content database DB2 Message database DB3 Nationality-language database DB4 Rental database DB5 User database DB6 Vehicle database K1 Key

Claims

1. The computer Acquire first information regarding a person present in a first area including an entrance of an escalator; acquire second information about the person present in a second area including a midpoint or an exit of the escalator; acquiring third information regarding a vehicle present on the escalator that is related to at least one of the first information or the second information; determining a change in a state of the vehicle based on the third information; outputting notification information indicating notification content determined based on the determined change in the state of the vehicle; Information provision method.

2. The computer includes: acquiring the third information by detecting the first area from a first direction; acquiring the third information by detecting the second area from a second direction; The first direction and the second direction are different directions. The information providing method according to claim 1 .

3. A computer comprising: Obtaining first information regarding a person present in a first area of ​​the escalator; acquiring second information about the person present in a second area of ​​the escalator; acquiring third information regarding a vehicle present on the escalator that is related to at least one of the first information or the second information; determining a change in a state of the vehicle based on the third information; outputting notification information indicating notification content determined based on the determined change in the state of the vehicle; The change in the state of the vehicle includes a change in the shape of the vehicle. Information provision method.

4. The change in the shape of the vehicle is a change in the shape of the vehicle due to folding. The information providing method according to claim 3.

5. The third information is fourth information indicating a shape of the vehicle at a time when the first information was acquired; and fifth information indicating a shape of the vehicle at a time when the second information is acquired, The computer identifies a change in the shape of the vehicle based on the fourth information and the fifth information.

5. The information providing method according to claim 3 or 4.

6. A computer comprising: Obtaining first information regarding a person present in a first area of ​​the escalator; acquiring second information about the person present in a second area of ​​the escalator; acquiring third information regarding a vehicle present on the escalator that is related to at least one of the first information or the second information; determining a change in a state of the vehicle based on the third information; outputting notification information indicating notification content determined based on the determined change in the state of the vehicle; Further acquiring characteristic information indicating characteristics of at least one of the person or the vehicle; The notification content is determined based on the characteristic information; the characteristic information includes party information regarding a party of the person; The notification content is determined based on the related party information. Information provision method.

7. A computer comprising: Obtaining first information regarding a person present in a first area of ​​the escalator; acquiring second information about the person present in a second area of ​​the escalator; acquiring third information regarding a vehicle present on the escalator that is related to at least one of the first information or the second information; determining a change in a state of the vehicle based on the third information; outputting notification information indicating notification content determined based on the determined change in the state of the vehicle; Further acquiring characteristic information indicating characteristics of at least one of the person or the vehicle; The notification content is determined based on the characteristic information; The characteristic information further includes status information indicating a status of the person, The notification information is output from at least one of a speaker and a display based on the status information. Information provision method.

8. The state information includes at least one of information indicating a wakefulness state or a sleep state of a person riding in the vehicle, or information indicating a visual or auditory state of the person. The information providing method according to claim 7.

9. A computer comprising: Obtaining first information regarding a person present in a first area of ​​the escalator; acquiring second information about the person present in a second area of ​​the escalator; acquiring third information regarding a vehicle present on the escalator that is related to at least one of the first information or the second information; determining a change in a state of the vehicle based on the third information; outputting notification information indicating notification content determined based on the determined change in the state of the vehicle; Further acquiring characteristic information indicating characteristics of at least one of the person or the vehicle; The notification content is determined based on the characteristic information; The vehicle is a rental vehicle, The characteristic information includes an identifier of the rental vehicle, The notification content is determined based on user information regarding the person renting the rental vehicle corresponding to the identifier of the rental vehicle. Information provision method.

10. The user information includes at least one of passport information regarding the person, including nationality, or rental registration information regarding the person registered at the time of rental of the rental vehicle, The information providing method according to claim 9.

11. A computer comprising: Obtaining first information regarding a person present in a first area of ​​the escalator; acquiring second information about the person present in a second area of ​​the escalator; acquiring third information regarding a vehicle present on the escalator that is related to at least one of the first information or the second information; determining a change in a state of the vehicle based on the third information; outputting notification information indicating notification content determined based on the determined change in the state of the vehicle; The escalator includes a first escalator and a second escalator that is installed continuously with the first escalator in front of the person in the traveling direction, The computer determines the notification content for the second escalator based on the notification content determined for the first escalator. Information provision method.

12. A computer comprising: Obtaining first information regarding a person present in a first area of ​​the escalator; acquiring second information about the person present in a second area of ​​the escalator; acquiring third information regarding a vehicle present on the escalator that is related to at least one of the first information or the second information; determining a change in a state of the vehicle based on the third information; outputting notification information indicating notification content determined based on the determined change in the state of the vehicle; When the third information indicating the presence of the vehicle is acquired at a first time point when the first information is acquired, the first information is linked to the third information and stored in a first storage unit, and the second information acquired a predetermined time after the first time point is linked to the third information and stored in a second storage unit, When the third information indicating the presence of the vehicle is acquired at a second time point when the second information is acquired, the second information is linked to the third information and stored in the second storage unit, and the first information acquired a predetermined time before the first time point is linked to the third information and stored in the first storage unit. Information provision method.

13. The predetermined time is determined based on an operating speed of the escalator. The information providing method according to claim 12.

14. a first information acquisition unit that acquires first information about a person present in a first area including an entrance of the escalator; a second information acquisition unit that acquires second information about the person present in a second area including a midpoint or an exit of the escalator; a third information acquisition unit that acquires third information regarding a vehicle present on the escalator that is related to at least one of the first information or the second information; a determination unit that determines a change in a state of the vehicle based on the third information; a notification content determination unit that determines notification content based on the determined change in the state of the vehicle; and an output unit that outputs notification information indicating the determined notification content. Information provision system.

15. Acquire first information regarding a person present in a first area including an entrance of an escalator; acquire second information about the person present in a second area including a midpoint or an exit of the escalator; acquiring third information regarding a vehicle present on the escalator that is related to at least one of the first information or the second information; determining a change in a state of the vehicle based on the third information; outputting notification information indicating notification content determined based on the determined change in the state of the vehicle; program.