Information output system, method for outputting information, and program
The information output system enhances support by providing guides with passenger information and congestion data, enabling better assistance and guidance in vehicles.
Patent Information
- Application Number
- JP2024070622
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-04-24
- Publication Date
- 2025-11-06
Smart Images

Figure 2025166532000001_ABST
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to an information output system, an information output method, and a program. [Background technology]
[0002] BACKGROUND ART Techniques have been devised to smoothly guide users of various modes of transportation, facilities, and the like.
[0003] For example, Patent Document 1 discloses an information processing device for providing information about route buses. This information processing device acquires data on the in-vehicle conditions, such as the degree of congestion, from route bus vehicles, and outputs a guide image generated based on the data via a signage device installed at the bus stop where the vehicle is stopping. The information processing device can also transfer data on passengers planning to board to an in-vehicle device. The in-vehicle device notifies the bus driver of the bus stop where the passenger plans to board and the details of any assistance required. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Publication No. 2023-118612 Summary of the Invention [Problem to be solved by the invention]
[0005] In Patent Document 1, the crew can recognize that a passenger who needs assistance is planning to board the bus. However, there is a possibility that the crew cannot clearly determine how to provide assistance to the passenger after the passenger boards the bus.
[0006] One of the objectives that the embodiments of the present disclosure aim to achieve is to provide an information output system, an information output method, and a program that enable guides to improve the quality of support provided to support recipients. It should be noted that this objective is only one of the objectives that the embodiments disclosed herein aim to achieve. Other objectives or problems and novel features will become apparent from the description of this specification or the accompanying drawings. [Means for solving the problem]
[0007] An information output system according to one aspect includes: a first acquisition means for acquiring person information indicating information about a support recipient who is a user in a predetermined area and who needs support; A second acquisition means for acquiring congestion information indicating a degree of congestion in the predetermined area; The device further includes an output unit that outputs the acquired person information and congestion information to a device corresponding to a guide associated with the predetermined area.
[0008] An information output method according to one aspect includes: Acquire personal information indicating information about a user in a predetermined area who is a support recipient and needs support; Obtaining congestion information indicating a degree of congestion in the predetermined area; outputting the acquired person information and congestion information to a device corresponding to a guide associated with the predetermined area; It is a computer-implemented method.
[0009] In one aspect, the program Acquire personal information indicating information about a user in a predetermined area who is a support recipient and needs support; Obtaining congestion information indicating a degree of congestion in the predetermined area; outputting the acquired person information and congestion information to a device corresponding to a guide associated with the predetermined area; This is what causes a computer to execute the above. [Effects of the Invention]
[0010] The present disclosure makes it possible to provide an information output system, an information output method, and a program that can improve the quality of support that guides provide to support recipients. [Brief explanation of the drawings]
[0011] [Figure 1] 1 is a block diagram illustrating an example of an information output system according to the present disclosure. [Figure 2] 10 is a flowchart illustrating an example of a typical process of the information output system. [Figure 3] 1 is a block diagram illustrating an example of a support system according to the present disclosure. [Figure 4] FIG. 1 is a simplified view of the interior of a bus. [Figure 5] FIG. 1 is a block diagram illustrating an example of a support server according to the present disclosure. [Figure 6A] 10 is an example of notification information displayed by a terminal. [Figure 6B] 10 is another example of notification information displayed by the terminal. [Figure 7A] 10 is a flowchart illustrating an example of a representative process of the support server. [Figure 7B] 10 is a flowchart illustrating an example of a representative process of the support server. [Figure 8] 10 is another example of notification information displayed by the terminal. [Figure 9] 10 is an example of a notification displayed on a display terminal. [Figure 10] 10 is another example of notification information displayed by the terminal. [Figure 11] FIG. 10 is a block diagram illustrating another example of a support server according to the present disclosure. [Figure 12] FIG. 10 is a block diagram illustrating another example of a support server according to the present disclosure. [Figure 13] FIG. 10 is a block diagram illustrating another example of a support system according to the present disclosure. [Figure 14] FIG. 10 is a block diagram illustrating another example of a support system according to the present disclosure. [Figure 15]FIG. 2 is a block diagram illustrating an example of a hardware configuration of an information processing device in which processing of the system or device is executed. DETAILED DESCRIPTION OF THE INVENTION
[0012] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Note that the following descriptions and drawings in the embodiments have been omitted or simplified as appropriate for clarity of explanation. Furthermore, in this disclosure, unless otherwise specified, when multiple items are defined as "at least one of multiple items," the definition may mean any one item, or any multiple items including all items.
[0013] Each drawing referenced in the embodiments is merely an example for describing one or more embodiments. Each drawing may not relate to only one particular embodiment, but may also relate to one or more other embodiments. As will be understood by those skilled in the art, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings to create, for example, an embodiment not explicitly shown or described. Not all features or steps shown in any one drawing are necessarily required to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate.
[0014] Additionally, common definitions used in this disclosure are explained below.
[0015] [Definition explanation] In the present disclosure, a "predetermined area" refers to any area that a user intends to use. For example, the predetermined area may be any real estate such as an event venue or facility, an amusement facility such as a movie theater or an aquarium, or a public facility, or an administrative unit of a certain area. Alternatively, the predetermined area may be any means of transportation such as a train, airplane, ship, or vehicle. Examples of vehicles include buses, taxis, ride-sharing vehicles, etc. Transportation may fall under the predetermined area regardless of whether it has a power plant or not. The predetermined area may include, for example, at least one of one or more seats or a space for a person to stand.
[0016] In this disclosure, a "user" refers to a person who uses a specified area. For example, if the specified area is a venue or facility, the user may be a person entering the venue or facility. Or, if the specified area is a means of transportation, the user may be a person boarding or getting on the means of transportation. A "user" includes not only a person who is currently using the specified area, but also a person waiting to use the specified area.
[0017] In this disclosure, a "support recipient" refers to a person who may require support (e.g., assistance) from another person, machine, etc., in at least one of moving to a predetermined area or moving within the predetermined area. For example, support recipients include injured people, people with physical disabilities, people with internal disabilities, people using wheelchairs or strollers, people who need walking aids such as canes, pregnant people, people with infants, elderly people, etc., but examples of support recipients are not limited to these.
[0018] In this disclosure, "crowding level" and "crowding information" refer to information indicating the degree to which a predetermined area is occupied. The occupation of a predetermined area may be by users of the predetermined area or by objects other than users. For example, the congestion information may indicate at least one of the following: the occupancy status of one or more seats in the predetermined area by people, etc. (people, or people and objects), or the occupancy status of the space in which people stand by people, etc.
[0019] In the present disclosure, the term "guide" refers to any person who may guide the support recipient. For example, the guide may be any of the staff members of a venue or facility, or a vehicle. Specifically, the guide may include an usher, a security guard, a vehicle attendant, a driver, etc.
[0020] Embodiment 1 [Configuration Description] 1 is a block diagram showing an example of an information output system according to the present disclosure. The information output system 10 includes a first acquisition unit 102, a second acquisition unit 104, and an output unit 106. The first acquisition unit 102 to the output unit 106 may include, for example, an interface that is connected to another device and transmits and receives data. Each unit of the information output system 10 will be described below.
[0021] The first acquisition unit 102 acquires personal information indicating information about a support recipient who is a user in a predetermined area and who needs support. The first acquisition unit 102 may acquire, as the personal information, information related to a living body, such as an image (i.e., a still image or a video) or audio of the support recipient. As an example, the first acquisition unit 102 may acquire, as the personal information, an image captured by a camera of a user who is waiting to use the predetermined area. The waiting user may be, for example, a user waiting to enter a facility or a venue, a user about to get into a vehicle, a user about to board an airplane, etc.
[0022] As another example, the first acquisition unit 102 may acquire, as the personal information, information such as text or pictures that indicate the characteristics of the support recipient. The characteristics of the support recipient include at least one of the following: the support recipient's injury or characteristics that qualify for support, the support required for the support recipient, and other characteristics of the support recipient (for example, age, gender, clothing, occupation, etc.). The first acquisition unit 102 may acquire the personal information from a device such as a camera or a sensor, or may acquire the personal information from a storage unit inside the information output system 10 or an external network.
[0023] The second acquisition unit 104 acquires congestion information indicating the degree of congestion in a predetermined area. The second acquisition unit 104 may acquire the congestion information from a device such as a camera or a sensor, or may acquire the congestion information from a storage unit inside the information output system 10 or an external network. As an example, the second acquisition unit 104 may acquire, as congestion information, video captured by a camera within the predetermined area. This video indicates the occupancy status of seats within the predetermined area and the occupancy status of spaces where people stand. As another example, the second acquisition unit 104 may acquire data indicating whether or not people are seated, detected by a sensor provided on each seat within the predetermined area.
[0024] The output unit 106 outputs the person information acquired by the first acquisition unit 102 and the congestion information acquired by the second acquisition unit 104 to a device corresponding to the guide for the predetermined area. This device can notify the guide of the output information using a visual display, a sound, or the like. This allows the guide to recognize the person information and the congestion information. The device has a display unit such as a display or a touch panel, a speaker, or the like as appropriate as a configuration for notifying the information.
[0025] Here, the output unit 106 may output the person information and the congestion information to the device in an associated state. "Associating the person information with the congestion information" means that the device can notify the person information and the congestion information in a manner that allows the guide to recognize that the person information and the congestion information are associated. For example, when the device displays the person information and the congestion information, the device may simultaneously display the person information and the congestion information. As another example, when displaying one piece of information, the device may embed a link that allows the other piece of information to be displayed in the other piece of information. Furthermore, the device may output both pieces of information consecutively by audio, allowing the guide to recognize that the two pieces of information are associated. The method of associating the person information and the congestion information will be further described in the second embodiment and subsequent embodiments.
[0026] Furthermore, the personal information acquired by the first acquisition unit 102 may be assigned an information identifier. Similarly, the congestion information acquired by the second acquisition unit 104 may also be assigned an information identifier. The output unit 106 may be configured to change the manner in which the device that outputs the information notifies the information, depending on at least one identifier of the personal information or the congestion information. For example, the output unit 106 may set the order in which the device notifies the information earlier when the identifier of the personal information and the congestion information is identifier A compared to when the identifier is identifier B.
[0027] Furthermore, the number of devices to which the output unit 106 can output information is not limited to one, and multiple devices may be provided. The output unit 106 may output (e.g., multicast or broadcast) the acquired person information and congestion information to multiple devices. Alternatively, the output unit 106 may be configured so that the device to which the information is output is changed depending on the identifier of at least one of the person information or the congestion information. For example, if the identifier of the person information and the congestion information is identifier A, the output unit 106 may output information related to identifier A to device A, and if the identifier of the person information and the congestion information is identifier B, the output unit 106 may output information related to identifier B to device B.
[0028] As an example, consider a case where the predetermined area is the interior of bus A and bus B, which is different from bus A. Here, bus A and bus B may belong to the same route, or may belong to different routes. The first acquisition unit 102 acquires video of the area around bus stop A, which is the bus stop for bus A, and video of the area around bus stop B, which is the bus stop for bus B. An identifier A1 is assigned to the former video, and an identifier B1 is assigned to the latter video. The second acquisition unit 104 acquires congestion information indicating the degree of congestion inside bus A and congestion information indicating the degree of congestion inside bus B. An identifier A2 is assigned to the former congestion information, and an identifier B2 is assigned to the latter congestion information. Device A and device B are provided as devices to which the output unit 106 can output information.
[0029] At this time, by referring to a table that associates identifiers with devices that output information, output unit 106 determines that the information assigned identifiers A1 and A2 will be output to device A, and that the information assigned identifiers B1 and B2 will be output to device B. Then, output unit 106 outputs video of the area around bus stop A and congestion information inside bus A to device A, and outputs video of the area around bus stop B and congestion information inside bus B to device B. In this way, output unit 106 can notify the guide in charge of bus A and the guide in charge of bus B of information about their respective buses.
[0030] [Flow description] 2 is a flowchart showing an example of a typical process of the information output system 10. This flowchart explains the process of the information output system 10. Note that the details of each process are as described above, and therefore will not be explained again as appropriate.
[0031] First, the first acquisition unit 102 acquires person information indicating information about the support recipient (step S12). Then, the second acquisition unit 104 acquires congestion information (step S14). Note that the process of step S12 and the process of step S14 may be executed either first, or both processes may be executed in parallel. The output unit 106 outputs the person information acquired in step S12 and the congestion information acquired in step S14 to the device (step S16).
[0032] [Effect description] As described above, the information output system 10 outputs person information about the support recipient and congestion information about a predetermined area to a device corresponding to a guide. Therefore, the guide can provide support (e.g., assistance or guidance) to the support recipient within the predetermined area based on the congestion information. For example, by referring to the congestion information, the guide can more smoothly guide the support recipient to a less crowded area within the predetermined area. As another example, the guide can determine, based on the congestion information, that there is a person in the area to which the support recipient is to be guided and encourage the person to move. Therefore, the information output system 10 can improve the quality of support provided by the guide to the support recipient compared to when the information about the person is simply notified to the guide.
[0033] Furthermore, the output unit 106 may output the person information and the congestion information to the device in a state in which the information is associated with each other. This allows the guide to more clearly recognize the person information and the congestion information. In other words, the information output system 10 allows the guide to reliably provide assistance.
[0034] The information output system 10 may be configured as a single computer device, or may be configured as a distributed system having multiple computer devices. In a distributed system, the processing executed by the information output system 10 can be shared and executed by multiple computer devices. In other words, the first acquisition unit 102 to the output unit 106 may be distributed and installed on two or more computer devices.
[0035] Some or all of the components of the information output system 10 may be provided on a cloud server built on a cloud, or on other types of virtualized servers created using virtualization technology, etc. Functions other than those provided on servers such as cloud servers or virtualized servers are placed on edges. For example, in a system that acquires video footage captured on-site via a network and monitors the footage, edges are devices placed in a specific area or near the site, and are also devices that are close to the terminal in terms of the network hierarchy.
[0036] In each of the following embodiments, specific examples of the information output system 10 described in the first embodiment are disclosed. However, the specific examples of the information output system 10 described in the first embodiment are not limited to those shown below. Furthermore, the configurations and processes described below are merely examples, and are not limited thereto.
[0037] Embodiment 2 (2A) [Configuration Description] 3 is a block diagram showing an example of a support system according to the present disclosure. The support system S includes cameras C1 and C2 and a support server 20. The cameras C1 and C2 are visible light cameras installed at bus stop T1 and inside bus U1, respectively, and the support server 20 is a server installed on the cloud side. Note that the number of cameras C1 and C2 is not limited to one, and multiple cameras may be installed. The support system S is, for example, a system owned by a bus company that operates bus U1.
[0038] Camera C1 captures the area around bus stop T1 and transmits the captured video data Z1 to support server 20. Video data Z1 shows bus U1 users E waiting for bus U1 as people present near bus stop T1. Users E include wheelchair user EA, user EB who has a leg injury and is having difficulty walking, and elderly user EC who uses a cane. These users require assistance from the driver of bus U1 in at least one of boarding bus U1 and moving around inside bus U1. Support server 20 can determine that users who require assistance from the driver of bus U1 are present near bus stop T1 by analyzing video data Z1 as described below.
[0039] Camera C2 captures the interior of bus stop T1 and transmits the captured video data Z2 to support server 20. Video data Z2 captures people inside bus U1, as well as the seats and spaces outside the seats. Camera C2 is installed inside bus U1, for example, as a drive recorder.
[0040] FIG. 4 is a simplified diagram showing the interior of a bus U1. FIG. 4 shows multiple seats SE, multiple passengers CU seated in some of the seats SE, and a space SU other than the seats. Some of the seats SE (PS) are priority seats PS that can be used preferentially by users who require assistance. A portion of the space SU is a space KA that can be used by users of wheelchairs or strollers. In the example of FIG. 4, of the five priority seats PS, four seats are occupied, and one seat is empty. There is also one passenger CU in the space KA. Furthermore, the bus U1 is equipped with a driver DR who can provide assistance to those requiring assistance as needed.
[0041] As shown in Figures 3 and 4, a terminal device TE (hereinafter simply referred to as terminal TE) is provided inside the bus U1 for displaying user support to the driver DR. The support server 20 transmits notification information I1 to the terminal TE. The notification information I1 is information that associates personal information about support recipients who are near the bus stop where the bus U1 is scheduled to stop with congestion information inside the bus U1. The driver DR can check the notification information I1 provided by the support server 20 by visually checking the display unit of the terminal TE.
[0042] Furthermore, a speaker SP is provided inside the bus U1 so that the driver DR can output announcements to bus passengers. When the driver DR determines that cooperation from the passenger CU is necessary in assisting the support recipient based on the notification information I1, the driver DR makes an announcement to the passenger CU through the speaker SP.
[0043] 5 is a block diagram showing an example of a support server according to the present disclosure. The support server 20 includes a receiving unit 202, a bus outside analysis unit 204, a bus inside analysis unit 206, a notification determination unit 208, a transmitting unit 210, and a storage unit 212. The support server 20 functions as a central server that analyzes videos captured by cameras C1 and C2 installed at the site.
[0044] The receiving unit 202 is an interface that receives, via the network, video data Z1 captured by camera C1 of the area around bus stop T1 and video data Z2 captured by camera C2 of the interior of bus U1. The receiving unit 202 outputs the received video data Z1 to the bus outside analysis unit 204 and outputs the received video data Z2 to the bus inside analysis unit 206. Note that cameras C1 and C2 continue to output video data Z1 and Z2, respectively, while capturing images. Therefore, the receiving unit 202 continues to output video data Z1 to the bus outside analysis unit 204 while camera C1 continues capturing images, and continues to output video data Z2 to the bus inside analysis unit 206 while camera C2 continues capturing images.
[0045] The bus outside analysis unit 204 analyzes the video of the video data Z1 and identifies people in the video. The bus outside analysis unit 204 then determines whether each identified person around bus stop T1 is waiting to board bus U1. For example, the bus outside analysis unit 204 detects at least one of the position, body orientation, or movement speed of each identified person, and determines whether each person is waiting for bus U1 based on the detection results.
[0046] For example, when the outside-bus analysis unit 204 determines that the identified person is in any of the following situations, it determines that the person is waiting for the bus U1. The movement speed of the identified person is below a predetermined threshold (for example, the person is almost stationary). The person's body must be facing the bus stop T1 or the bus stop location of bus U1. The person is in the pre-determined waiting position for bus U1. For example, assume that bus stop T1 is a bus stop where buses of multiple routes stop, and that waiting lanes are provided in different locations around bus stop T1 for each route. In this case, the outside-bus analysis unit 204 identifies the lane corresponding to bus U1 from among the multiple lanes and determines that user E, who is located in that lane, is waiting for bus U1.
[0047] The outside-bus analysis unit 204 identifies support recipients from among the people waiting for the bus U1 identified as described above. To identify support recipients, the outside-bus analysis unit 204 detects the number of people who will be support recipients and the characteristics of each support recipient. For example, the outside-bus analysis unit 204 determines whether each person in the video is a support recipient by determining at least one of the following for each person: - Whether or not the person has injuries or is pregnant · Whether or not there is a caregiver - Whether the person is an infant (i.e., under a certain age) Whether or not you are elderly (i.e., over a certain age) -Whether or not there is any difficulty in walking or maintaining posture Whether or not the person has any marks indicating that they are disabled As another example, the outside-bus analysis unit 204 may determine whether each person in the video is a person requiring assistance by identifying the person's belongings (for example, a cane, wheelchair, stroller, cast, or various marks).
[0048] In this example, the outside-bus analysis unit 204 determines that the support recipients waiting for bus U1 around bus stop T1 include one person in a wheelchair (user EA), one injured person (user EB), and one person with difficulty walking (user EC).The outside-bus analysis unit 204 outputs the number of identified support recipients and information on the characteristics of each support recipient to the notification determination unit 208 as person information.
[0049] The outside-bus analysis unit 204 may determine whether or not each person identified around bus stop T1 as a result of analyzing the video of video data Z1 is a support recipient. Thereafter, the outside-bus analysis unit 204 generates person information by determining whether or not the identified support recipient is a person waiting for bus U1.
[0050] The bus outside analysis unit 204 may, for example, use a trained model stored in the memory unit 212 to perform at least one of the above-described functions: identifying people in the video, determining whether a person is waiting for the bus U1, and identifying support recipients. The model is trained using a machine learning technique. For example, with regard to identifying support recipients, the model is trained by inputting training data including multiple sets of sample videos and information indicating the number of support recipients in the video and their characteristics as correct labels. After this training, video information from the video data Z1 is input to the model. The model outputs information indicating the number of support recipients and their characteristics corresponding to the input information. The bus outside analysis unit 204 outputs this output information to the notification determination unit 208 as person information. The bus outside analysis unit 204 can also use a model trained using a similar technique to identify people in the video or determine whether a person is waiting for the bus U1.
[0051] The trained model may have a configuration including, for example, a neural network. Furthermore, such a model may be generated using a deep learning technique and include layers such as a feature extraction layer and a fully connected layer.
[0052] However, the out-of-bus analysis unit 204 may execute the above-described identification process by using any algorithm for video analysis, instead of a trained model.
[0053] Furthermore, the outside-bus analysis unit 204 may also determine the characteristics (for example, age, sex, clothing, occupation, etc.) of each person in the video other than the support recipient.
[0054] The bus interior analysis unit 206 analyzes the video of the video data Z2 and identifies people in the video, as well as seats SE and spaces other than seats SU in the video. Then, the bus interior analysis unit 206 uses the identified information to generate congestion information indicating the degree of congestion inside the bus U1 and outputs the generated congestion information to the notification determination unit 208.
[0055] The congestion information is information that indicates where people are present and where they are not present in each seat SE and space SU inside the bus U1. The bus interior analysis unit 206 generates, as congestion information, information that indicates a map showing information about the inside of the bus U1 and people, as shown in Fig. 4, for example. However, the format of the congestion information is not limited to this.
[0056] The inside-bus analysis unit 206 may, for example, use a trained model stored in the memory unit 212 to identify people in the video as described above. The model is a model trained using a machine learning technique. Details of the training performed and the configuration of the model are the same as those described for the model used by the outside-bus analysis unit 204, and therefore will not be described here. However, the inside-bus analysis unit 206 may also perform the above identification process by using any algorithm for video analysis, rather than a trained model.
[0057] The inside-bus analysis unit 206 may also determine the characteristics of each person in the video (for example, age, gender, clothing, occupation, whether or not the person is a person eligible for support, etc.). Furthermore, the inside-bus analysis unit 206 may determine whether or not each person in the video is a person eligible for support. The details of this determination are the same as those performed by the outside-bus analysis unit 204, and therefore will not be described here.
[0058] The notification determination unit 208 determines that the next bus stop for bus U1 is bus stop T1. The notification determination unit 208 may perform this determination, for example, by receiving information about the next bus stop from bus U1. Alternatively, the notification determination unit 208 may perform this determination by using location information output using a GPS (Global Positioning System) function provided on bus U1, as described below.
[0059] When it is determined that bus U1 will next stop at bus stop T1, the notification determination unit 208 determines whether or not there is a person who is a support recipient waiting for bus U1 around bus stop T1, based on the person information generated by the bus outside analysis unit 204. If such a person who is a support recipient is present, the notification determination unit 208 generates notification information I1 including the person information and congestion information, and outputs it to the terminal TE via the transmission unit 210. Here, the notification determination unit 208 sets the notification information I1 so that the person information and the congestion information are associated with each other and displayed on the terminal TE.
[0060] In this example, the notification determination unit 208 determines that the above-mentioned users EA to EC are support recipients waiting for bus U1 near bus stop T1. The notification determination unit 208 may output this person information generated by the outside-bus analysis unit 204 to the terminal TE so that it is displayed on the terminal TE together with congestion information. Alternatively, the notification determination unit 208 may determine that user EA is a wheelchair user and should be guided to a designated space KA on bus U1, and that users EB and EC should be guided to priority seats PS on bus U1. Based on this determination, the notification determination unit 208 generates person information indicating that one wheelchair support recipient should be guided to space KA and the other two support recipients should be guided to priority seats PS, and displays this person information on the terminal TE in association with the congestion information. Space KA and priority seat PS indicate candidate locations to which the support recipients may be guided. Note that a support recipient determined to be guided to a priority seat PS is also referred to as a priority target.
[0061] Fig. 6A is an example of notification information I1 displayed by the terminal TE. As shown in Fig. 6A, the terminal TE displays a map showing the interior of the bus U1 and information about people, in association with the person information generated by the notification determination unit 208. Specifically, the terminal TE displays a comment N1 including the person information of the user EA to be guided, connected with an arrow to the position of the space KA to which the support recipient should be guided. In addition, the terminal TE displays a comment N2 including the person information of the users EB and EC to be guided, in close proximity to the position of the priority seat PS to which the support recipient should be guided. The comments N1 and N2 are transmitted from the notification determination unit 208 as notification information I1.
[0062] When bus U1 arrives at bus stop T1, the driver DR of bus U1 can briefly see passengers about to board bus U1. However, because driver DR must drive safely, he cannot focus his gaze on the direction of bus stop T1, which is different from the bus's direction of travel. This makes it difficult for driver DR to determine whether there are passengers who require assistance boarding bus U1. However, by referring to the display shown in FIG. 6A, driver DR can determine whether there are any assistance recipients who may require assistance boarding bus U1, as well as information about the seats and spaces currently available inside bus U1. After bus U1 arrives at bus stop T1, driver DR can smoothly guide assistance recipients EA to EC to spaces KA and priority seats PS based on notification information I1.
[0063] 6B is another example of notification information I1 displayed by terminal TE. The notification determination unit 208 grasps the fact that there is a wheelchair user near bus stop T1 and that there is one or more passengers in space KA on bus U1 (i.e., space KA is occupied). Based on this fact, the notification determination unit 208 determines that space KA needs to be vacated. The notification determination unit 208 may generate comment N3 so that a comment requesting passengers to vacate space KA is included in comment N3 together with personal information of user EA.
[0064] Furthermore, the notification determination unit 208 grasps the fact that there are two priority support recipients around bus stop T1 and that there is one vacant priority seat PS on bus U1, and determines based on this fact that there are not enough vacant seats for support recipients (i.e., the priority seats are occupied). The notification determination unit 208 may generate comment N4 so that a comment to ask passengers to vacate the priority seat PS is included in comment N4 together with personal information of users EB and EC.
[0065] The notification determination unit 208 may display information about the appearance of user EA, who the bus outside analysis unit 204 has determined to be a support recipient waiting for bus U1, on the display unit of terminal TE, adjacent to the person information N1. The information about user EA's appearance is information about user EA shown in the video data Z1, and may include, for example, at least one of user EA's face or clothing. Similarly, the notification determination unit 208 may display information about users EB and EC adjacent to the person information N2. This allows the driver DR to more clearly grasp the information about the support recipient based on the notification information I1, thereby enabling the driver DR to more smoothly guide the support recipient to the specified location.
[0066] The notification determination unit 208 may transmit video data Z1 as the personal information to be included in the notification information I1, instead of or in addition to the personal information N1 and N2. Here, the notification determination unit 208 may transmit the video data Z1 itself to the terminal TE. Alternatively, the notification determination unit 208 may add to the video data Z1 an indication that highlights in the video the users EA to EC who are recognized by the bus outside analysis unit 204 in the video of the video data Z1 as support recipients who are about to board the bus U1, and transmit the video data Z1 to the terminal TE.
[0067] Furthermore, the notification determination unit 208 may transmit video data Z2 as congestion information to be included in the notification information I1, instead of or in addition to the map information described above, which is the analysis result of the video of the interior of the bus U1. Here, the notification determination unit 208 may transmit the video data Z2 itself to the terminal TE. Alternatively, the notification determination unit 208 may add an indication to the video data Z2 that highlights in the video a person recognized by the bus interior analysis unit 206 in the video of the video data Z2 as a person inside the bus U1, and transmit the video data Z2 to the terminal TE.
[0068] The "highlighting display" described above is, for example, displaying the appearance of the user EA or EC (or person) in the video by surrounding it with a line or by changing the brightness of the appearance.
[0069] Furthermore, the notification determination unit 208 may notify, as the notification information I1, not only the person information and congestion information described above, but also the number of passengers of bus U1 at bus stop T1, as determined by the bus exterior analysis unit 204 based on the video of video data Z1. Furthermore, the notification determination unit 208 may notify information indicating at least one of the following: characteristics of passengers (not limited to support recipients) in the vicinity of bus stop T1, as determined by the bus exterior analysis unit 204, or characteristics of passengers on bus U1, as determined by the bus interior analysis unit 206. Examples of characteristics of passengers include age, gender, clothing, and occupation. Furthermore, the notification information I1 may include at least one of video captured by camera C1 or video captured by camera C2. This allows the driver to visually check the terminal TE to ascertain detailed information about passengers at or inside bus stop T1.
[0070] The terminal TE may further include a speaker for the driver. The notification determination unit 208 outputs the notification information I1 to the speaker, thereby providing the notification information I1 to the driver by voice.
[0071] The transmitting unit 210 transmits the notification information I1 generated by the notification determining unit 208 and other information generated by the support server 20 as needed.
[0072] The memory unit 212 stores at least one of the received video data Z1 or Z2, the analysis results of the video data by the bus outside analysis unit 204 or the bus inside analysis unit 206, the notification information I1 output by the notification determination unit 208, or the model used for analysis by the bus outside analysis unit 204 or the bus inside analysis unit 206.
[0073] [Flow description] 7A and 7B are flowcharts showing an example of a representative process of the support server 20. This flowchart explains the process of the support server 20. Note that the details of each process are as described above, and therefore will not be explained as appropriate.
[0074] First, the receiving unit 202 acquires video data Z1 and Z2 from cameras C1 and C2, respectively (step S22). The inside-bus analysis unit 206 analyzes the video of video data Z2 to generate congestion information indicating the degree of congestion inside bus U1 (step S24). The outside-bus analysis unit 204 analyzes the video of video data Z1 to generate information about support recipients present around bus stop T1 as person information (step S26). Note that the processing of step S24 and the processing of step S26 may be performed either first, or both may be performed in parallel.
[0075] The notification determination unit 208 determines whether or not there is a support recipient waiting for the bus U1 near the bus stop T1 based on the person information (step S28). If there is no support recipient waiting for the bus U1 (No in step S28), the notification determination unit 208 outputs congestion information to the terminal TE (step S30). However, the notification determination unit 208 may transmit not only the congestion information but also at least one of the following information, for example: Information indicating the number or characteristics of passengers E waiting for bus U1 at bus stop T1, as determined by the bus outside analysis unit 204 Information indicating the characteristics of passengers on bus U1 determined by the bus analysis unit 206 -Video taken by camera C1 or C2
[0076] If there is a support recipient waiting for the bus U1 (Yes in step S28), the notification determination unit 208 generates notification information I1 including person information and congestion information, thereby determining the content to be notified to the driver DR (step S32).The notification determination unit 208 notifies the driver DR of the notification information I1 by outputting the notification information I1 to the terminal TE via the transmission unit 210 (step S34).
[0077] The driver DR recognizes the presence of the person requiring assistance at bus stop T1 by visually checking the notification information I1. The driver DR can announce to passengers through the speaker SP that a person who may need assistance, such as seating, will board the bus at the next bus stop. The driver DR also recognizes from the notification information I1 that one wheelchair user and two priority persons are scheduled to board the bus at bus stop T1. Therefore, the driver DR can announce to passengers to keep space KA, which is a wheelchair space, open for the wheelchair user and to ask the priority persons to give up their priority seats PS. After that, when bus U1 stops at bus stop T1, the driver DR can provide assistance to the person requiring assistance waiting at bus stop T1. The driver DR can perform such operations based on comments N1 and N2 or comments N3 and N4.
[0078] After the process of step S30 or S34 is completed, the notification determination unit 208 determines whether the next bus stop where bus U1 will stop is the end bus stop (step S36). The notification determination unit 208 may make this determination by, for example, comparing the bus stops related to the route of bus U1 stored in the storage unit 212 with the next bus stop scheduled to stop transmitted from bus U1.
[0079] If the next bus stop where bus U1 stops is not the end point (No in step S36), the support server 20 returns to step S22 and executes the process. Therefore, the support server 20 can repeatedly execute the process flows of Figures 7A and 7B until bus U1 stops at the bus stop immediately before the end point. If the next bus stop where bus U1 stops is the end point (Yes in step S36), the support server 20 stops the process.
[0080] [Effect description] In recent years, the aging of the population has led to a shortage of drivers. It is also expected that the number of passengers needing assistance will increase on public transportation such as buses. Therefore, if a driver becomes aware of a person requiring assistance at a bus stop for the first time when the bus arrives, the driver may be slow to respond to the person. Furthermore, if there are no spaces or seats available on the bus for the person requiring assistance, the driver must ask passengers to vacate their space or seat when the bus stops. This could lead to delays in bus schedules.
[0081] The support server 20 can solve the problems described above. The support server 20 notifies the driver DR's terminal TE in advance of information about passengers who are likely to need support, allowing the driver to provide support smoothly. At this time, the support server 20 performs analysis based on images obtained from cameras installed on the bus stop T1 and the bus U1 and transmits the analysis results to the terminal TE. Therefore, compared to when the images are transmitted directly to the terminal TE, the driver DR can quickly confirm the necessary information. This allows the driver DR to provide support to the support recipient more smoothly. Furthermore, the driver DR can request the support recipient to move out of the space or seat reserved for the support recipient in advance (i.e., before stopping at the bus stop), allowing the driver DR to smoothly execute requests to passengers.
[0082] Furthermore, the notification determination unit 208 may output to the terminal TE, as shown in FIGS. 6A and 6B, location information indicating candidate locations within the bus U1 to which the support recipient is to be guided (the above-mentioned space KA and priority seat PS) in association with person information and congestion information. However, the notification determination unit 208 may associate the location information only with person information by indicating the location information in comments N1 to N4 without associating the location information with a map. Alternatively, the notification determination unit 208 may associate the location information only with congestion information by indicating the location information on the map without associating the location information with a comment. The notification determination unit 208 can indicate the location information on the map by, for example, displaying the location information in a color different from the map or by flashing the location information on the display unit of the terminal TE. This allows the driver DR to clearly recognize the location information, thereby enabling smoother guidance of the support recipient.
[0083] Furthermore, when a candidate position to which the support recipient is to be guided inside the bus U1 is occupied, the notification determination unit 208 may output information regarding the release of the occupancy state (for example, information for requesting passengers to vacate a space KA) to the terminal TE. By outputting the information regarding the release of the occupancy state in association with the candidate position to which the support recipient is to be guided, the notification determination unit 208 can more clearly indicate to the driver DR what he or she should request of the passenger. This allows the driver DR to more smoothly make requests to the passenger.
[0084] Furthermore, the notification determination unit 208 may output person information and congestion information so that the terminal TE displays a map showing the interior of the bus U1 and information on locations that are candidates for where the support recipient will be guided. This allows the driver DR to more clearly recognize where to guide the support recipient inside the bus U1, making it possible to guide the support recipient more smoothly.
[0085] The bus interior analysis unit 206 may also generate congestion information based on video footage from inside the bus U1. This is expected to result in more accurate congestion information than when generated by an on-board sensor, etc. This allows the driver DR to perform more accurate assistance work.
[0086] Below, we will explain various variations of the configuration and processing of the support system S shown in (2A). Any one or more variations in the following explanations may be applied to (2A) as appropriate. However, the variations made to the support system S are not limited to those shown below.
[0087] (2B) 8 shows another example of the notification information I1 displayed by the terminal TE. In this example, the inside-bus analysis unit 206 generates congestion information for the inside of the bus U1, indicating that two priority seats PS are vacant (i.e., unoccupied). The outside-bus analysis unit 204 generates personal information for users EA to EC, as shown in (2A).
[0088] Based on the congestion information and person information, the notification determination unit 208 determines that there are two priority support recipients near bus stop T1 and that there are two vacant priority seats PS on bus U1. Based on this information, the notification determination unit 208 determines that there are vacant seats (unoccupied) for the support recipients. The notification determination unit 208 selects two vacant seats from the priority seats PS as candidate locations to which the support recipients will be guided. Note that the notification determination unit 208 may select vacant seats on bus U1 as candidate locations to which the support recipients will be guided by using only the congestion information. However, by selecting candidate locations based on the congestion information and person information, the notification determination unit 208 can identify a location that is more preferable for the support recipients. For example, the notification determination unit 208 may select priority seats, rather than just seats, as candidate locations for the priority support recipients.
[0089] Then, as shown in Fig. 8, the notification determination unit 208 displays on the terminal TE location information indicating the locations of the two selected priority seats PS in association with the person information in the comments and the congestion information on the map. This allows the driver DR to recognize vacant seats to which the support recipient can be guided, making it possible to smoothly guide the support recipient. However, the notification determination unit 208 may output the location information to the terminal TE in a state in which it is associated with either the map or the comments, rather than the other. The details of this are omitted as they have been explained in (2A).
[0090] (2C) A display terminal connected to the support server 20 may be further provided inside the bus U1 to display information to passengers. The display terminal may be, for example, an electronic bulletin board or a signage terminal. The display terminal may display, for example, text information that a wheelchair-bound support recipient and a priority support recipient are scheduled to board the bus at bus stop T1.
[0091] FIG. 9 is an example of a notification displayed by a display terminal. The display terminal displays, as a map, seats SE and spaces SU inside bus U1, as well as congestion information indicating the presence of passengers, and further displays comments N5 and N6 for passengers. Comment N5 indicates that one wheelchair user (user EA) is scheduled to board at bus stop T1, and urges passengers to leave space KA, a wheelchair space, vacant. Comment N6 indicates that two priority users (users EB and EC) are scheduled to board at bus stop T1, and urges passengers to leave priority seat PS vacant. On the map, space KA indicates a candidate location to which user EA may be guided, and priority seat PS indicates a candidate location to which users EB and EC may be guided. The notification determination unit 208 generates notification information shown in FIG. 9, which has substantially the same content as notification information I1, as shown in (2A), and outputs it to the display terminal.
[0092] Here, the display terminal displays the information indicated by the comment N5, including the location information of the space KA that is a candidate for user EA to be guided to, in association with personal information about user EA. The display terminal also simultaneously displays the comment N5 and the space KA on the map, and by connecting the two with an arrow, displays the location information of the space KA in association with the congestion information. Similarly, the display terminal displays the location information of the priority seat PS in association with personal information about users EB and EC, and also displays the location information of the priority seat PS in association with the congestion information. This allows the display terminal to clearly communicate a request for cooperation from passengers (especially passengers sitting in the space KA or the priority seat PS) in getting user EA on the bus U1. However, the notification determination unit 208 may output the location information to the display terminal in association with either the map or the comment, rather than associating it with the other. Details of this are as explained in (2A) and (2B), and are therefore omitted here.
[0093] As described above, the support server 20 can also display information about the support provided to the support recipient on the display terminal that displays the information to passengers. This assists the driver DR in providing support to the support recipient, thereby reducing the workload of the driver DR.
[0094] In addition, the notification determination unit 208 can display the information displayed on the terminal TE shown in (2A) or (2B) on the display terminal in the same manner as shown in (2A) or (2B).
[0095] (2D) The speaker SP may be connected to the assistance server 20, and the notification determination unit 208 may transmit audio information output by the speaker SP to the speaker SP via the transmission unit 210. This audio information conveys to the passengers a request for cooperation in providing assistance to the assistance recipient. The content of the audio information is the same as the above-mentioned comments N5 and N6 displayed on the display terminal. The method by which the notification determination unit 208 creates the audio information is the same as that shown in (2A). This allows the assistance server 20 to automatically notify the passengers of the request for cooperation via the speaker SP. This makes it possible to reduce the workload of the driver DR.
[0096] Furthermore, by acquiring the analysis results of the outside-bus analysis unit 204, the inside-bus analysis unit 206 may detect, based on the video from the camera C2, that the support recipients waiting at bus stop T1 have been guided to space KA or priority seat PS. In response to this detection, the notification determination unit 208 may control the speaker SP of the bus U1 to output, as audio information, words of gratitude for the support. Note that the notification determination unit 208 may also control the speaker SP to output audio information expressing gratitude each time a support recipient is guided to a seat or space. Alternatively, the notification determination unit 208 may control the speaker SP to output audio information expressing gratitude after all of the support recipients waiting for the bus U1 at bus stop T1 have been guided to their seats or spaces.
[0097] (2E) In (2C) or (2D), the notification determination unit 208 may change the notification to be output to the display terminal or the speaker SP depending on the person information and the congestion information. For example, if the notification determination unit 208 determines that there is an empty seat (not occupied) for the support recipient waiting for bus U1 at bus stop T1, it may not output display information or audio information requesting passengers to vacate a priority seat to the display terminal or the speaker SP. Alternatively, the notification determination unit 208 may only convey, by display information or audio information, that the support recipient is planning to board bus U1 at bus stop T1, but may control the display information or audio information not to include a request to vacate a priority seat. On the other hand, if the notification determination unit 208 determines that there is no empty seat (occupied) for the support recipient waiting for bus U1 at bus stop T1, it outputs display information or audio information requesting passengers to vacate a priority seat to the display terminal or the speaker SP. Details of this are as described in (2C) or (2D).
[0098] As another example, the notification determination unit 208 may change the notification to be output to the display terminal or the speaker SP depending on the congestion information, without using person information. For example, when the congestion level inside bus U1 is less than a predetermined threshold (for example, the number of occupied seats out of the total number of seats on bus U1 is less than a predetermined number), the notification determination unit 208 may execute control similar to that executed when it is determined that there is an empty seat for the support recipient waiting for bus U1 at bus stop T1. On the other hand, when the congestion level inside bus U1 is equal to or greater than a predetermined threshold (for example, the number of occupied seats out of the total number of seats on bus U1 is equal to or greater than a predetermined number), the notification determination unit 208 may execute control similar to that executed when it is determined that there is no empty seat for the support recipient waiting for bus U1 at bus stop T1.
[0099] As described above, the notification determination unit 208 changes the notification to be output to the display terminal or the speaker SP, so that the notification determination unit 208 can suppress prompting passengers to provide assistance when prompting passengers to provide assistance is not necessarily necessary, thereby reducing the annoyance that passengers may feel.
[0100] (2F) In addition, in (2C) or (2D), the inside-bus analysis unit 206 may determine whether each person in the video is a support recipient. For example, the notification determination unit 208 may determine whether a passenger in space KA is a support recipient using the analysis results of the inside-bus analysis unit 206. If the passenger in space KA is a support recipient, the notification determination unit 208 may not output display information or audio information requesting the passenger to make space KA available to the display terminal or speaker SP. Alternatively, the notification determination unit 208 may control the display information or audio information to simply convey that a wheelchair-using support recipient is planning to board the bus at bus stop T1, without including a request to make space KA available in the display information or audio information. Note that if the passenger in space KA is not a support recipient, the notification determination unit 208 can execute the control shown in (2C) or (2D) above.
[0101] Similarly, the notification determination unit 208 may determine whether each passenger sitting in a priority seat PS is a support recipient, using the analysis results of the in-bus analysis unit 206. For example, the notification determination unit 208 may determine whether, among the passengers sitting in the priority seats PS, passengers with a number equal to or greater than a predetermined threshold are support recipients. As another example, the notification determination unit 208 may add up the number of vacant seats in the priority seats PS and the number of passengers sitting in the priority seats PS who are not support recipients, and determine whether the sum is equal to or greater than the number of priority users at bus stop T1.
[0102] If the number of passengers equal to or greater than a predetermined threshold is a support target, or if the sum is less than the number of priority target users, the notification determination unit 208 may not output display information or audio information requesting passengers to vacate priority seats PS to the display terminal or speaker SP. In other cases, the notification determination unit 208 can execute the control shown in (2C) or (2D).
[0103] As described above, the notification determination unit 208 can change the information output from the display terminal or speaker SP depending on the number of support recipients among passengers inside the bus U1, particularly in the spaces KA or priority seats PS. This allows the support server 20 to prevent a support recipient who does not need to give up their space or seat from feeling uncomfortable or having to go to the trouble of moving, etc., when the support recipient is in the space KA or priority seat PS.
[0104] 6B of (2A), the notification determination unit 208 may also execute the same control as in (2F). That is, if the passenger in space KA is a support recipient, the notification determination unit 208 may not output comment N3 to terminal TE. Alternatively, the notification determination unit 208 may only notify terminal TE that a wheelchair-using support recipient is planning to board the bus at bus stop T1, and may perform control such that a comment requesting the passenger to leave space KA free is not included in comment N3. Furthermore, the notification determination unit 208 can also perform the same control regarding comment N4 in cases such as when passengers in priority seats PS with a number equal to or greater than a predetermined threshold are support recipients.
[0105] (2G) The storage unit 212 may further store information related to support for the support recipient. The information related to support includes, for example, at least one of information about a description of assistive devices provided on the bus U1 to support the support recipient, the location of the assistive devices, and a method by which the driver or the like will support the support recipient. The information related to support is stored in the storage unit 212 in association with information about the characteristics of the support recipient.
[0106] The notification determination unit 208 compares the characteristic information of the support recipient included in the person information generated by the outside-bus analysis unit 204 with the information about support stored in the storage unit 212. As a result, the notification determination unit 208 can acquire information about support that corresponds to the characteristic information of the support recipient included in the person information. For example, if the characteristic information of the support recipient is "wheelchair user," the notification determination unit 208 acquires, as information about support, at least one of the storage location and deployment method of a ramp used by wheelchair users when boarding the bus. Furthermore, if the characteristic information of the support recipient is "user with a leg injury," the notification determination unit 208 acquires, as information about support, the assistance method to be used when guiding the user to a priority seat after boarding bus U1.
[0107] Fig. 10 shows another example of notification information I1 displayed by the terminal TE. This example differs from Fig. 6A in that the terminal TE further displays the slope position SL and the slope deployment method N5. The notification determination unit 208 generates this display information by using the acquired information on assistance, and generates notification information I1 so that this information is displayed on the terminal TE in association with person information and congestion information.
[0108] If the driver DR is not accustomed to assisting the support recipient, it is expected that it will take a long time to provide assistance. For example, when boarding a wheelchair user, it is conceivable that the driver DR will need time to find and use the ramp needed for boarding. This may lead to delays in the bus schedule. However, by having the support server 20 present information for supporting the support recipient as described above, the time required for the driver DR to provide assistance can be reduced. As a result, bus schedule delays can be prevented.
[0109] (2H) The inside-bus analysis unit 206 may detect passengers inside bus U1 who are about to get up from their seats or who are showing signs of getting off at the next bus stop. For example, if the inside-bus analysis unit 206 detects that a passenger in space KA shown in Fig. 4 is showing signs of getting off at the next bus stop, the inside-bus analysis unit 206 predicts the degree of congestion in the near future based on the detection result, and outputs the prediction result to the notification determination unit 208 as congestion information.
[0110] The notification determination unit 208 acquires, as congestion information, information indicating that there is no person in the space KA. Therefore, even if there is a wheelchair user EA at the bus stop T1, the notification determination unit 208 does not need to generate a notification to ask passengers to leave the wheelchair space KA free. In other words, the notification determination unit 208 can generate the comment N1 as shown in (2A) as information to be displayed on the terminal TE. However, the notification determination unit 208 does not need to generate the comment N3 to ask passengers to leave the space KA free as information to be displayed on the terminal TE.
[0111] Similarly, if the bus interior analysis unit 206 detects that one passenger occupying priority seat PS shown in FIG. 4 is planning to get off at the next bus stop, the bus interior analysis unit 206 generates, as congestion information, information indicating that two priority seats PS will be vacant. In this case, even if priority users EB and EC are present at bus stop T1, the notification determination unit 208 does not need to generate a notification to ask passengers to vacate the priority seats SP. That is, the notification determination unit 208 can generate comment N2 as information to be displayed on the terminal TE, as shown in (2A). However, the notification determination unit 208 does not need to generate comment N4 to ask passengers to vacate the priority seats PS as information to be displayed on the terminal TE. This is because the notification determination unit 208 determines that the number of vacant priority seats PS is sufficient for both priority users EB and EC to sit. The method for this determination is as described above.
[0112] In addition, if the inside-bus analysis unit 206 detects that one or more passengers in the priority seats PS are planning to get off at the next bus stop, the notification determination unit 208 may calculate one of the following values. (i) The sum of the number of vacant seats at the priority seat PS and the number of passengers who are indicating that they are about to disembark. (ii) Add the number of vacant seats in the priority seats PS at that time and the number of passengers who are showing signs of getting off, and subtract the number of passengers standing in all or part of the space SU. The partial area of the space SU in (ii) refers to, for example, a range within a predetermined distance from the priority seat PS. Passengers standing within a predetermined distance from the priority seat PS are detected by the inside-bus analysis unit 206 as described above. The calculated value in (i) or (ii) is the number of seats expected to be vacant at the priority seats PS when the bus stops at bus stop T1. The notification determination unit 208 compares the calculated value with the number of support recipients who are eligible to sit in the priority seats PS at bus stop T1. If the calculated value is less than the number of support recipients, the notification determination unit 208 generates a notification to request that the priority seats PS be vacated. On the other hand, if the calculated value is equal to or greater than the number of support recipients, the notification determination unit 208 does not need to generate a notification to request that the priority seats PS be vacated, as described above.
[0113] The in-bus analyzer 206 may perform the above detection using a trained model or an arbitrary algorithm, as shown in (2A).
[0114] The display method of the terminal TE described above can also be applied to the display on the display terminal (2C) or the audio output by the speaker SP (2D). This can reduce the annoyance that passengers may feel if a notification is given to them in a situation where it is not necessary.
[0115] (2I) An additional camera (hereinafter also referred to as a side camera) may be provided on the side of bus U1. This side camera can capture an image of user E immediately before boarding bus U1 when bus U1 stops at bus stop T1, and transmit the captured video data to support server 20. The outside-bus analysis unit 204 generates person information by analyzing the captured video data in the same way as video data Z1. This person information is used by notification determination unit 208 in the same way as in (2A). In this way, support server 20 can further use data on user E when the bus stops at bus stop T1, thereby enabling more accurate determination of support recipients.
[0116] (2J) The bus U1 may be equipped with a device having a GPS function that can detect its own position. This device outputs its own position detected by the GPS function to the support server 20 at predetermined intervals.
[0117] The storage unit 212 stores location information for each bus stop on the route operated by the bus U1. The support server 20 may, for example, compare the acquired location information for the bus U1 with the location information for each bus stop, and when it detects that the bus U1 is located within a predetermined distance from the location of the bus stop T1, execute the flow shown in Figures 7A and 7B.
[0118] At this time, the bus outside analysis unit 204 can identify the camera installed at bus stop T1 among the cameras C1 installed at each bus stop and perform analysis using the video from the identified camera. The bus outside analysis unit 204 can identify the camera installed at bus stop T1 based on, for example, location information transmitted from the camera.
[0119] Similarly, the inside-bus analysis unit 206 can identify the camera C2 installed on bus U1 among the cameras C2 installed on multiple buses and perform analysis using the footage from the identified camera. The outside-bus analysis unit 204 can identify the camera installed on bus U1 based on, for example, location information transmitted from a device on bus U1.
[0120] Furthermore, the bus outside analysis unit 204 may use video footage captured by the camera identified by the bus inside analysis unit 206 to perform an analysis of the support recipient waiting near bus stop T1. This analysis may be performed when the position of bus U1 is within a predetermined threshold of the position of bus stop T1 (for example, when the two positions are very close to each other). This analysis is performed in the same manner as the analysis performed by the bus outside analysis unit 204 on video footage captured by camera C1. The person information generated by the bus outside analysis unit 204 as a result of the analysis is used by the notification determination unit 208 in the same manner as described above.
[0121] As another example, if the support server 20 detects, as a result of the above comparison process, that the bus U1 has departed from the bus stop T0, which is one stop before the bus stop T1, the support server 20 may execute the flow shown in Figures 7A and 7B.
[0122] In this way, the support server 20 can execute the flow shown in Figures 7A and 7B when the bus U1 approaches the bus stop T1. Therefore, the support server 20 can generate and present the notification information I1 at an appropriate timing. This allows the driver DR to provide support to the support recipient more smoothly.
[0123] (2K) The support server 20 does not need to provide the terminal TE with all or part of the notification information I1 (for example, person information in the notification information I1) for each bus stop on the route of the bus U1. For example, the support server 20 may transmit all or part of the notification information I1 to the terminal TE when the bus U1 approaches a certain predetermined bus stop on the route of the bus U1, and may not transmit the information to the terminal TE when the bus U1 approaches any other bus stop.
[0124] The predetermined bus stop is, for example, a bus stop that is close to a predetermined facility. The predetermined facility may be, for example, a facility that is expected to have a large number of support recipients, such as a hospital or care center, or may be a facility that is expected to have a large number of users, such as a train station, residential area, or supermarket.
[0125] For example, when bus U1 transmits its own location using the GPS function as shown in (2J), the support server 20 compares the acquired location information of bus U1 with the location information of a predetermined bus stop. Then, when it detects that bus U1 is located within a predetermined distance from the location of the predetermined bus stop, the support server 20 may execute the flow shown in Figures 7A and 7B. As another example, when the support server 20 detects, as a result of the above comparison process, that bus U1 has departed from the bus stop immediately before the predetermined bus stop, it may execute the flow shown in Figures 7A and 7B. Details of the process executed by the support server 20 are as described in (2J).
[0126] As described above, the support server 20 may execute the flow shown in Figures 7A and 7B for a specific bus stop. This allows the support server 20 to refrain from providing information about the support recipient when there is little need to provide such information. Therefore, unnecessary processing by the support server 20 can be suppressed.
[0127] (2L) Instead of or in addition to camera C1, which is a visible light camera, a device capable of detecting at least one of a person's appearance or behavior, such as a thermographic camera, may be installed at bus stop T1. By analyzing the detection result data from the device, the outside-bus analysis unit 204 identifies the number of support recipients who will be bus U1 users E around bus stop T1 and detailed information about the support recipients, and generates person information.
[0128] (2M) Instead of or in addition to camera C2, which is a visible light camera, bus U1 may be provided with a device capable of detecting the occupancy status of the space inside bus U1, such as a thermographic camera, a motion sensor, or an occupancy detection sensor provided on each seat. The receiving unit 202 receives the detection data from the device. The inside-bus analysis unit 206 analyzes the detection result data to generate congestion information inside bus U1. The congestion information is displayed on terminal TE as a map, for example, as described above.
[0129] (2N) The inside-bus analysis unit 206 may determine whether or not trouble (e.g., a fight) has occurred between passengers on board the bus U1. As described above, the inside-bus analysis unit 206 can determine whether trouble has occurred using a learned model, an arbitrary algorithm, or the like. If the inside-bus analysis unit 206 determines that trouble has occurred, it may notify the terminal TE of information indicating the occurrence of the trouble and information about the person determined by the inside-bus analysis unit 206 to be causing the trouble, along with the alarm information I1. The information about the person includes, for example, video of the person captured by the camera C2 and characteristic information about the person determined by the inside-bus analysis unit 206. This enables the driver DR to recognize the occurrence of trouble and take appropriate measures.
[0130] (2O) The outside-bus analysis unit 204 may be provided in a terminal device installed at a bus stop, rather than in the support server 20. That is, this terminal device may analyze the video data Z1 from the camera C1 to identify the number of support recipients who will be users E of the bus U1 and detailed information about the support recipients, and generate personal information. The terminal device transmits this personal information to the support server 20. The support server 20 performs the above-mentioned processing based on the received personal information.
[0131] (2P) The in-bus analysis unit 206 may be provided in a terminal device provided on the bus U1, rather than in the support server 20. That is, this terminal device may analyze the video data Z2 from the camera C2 and generate congestion information for the bus U1. The terminal device transmits this congestion information to the support server 20. The receiving unit 202 of the support server 20 performs the above-described processing based on the received congestion information.
[0132] (2Q) The support server 20 may be provided as a server mounted on the bus U1, rather than being provided as a cloud server at a location separate from the bus U1. In this case, the support device on the bus U1 functions as a stand-alone device.
[0133] In the following third to fifth embodiments, variations of the support server 20 described in the second embodiment will be disclosed. However, the variations of the support server 20 are not limited to those described below. Furthermore, the explanation of the points already explained in the second embodiment will be omitted as appropriate, and the explanation will focus on the processing specific to each embodiment.
[0134] Embodiment 3 11 is a block diagram showing another example of a support server according to the present disclosure. Compared to the support server 20 shown in FIG. 5, the support server 30 has a biometric authentication unit 214 instead of the off-bus analysis unit 204.
[0135] The storage unit 212 stores information on facial features that can identify users of bus U1 and information indicating the characteristics of users of bus U1, in association with each user. The information on facial features is information used for facial recognition, and for example, the positions of feature points such as the eyes, nose, and mouth in a facial image and the distance between feature points are defined as "features." The information indicating the characteristics of users of bus U1 includes, for example, information indicating whether the user is a support recipient or not, and information such as the user's attributes. The user's attribute information includes, for example, information on whether the user is a wheelchair or stroller user, or whether the user is a priority user. If the user is a priority user, the user's attribute information may include more detailed information such as whether the user has an injury, internal disability, pregnancy, or walking aid, whether the user has an infant, or whether the user is elderly.
[0136] The biometric authentication unit 214 detects a face image of a person captured by the camera C1, and calculates information on the face feature amount of the person based on the face image. The biometric authentication unit 214 compares the calculated face feature amount information with the face feature amount information stored in the storage unit 212.
[0137] For example, the biometric authentication unit 214 calculates the similarity between the calculated feature amount and the feature amount stored in the storage unit 212. If there is a feature amount on the storage unit 212 side with a similarity greater than a threshold, the feature amount is determined to match, and the result is "authentication successful." If the feature amount is a feature vector, the biometric authentication unit 214 calculates the distance between the calculated feature vector and the feature vector on the storage unit 212 side. If there is a feature vector on the storage unit 212 side with a distance smaller than the threshold, the feature vector is determined to match, and the result is "authentication successful." On the other hand, if there is no feature amount on the storage unit 212 side with a similarity greater than the threshold, or if there is no feature vector on the storage unit 212 side with a distance smaller than the threshold, the biometric authentication unit 214 determines "authentication failed."
[0138] When there is a feature on the storage unit 212 side for which the authentication result is "authentication successful," the biometric authentication unit 214 extracts information indicating the user's characteristics that is stored in the storage unit 212 in association with the feature. The biometric authentication unit 214 determines whether or not the person appearing in the captured video is a support recipient based on the extracted information. If the person is a support recipient, the biometric authentication unit 214 outputs information indicating the user's characteristics as person information to the notification determination unit 208. For a different person appearing in the captured video, the biometric authentication unit 214 outputs information indicating the person's characteristics stored in the storage unit 212 as person information to the notification determination unit 208 each time that person is a support recipient. Note that when the authentication result is "authentication successful" but the person appearing in the captured video is not a support recipient, the biometric authentication unit 214 may or may not output information indicating the person's characteristics to the notification determination unit 208 as person information.
[0139] The notification determination unit 208 executes the process described in the second embodiment using the person information output from the biometric authentication unit 214. In this way, the support server 20 can generate notification information I1 using face authentication and provide it to the driver DR.
[0140] Note that instead of facial feature information, the storage unit 212 may store information on a captured facial image in association with information indicating the characteristics of the user of bus U1. In this case, the biometric authentication unit 214 calculates the similarity between the captured facial image and the facial image stored in the storage unit 212. If there is a facial image on the storage unit 212 with a similarity greater than a threshold, the biometric authentication unit 214 determines that the features match and determines that the authentication is successful. On the other hand, if there is no facial image on the storage unit 212 with a similarity greater than the threshold, the biometric authentication unit 214 determines that the authentication is unsuccessful. The processing performed by the biometric authentication unit 214 when the authentication result is "authentication successful" is as described above.
[0141] The storage unit 212 may store information indicating the assistance required by the user (for example, wheelchair guidance, guidance to a priority seat, etc.) instead of or in addition to the information indicating the user's characteristics. This information may be registered in advance in the storage unit 212 by the user or a bus company staff member via an app service, for example. As a result of the above-mentioned face authentication process, the biometric authentication unit 214 can output information indicating the assistance required by the user as person information to the notification determination unit 208. The notification determination unit 208 can generate notification information I1 based on this person information.
[0142] Furthermore, the biometric authentication unit 214 can perform similar processing for any biometric authentication, not limited to facial authentication, such as fingerprint, finger vein, or iris. The storage unit 212 stores biometric authentication information that can identify a user of bus U1 and information that indicates the characteristics of the user of bus U1, in association with each other. The biometric authentication unit 214 uses the information in the storage unit 212 to perform the above-mentioned matching processing.
[0143] Embodiment 4 (4A) 12 is a block diagram showing another example of a support server according to the present disclosure. The support server 40 further includes a point setting unit 216, as compared with the support server 20 shown in FIG.
[0144] The memory unit 212 stores facial feature information that can identify a point recipient and point information of the point recipient, in association with each point recipient. The definition of the facial feature information is as described in embodiment 3. The point information of a point recipient indicates the numerical value of points acquired by the point recipient. Points are a type of reward and refer to units that can be used by a point recipient to ride bus U1 or to purchase products or services from the company of bus U1 or companies affiliated with that company. In addition to the point information of a point recipient, personal information such as the name of the point recipient may also be stored in the memory unit 212 in association with the facial feature information.
[0145] The inside-bus analysis unit 206 determines whether each person inside bus U1 is a person requiring support. This determination method is the same as the method executed by the outside-bus analysis unit 204, so a description thereof will be omitted. Note that the inside-bus analysis unit 206 may determine that a person requiring support who has been identified by the outside-bus analysis unit 204 as being at bus stop T1 has boarded bus U1 by analyzing facial images, etc., to determine that the person requiring support inside bus U1 is a person requiring support.
[0146] Furthermore, the inside-bus analysis unit 206 determines whether other passengers have provided any assistance to the identified support recipient on board the bus U1. Some assistance indicates, for example, that a passenger performs at least one of the following actions, but examples of assistance are not limited to these. Offering your seat to the person receiving support or an infant or child accompanied by the person receiving support Move from Space KA, which is a wheelchair space. Helping the recipient move their wheelchair Assist the recipient in either getting on or off the U1 bus The in-bus analysis unit 206 may simply determine whether or not the passenger provided assistance, or may specifically determine what kind of assistance the passenger provided.
[0147] The inside-bus analysis unit 206 may determine whether a passenger provided some kind of assistance using, for example, a trained model stored in the storage unit 212. The model is trained using a machine learning technique. For example, the model is trained by inputting training data including multiple sets of sample videos and information indicating the content of assistance provided in the videos as correct labels. After this training, video information from video data Z2 is input to the model. The model outputs information indicating the content of assistance corresponding to this input information. The inside-bus analysis unit 206 generates point target information by associating this information indicating the content of assistance with information on a facial image of the passenger who provided assistance (hereinafter also referred to as the supporter). The inside-bus analysis unit 206 outputs the point target information to the point setting unit 216.
[0148] The structure of the trained model is as shown in (2A). In addition, the in-bus analysis unit 206 may acquire information indicating the content of the support related to the video of the video data Z2 by using not only the model but also any algorithm or the like.
[0149] The point setting unit 216 calculates information on the feature amount of the face image of the supporter based on the face image of the acquired point target information. The point setting unit 216 performs face authentication by comparing the calculated information on the feature amount of the face of the supporter with the information on the feature amount of the face of the point target stored in the storage unit 212. Details of this comparison process are as described in embodiment 3.
[0150] If the comparison results in the presence of facial features of the point target person for which authentication has been determined to be "successful," the point setting unit 216 updates the point information stored in association with the point target person for which authentication has been "successful" by adding a predetermined number of points. The point setting unit 216 may add a uniform point value to the point information regardless of the content of support. Alternatively, the point setting unit 216 may add different point values to the point information depending on the content of support. For example, the point setting unit 216 refers to a table stored in the storage unit 212 in which support content and corresponding point values are recorded. The point setting unit 216 compares the support content of the point target information with the content of the table and identifies the point value corresponding to the point target information, thereby determining the point value to be added to the point information.
[0151] If there are no facial features of the point target person for whom "authentication was successful," the point setting unit 216 may delete information such as the facial features of the supporter. Alternatively, the point setting unit 216 may store information on the facial features of the supporter and the content of support (or the point value corresponding to the support content) in the storage unit 212. If the supporter is later registered in the storage unit 212 as a point target person, the point setting unit 216 performs face authentication on the facial image of the newly registered point target person as described above. If "authentication was successful," the support server 40 can add a point value corresponding to the previously performed support content to the point information stored in association with the point target person.
[0152] Points may also be assigned to supporters who provide assistance to passengers other than those determined to be support recipients, such as by offering their seats or responding to sudden illnesses. For example, the inside-bus analysis unit 206 uses the above method to determine whether the supporter provided some kind of assistance. The inside-bus analysis unit 206 may simply determine whether the supporter provided assistance, or may specifically determine what kind of assistance the supporter provided. The point setting unit 216 performs face authentication by comparing the calculated facial feature information of the supporter with the facial feature information of the point recipient stored in the storage unit 212. If the comparison results in a facial feature of a point recipient determined to be "authenticated successfully," the point setting unit 216 updates the point information stored in association with the point recipient determined to be "authenticated successfully" by adding a predetermined number of points to the point information. Details of the processing that the point setting unit 216 can execute are as described above.
[0153] As described above, the inside-bus analysis unit 206 detects supporters inside the bus, and the point setting unit 216 associates point information with information about the supporters and stores the information in the storage unit 212. In this way, the support server 40 can motivate supporters to provide support, thereby encouraging active support.
[0154] Furthermore, the point setting unit 216 may change the point information depending on the content of the support. This allows the point setting unit 216 to provide high point information for support that requires a lot of effort, thereby enabling more fair point setting.
[0155] The point setting unit 216 may provide supporters with some kind of reward, such as a discount on a product or service fee (for example, the fare for the bus U1), a lottery, money, cryptocurrency, or the like, in addition to points.
[0156] The point-granting function of the point setting unit 216 may be stored in a device external to the support server 40. In this case, the point setting unit 216 outputs the personal information of the point recipient stored in the storage unit 212 in association with the feature values of the point recipient for which "authentication was successful" to the external device via the transmission unit 210. The point setting unit 216 may also output information on the support content provided or information on the point value corresponding to the support content to the external device. When the external device receives the personal information, it updates the point information stored in the storage unit of the external device in association with the user's personal information. When the external device acquires information on the support content provided, it adds a point value corresponding to the support content to the initial point information. On the other hand, when the external device acquires information on the point value corresponding to the support content, it adds the point value to the initial point information.
[0157] As another example, all of the functions of the point setting unit 216 may be stored in a device external to the support server 40. In this way, by providing the point granting function in a device external to the support server 40, it is possible to deal with a situation where the company of bus U1 and the company operating the point service are different companies.
[0158] (4B) In (4A), if the in-bus analysis unit 206 determines that the supporter has provided support, the notification determination unit 208 may include the supporter's support in the notification information I1 and send it to the terminal TE. The driver DR can find out that the supporter has provided support by looking at the display unit of the terminal TE and express his or her gratitude through the speaker SP.
[0159] Also, as shown in (2D), when the notification determination unit 208 transmits audio information to the speaker SP, the notification determination unit 208 may control the speaker SP of the bus U1 to output information expressing gratitude for the support as audio information.
[0160] Furthermore, as shown in (2C), if a display terminal for displaying notifications to users is provided inside bus U1, notification determination unit 208 may further output information expressing gratitude for the support to the display terminal.
[0161] (4C) Like the support servers according to other embodiments, the support server 40 can also be applied to means of transportation other than buses, any facility, and the like. For example, when the support server 40 is applied to passengers inside or outside a facility, a function equivalent to the in-bus analysis unit 206 of the support server 40 can detect that a support recipient is located at an elevator or traffic light within a predetermined area and that another person has provided support to the support recipient at that location. Based on this detection, if the other person is a point recipient, the point setting unit 216 can award points corresponding to the support to the point recipient.
[0162] (4D) Furthermore, when reservation information for reserving a ride on bus U1 is sent from the terminal of a user of bus U1, the point setting unit 216 compares the user's personal information included in the reservation information with the personal information stored in the storage unit 212. If matching personal information is found, a predetermined number of points may be added to the point information associated with the matching personal information and stored in the storage unit 212. Even when the support server 40 is applied to transportation means other than buses or arbitrary facilities, if a reservation for admission or the like is made in advance, the support server 40 can perform the same processing to update the point information of the user who made the reservation.
[0163] For example, if the user making a reservation is a support recipient, the support server 40 can know the support recipient's planned use in advance. This allows the driver DR of bus U1 and the bus company to prepare in advance to accept the support recipient, enabling smooth support to the support recipient.
[0164] (4E) In the third embodiment, it has been described that the support server 30 detects support recipients or other people in the vicinity of the bus stop T1 by using the video captured by the camera C1 and pre-stored information indicating biometric feature values and characteristics of users of the bus U1. Here, the storage unit 212 may further store point information of users of the bus U1 associated with the biometric feature value information of the users. The point setting unit 216 can add a predetermined point value to the point information associated with the biometric feature value information of the detected users in the vicinity of the bus stop T1. The added point value may be the same regardless of the characteristics of the detected person (e.g., whether or not the person is a support recipient, or what type of support recipient the person is), or may differ depending on the person's characteristics. By awarding points to users in this manner, the point setting unit 216 can motivate users to ride the bus U1.
[0165] Fifth embodiment Fig. 13 is a block diagram showing another example of a support system according to the present disclosure. Compared to Fig. 3, Fig. 13 differs in that a camera C1 is not provided at bus stop T1, and instead a two-dimensional code R1 is provided. The two-dimensional code R1 is composed of multiple two-dimensional codes Q1 to Q3. Here, an example will be described in which a QR (Quick Response) code (registered trademark) is used as the two-dimensional code, but examples of two-dimensional codes are not limited to this.
[0166] In this example, bus stop T1 is a bus stop where buses of multiple routes stop, and QR codes Q1 to Q3 for each of the multiple routes are printed on bus stop T1. Here, bus U1 operates on the route that user E, who is near bus stop T1, wishes to board, and the QR code for bus U1 is Q1. User E photographs the QR code Q1 of bus U1 using terminal C3, causing terminal C3 to read the URL (Uniform Resource Locator) information written on Q1. Terminal C3 is, for example, an information terminal such as a smartphone. The information obtained by terminal C3 connecting to the URL is displayed on the screen of terminal C3.
[0167] The screen of terminal C3 displays the bus stop where user E plans to get off and a format for inputting information indicating user E's characteristics. As described above, the information indicating user E's characteristics includes, for example, information indicating whether user E is a recipient of support, and information such as user E's attributes. User E inputs the information by operating terminal C3. As an example, user E may input that she is a recipient of support by checking one of the attributes displayed on the screen, such as wheelchair or stroller use, elderly, pregnant, or having difficulty walking.
[0168] The screen of terminal C3 may also be displayed so that information indicating the support required by user E can be input. The information indicating the support required by the user is as described in embodiment 3. Terminal C3 transmits the information input in this manner to the support server 20 as input information Z3.
[0169] The receiving unit 202 receives input information Z3 and outputs it to the bus outside analysis unit 204. The bus outside analysis unit 204 analyzes the input information Z3 and determines whether user E, who sent the input information Z3, is a support recipient, and if so, what type of support recipient he or she is. If user E is a support recipient, the bus outside analysis unit 204 outputs information on the characteristics of the support recipient as person information to the notification determination unit 208. However, even if user E is not a support recipient, the bus outside analysis unit 204 may output information on the characteristics of user E as person information to the notification determination unit 208.
[0170] The notification determination unit 208 generates notification information I1 based on the acquired person information, as described in the second embodiment, and transmits it to the terminal TE. The driver DR, looking at the display unit of the terminal TE, can recognize the presence of the support recipient near the bus stop T1.
[0171] The notification determination unit 208 may further include information on the bus stop where the support recipient is scheduled to get off in the notification information I1. This allows the driver DR to know in advance which bus stop the support recipient will get off at by looking at the terminal TE.
[0172] When user E, who is the support recipient, wants to receive support when boarding bus U1, he or she can receive support by photographing the QR code at bus stop T1, entering the necessary information, and sending it to support server 20. Furthermore, since it is only necessary to install QR codes instead of installing cameras C1 around bus stop T1, the support system S can be configured more inexpensively.
[0173] At least one of the information indicating the characteristics of user E and the information indicating the support required by user E may be stored in advance in the storage unit 212 in association with the identification information of the terminal of user E. The information may be registered in the storage unit 212 via an application service, as described in the third embodiment.
[0174] In this case, for example, a format for inputting the bus stop where user E plans to get off is displayed on the screen of terminal C3. In other words, user E does not need to input information indicating his / her characteristics or information indicating the assistance he / she needs. Terminal C3 transmits the input information, together with the terminal's identification information, to the assistance server 20 as input information Z3. The bus outside analysis unit 204 compares the identification information included in the received input information Z3 with the identification information stored in the memory unit 212 for each piece of identification information stored in the memory unit 212. If the two are identical, the bus outside analysis unit 204 outputs at least one of the information indicating user E's characteristics and the information indicating the assistance he / she needs, which is stored in association with the identification information stored in the memory unit 212, to the notification determination unit 208 as person information.
[0175] In this way, by registering information related to personal information in advance in the storage unit 212, the effort required of the user E to input information can be reduced.
[0176] Sixth embodiment Fig. 14 is a block diagram showing another example of a support system according to the present disclosure. Compared to Fig. 3, Fig. 14 differs in that a camera C1 is not provided at bus stop T1, and instead an IC (Integrated Circuit) card reader C4 is provided. The IC card reader C4 is provided with a button for inputting the destination bus stop. If multiple routes pass through bus stop T1, a user can input any bus stop on each route as the destination by operating the button.
[0177] When bus user E of bus U1 arrives at bus stop T1, he or she inserts the IC card D1 he or she has brought with him or her into IC card reader C4. Here, at least one of information indicating user E's characteristics and information indicating the assistance required by user E is pre-stored in IC card D1. IC card reader C4 reads out the stored information. The information stored in IC card D1 has been described above and will not be repeated here. The procedure for storing such information in IC card D1 may be performed, for example, at a bus information center or bus company, or via an app service. Note that IC card D1 may be in the form of a card or a card displayed on a device such as a smartphone.
[0178] When the IC card reader C4 is able to read the information on the IC card D1, it puts the user E in a state where he or she can operate the buttons to input the destination. By operating the buttons, the user E inputs the bus stops where the bus U1 is scheduled to stop. The IC card reader C4 transmits the information stored in the IC card D1 and the information indicating the destination to the support server 20 as input information Z4.
[0179] The processing executed by each unit of the support server 20 after receiving the input information Z4 is the same as the processing executed after receiving the input information Z3 in the fifth embodiment, and therefore the description thereof will be omitted. If the support recipient user E wants to receive support in boarding the bus U1, he or she can receive the support by having the IC card D1 read by the IC card reader C4 at the bus stop T1. Furthermore, since it is only necessary to install the IC card reader C4 instead of the camera C1 around the bus stop T1, the support system S can be configured more inexpensively.
[0180] The support servers shown in the second to sixth embodiments may be configured as a single computer device, similar to the information output system 10, or may be configured as a distributed system having a plurality of computer devices.
[0181] In the above-described embodiments, the present disclosure has been described as a hardware configuration, but the present disclosure is not limited to this. The present disclosure can also be realized by causing a processor in a computer to execute a computer program to perform the processing of the devices constituting the information output system 10 or the support servers 20 to 40 described in the above-described embodiments.
[0182] 15 is a block diagram showing an example of the hardware configuration of an information processing device (in other words, a computer) that executes the processing of the system or device described in each embodiment. Referring to FIG. 15, an information processing device 90 includes a signal processing circuit 91, a processor 92, and a memory 93.
[0183] The signal processing circuit 91 is a circuit for processing signals in accordance with the control of the processor 92. The signal processing circuit 91 may include a communication circuit for receiving signals from a transmitting device.
[0184] The processor 92 is connected to the memory 93, and performs the processing of the system described in the above embodiment by reading and executing a computer program from the memory 93. As an example of the processor 92, one of a CPU (Central Processing Unit), an MPU (Micro Processing Unit), an FPGA (Field-Programmable Gate Array), a DSP (Digital Signal Processor), and an ASIC (Application Specific Integrated Circuit) may be used, or a plurality of these may be used in parallel.
[0185] The memory 93 is configured with a volatile memory, a nonvolatile memory, or a combination thereof. The memory 93 is not limited to one, and multiple memories may be provided. The volatile memory may be, for example, a RAM (Random Access Memory) such as a DRAM (Dynamic Random Access Memory) or an SRAM (Static Random Access Memory). The nonvolatile memory may be, for example, a ROM (Read Only Memory) such as a PROM (Programmable Random Only Memory) or an EPROM (Erasable Programmable Read Only Memory), a flash memory, or an SSD (Solid State Drive).
[0186] The memory 93 is used to store one or more instructions. Here, the one or more instructions are stored as programs in the memory 93. The processor 92 can perform the processes described in the above embodiments by reading and executing these programs from the memory 93.
[0187] The memory 93 may include memory built into the processor 92 in addition to memory provided outside the processor 92. The memory 93 may also include storage located away from the processors constituting the processor 92. In this case, the processor 92 can access the memory 93 via an I / O (Input / Output) interface.
[0188] As described above, one or more processors included in each system or device in the above-described embodiments execute one or more programs including instructions for causing a computer to execute the algorithms described using the drawings. Execution of the programs enables the information processing described in each embodiment to be realized.
[0189] The program includes instructions or software code that, when loaded into a computer, causes the computer to perform one or more functions described in the embodiments. The program may be stored in a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, computer-readable media or tangible storage media include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disk (DVD), Blu-ray disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices. The program may also be transmitted on a transitory computer-readable medium or communication medium. By way of example and not limitation, transitory computer-readable media or communication media include electrical, optical, acoustic, or other forms of propagated signals. The transitory computer-readable medium or communication medium may provide the program to the computer via a wired communication path, such as electrical wires and optical fibers, or via a wireless communication path.
[0190] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes. (Appendix 1) a first acquisition means for acquiring person information indicating information about a support recipient who is a user in a predetermined area and who needs support; A second acquisition means for acquiring congestion information indicating a degree of congestion in the predetermined area; and an output unit configured to output the acquired person information and congestion information to a device corresponding to a guide associated with the predetermined area. Information output system. (Appendix 2) The output means outputs the person information and the congestion information to the device in a state in which the person information and the congestion information are associated with each other. 10. The information output system according to claim 1. (Appendix 3) the output means outputs to the device position information indicating candidate positions to which the support recipient is guided within the predetermined area in association with at least one of the person information or the congestion information. 3. The information output system according to claim 1 or 2. (Appendix 4) the information output system further comprises a selection means for selecting, based on at least the congestion information, a candidate position to which the support recipient is to be guided from among unoccupied areas within the predetermined area; the output means outputs location information indicating the selected candidate location to the device or at least one of another device within the predetermined area in a state in which the location information is associated with at least one of the person information or the congestion information. 3. The information output system according to claim 1 or 2. (Appendix 5) When a position within the predetermined area that is a candidate for guiding the support recipient is occupied, the information output system outputs information regarding release of the occupancy state to at least one of the device or another device within the predetermined area in a state in which the information is associated with position information indicating the candidate position. 3. The information output system according to claim 1 or 2. (Appendix 6) the output means outputs the person information and the congestion information so that the device displays a map showing the predetermined area and the position information within the map. An information output system according to any one of appendix 3 to 5. (Appendix 7) the output means changes a notification regarding the support recipient to be output to the device or another device within the predetermined area in accordance with the congestion information. An information output system according to any one of appendices 1 to 6. (Appendix 8) the output means changes the notification depending on the number of support recipients within the predetermined area indicated by the congestion information. 8. The information output system according to claim 7. (Appendix 9) the information output system further includes a third acquisition means for acquiring support information indicating information related to support for the support recipient based on the person information, the output means outputs the person information, the congestion information, and the support information to the device in an associated state. An information output system according to any one of appendices 1 to 8. (Appendix 10) a detection means for detecting a supporter who has provided support to the support recipient within the predetermined area; and an associating means for associating reward information with the supporter information and storing the information in a storage means. An information output system according to any one of appendices 1 to 9. (Appendix 11) the associating means changes the reward information depending on the content of the support provided by the supporter to the support recipient. 11. The information output system according to claim 10. (Appendix 12) The second acquisition means generates the congestion information based on an image of the interior of the predetermined area. An information output system according to any one of appendices 1 to 11. (Appendix 13) the second acquisition means predicts the congestion degree within the predetermined area based on the image, and includes the predicted congestion degree as the congestion information. 13. The information output system according to claim 12. (Appendix 14) Acquire personal information indicating information about a user in a predetermined area who is a support recipient and needs support; Obtaining congestion information indicating a degree of congestion in the predetermined area; outputting the acquired person information and congestion information to a device corresponding to a guide associated with the predetermined area; A computer-implemented method of outputting information. (Appendix 15) Acquire personal information indicating information about a user in a predetermined area who is a support recipient and needs support; Obtaining congestion information indicating a degree of congestion in the predetermined area; outputting the acquired person information and congestion information to a device corresponding to a guide associated with the predetermined area; A program that makes a computer do something.
[0191] Some or all of the elements (e.g., configurations and functions) described in Supplementary Notes 2 to 13 that are dependent on Supplementary Note 1 may also be dependent on Supplementary Notes 14 and 15 in the same dependency relationship as Supplementary Notes 2 to 13. Some or all of the elements described in any Supplementary Note may be applied to various hardware, software, recording means for recording software, systems, and methods.
[0192] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate. [Explanation of symbols]
[0193] 10 Information Output System 102 First acquisition unit 104 Second acquisition unit 106 Output unit 20, 30, 40 support servers 202 Receiving unit 204 Outside bus analysis unit 206 Inside bus analysis unit 208 Notification determining unit 210 Transmission unit 212 Storage unit 214 Biometric authentication unit 216 Point setting unit
Claims
1. a first acquisition means for acquiring person information indicating information about a support recipient who is a user in a predetermined area and who needs support; a second acquisition means for acquiring congestion information indicating a degree of congestion in the predetermined area; and an output unit configured to output the acquired person information and congestion information to a device corresponding to a guide associated with the predetermined area. Information output system.
2. The output means outputs the person information and the congestion information to the device in a state in which the person information and the congestion information are associated with each other. The information output system according to claim 1 .
3. the output means outputs to the device position information indicating candidate positions to which the support recipient is guided within the predetermined area in association with at least one of the person information or the congestion information.
3. The information output system according to claim 1 or 2.
4. the information output system further comprises a selection means for selecting, based on at least the congestion information, a candidate position to which the support recipient is to be guided from among unoccupied areas within the predetermined area; the output means outputs location information indicating the selected candidate location to the device or at least one of another device within the predetermined area in a state in which the location information is associated with at least one of the person information or the congestion information.
3. The information output system according to claim 1 or 2.
5. When a position within the predetermined area that is a candidate for guiding the support recipient is occupied, the information output system outputs information regarding release of the occupancy state to at least one of the device or another device within the predetermined area in a state in which the information is associated with position information indicating the candidate position.
3. The information output system according to claim 1 or 2.
6. the output means outputs the person information and the congestion information so that the device displays a map showing the predetermined area and the position information within the map. The information output system according to claim 3 .
7. the output means changes a notification regarding the support recipient to be output to the device or another device within the predetermined area in accordance with the congestion information.
3. The information output system according to claim 1 or 2.
8. the information output system further includes a third acquisition means for acquiring support information indicating information regarding support for the support recipient based on the person information, the output means outputs the person information, the congestion information, and the support information to the device in an associated state.
3. The information output system according to claim 1 or 2.
9. Acquire personal information indicating information about a user in a predetermined area who is a support recipient and needs support; Obtaining congestion information indicating a degree of congestion in the predetermined area; outputting the acquired person information and congestion information to a device corresponding to a guide associated with the predetermined area; A computer-implemented method of outputting information.
10. Acquire personal information indicating information about a user in a predetermined area who is a support recipient and needs support; Obtaining congestion information indicating a degree of congestion in the predetermined area; outputting the acquired person information and congestion information to a device corresponding to a guide associated with the predetermined area; A program that makes a computer do something.
Citation Information
Patent Citations
Information processor and vehicle system
JP2023118612A