Voice guidance method

Abstract

The voice guidance method includes a determination step of determining whether a visually impaired person is included in passengers in a vehicle that is a public transportation vehicle, and a guidance step of providing voice guidance to inform the visually impaired person of a state around the vehicle when the visually impaired person gets off the vehicle, in a case where it is determined that the visually impaired person is included in the passengers.

Description

Technical Field

[0001] This invention relates to the technical field of voice guidance methods in vehicles. Background Technology

[0002] As an example of this type of method, the following method has been proposed in a vehicle allocation service (see Japanese Unexamined Patent Application Publication No. 2019-078692A). That is, in the case that the user is visually impaired, voice guidance is provided to direct the user to the allocated autonomous driving vehicle. Summary of the Invention

[0003] Voice guidance is an important source of information to support visually impaired individuals when they go out. Therefore, it is desirable to provide voice guidance for visually impaired individuals in various scenarios. For example, when getting out of a vehicle, visually impaired individuals often do not have enough time to assess their surroundings.

[0004] The present invention was made in view of the above circumstances, and the object of the present invention is to provide a voice guidance method for providing voice guidance when getting off a vehicle.

[0005] According to one aspect of the present invention, a voice guidance method includes: a determination step: determining whether a visually impaired person is among the passengers in a vehicle serving as a public transportation vehicle; and a guidance step: when it is determined that the visually impaired person is among the passengers, providing voice guidance to inform the visually impaired person of the surrounding conditions of the vehicle when the visually impaired person disembarks from the vehicle. Attached Figure Description

[0006] The features, advantages, and technical and industrial significance of exemplary embodiments of the present invention will now be described with reference to the accompanying drawings, in which like reference numerals denote like elements, and wherein:

[0007] Figure 1 This is a diagram illustrating an outline of a voice-guided system according to an embodiment;

[0008] Figure 2 This is a block diagram illustrating the configuration of a server according to an embodiment;

[0009] Figure 3 This is a block diagram illustrating the configuration of a bus according to an embodiment;

[0010] Figure 4 A block diagram illustrating the configuration of a bus stop according to an embodiment; and

[0011] Figure 5 This is a flowchart illustrating the operation of a voice guidance system according to an embodiment. Specific Implementation

[0012] Reference Figures 1 to 5 An embodiment of the voice guidance method is described below. In the embodiment described below, a bus route is used as an example of public transportation. The voice guidance method is not limited to buses route but can also be applied to trains or taxis, etc.

[0013] exist Figure 1 In this system, voice guidance system 1 includes a server 10, a terminal device 20 owned by a user, a bus 30, and a bus stop 40. For example, the server 10, terminal device 20, bus 30, and bus stop 40 can communicate with each other via a wide area network such as the Internet. "User" refers to a passenger on a bus route. Users include able-bodied and disabled persons. An application for using voice guidance system 1 is installed on the terminal device 20.

[0014] Server 10 stores reservation information database 110 (hereinafter referred to as "Reservation Information DB 110"), management information database 120 (hereinafter referred to as "Management Information DB 120"), and weather information 130.

[0015] Reservation information DB 110 includes reservation information input by the user via terminal device 20. The reservation information includes, for example, vehicle information (e.g., bus number) indicating the bus the user will be taking, the user's boarding location (e.g., bus stop name) and planned boarding time, and the user's alighting location (e.g., bus stop name) and planned alighting time. The reservation information is associated with user information identifying the user. User information may include, for example, full name, contact information (phone number, email address, address, etc.), gender, age, and information indicating payment methods. In this embodiment, the user information specifically includes information indicating whether the user is visually impaired.

[0016] Note that an identifier can be assigned to user information. For example, user information can be stored together with the assigned identifier in a user information database (not shown). In this case, appointment information can be associated with the identifier assigned to the user information (instead of the user information itself).

[0017] Management information DB 120 includes information used to operate the buses. This information may include, for example, bus identification information, bus stop identification information, route information, operating schedules, and timetables for each bus stop. Weather information 130 may include not only current weather information but also future weather information (i.e., weather forecast information). It should be noted that, for example, server 10 may obtain weather information 130 from a company that provides weather information.

[0018] The following describes an overview of the operation of the voice guidance system 1. Server 10 determines whether a user is visually impaired based on user information associated with reservation information included in reservation information DB 110 (i.e., reservation information input by the user via terminal device 20). If server 10 determines that the user is visually impaired, server 10 indicates the bus the user took and the bus stop where the user alighted, based on the reservation information and management information DB 120 for that user. Here, the bus the user took is bus 30, and the bus stop where the user alighted is bus stop 40.

[0019] For example, server 10 sends information to bus 30 instructing a visually impaired user to board bus 30 and information to bus stop 40 instructing the user to alight from bus 30. Furthermore, for example, server 10 also sends information to bus stop 40 instructing a visually impaired user to alight from bus 30 at bus stop 40, and information indicating at least one of the following: the scheduled alighting time included in the user's reservation information, and the arrival time of bus 30 at bus stop 40 based on management information DB 120. Note that if bus stop 40 is configured to recognize the approach of bus 30, instead of or appending information indicating at least one of the scheduled alighting time and arrival time, server 10 may send information identifying bus 30 to bus stop 40.

[0020] Server 10 sends area-specific weather information (so-called grid weather information) indicating the weather in the area including bus station 40 to at least one of bus 30 and bus station 40 based on weather information 130. Note that the area-specific weather information can be real-time observed information or it can be pre-predicted information (i.e., weather forecast).

[0021] When bus 30 arrives at bus stop 40, bus 30 detects obstacles around bus 30 and bus stop 40. When bus 30 arrives at bus stop 40, bus stop 40 detects obstacles around bus 30 and bus stop 40. For example, "obstacles" are not limited to objects but also include concepts such as pedestrians. Bus 30 and bus stop 40 extract movable bodies as moving obstacles from among the detected obstacles. Bus 30 and bus stop 40 specifically extract movable bodies that approach bus 30 (i.e., movable bodies that may come into contact with or collide with visually impaired users disembarking from bus 30). In addition, bus stop 40 estimates the congestion level of the sidewalk based on the number of people present on the sidewalk around bus stop 40.

[0022] Note that, as a detection method for moving objects, existing methods using sensors such as cameras or radar can be employed, for example. As a detection method for obstacles, existing methods such as methods for detecting moving objects based on changes in the position of detected obstacles over time can be employed, for example. For example, the level of congestion on a sidewalk can be estimated as follows: For example, bus stop 40 is communicable via a predetermined communication standard such as Bluetooth. Bus stop 40 detects the number of terminal devices (e.g., smartphones, etc.) owned by people around bus stop 40 and corresponding to the predetermined communication standard. Bus stop 40 can estimate the level of congestion on the sidewalk based on the number of terminal devices thus detected.

[0023] When bus 30 arrives at bus stop 40, at least one of bus 30 and bus stop 40 provides information indicating the extracted movable body or information indicating the estimated level of congestion on the sidewalk. At least one of bus 30 and bus stop 40 further provides area-specific weather information sent from server 10.

[0024] Reference Figure 2 Describe server 10. In Figure 2 In this configuration, server 10 includes a processing unit 11, a storage device 12, and a communication unit 13. The processing unit 11, storage device 12, and communication unit 13 are interconnected via bus 14. Reservation information DB 110, management information DB 120, and weather information 130 can be stored in storage device 12.

[0025] The processing unit 11 determines whether the user is visually impaired based on the user information associated with the reservation information included in the reservation information DB 110. If the processing unit 11 determines that the user is visually impaired, the processing unit 11 performs the following operations.

[0026] That is, processing unit 11, based on the user's reservation information and management information DB 120, specifies the bus 30 the user is taking and the bus stop 40 where the user will alight from bus 30. For example, processing unit 11 sends information via communication unit 13 to bus 30 instructing a visually impaired user to take bus 30 and instructing the user to alight from bus 30 at bus stop 40. Processing unit 11 also sends via communication unit 13 to bus stop 40 information instructing a visually impaired user to alight from bus 30 at bus stop 40, and instructing at least one of the following: the alighting schedule time included in the user's reservation information, and the arrival time of bus 30 at bus stop 40 based on management information DB 120. Processing unit 11 sends area-specific weather information about the area including bus stop 40 to at least one of bus 30 and bus stop 40.

[0027] Reference Figure 3 Describe bus 30. In Figure 3 In this bus 30, there are a processing unit 31, a detection unit 32, a communication unit 33, and a notification unit 34. For example, the detection unit 32 detects obstacles around the bus 30 based on the output from sensors such as cameras or radar. During the operation of the bus 30 system, the detection unit 32 can always detect obstacles around the bus 30. The notification unit 34 outputs voice both inside and outside the bus 30 via a speaker (not shown) installed in the bus 30.

[0028] When the processing unit 31 receives information from the server 10 via the communication unit 33 indicating that a visually impaired user is on the bus 30, and the bus 30 arrives near the bus stop 40 where the user intends to alight, the processing unit 31 obtains obstacle detection results from the detection unit 32. The processing unit 31 extracts information indicating a movable object approaching the bus 30 from the acquired obstacle detection results. The processing unit 31 generates a warning voice to draw attention to the movable object indicated by the extracted information. Note that if information indicating multiple movable objects is extracted from the obstacle detection results, the processing unit 31 may also generate a warning voice to draw attention only to movable objects approaching the exit of the bus 30. If no information indicating a movable object approaching the bus 30 is extracted from the obstacle detection results, the processing unit 31 may not generate a warning voice.

[0029] The processing unit 31 controls the notification unit 34 to output a warning voice message. Provided that the processing unit 31 receives area-specific weather information from the server 10 via the communication unit 33, the processing unit 31 controls the notification unit 34 to output a voice message corresponding to the area-specific weather information. Note that, for example, the processing unit 31 can control the notification unit 34 to output a voice message to draw attention to the steps inside the bus 30. Furthermore, for example, the processing unit 31 can control the notification unit 34 to output a voice message providing guidance regarding a device that assists visually impaired individuals in walking, such as a handrail installed inside the bus 30.

[0030] Reference Figure 4 Please describe bus stop 40 in more detail. Figure 4 In this bus stop 40, there are a processing unit 41, a detection unit 42, a communication unit 43, and a notification unit 44. For example, the detection unit 42 detects obstacles around the bus stop 40 based on the output of sensors such as cameras or radar. The notification unit 44 outputs voice through a speaker (not shown) installed in the bus stop 40. Note that, for example, the sensors or speakers may be placed on the guidance display panel, canopy (i.e., roof structure), etc. of the bus stop 40.

[0031] When the processing unit 41 receives information from the server 10 via the communication unit 43 instructing a visually impaired user to disembark from bus 30 at bus stop 40, the processing unit 41 estimates the level of congestion on the sidewalk around bus stop 40 at a predetermined time before at least one of the user's planned disembarkation time and the arrival time of bus 30 at bus stop 40. The processing unit 41 controls the notification unit 44 to output a voice message corresponding to the estimated level of congestion on the sidewalk, based on at least one of the planned disembarkation time and the arrival time (i.e., when bus 30 arrives at bus stop 40). Note that if the processing unit 41 can specify bus 30, it can also send the information indicating the estimated level of congestion on the sidewalk directly or via the server 10 to bus 30. In this case, the processing unit 31 of bus 30 can control the notification unit 34 to output a voice message corresponding to the level of congestion on the sidewalk when bus 30 arrives at bus stop 40.

[0032] When the processing unit 41 receives information from the server 10 via the communication unit 43 instructing a visually impaired user to disembark from bus 30 at bus stop 40, the processing unit 41 obtains obstacle detection results from the detection unit 42 for at least one of the planned disembarkation time and the arrival time. The processing unit 41 extracts information indicating a movable object approaching bus 30 from the acquired obstacle detection results. The processing unit 41 generates a warning voice to draw attention to the movable object indicated by the extracted information. Note that if information indicating multiple movable objects is extracted from the obstacle detection results, the processing unit 41 can generate a warning voice to draw attention only to movable objects approaching the exit of bus 30.

[0033] The processing unit 41 controls the notification unit 44 to output a warning voice. Provided that the processing unit 41 receives region-specific weather information from the server 10 via the communication unit 43, the processing unit 41 controls the notification unit 44 to output a voice message corresponding to the region-specific weather information.

[0034] The following will refer to Figure 5 The flowchart describes the operation of the voice-guided system 1. Figure 5 In this process, the processing unit 11 of the server 10 determines whether the user is a visually impaired person based on the user information associated with the reservation information included in the reservation information DB 110 (step S102).

[0035] In step S102, if the processing unit 11 determines that the user is not visually impaired (step S102: No), Figure 5 The operation shown in the diagram ends. Afterwards, the processing of step S101 is performed for other users. That is, voice guidance is not provided on buses without any visually impaired individuals.

[0036] In step S102, if the processing unit 11 determines that the user is visually impaired (step S102: Yes), the processing unit 11 indicates the bus 30 that the visually impaired user is riding and the bus stop 40 where the user will get off the bus 30. Then, the processing unit 31 of the bus 30 determines whether the next bus stop the bus 30 will be the same bus stop 40 where the visually impaired user will get off the bus 30 (step S103).

[0037] In step S103, if the processing unit 31 determines that the next bus stop for the bus 30 is not bus stop 40 (step S103: No), step S103 is executed again. At this time, the processing unit 31 can control the notification unit 34 to output voice to inform the visually impaired user of the bus 30's location.

[0038] In step S103, if the processing unit 31 determines that the next bus stop for the bus 30 is bus stop 40 (step S103: Yes), the processing unit 31 executes step S104 and subsequent steps as described below. At this time, the processing unit 41 of bus stop 40 executes step S104 and subsequent steps as described below based on at least one of the user's planned alighting time as a visually impaired person and the arrival time of the bus 30 at bus stop 40.

[0039] In step S104, the processing unit 41 of bus stop 40 estimates the congestion level on the sidewalk around bus stop 40. In step S105, the processing unit 31 of bus 30 extracts information indicating a moving object approaching bus 30 from the obstacle detection results from detection unit 32. In step S106, at least one of the processing units 31 of bus 30 and bus stop 40 obtains area-specific weather information about the area including bus stop 40 from server 10.

[0040] In step S107, the processing unit 31 of the bus 30 controls the notification unit 34 to output a warning voice based on the processing result of step S105. If the processing unit 31 obtains area-specific weather information in step S106, the processing unit 31 controls the notification unit 34 to output a voice corresponding to the area-specific weather information. In step S107, the processing unit 41 of the bus stop 40 controls the notification unit 44 to output a voice corresponding to the information on the level of pedestrian congestion estimated by the indication in step S104. Furthermore, the processing unit 41 controls the notification unit 44 to output a warning voice based on the processing result of step S105. If the processing unit 41 obtains area-specific weather information in step S106, the processing unit 41 controls the notification unit 44 to output a voice corresponding to the area-specific weather information. As a result, voice guidance is provided to a visually impaired user.

[0041] Note that during the processing in step S107, the terminal device 20, owned by a visually impaired user, can provide the aforementioned voice guidance. In this case, information indicating the results of the processing in steps S104 and S105 can be sent to the terminal device 20 via the server 10. Furthermore, the server 10 can send area-specific weather information to the terminal device 20.

[0042] Technical effect

[0043] Using this voice guidance system 1, when a visually impaired user disembarks from bus 30, voice guidance can be provided regarding the surrounding environment of bus stop 40 (e.g., movable objects approaching bus 30, pedestrian congestion, area-specific weather information, etc.). Therefore, the visually impaired user can understand the surrounding environment of bus 30 and bus stop 40 before disembarking from bus 30. In the voice guidance system 1, both bus stop 40 and bus 30 provide voice guidance. Therefore, even after the visually impaired user disembarks from bus 30, it can be expected that the voice guidance will be relatively easy for them to hear. Thus, the visually impaired user can easily use the bus route, making it possible to promote the use of the bus route by the visually impaired.

[0044] Meanwhile, in the voice guidance system 1, voice guidance is not provided when there are no visually impaired passengers on bus 30. This is because the information provided through voice guidance is not as important to able-bodied individuals who can perceive the surrounding environment of bus 30 and bus stop 40 from visual information. Therefore, compared to providing voice guidance every time bus 30 stops at a bus stop, it is possible to reduce the likelihood of able-bodied individuals becoming annoyed by the voice guidance.

[0045] Note that even if there are no visually impaired persons on bus 30, when bus 30 stops at a bus stop, information such as indicating the presence of movable objects approaching bus 30 can be provided. That is, voice guidance about the surrounding environment of the bus stop can be provided by changing the content of the guidance based on whether there are visually impaired persons on bus 30.

[0046] Various aspects of the present invention derived from the above embodiments will be described below.

[0047] A voice guidance method according to one aspect of the present invention includes: a determination step: determining whether a visually impaired person is among the passengers in a vehicle serving as a public transportation vehicle; and a guidance step: if it is determined that a visually impaired person is among the passengers, providing voice guidance to inform the visually impaired person of the surrounding conditions of the vehicle when the visually impaired person disembarks from the vehicle. In the above embodiment, "bus 30" corresponds to an example of "vehicle serving as a public transportation vehicle".

[0048] In this voice guidance method, the state around the vehicle may include at least one of the following: the level of congestion on the sidewalk, information about moving objects approaching the vehicle, and weather information.

[0049] In this voice guidance method, if it is determined that there are no visually impaired passengers, the status of the vehicle's surroundings may not be provided.

[0050] This invention is not limited to the embodiments described above. The invention is open to modification as long as such modifications do not depart from the inventive principles or ideas as can be read from the claims and the entire specification. Voice guidance methods based on such modifications are also within the technical scope of this invention.

Claims

1. Voice-guided methods, including: The server receives reservation information, which indicates the vehicle information of the public transportation vehicle that the user wants to take, the drop-off location of the user, and whether the user is visually impaired. The server determines whether the user is visually impaired based on the reservation information. If the user is determined to be a visually impaired person, the server, based on the reservation information, designates the vehicle the visually impaired person should take and the station where the visually impaired person should disembark from the vehicle. The server then sends the information of the designated vehicle and the designated station to the designated vehicle, and sends at least one of the following information to the designated station: information instructing the visually impaired person to disembark from the designated vehicle at the designated station, information instructing the visually impaired person's planned disembarkation time, and information instructing the designated vehicle's arrival time at the designated station. The congestion level on the sidewalk around the designated station is estimated by the designated station at a predetermined time before at least one of the scheduled alighting time and the arrival time; Based on at least one of the planned alighting time and the arrival time, the designated station outputs a voice message corresponding to information indicating the estimated level of congestion on the sidewalk; When the designated vehicle arrives at the designated station, the designated vehicle uses sensors to detect the area around the designated vehicle and the designated station, and the designated vehicle determines whether a moving object is approaching the designated vehicle based on the data from the sensors. as well as When the designated vehicle determines that a mobile object is approaching the designated vehicle, the designated vehicle provides a warning voice to draw attention to the approaching mobile object.

2. The voice guidance method according to claim 1, wherein, If it is determined that the visually impaired person is not among the passengers of the designated vehicle, the warning voice will not be provided.

3. The voice guidance method according to claim 1 further includes: The designated station obtains obstacle detection results obtained by the designated station using sensors at least at one of the scheduled alighting time and the arrival time, and the designated station extracts information from the obtained obstacle detection results indicating a movable body approaching the designated vehicle. as well as Based on at least one of the planned alighting time and the arrival time, the designated station generates a warning voice to draw attention to the movable body indicated by the extracted information.

4. The voice guidance method according to claim 1 further includes: The server sends area-specific weather information, indicating the weather in the area including the designated station, to at least one of the designated station and the designated vehicle, based on weather information. When the designated vehicle arrives at the designated station, at least one of the station that received the area-specific weather information and the designated vehicle outputs a voice message corresponding to the area-specific weather information.

Images