Server device, system, and server device control method and program
By interacting with passengers to assess their satisfaction and adjusting information and destinations accordingly, the system enhances the passenger experience in automatic driving vehicles by providing personalized content and optimizing routes.
Patent Information
- Application Number
- JP2023528904
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-06-18
- Publication Date
- 2025-01-28
- Estimated Expiration
- 2041-06-18
AI Technical Summary
Existing automatic driving vehicles provide information to passengers that is predetermined and not tailored to their individual interests or preferences, leading to reduced passenger satisfaction in transportation methods used in sightseeing spots.
A server device communicates with passengers to ask about their impressions of guided spots, calculates their satisfaction, and adjusts the information provided based on these responses to enhance passenger satisfaction.
The system improves passenger satisfaction by personalizing information delivery and can also adjust the destination based on calculated satisfaction levels, ensuring a more enjoyable experience.
Smart Images

Figure 0007622840000001 
Figure 0007622840000002 
Figure 0007622840000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a server device, a system, a control method for a server device, and a storage medium. [Background technology]
[0002] In recent years, self-driving cars have been put to practical use. For example, self-driving cars have been put to practical use as a means of transportation in theme parks, tourist spots, and the like. The following Patent Documents 1 and 2 disclose technologies that can be applied to self-driving cars. These documents disclose technologies for estimating people's interests and emotions.
[0003] For example, Patent Document 1 describes that the behavior of a vehicle passenger is detected, and information on what the passenger is directly or potentially interested in is presented, stimulating the passenger's interest and supporting the promotion of promotion. The cloud server in Patent Document 1 is communicably connected to a bus. The cloud server includes a communication circuit that receives attribute information of customers who are scheduled to board the bus, which is registered in a customer interest database. The cloud server includes a processor that infers the interests of the customer that the customer is directly or potentially interested in based on the detection result of the customer's behavior detected by an in-vehicle camera or the like mounted on the bus while on board the bus and the customer's attribute information. The processor displays the information on the inferred interests on an in-vehicle terminal mounted on the bus via the communication circuit so that it can be viewed.
[0004] Patent Document 2 describes that an emotion estimation device, emotion estimation method, emotion estimation program, and emotion counting system capable of estimating accurate emotions of an estimated target are provided. The emotion estimation device of Patent Document 2 has a pulse analysis unit, a facial expression analysis unit, an utterance content analysis unit, an utterance tone analysis unit, and an emotion estimation unit. The pulse analysis unit analyzes the pulse of the estimated target to generate pulse information. The facial expression analysis unit analyzes the facial expression of the estimated target based on image information of the face of the estimated target to generate facial expression information. The utterance content analysis unit analyzes the utterance content of the estimated target based on voice information of the estimated target to generate speech content information. The speech tone analysis unit analyzes the speech tone of the estimated target based on the voice information to generate speech tone information. The emotion estimation unit estimates the emotion of the estimated target based on at least two of the pulse information, facial expression information, utterance content information, and speech tone information. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] JP 2020-057066 A [Patent Document 2] JP 2018-068618 A Summary of the Invention [Problem to be solved by the invention]
[0006] Users board self-driving cars and travel to tourist spots and theme parks. At such times, the self-driving cars may provide passengers with information by voice or other means, but the information provided is predetermined and often does not correspond to the information that the users truly want.
[0007] The main object of the present invention is to provide a server device, a system, a control method for a server device, and a storage medium that contribute to improving the satisfaction of passengers on means of transportation used in tourist destinations and the like. [Means for solving the problem]
[0008] According to a first aspect of the present invention, a server device is provided which includes a communication unit that communicates with a patrol vehicle patrolling within a specified area, a conversation unit that asks passengers of the patrol vehicle about their impressions of spots that the patrol vehicle has guided them to and obtains responses from the passengers of the patrol vehicle, and a calculation unit that calculates the satisfaction level of the passengers of the patrol vehicle regarding the guided spots based on the responses from the passengers of the patrol vehicle.
[0009] According to a second aspect of the present invention, a system is provided that includes a patrol vehicle that patrols a specified area, and a server device connected to the patrol vehicle via wireless communication, the server device comprising a communication unit that communicates with the patrol vehicle, a conversation unit that asks passengers of the patrol vehicle about their impressions of spots that the patrol vehicle has guided them to and obtains responses from the passengers of the patrol vehicle, and a calculation unit that calculates the satisfaction level of the passengers of the patrol vehicle regarding the guided spots based on the responses from the passengers of the patrol vehicle.
[0010] According to a third aspect of the present invention, there is provided a control method for a server device, in which the server device communicates with a patrol vehicle circulating within a specified area, asks the passengers of the patrol vehicle about their impressions of spots that the patrol vehicle has guided the passengers to, obtains responses from the passengers of the patrol vehicle, and calculates the satisfaction level of the passengers of the patrol vehicle with respect to the guided spots based on the responses from the passengers of the patrol vehicle.
[0011] According to a fourth aspect of the present invention, there is provided a computer-readable storage medium that stores a program for causing a computer mounted on a server device to execute the following processes: communicating with a patrol vehicle circulating within a specified area; asking passengers of the patrol vehicle about their impressions of spots introduced to them by the patrol vehicle and obtaining responses from the passengers of the patrol vehicle; and calculating the satisfaction level of the passengers of the patrol vehicle with respect to the introduced spots based on the responses from the passengers of the patrol vehicle. Effect of the Invention
[0012] According to each aspect of the present invention, the present invention provides a server device, a system, a method for controlling a server device, and a storage medium that contribute to improving the satisfaction of passengers of means of transportation used in tourist destinations, etc. Note that the effects of the present invention are not limited to those described above. The present invention may achieve other effects instead of or in addition to the effects described above. [Brief description of the drawings]
[0013] [Figure 1] FIG. 1 is a diagram for explaining an overview of an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of a schematic configuration of the information providing system according to the first embodiment. [Diagram 3] FIG. 3 is a diagram for explaining the operation of the information providing system according to the first embodiment. [Figure 4] FIG. 4 is a diagram for explaining a patrol vehicle according to the first embodiment. [Diagram 5] FIG. 5 is a diagram for explaining a patrol vehicle according to the first embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of a processing configuration of the control device according to the first embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of a processing configuration of the server device according to the first embodiment. [Figure 8] FIG. 8 is a diagram illustrating an example of the vehicle management database according to the first embodiment. [Figure 9] FIG. 9 is a diagram illustrating an example of a processing configuration of a communication unit according to the first embodiment. [Figure 10] FIG. 10 is a diagram illustrating an example of the provided voice database according to the first embodiment. [Figure 11] FIG. 11 is a sequence diagram illustrating an example of an operation of the information providing system according to the first embodiment. [Figure 12] FIG. 12 is a diagram illustrating an example of a processing configuration of a server device according to the second embodiment. [Figure 13]FIG. 13 is a diagram illustrating an example of a destination determination table according to the second embodiment. [Figure 14] FIG. 14 is a diagram illustrating an example of a vehicle management database according to the second embodiment. [Figure 15] FIG. 15 is a sequence diagram illustrating an example of an operation of the information providing system according to the second embodiment. [Figure 16] FIG. 16 is a diagram illustrating an example of a processing configuration of a server device according to the third embodiment. [Figure 17] FIG. 17 is a diagram illustrating an example of a user information database according to the third embodiment. [Figure 18] FIG. 18 is a diagram illustrating an example of a vehicle management database according to the third embodiment. [Figure 19] FIG. 19 is a diagram illustrating an example of a provided voice database according to the third embodiment. [Figure 20] FIG. 20 is a diagram illustrating an example of a hardware configuration of a server device according to the present disclosure. [Figure 21] FIG. 21 is a diagram showing an example of a passenger information database according to a modified example of the present disclosure. [Figure 22] FIG. 22 is a diagram illustrating an example of a processing configuration of a server device according to a modification of the present disclosure. [Diagram 23] FIG. 23 is a diagram for explaining the operation of the server device according to the modification of the present disclosure. [Figure 24] FIG. 24 is a diagram for explaining the operation of the server device according to the modification of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0014] First, an outline of one embodiment will be described. The reference numerals in the drawings are added to each element for convenience as an example to aid in understanding, and the description of the outline is not intended to be limiting. Furthermore, unless otherwise specified, the blocks shown in each drawing represent functional units rather than hardware units. The connection lines between the blocks in each drawing include both bidirectional and unidirectional. The unidirectional arrows are used to diagrammatically indicate the flow of the main signal (data) and do not exclude bidirectionality. In this specification and the drawings, elements that can be similarly described may be given the same reference numerals to avoid redundant description.
[0015] A server device 100 according to an embodiment includes a communication unit 101, a conversation unit 102, and a calculation unit 103 (see FIG. 1). The communication unit 101 communicates with a traveling vehicle traveling within a predetermined area. The conversation unit 102 asks the passengers of the traveling vehicle about their impressions of the spots that the traveling vehicle has introduced to the passengers, and acquires responses from the passengers of the traveling vehicle. The calculation unit 103 calculates the satisfaction level of the passengers of the traveling vehicle with respect to the introduced spots, based on the responses from the passengers of the traveling vehicle.
[0016] The server device 100 communicates with a traveling vehicle that travels within a predetermined area such as a tourist spot or a theme park, and talks with passengers on the traveling vehicle. Specifically, the server device 100 asks the passengers about their impressions of the tourist spots and other places that the traveling vehicle has taken the passengers to, and calculates the satisfaction level of the visited spots (passenger satisfaction) based on the passengers' responses. The server device 100 changes the information provided to the passengers on the traveling vehicle or changes the spots to which the passengers are guided, depending on the calculated satisfaction level. In this way, the server device 100 can change the services provided to the passengers depending on the passenger satisfaction level, thereby improving passenger satisfaction.
[0017] Specific embodiments will be described in more detail below with reference to the drawings.
[0018] [First embodiment] The first embodiment will be described in more detail with reference to the drawings.
[0019] [System configuration] Fig. 2 is a diagram showing an example of a schematic configuration of the information providing system according to the first embodiment. As shown in Fig. 2, the information providing system includes a server device 10 and a plurality of patrol vehicles 20-1 to 20-3.
[0020] In the following description, unless there is a particular reason to distinguish between the patrol vehicles 20-1 to 20-3, they will simply be referred to as "patrol vehicles 20." Also, although three patrol vehicles 20 are illustrated in Fig. 2, it is of course not intended to limit the number of patrol vehicles 20 included in the information provision system to "three." It is sufficient for the information provision system to include at least one or more patrol vehicles 20.
[0021] The server device 10 and the traveling vehicle 20 are configured to be able to communicate with each other by wireless communication means such as 4G (4th Generation), 5G (5th Generation), etc. More specifically, the server device 10 communicates with the traveling vehicle 20 via a base station 30.
[0022] The server device 10 is a device that provides various services to passengers of the traveling vehicle 20. For example, the server device 10 provides useful information to passengers of the traveling vehicle 20. The server device 10 may be installed in a building of a system operating company or the like, or may be installed on a network (cloud).
[0023] The patrol vehicle 20 is a vehicle that travels within a predetermined area (predetermined area). The patrol vehicle 20 travels with at least one passenger on board. In the first embodiment, the patrol vehicle 20 will be described on the assumption that it travels with a relatively small group of passengers, such as a family. However, it is needless to say that this is not intended to limit the capacity of the patrol vehicle 20.
[0024] In the first embodiment, the patrol vehicle 20 is described as a vehicle (such as a cart, a microbus, or a bus) that can run automatically without a human being performing a driving operation. However, the patrol vehicle 20 may be a conventional vehicle that is driven by a human being. The patrol vehicle 20 is configured to be controllable by the server device 10.
[0025] [Operation overview] Next, an outline of the operation of the information providing system according to the first embodiment will be described.
[0026] The traveling vehicle 20 moves (travels) within a tourist spot as shown in Fig. 3 based on instructions from the server device 10. As shown in Fig. 3, the tourist spot includes multiple tourist spots A to F. The traveling vehicle 20 is controlled to carry passengers (tourists) and travel around at least one or more tourist spots.
[0027] For example, in Fig. 3, tourists board a patrol vehicle 20 at a departure and arrival point. The patrol vehicle 20 carrying the tourists travels along the route shown by the dotted line, passing through tourist spots A to F. Note that although Fig. 3 illustrates one patrol vehicle 20, in reality, multiple patrol vehicles 20 travel around the tourist spots.
[0028] The server device 10 acquires information from inside the traveling vehicle 20 while the vehicle is moving, and analyzes the acquired information. The server device 10 provides information according to the analysis result to the passengers of the traveling vehicle 20. For example, the server device 10 provides the passengers with information about tourist spots to which the passengers have been guided and information about tourist spots to which the passengers are scheduled to be guided.
[0029] Fig. 4 is a plan view for explaining the internal configuration of patrol vehicle 20. As shown in Fig. 4, partitions 21-1 to 21-4 are installed in front of each of seats A to D of patrol vehicle 20. Furthermore, each partition 21 is equipped with a camera 22, a microphone 23, and a speaker 24 (see Fig. 5). As shown in Fig. 5, messages encouraging passengers to get on and off safely may be posted on partitions 21.
[0030] The devices (camera 22, microphone 23, speaker 24) embedded in each partition 21 are connected to a control device 40 shown in Fig. 4. The control device 40 is a device (module) that controls the entire patrol vehicle 20. More specifically, the control device 40 controls the movement of the patrol vehicle 20, controls devices such as the camera 22, controls communications between the server device 10 and the patrol vehicle 20, and the like.
[0031] The control device 40 transmits image data acquired from the camera 22 to the server device 10 periodically or at a predetermined timing.
[0032] The server device 10 detects that a passenger has taken a seat by analyzing the acquired image data.
[0033] The server device 10 determines a "representative" in the traveling vehicle 20. When there is only one passenger, the passenger becomes the representative. When there are multiple passengers seated, the server device 10 determines the "representative" by any method.
[0034] For example, the server device 10 determines the representative based on the seat location (front row, back row, right side in the traveling direction, left side). For example, in the example of Fig. 4, the server device 10 determines the person seated in seat D as the representative.
[0035] Alternatively, the server device 10 may estimate the attributes (gender, age) of the seated persons by analyzing image data, and determine the representative based on the estimated attributes, etc. For example, in the case of a family group, the server device 10 may designate the "father" as the representative, or the "children" as the representative, etc.
[0036] Once the representative has been determined, the server device 10 starts movement control (patrol control) of the patrol vehicle 20. For example, the server device 10 controls the patrol vehicle 20 so that it moves along the route shown by the dotted line in Fig. 3. The server device 10 notifies the patrol vehicle 20 of the destination of the patrol vehicle 20 (the coordinates of the destination tourist spot). The control device 40 controls the movement (straight ahead, stopping, etc.) of the patrol vehicle 20 so that it reaches the destination.
[0037] The server device 10 also manages the state and status of each traveling vehicle 20. For example, the server device 10 manages the state of the traveling vehicle 20, such as "guiding a tourist spot" or "moving to a tourist spot."
[0038] The server device 10 provides information according to the state of the traveling vehicle 20. For example, when the traveling vehicle 20 is guiding a tourist spot A, the server device 10 provides information about the tourist spot A. For example, if the tourist spot A is a historical building such as a "castle," the server device 10 provides the passengers of the traveling vehicle 20 with the history and background of the construction of the building.
[0039] When the tour guide for the tourist spots has finished, the server device 10 uses the microphone 23 and speaker 24 attached to the patrol vehicle 20 to talk to the representative. More specifically, the server device 10 asks the representative about his / her impressions of the tourist spots for which the tour guide has finished. For example, the server device 10 outputs a voice message such as "Were you satisfied with tourist spot A?" from the speaker 24.
[0040] At this time, the server device 10 acquires a face image (image data including a face image) and voice of the representative who answers the question. The server device 10 acquires image data of the representative who answers the question and voice data of the representative.
[0041] The server device 10 calculates the satisfaction level (representative satisfaction level) of the tourist spot that was guided by analyzing the image data and the voice data.
[0042] The server device 10 determines the information to be provided to the passengers of the touring vehicle 20 (passengers including the representative) according to the calculated satisfaction level. More specifically, the server device 10 changes the information (audio output from the speaker 24) to be provided on the way to the next tourist spot. For example, if the satisfaction level is high, the server device 10 provides more in-depth information on the tourist spot that has already been visited. If the satisfaction level is low, the server device 10 provides information that is unrelated to the tourist spot that has been visited (for example, a guide to the entire tourist spot).
[0043] Next, each device included in the information providing system according to the first embodiment will be described in detail.
[0044] [Control device] Fig. 6 is a diagram showing an example of a processing configuration (processing module) of the control device 40 according to the first embodiment. Referring to Fig. 6, the control device 40 includes a communication control unit 201, an operation control unit 202, a position information transmission unit 203, a device control unit 204, and a storage unit 205.
[0045] The communication control unit 201 is a means for controlling communication with other devices. For example, the communication control unit 201 receives data (packets) from the server device 10. The communication control unit 201 also transmits data to the server device 10. The communication control unit 201 passes the data received from the other devices to the other processing modules. The communication control unit 201 transmits data acquired from the other processing modules to the other devices. In this way, the other processing modules transmit and receive data to and from the other devices via the communication control unit 201. The communication control unit 201 has a function as a receiving unit that receives data from the other devices and a function as a transmitting unit that transmits data to the other devices.
[0046] The operation control unit 202 is a means for controlling the operation of the patrol vehicle 20. The operation control unit 202 controls the drive system (engine, brakes, steering wheel, etc.) of the patrol vehicle 20 so that the patrol vehicle 20 reaches the destination instructed by the server device 10. The operation control unit 202 controls the drive system in accordance with a "movement instruction" received from the server device 10. The movement instruction includes the coordinates (X coordinate, Y coordinate) of the destination, so the operation control unit 202 moves the patrol vehicle 20 to the coordinate position.
[0047] When the operation control unit 202 reaches the designated destination, it stops and waits until it receives a new movement instruction. When the operation control unit 202 receives a new movement instruction, it moves according to the instruction. Note that existing technology can be used for the automatic operation of the patrol vehicle 20, and since it is different from the purpose of the present disclosure, a detailed description will be omitted.
[0048] The location information transmission unit 203 is a means for transmitting the current location of the own device (the patrol vehicle 20) to the server device 10. The location information transmission unit 203 receives GPS signals from GPS (Global Positioning System) satellites to perform positioning, and generates location information including the latitude, longitude, and altitude of the patrol vehicle 20. Alternatively, the location information transmission unit 203 may generate the location information by using radio waves received from the base station 30.
[0049] The position information transmission unit 203 periodically or at a predetermined timing notifies the server device 10 of the generated position information (coordinate information). The position information transmission unit 203 transmits to the server device 10 a “current position notification” including the position information and the vehicle ID.
[0050] The vehicle ID is an ID for identifying each of the patrol vehicles 20 included in the information providing system. The vehicle ID may be a media access control (MAC) address or an internet protocol (IP) address of the patrol vehicle 20.
[0051] The device control unit 204 is a means for controlling each device (camera 22, microphone 23, speaker 24) embedded in the partition 21.
[0052] When there is no instruction from the server device 10 (when the state of the server device 10 is not the "conversation mode" described later), the device control unit 204 acquires image data from the camera 22 periodically or at a predetermined timing.
[0053] The device control unit 204 transmits the acquired image data to the server device 10. Specifically, the device control unit 204 transmits a "passenger image notification" including a vehicle ID, a seat ID, and image data to the server device 10. In this manner, the passenger image notification includes image data showing the seat (the passenger sitting in the seat).
[0054] The seat ID is an ID for identifying each seat in the traveling vehicle 20. A system administrator or the like determines a seat ID for each seat in the traveling vehicle and sets the seat ID in the control device 40.
[0055] The vehicle ID and the seat ID are shared between the server device 10 and the traveling vehicle 20 by any method. For example, a system administrator determines a seat ID and sets the determined seat ID in the server device 10. The system administrator also sets the determined seat ID in the control device 40.
[0056] If there is no passenger seated in a seat, the device control unit 204 does not need to transmit a passenger image notification related to that seat to the server device 10.
[0057] Furthermore, the device control unit 204 receives a "guidance voice output instruction" from the server device 10. The device control unit 204 outputs the voice data included in the instruction from the speaker 24 of each seat (or a seat where an occupant is seated).
[0058] When the state of the server device 10 is in the conversation mode, the device control unit 204 controls each device according to instructions from the server device 10. The device control unit 204 receives a "conversation start instruction" from the server device 10. The conversation start instruction includes the seat ID where the conversation partner (representative) will sit.
[0059] The device control unit 204 controls the microphone 23 and the speaker 24 so that the representative can have a conversation with the server device 10. The device control unit 204 also acquires image data of the representative who is having a conversation.
[0060] More specifically, during a conversation, the device control unit 204 outputs voice data acquired from the server device 10 from the speaker 24 corresponding to the seat specified by the server device 10. In addition, the device control unit 204 acquires voice data from the microphone 23 corresponding to the seat specified by the server device 10, and transmits the voice data to the server device 10.
[0061] During the conversation, the device control unit 204 also acquires image data from the camera 22 of the seat (seat ID included in the conversation start instruction) designated by the server device, and transmits the image data to the server device 10.
[0062] When the device control unit 204 receives the "conversation end instruction" from the server device 10, it ends the conversation with the representative.
[0063] The memory unit 205 is a means for storing information necessary for the operation of the patrol vehicle 20 .
[0064] [Server device] Fig. 7 is a diagram showing an example of a processing configuration (processing module) of the server device 10 according to the first embodiment. Referring to Fig. 7, the server device 10 includes a communication control unit 301, a vehicle position management unit 302, a representative determination unit 303, a vehicle operation control unit 304, a communication unit 305, an information provision unit 306, and a storage unit 307.
[0065] The communication control unit 301 is a means (communication unit) for controlling communication with other devices. For example, the communication control unit 301 receives data (packets) from the patrol vehicle 20. The communication control unit 301 also transmits data to the patrol vehicle 20. The communication control unit 301 passes the data received from the other devices to the other processing modules. The communication control unit 301 transmits data acquired from the other processing modules to the other devices. In this way, the other processing modules transmit and receive data to and from the other devices via the communication control unit 301. The communication control unit 301 has a function as a receiving unit that receives data from the other devices and a function as a transmitting unit that transmits data to the other devices.
[0066] The vehicle location management unit 302 is a means for managing the current location of the patrol vehicle 20. The vehicle location management unit 302 receives a "current location notification" from the patrol vehicle 20. The vehicle location management unit 302 stores the location information included in the notification in the vehicle management database (see FIG. 8). More specifically, the vehicle location management unit 302 identifies the patrol vehicle 20 from the vehicle ID included in the current location notification, and updates the current location field of the corresponding entry.
[0067] It should be noted that the vehicle management database shown in Fig. 8 is merely an example, and is not intended to limit the items to be stored, etc. For ease of understanding, the vehicle ID shown in Fig. 8 uses the symbol of the patrol vehicle 20, and the seat ID in which the representative sits uses the seat name (seats A to D) shown in Fig. 4.
[0068] The representative determination unit 303 is a means for determining a representative from among the passengers of the patrol vehicle 20. When there are multiple passengers on board the patrol vehicle 20, the representative determination unit 303 determines a representative from among the multiple passengers. For example, the representative determination unit 303 determines a representative by analyzing image data included in a "passenger image notification" received from each patrol vehicle 20 periodically or at a predetermined timing.
[0069] The representative determination unit 303 analyzes image data of each seat in the patrol vehicle 20 and determines whether or not a passenger is seated (occupied) in each seat. For example, the representative determination unit 303 can determine whether or not a passenger is seated by comparing image data (template) of an empty seat with image data of an image and audio notification.
[0070] For example, in the example of FIG. 4, the representative determination unit 303 recognizes that passengers are seated in each of seats B to D.
[0071] The representative determination unit 303 determines a representative from among the people seated in the patrol vehicle 20. The representative determination unit 303 determines the representative using any method. For example, the representative determination unit 303 determines the representative based on the seat position (front row, back row, right side in the direction of travel, left side). For example, in the example of FIG. 4, the person seated in seat D on the right side of the front row is selected as the representative.
[0072] Alternatively, the representative determination unit 303 may estimate attributes (e.g., gender, age) of each seated person by analyzing image data, and determine a representative based on the estimated attributes, etc. The representative determination unit 303 may use a learning model prepared in advance to estimate the attributes.
[0073] The learning model can be generated by machine learning using teacher data to which image data labels (attributes; for example, father, child) are assigned. Any algorithm, such as a support vector machine, boosting, or neural network, can be used to generate the learning model. Since the algorithm, such as the support vector machine, can use a known technique, a description thereof will be omitted.
[0074] For example, in the case of a family group, the representative determination unit 303 will select the "father" as the representative, or the "child" as the representative.
[0075] Alternatively, the representative determination unit 303 may determine the attribute of the seated person (father, mother, child) based on the seated person's clothing.
[0076] The representative determination unit 303 stores the seat position of the determined representative in the vehicle management database. In the example of Fig. 4, the person sitting in seat D is selected as the representative and is registered in the vehicle management database. Since the passenger image notification includes the seat ID of the subject of the image data capture, the representative determination unit 303 can grasp the relationship between the image data and the seat ID.
[0077] When the representative determination unit 303 determines the representative, it notifies the vehicle operation control unit 304 of the determination (representative selection completion) together with the vehicle ID of the corresponding patrol vehicle 20.
[0078] The vehicle operation control unit 304 is a means for instructing (controlling) the operation (movement) of the patrol vehicle 20. When the patrol vehicle 20 is an autonomous vehicle, the vehicle operation control unit 304 controls the operation of the patrol vehicle 20 by transmitting to the patrol vehicle 20 a "movement instruction" including the destination of the patrol vehicle 20. The vehicle operation control unit 304 transmits to the patrol vehicle 20 a movement instruction including the vehicle ID of the patrol vehicle 20 to be controlled and the destination coordinates (X coordinate, Y coordinate) of the patrol vehicle.
[0079] The vehicle operation control unit 304 starts controlling the movement of the patrol vehicle 20 for which the representative has been determined (the patrol vehicle 20 into which the passenger boarded at the departure and arrival point). The vehicle operation control unit 304 controls the patrol vehicle 20 to move to a predetermined tourist spot, stop in front of the predetermined tourist spot for a certain period of time, and move to the next predetermined tourist spot.
[0080] In the example of Fig. 3, the patrol vehicle 20 travels to tourist spot A and stops there for a certain period of time (or travels around tourist spot A at a low speed). After that, the patrol vehicle 20 travels toward the next tourist spot B. The vehicle operation control unit 304 transmits a movement instruction to the patrol vehicle 20 to be controlled so that the patrol vehicle 20 travels (travels) in this manner.
[0081] The vehicle operation control unit 304 obtains the destination (tourist attraction to be guided) from the route described in the route field of the vehicle management database. In the example of Fig. 8, the vehicle operation control unit 304 controls the patrol vehicle 20 to visit tourist attractions A to F in that order. The vehicle operation control unit 304 can obtain the coordinates of each tourist attraction by referring to table information that stores the tourist attraction in association with its coordinates (X coordinate, Y coordinate).
[0082] The route shown in FIG. 8 is merely an example, and is not intended to limit the travel route of the patrol vehicle 20. As shown in FIG. 8, it is not necessary to visit each tourist spot included in the tourist destination. For example, a route that visits some of the tourist spots may be registered in the vehicle management database. Alternatively, the order of the tourist spots to be visited may differ depending on the patrol vehicle 20. For example, a route that guides the tourist spots in the order of "A, B, C, D, E, F" and a route that guides the tourist spots in the order of "A, F, E, D, C, B" may be registered.
[0083] Furthermore, the vehicle operation control unit 304 calculates the state of the patrol vehicle 20 based on the current position of the patrol vehicle 20 and the contents of the movement instruction. For example, the vehicle operation control unit 304 instructs the patrol vehicle 20 to move to tourist spot A, and if the position of the patrol vehicle 20 is at the coordinate position of tourist spot A, it determines that the patrol vehicle 20 is guiding the tourist spot A. Furthermore, the vehicle operation control unit 304 instructs the patrol vehicle 20 to move to tourist spot B, and if the patrol vehicle 20 has not yet reached tourist spot B, it determines that the state of the patrol vehicle 20 is moving to tourist spot B.
[0084] The vehicle operation control unit 304 reflects the determined state of the patrol vehicle 20 in the state field of the vehicle management database. For example, as shown in Fig. 8, when the patrol vehicle 20 reaches tourist spot A and stops temporarily, a setting such as "guiding tourist spot A" is written in the state field.
[0085] Here, the operation modes (control modes) of the server device 10 for the patrol vehicle 20 include two modes, a "normal mode" and a "conversation mode." The default mode is the "normal mode."
[0086] The operation mode while the touring vehicle 20 is guiding passengers around the tourist spots is the normal mode. Specifically, the server device 10 is set to the normal mode while it is providing information to passengers of the touring vehicle 20. For example, the control mode is the normal mode from when the touring vehicle 20 arrives at a tourist spot, provides passengers with information about the tourist spot, and until the touring vehicle 20 leaves the tourist spot. In other words, the normal mode is also set for the time from when the touring vehicle 20 arrives at the tourist spot, when the passengers get off the touring vehicle 20, tour the tourist spot, and then get on the touring vehicle 20.
[0087] When the patrol vehicle 20 finishes guiding the tourist spot (when it leaves the tourist spot and heads to the next tourist spot), the mode is switched from the "normal mode" to the "conversation mode".
[0088] Thus, in the normal mode (guidance mode), the server device 10 (traveling vehicle 20) outputs a one-sided guidance voice, and there is no conversation between the server device 10 and the passenger (representative). In the normal mode (guidance mode), for example, the traveling vehicle 20 stops in front of a tourist spot and provides information such as tourist information to the passengers inside the vehicle. After the tourist information is finished, a free time is set, and the passengers may get off the traveling vehicle 20 and visit the tourist spots. On the other hand, in the conversation mode, after the tourist information by the traveling vehicle 20 is finished, or when the passengers who have returned from the tourist spots after the free time has ended get on the traveling vehicle 20, the traveling vehicle 20 starts moving toward the next tourist spot. At the timing when the traveling vehicle 20 starts moving, the operation mode is switched from the normal mode (guidance mode) to the conversation mode, the satisfaction level of the tourist spot where the guidance has been finished is analyzed, and processing according to the satisfaction level (for example, changing the content of the information provided, changing the destination) is performed.
[0089] The communication unit 305 is a means for communicating with passengers of the patrol vehicle 20, particularly with the representative. Fig. 9 is a diagram showing an example of a processing configuration of the communication unit 305 according to the first embodiment. As shown in Fig. 9, the communication unit 305 includes sub-modules including a guidance end detection unit 351, a conversation unit 352, and a satisfaction level calculation unit 353.
[0090] The guidance end detection unit 351 is a means for detecting when the touring vehicle 20 has finished guiding the tourist spots. The guidance end detection unit 351 monitors (polls) the status field of the vehicle management database, and detects a change in the setting value of the status field from "guiding" to "moving."
[0091] For example, the guidance end detection unit 351 detects that the setting value in the status field has changed from "guiding to tourist spot A" to "moving to tourist spot B." When it detects that the guidance has ended, the guidance end detection unit 351 notifies the conversation unit 352 of the tourist spot where the guidance has ended. In addition, the guidance end detection unit 351 sets the operation mode for the traveling vehicle 20 for which the guidance has ended to "conversation mode."
[0092] The conversation unit 352 is a means for conversing with passengers (representatives) of the patrol vehicle 20. The conversation unit 352 asks the passengers of the patrol vehicle 20 about their impressions of the spots that the patrol vehicle 20 has guided them to, and acquires responses from the passengers of the patrol vehicle 20. The conversation unit 352 refers to the vehicle management database and identifies the representative of the patrol vehicle 20 for which the guidance has finished (the seat in which the representative sits).
[0093] The conversation unit 352 transmits a “conversation start instruction” including the vehicle ID of the patrol vehicle 20 and the seat ID of the identified seat to the target patrol vehicle 20.
[0094] After transmitting the instruction to start conversation, the conversation unit 352 transmits to the traveling vehicle 20 voice data such as asking about the impressions of the tourist spot where the tour has been completed. For example, in the above example, the conversation unit 352 transmits to the traveling vehicle 20 voice data such as "Were you satisfied with tourist spot A?"
[0095] Furthermore, in response to transmitting the above voice data (question regarding impressions of tourist spots), the conversation unit 352 acquires voice data regarding the response and image data of the representative from the patrol vehicle 20. The conversation unit 352 passes the acquired voice data and image data to the satisfaction level calculation unit 353. In the following description, the voice data and image data regarding the passenger's response to the question from the conversation unit 352 are referred to as "voice and image data at the time of response."
[0096] When the conversation ends (when the answering voice image data is acquired), the conversation unit 352 transmits a "conversation end instruction" including the vehicle ID of the patrol vehicle 20 to the patrol vehicle 20. In addition, the conversation unit 352 sets the operation mode to the "normal mode."
[0097] In this way, the conversation unit 352 starts a conversation with the representative when the traveling vehicle 20 finishes guiding the tourist spots. At that time, the conversation unit 352 transmits voice data corresponding to a question for the representative to the traveling vehicle 20. The conversation unit 352 receives voice data and image data at the time of answering the question from the traveling vehicle 20 as a response from a passenger (representative) of the traveling vehicle 20.
[0098] The satisfaction calculation unit 353 is a means for calculating the satisfaction of passengers with respect to tourist spots guided by the traveling vehicle 20. The satisfaction calculation unit 353 calculates the satisfaction of passengers of the traveling vehicle 20 with respect to the guided places (spots, tourist spots) based on answers from the passengers of the traveling vehicle 20. The satisfaction calculation unit 353 inputs the above acquired answering voice image data (voice data and image data when the representative answers the question) into a learning model prepared in advance, thereby acquiring the satisfaction of the person answering the question (the representative's satisfaction with the guided tourist spots).
[0099] The learning model can be obtained by preparing a large amount of image data and voice data to which labels (quantified satisfaction levels) are attached, and learning using the large amount of image data and voice data as training data. For example, high satisfaction levels are attached as labels to image data and voice data with smiling faces and bright tones, and low satisfaction levels are attached as labels to image data and voice data with smiling faces and dark tones that show dissatisfaction in their hearts.
[0100] By using the learning model generated in this manner, the satisfaction level calculation unit 353 can grasp the satisfaction level of the passenger (representative) more accurately.
[0101] The satisfaction level calculation unit 353 sets the calculated satisfaction level in the satisfaction level field of the vehicle management database.
[0102] The information providing unit 306 is a means for providing information to passengers of the traveling vehicle 20. For example, the information providing unit 306 determines information to be provided to passengers of the traveling vehicle 20 based on the degree of satisfaction calculated by the satisfaction level calculation unit 353. The information providing unit 306 realizes the above-mentioned information provision by transmitting a "guidance voice output instruction" to the traveling vehicle 20 in the normal mode.
[0103] The information providing unit 306 accesses the vehicle management database and refers to the entry of the patrol vehicle 20 to which information is to be provided. The information providing unit 306 reads the satisfaction degree from the satisfaction degree field of the entry. If the satisfaction degree field is blank (no set value), the information providing unit 306 provides information using a predetermined voice.
[0104] For example, since the satisfaction level has not been calculated before the patrol vehicle 20 finishes guiding the tourist spot A, the information provision unit 306 provides information about the tourist spot A. More specifically, the information provision unit 306 transmits to the patrol vehicle 20 a guidance voice output instruction including previously prepared voice data and the vehicle ID of the target patrol vehicle 20.
[0105] On the other hand, if a satisfaction level is set in the satisfaction level field of the identified entry, the information provision unit 306 determines information to be provided during movement to the next tourist spot according to the satisfaction level. More specifically, the information provision unit 306 changes the voice data to be transmitted to the traveling vehicle 20 according to the satisfaction level.
[0106] The information providing unit 306 refers to a provided voice database that stores destinations, satisfaction levels, and provided voice data (information to be provided) in association with each other, and acquires the voice data to be transmitted to the patrol vehicle 20 (see FIG. 10). Note that the provided voice database shown in FIG. 10 is merely an example, and is not intended to limit the items to be stored.
[0107] The system administrator decides the voice data to be provided to passengers (contents to be provided as voice data) taking into consideration the tourist spots guided by the patrol vehicle 20 and the degree of satisfaction. The system administrator simply registers the decided voice data in the provided voice database.
[0108] For example, if the satisfaction level is high, voice data of more in-depth information on the tourist spot that has been guided to is registered. If the satisfaction level is low, voice data of information unrelated to the tourist spot that has been guided to (information unrelated to the tourist spot; for example, information on the entire tourist spot, information on the next tourist spot, etc.) is registered. That is, if the calculated satisfaction level is equal to or higher than a first threshold, the information providing unit 306 provides information on the tourist spot that has been guided to the passenger by the traveling vehicle 20. If the calculated satisfaction level is equal to or lower than a second threshold, the information providing unit 306 provides information unrelated to the tourist spot that has been guided to the passenger by the traveling vehicle 20.
[0109] In the example of Fig. 10, if the satisfaction level for tourist spot A is high (e.g., satisfaction level is 70% or higher), the information providing unit 306 provides information using voice data B1. If the satisfaction level for tourist spot A is low (e.g., satisfaction level is 30% or lower), the information providing unit 306 provides information using voice data B3. If the satisfaction level for tourist spot A is average (medium; e.g., satisfaction level is higher than 30% and lower than 70%), the information providing unit 306 provides information using voice data B2.
[0110] The storage unit 307 is a means for storing information necessary for the operation of the server device 10. In the storage unit 307, a vehicle management database and a provided voice database are constructed.
[0111] [System Operation] Next, a description will be given of the operation of the information providing system according to the first embodiment. Fig. 11 is a sequence diagram showing an example of the operation of the information providing system according to the first embodiment.
[0112] When a passenger gets on the traveling vehicle 20, the traveling vehicle 20 acquires image data of each seat. The traveling vehicle 20 transmits a passenger image notification including the captured image data to the server device 10 (step S01).
[0113] The server device 10 analyzes the image data acquired by the passenger image notification to determine the representative based on the situation in which the passengers boarded the traveling vehicle 20 (step S02).
[0114] When the representative is determined, the server device 10 starts the movement of the touring vehicle 20 (movement to the tourist spots; tour) (step S03).
[0115] The server device 10 provides various information on the way to the tourist spot and after arriving at the tourist spot. The server device 10 transmits voice data to the traveling vehicle 20 in response to a guidance voice output instruction (step S04).
[0116] The touring vehicle 20 outputs the voice guidance acquired from the server device 10 (step S05).
[0117] When the tourist spot guidance is completed, the server device 10 starts a conversation with the representative. The server device 10 transmits a conversation start instruction to the traveling vehicle 20 (step S06).
[0118] The server device 10 transmits a question to the representative of the touring vehicle 20 (step S07). The server device 10 transmits voice data to the touring vehicle 20 asking about the impressions of the tourist spots for which the tour has been completed.
[0119] The patrol vehicle 20 transmits the answer of the representative (step S08). The patrol vehicle 20 transmits the answering voice image data to the server device 10.
[0120] The server device 10 transmits a conversation end instruction to the traveling vehicle 20 (step S09).
[0121] The server device 10 calculates the satisfaction level of the representative (step S10).
[0122] The server device 10 determines, based on the calculated satisfaction level of the representative, information to be provided to the passengers of the traveling vehicle 20. The server device 10 transmits a guidance voice output instruction including the determined information (voice data) to the traveling vehicle 20 (step S11).
[0123] The touring vehicle 20 outputs the voice guidance acquired from the server device 10 (step S12).
[0124] As described above, the server device 10 according to the first embodiment asks the representative about his / her impressions of the tourist spots visited by the traveling vehicle 20. The server device 10 calculates the representative's satisfaction with the visited tourist spots based on the representative's response. The server device 10 changes the services provided to passengers of the traveling vehicle 20 according to the calculated satisfaction. In this way, the server device 10 can change the services provided to passengers according to their satisfaction, thereby improving passenger satisfaction.
[0125] Furthermore, the server device 10 according to the first embodiment calculates the satisfaction level of the answerer (representative) according to the facial expression and tone of voice of the answerer. That is, the server device 10 does not calculate the satisfaction level simply by image analysis (whether the representative is smiling or not), but calculates the satisfaction level taking into consideration the voice data at the time of answering the question. As a result, a highly accurate estimation of satisfaction level is realized even in cases where the person is smiling on the surface but is not satisfied deep down, or where the change in facial expression indicates that the person is very satisfied deep down.
[0126] Furthermore, the traveling vehicle 20 according to the first embodiment provides information to passengers by outputting audio from the speaker 24. Because the information is provided by audio, the information providing system according to the first embodiment (server device 10, traveling vehicle 20) can provide useful information to passengers without interfering with sightseeing by the passengers.
[0127] [Second embodiment] Next, the second embodiment will be described in detail with reference to the drawings.
[0128] In the first embodiment, it has been described that the server device 10 calculates the satisfaction level of a passenger and changes the information provided to the passenger in accordance with the calculated satisfaction level. In the second embodiment, it will be described that the server device 10 changes the destination of the traveling vehicle 20 in accordance with the calculated satisfaction level.
[0129] The configuration of the information provision system according to the second embodiment can be the same as that of the first embodiment, and therefore the description corresponding to Fig. 2 will be omitted. Also, the processing configuration of the patrol vehicle 20 according to the second embodiment can be the same as that of the first embodiment, and therefore the description thereof will be omitted.
[0130] The following description will focus on the differences between the first and second embodiments.
[0131] Fig. 12 is a diagram showing an example of a processing configuration (processing module) of the server device 10 according to the second embodiment. Referring to Fig. 12, a destination determination unit 308 is added to the configuration of the server device 10 according to the first embodiment.
[0132] When the satisfaction level calculation unit 353 according to the second embodiment finishes calculating the satisfaction level, it passes the vehicle ID and the generated satisfaction level to the destination determination unit 308.
[0133] The destination determination unit 308 is a means for determining a destination (a tourist spot to be a destination) according to the passenger's satisfaction level. The destination determination unit 308 determines a tourist spot to be a destination of the traveling vehicle 20 based on the satisfaction level calculated by the satisfaction level calculation unit 353. That is, when the destination determination unit 308 obtains the satisfaction level from the satisfaction level calculation unit 353, the destination determination unit 308 determines a destination of the traveling vehicle 20 according to the satisfaction level.
[0134] The destination determination unit 308 refers to a destination determination table that stores the tourist spot from which the vehicle 20 travels, the degree of satisfaction with the tourist spot from which the vehicle travels, and the destination in association with each other, and determines the destination of the touring vehicle 20 (see FIG. 13). For example, the tourist spot guided by the touring vehicle 20 is "Tourist Spot A." In this case, if the degree of satisfaction with Tourist Spot A is high, "Tourist Spot C" is selected as the next tourist spot. On the other hand, if the degree of satisfaction with Tourist Spot A is low, "Tourist Spot D" is selected as the next tourist spot.
[0135] The destination determination unit 308 reflects the destination (the next tourist spot to be guided) determined according to the satisfaction level in the vehicle management database (see FIG. 14). As shown in FIG. 14, the vehicle management database according to the second embodiment includes a destination field instead of or in addition to the tour route field.
[0136] The destination determination unit 308 sets the destination determined according to the destination determination table in the destination field of the vehicle management database.
[0137] The vehicle operation control unit 304 according to the second embodiment instructs the traveling vehicle 20 to move to the set destination.
[0138] [System Operation] Next, the operation of the information providing system according to the second embodiment will be described. Fig. 15 is a sequence diagram showing an example of the operation of the information providing system according to the second embodiment. Note that the operation up to the calculation of the satisfaction level can be the same as the operation of the first embodiment, and therefore the description will be omitted.
[0139] After calculating the satisfaction level (step S20), the server device 10 determines the next destination according to the calculated satisfaction level (step S21). For example, if the satisfaction level of the introduced tourist spot is high, the server device 10 sets a tourist spot similar to the tourist spot as the next destination. Alternatively, if the satisfaction level of the introduced tourist spot is low, the server device 10 sets a tourist spot that is less related to the tourist spot as the next destination.
[0140] The server device 10 moves the traveling vehicle 20 to the set destination. The server device 10 transmits a movement instruction including the coordinates of the destination to the traveling vehicle 20 (step S22).
[0141] The patrol vehicle 20 moves to the instructed destination (tourist spot) (step S23).
[0142] In the second embodiment, similarly to the first embodiment, the information provided to the passengers of the touring vehicle 20 may be changed depending on the satisfaction level of the representative.
[0143] As described above, the server device 10 according to the second embodiment changes tourist spots to which a passenger is guided depending on the passenger's satisfaction level. Therefore, the server device 10 can guide a passenger to tourist spots that are likely to make the passenger more satisfied, or guide a passenger with low satisfaction to tourist spots that are likely to increase the satisfaction level.
[0144] [Third embodiment] Next, the third embodiment will be described in detail with reference to the drawings.
[0145] In the first and second embodiments, the passengers are assumed to board the traveling vehicle 20 without any prior preparation. In the third embodiment, a case is described in which the passengers register their own biometric information, personal information, attribute information, hobbies, interests, etc. in the server device 10 in advance. In the third embodiment, a case is described in which the passengers are identified by a matching process using the biometric information, and information is provided based on the attributes, etc. of the identified passengers.
[0146] The configuration of the information provision system according to the third embodiment can be the same as that of the first embodiment, and therefore the description corresponding to Fig. 2 will be omitted. Also, the processing configuration of the patrol vehicle 20 according to the third embodiment can be the same as that of the first embodiment, and therefore the description thereof will be omitted.
[0147] The following description will focus on the differences between the first to third embodiments.
[0148] Fig. 16 is a diagram showing an example of a processing configuration (processing module) of the server device 10 according to the third embodiment. Referring to Fig. 16, a user registration unit 309 is added to the configuration of the server device 10 according to the second embodiment.
[0149] The user registration unit 309 is a means for acquiring biometric information, personal information, etc. of a user who plans to visit a tourist spot, and registering the user. For example, the user registration unit 309 acquires the above biometric information, etc. from a user who accesses a website operated by a tourist center or the like of the tourist spot.
[0150] The user registration unit 309 displays a GUI (Graphical User Interface), an input form, and the like, for inputting biometric information, personal information, etc., on the user's terminal. The user operates the terminal to input the biometric information (e.g., a face image), personal information, etc., to the server device 10.
[0151] The user registration unit 309 generates a feature amount (a feature vector consisting of a plurality of feature amounts) from the face image acquired from the terminal.
[0152] Since existing technology can be used for the process of generating the feature amount, a detailed description thereof will be omitted. For example, the user registration unit 309 extracts the eyes, nose, mouth, etc. as feature points from the face image. After that, the user registration unit 309 calculates the position of each feature point and the distance between each feature point as feature amounts, and generates a feature vector (vector information that characterizes the face image) consisting of multiple feature amounts.
[0153] Furthermore, the user registration unit 309 generates a user ID for identifying the user. The user ID may be any information that can uniquely identify a registered user. For example, the user registration unit 309 may assign a unique value each time a user is registered as the user ID.
[0154] The user registration unit 309 associates the generated user ID, feature amount (biometric information), personal information, etc., and stores them in a user information database (see FIG. 17). That is, the storage unit 307 stores the biometric information and attribute information of each of a plurality of users in association with each other. Note that the user information database shown in FIG. 17 is merely an example, and is not intended to limit the items to be stored. For example, a "face image" may be registered in the user information database as biometric information.
[0155] The representative determination unit 303 according to the third embodiment determines a representative by the method described in the first embodiment. After that, the representative determination unit 303 identifies the representative by a matching process using image data of the determined representative and biometric information registered in the user information database.
[0156] The representative determination unit 303 identifies attribute information corresponding to passengers of the patrol vehicle 20 by biometric authentication using biometric information generated from image data received from the patrol vehicle 20 and the stored biometric information. Specifically, the representative determination unit 303 extracts a face image from the image data of the representative, and generates features from the face image. The representative determination unit 303 sets the generated features as a comparison target, and performs a comparison process with the features registered in the user information database.
[0157] More specifically, the representative determination unit 303 calculates the similarity between the feature amount (feature vector) to be matched and each of the multiple feature amounts on the registration side. The similarity can be calculated using chi-square distance, Euclidean distance, or the like. Note that the greater the distance, the lower the similarity, and the closer the distance, the higher the similarity.
[0158] The representative determination unit 303 identifies a user (entry) whose similarity is equal to or greater than a predetermined value and whose feature has the highest similarity as the representative. The representative determination unit 303 sets the user ID of the identified representative in the representative field of the vehicle management database (see FIG. 18).
[0159] When providing information to passengers of the patrol vehicle 20, the information providing unit 306 according to the third embodiment changes the information to be provided depending on the representative's satisfaction level and attributes (e.g., gender, age, hobbies and interests). For example, the information to be provided may differ depending on the gender and satisfaction level. In this case, information such as that shown in FIG. 19 is registered in the provided voice database according to the third embodiment.
[0160] The information providing unit 306 searches the user information database using the representative's user ID as a key, and acquires the representative's attributes (gender, age, hobbies, interests, etc.). The information providing unit 306 refers to the provided voice database, and specifies the voice data to be provided as information according to the acquired attribute values and satisfaction level.
[0161] As described above, the server device 10 according to the third embodiment determines information to be provided to passengers of the traveling vehicle 20 based on the attributes of the passengers of the traveling vehicle 20 and the calculated satisfaction level. Since the information to be provided to the passengers is determined taking into consideration not only the satisfaction level but also the attributes of the representative, it is possible to provide information that is more useful to passengers (that can increase their satisfaction).
[0162] Next, the hardware of each device constituting the information providing system will be described. Fig. 20 is a diagram showing an example of the hardware configuration of the server device 10.
[0163] The server device 10 can be configured by an information processing device (so-called a computer), and has the configuration exemplified in Fig. 20. For example, the server device 10 has a processor 311, a memory 312, an input / output interface 313, a communication interface 314, etc. The components such as the processor 311 are connected by an internal bus or the like, and are configured to be able to communicate with each other.
[0164] However, the configuration shown in Fig. 20 is not intended to limit the hardware configuration of the server device 10. The server device 10 may include hardware not shown, and may not include the input / output interface 313 as necessary. In addition, the number of processors 311 and the like included in the server device 10 is not intended to be limited to the example shown in Fig. 20, and for example, the server device 10 may include multiple processors 311.
[0165] The processor 311 is, for example, a programmable device such as a central processing unit (CPU), a micro processing unit (MPU), or a digital signal processor (DSP). Alternatively, the processor 311 may be a device such as a field programmable gate array (FPGA), or an application specific integrated circuit (ASIC). The processor 311 executes various programs including an operating system (OS).
[0166] The memory 312 is a random access memory (RAM), a read only memory (ROM), a hard disk drive (HDD), a solid state drive (SSD), etc. The memory 312 stores an OS program, application programs, and various data.
[0167] The input / output interface 313 is an interface for a display device and an input device (not shown). The display device is, for example, a liquid crystal display, etc. The input device is, for example, a keyboard, a mouse, etc. that accepts user operations.
[0168] The communication interface 314 is a circuit, a module, etc. that communicates with other devices. For example, the communication interface 314 includes a network interface card (NIC).
[0169] The functions of the server device 10 are realized by various processing modules. The processing modules are realized, for example, by the processor 311 executing a program stored in the memory 312. The program can be recorded in a computer-readable storage medium. The storage medium can be a non-transitory medium such as a semiconductor memory, a hard disk, a magnetic recording medium, or an optical recording medium. That is, the present invention can also be embodied as a computer program product. The program can be downloaded via a network or updated using a storage medium storing the program. The processing modules may also be realized by a semiconductor chip.
[0170] Like the server device 10, the control device 40 can also be configured by an information processing device, and the basic hardware configuration is the same as that of the server device 10, so a description thereof will be omitted. Also, the hardware configuration of the patrol vehicle 20 can be the same as that of an existing autonomous vehicle, so a description thereof will be omitted.
[0171] The server device 10, which is an information processing device, is equipped with a computer, and can realize the functions of the server device 10 by causing the computer to execute a program. The server device 10 also executes a control method for the server device 10 by the program.
[0172] [Variations] The configuration, operation, and the like of the information providing system described in the above embodiment are merely examples, and are not intended to limit the system configuration, and the like.
[0173] In the above embodiment, the predetermined area patrolled by the traveling vehicle 20 is described as a tourist spot, but the predetermined area is not limited to a tourist spot. For example, the traveling vehicle 20 may patrol a facility such as a theme park, a zoo, or an aquarium. For example, when the traveling vehicle 20 patrols a zoo, the server device 10 may change the content of the information provided based on the impressions of the animal that was guided, or may select the next animal to guide.
[0174] The server device 10 can analyze the image data included in the passenger image notification, and if the passenger is performing a dangerous action (e.g., sticking a hand or face out of the window), provide information to stop the dangerous action. For example, the information providing unit 306 inputs the image data into a learning model and obtains a conclusion as to whether the passenger's action is dangerous or not. If the passenger is performing a dangerous action, the information providing unit 306 instructs (warns) the passenger to stop the dangerous action via the speaker 24.
[0175] In the above embodiment, a representative is selected from among a plurality of passengers, and information is provided or spots to be guided are changed based on the satisfaction level (impressions, opinions) of the representative. However, the server device 10 may calculate the satisfaction level of each passenger, calculate the consensus of the plurality of passengers from the calculated satisfaction level (satisfaction level of all passengers), and use it for providing information, etc. Specifically, the satisfaction level calculation unit 353 may calculate the average satisfaction level of each passenger and treat it as the satisfaction level of multiple passengers (for example, a family). In this way, the server device 10 may calculate the satisfaction level based on conversations with multiple passengers, not limited to the representative.
[0176] In the above embodiment, the representative's answer (voice image data at the time of answering) to an inquiry (question) about the impression of the tourist spot is input into a learning model to calculate the satisfaction level of the representative. However, the server device 10 may input the voice data and the image data into different learning models to obtain a smile score and an emotion score. The smile score is information that quantifies the degree of smile. The emotion score is information that quantifies the emotion of the speaker based on the speech state of the voice. For example, even if the pronunciation is "It was fun," the emotion score is data that quantifies whether it was really fun or boring depending on the way of speaking. The server device 10 may calculate the satisfaction level for the experience (the tourist spot to which the representative was guided) based on the two scores (smile score, emotion score). For example, the server device 10 may calculate the sum of the smile score and the emotion score as the satisfaction level, or may calculate the multiplication result of the smile score and the emotion score as the satisfaction level.
[0177] The server device 10 may have more conversations (complex conversations) rather than just a simple conversation such as asking the passenger (representative) about his / her impressions of the tourist spots, and may calculate the satisfaction level based on the exchanges in the conversation. For example, the server device 10 may talk to the representative for a longer period of time by asking about detailed impressions rather than just asking about the overall impressions of the tourist spots. The server device 10 may calculate the satisfaction level based on the content of the long conversation, the representative's facial expression, voice, and the like. In this way, the server device 10 may not only directly inquire the representative about whether or not he / she is satisfied, but also determine whether or not the representative is truly satisfied based on the content of the conversation and facial expression. That is, the server device 10 may estimate the satisfaction level from the content of the conversation (what the representative is saying), the timing of the conversation, or facial expression (smile score obtained by smile estimation).
[0178] The server device 10 may calculate the satisfaction level using information other than the facial expression (image) and voice of the passenger. For example, the server device 10 may calculate the satisfaction level using vital data of the passenger (representative) instead of or in addition to the facial expression and voice. In this case, the passenger of the patrol vehicle 20 wears a portable terminal capable of acquiring vital data such as heart rate, pulse, and sweat. The portable terminal transmits the representative's vital data (vital data of the representative when talking with the server device 10) to the server device 10 via the control device 40. The satisfaction level calculation unit 353 of the server device 10 acquires the satisfaction level by inputting the voice, image, and vital data into a learning model prepared in advance. The satisfaction level acquired in this way more accurately reflects the representative's impressions, and the server device 10 can provide more useful information to the passengers.
[0179] In the above embodiment, a case has been described in which passenger facial expressions, voices, and the like are acquired by devices (camera 22, microphone 23) installed in the patrol vehicle 20. However, such information may be acquired by MR (Mixed Reality) glasses worn by the passenger. The server device 10 may calculate the satisfaction level based on the information acquired by the MR glasses.
[0180] Alternatively, the facial expression, voice, etc. may be acquired by a terminal (e.g., a smartphone, etc.) carried by the user. The terminal acquires image data and voice data including the facial expression and voice of the user by devices such as a camera and a microphone equipped in the terminal. The terminal may transmit the acquired image data and voice data to the control device 40 by Bluetooth (registered trademark) or the like, and the control device 40 may transmit the image data, etc. to the server device 10. Alternatively, the terminal may transmit the image data, etc. directly to the server device 10. In this case, a number or the like may be attached to each seat of the patrol vehicle 20 to make each seat identifiable. In other words, by configuring the image data captured by the terminal to include seat identification information, it becomes possible to identify the seat position corresponding to the image transmitted from the terminal (smartphone).
[0181] The server device 10 may analyze image data included in the passenger image notification and change the information to be provided depending on the passenger's state (e.g., standing, sitting). The scenery and views that a passenger who is standing and sightseeing at tourist spots can see are different from the scenery and views that a passenger who is sitting and sightseeing at tourist spots can see, and the server device 10 may provide information corresponding to the different scenery and views.
[0182] In addition to providing information about tourist spots, the server device 10 may provide passengers with information associated with sightseeing at the tourist spots. For example, when providing information at the end of a route tour, the server device 10 may provide passengers with recommended information about meals. For example, the server device 10 may provide passengers with information about Japanese restaurants, Chinese restaurants, and the like. Alternatively, as in the third embodiment, when attribute information of passengers (e.g., country of origin, etc.) is registered, the server device 10 may provide information according to the attribute information. For example, the server device 10 may provide information about restaurants that foreigners like. Alternatively, the server device 10 may change the content of the information provided depending on the time of day, etc., when providing the information.
[0183] Even if there is no user registration as described in the third embodiment, the server device 10 may identify a passenger using biometric authentication (face authentication). The server device 10 (representative determination unit 303) identifies a passenger by biometric authentication and assigns an ID to the identified passenger. The server device 10 may store the passenger ID, biometric information (face image, feature amount), and satisfaction history assigned to the passenger in association with each other. For example, the server device 10 (satisfaction calculation unit 353) stores the passenger ID, biometric information, and satisfaction history in the passenger information database in association with each other (see FIG. 21). As shown in FIG. 21, the server device 10 stores the satisfaction history for each passenger, with a set of a tourist spot introduced to the passenger (representative) and the satisfaction level for the tourist spot as an element. For example, when a passenger visits the same tourist spot on another occasion, the server device 10 may identify the passenger's history by biometric authentication and use the history to provide information to the passenger.
[0184] Furthermore, the server device 10 can handle seat changes by using biometric authentication. For example, it is assumed that passengers get off at a specific tourist spot and get back on the traveling vehicle 20 at the same spot. In that case, even if the passengers do not sit in the same seat, the server device 10 can continue a conversation with the representative by identifying the representative through biometric authentication.
[0185] The server device 10 may analyze the satisfaction level (satisfaction level history) of passengers and provide useful information to the operator (manager) of the tourist spot or theme park. In this case, the server device 10 includes a history analysis unit 310 as shown in FIG. 22. The history analysis unit 310 generates useful information for the operator, etc., and provides the generated information to the operator. For example, the history analysis unit 310 calculates the average satisfaction level for each tourist spot. The history analysis unit 310 generates a graph as shown in FIG. 23 based on the calculated average satisfaction level and presents it to the operator, etc. The operator (manager) who comes into contact with the information as shown in FIG. 23 may review the travel route of the traveling vehicle 20 or change the information to be provided to passengers. For example, the operator considers measures to improve the satisfaction level of tourist spots with low satisfaction levels, such as tourist spots B and D. Alternatively, the server device 10 may present the satisfaction level of passengers in real time. That is, the server device 10 may display the satisfaction level of the representative of each traveling vehicle 20 in operation in real time. The server device 10 can provide the operator, etc. with information on the degree of satisfaction of passengers with each tourist spot. In this way, the operator can know the passengers' true impressions and satisfaction levels without using a questionnaire or the like to collect satisfaction with tourist spots. Alternatively, the operator can learn of the existence of tourist spots that are attracting the interest of users and that the operator itself is not aware of.
[0186] When a user registers in advance as in the third embodiment, the server device 10 may calculate the satisfaction level for each attribute of the user and present it to the administrator, etc. For example, the server device 10 may calculate the average satisfaction level for each generation and age for each tourist spot and present it to the administrator, etc.
[0187] In the above embodiment, the server device 10 may provide the operator with information useful for the management of the tourist spot using the satisfaction level (impressions of the guided spots) acquired from the passengers of the patrol vehicle 20. The server device 10 may calculate information that can be used to review the number of patrol vehicles 20, their routes, and the content provided to the patrol vehicles 20 according to the calculated satisfaction level, and provide the information to the operator. For example, the server device 10 provides the operator with the satisfaction level for each weather. According to the information, the operator operates the site by increasing the number of patrol vehicles 20 on days with weather that is high in satisfaction and decreasing the number of patrol vehicles 20 on days with weather that is low in satisfaction. Alternatively, if there is a tourist spot whose satisfaction level changes significantly depending on the weather, the server device 10 provides the operator with the information. The operator takes measures such as setting a tour course that excludes the tourist spots with low satisfaction on days with weather that is low in satisfaction.
[0188] The server device 10 may be adapted to a passenger's transfer (change of vehicles) of the patrol vehicle 20. For example, as shown in FIG. 24, a passenger gets on the patrol vehicle 20-1 and travels to a transfer station. At the transfer station, the passenger transfers to either the patrol vehicle 20-2 that travels around tourist spots B, C, and D, or the patrol vehicle 20-3 that travels around tourist spots E, F, and D. At this time, the server device 10 identifies the passenger who has boarded the patrol vehicle 20-1 using the biometric information of the passenger, and stores the ID of the identified passenger in association with the biometric information. The server device 10 identifies whether the identified passenger has boarded the patrol vehicle 20-2 or the patrol vehicle 20-3. Specifically, the server device 10 identifies which patrol vehicle 20 the passenger has boarded by biometric authentication using the biometric information obtained from image data acquired from the patrol vehicle 20-2 or the patrol vehicle 20-3 and the stored biometric information. Furthermore, the server device 10 talks with the passenger of the identified traveling vehicle 20 and calculates the satisfaction level of the passenger. The server device 10 stores the calculated satisfaction level in association with the passenger's ID. By doing so, even if the passenger changes traveling vehicles 20, the server device 10 can identify the passenger's transfer destination by biometric authentication and can manage the history of the passenger's satisfaction level.
[0189] Alternatively, as described above, when the server device 10 determines the destination of the tour vehicle 20 based on the satisfaction level, the server device 10 may provide information (provide information to passengers) to transfer to the tour vehicle 20 heading to the determined destination. For example, in the example of FIG. 24, if the tourist spot determined based on the satisfaction level of the passenger who boarded the tour vehicle 20-1 is tourist spot B, the server device 10 (information providing unit 306) may guide (notify) the passenger to transfer to the tour vehicle 20-2. Also, if the tourist spot determined based on the satisfaction level of the passenger who boarded the tour vehicle 20-1 is tourist spot E, the server device 10 (information providing unit 306) may guide the passenger to transfer to the tour vehicle 20-3. In this way, the satisfaction level calculation unit 353 calculates the satisfaction level of the passenger of the tour vehicle 20-1 (first tour vehicle). The destination determination unit 308 determines the spot to which the passenger of the tour vehicle 20-1 (first tour vehicle) is guided based on the calculated passenger satisfaction level. The information providing unit 306 guides the passengers of the patrol vehicle 20-1 (first patrol vehicle) to transfer to the patrol vehicle 20-2 or patrol vehicle 20-3 (second patrol vehicle) traveling to the determined spot.
[0190] Alternatively, the server device 10 may output the guidance regarding transfers in the patrol vehicle 20 to a display device such as an LCD monitor, rather than as audio (audio output from the speaker 24). In this case, the patrol vehicle 20 may be provided with a display device on the partition 21. In this case, the server device 10 may display the above guidance on a display device corresponding to the representative's seat, or may also provide the above guidance on display devices of other seats. In this way, the server device 10 may provide the above guidance taking into account the seat positions (boarding positions) of passengers.
[0191] In the above embodiment, the case where the server device 10 selects the representative has been described. However, the representative may be determined by the passenger. For example, the traveling vehicle 20 may output a display simulating the seat arrangement and a display prompting the passenger to select a representative on an LCD monitor or the like, and set the passenger in the seat selected by the passenger as the representative. In this way, the server device 10 may obtain the representative by using an interface that allows the user to input the representative, instead of analyzing image data obtained from the traveling vehicle 20.
[0192] In the above embodiment, the server device 10 determines the tour route of the traveling vehicle 20. However, the passenger may select the tour route. In this case, the traveling vehicle 20 may display a plurality of tour routes as "candidate tour routes" and acquire the route (course) desired by the passenger. The traveling vehicle 20 transmits the acquired route to the server device 10. The server device 10 controls the traveling vehicle 20 according to the selected route.
[0193] The server device 10 may verify the identity of the user when registering the user. Specifically, the server device 10 acquires the user's biometric information, personal information, and the like, as well as an identification document (e.g., a passport) on which the biometric information is recorded. The server device 10 performs one-to-one matching using the biometric information on the identification document and the biometric information acquired from the user. If the matching is successful, the server device 10 may register the user.
[0194] In the above embodiment, the feature amount generated from the face image is stored in the member information database, but the feature amount does not have to be stored in the database. Instead of the feature amount, a face image may be registered in the member information database, and the server device 10 may generate the feature amount from the registered face image every time it processes an authentication request.
[0195] Although the format of data transmission between the devices (server device 10, patrol vehicle 20) is not particularly limited, the data transmitted between these devices may be encrypted. Biometric information and the like is transmitted between these devices, and in order to appropriately protect this information, it is desirable to transmit and receive encrypted data.
[0196] In the flow charts (flow charts, sequence diagrams) used in the above description, multiple steps (processes) are described in order, but the order of execution of the steps executed in the embodiments is not limited to the order described. In the embodiments, the order of the steps shown in the figures can be changed to a degree that does not interfere with the content, such as executing each process in parallel.
[0197] The above-mentioned embodiments have been described in detail to facilitate understanding of the present disclosure, and it is not intended that all of the configurations described above are necessary. In addition, when a plurality of embodiments are described, each embodiment may be used alone or in combination. For example, it is possible to replace a part of the configuration of an embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of an embodiment. Furthermore, it is possible to add, delete, or replace a part of the configuration of an embodiment with another configuration.
[0198] From the above explanation, it is clear that the present invention has industrial applicability, and the present invention can be suitably applied to an information providing system that authenticates users who have registered as members.
[0199] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. [Appendix 1] A communication unit that communicates with a patrol vehicle that patrols within a predetermined area; a conversation unit that asks the passengers of the traveling vehicle about their impressions of the spots that the traveling vehicle has guided the passengers to and acquires responses from the passengers of the traveling vehicle; a calculation unit that calculates a degree of satisfaction of the passengers of the traveling vehicle with respect to the guided spot based on the answers from the passengers of the traveling vehicle; A server device comprising: [Appendix 2] The conversation unit transmits voice data corresponding to the question to the patrol vehicle, The server device according to claim 1, which receives from the traveling vehicle voice data and image data in response to the question as a response from a passenger of the traveling vehicle. [Appendix 3] The server device according to claim 2, wherein the calculation unit calculates the satisfaction level of passengers of the traveling vehicle by inputting voice data and image data of the responses to the questions into a learning model. [Appendix 4] A representative determination unit is further provided for determining a representative from among a plurality of passengers when the traveling vehicle has a plurality of passengers; The server device according to any one of claims 1 to 3, wherein the conversation unit converses with the representative. [Appendix 5] The server device according to any one of claims 1 to 4, wherein the conversation unit starts the conversation when the patrol vehicle finishes giving guidance about the spot. [Appendix 6] The server device according to any one of claims 1 to 5, wherein the patrol vehicle is an autonomous vehicle, and further comprises a vehicle operation control unit that controls the operation of the patrol vehicle by sending a movement instruction to the patrol vehicle, the movement instruction including the destination of the patrol vehicle. [Appendix 7] The server device according to any one of claims 1 to 6, further comprising an information providing unit that determines information to be provided to passengers of the traveling vehicle based on the calculated satisfaction level. [Appendix 8] The information providing unit is If the calculated satisfaction level is equal to or greater than a first threshold, the traveling vehicle provides the passenger with information about the spot that has already been guided thereto; The server device according to claim 7, wherein, if the calculated satisfaction level is equal to or lower than a second threshold, the traveling vehicle provides the passenger with information unrelated to the spots to which the passenger has already been guided. [Appendix 9] The server device according to any one of claims 1 to 8, further comprising a destination determination unit that determines a spot to which the traveling vehicle should move based on the calculated satisfaction level. [Appendix 10] A storage unit is further provided for storing biometric information and attribute information of each of a plurality of users in association with each other, the representative determination unit identifies attribute information corresponding to a passenger of the traveling vehicle by biometric authentication using biometric information generated from image data received from the traveling vehicle and the stored biometric information; The server device according to claim 7, which cites claim 4, wherein the information providing unit determines information to be provided to passengers of the traveling vehicle based on the identified attribute information and the calculated satisfaction level. [Appendix 11] A patrol vehicle that patrols within a predetermined area; a server device connected to the patrol vehicle via wireless communication; Including, The server device includes: A communication unit that communicates with the patrol vehicle; a conversation unit that asks the passengers of the traveling vehicle about their impressions of the spots that the traveling vehicle has guided the passengers to and acquires responses from the passengers of the traveling vehicle; a calculation unit that calculates a degree of satisfaction of the passengers of the traveling vehicle with respect to the guided spot based on the answers from the passengers of the traveling vehicle; A system comprising: [Appendix 12] A first patrol vehicle and a second patrol vehicle are included. The calculation unit calculates a satisfaction level of a passenger of the first traveling vehicle, The server device includes: a destination determination unit that determines a spot to which the passengers of the first traveling vehicle should be guided based on the calculated satisfaction level of the passengers of the first traveling vehicle; an information providing unit that guides passengers of the first traveling vehicle to transfer to the second traveling vehicle that moves to the determined spot; 12. The system of claim 11, further comprising: [Appendix 13] In the server device, Communicate with patrol vehicles patrolling within a specified area; asking the passengers of the traveling vehicle about their impressions of the spots that the traveling vehicle has guided the passengers to, and acquiring responses from the passengers of the traveling vehicle; A control method for a server device, the method comprising: calculating a degree of satisfaction of the passengers of the traveling vehicle with respect to the guided spot based on the answers from the passengers of the traveling vehicle. [Appendix 14] A computer installed in the server device A process of communicating with a patrol vehicle traveling within a predetermined area; A process of asking the passengers of the traveling vehicle about their impressions of the spots that the traveling vehicle has guided the passengers to and acquiring responses from the passengers of the traveling vehicle; A process of calculating a satisfaction level of the passengers of the traveling vehicle regarding the guided spot based on the answers from the passengers of the traveling vehicle; A computer-readable storage medium that stores a program for executing the above.
[0200] The disclosures of the above cited prior art documents are incorporated herein by reference. Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments. It will be understood by those skilled in the art that these embodiments are merely illustrative and that various modifications are possible without departing from the scope and spirit of the present invention. In other words, the present invention naturally includes various modifications and amendments that a person skilled in the art can make in accordance with the entire disclosure, including the scope of the claims, and the technical ideas. [Explanation of symbols]
[0201] 10. Server device 20 Patrol Vehicle 20-1 Patrol vehicle 20-2 Patrol vehicle 20-3 Patrol vehicle 21 Folding screen 21-1 Folding screen 21-2 Folding screen 21-3 Folding screen 21-4 Folding screen 22 Camera 23. Mike 24 speakers 30 base station 40 Control device 100 Server device 101 Communications Department 102 Conversation Section 103 Calculation section 201 Communication control section 202 Operation Control Unit 203 Location information transmission unit 204 Device control section 205 Storage section 301 Communication Control Unit 302 Vehicle Location Management Unit 303 Representative Determination Department 304 Vehicle Operation Control Unit 305 Communications Department 306 Information Provision Department 307 Storage section 308 Destination Determination Unit 309 User Registration Department 310 History Analysis Unit 311 Processor 312 Memory 313 Input / Output Interface 314 Communication Interface 351 Guidance end detection unit 352 Conversation Section 353 Satisfaction Calculation Department
Claims
1. a communication unit that communicates with the first and second patrol vehicles that patrol within a predetermined area; a conversation unit that asks the passengers of the first traveling vehicle about their impressions of the spots that the first traveling vehicle has guided the passengers to and acquires responses from the passengers of the first traveling vehicle; a calculation unit that calculates a degree of satisfaction of the passengers of the first traveling vehicle with respect to the guided spot based on the answers from the passengers of the first traveling vehicle; a destination determination unit that determines a spot to which the passengers of the first traveling vehicle should be guided based on the calculated satisfaction level of the passengers of the first traveling vehicle; an information providing unit that guides passengers of the first traveling vehicle to transfer to the second traveling vehicle that moves to the determined spot; A server device comprising:
2. the conversation unit transmits voice data corresponding to the question to the first patrol vehicle; 2. The server device according to claim 1, further comprising: a server device configured to receive, from the first vehicle, voice data and image data in response to the question as a response from a passenger of the first vehicle.
3. The server device according to claim 2 , wherein the calculation unit calculates the satisfaction level of the passenger of the first traveling vehicle by inputting the voice data and image data of the response to the question into a learning model.
4. A representative determination unit is further provided for determining a representative from among a plurality of passengers when the first traveling vehicle has a plurality of passengers; The server device according to claim 1 , wherein the conversation unit converses with the representative.
5. The server device according to claim 1 , wherein the conversation unit starts the conversation at a timing when the first patrol vehicle finishes guiding the spot.
6. The server device according to any one of claims 1 to 5, further comprising a vehicle operation control unit that controls the operation of the first patrol vehicle by sending a movement instruction including a destination of the first patrol vehicle to the first patrol vehicle, the first patrol vehicle being an autonomous vehicle.
7. a first and a second patrol vehicle that patrol within a predetermined area; a server device connected to the first and second patrol vehicles via wireless communication; Including, The server device includes: A communication unit that communicates with the first and second patrol vehicles; a conversation unit that asks the passengers of the first traveling vehicle about their impressions of the spots that the first traveling vehicle has guided the passengers to and acquires responses from the passengers of the first traveling vehicle; a calculation unit that calculates a degree of satisfaction of the passengers of the first traveling vehicle with respect to the guided spot based on the answers from the passengers of the first traveling vehicle; a destination determination unit that determines a spot to which the passengers of the first traveling vehicle should be guided based on the calculated satisfaction level of the passengers of the first traveling vehicle; an information providing unit that guides passengers of the first traveling vehicle to transfer to the second traveling vehicle that moves to the determined spot; A system comprising:
8. In the server device, Communicating with first and second patrol vehicles that patrol within a predetermined area; Asking passengers of the first traveling vehicle about their impressions of the spots introduced to the passengers by the first traveling vehicle, and acquiring responses from the passengers of the first traveling vehicle; Calculating a satisfaction level of the passengers of the first traveling vehicle with respect to the guided spot based on the answers from the passengers of the first traveling vehicle; determining a spot to which the passengers of the first traveling vehicle should be guided based on the calculated satisfaction level of the passengers of the first traveling vehicle; A control method for a server device, which guides passengers of the first traveling vehicle to transfer to the second traveling vehicle moving to the determined spot.
9. A computer installed in the server device A process of communicating with first and second patrol vehicles patrolling within a predetermined area; A process of asking the passengers of the first traveling vehicle about their impressions of the spots that the first traveling vehicle has guided the passengers to and acquiring responses from the passengers of the first traveling vehicle; A process of calculating a satisfaction level of the passengers of the first traveling vehicle with respect to the guided spot based on the answers from the passengers of the first traveling vehicle; A process of determining a spot to which the passengers of the first traveling vehicle should be guided based on the calculated satisfaction level of the passengers of the first traveling vehicle; instructing passengers of the first vehicle to transfer to the second vehicle traveling to the determined spot; A program for executing the above.
Citation Information
Patent Citations
Visiting route searching system and program
JP2006163670A
Facility satisfaction calculation device
JP2018055550A
Emotion estimating device, emotion estimating method, emotion estimating program, and emotion counting system
JP2018068618A
Information presentation server, information presentation system and information presentation method
JP2020057066A
Vehicle navigation system and control method of vehicle navigation system
JP2021009046A