Program, information processing method and information processing device
The program automates cleaning state checking in guest rooms using a robot with a camera, addressing the need for manual inspection, enhancing efficiency and guest room readiness.
Patent Information
- Application Number
- JP2024150832
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2020-01-07
- Filing Date
- 2024-09-02
- Publication Date
- 2024-11-08
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing systems for cleaning guest rooms in accommodation facilities require manual inspection and cleaning by employees, lacking automation for checking the cleaning state.
A program that uses a robot equipped with a camera to automatically check the cleaning state of guest rooms by analyzing images, integrating with a database to record and update cleaning status, and allowing voice-controlled operation of room indicators and robots for efficient cleaning and inspection.
Enables automated cleaning state checking, reducing manual labor, improving efficiency, and ensuring timely preparation of guest rooms, while minimizing errors and enhancing guest satisfaction.
Smart Images

Figure 2024159987000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a program, an information processing method, an information processing device, and a robot. [Background technology]
[0002] A system has been proposed for hotels, private lodgings, and other accommodation facilities that uses robots to deliver items necessary for cleaning to guest rooms (Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] International Publication No. 2019 / 244365 Summary of the Invention [Problem to be solved by the invention]
[0004] According to the system of Patent Document 1, items necessary for cleaning are automatically delivered to the guest room to be cleaned. However, cleaning work and inspection after cleaning work must be performed by an employee.
[0005] In one aspect, an object of the present invention is to provide a program or the like that uses a robot to automatically inspect the cleaning status of guest rooms. [Means for solving the problem]
[0006] The program extracts information about guest rooms that have been cleaned from a database that records the cleaning status of the guest rooms, and based on the information, causes a robot to enter the guest room that has been cleaned, obtains images taken by a camera mounted on the robot, and causes the computer to execute a process of checking the cleaning status based on the images. Effect of the Invention
[0007] In one aspect, a program or the like can be provided that utilizes a robot to automatically inspect the cleaning status of guest rooms. [Brief description of the drawings]
[0008] [Figure 1] FIG. 2 is an explanatory diagram showing an overview of the operation of the information processing system; [Diagram 2] FIG. 1 is an explanatory diagram illustrating a configuration of an information processing system. [Diagram 3] FIG. 1 is an explanatory diagram illustrating a record layout of a PMSDB. [Figure 4] FIG. 2 is an explanatory diagram illustrating a record layout of a speaker DB. [Diagram 5] FIG. 13 is an explanatory diagram illustrating the record layout of a cleaning status DB. [Figure 6] FIG. 11 is a state transition diagram illustrating state transitions of a cleaning state DB. [Figure 7] FIG. 2 is a sequence diagram showing an overview of the operation of the information processing system. [Figure 8] 11 is a flowchart illustrating a process flow of a program. [Figure 9] 13 is a flowchart illustrating a process flow of a subroutine of a cleaning request process. [Figure 10] 10 is a flowchart illustrating a process flow of a subroutine of a cleaning start process. [Figure 11] FIG. 11 is an explanatory diagram illustrating an overview of a recommendation model according to a second embodiment. [Figure 12] FIG. 11 is an explanatory diagram illustrating a configuration of an information processing system according to a third embodiment. [Figure 13] FIG. 13 is an explanatory diagram illustrating a record layout of a cleaning status DB according to the third embodiment. [Figure 14] FIG. 11 is a state transition diagram illustrating the transition of cleaning states in the third embodiment. [Figure 15] 13 is a flowchart illustrating the flow of processing of a program according to a third embodiment. [Figure 16] FIG. 13 is an explanatory diagram illustrating the record layout of a transportation DB in the fourth embodiment. [Figure 17] 13 is a flowchart illustrating the flow of processing of a program according to a fourth embodiment. [Figure 18] FIG. 13 is a functional block diagram of an information processing device according to a fifth embodiment. [Figure 19] FIG. 13 is an explanatory diagram showing the configuration of an information processing system according to a sixth embodiment. [Figure 20] FIG. 23 is an explanatory diagram illustrating a configuration of an information processing system according to a seventh embodiment. [Figure 21] FIG. 13 is an explanatory diagram illustrating a record layout of a confirmation condition DB. [Figure 22] FIG. 13 is an explanatory diagram illustrating a record layout of a confirmation result DB. [Figure 23] 20 is a flowchart illustrating the flow of processing of a program according to a seventh embodiment. [Figure 24] FIG. 23 is an explanatory diagram for explaining an overview of a recommendation model according to an eighth embodiment. [Diagram 25] FIG. 23 is an explanatory diagram for explaining the output of the smart speaker of the eighth embodiment. [Figure 26] 13 is a flowchart illustrating the flow of processing of a program according to an eighth embodiment. [Figure 27] FIG. 23 is an explanatory diagram illustrating the output of a smart speaker according to a ninth embodiment. [Figure 28] 13 is a flowchart illustrating a process flow of a program according to a ninth embodiment. [Figure 29] FIG. 23 is an explanatory diagram for explaining an overview of a recommendation model used in a modified example of the ninth embodiment. [Diagram 30] FIG. 23 is a functional block diagram of an information processing device according to a tenth embodiment. [Diagram 31] FIG. 23 is a functional block diagram of an information processing device according to an eleventh embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] [Embodiment 1] 1 is an explanatory diagram showing an overview of the operation of an information processing system 10. The information processing system 10 includes a smart speaker 20, an information processing terminal 18, and a room indicator 17. The smart speaker 20 and the information processing terminal 18 are examples of a user interface of the present embodiment.
[0010] The smart speaker 20 is placed in a guest room of a hotel, private lodging, or other lodging facility. The smart speaker 20 is substantially hemispherical in shape, and has a circular touch panel 25 and a camera 28 (see FIG. 2) on the flat surface. The smart speaker 20 is installed so that the touch panel 25 faces diagonally upward. The smart speaker 20 has a microphone 26 at the top of the spherical portion and a speaker 27 at the bottom of the spherical portion.
[0011] The information processing terminal 18 is a general-purpose portable information processing device such as a smartphone or a tablet. The information processing terminal 18 may be a portable information processing device dedicated to this system. The information processing terminal 18 has a touch panel, a microphone, and a speaker. The staff of the accommodation facility carry the information processing terminal 18 while performing their duties.
[0012] The room indicator 17 is a device installed in a cleaning preparation room, a linen room, or the like. The room indicator 17 is a combination of a display that displays a list of the cleaning and checking status of guest rooms, and a general-purpose computer, etc. The room indicator 17 displays data recorded in a cleaning status DB 44 (see FIG. 2), which will be described later, in real time. That is, as data is recorded in the cleaning status DB 44, the data is automatically displayed on the room indicator 17.
[0013] In the example shown in Figure 1, the "Not yet" in the cleaning queue indicates that cleaning is possible but not yet completed. The "Not possible" in the cleaning queue indicates that cleaning cannot be completed due to reasons such as a guest being staying at the hotel. The "Completed" in the cleaning queue indicates that cleaning has been completed.
[0014] "Not possible" in the confirmation column indicates that cleaning has not been completed or that the cleaning status cannot be confirmed because a guest is currently staying at the hotel. "Not yet" in the confirmation column indicates that cleaning has been completed and confirmation is awaited. "Completed" in the confirmation column indicates that confirmation after cleaning has been completed. The room indicator 17 may display the cleaning status and confirmation status using, for example, red, yellow, blue, etc. lamps.
[0015] The cleaning staff and the inspection staff perform cleaning and inspection work for the guest rooms by looking at the display of the room indicator 17. The screen of the room indicator 17 can also be displayed on the display of the information processing terminal 18 and a personal computer installed at the front desk, etc. In other words, the cleaning staff and the inspection staff can check the cleaning status and inspection status using the information processing terminal 18. The front desk staff can check the cleaning status and inspection status using the personal computer installed at the front desk.
[0016] For example, a guest staying in room 303 who is staying for multiple nights speaks to the smart speaker 20, "Please clean up," before going out. Through voice recognition and semantic analysis, the guest's intention is inferred, and "not done" is displayed in the cleaning column of the room indicator 17. The cleaning staff cleans the rooms with "not done" displayed in the cleaning column one by one, and replenishes towels and other items to keep the rooms in order.
[0017] For example, in room 305, a cleaning staff member who has finished cleaning speaks to the smart speaker 20, saying something like "Finished." Through voice recognition and semantic analysis, the cleaning staff member's intention is inferred, and "Finished" is displayed in the cleaning column of the room indicator 17. Along with a voice message from the smart speaker 20 saying "This is the status of 3F," an excerpt from the screen of the room indicator 17 showing the cleaning status of nearby rooms is displayed. The cleaning staff member can determine which room to clean next.
[0018] For example, a cleaning staff member moving along a corridor uses the information processing terminal 18 to check the cleaning status. The cleaning staff member checks the status of the room where cleaning has been completed. After completing the check, the cleaning staff member speaks to the smart speaker 20, saying something like "Check OK." Through voice recognition and semantic analysis, the cleaning staff member's intention is inferred, and "Completed" is displayed in the cleaning column of the room indicator 17.
[0019] When a guest checks out at the front desk, the check-out information is reflected in the room indicator 17, and "Not yet" is displayed in the cleaning column of the room where the guest stayed. The front desk checks the status of the room indicator 17 and guides new guests to rooms that have been cleaned and inspected.
[0020] As described above, in each guest room, the room indicator 17 can be operated by voice instructions via the smart speaker 20 without having to remember special commands or other operating methods. For example, even if a cleaning staff member is holding cleaning tools in both hands, the cleaning staff can operate the room indicator 17 via the smart speaker 20, thereby improving work efficiency.
[0021] The front desk can check in real time that cleaning and inspection have been completed, so even if a guest arrives earlier than expected, they can reduce the time they have to wait for their room to be prepared.
[0022] As described above, the smart speaker 20 and the information processing terminal 18 are an example of a user interface through which users such as guests and staff at the accommodation facility operate the room indicator 17. The user interface is not limited to the smart speaker 20 as long as it can acquire information from the user. For example, it can be replaced by a smartphone, tablet, or PC equipped with a microphone and speaker function. The user interface can also be replaced by a so-called smart TV that combines the functions of a TV and a computer.
[0023] The user interface may acquire information based on so-called gesture input based on a user's gestures and the like. The gesture input may be based on the user's foot movements such as stepping, jumping, etc. The user interface may acquire information based on the user's biosignals such as electroencephalograms, myoelectric potential, or electrooculography. The user interface may acquire information based on a combination of multiple input means such as voice input and gesture input.
[0024] It is desirable for the user interface to accept inputs in a non-contact manner, so that the user can input data even when both hands are occupied with luggage or the like.
[0025] The user interface may accept information from the user by character input via an input device such as a touch panel or a keyboard. The user interface may accept information from the user by photographing a handwritten note, pamphlet, or the like indicated by the user with the camera 28 and performing character recognition.
[0026] When accepting input of information by text, the information processing system 10 may display the accepted input on the touch panel 25 of the user interface or on another display device. The information processing system 10 may display the accepted input in a plurality of languages including the language used by the user. The user can check whether or not their intention has been correctly recognized by looking at the screen.
[0027] In the following description, data acquired by the user interface from the user may be referred to as acquired data. A specific example will be described using an example in which the acquired data is voice data. Also, a specific example will be described using an example in which the user interface outputs voice, but text may be displayed on the screen, or both voice and text may be output to the screen, and the type of output means is not limited.
[0028] 2 is an explanatory diagram illustrating the configuration of the information processing system 10. The information processing system 10 includes a management server 30, a voice response server 14, a PBX (Private Branch eXchange) 16, and a PMS (Property Management System) server 15 in addition to the above-mentioned smart speaker 20, information processing terminal 18, and room indicator 17.
[0029] The management server 30 is connected to the PMS server 15 via the PBX 16. The management server 30 may be connected to the PMS server 15 without the PBX 16.
[0030] The smart speaker 20 includes a CPU (Central Processing Unit) 21, a main memory device 22, an auxiliary memory device 23, a communication unit 24, and a bus in addition to the above-mentioned touch panel 25, microphone 26, speaker 27, and camera 28. The CPU 21 is an arithmetic and control device that executes the program of this embodiment. One or more CPUs or a multi-core CPU or the like is used as the CPU 21. The CPU 21 is connected to each hardware unit constituting the smart speaker 20 via the bus.
[0031] The main memory device 22 is a storage device such as an SRAM (Static Random Access Memory), a DRAM (Dynamic Random Access Memory), a flash memory, etc. The main memory device 22 temporarily stores information required during processing performed by the CPU 21 and programs being executed by the CPU 21.
[0032] The auxiliary storage device 23 is a storage device such as an SRAM, a flash memory, a hard disk, etc. The auxiliary storage device 23 stores programs to be executed by the CPU 21 and various data required for executing the programs.
[0033] The communication unit 24 is an interface that performs data communication between the smart speaker 20 and a network. The touch panel 25 includes a display unit 251 such as a liquid crystal display panel, and an input unit 252 that is layered on the display unit 251.
[0034] Note that the shape of the smart speaker 20 shown in FIG. 1 is an example, and the smart speaker 20 is not limited to a substantially hemispherical shape. The smart speaker 20 may have any shape, such as a columnar shape or a rectangular parallelepiped shape. The smart speaker 20 may be a general-purpose information processing device such as a smartphone, tablet, or personal computer. The smart speaker 20 may be configured by combining a general-purpose information processing device such as a personal computer with an external microphone, speaker, and camera.
[0035] The management server 30 includes a CPU 31, a main memory device 32, an auxiliary memory device 33, a communication unit 34, and a bus. The CPU 31 is an arithmetic and control device that executes the program of this embodiment. One or more CPUs or a multi-core CPU or the like is used as the CPU 31. The CPU 31 is connected to each hardware unit constituting the management server 30 via the bus.
[0036] The main memory device 32 is a storage device such as an SRAM, a DRAM, a flash memory, etc. The main memory device 32 temporarily stores information required during processing performed by the CPU 31 and programs being executed by the CPU 31.
[0037] The auxiliary storage device 33 is a storage device such as an SRAM, a flash memory, a hard disk, etc. The auxiliary storage device 33 stores a speaker DB (Database) 41, a cleaning state DB 44, programs to be executed by the CPU 31, and various data required for executing the programs.
[0038] The speaker DB 41 and the cleaning status DB 44 may be recorded in an external mass storage device connected to the management server 30, or in another server connected to the management server 30 via a network.
[0039] The communication unit 34 is an interface that performs data communication between the management server 30 and the network. The management server 30 is a general-purpose information processing device such as a personal computer or a server machine. The management server 30 may be a virtual machine that runs on a large computer. The management server 30 may be configured by combining multiple computers or server machines.
[0040] The voice response server 14 is an information processing device that acquires voice data from the smart speaker 20, performs processing such as voice recognition, and transmits the voice data related to the response to the smart speaker 20.
[0041] The PMS server 15 is an information processing device that manages the PMS. Here, we will briefly explain the PMS. The PMS is a management system for accommodation facilities, and records the address, name, nationality, payment method, accompanying persons, accommodation history, etc. of guests. The PMS used in accommodation facilities that provide services tailored to individual customers, such as luxury hotels and private lodgings, also records information such as the guest's preferences, various anniversaries, and allergies. The PMS is introduced for each accommodation facility or chain, and is used for processing reservations, check-in, check-out, settlement, etc.
[0042] The voice response server 14 and the PMS server 15 are general-purpose information processing devices such as personal computers or server machines. The voice response server 14 and the PMS server 15 may be virtual machines that run on a large-scale computer. The voice response server 14 and the PMS server 15 may be configured by combining a plurality of computers or server machines.
[0043] The PBX 16 is a switchboard that controls internal telephones in the accommodation facility and connections to external telephones, etc. The management server 30 can obtain information from the PMS server 15 via the PBX 16 by sending signals to the PBX 16 using a predetermined protocol.
[0044] 3 is an explanatory diagram explaining the record layout of the PMSDB. The PMSDB is a DB that records information related to users staying at or making reservations at accommodation facilities, among the information recorded in the PMS server 15, in an associated manner. The PMSDB has a date field, an accommodation facility field, a guest field, and a status field. The accommodation facility field has a name field and a room number field.
[0045] The guest field includes a representative field, a number of accompanying persons field, a relationship field, a check-out date field, and a special notes field. The representative field includes a name field, an age field, an address field, a gender field, and a nationality field.
[0046] The date field records the date. The name field records the name of the accommodation facility. The room number field records the room number of the guest room. The name field records the name of the representative. The age field records the age of the representative. The address field records the address of the representative. The gender field records the gender of the representative. The nationality field records the nationality of the representative.
[0047] The Number of Accompanying Guests field records the number of guests accompanying the representative. The Relationship field records the relationship between the representative and their accompanying guests. The Check-out Date field records the planned check-out date. The Special Notes field records special notes regarding the guest. The Status field records the status of the guest. The information recorded in each subfield of the Guest field is an example of guest attributes related to the attributes of the guest.
[0048] The PMSDB has one record for each guest room. Data for each subfield in the guest field is obtained when the reservation is made, or is entered by the front desk clerk or other person at check-in. For guests who have stayed at the hotel in the past, data may be obtained from data recorded at those previous stays.
[0049] We will continue the explanation using the record for room 333 in Figure 3 as an example. The subfields of the representative field record the age, address, gender, and nationality of the representative, Mr. "Tanaka Ichiro." The "1" in the number of accompanying persons field indicates that a total of two people will be staying at the hotel: the representative, Mr. "Tanaka Ichiro," and one accompanying person. The "Couple" in the relationship field means that the two people staying in room 333 are a married couple.
[0050] "June 21" in the Check-out Date field means that the guest staying in Room 333 plans to check out on June 21. "Silver Wedding" in the Notes field means that the couple staying in Room 333 is celebrating their silver wedding anniversary. "Not Yet Arrived" in the Status field means that they have not yet checked in.
[0051] We will continue the explanation using the record for room 334 in Figure 3 as an example. The subfields of the representative field record the age, address, gender, and nationality of the representative, Mr. Wang Min. The "3" in the number of accompanying persons field indicates that a total of four people will be staying at the hotel: the representative, Mr. Wang Min, and three accompanying persons. The "Family" in the relationship field means that the four people staying in room 334 are a family.
[0052] "June 30" in the Check-out Date field means that the guest staying in Room 334 plans to check out on June 30. "2 Infants" in the Special Notes field means that of the four guests staying in Room 334, two are infants. "Checked in" in the Status field means that the guest has already checked in.
[0053] 4 is an explanatory diagram illustrating a record layout of the speaker DB 41. The speaker DB 41 is a DB that records a speaker ID (identifier) uniquely assigned to the smart speaker 20 in association with an installation location. In the present embodiment, the speaker ID is used as a specific example for identifying the smart speaker 20, but the user interface identifier for identifying the user interface may be any information for identifying the user interface, such as the room number of the guest room in which the user interface is installed or an IP address assigned to the user interface.
[0054] The speaker DB41 has a speaker ID field and an installation location field. The installation location field has an accommodation facility name field and a room number field. The speaker ID field records a speaker ID. The accommodation facility name field records the name of the accommodation facility. The room number field records the room number of the guest room. The speaker DB41 has one record for each smart speaker 20.
[0055] 5 is an explanatory diagram illustrating the record layout of the cleaning status DB 44. The cleaning status DB 44 is a DB that records guest rooms in association with cleaning statuses. The cleaning status DB 44 has an accommodation facility name field, a room number field, and a status field. The status field has a cleaning field, a confirmation field, and a special notes field.
[0056] The accommodation name field records the name of the accommodation. The room number field records the room number of the guest room. The cleaning field records the status of the cleaning staff's work. "Not yet" in the cleaning field indicates that cleaning is possible but not yet completed. "Not possible" in the cleaning field indicates that cleaning cannot be done because a guest is currently staying, etc. "Completed" in the cleaning field indicates that cleaning has been completed.
[0057] The confirmation field records the status of the work of the person in charge of confirmation. "Not possible" in the confirmation field indicates that the cleaning status cannot be confirmed because cleaning has not been completed or a guest is currently staying at the property. "Not yet" in the confirmation field indicates that cleaning has been completed and confirmation is possible. "Completed" in the confirmation field indicates that the post-cleaning confirmation has been completed.
[0058] The special notes column records any special notes about cleaning. For example, the special notes column for Room 306 records that cleaning and inspection must be completed by "13:00."
[0059] 6 is a state transition diagram explaining state transitions of the cleaning status DB 44. When a guest checks in, or when a guest who has gone out returns and receives a room key from the front desk, "Not possible" is recorded in the cleaning field and the confirmation field.
[0060] When a guest room is ready to be cleaned, such as when a cleaning request is received from a guest, when the guest has checked out, or when the guest has left their room key at the front desk and gone out, the "Not Yet" field will be recorded.
[0061] When the cleaner has finished cleaning and is ready to check, "Finished" is recorded in the cleaning field and "Not yet" is recorded in the check field. If the checker determines that re-cleaning is necessary, "Not yet" is recorded in the cleaning field and "Not possible" is recorded in the check field. If the checker determines that the cleaning was performed correctly, "Finished" is recorded in the cleaning field and the check field. At the same time, the PMS server 15 is notified that the guest room cleaning and check are complete.
[0062] 7 is a sequence diagram showing an outline of the operation of the information processing system 10. The cleaning status DB 44 is updated by a check-out process or the like at the front desk (step S800). A room attendant who receives a cleaning request from a guest verbally or over the phone may update the cleaning status DB 44 by operating a personal computer or the like.
[0063] The user speaks to the smart speaker 20, for example, saying "Please clean" or "Finished." The voice is acquired by the microphone 26 (step S801). The CPU 21 transmits voice data obtained by converting the acquired voice into an electrical signal, an image captured by the camera 28, and the speaker ID to the voice response server 14 (step S802).
[0064] The voice response server 14 performs voice recognition based on the voice data and converts the user's request into a character string (step S811). The voice response server 14 performs semantic analysis based on the converted character string and determines the meaning of the user's request (step S812). The voice response server 14 performs emotion analysis to estimate the user's emotion at the time of speaking based on the voice data (step S813). Since publicly known methods can be used for the voice recognition, semantic analysis, and emotion analysis, detailed explanations are omitted. Information such as tone and speed of voice may be used for the emotion analysis.
[0065] Based on the results of the semantic analysis and the emotion analysis, the voice response server 14 determines whether or not to make an inquiry to the management server 30 (step S814). For example, if the user requests general information such as a weather forecast or traffic information, the voice response server 14 determines that an inquiry to the management server 30 is not necessary.
[0066] When it is determined that an inquiry to the management server 30 is not necessary, the voice response server 14 collects information from WEB services and the like via the network, and creates voice data for a response to the user. The voice response server 14 transmits the voice data to the smart speaker 20, and a response is output by voice from the smart speaker 20. The process performed by the voice response server 14 when an inquiry to the management server 30 is not made is well known, and therefore detailed description will be omitted.
[0067] When the user makes a comment about cleaning the guest room, the voice response server 14 determines that it is necessary to inquire of the management server 30. The voice response server 14 transmits the content of the user's comment obtained by analyzing the voice data, the image captured by the camera 28, and the speaker ID to the management server 30 (step S821).
[0068] The following describes an overview of the processing performed when it is determined that an inquiry to the management server 30 is necessary. The processing enclosed by the dashed line will be described in detail later.
[0069] The CPU 31 determines whether or not the cleaning status DB 44 needs to be updated based on the content of the comment (step S822). If it is determined that the update is necessary, the CPU 31 updates the cleaning status DB 44. Specifically, the CPU 31 searches the cleaning status DB 44 using the speaker ID as a key to extract a record. The CPU 31 updates the status field of the extracted record.
[0070] The CPU 31 determines whether or not a response to the user is required (step S823). For example, when it is determined that the content of the statement is the user's monologue, or is a conversation with another user, the CPU 31 determines that neither updating the cleaning status DB 44 nor responding to the user is required, and does not perform the following process.
[0071] For example, if the cleaning staff says something like "Finished," the CPU 31 determines that a response regarding the cleaning status of nearby rooms is required, and acquires the necessary information from the PMS server 15. If it is determined that a response should be made to the user, the CPU 31 transmits the response content to the voice response server 14 (step S824).
[0072] The voice response server 14 creates a response in a natural voice based on the received information (step S831). The voice response server 14 transmits voice data and an image related to the response to the smart speaker 20 (step S832). The CPU 21 displays the received image on the touch panel 25 and outputs the voice from the speaker 27 (step S833).
[0073] 8 is a flow chart for explaining the flow of program processing. Using FIG. 8, the flow of processing performed by CPU 31 in the portion enclosed by the dashed line in FIG. 7 will be explained in more detail.
[0074] The CPU 31 receives the user's utterance, the image captured by the camera 28, and the speaker ID transmitted by the voice response server 14 in the above-mentioned step S821 (step S851). The CPU 31 searches the speaker DB 41 using the received speaker ID as a key, and acquires the name of the accommodation facility where the smart speaker 20 is installed and the room number (step S852).
[0075] Based on the content of the comment received in step S851, the CPU 31 determines whether or not the user, i.e., the guest, has requested that the guest room be cleaned (step S853). If it is determined that the guest room has been requested to be cleaned (YES in step S853), the CPU 31 starts a cleaning request processing subroutine (step S854). The cleaning request processing subroutine is a subroutine that accepts a cleaning request from a guest. The processing flow of the cleaning request processing subroutine will be described later. Thereafter, the CPU 31 ends the processing.
[0076] If it is determined that cleaning of the guest room has not been requested (NO in step S853), CPU 31 determines whether or not the user, i.e., the room cleaner, has reported the start of cleaning (step S861). If it is determined that the start of cleaning has been reported (YES in step S861), CPU 31 starts a cleaning start processing subroutine (step S862). The cleaning start processing subroutine is a subroutine that provides information to the cleaner. The processing flow of the cleaning start processing subroutine will be described later. After that, CPU 31 ends the processing.
[0077] If it is determined that the user has not reported the start of cleaning (NO in step S861), the CPU 31 determines whether or not the user has reported the end of cleaning (step S866). If it is determined that the user has reported the end of cleaning (YES in step S866), the CPU 31 determines whether or not the user is a predetermined cleaning person (step S867). The determination is made based on, for example, an image of the user captured by the camera 28, voiceprint authentication, or input of a predetermined password, etc.
[0078] A designated cleaner means a person employed by an accommodation facility to perform cleaning work, or a person employed by a cleaning company that has been commissioned by the accommodation facility to perform cleaning work at the accommodation facility. A designated cleaner may not only mean a person who is employed, but also a person who has received sufficient training and is certified as being qualified to perform work at the accommodation facility. A designated cleaner may also mean a specific cleaner who is assigned to clean a specific guest room at a specific date and time. A designated cleaner may also mean a person who meets specified conditions, such as being an employee of a specific cleaning company.
[0079] In either case, information necessary for the judgment in step S867, such as the name, facial photo, voiceprint, and password of the specified cleaning person, is recorded in the auxiliary storage device 33 or an external server connected via a network.
[0080] If it is determined that the cleaning staff is the designated cleaning staff (YES in step S867), the CPU 31 updates the cleaning status DB 44 (step S868). Specifically, as described with reference to Fig. 6, the CPU 31 records "Completed" in the cleaning field of the record related to the guest room currently being cleaned, and "Not yet" in the confirmation field. If it is determined that the cleaning staff is not the designated cleaning staff (NO in step S867), or after step S868 is completed, the CPU 31 ends the process.
[0081] If it is determined that the user has not reported completion of cleaning (NO in step S866), the CPU 31 determines whether or not the user has reported completion of checking (step S871).If it is determined that the user has reported completion of checking (YES in step S871), the CPU 31 determines whether or not the user is a specified person in charge of checking (step S872).
[0082] A designated inspector means a person employed by the accommodation facility in charge of inspecting the cleaning work, or a person employed by a cleaning company that has been commissioned by the accommodation facility to inspect the cleaning work at the accommodation facility. A designated inspector may mean not only a person who is employed, but also a person who has received sufficient training and is certified as being qualified to inspect the cleaning work at the accommodation facility. A designated inspector may mean a person who is assigned to inspect a specific guest room at a specific date and time. A designated inspector may mean a person who meets specified conditions, such as being an employee of the accommodation facility.
[0083] The same person may be the cleaning person in one room and the inspection person in another room. The inspection person and the cleaning person may belong to different departments or companies.
[0084] In either case, information necessary for the judgment in step S872, such as the name, facial photograph, voiceprint, and password of the designated verification officer, is recorded in the auxiliary storage device 33 or an external server connected via a network.
[0085] When it is determined that the person in charge of checking is the specified person in charge of checking (YES in step S872), the CPU 31 updates the cleaning status DB 44 (step S873). Specifically, when the person in charge of checking reports that it is determined that re-cleaning is necessary, the CPU 31 records "Not yet" in the cleaning field and "Not possible" in the checking field.
[0086] If the inspector reports that the cleaning was completed correctly, the CPU 31 records "Completed" in the cleaning field and the confirmation field. The CPU 31 notifies the PMS server 15 that the cleaning and inspection of the guest room is completed.
[0087] If it is determined that the completion of confirmation has not been reported (NO in step S871), if it is determined that the person in charge of confirmation is not a predetermined person (NO in step S872), or after completion of step S873, CPU 31 ends the process.
[0088] 9 is a flowchart illustrating the process flow of the cleaning request processing subroutine. The cleaning request processing subroutine is a subroutine for accepting a cleaning request from a guest.
[0089] The CPU 31 transmits the room number of the guest room to the PMS server 15 via the PBX 16 to request information about the guest (step S901). The CPU 31 acquires information about the guest recorded in the PMS 15 (step S902). The information about the guest includes information recorded in one record of the PMSDB described with reference to FIG. 3.
[0090] The CPU 31 determines whether the guest is staying multiple nights (step S903). If it is determined that the guest is staying multiple nights (YES in step S903), the CPU 31 checks by what time cleaning should be completed (step S904).
[0091] For example, if it is determined from the image captured by the camera 28 that the guest is getting ready to go out, the CPU 31 asks the guest via the smart speaker 20, "You're going out, aren't you? What time do you plan to return?" The CPU 31 performs voice recognition and semantic analysis on the guest's answer to obtain the planned return time. The CPU 31 determines that the cleaning deadline is a time earlier than the obtained time.
[0092] For example, if a reservation for a restaurant, tea room, massage, or the like within the accommodation facility is recorded in the PMS, CPU 31 determines that the cleaning deadline is a time earlier than the scheduled end time of use. If the guest specifies a specific cleaning deadline, CPU 31 determines that the deadline specified by the guest is the cleaning deadline.
[0093] The CPU 31 may calculate the scheduled time for cleaning to be completed based on the standard cleaning time, and ask the guest via the smart speaker 20, "We plan to finish cleaning by 3 o'clock. Is that okay?" If the guest agrees, the CPU 31 determines that the time asked of the guest is the cleaning deadline.
[0094] The CPU 31 updates the cleaning status DB 44 (step S905). Specifically, as described with reference to FIG. 6, the CPU 31 records "Not yet" in the cleaning field and "Not possible" in the confirmation field of the record related to the guest room currently being used by the guest. The CPU 31 records the cleaning deadline and other requests from the guest in the remarks field. After that, the CPU 31 ends the process.
[0095] Note that CPU 31 may execute step S905 after confirming, via an image captured by camera 28 or the like, that the guest has left the guest room.
[0096] If it is determined that the guest did not stay multiple nights (NO in step S903), the CPU 31 waits for a notification that the guest has checked out (step S906). The notification is automatically sent, for example, when the front desk staff processes the check-out. The CPU 31 may access the PMS server 15 as necessary to check whether the check-out has been recorded.
[0097] After confirming that the guest has checked out, the CPU 31 updates the cleaning status DB 44 (step S907). Specifically, as described with reference to Fig. 6, the CPU 31 records "Not yet" in the cleaning field and "Not OK" in the confirmation field of the record related to the guest room used by the guest. Then, the CPU 31 ends the process.
[0098] In step S906, the CPU 31 may settle the accommodation fee and start a system for carrying out the check-out procedure. The system for carrying out the check-out procedure in the guest room has been used for a long time, and therefore the explanation thereof will be omitted.
[0099] 10 is a flowchart illustrating the process flow of the cleaning start processing subroutine. The cleaning start processing subroutine is a subroutine for providing information to the person in charge of cleaning.
[0100] The CPU 31 determines whether the user is a predetermined cleaning person (step S911). The determination is made based on, for example, an image of the user captured by the camera 28, voiceprint authentication, or input of a predetermined password.
[0101] If it is determined that the person is not the designated cleaning staff (NO in step S911), the CPU 31 ends the process. If it is determined that the person is the designated cleaning staff (YES in step S911), the CPU 31 transmits the room number of the guest room to the PMS server 15 via the PBX 16 to request information about the guest (step S912).
[0102] The CPU 31 acquires (step S913) information about the guest recorded in the PMS 15. The information about the guest includes information recorded in one record of the PMSDB described with reference to FIG.
[0103] The CPU 31 extracts information to be notified to the cleaning staff from the acquired information (step S915). For example, in the case of an accommodation facility that provides bath towels, cups, etc. according to the number of guests, the CPU 31 extracts the number of guests. In the case of an accommodation facility that provides amenities such as cosmetics according to the gender of the guest, the CPU 31 extracts the number of guests by gender. In the case of an accommodation facility that provides amenities for infants, the CPU 31 extracts the presence or absence of infants and their ages, etc.
[0104] The CPU 31 outputs the extracted information to the smart speaker 20 via the voice response server 14 (step S916). After that, the CPU 31 ends the process. Based on the information output from the smart speaker 20, the cleaning staff can prepare the guest room to meet the needs of the guest.
[0105] According to this embodiment, it is possible to provide an information processing system 10 that controls devices in an accommodation facility, specifically, the room indicator 17, based on voice instructions. Since instructions can be given in natural language, it is possible to provide an information processing system 10 that can be easily used not only by employees such as cleaners, but also by guests.
[0106] When a guest requests cleaning via the smart speaker 20, the information is reflected directly in the room indicator 17 without the need for input by the front desk staff, etc. It is possible to provide an information processing system 10 that can quickly respond to guest requests without the time lag associated with input work.
[0107] According to this embodiment, even if a cleaning person or the like has both hands full with cleaning tools or the like, the cleaning person or the like can operate the room indicator 17 by voice via the smart speaker 20. In other words, the cleaning person or the like can operate the room indicator 17 without stopping his or her work. Therefore, the results of the cleaning work and the checking work are promptly reflected in the room indicator 17. As described above, it is possible to provide an information processing system 10 that enables a front desk staff or the like to grasp the status of the guest room without any time lag and guide the guest.
[0108] According to this embodiment, the screen of the room indicator 17 can be displayed on the information processing terminal 18 carried by the cleaning staff or the like. Therefore, the cleaning staff or the like can judge the situation and make an appropriate decision without returning to the cleaning preparation room or the like where the room indicator 17 is installed.
[0109] By utilizing the smart speaker 20 installed in each guest room as the user interface, an information processing system 10 can be provided that does not require the user to input a guest room number, etc.
[0110] 8, in steps S867 and S872, it is determined whether the person in charge is a specific person, and the cleaning status DB 44 is updated only when it is determined that the person in charge is a specific person. This prevents incorrect information from being registered in the cleaning status DB 44 due to mischief by an outsider, resulting in missed cleaning and missed checks.
[0111] 10, the CPU 31 ends the process when it is determined in step S911 that the person is not a cleaning staff member. This makes it possible to prevent personal information of the guest from being leaked to outsiders.
[0112] If it is determined in step S911 that the person who reported the start of measurement is not a cleaning staff member, the CPU 31 may end the process after recording an image, voice, etc. of the person who reported the start of measurement in the auxiliary storage device 33. By separately analyzing the recorded information, it is possible to identify the reason why the subroutine for the cleaning start process was started by a person other than the cleaning staff member. Possible reasons include, for example, failure to register the cleaning staff member, erroneous recognition in step S861 of FIG. 8, or mischief by a guest.
[0113] By using the cleaning start processing subroutine, the cleaner can prepare the guest room to suit the guest, thus providing an information processing system 10 that contributes to improving guest satisfaction.
[0114] In an accommodation facility that does not change the way rooms are prepared depending on the guest, the determination in step S861 and the start of the cleaning start process subroutine in step S862 in the program described using FIG. 8 can be omitted.
[0115] If it is determined in step S911 or step S867 that the person is not a cleaning staff member, or if it is determined in step S872 that the person is not a confirmation staff member, CPU 31 may output a notification to the front desk or security room of the accommodation facility. At this time, it is desirable for CPU 31 to make the video captured by camera 28 and the audio acquired by microphone 26 available for viewing at the front desk or security room. This allows for early detection of a suspicious person who has entered the accommodation facility disguised as a cleaning staff member or confirmation staff member.
[0116] The CPU 31 may record the change log of the cleaning status DB 44 in the auxiliary storage device 33. By separately analyzing the change log, it is possible to calculate, for example, the cleaning time required for each cleaning staff member and the frequency at which the inspection staff member determines that re-cleaning is necessary. This makes it possible to assess the abilities of cleaning staff members and manage work efficiency.
[0117] The room indicator 17 does not need to have a display. The staff of the accommodation facility can check the information of the room indicator 17 by operating the information processing terminal 18 as necessary. The function of the room indicator 17 may be realized by a combination of the management server 30 and an external diff player.
[0118] [Embodiment 2] This embodiment relates to an information processing system 10 that arranges a guest room using a recommendation model created by machine learning. Explanation of parts common to the first embodiment will be omitted.
[0119] FIG. 11 is an explanatory diagram for explaining an overview of the recommendation model of the second embodiment. The recommendation model is a model that receives input data such as guest attributes and weather, and outputs output data related to the maintenance status of the guest room. The user attributes include the user attributes recorded in the PMS server 15, the guest requests acquired via the smart speaker 20, and the guest's emotions inferred by analyzing the user's voice. The user attributes include matters recorded in each subfield of the guest field described using FIG. 3.
[0120] The output data types A, B, etc. are types of room maintenance conditions that combine, for example, the temperature settings of the air conditioner, the types of drinks in the refrigerator, and the types of amenities such as shampoo, etc. The recommendation model outputs the recommendation probability for each type.
[0121] The recommendation model is created by machine learning such as deep learning based on training data collected by questionnaires to room attendants, for example, on the room maintenance status that a veteran room attendant would select for various input data. The recommendation model may be a program coded with a decision tree that determines the room maintenance status based on input data.
[0122] In this embodiment, in step S915 of the cleaning start processing subroutine described with reference to Fig. 10, the CPU 31 inputs the PMS information and weather information acquired from an Internet weather forecast site or the like to the recommendation model. The CPU 31 acquires the recommendation probability of each type from the recommendation model, and outputs the type with the highest recommendation probability in step S916.
[0123] The output may be, for example, "Type B is recommended. The air conditioner temperature setting should be 22 degrees, and the refrigerator should contain three bottles of gas mineral water and two cans of beer," which is output as a voice from the speaker 27 and is also displayed on the display unit 251. The cleaner maintains the guest room in accordance with the output.
[0124] According to this embodiment, the guest room can be prepared according to the guest's attributes and the weather. For example, if the guest is recorded in the PMS server 15 as not drinking alcohol, the refrigerator can be stocked with more soft drinks instead of alcoholic beverages such as beer. As described above, the information processing system 10 that improves the satisfaction of guests can be provided.
[0125] [Embodiment 3] This embodiment relates to an information processing system 10 that controls a robot 80 that transports luggage in an accommodation facility. Explanations of parts common to the first embodiment will be omitted. The robot 80 is an example of a device in an accommodation facility that is controlled based on voice instructions.
[0126] 12 is an explanatory diagram illustrating a configuration of an information processing system 10 according to embodiment 3. The information processing system 10 includes a robot 80 in addition to the smart speaker 20, the information processing terminal 18, the room indicator 17, the management server 30, the voice response server 14, the PBX 16, and the PMS server 15 described above.
[0127] The robot 80 includes a CPU 81, a main memory device 82, an auxiliary memory device 83, a communication unit 84, a touch panel 85, a microphone 86, a speaker 87, a camera 88, a bus, and an actuator for traveling (not shown). The CPU 81 is an arithmetic and control device that executes the program of this embodiment. One or more CPUs or a multi-core CPU or the like is used as the CPU 81. The CPU 81 is connected to each hardware unit constituting the robot 80 via the bus.
[0128] The main memory device 82 is a storage device such as an SRAM, a DRAM, a flash memory, etc. The main memory device 82 temporarily stores information required during processing performed by the CPU 81 and programs being executed by the CPU 81.
[0129] The auxiliary storage device 83 is a storage device such as an SRAM, a flash memory, a hard disk, etc. The auxiliary storage device 83 stores programs to be executed by the CPU 81 and various data required for executing the programs.
[0130] The communication unit 84 is an interface that performs data communication between the robot 80 and a network. The touch panel 85 includes a display unit 851 such as a liquid crystal display panel, and an input unit 852 stacked on the display unit 851. The robot 80 is a transport robot that transports luggage to a specified destination.
[0131] 13 is an explanatory diagram for explaining the record layout of the cleaning status DB 44 in the third embodiment. The cleaning status DB 44 is a DB that records guest rooms in association with their cleaning status. The cleaning status DB 44 has an accommodation facility name field, a room number field, and a status field. The status field has a cleaning status field and a special notes field.
[0132] The accommodation facility name field records the name of the accommodation facility. The room number field records the room number of the guest room. The cleaning status field records the cleaning status. "Not possible" in the cleaning status field indicates that cleaning is not possible due to a guest being staying there, etc. "Waiting for delivery" indicates that the room is waiting for delivery of items used for maintaining the guest room, such as sheets, bath towels, and shampoo.
[0133] "Waiting for cleaning" indicates a state where the room is waiting for the cleaning staff to start work. "Waiting for collection" indicates a state where the room is waiting for collection of used bath towels and trash, etc. "Waiting for confirmation" indicates a state where the room is waiting for confirmation by the inspection staff. "Finished" indicates that cleaning and confirmation have been completed and the room is ready to welcome guests.
[0134] 14 is a state transition diagram explaining the transition of the cleaning state in the embodiment 3. When a guest checks in, or when an out guest returns and receives a room key from the front desk, "Not possible" is recorded in the cleaning state field.
[0135] When a cleaning request is received from a guest, when the guest checks out, or when the guest leaves the room key at the front desk and goes out, the cleaning status field records "waiting for delivery." The robot 80 delivers the necessary items to the guest room. After delivery is completed or if there are no items to deliver, the cleaning status field records "waiting for cleaning."
[0136] When the cleaner finishes cleaning, "Waiting for collection" is recorded in the cleaning status field. The robot 80 goes to the guest room and collects the items. After collection is completed or if there are no items to be collected, "Waiting for confirmation" is recorded in the cleaning status field. The cleaner inputs whether there are any items that need to be collected via the smart speaker 20.
[0137] If the inspector determines that the inspection is complete and there is no problem, "Completed" is recorded in the cleaning status field, and the PMS server 15 is notified that the room cleaning and inspection are complete. If the inspector determines that re-cleaning is necessary, "Waiting for cleaning" is recorded in the cleaning status field.
[0138] Fig. 15 is a flowchart explaining the flow of processing of the program according to the embodiment 3. The program explained using Fig. 15 is a program for controlling delivery by the robot 80, and is executed in parallel with the program explained using Fig. 8.
[0139] The CPU 31 searches the cleaning status DB 44 to acquire a record in which "waiting for delivery" or "waiting for collection" is recorded in the cleaning status field (step S921). The CPU 31 determines the delivery origin and delivery destination based on the acquired record (step S922). Specifically, if it is "waiting for delivery", the delivery origin is a linen room or the like, and the delivery destination is a guest room. If it is "waiting for collection", the delivery origin is a guest room, and the delivery destination is a waste collection room.
[0140] The CPU 31 instructs the robot 80 of the delivery origin and delivery destination (step S923). The CPU 81 receives the instruction (step S941). The CPU 81 moves to the delivery origin (step S942). The CPU 81 receives the item (step S943).
[0141] Receiving an item may be performed by the CPU 81 operating an actuator or the like to load the item, or by another machine or a human loading the item onto the robot 80. For example, when a human loads an item onto the robot 80, the CPU 81 displays the required item and delivery destination on the display unit 851. The human looks at the displayed content, selects an appropriate item, loads it onto the robot 80, and then operates the input unit 852 to give instructions to head to the delivery destination.
[0142] The CPU 81 moves the robot 80 to the delivery destination (step S944). The CPU 81 unloads the item (step S945). The task of unloading the item may be performed by the CPU 81 operating an actuator or the like to load the item, or may be performed by another machine or a human being unloading the item from the robot 80.
[0143] The CPU 81 notifies the management server 30 that the delivery has been completed (step S946). The CPU 31 receives the notification (step S925). The CPU 31 updates the cleaning status DB 44 (step S926). Specifically, as described using FIG. 13, when the delivery has been completed, "waiting for cleaning" is recorded in the cleaning status field. When the collection has been completed, "waiting for confirmation" is recorded in the cleaning status field.
[0144] The CPU 31 determines whether or not to end the process (step S927). For example, if the cleaning service time for the guest room has ended (YES in step S927), the CPU 31 determines to end the process. If it is determined not to end the process (NO in step S927), the CPU 31 returns to step S921. If it is determined to end the process, the CPU 31 ends the process.
[0145] The CPU 31 may obtain a plurality of records in step S921, and instruct the robot 80 to go around a plurality of guest rooms in sequence in step S923.
[0146] According to this embodiment, it is possible to provide an information processing system 10 that eliminates the need for the cleaner to carry items used for maintaining the guest rooms. This reduces the burden on the cleaner. In addition, since the cleaner does not need to return to the cleaning preparation room to replenish items, the efficiency of the cleaning work can be improved.
[0147] [Variation 1] The robot 80 may deliver items to be provided to guests, such as sheets, bath towels, and shampoo, as well as cleaning tools to be used by cleaning staff, such as dusters, mops, detergent, and vacuum cleaners. The items to be provided to guests and the cleaning tools may be delivered by the same robot 80 or by different robots 80.
[0148] When a cleaner cleans multiple rooms in succession, the robot 80 carrying the cleaning tools may move with the cleaner. Specifically, the robot 80 delivers the cleaning tools to the room that is to be cleaned first and waits for the cleaner to arrive. The cleaner cleans the room using the cleaning tools delivered by the robot 80.
[0149] After completing cleaning, the cleaner loads the cleaning tools onto the robot 80 or instructs the robot 80 to load the cleaning tools. The cleaner operates the information processing terminal 18 to check the status of the room indicator 17 and determine the next guest room to be cleaned. The cleaner operates the input unit 852 to instruct the robot 80 to head to the next guest room. The robot 80 delivers the cleaning tools to the instructed guest room.
[0150] According to this modification, since the cleaning staff does not need to carry cleaning tools, it is possible to provide an information processing system 10 that reduces the burden on the cleaning worker.
[0151] The robot 80 may carry used bath towels, trash, etc., in addition to the cleaning tools. It is possible to provide an information processing system 10 that transitions to a "waiting for confirmation" state when cleaning of a guest room is completed, without passing through the "waiting for collection" state described using Fig. 14. In this case, when the cleaning staff completes a series of cleaning and returns to the cleaning preparation room, the robot 80 moves to a waste collection room or the like and unloads the used bath towels, trash, etc., that it has carried.
[0152] CPU 31 may instruct robot 80 which guest room to clean next. Robot 80 loads cleaning tools and moves to the instructed guest room. CPU 81 may display on display unit 851 the guest room to clean next that is instructed by CPU 31.
[0153] The cleaner moves with the robot 80 and cleans the next guest room. Since the cleaner does not need to decide which guest room to clean next, the information processing system 10 can be provided that enables even an inexperienced cleaner to efficiently proceed with the work.
[0154] [Variation 2] There may be a concentration of rooms "waiting to be cleaned" during certain times of the day, such as around check-out time. Such concentration times can be predicted based on past performance statistics and the room occupancy rate of the day, etc.
[0155] In this modification, the CPU 31 calculates the predicted number of guest rooms that can be cleaned during the concentrated time period for each floor of the accommodation facility. The CPU 31 causes the robot 80 to deliver the necessary number of items to a temporary storage location provided for each floor based on the predicted number. The robot 80 or a cleaning worker carries the necessary items from the temporary storage location to the guest rooms and cleans them.
[0156] By predicting necessary items and delivering them to a temporary storage location, the information processing system 10 can be provided, which can quickly deliver items to and clean each guest room. Even if the time between the check-out time and the check-in time of the next guest is short, the information processing system 10 can be provided, which can smoothly perform guest room maintenance.
[0157] For example, a large robot 80 with a large load capacity delivers items from a linen room or a warehouse to a temporary storage location, and a small robot 80 delivers the items from the temporary storage location to each guest room. It is possible to provide an information processing system 10 that delivers items in a hallway in front of the guest rooms without impeding the passage of guests.
[0158] [Embodiment 4] This embodiment relates to an information processing system 10 in which a robot 80 delivers various items. Descriptions of parts common to the third embodiment will be omitted.
[0159] 16 is an explanatory diagram for explaining the record layout of the transportation DB in the fourth embodiment. The transportation DB is a DB that records the delivery origin, delivery destination, delivered goods, and delivery status in association with each other. The transportation DB has an accommodation facility name field, a delivery origin field, a delivery destination field, a goods field, and a status field.
[0160] The accommodation name field records the name of the accommodation. The delivery origin field records the location of the delivery origin. The delivery destination field records the name of the delivery destination. The item field records the item to be delivered. The status field records the status of the item. "Finished" indicates that the item has arrived at the delivery destination. "In transit" indicates that the item is in transit from the delivery origin to the delivery destination. "Not yet received" indicates that the item has not yet been loaded onto the robot 80. The initial value of the status field is "Not yet received".
[0161] 16 is created when a cleaning staff member finishes cleaning and updates the cleaning status DB 44. The CPU 31 records the room number recorded in the room number field of the updated record in the cleaning status DB 44 in the delivery origin field of the record added to the delivery DB.
[0162] 16 is created when a guest requests room service for a meal via the smart speaker 20. Specifically, the CPU 31 searches the speaker DB 41 using the speaker ID of the smart speaker 20 that accepted the guest's request as a key to extract a record. The CPU 31 records the room number recorded in the room number field of the extracted record in the delivery destination field of the record added to the transportation DB.
[0163] 16 is created when a guest requests the clearing of dishes after room service via the smart speaker 20. Specifically, the CPU 31 searches the speaker DB 41 using the speaker ID of the smart speaker 20 that accepted the guest's request as a key to extract a record. The CPU 31 records the room number recorded in the room number field of the extracted record in the delivery origin field of the record added to the transportation DB.
[0164] The transportation DB may contain a mixture of records added by CPU 31 as described above, records automatically generated by a room service ordering system or the like, and records manually created by accommodation facility staff.
[0165] Fig. 17 is a flowchart explaining the flow of processing of the program of the embodiment 4. The program explained using Fig. 17 is a program for controlling delivery by the robot 80, and is executed in parallel with the program explained using Fig. 8. The robot 80 has a transport mechanism appropriate for each purpose, such as for transporting meals or collecting garbage.
[0166] The CPU 31 searches the delivery DB to acquire a record in which "before receipt" is recorded in the status field (step S951). The CPU 31 selects the robot 80 to be used for delivery based on the item recorded in the item field of the acquired record (step S952).
[0167] The CPU 31 instructs the robot 80 of the delivery origin, delivery destination, and item (step S953). The CPU 81 receives the instruction (step S971). The CPU 81 moves to the delivery origin (step S972). The CPU 81 receives the item (step S973). The CPU 81 notifies the management server 30 that the item has been received (step S974).
[0168] The CPU 31 receives the notification (step S954). The CPU 31 updates the transportation DB (step S955). Specifically, the CPU 31 records "on the move" in the status field.
[0169] The CPU 81 moves the robot 80 to the delivery destination (step S975). The CPU 81 unloads the item (step S976). The task of unloading the item may be performed by the CPU 81 operating an actuator or the like to load the item, or may be performed by another machine or a human being unloading the item from the robot 80.
[0170] The CPU 81 notifies the management server 30 that the delivery has been completed (step S977). The CPU 31 receives the notification (step S956). The CPU 31 updates the transportation DB (step S957). Specifically, the status field is recorded with "Completed."
[0171] The CPU 31 determines whether or not to end the process (step S958). For example, if the time for room service has ended, the CPU 31 determines to end the process. If it is determined not to end the process (NO in step S958), the CPU 31 returns to step S951. If it is determined to end the process (YES in step S958), the CPU 31 ends the process.
[0172] The CPU 31 may obtain a plurality of records in step S951, and instruct the robot 80 to go around a plurality of guest rooms in sequence in step S953.
[0173] According to this embodiment, it is possible to provide an information processing system 10 that allows a robot 80 to deliver various items.
[0174] The CPU 31 may determine the details of the item by using the recommendation model described in the embodiment 2. An example will be described in which a guest requests the delivery of shampoo via the smart speaker 20.
[0175] The CPU 31 acquires the attributes of the guest based on the user attributes recorded in the PMS server 15, the guest requests acquired via the smart speaker 20, and the guest's emotions inferred by analyzing the user's voice. The CPU 31 accepts the guest attributes and the weather, and selects a recommendation model that outputs output data regarding the brand of shampoo to recommend to the guest. The CPU 31 inputs the guest attributes and the weather into the selected recommendation model. The CPU 31 determines the brand of shampoo to deliver to the guest room based on the output data.
[0176] As a result of the above, an information processing system 10 can be realized that provides shampoos according to the gender, age, etc. of guests.
[0177] An example will be described in which a guest requests room service for dinner via the smart speaker 20. For example, if the guest places an order that gives the accommodation facility a lot of discretion, such as the "chef's recommended course," the CPU 31 accepts the guest's attributes and the weather, and selects a recommendation model that outputs output data related to dinner recommended to the guest. The output data is, for example, the probability that the guest prefers each dish, such as a main dish and a side dish.
[0178] The CPU 31 inputs the guest's attributes and the weather into the selected recommendation model. The CPU 31 acquires the output data and transmits it to the kitchen via the network. The chef in the kitchen looks at the output data and creates a course meal that matches the guest's preferences. The chef has the robot 80 transport the cooked food.
[0179] As a result of the above, an information processing system 10 can be realized that supports the provision of food tailored to the preferences of guests.
[0180] [Embodiment 5] 18 is a functional block diagram of an information processing device according to the fifth embodiment. The information processing device includes an acquisition unit 91 and a device control unit 92. The acquisition unit 91 acquires voice data from a user interface 20 installed in a guest room of the accommodation facility. The device control unit 92 controls devices 17, 80 in the accommodation facility based on the voice data acquired by the acquisition unit 91 and a user interface identifier that identifies the user interface 20.
[0181] [Embodiment 6] The present embodiment relates to a form in which a management server 30 for an information processing system 10 of the present embodiment is realized by combining and operating a general-purpose computer 90 and a program 97. Fig. 19 is an explanatory diagram showing the configuration of an information processing system 10 of the sixth embodiment. Note that a description of parts common to the first embodiment will be omitted.
[0182] The information processing system 10 of this embodiment includes a smart speaker 20, a voice response server 14, a PMS server 15, a PBX 16, a room indicator 17, an information processing terminal 18, and a computer 90, which are connected via a network. The computer 90 includes a CPU 31, a main memory device 32, an auxiliary memory device 33, a communication unit 34, a reading unit 36, and a bus.
[0183] The program 97 is recorded in a portable recording medium 96. The CPU 31 reads the program 97 via the reading unit 36 and stores it in the auxiliary storage device 33. The CPU 31 may also read the program 97 stored in a semiconductor memory 98 such as a flash memory mounted on the computer 90. Furthermore, the CPU 31 may download the program 97 from another server computer (not shown) connected via the communication unit 34 and a network (not shown) and store it in the auxiliary storage device 33.
[0184] The program 97 is installed as a control program for the computer 90, and is loaded into and executed by the main storage device 32. In this way, the computer 90 functions as the management server 30 described above.
[0185] [Embodiment 7] This embodiment relates to an information processing system 10 that performs a checking operation after cleaning is completed using a robot 80. Explanation of parts common to the first embodiment will be omitted.
[0186] 20 is an explanatory diagram illustrating a configuration of an information processing system 10 according to embodiment 7. The information processing system 10 includes a smart speaker 20, an information processing terminal 18, a room indicator 17, a management server 30, a voice response server 14, a PMS server 15, a PBX 16, and a robot 80.
[0187] The robot 80 of this embodiment includes a CPU 81, a main memory device 82, an auxiliary memory device 83, a communication unit 84, a touch panel 85, a microphone 86, a speaker 87, a plurality of cameras 88, an odor sensor 89, a bus, and a traveling actuator (not shown). The CPU 81 is an arithmetic and control device that executes the program of this embodiment. One or a plurality of CPUs or a multi-core CPU is used as the CPU 81. The CPU 81 is connected to each hardware unit constituting the robot 80 via the bus.
[0188] The main memory device 82 is a storage device such as an SRAM, a DRAM, a flash memory, etc. The main memory device 82 temporarily stores information required during processing performed by the CPU 81 and programs being executed by the CPU 81.
[0189] The auxiliary storage device 83 is a storage device such as an SRAM, a flash memory, or a hard disk. The auxiliary storage device 83 stores the confirmation condition DB 45, the program to be executed by the CPU 81, and various data required for executing the program. The confirmation condition DB 45 may be stored in the auxiliary storage device 33 of the management server 30, or in another server connected to the robot 80 via a network.
[0190] The communication unit 84 is an interface for performing data communication between the robot 80 and a network. The touch panel 85 includes a display unit 851 such as a liquid crystal display panel, and an input unit 852 stacked on the display unit 851.
[0191] The multiple cameras 88 are arranged at multiple heights, for example, about 5 cm above the floor, about 1 meter above the floor, and about 1.5 meters above the floor. The cameras 88 are attached to the hands of the robot 80 and may be movable to any position. The robot 80 may be equipped with cameras 88 with multiple viewing angles and sensitivities. The cameras 88 may be so-called 360-degree cameras.
[0192] The odor sensor 89 is a sensor that detects odor substances that are the cause of odors that guests find unpleasant.
[0193] The robot 80 is a cleaning inspection robot that automatically moves to a specified room and takes pictures and records odors according to a predetermined procedure. The robot 80 has a manipulator that opens and closes the bathroom and closet doors. The robot 80 may also function as the transport robot described in the third embodiment.
[0194] The auxiliary storage device 33 stores the above-mentioned speaker DB 41, cleaning state DB 44, programs to be executed by the CPU 31, and various data required for executing the programs, as well as a confirmation result DB 46.
[0195] The confirmation result DB 46 may be recorded in an external mass storage device connected to the management server 30, or in another server connected to the management server 30 via a network.
[0196] 21 is an explanatory diagram for explaining the record layout of the confirmation condition DB 45. The confirmation condition DB 45 is a DB that records a room number, a room situation, and a confirmation shooting location and shooting conditions in association with each other. The confirmation condition DB 45 has a room number field, a situation field, a location field, a reference image field, and a shooting condition field. The shooting condition field has a camera field, a camera position field, and a camera direction field. The confirmation condition DB 45 has one record for one confirmation location.
[0197] The room number is recorded in the room number field. The status field records whether it is a room for multiple nights or a room that has already been checked out. "Multiple nights" in FIG. 21 means that it is a room for multiple nights. If it is a room that has already been checked out, "Checked out" is recorded in the status field.
[0198] The location field records the location where the image is taken. The reference image field records a standard image of the location to be photographed. The camera field records which of the multiple cameras 88 mounted on the robot 80 is to be used.
[0199] The camera position field records coordinates indicating the position of the camera at the time of shooting. The camera orientation field records coordinates indicating the orientation of the camera at the time of shooting. The coordinates are expressed in three-dimensional coordinates, for example, using the door of each guest room as a reference. In this way, the same values can be used in the camera position field and the camera orientation field for guest rooms of the same type. The coordinates may be expressed in three-dimensional coordinates using a specific location within the accommodation facility as a reference.
[0200] The shooting condition field may have subfields for recording the shutter speed, sensitivity, focal length, and the like.
[0201] The shooting location recorded in the location field may be different between when the status field is "checked out" and when the status field is "continuous stay." For example, when the status field is "continuous stay," it is not necessary to include "inside the closet" in the shooting target.
[0202] 22 is an explanatory diagram for explaining the record layout of the check result DB 46. The check result DB 46 is a DB that records the check results performed in each guest room based on the check condition DB 45 in association with the room number and the check date and time.
[0203] The confirmation result DB 46 has a room number field, a confirmation date and time field, a status field, a location field, and a result field. The result field has an appearance field and an odor field. The appearance field has an image data field and an appearance judgment field. The odor field has an odor data field and an odor judgment field. The confirmation result DB 46 has one record for one confirmation of one location.
[0204] The room number field records the room number. The confirmation date and time field records the date and time when the robot 80 started checking the room. The status field records whether the room is for multiple nights or the room has already been checked out.
[0205] The location field records the location where the image was taken. The location recorded in the location field corresponds to the location field of the check condition DB 45 described with reference to Fig. 21. The image data field records data of the image taken by the camera 88 based on the shooting conditions recorded in the shooting condition field of the inspection condition DB 45.
[0206] The appearance judgment field records the judgment result that the CPU 31 judges based on each image. "Normal" indicates that the CPU 31 judges that the similarity with the reference image recorded in the reference image field of the inspection condition DB 45 is equal to or greater than a predetermined threshold. If the CPU 31 judges that the similarity with the reference image is less than the predetermined threshold, "Abnormal" is recorded in the appearance judgment field.
[0207] The odor data field records odor data acquired by the odor sensor 89. The odor data is, for example, text data recording the concentration or amount of an odor substance measured by the odor sensor 89. It is preferable that the odor sensor 89 measures the concentration of each of a plurality of odor substances. By having an expert analyze the data measuring the concentration of each of a plurality of odor substances, the cause of the odor can be clarified and countermeasures can be taken.
[0208] The odor determination field records the result of the odor determination performed by the odor sensor. "Normal" indicates that the odor substance is below a predetermined threshold, i.e., the CPU 31 has determined that the odor is within the standard range. If the CPU 31 determines that the concentration of the odor substance is equal to or greater than the predetermined threshold, then "Abnormal" is recorded in the odor determination field.
[0209] 23 is a flowchart explaining the processing flow of the program of the seventh embodiment. CPU 31 extracts guest rooms awaiting confirmation from cleaning status DB 44, i.e., guest rooms for which cleaning has been completed but post-cleaning confirmation has not been completed (step S501). CPU 31 transmits the room numbers of the extracted guest rooms to robot 80 (step S502). By step S502, CPU 31 realizes the function of an entry instruction unit that causes confirmation robot 80 to enter guest rooms for which cleaning has been completed.
[0210] The room number is an example of information related to the guest room to be checked. The CPU 31 may transmit, for example, location information of the guest room to be checked or a route to the guest room to the robot.
[0211] The CPU 81 receives the room number (step S601). The CPU 81 searches for the confirmation conditions using the received room number as a key, and acquires the confirmation conditions (step S602). The CPU 81 moves to the guest room corresponding to the received room number (step S603). The CPU 81 autonomously moves the robot 80 to the destination based on a map of the accommodation facility, wireless beacons placed in various locations in the accommodation facility, images captured by the camera 88, and the like. Systems for autonomously driving a moving object such as the robot 80 to a destination are well known, and therefore will not be described here.
[0212] The CPU 81 enters the guest room (step S604). The CPU 81 moves to a location where an image is to be taken in accordance with the confirmation conditions acquired in step S602 (step S605). The CPU 81 adjusts the position and orientation of the camera 88 to match the confirmation conditions acquired in step S602, and takes an image (step S606).
[0213] It is preferable that the CPU 81 adjusts the position, orientation, and settings of the camera 88 so as to obtain a high similarity to the reference image before photographing the image. In this way, the CPU 81 can photograph an image with the same layout as the reference image.
[0214] The similarity of images can be quantitatively evaluated using any method such as MSE (Mean Square Error), PSNR (Peak Signal-to-Noise ratio), SSIM (Structural Similarity), etc. Various methods for evaluating the similarity of images are known, so the description will be omitted.
[0215] The CPU 81 transmits the captured image and odor sensor data acquired during image capture to the management server 30 (step S607). The CPU 81 determines whether or not image capture for all conditions acquired in step S602 has been completed (step S608). If it determines that image capture has not been completed (NO in step S608), the CPU 81 returns to step S605.
[0216] The loop process from step S605 to step S608 will be described with a specific example. In the first step S605, the CPU 81 opens the door to the guest room and moves to the entrance. In the following step S606, the CPU 81 uses the No. 1 camera 88 to capture an image seen from the entrance of the guest room.
[0217] In step S605 for the second time, the CPU 81 opens the bathroom door and moves to the bathroom entrance. In the following step S606, the CPU 81 uses the No. 4 camera 88 to capture an image of the entire bathroom. The CPU 81 may turn on the bathroom lights before capturing the image. The robot 80 may be equipped with a lighting device for capturing images. If the No. 4 camera is a camera for capturing images in dark places, the CPU 81 may capture the image without turning on the lights.
[0218] In step S605 for the third time, CPU 81 moves camera 88 to a position from which the bathtub can be viewed. In the following step S606, CPU 81 uses camera No. 2 to capture an image of the inside of the bathtub. As described above, by sequentially capturing images in accordance with the conditions defined in confirmation condition DB 45, CPU 81 comprehensively captures images of locations where mistakes may occur during cleaning.
[0219] When it is determined that image shooting for all conditions has been completed (YES in step S608), the CPU 81 leaves the guest room (step S609). If no instruction for the next place to check has been received, the CPU 81 moves to a predetermined waiting place.
[0220] If it is determined in step S605 that the predetermined photographing location cannot be reached due to an obstacle such as a guest's suitcase, the CPU 81 takes an image of the obstacle in step S606.
[0221] CPU 31 receives the image and odor sensor data transmitted from robot 80 (step S511). In step S511, CPU 31 realizes the function of an image acquisition unit that acquires an image captured by a camera mounted on robot 80. CPU 31 creates a new record in confirmation result DB 46 and records the received data in the image data field and odor data field, respectively. CPU 31 analyzes the received data (step S512).
[0222] For example, CPU 31 detects an object from the received image by an object detection method such as R-CNN (Regional Convolutional Neural Network), YOLO (You Only Look Once), or SSD (Single Shot Multibox Detector). For example, if a specified fixture is not placed in a specified location, CPU 31 determines that there is an abnormality in the appearance of the guest room. CPU 31 may determine that there is no abnormality when the similarity between the image received in step S511 and a specified reference image is high, and that there is an abnormality when the similarity is low.
[0223] The CPU 31 may make the judgment using a learning model that outputs whether an image is normal or abnormal when it is input. Such a learning model can be generated by performing supervised learning using training data that records many combinations of images and the presence or absence of abnormalities. The CPU 31 records "normal" or "abnormal" in the appearance judgment field of the confirmation result DB 46.
[0224] CPU 31 determines that there is something wrong with the odor when odor molecules exceeding a predetermined threshold are detected based on the data from the odor sensor. CPU 31 records "normal" or "abnormal" in the odor determination field of confirmation result DB 46. In step S512, CPU 31 realizes the function of a confirmation unit that confirms the cleaning status of the guest room.
[0225] The CPU 31 determines whether data acquisition has ended (step S513). For example, the CPU 31 determines that data acquisition has ended when steps S511 to S513 have been repeated a predetermined number of times. The CPU 31 may determine that acquisition of predetermined data has ended when a signal indicating that the last image has been transmitted from the robot 80 has been received, or when a signal indicating that the robot 80 has left the guest room has been received. If it is determined that data acquisition has not ended (NO in step S513), the CPU 31 returns to step S511.
[0226] When it is determined that the process is completed (YES in step S513), CPU 31 determines whether the state of the guest room is "normal" (step S514). Specifically, CPU 31 determines that the state of the guest room is normal if "normal" is recorded in all appearance determination fields and odor determination fields, and determines that the state of the guest room is not normal in other cases.
[0227] If it is determined to be "normal" (YES in step S514), CPU 31 extracts from cleaning status DB 44 a record relating to the room number for which confirmation was performed, and records "Ended" in the confirmation field (step S515). If it is determined to be not "normal" (NO in step S514), CPU 31 extracts from cleaning status DB 44 a record relating to the room number for which confirmation was performed, and records "Waiting for reconfirmation" in the confirmation field (step S516). "Waiting for reconfirmation" is an example of a record that means that the cleaning status has been determined to be not "normal".
[0228] The CPU 31 notifies the staff of the accommodation facility that "waiting for reconfirmation" has occurred via a room indicator, a text message, or the like (step S517). The staff checks the data recorded in the confirmation result DB 46 and, if necessary, visits the guest room to reconfirm the cleaning status.
[0229] The CPU 31 may record the inspection result using the robot 80 and the inspection result by a human inspector in the cleaning status DB 44 in a manner that allows them to be distinguished from each other. The CPU 31 may display the inspection result using the robot 80 and the inspection result by a human inspector on the room indicator 17 in a manner that allows them to be distinguished from each other.
[0230] After step S515 or step S518 is completed, CPU 31 judges whether or not to end the process (step S518). For example, if the time for providing the room cleaning service has ended, CPU 31 judges to end the process. If it is determined not to end (NO in step S518), CPU 31 returns to step S501. If it is determined to end (YES in step S518), CPU 31 ends the process.
[0231] Instead of or in addition to the robot 80, the CPU 31 may remotely control the camera 28 of the smart speaker 20 or other cameras installed in the passenger compartment to take pictures of the inside of the passenger compartment.
[0232] According to this embodiment, it is possible to provide an information processing system 10 that uses a robot 80 to perform a checking operation after cleaning is completed.
[0233] If it is determined in step S512 that there is an abnormality in the image, the CPU 31 may instruct the robot 80 to take additional images of the surrounding area, etc. The CPU 31 also records the additionally taken images in the confirmation result DB 46. The staff member who has received the notification in step S517 can quickly determine whether or not re-maintenance is required by checking the additionally taken images.
[0234] If it is determined in step S512 that there is an abnormality in the odor, the CPU 31 may remotely control the air conditioning equipment in the guest room to increase the ventilation level. The CPU 81 may execute the analysis in step S512 and transmit the analysis result together with the image, etc. to the management server.
[0235] The CPU 81 may check the cleaning status of common areas such as a corridor, a lounge, etc. The CPU 81 may check the cleaning status of a corridor or the like while moving to a guest room based on an instruction from the management server 30.
[0236] [Embodiment 8] This embodiment relates to an information processing system 10 that proposes a service when no explicit request has been received from a guest. In the following description, a format in which a service is proposed when no explicit request has been received is referred to as a push type. Descriptions of parts common to the first embodiment will be omitted.
[0237] FIG. 24 is an explanatory diagram for explaining an overview of the recommendation model of the eighth embodiment. The recommendation model is a model that receives the attributes of a guest, the weather, and the date and time, and outputs information about services proposed to the guest. The attributes of the guest include the attributes of the guest recorded in the PMS server 15, the requests of the guest acquired via the smart speaker 20, and the emotions of the guest inferred by analyzing the voices of the guest. The attributes of the guest include matters recorded in each subfield of the guest field described using FIG. 3.
[0238] The output data indicates the probability that each service that can be provided to the guest will be accepted by the guest. In the example shown in FIG. 24, the probability that "Wine-1" will be accepted by the guest is 30 percent, and the probability that "Wine-2" will be accepted by the guest is 25%. The output of the recommendation model is not limited to room service that brings items to the guest room. For example, it may be a restaurant reservation or a transportation reservation.
[0239] The recommendation model is created by machine learning such as deep learning based on training data that collects orders received from various guests in the past. The recommendation model may be a program that codes a decision tree that determines the maintenance status of the guest room based on the input data. The recommendation model realizes the function of a service determination unit that determines the service to be recommended to the guest.
[0240] 25 is an explanatory diagram for explaining the output of the smart speaker 20 in the eighth embodiment. The CPU 31 outputs services proposed to the guest via the smart speaker 20. The output is performed, for example, by displaying on the touch panel 25 and outputting from the microphone 26. The output may be performed from either the touch panel 25 or the microphone 26. The output may be performed from a television or radio in the guest room.
[0241] For example, if the guest responds with an "yes" to the suggestion, the CPU 31 notifies the room service staff of the guest's request. For example, if the guest responds with an "yes" to the suggestion, such as "non-alcoholic would be better," the CPU 31 acquires the guest's request through the chatbot via the smart speaker 20.
[0242] 26 is a flowchart for explaining the flow of processing of the program of the eighth embodiment. The CPU 31 judges whether or not a guest is present in the room (step S521). For example, if the room key has been left at the front desk or if it is a time period when a restaurant or the like has been reserved, the CPU 31 judges that the guest is not present in the room.
[0243] If it is determined that the guest is present in the room (YES in step S521), CPU 31 determines whether or not the guest is asleep (step S522). For example, CPU 31 obtains data from a sleep sensor arranged in the guest room to determine whether or not the guest is asleep. As sleep sensors include, for example, a type that is installed under the mattress and a type that is installed at the bedside, detailed explanations are omitted. CPU 31 may also determine whether or not the guest is asleep by detecting whether or not the lights in the guest room are on.
[0244] If it is determined that the guest is not asleep (NO in step S522), the CPU 31 acquires the guest's attributes based on the guest's attributes recorded in the PMS server 15, the guest's request acquired via the smart speaker 20, the guest's feelings inferred by analyzing the guest's voice, and the like (step S523). In step S523, the CPU 31 realizes the function of an attribute acquisition unit that acquires the guest's attributes.
[0245] The CPU 31 inputs the guest's attributes, the weather, and the date and time into the recommendation model described with reference to Fig. 24, and obtains information about the services to be output (step S524). Of the services determined to have a high probability of being accepted by the guest, the CPU 31 deletes services that cannot be provided to the guest due to reasons such as out-of-stock or the end of the service provision time (step S525). The CPU 31 determines whether or not there is a service among the remaining services that has a probability of being accepted by the guest that exceeds a predetermined threshold (step S526).
[0246] If it is determined that the service exists (YES in step S526), the CPU 31 proposes a service to the guest as described with reference to FIG. 25 (step S527). The CPU 31 determines whether the guest has responded to the proposal via the smart speaker 20 (step S528). In step S528, the CPU 31 realizes the function of a reception unit that receives a request for or against the provision of the proposed service.
[0247] If it is determined that there was no reaction (NO in step S528), CPU 31 records the content of the proposal and the fact that there was no reaction to the proposal in the guest's attributes (step S529). If it is determined that there was a reaction (YES in step S528), CPU 31 accepts the details of the guest's request via a chatbot or the like (step S531). CPU 31 records the content of the guest's request in the guest's attributes (step S532). CPU 31 notifies the responsible department of the content of the guest's request (step S533).
[0248] If the chatbot is unable to fully grasp the guest's request in step S531, the CPU 31 hands over the response to, for example, a front desk staff member.
[0249] If it is determined that the guest is not present in the room (NO in step S521), if it is determined that the guest is asleep (YES in step S522), or if it is determined that the guest does not exist (NO in step S526), after completing step S529, or after completing step S533, CPU 31 ends the process.
[0250] According to this embodiment, it is possible to provide an information processing system 10 that proposes services to guests in a push-type manner. By adding the guest's response to the proposal to the guest's attributes, it is possible to provide an information processing system 10 that improves the accuracy of proposals to regular guests.
[0251] When an appropriate suggestion is output, the guest can order the service with just the word "please." Therefore, it is possible to provide the information processing system 10 that allows the guest to easily enjoy the service.
[0252] [Embodiment 9] This embodiment relates to an information processing system 10 that provides services based on the physical condition information of a guest. Explanation of parts common to the eighth embodiment will be omitted.
[0253] 27 is an explanatory diagram for explaining the output of the smart speaker 20 of the ninth embodiment. The CPU 31 proposes services and the like to the guest based on the physical condition information of the guest. The proposal is made, for example, by displaying on the touch panel 25 and outputting from the microphone 26. The proposal may be made from either the touch panel 25 or the microphone 26. The proposal may be made from a television or radio in the guest room.
[0254] The physical condition information may be, for example, the depth of sleep, heart rate, respiratory rate, body temperature, etc., acquired from a sleep sensor placed in the guest room. The physical condition information may be body temperature measured with a non-contact thermometer placed in the guest room or in the hallway. The physical condition information may be blood pressure and heart rate measured with a blood pressure monitor placed in the guest room or in a shared facility. A sensor that detects the physical condition of the guest from excrement may be installed in the toilet in the guest room. The physical condition information may be the presence or absence of hoarseness in the guest's voice acquired by the smart speaker 20. The physical condition information may be a subjective physical condition acquired by the smart speaker 20 based on a conversation with the guest.
[0255] 27, a suggestion regarding making a reservation at a nearby clinic is output from the smart speaker 20. The CPU 31 may, for example, provide supplements that are useful for improving the guest's physical condition, or suggest changing the air conditioning temperature setting. The CPU 31 may not make a suggestion to the guest, but may automatically change the temperature setting of the air conditioning device by remote control.
[0256] 28 is a flowchart for explaining the flow of processing of the program of embodiment 9. The CPU 31 acquires the attributes of the guest based on the attributes of the guest recorded in the PMS server 15, the guest's request acquired via the smart speaker 20, and the guest's feelings inferred by analyzing the guest's voice and the guest's request (step S541).
[0257] The CPU 31 acquires the physical condition information of the guest (step S542). The CPU 31 determines whether or not there is something wrong with the physical condition of the guest (step S543). For example, the CPU 31 determines that there is something wrong with the physical condition of the guest when the body temperature exceeds 37.5 degrees, when there is something wrong with the heartbeat rhythm, or when there is something wrong with the respiratory rhythm. The CPU 31 may change the threshold value for determining the abnormality based on the attribute acquired in step S541.
[0258] If it is determined that there is an abnormality (YES in step S543), the CPU 31 determines whether or not the abnormality is serious (step S544). For example, if the body temperature exceeds 40 degrees or the heartbeat rhythm indicates ventricular fibrillation, the CPU 31 determines that there is a serious abnormality.
[0259] If it is determined that the abnormality is serious (YES in step S544), the CPU 31 speaks to the guest via the smart speaker 20, such as "Your fever seems very high. Would you like to call for help?" (step S545). If there is a reply from the guest, the CPU 31 uses the chatbot to converse with the guest via the smart speaker 20.
[0260] For example, if the guest mistakenly holds hot coffee over the body temperature sensor, and there is no abnormality in the guest's physical condition, the abnormal condition is resolved by speaking to the guest. The CPU 31 determines whether the abnormal condition has been resolved (step S546). If it is determined that the abnormal condition has not been resolved (NO in step S546), the CPU 31 notifies the hotel staff of the guest's condition (step S547).
[0261] If it is determined that the abnormality is not serious (NO in step S544), the CPU 31 determines the service to be provided to the guest based on the attribute and physical condition information of the guest (step S551). The determination is made based on a rule-based method such as a decision tree that performs case classification based on various information such as the presence or absence of fever, appetite, age, sex, nationality, and depth of sleep.
[0262] The CPU 31 provides the guest with a service that is expected to contribute to improving the guest's physical condition (step S552). For example, as described with reference to Fig. 27, the CPU 31 suggests to the guest to make a reservation at a nearby clinic via the smart speaker 20. The CPU 31 may remotely control an air conditioning device to change the room temperature.
[0263] If it is determined that there is no abnormality (NO in step S543), if it is determined that the abnormality has been resolved (YES in step S546), after the completion of step S547, or after the completion of step S552, CPU 31 ends the process.
[0264] According to the present embodiment, it is possible to provide an information processing system 10 that detects abnormalities in the physical condition of a guest and takes appropriate measures. It is possible to provide an information processing system 10 that automatically notifies staff when a guest is in such a serious condition that the guest is unable to call for help by himself / herself.
[0265] For example, if an infectious disease that causes fever, such as COVID-19, is spreading, if the CPU 31 detects a fever above the threshold value, it may notify staff or an infectious disease specialist and prohibit guests from going out.
[0266] When CPU 31 determines that there is nothing abnormal in the physical condition of the guest (NO in step S543), CPU 31 may acquire and provide to the guest a service for further improving the health of the guest.
[0267] [Variations] FIG. 29 is an explanatory diagram for explaining an outline of a recommendation model used in a modified example of the ninth embodiment. The recommendation model is a model that receives attributes of a guest and information on the physical condition of the guest, and outputs information on services that improve the physical condition of the guest. The attributes of the guest include the attributes of the guest recorded in the PMS server 15, the requests of the guest acquired via the smart speaker 20, and the emotions of the guest inferred by analyzing the voices of the guest. The attributes of the guest include matters recorded in each subfield of the guest field described using FIG. 3.
[0268] The output of the recommendation model in this embodiment is the expected probability that various services, such as changing the air conditioning settings in the guest room, providing supplements such as vitamins, and making reservations at nearby clinics, will contribute to improving the guest's physical condition.
[0269] In this modified example, in step S551, the CPU 31 inputs the attributes of the guest and the physical condition information of the guest into the recommendation model described with reference to Fig. 29, and obtains information related to the service to be output. The CPU 31 determines the service to be provided to the guest by extracting items with high probability from the output of the recommendation model.
[0270] [Embodiment 10] FIG. 30 is a functional block diagram of an information processing device according to a tenth embodiment. The information processing device includes an attribute acquisition unit 71, a service determination unit 72, an output unit 73, and a reception unit 74. The attribute acquisition unit 71 acquires attributes of the guest. The service determination unit 72 determines a service to be recommended to the guest based on the attributes acquired by the attribute acquisition unit 71. The output unit 73 outputs information on the service determined by the service determination unit 72 in a push format via a user interface 20 installed in the guest room where the guest is staying. The reception unit 74 receives the information on whether or not to provide the service output by the output unit 73 via the user interface 20.
[0271] [Embodiment 11] 31 is a functional block diagram of the information processing system 10 according to the embodiment 11. The information processing system 10 includes an information processing device 30 and a robot 80. The information processing device 30 includes an entry instruction unit 75, an image acquisition unit 76, and a confirmation unit 77.
[0272] The entry instruction unit 75 causes the robot 80 to enter the guest room after cleaning has been completed. The image acquisition unit 76 acquires images taken by a camera 88 mounted on the robot 80. The confirmation unit 77 confirms the cleaning status based on the images acquired by the image acquisition unit 76.
[0273] The robot 80 includes a moving unit 78 and a camera 88. The moving unit 78 moves to the guest room where cleaning has been completed. The camera 88 takes images in the guest room to be used for checking the cleaning status.
[0274] In each of the above-described embodiments, the information processing system 10 is mainly used in a hotel. A hotel is an example of an accommodation facility. The accommodation facility using the information processing system 10 is not limited to a hotel. An accommodation facility is any facility where guests can stay overnight and has rooms for lodging, i.e., guest rooms. Specific examples of accommodation facilities include inns, private lodging facilities, real estate, hospitals, nursing homes, condominiums, and villas.
[0275] A guest is an example of a person staying at an accommodation facility. A person staying at an accommodation facility may be an owner of the accommodation facility or an individual room included in the accommodation facility. A person staying at an accommodation facility may be a family member, relative, friend, or acquaintance of such an owner.
[0276] The following description will be given taking the case where the accommodation facility is a care facility as an example. The server of the system that stores information on the care-requiring persons staying there realizes the function of the PMS server 15 in each embodiment. The display that displays the cleaning and inspection status of each room in the care facility realizes the function of the room indicator 17 in each embodiment.
[0277] That is, the PMS server 15 is an example of a server that stores information about guests staying at the accommodation facility. The room indicator 17 is an example of a display device that displays a list of the cleaning and inspection status of each room in the accommodation facility.
[0278] The technical features (constitutive elements) described in each embodiment can be combined with each other, and by combining them, new technical features can be formed. The embodiments disclosed herein are illustrative in all respects and should not be considered as limiting. The scope of the present invention is defined by the claims, not by the above meaning, and is intended to include all modifications within the scope and meaning equivalent to the claims.
[0279] (Appendix 1) The data is acquired through a user interface installed in the guest room of the accommodation facility. Controlling devices in the accommodation facility based on the acquired data and a user interface identifier that identifies the user interface. A program that causes a computer to carry out processing.
[0280] (Appendix 2) The device is a room indicator that displays the cleaning status of the guest room at a glance. 2. The program described in Appendix 1.
[0281] (Appendix 3) If the acquired data indicates a request for cleaning of the guest room in which the user interface is installed, outputting to the room indicator that the guest room is waiting to be cleaned. 2. The program described in Appendix 2.
[0282] (Appendix 4) If the acquired data indicates the completion of a task in the guest room in which the user interface is installed, determining whether or not a user who issued the acquired data is a specific person in charge; If it is determined that the person in charge is a specified person, a message indicating that the work has been completed is output to the room indicator. 2. A program according to claim 2 or 3.
[0283] (Appendix 5) If the acquired data indicates completion of confirmation of the work performed in the guest room in which the user interface is installed, determining whether or not the user who issued the acquired data is a predetermined person in charge of confirmation; If it is determined that the person in charge of confirmation is a specified person in charge of confirmation, a message indicating that confirmation has been completed is output to the room indicator. 5. A program according to any one of claims 2 to 4.
[0284] (Appendix 6) The device is a robot that transports items within the accommodation facility. 2. The program described in Appendix 1.
[0285] (Appendix 7) If the acquired data indicates a cleaning request for a guest room in which the user interface is installed, an instruction is output to the robot to transport items to be used for cleaning to the guest room. 6. The program described in Appendix 6.
[0286] (Appendix 8) if the acquired data indicates completion of an activity in a guest room in which the user interface is installed; Output an instruction to the robot to collect items used in cleaning from the guest room. 13. A program according to claim 6 or 7.
[0287] (Appendix 9) If the acquired data indicates a request to deliver an item to a guest room in which the user interface is installed, output an instruction to the robot to deliver the requested item to the guest room. 10. The program according to any one of claims 6 to 8.
[0288] (Appendix 10) The acquired data is audio data. 10. The program of any one of appendixes 1 to 9.
[0289] (Appendix 11) The data is acquired through a user interface installed in the guest room of the accommodation facility. Controlling devices in the accommodation facility based on the acquired data and a user interface identifier that identifies the user interface. An information processing method for causing a computer to execute processing.
[0290] (Appendix 12) An acquisition unit that acquires acquired data from a user interface installed in a guest room of the accommodation facility; an equipment control unit that controls equipment in the accommodation facility based on the acquired data acquired by the acquisition unit and a user interface identifier that identifies the user interface; An information processing device comprising: [Explanation of symbols]
[0291] 10. Information Processing Systems 14 Voice response server 15 PMS Server 16 PBX 17 Room Indicator (Equipment) 18 Information processing terminal (user interface) 20 Smart Speaker (User Interface) 21 CPU 22 Main storage 23 Auxiliary storage device 24 Communications Department 25 Touch Panel 251 Display section 252 Input section 26. Mike 27 Speaker 28 Camera 30 Management server (information processing device) 31 CPU 32 Main storage 33 Auxiliary storage device 34 Communications Department 36 Reading unit 41 Speaker DB 44 Cleaning status DB 45 Confirmation Condition DB 46 Confirmation result DB 71 Attribute acquisition part 72 Service Judgment Department 73 Output section 74 Reception 75 Entry instruction section 76 Image acquisition unit 77 Confirmation Department 78 Mobile Division 80 Robot (equipment) 81 CPU 82 Main storage 83 Auxiliary storage device 84 Communications Department 85 Touch Panel 851 Display section 852 Input section 86 Mike 87 Speaker 88 Camera 89 Odor Sensor 90 Computer 91 Acquisition Department 92 Equipment control section 96 Portable recording media 97 Program 98 Semiconductor Memory
Claims
1. Extract information about rooms that have been cleaned from a database that records the cleaning status of guest rooms, Based on the information, the robot enters the room that has been cleaned. Acquire an image taken by a camera mounted on the robot; Check the cleaning status based on the image A program that causes a computer to carry out processing.
2. The robot is made to take an image having the same layout as a predetermined reference image. The program according to claim 1.
3. Acquire odor data measured by an odor sensor mounted on the robot; The cleaning state is confirmed based on the image and the odor data. The program according to claim 1 or 2.
4. Based on the plurality of images taken in the guest room, it is determined whether the cleaning state of the guest room is normal or not. The program according to any one of claims 1 to 3.
5. A determination is made as to whether or not the cleaning state of the guest room is normal based on the plurality of images taken in the guest room and the odor data. The program according to claim 3.
6. If the cleaning condition of the guest room is determined to be normal, record the determination result. The program according to any one of claims 1 to 5.
7. If it is determined that the cleaning condition of the guest room is not normal, the determination result is recorded and the determination result is notified. The program according to any one of claims 1 to 6.
8. The result of judging whether the cleaning status is normal or not is displayed on a room indicator that displays a list of the cleaning status of the guest rooms. The program according to any one of claims 4 to 7.
9. The robot delivers cleaning tools to the guest room that it is scheduled to clean. The program according to any one of claims 1 to 8.
10. When a guest is staying in the guest room, the robot is not allowed to enter the guest room. The program according to any one of claims 1 to 9.
11. Acquire the attributes of guests, determining services to recommend to the guest based on the acquired attributes; outputting information about the service in a push format through a user interface installed in the guest room where the guest is staying; Accepting a request for provision of the service via the user interface The program according to any one of claims 1 to 10.
12. The service to be recommended to the lodger is determined using a recommendation model that receives attributes of the lodger and outputs information about the service to be recommended to the lodger. The program according to claim 11.
13. The attributes of the lodger include physical condition information of the lodger acquired from a sensor installed in the lodging facility. The program according to claim 11 or 12.
14. If the health information indicates that the guest is in an abnormal physical condition, notify the accommodation staff. The program according to claim 13.
15. Extract information about rooms that have been cleaned from a database that records the cleaning status of guest rooms, Based on the information, the robot enters the room that has been cleaned. Acquire an image taken by a camera mounted on the robot; Check the cleaning status based on the image An information processing method for causing a computer to execute processing.
16. an extraction unit that extracts information about guest rooms that have been cleaned from a database that records the cleaning status of the guest rooms; an entry instruction unit that causes the robot to enter the room that has been cleaned based on the information; an image acquisition unit that acquires an image captured by a camera mounted on the robot; a confirmation unit for confirming the cleaning state based on the image; An information processing device comprising:
17. a receiving unit for receiving information on guest rooms that have been cleaned, the information being extracted from a database that records the cleaning status of the guest rooms; a moving unit that moves to the guest room for which cleaning has been completed based on the information received by the receiving unit; A camera for taking images used to check the cleaning status in the guest room; A robot comprising:
18. Transmitting the image to an information processing system that determines the cleaning state based on the image. The robot of claim 17.
19. The cleaning state is determined based on the image. The robot of claim 17.
Citation Information
Patent Citations
Room service method based on voice assistant
CN108961099A
Lock and locking device using the same
JP1996021138A
Information provision device, information provision method and information provision program
JP2017167679A
Hotel service providing method and hotel service providing system
US20170223482A1
Program and information processing method
WO2019244365A1
