Information processing device, information processing method, information processing program, and information processing system
The information processing device addresses inefficiencies in ICT services by enabling voice-activated task execution, automating task orders, and improving service efficiency in accommodation facilities.
Patent Information
- Application Number
- JP2024016396
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-02-06
- Publication Date
- 2025-08-19
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Conventional ICT services for accommodation facilities are inefficient due to the operational burden on users who need to manually operate smartphones or tablets, which hinders seamless service provision.
An information processing device equipped with a voice input unit and an output control unit that analyzes voice commands and automatically executes tasks, reducing the need for manual operation by converting voice inputs into actionable orders for associated tasks.
Efficiently provides ICT services by allowing users to interact via voice commands, reducing operational burden and enhancing service efficiency through automated task execution.
Smart Images

Figure 2025121142000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to an information processing device, an information processing method, an information processing program, and an information processing system. [Background technology]
[0002] Conventionally, ICT (Information and Communication Technology) services have been proposed to improve the efficiency of hotel operations. For example, a method is known in which, when an electronic message addressed to a guest is sent to the hotel, the guest can receive the message without going through the front desk (see, for example, Patent Document 1). Also known is a technology that supports ordering by hotel staff and guests using smartphones and tablet devices installed in guest rooms (see, for example, Non-Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Publication No. 5-290060 [Non-patent literature]
[0004] [Non-Patent Document 1] "Smart All in", Techno Support Company, Inc. [Retrieved January 19, 2024], Internet<URL:https: / / tsc-soft.co.jp / wp-content / uploads / 2019 / 08 / SmartAllin_digitalecatalog.pdf> Summary of the Invention [Problem to be solved by the invention]
[0005] However, conventional technologies may not be able to efficiently provide ICT services for accommodation facilities.
[0006] For example, in the technology described in Non-Patent Document 1, the user (guest or employee) needs to operate the smartphone or tablet terminal by hand, which places an operational burden on the user. [Means for solving the problem]
[0007] In order to solve the above-mentioned problems and achieve the objectives, the information processing device of the present invention is characterized by having an analysis unit that analyzes voice collected by a voice input device, and an output control unit that outputs information regarding the voice order to an object associated with the task ordered by the voice based on the analysis results by the analysis unit. [Effects of the Invention]
[0008] According to the present invention, ICT services for accommodation facilities can be provided efficiently. [Brief explanation of the drawings]
[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to the first embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of the configuration of the information processing device according to the first embodiment. [Figure 3] FIG. 3 is a diagram showing an example of a guest room table. [Figure 4] FIG. 4 is a diagram illustrating an example of the assistant table. [Figure 5] FIG. 5 is a diagram illustrating an example of the guest table. [Figure 6] FIG. 6 is a diagram illustrating an example of the device table. [Figure 7] FIG. 7 is a diagram illustrating an example of the facility table. [Figure 8] FIG. 8 is a diagram illustrating an example of the task table. [Figure 9] FIG. 9 is a diagram illustrating an example of the configuration of a voice assistant device. [Figure 10]FIG. 10 is a diagram illustrating the operation of the information processing system. [Figure 11] FIG. 11 is a diagram illustrating the operation of the information processing system. [Figure 12] FIG. 12 is a diagram illustrating the operation of the information processing system. [Figure 13] FIG. 13 is a diagram illustrating the operation of the information processing system. [Figure 14] FIG. 14 is a diagram illustrating the operation of the information processing system. [Figure 15] FIG. 15 is a flowchart showing the flow of processing by the information processing device according to the first embodiment. [Figure 16] FIG. 16 is a flowchart showing the flow of processing by the information processing device according to the first embodiment. [Figure 17] FIG. 17 is a diagram illustrating an example of the configuration of a computer that executes an information processing program. DETAILED DESCRIPTION OF THE INVENTION
[0010] Hereinafter, embodiments of an information processing device, an information processing method, an information processing program, and an information processing system according to the present application will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to the embodiments described below.
[0011] [First embodiment] [Configuration of the first embodiment] First, the configuration of an information processing system according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of the configuration of an information processing system according to the first embodiment.
[0012] The information processing system 1 is a system for providing users with ICT services related to accommodation facilities. Users include guests and employees of accommodation facilities. In the following description, guests will be referred to as guests, and employees will be referred to as staff. An accommodation facility is a facility that has multiple guest rooms and provides services such as accommodation and meals to guests. In this embodiment, the accommodation facility is a hotel. However, the accommodation facility may also be a facility other than a hotel, such as an inn, guesthouse, or pension.
[0013] 1, the information processing system 1 includes an information processing device 10, a terminal 21 connected to the information processing device 10 via a network N, a guest room control device 31, and a voice assistant device 32. The network N may be a local network provided within a hotel, or may include an external network such as the Internet.
[0014] Note that multiple cabin control devices (e.g., cabin control device 31a and cabin control device 31b) will be referred to as cabin control device 31 without distinction. Also, multiple voice assistant devices (e.g., voice assistant device 32a and voice assistant device 32b) will be referred to as voice assistant device 32 without distinction. Similarly, for elements that are assigned a symbol that combines numbers and letters, if the letters are omitted, it will not be considered that the elements that share the numerical portion will be distinguished from each other.
[0015] The terminal 21 is provided at the front desk 2 of the hotel. However, the terminal 21 may be a terminal used by an employee. The terminal 21 may be a device carried by an employee. The terminal 21 may also be a smartphone, a personal computer, a tablet terminal, or a voice assistant device. There may also be multiple terminals 21.
[0016] Each guest room is provided with a cabin control device 31 and a voice assistant device 32. For example, the guest room 3a is provided with a cabin control device 31a and a voice assistant device 32a.
[0017] The cabin control device 31 is a so-called control panel. The cabin control device 31 is connected to the device group 33 and the sensor group 34 by wire or wirelessly. The cabin control device 31 can transmit and receive control signals, sensor values, etc. between the device group 33 and the sensor group 34.
[0018] The device group 33 includes a fan coil unit, lighting, an outlet, curtains, a night panel, a DND (Do Not Disturb) / MR (Make Up Room) lamp, etc. The sensor group 34 includes a magnet sensor, a motion sensor, a temperature sensor, etc.
[0019] The voice assistant device 32 is a device that receives voice input and outputs voice. A user can operate the voice assistant device 32 by voice. The voice assistant device 32 analyzes the input voice and performs processing according to the analysis result. The voice assistant device 32 also outputs voice according to the processing result.
[0020] The voice assistant device 32 has at least a function of receiving voice input, a function of outputting voice, and a function of transmitting and receiving data to and from other devices via the network N. The voice assistant device 32 may be a so-called smart speaker.
[0021] The voice assistant device 32 converts input voice into voice data. The voice data is data that represents the waveform of the voice as a digital signal. The voice assistant device 32 also outputs voice based on the voice data.
[0022] The function of analyzing voice and the function of performing processing according to the analysis results may be realized by the voice assistant device 32, or may be realized by another device (for example, the information processing device 10, the cabin control device 31, or an external server) connected to the voice assistant device 32. In this embodiment, processing such as voice analysis is performed by the information processing device 10.
[0023] Furthermore, the information processing system 1 is connected to a group of in-building facilities 4. The group of in-building facilities 4 includes an elevator system 41, a laundry system 42, and the like. The systems of the group of in-building facilities 4 are a combination of equipment, sensors for managing the equipment, and computers. For example, the elevator system 41 includes equipment such as cars for passengers to ride in and hoists, sensors for measuring the position of the cars, and computers for controlling the raising and lowering of the cars and the opening and closing of the doors. Also, for example, the laundry system 42 includes washing machines, rooms in which the washing machines are installed, and computers for controlling each washing machine.
[0024] The configuration of the information processing device 10 will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the configuration of the information processing device according to the first embodiment. As shown in Fig. 2, the information processing device 10 includes a communication unit 11, a control unit 12, and a storage unit 13.
[0025] The communication unit 11 is an interface for communicating with other devices. The communication unit 11 communicates with the cabin control device 31 and the voice assistant device 32.
[0026] The control unit 12 has an internal memory for storing programs that define various processing procedures and necessary data, and executes various processes using these. Here, the control unit 12 is, for example, an electronic circuit such as a CPU or an MPU (Micro Processing Unit), or an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).
[0027] The control unit 12 includes a receiving unit 121 , an analyzing unit 122 , a generating unit 123 , an updating unit 124 , and an output control unit 125 .
[0028] The receiving unit 121 receives input of voice data. For example, the receiving unit 121 receives input of voice data via the voice assistant device 32.
[0029] The analysis unit 122 analyzes the voice data, converts the voice data into text data, and interprets the meaning of the voice data or the text data obtained by conversion.
[0030] The analysis unit 122 analyzes the voice data using an existing voice recognition method. For example, the analysis unit 122 performs the analysis using a machine learning model for performing a voice recognition task, a text analysis task, etc. The analysis unit 122 can also extract specific keywords from the voice data.
[0031] The generation unit 123 generates data to be output. For example, the generation unit 123 generates voice data representing a voice to be output from the voice assistant device 32. Also, for example, the generation unit 123 generates a control signal to control each device via the cabin control device 31.
[0032] The update unit 124 updates the database related to the information processing system 1. Updating the database includes, for example, updating the values of records in a table, adding records to a table, deleting records from a table, and so on.
[0033] The output control unit 125 controls the output of data to other devices. For example, the output control unit 125 outputs (transmits) the data generated by the generation unit 123 to the cabin control device 31, the voice assistant device 32, etc. via the communication unit 11.
[0034] The storage unit 13 stores data and programs necessary for various processes performed by the control unit 12. For example, the storage unit 13 is a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk.
[0035] The memory unit 13 includes model information 131 , a guest room table 132 , an assistant table 133 , a guest table 134 , a device table 135 , a facility table 136 , and a task table 137 .
[0036] The model information 131 is parameters for constructing a model used to analyze voice data. If the model is a neural network, the model information 131 is parameters such as weights and biases. The analysis unit 122 can analyze voice data using a model constructed based on parameters read from the model information 131.
[0037] The guest room table 132 is a table that stores information about guest rooms. Fig. 3 is a diagram showing an example of the guest room table. As shown in Fig. 3, the guest room table 132 includes columns for "room ID," "floor," "room number," and "size."
[0038] The column "Room ID" stores an ID that identifies the guest room. The column "Floor" stores the floor on which the guest room is located. The column "Room Number" stores a number assigned to the guest room. The column "Size" stores the size of the guest room (for example, the type of bed).
[0039] For example, FIG. 3 shows that a guest room with ID "R001" is located on "3F," the room number is "301," and the size is "twin."
[0040] The assistant table 133 is a table that stores information about the voice assistant device 32. Fig. 4 is a diagram showing an example of the assistant table. As shown in Fig. 4, the assistant table 133 includes columns of "assistant ID," "room ID," "MAC address," and "set language."
[0041] The column "Assistant ID" stores an ID that identifies the voice assistant device 32. The column "Room ID" stores the ID of the guest room in which the voice assistant device 32 is installed. The column "MAC Address" stores the MAC address of the voice assistant device 32. The column "Set Language" stores the language set in the voice assistant device 32.
[0042] For example, Figure 4 shows that a voice assistant device 32 with an ID of "A001" is installed in guest room "R001," has a MAC address of "00:00:5e:00:53:01," and has a set language of "Japanese."
[0043] The guest table 134 is a table that stores information about guests. Fig. 5 is a diagram showing an example of the guest table. As shown in Fig. 5, the guest table 134 includes columns such as "guest ID," "room ID," "language," "gender," and "age."
[0044] The column "Guest ID" stores an ID that identifies the guest. The column "Room ID" stores an ID that identifies the guest room where the guest is staying. The column "Language" stores the language associated with the guest. The column "Gender" stores the gender of the guest. The column "Age" stores the age of the guest.
[0045] For example, Figure 5 shows that a guest with ID "G001" is staying in guest room "R001," speaks "Japanese," is male, and is 66 years old.
[0046] The device table 135 is a table that stores information about devices and sensors installed in guest rooms. Fig. 6 is a diagram showing an example of the device table. As shown in Fig. 6, the device table 135 includes columns of "room ID," "device ID," and "type."
[0047] The column "Room ID" stores an ID that identifies the room in which the device or sensor is installed. The column "Device ID" stores an ID that identifies the device or sensor. The column "Type" stores the type of device or sensor.
[0048] For example, FIG. 6 shows that a sensor or device with an ID of "D00101" is installed in guest room "R001" and its type is "lighting."
[0049] The facility table 136 is a table that stores information about facilities within the building. Fig. 7 is a diagram showing an example of the facility table. As shown in Fig. 7, the facility table 136 includes columns for "facility ID," "name," and "operation status."
[0050] The column "Facility ID" stores an ID that identifies the facility within the building. The column "Name" stores the name of the facility within the building. The column "Operation Status" stores the operation status of the facility within the building.
[0051] For example, FIG. 7 shows that the name of the facility in the building with ID "F001" is "Elevator No. 1" and the operation status is "Stopped at 1st floor."
[0052] The task table 137 is a table that stores information about tasks for staff members. Fig. 8 is a diagram showing an example of the task table. As shown in Fig. 8, the task table 137 includes columns such as "task ID," "task type," "person in charge," and "submission destination."
[0053] The column "Task ID" stores an ID that identifies a task. The column "Task Type" stores the type of task. The column "Responsible Person" stores the person in charge of the task. The column "Submission Destination" stores the destination where data related to the task is submitted.
[0054] For example, FIG. 8 shows that the type of the task with ID "T001" is "in-room dining", the person in charge is "in-room dining reception", and the input destination is "restaurant POS".
[0055] The structure and contents of the data stored in the information processing device 10 are not limited to those described here. Data according to the services to be provided may be added to the information processing device 10 as appropriate.
[0056] The configuration of the voice assistant device 32 will be described using Fig. 9. Fig. 9 is a diagram showing an example of the configuration of the voice assistant device. As shown in Fig. 9, the voice assistant device 32 has a communication unit 321, a voice input unit 322, a voice output unit 323, a control unit 324, and a storage unit 325.
[0057] The communication unit 321 is an interface for communicating with other devices, and communicates with the cabin control device 31 and the information processing device 10.
[0058] The audio input unit 322 is a device that accepts audio input. The audio input unit 322 is, for example, a microphone. The audio output unit 323 is a device that outputs audio. The audio output unit 323 is, for example, a speaker. In other words, the voice assistant device 32 corresponds to both an audio input device that collects audio and an audio output device that outputs audio.
[0059] The control unit 324 has an internal memory for storing programs that define various processing procedures and necessary data, and executes various processes using these. Here, the control unit 324 is, for example, an electronic circuit such as a CPU or MPU, or an integrated circuit such as an ASIC or FPGA.
[0060] The storage unit 325 stores data and programs necessary for various processes performed by the control unit 324. For example, the storage unit 325 is a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk.
[0061] The information processing system 1 can provide various services at the accommodation facility using each device. Also, guests can communicate with staff and other guests via the voice assistant device 32 provided in their guest rooms. Also, guests can operate the devices 33 in their guest rooms and obtain information about the facilities within the hotel via the voice assistant device 32.
[0062] In this way, according to the information processing system 1, when a guest receives a service, the guest need only operate the voice assistant device 32 by voice, without having to operate a device with his or her hands. As a result, the operational burden on the user is reduced, and the service can be provided efficiently.
[0063] [Example] Here, the information processing system 1 can realize a dialogue between the guest and the voice assistant device 32. For example, the voice assistant device 32 replies to the voice input by the guest by outputting a voice.
[0064] 5, each guest is associated with a language in guest table 134. The language in guest table 134 may be registered by a hotel reservation system when a guest makes a reservation for a stay at a hotel. Alternatively, the language in guest table 134 may be manually registered by a user.
[0065] As shown in FIG. 10, the voice assistant device 32 replies to the guest in a registered language. FIG. 10 is a diagram illustrating the operation of the information processing system. As shown in FIG. 10, first, the guest utters "Hello" in Japanese (step S511). In response to the guest's utterance, the voice assistant device 32 outputs a Japanese voice saying "Hello, how can I help you?" (step S512). The guest then utters in Japanese, "It's cold, so please turn up the air conditioner temperature." (step S513). Then, the voice assistant device 32 outputs a Japanese voice saying "I understand" (step S514).
[0066] At this time, the reception unit 121 of the information processing device 10 receives input of voice data based on the voice of the guest from the voice assistant device 32. The analysis unit 122 analyzes the voice data. The generation unit 123 identifies a language associated with the guest. The generation unit 123 generates voice data of a response in the identified language. The output control unit 125 transmits the generated voice data to the voice assistant device 32.
[0067] For example, the voice assistant device 32 transmits the ID of its own device along with the voice data to the information processing device 10. Based on the ID of the voice assistant device 32 that transmitted the voice, the information processing device 10 refers to the assistant table 133 and the guest room table 132, and identifies the language of the guest staying in the guest room in which the voice assistant device 32 is installed.
[0068] In this way, the output control unit 125 outputs to the voice assistant device 32 installed in the guest room a message in response to the voice, which message is generated in the language associated with the voice assistant device 32. This makes it possible to provide services that are compatible with speakers of various languages.
[0069] FIG. 11 is a diagram illustrating the operation of the information processing system. FIG. 11 shows an example in which the language associated with the guest is English. As shown in FIG. 11, first, the guest utters "Hello." in English (step S521). In response to the guest's utterance, the voice assistant device 32 outputs the English voice "Hello, can I help you?" (step S522). Furthermore, the guest utters "Please turn the air conditioner up." in English (step S523). Then, the voice assistant device 32 outputs the English voice "Of course." (step S524).
[0070] 12, when a guest instructs to change the language, the information processing device 10 can change the language associated with the guest. The voice assistant device 32 responds in the changed language.
[0071] 12, the voice assistant device 32 outputs a voice in English saying, "Hello, can I help you?" (Step S531). Then, the guest speaks in Japanese saying, "Please speak in Japanese" (Step S532).
[0072] At this time, the update unit 124 of the information processing device 10 determines, based on the analysis result of the voice data, that there has been an instruction to change the language from English to Japanese. Then, the update unit 124 updates the set language in the assistant table 133 corresponding to the assistant who input the voice data from "English" to "Japanese."
[0073] Thereafter, the generation unit 123 generates voice data of a reply in Japanese by referring to the updated assistant table 133. As a result, the voice assistant device 32 outputs the voice "I understand" (step S533).
[0074] 13, the information processing system 1 can realize a dialogue between the guest and the staff member via the voice assistant device 32. In this case, the language used by the guest and the language used by the staff member may differ.
[0075] 13, it is assumed that the guest speaks English and the staff speaks Japanese. It is assumed that the information processing device 10 stores the language (English) associated with the voice assistant device 32 and the language (Japanese) associated with the terminal 21 used by the staff.
[0076] The analysis unit 122 of the information processing device 10 analyzes that the voice data input from the voice assistant device 32 is "Hello." in English. The generation unit 123 generates voice data representing "Hello.", which is a Japanese translation of the English "Hello." Then, the output control unit 125 transmits the generated voice data to the terminal 21, causing it to output the voice "Hello." Note that the format of the output from the terminal 21 is not limited to voice, and may be a text message or the like.
[0077] In this way, the output control unit 125 outputs to the terminal 21 a message indicating information about the voice order, which is generated in the language associated with the terminal 21 of the person in charge associated with the task, based on the analysis result by the analysis unit 122. This allows the guest and staff to communicate even if they speak different languages.
[0078] Furthermore, the information processing system 1 can transmit orders from guests input via the voice assistant device 32 to staff. The staff performs tasks that arise in response to the orders. At this time, it is assumed that a person in charge (person in charge, responsible department, etc.) is assigned to each task. The person in charge for each task is stored in the task table 137.
[0079] 14, consider the case where a guest says, "I would like to dine in my room," to the voice assistant device 32. The analysis unit 122 of the information processing device 10 analyzes the input voice data and determines that an order for dining in the room, i.e., "in-room dining," has been placed.
[0080] The output control unit 125 refers to the task table 137 and identifies that the person in charge of "in-room dining" is the "room dining receptionist." Then, the output control unit 125 outputs a voice message to the terminal 21a used by the room dining receptionist, saying, "A customer in room XXX has placed an order for in-room dining." It is assumed that the information processing device 10 stores in advance the correspondence between the person in charge and the terminal.
[0081] In this way, the output control unit 125 outputs information about the voice order to the target (person in charge) associated with the task ordered by voice, based on the analysis result by the analysis unit 122. As a result, the voice order made by the guest is automatically conveyed to the person in charge, etc., thereby improving the efficiency of service provision.
[0082] 8, the task table 137 stores the following tasks: in-room dining (an example of serving meals), turndown (an example of cleaning), replenishing amenities, shopping, and baggage removal (an example of transporting luggage). As a result, the output control unit 125 can determine whether the task ordered by voice is serving meals, cleaning, replenishing supplies, purchasing goods, or transporting luggage, and output information about the voice order to the terminal of the person in charge associated with the determined task. In this way, the information processing device 10 can handle the contents of major orders that occur in a hotel.
[0083] Furthermore, for a task for which a destination is specified in the task table 137, the output control unit 125 inputs data created based on the order into the system of the destination.
[0084] The information processing device 10 may also acquire the contents of the order by having a dialogue with the guest. For example, the output control unit 125 causes the voice assistant device 32 to output a voice question corresponding to the task. The contents of the order include information specifying the goods or services desired by the guest, the quantity of the goods or services desired by the guest, the time when the goods or services desired by the guest will be provided, etc.
[0085] For example, if the task is "in-room dining," the output control unit 125 outputs a voice prompt asking, "What would you like to order?" to specify the item to be ordered. In response, the guest responds, "A sandwich." Once the item to be ordered is determined, the output control unit 125 outputs a voice prompt asking, "How many?" to specify the quantity. In response, the guest responds, "One."
[0086] Furthermore, when the order for one item is confirmed, the output control unit 125 outputs a voice message saying, "Is there anything else you would like to order?" In response, the guest responds, "I'd like a beer, please." Furthermore, if there are multiple brands of beer, the output control unit 125 outputs a voice message saying, "We have beer A and beer B. Which would you like?" In response, the guest responds, "I'd like one beer A, please."
[0087] Furthermore, since the beer order has been confirmed, the output control unit 125 outputs a voice message asking, "Is there anything else you would like to order?" In response, the guest replies, "No." The output control unit 125 determines that all the order details have been confirmed, and outputs a voice message saying, "Confirming your order. One sandwich and one A beer, correct?" in order to confirm the order details. If the guest replies affirmatively, such as "Yes," the information processing device 10 outputs the order details to the person in charge.
[0088] The tasks are not limited to those shown in FIG. 8 and the like. For example, the tasks include tourist information around the hotel and transportation information. For example, when a guest places an order for tourist or transportation information, the information processing device 10 generates a response message based on information acquired from an external database or the like and transmits the response message to the voice assistant device 32.
[0089] [Processing procedure of information processing device] Fig. 15 is a flowchart showing the flow of processing in the information processing device according to embodiment 1. Fig. 15 shows processing in the case where audio data is output to a guest according to a language.
[0090] 15, first, the information processing device 10 waits until it receives input of voice data (step S101, No). When the information processing device 10 receives input of voice data (step S101, Yes), it analyzes the voice data (step S102).
[0091] The information processing device 10 determines whether or not an instruction to change the language has been given based on the analysis result (step S103). If the information processing device 10 determines that an instruction to change the language has been given (step S103, Yes), it changes the language associated with the voice assistant device 32 (step S104). If the information processing device 10 determines that an instruction to change the language has not been given (step S103, No), it proceeds to step S105.
[0092] The information processing device 10 may make the determination in step S103 using a machine learning model trained to determine whether or not an instruction to change the language is given and to output the language to which the language is to be changed, based on the voice data or text data.
[0093] Next, the information processing device 10 acquires the language associated with the voice assistant device 32 (step S105). The information processing device 10 generates voice data according to the analysis result, in the language associated with the voice assistant device (step S106). Then, the information processing device 10 outputs the generated voice data to the voice assistant device 32 (step S107). Thereafter, the voice assistant device 32 outputs voice based on the voice data.
[0094] Fig. 16 is a flowchart showing the flow of processing in the information processing device according to the first embodiment. Fig. 16 shows processing when an order is received from a guest.
[0095] 16, first, the information processing device 10 waits until it receives input of voice data (step S201, No). When the information processing device 10 receives input of voice data (step S201, Yes), it analyzes the voice data (step S202).
[0096] The information processing device 10 determines whether the content of the voice data is interpretable based on the analysis result (step S203). If the information processing device 10 determines that the content of the voice data is interpretable (step S203, Yes), it determines whether the content of the voice data is a task order (step S204).
[0097] The information processing device 10 may make the determination in step S203 using a machine learning model that has been trained to output, based on voice data or text data, whether a task has been ordered and which of the tasks stored in the task table 137 has been ordered.
[0098] When the information processing device 10 determines that the content of the voice data is a task order (step S204, Yes), it identifies the person in charge of the task (step S205). Then, the information processing device 10 transmits a message to an address corresponding to the identified person in charge (step S206). For example, the information processing device 10 transmits a message indicating that an order has been placed or the contents of the order to a terminal associated with the person in charge.
[0099] When the information processing device 10 determines that the content of the voice data is not a task order (step S204, No), it executes a process corresponding to the content (step S207).
[0100] Furthermore, if the information processing device 10 determines in step S203 that the content of the voice data cannot be interpreted (step S203, No), it requests re-input of the voice (step S208). For example, the information processing device 10 causes the voice assistant device 32 to output a voice saying, "Please say that again."
[0101] The information processing device 10 may simultaneously perform the process shown in Fig. 15 and the process shown in Fig. 16. For example, when an order is made by a guest, the information processing device 10 generates voice data in a language associated with the guest as a reply to the effect that the order has been accepted.
[0102] Furthermore, when an order is made by a guest in a first language (e.g., English), the information processing device 10 may send a message generated in a second language (e.g., Japanese) that is associated in advance with the identified person in charge.
[0103] In this embodiment, the voice input device and the voice output device are described as being voice assistant devices 32 (so-called smart speakers) installed in guest rooms of accommodation facilities. However, the voice input device and the voice output device are not limited to those described above.
[0104] For example, the voice input device may be a mobile terminal device such as a smartphone or tablet operated by an employee, or a device such as an Inter Communication System. In this case, for example, when a guest makes various requests to an employee face-to-face (for example, to the front desk or to a passing employee), the employee who handles the request face-to-face can accept the input of the voice request from the guest. In other words, when an employee receives a voice request from a guest face-to-face, the employee can accept the voice request via the employee's smartphone or tablet, a stationary microphone, a smart speaker that allows the user and the device to respond in natural language, or the like.
[0105] The voice input device and the voice output device may be a mobile terminal device of the guest. In this case, the voice input device and the voice output device may be realized as a device that enables internal calls to employees of the accommodation facility and other guests by installing an application that realizes the program according to the present embodiment on the mobile terminal device such as a smartphone or tablet of the guest.
[0106] [System configuration, etc.] Furthermore, the components of each device shown in the figure are functional concepts and do not necessarily have to be physically configured as shown. In other words, the specific form of distribution and integration of each device is not limited to that shown, and all or part of the devices can be functionally or physically distributed or integrated in any unit depending on various loads, usage conditions, etc. Furthermore, all or any part of the processing functions performed by each device can be realized by a CPU (Central Processing Unit) and a program analyzed and executed by the CPU, or can be realized as hardware using wired logic. Note that the program may be executed not only by the CPU but also by other processors such as a GPU.
[0107] Furthermore, among the processes described in this embodiment, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using a known method.In addition, the information including the processing procedures, control procedures, specific names, various data and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified.
[0108] [program] In one embodiment, the information processing device 10 can be implemented by installing an information processing program that executes the above-described processes as package software or online software on a desired computer. For example, by executing the above-described information processing program on a computer, the computer can function as the information processing device 10. The term "computer" as used herein includes desktop and notebook personal computers. Other examples of computers also include mobile communication terminals such as smartphones, mobile phones, and PHS (Personal Handyphone Systems), as well as slate terminals such as PDAs (Personal Digital Assistants). The information processing device 10 may also be implemented as a cloud that provides services related to the above-described processes.
[0109] 17 is a diagram showing an example of a computer that executes an information processing program. The computer 1000 includes, for example, a memory 1010 and a CPU 1020. The computer 1000 also includes a hard disk drive interface 1030, a disk drive interface 1040, a serial port interface 1050, a video adapter 1060, and a network interface 1070. These components are connected by a bus 1080.
[0110] The memory 1010 includes a ROM (Read Only Memory) 1011 and a RAM (Random Access Memory) 1012. The ROM 1011 stores a boot program such as a BIOS (Basic Input Output System). The hard disk drive interface 1030 is connected to a hard disk drive 1090. The disk drive interface 1040 is connected to a disk drive 1100. A removable storage medium such as a magnetic disk or optical disk is inserted into the disk drive 1100. The serial port interface 1050 is connected to a mouse 1110 and a keyboard 1120, for example. The video adapter 1060 is connected to a display 1130, for example.
[0111] The hard disk drive 1090 stores, for example, an OS 1091, an application program 1092, a program module 1093, and program data 1094. That is, a program that defines each process of the information processing device 10 is implemented as a program module 1093 in which computer-executable code is written. The program module 1093 is stored, for example, in the hard disk drive 1090. For example, a program module 1093 for executing the same process as the functional configuration of the information processing device 10 is stored in the hard disk drive 1090. Note that the hard disk drive 1090 may be replaced by an SSD (Solid State Drive).
[0112] Furthermore, setting data used in the processing of the above-described embodiment is stored as program data 1094, for example, in the memory 1010 or the hard disk drive 1090. Then, the CPU 1020 reads the program module 1093 or the program data 1094 stored in the memory 1010 or the hard disk drive 1090 into the RAM 1012 as necessary, and executes the processing of the above-described embodiment.
[0113] The program module 1093 and program data 1094 are not limited to being stored in the hard disk drive 1090, but may also be stored in, for example, a removable storage medium and read by the CPU 1020 via the disk drive 1100 or the like. Alternatively, the program module 1093 and program data 1094 may be stored in another computer connected via a network (such as a local area network (LAN) or a wide area network (WAN)). The program module 1093 and program data 1094 may then be read by the CPU 1020 from the other computer via the network interface 1070. [Explanation of symbols]
[0114] 1. Information Processing Systems 2 Front 3a, 3b guest rooms 4 Facilities within the building 10. Information processing equipment 21 terminals 31, 31a, 31b Cabin control device 32, 32a, 32b Voice assistant devices 33, 33a, 33b equipment group 34, 34a, 34b Sensor group 41 Elevator System 42 Laundry System 11 Communications Department 12 Control Unit 13 Storage section 121 Reception 122 Analysis Department 123 Generation part 124 Update Department 125 Output control section 131 Model Information 132 Guest room table 133 Assistant Table 134 Guest Table 135 Device Table 136 Facility Table 137 Task Table N Network
Claims
1. an analysis unit that analyzes the voice collected by the voice input device; an output control unit that outputs information about the voice order to an object associated with the task ordered by voice based on the analysis result by the analysis unit; An information processing device comprising:
2. The output control unit determines whether the task ordered by voice is serving food, cleaning, replenishing supplies, purchasing goods, or transporting luggage, and outputs information about the order by voice to a terminal of a person in charge associated with the determined task.
2. The information processing apparatus according to claim 1, wherein:
3. The output control unit outputs a message in response to the voice, the message being generated in a language associated with the voice input device, to a voice output device installed in the guest room.
2. The information processing apparatus according to claim 1, wherein:
4. The output control unit outputs, to the terminal, a message indicating information about the voice order, which is generated in a language associated with a terminal of a person in charge associated with the task, based on the analysis result by the analysis unit.
2. The information processing apparatus according to claim 1, wherein:
5. An information processing method executed by an information processing device, an analysis step of analyzing the voice collected by the voice input device; an output control step of outputting information about the voice order to an object associated with the task ordered by voice based on the analysis result of the analysis step; An information processing method comprising:
6. an analyzing step of analyzing the voice collected by the voice input device; an output control step of outputting information about the voice order to an object associated with the task ordered by voice based on the analysis result of the analysis step; An information processing program characterized by causing a computer to execute the above.
7. An information processing system having a voice assistant device and an information processing device connected to the voice assistant device via a network, The voice assistant device a voice input unit that accepts voice input; an audio output unit that outputs audio; and The information processing device includes: an analysis unit that analyzes the voice input to the voice input unit; an output control unit that outputs information about the voice order to an object associated with the task ordered by voice based on the analysis result by the analysis unit; An information processing system comprising:
Citation Information
Patent Citations
Image display device, and evacuation information presentation system
JP2019125087A
Program, method for processing information, and image processor
JP2020205053A
Communication system
JP2022033526A
Information display device and information display system
WO2018146846A1
Air-conditioning system
WO2019239507A1