Information processing method, program, information processing system, and information processing terminal

Abstract

In this information processing method, at least one piece of information is acquired, among first information indicating at least one item selected from among a plurality of items related to the operation of a laundry machine displayed on a display unit, and second information indicating text including an input character string related to the operation of the laundry machine (S11, S12, S13). In the information processing method, the operation details of the laundry machine are determined on the basis of the acquired at least one piece of information among the first information and the second information (S14).

Description

Information processing method, program, information processing system, and information processing terminal

[0001] The present disclosure relates to an information processing method for determining operation details of a washing machine.

[0002] Patent Document 1 discloses a washing machine that suggests a washing course by referring to information such as the type of laundry and the degree of dirt input using artificial intelligence through voice recognition.

[0003] US Patent Application Publication No. 2020 / 0020336

[0004] The present disclosure provides an information processing method and the like that makes it easy to determine the operation details of a washing machine while reducing the number of processing steps.

[0005] In an information processing method according to one aspect of the present disclosure, at least one of first information indicating one or more selected items among a plurality of items related to the operation of a washing machine displayed on a display unit and second information indicating text displayed on the display unit and including an input character string related to the operation of the washing machine is acquired. In the information processing method, operation details of the washing machine are determined based on at least one of the acquired first information and second information.

[0006] A program according to one aspect of the present disclosure causes one or more processors to execute the information processing method.

[0007] An information processing system according to one aspect of the present disclosure includes an acquisition unit and a determination unit. The acquisition unit acquires at least one of first information indicating one or more selected items among a plurality of items related to the operation of a washing machine displayed on a display unit, and second information indicating text displayed on the display unit and including an input character string related to the operation of the washing machine. The determination unit determines operation details of the washing machine based on at least one of the acquired first information and the acquired second information.

[0008] According to one aspect of the present disclosure, an information processing terminal includes a display unit, a control unit, and a communication unit. The control unit displays at least one of a first area prompting a user to select one or more items from a plurality of items related to the operation of a washing machine and a second area prompting a user to input text including a character string related to the operation of the washing machine. The communication unit transmits at least one of first information indicating the selected one or more items and second information indicating the input text to an information processing system that determines operation details of the washing machine based on the at least one piece of information.

[0009] The information processing method and the like according to the present disclosure has the advantage that it is easy to determine the operation details of the washing machine while reducing the number of processing steps.

[0010] FIG. 1 is a block diagram showing an overall configuration including an information processing system according to Embodiment 1. FIG. 2 is a diagram showing an example of an initial screen displayed on a display unit of an information processing terminal according to Embodiment 1. FIG. 3 is a diagram showing an example of a decision screen displayed on a display unit of an information processing terminal according to Embodiment 1. FIG. 4 is a diagram showing an example of a decision screen displayed on a display unit of an information processing terminal according to Embodiment 1. FIG. 5 is a diagram showing an example of an execution screen displayed on a display unit of an information processing terminal according to Embodiment 1. FIG. 6 is a diagram showing an example of an edit screen displayed on a display unit of an information processing terminal according to Embodiment 1. FIG. 7 is a flowchart showing an example of an operation of the information processing system according to Embodiment 1. FIG. 8 is a flowchart showing an example of an operation of the information processing terminal according to Embodiment 1. FIG. 9 is a block diagram showing an overall configuration including an information processing system according to Embodiment 2. FIG. 10 is a diagram showing an example of a screen displayed on a display unit of a washing machine according to Embodiment 2. FIG. 11 is a diagram showing another example of a decision screen displayed on a display unit.

[0011] (Findings that Form the Basis of the Present Disclosure) First, the inventor's point of view will be explained below.

[0012] When a user sets the operation mode of a washing machine to wash clothes, the user can select the desired operation mode from a wide range of available operation modes. However, it is difficult for busy users to set the operation mode that is suitable for them.

[0013] In recent years, therefore, technologies have been developed that suggest washing machine operation options suitable for users. For example, Patent Literature 1 discloses a technology that recognizes a user's voice using voice recognition and suggests washing machine operation options by referring to the recognized information such as the type of laundry and the degree of soiling.

[0014] However, with the above technology, there are cases where the information contained in the user's voice recognized by voice recognition is insufficient to determine the operation mode of the washing machine, or where voice recognition fails. In such cases, it is necessary to prompt the user to input voice again or to inquire about the necessary information from the user, which tends to increase the processing time required to determine the operation mode of the washing machine.

[0015] Furthermore, the above technology cannot be implemented in washing machines that do not have a microphone or speaker by simply updating the software. To implement the above technology in such a washing machine, a microphone and speaker must be newly installed, resulting in additional component costs.

[0016] In view of the above, the inventors have come up with the present disclosure.

[0017] Hereinafter, each embodiment will be described in detail with reference to the accompanying drawings as appropriate. However, more detailed explanation than necessary may be omitted. For example, detailed explanation of well-known matters or redundant explanation of substantially identical configurations may be omitted. This is to avoid unnecessary redundancy in the following explanation and to facilitate understanding by those skilled in the art.

[0018] The inventors have provided the accompanying drawings and the following description to enable those skilled in the art to fully understand the present disclosure, and do not intend for them to limit the subject matter described in the claims.

[0019] (Embodiment 1) [1-1. Overall Configuration] First, an overall configuration including an information processing system 1 according to embodiment 1 will be described with reference to FIG. 1. FIG. 1 is a block diagram showing the overall configuration including the information processing system 1 according to embodiment 1. In embodiment 1, information processing system 1 is used to determine operation details of washing machine 2 that are suitable for a user. A user is a person who uses washing machine 2, that is, a person who washes clothes using washing machine 2. There may be one user or multiple users. The operation of washing machine 2 includes at least a washing operation for washing clothes, and may also include a drying operation for drying clothes or a maintenance operation such as cleaning the washing tub of washing machine 2.

[0020] The washing machine 2 includes a functional unit 21 and a communication unit 22. In the first embodiment, the washing machine 2 is a drum-type washing machine, for example. Of course, the washing machine 2 is not limited to a drum-type washing machine, and may be, for example, a vertical washing machine or the like.

[0021] The functional unit 21 executes various functions of the washing machine 2. In the first embodiment, the functional unit 21 has a washing function for executing a washing operation to wash the clothes contained in the washing tub, and a drying function for executing a drying operation to dry the clothes contained in the washing tub and washed. The washing operation washes the clothes by, for example, rotating the washing tub and performing washing, rinsing, and / or spin-drying on the clothes contained in the washing tub. The drying operation dries the clothes contained in the washing tub and washed by, for example, supplying dry air dehumidified by a heat pump.

[0022] Functional unit 21 executes a function according to a user input received by, for example, a user interface installed in washing machine 2. Furthermore, functional unit 21 executes a function according to a user input received by information processing terminal 3, for example, by communicating with information processing terminal 3 owned by the user via communication unit 22.

[0023] The communication unit 22 communicates with the communication unit 10 of the information processing system 1 via an external network NT1 such as the Internet. The communication between the communication unit 22 and the communication unit 10 of the information processing system 1 may be wired communication as well as wireless communication. Furthermore, the standard of communication between the communication unit 22 and the information processing system 1 is not particularly limited. Furthermore, the communication unit 22 also communicates with the information processing terminal 3 as described above.

[0024] As described above, the information processing terminal 3 is a terminal owned by a user, and may include, for example, a smartphone, a tablet terminal, or a desktop or laptop personal computer. In the first embodiment, the information processing terminal 3 is a smartphone. The information processing terminal 3 includes a communication unit 31, a display unit 32, an input receiving unit 33, and a control unit 34.

[0025] Communication unit 31 has a function of communicating with communication unit 22 of washing machine 2 and a function of communicating with communication unit 10 of information processing system 1. Communication between communication unit 31 and communication unit 22 of washing machine 2 is wireless communication in accordance with a standard such as Wi-Fi (registered trademark) or BLE (Bluetooth (registered trademark) Low Energy). The standard of communication between communication unit 31 and communication unit 22 of washing machine 2 is not particularly limited. Communication between communication unit 31 and communication unit 10 of information processing system 1 may be wired communication in addition to wireless communication via external network NT1. The standard of communication between communication unit 31 and communication unit 10 of information processing system 1 is not particularly limited.

[0026] The display unit 32 is, for example, a liquid crystal display, and displays various information. In the first embodiment, the display unit 32 displays an initial screen P0 (see FIG. 2), a decision screen P1 (see FIGS. 3 and 4), an execution screen P2 (see FIG. 5), an edit screen P3 (see FIG. 6), or the like. The initial screen P0 is a screen for selecting whether or not to start a process for determining the operation details of the washing machine 2. The initial screen P0 is a screen for displaying a list of operation details of the washing machine 2 that have already been determined. The decision screen P1 is a screen for determining operation details of the washing machine 2 that are suitable for the user by inquiring of the user about the operation details of the washing machine 2. The execution screen P2 is a screen for selecting whether or not to operate the washing machine 2 according to the determined operation details of the washing machine 2. The edit screen P3 is a screen for changing at least a part of the operation details of the washing machine 2 that have already been determined. Details of the initial screen P0, the decision screen P1, the execution screen P2, and the edit screen P3 will be described later.

[0027] The input receiving unit 33 receives inputs from a user. In the first embodiment, the display unit 32 is configured as a touch panel display. Therefore, in the first embodiment, the display unit 32 also serves as the input receiving unit 33.

[0028] Control unit 34 controls display unit 32. In the first embodiment, when an application dedicated to washing machine 2 installed in information processing terminal 3 is executed, control unit 34 first causes display unit 32 to display initial screen P0. Then, control unit 34 causes display unit 32 to display decision screen P1, execution screen P2, or edit screen P3 in accordance with an input by a user operation accepted by input accepting unit 33.

[0029] Note that instead of the above-mentioned applications, the control unit 34 may execute, for example, an instant messenger application installed in the information processing terminal 3, thereby causing the display unit 32 to display the initial screen P0, the decision screen P1, the execution screen P2, or the edit screen P3. The instant messenger may include, for example, LINE (registered trademark), WhatsApp (registered trademark), WeChat (registered trademark), Messenger (registered trademark), or Snapchat (registered trademark). Of course, the instant messenger is not limited to the above examples.

[0030] [1-2. Information Processing System] Next, details of the information processing system 1 will be described. In the first embodiment, the information processing system 1 is configured by a server installed in a remote location away from the facility where the washing machine 2 is installed (here, the residence where the user lives), for example. In the first embodiment, the information processing system 1 is described as targeting one washing machine 2, but the information processing system 1 may target multiple washing machines 2. As shown in FIG. 1 , the information processing system 1 includes a communication unit 10, a processing unit 11, and a storage unit 12.

[0031] As already described, communication unit 10 has a function of communicating with communication unit 22 of washing machine 2 via external network NT1. Also, communication unit 10 has a function of communicating with communication unit 31 of information processing terminal 3 via external network NT1.

[0032] The processing unit 11 includes a processor and a memory, and is configured to perform various functions by the processor executing programs stored in the memory. The processing unit 11 has the functions of executing an acquisition unit 111, a determination unit 112, and a presentation unit 113. In other words, the information processing system 1 includes the acquisition unit 111, the determination unit 112, and the presentation unit 113.

[0033] Acquisition unit 111 acquires at least one of first information and second information. The first information is information indicating one or more items selected by the user by operating information processing terminal 3 from among a plurality of items related to the operation of washing machine 2 displayed on display unit 32 (here, display unit 32 of information processing terminal 3). In the first embodiment, the plurality of items include a first item related to the type of operation of washing machine 2, a second item related to the handling of clothes to be washed, a third item related to the state of soiling of the selected clothes, and a fourth item related to the user's request for the operation of washing machine 2. Of course, the plurality of items may include items other than the first to fourth items listed above.

[0034] The second information is information indicating text T1 (see FIG. 4 ) that is displayed on display unit 32 and includes a character string related to the operation of washing machine 2 that is input by the user operating information processing terminal 3. For example, if text T1 is "I want to wash gently," the character string "wash gently" corresponds to a character string related to the operation of washing machine 2. The character string represents, for example, a user's request regarding the operation of washing machine 2 that is not included in the multiple items.

[0035] In the first embodiment, acquisition unit 111 acquires, via communication unit 10, first information that is input to information processing terminal 3 and transmitted from information processing terminal 3. Also, in the first embodiment, when a predetermined item different from the plurality of items is selected at information processing terminal 3, acquisition unit 111 acquires, via communication unit 10, second information that is input to information processing terminal 3 and transmitted from information processing terminal 3. That is, in the first embodiment, acquisition unit 111 acquires at least the first information, and further acquires the second information when a condition that a predetermined item is selected is satisfied. The predetermined item is selected, for example, when a user's request regarding the operation of washing machine 2, which is not included in the plurality of items, is to be reflected in the operation content of washing machine 2.

[0036] Determination unit 112 determines the operation details of washing machine 2 based on at least one of the first information and the second information acquired by acquisition unit 111. In the first embodiment, determination unit 112 determines the operation details of washing machine 2 based on at least the first information acquired by acquisition unit 111, and when acquisition unit 111 has acquired the second information, determination unit 112 determines the operation details of washing machine 2 based on both the first information and the second information. When acquisition unit 111 has acquired the second information, determination unit 112 extracts character strings related to the operation of washing machine 2 included in text T1 by, for example, performing an appropriate language analysis process on text T1 included in the second information.

[0037] In the first embodiment, determination unit 112 reads out the associated data stored in storage unit 12 and compares at least one of the first information and the second information acquired by acquisition unit 111 with the associated data to determine operation details of washing machine 2 that are suitable for the user. When the second information is not referenced, the associated data is data that associates one or more items indicated by the first information with operation details of washing machine 2. When the second information is referenced, the associated data is data that associates one or more items indicated by the first information and character strings related to operation of washing machine 2 indicated by the second information with operation details of washing machine 2.

[0038] Presentation unit 113 displays the operation details of washing machine 2 determined by determination unit 112 on display unit 32 (here, display unit 32 of information processing terminal 3), thereby presenting the operation details of washing machine 2 to the user. Specifically, presentation unit 113 transmits a signal including information indicating the operation details of washing machine 2 determined by determination unit 112 to information processing terminal 3 via communication unit 10. When communication unit 31 receives the signal, information processing terminal 3 displays the information included in the signal on display unit 32. In this way, the operation details of washing machine 2 determined by determination unit 112 are presented to the user.

[0039] In the first embodiment, presentation unit 113 displays, on display unit 32, an explanation of the operation content of washing machine 2 and the reason for determining the operation content of washing machine 2, in addition to the operation content of washing machine 2 determined by determination unit 112. Furthermore, in the first embodiment, presentation unit 113 displays, on display unit 32, a link (hyperlink) for transitioning to execution screen P2.

[0040] Storage unit 12 is a storage device that stores information (such as computer programs) required for each unit of processing unit 11 to execute various functions. Storage unit 12 is realized by, for example, a semiconductor memory, but is not particularly limited and any known electronic information storage means can be used. In the first embodiment, storage unit 12 stores, for example, related data referenced by determination unit 112. Furthermore, storage unit 12 stores, for example, the operation details of washing machine 2 determined by determination unit 112 for each user.

[0041] [1-3. Specific Examples] Specific examples of processing by the information processing system 1 will be described below with reference to various screens displayed on the display unit 32 of the information processing terminal 3.

[0042] 2 is a diagram showing an example of an initial screen P0 displayed on display unit 32 of information processing terminal 3 according to embodiment 1. As already described, initial screen P0 is displayed on display unit 32, for example, when an application dedicated to washing machine 2 is executed on information processing terminal 3. An icon I0 for starting a process of creating new operation details (programs) for washing machine 2 is displayed on initial screen P0. When the user selects icon I0, control unit 34 of information processing terminal 3 causes display unit 32 to display determination screen P1.

[0043] 3 is a diagram showing an example of a decision screen P1 displayed on the display unit 32 of the information processing terminal 3 according to the first embodiment. The decision screen P1 first displays a first area A1 that prompts the user to select one or more items from a plurality of items related to the operation of the washing machine 2. In other words, the control unit 34 of the information processing terminal 3 causes the display unit 32 to display the first area A1. Here, as shown in (a) of FIG. 3, an area A11 is displayed as the first area A1 on the decision screen P1. The area A11 displays a message M11 that prompts the user to select a first item related to the operation type of the washing machine 2, and a plurality of (here, two) icons I11 for specifying the operation type.

[0044] 3A, the user selects icon I11 including the character string "Wash-Dry" which specifies the washing operation and the drying operation as the operation types of washing machine 2. If the user wants to perform a maintenance operation on washing machine 2, such as cleaning the washing tub of washing machine 2, the user may select icon I11 including the character string "Maintenance."

[0045] 3B, when the selection of the first item is completed, an area A12 is further displayed as the first area A1 on the determination screen P1. Area A12 displays a message M12 prompting the user to select a second item regarding the care of the clothes to be washed, an area A121 for specifying the care label attached to the clothes, an area A122 for specifying the additional term attached to the clothes, and multiple (here, two) icons I12.

[0046] 3B, the user specifies the care label attached to the garment in area A121 and the additional term attached to the garment in area A122, and then selects icon I12 containing the string "Input Complete" indicating that input is complete. If the garment does not have a care label or additional term attached, the user may select icon I12 containing the string "No Care Label." Furthermore, if the information processing terminal 3 is equipped with a camera, the user may select the second item by capturing an image of a tag containing the care label and additional term attached to the garment with the camera and selecting the captured image.

[0047] After the selection of the second item is completed, an area A13 is further displayed as the first area A1 on the determination screen P1, as shown in Fig. 3(c) . Area A13 displays a message M13 prompting the user to select a third item relating to the soiling state of the laundry to be washed, and multiple (seven in this example) icons I13 for specifying the soiling state of the laundry.

[0048] In the example shown in FIG. 3C, the user selects the icon I13 including the character string "sebum stains" which specifies that the clothes have sebum stains.

[0049] 4 is a diagram showing an example of a decision screen P1 displayed on display unit 32 of information processing terminal 3 according to embodiment 1. When the selection of the third item is completed, area A14 is further displayed as first area A1 on decision screen P1, as shown in (a) of FIG. 4. Area A14 displays a message M14 prompting the user to select a fourth item related to the user's request for operation of washing machine 2, and a plurality of (here, nine) icons I14 for specifying the user's request.

[0050] 4A, the user selects icon I14 including the character string “Other.” Icon I14 is also icon I141 for specifying a predetermined item to be selected when the user wants to reflect a user's request regarding the operation of washing machine 2, which is not included in the plurality of items, in the operation of washing machine 2.

[0051] When a predetermined item is selected in the fourth item, as shown in (b) of Fig. 4, the determination screen P1 further displays a second area A2 prompting the user to input text T1 including a character string related to the operation of the washing machine 2. In other words, the control unit 34 of the information processing terminal 3 causes the second area A2 to be displayed on the display unit 32. The second area A2 displays a message M2 prompting the user to input a request for the operation of the washing machine 2.

[0052] In the example shown in Fig. 4(b), the user has input text T1 including the character string "I want to wash gently." If an item other than the predetermined item is selected in the fourth item, the second area A2 is not displayed on the decision screen P1.

[0053] When a predetermined item is selected in the fourth item and text T1 is input, communication unit 31 of information processing terminal 3 transmits first information indicating the selected one or more items and second information indicating the input text T1 to information processing system 1. When an item other than the predetermined item is selected in the fourth item, communication unit 31 of information processing terminal 3 transmits only the first information to information processing system 1. Then, as shown in (c) of FIG. 4 , decision screen P1 further displays message M3 indicating that processing to determine the operation details of washing machine 2 is in progress until a signal including information indicating the determined operation details of washing machine 2 is received from information processing system 1.

[0054] Acquisition unit 111 of information processing system 1 acquires first information transmitted from information processing terminal 3 via communication unit 10. Furthermore, when a predetermined item is selected on information processing terminal 3, acquisition unit 111 acquires second information transmitted from information processing terminal 3 via communication unit 10. Then, determination unit 112 of information processing system 1 determines the operation content of washing machine 2 based on the first information (or both the first information and the second information) acquired by acquisition unit 111. Thereafter, presentation unit 113 transmits a signal including information indicating the operation content of washing machine 2 determined by determination unit 112 to information processing terminal 3 via communication unit 10. Furthermore, determination unit 112 stores the determined operation content of washing machine 2 in memory unit 12, linking it to the user of information processing terminal 3.

[0055] When communication unit 31 of information processing terminal 3 receives the signal, as shown in Fig. 4(c), determination screen P1 further displays processing result R1, i.e., the determined operation details of washing machine 2 (here, "home cleaning course"). In the example shown in Fig. 4(c), processing result R1 displays, in addition to the determined operation details of washing machine 2, an explanation of the operation details of washing machine 2, the reason why the operation details of washing machine 2 were determined, and a link (hyperlink) for transitioning to execution screen P2.

[0056] When the link is selected, an execution screen P2 as shown in (a) of FIG. 5 is displayed on the display unit 32. FIG. 5 is a diagram showing an example of the execution screen P2 displayed on the display unit 32 of the information processing terminal 3 according to the first embodiment. As shown in (a) of FIG. 5, the execution screen P2 is a screen in which an area A3 is further displayed on the initial screen P0. An icon I2 including a character string indicating the determined operation content (course) of the washing machine 2 is displayed in the area A3. The icon I2 includes an icon I21 for transitioning to the editing screen P3. Note that in the example shown in (a) of FIG. 5, only one determined operation content of the washing machine 2 is displayed in the area A3, but multiple operation contents may be displayed.

[0057] In the example shown in Fig. 5(a), the user selects a portion of icon I2 other than icon I21. As a result, area A4 is displayed on execution screen P2 as shown in Fig. 5(b). Area A4 displays message M4 asking whether the user wants to operate washing machine 2 with the operation content of washing machine 2 selected by the user, and multiple (here, two) icons I3 for specifying an answer to the question.

[0058] 5(b), the user selects icon I3 including the character string "OK." As a result, communication unit 31 of information processing terminal 3 transmits, to information processing system 1, an instruction signal instructing the execution of operation of washing machine 2 according to the operation content selected by the user.

[0059] When communication unit 10 receives the instruction signal, processing unit 11 of information processing system 1 transmits a control signal to washing machine 2 via communication unit 10, instructing washing machine 2 to operate according to the operation content selected by the user. In other words, when processing unit 11 receives an execution input to execute the operation content of washing machine 2 displayed on display unit 32 (here, display unit 32 of information processing terminal 3), processing unit 11 transmits a control signal to washing machine 2 instructing washing machine 2 to operate according to the operation content.

[0060] When communication unit 22 receives the control signal, washing machine 2 starts operation according to the operation content instructed by the control signal. This allows the user to operate washing machine 2 according to the selected operation content of washing machine 2 by remotely controlling washing machine 2 using information processing terminal 3. Note that if the user selects icon I3 containing the character string "Cancel" on execution screen P2, information processing terminal 3 does not transmit an instruction signal to information processing system 1.

[0061] Fig. 6 is a diagram showing an example of edit screen P3 displayed on display unit 32 of information processing terminal 3 according to embodiment 1. As shown in (a) of Fig. 6, when a user selects icon I21 on execution screen P2, edit screen P3 as shown in (b) of Fig. 6 is displayed on display unit 32. Edit screen P3 displays area A5 for editing the operation details of washing machine 2 to be edited, and multiple (here, two) icons I4 for specifying whether or not to register the edited operation details of washing machine 2.

[0062] When the user selects icon I4 including the character string "Register" after changing at least a part of the operation details of washing machine 2 in area A5, communication unit 31 of information processing terminal 3 transmits a signal including information indicating the operation details of washing machine 2 edited by the user to information processing system 1. When communication unit 10 receives the signal, processing unit 11 of information processing system 1 overwrites the operation details of washing machine 2 included in the signal onto the existing operation details of washing machine 2 stored in memory unit 12 and stores the updated operation details. In other words, when processing unit 11 receives a change input to change at least a part of the operation details of washing machine 2 displayed on display unit 32 (here, display unit 32 of information processing terminal 3), processing unit 11 changes the operation details of washing machine 2 in accordance with the change input.

[0063] [2. Operation] An example of operation of the information processing system 1 according to the first embodiment and an example of operation of the information processing terminal 3 will be described below.

[0064] First, an example of the operation of the information processing system 1 according to the first embodiment will be described with reference to Fig. 7. Fig. 7 is a flowchart showing an example of the operation of the information processing system 1 according to the first embodiment.

[0065] First, the acquisition unit 111 acquires the first information transmitted from the information processing terminal 3 via the communication unit 10 (S11). Here, if the user has selected a predetermined item on the information processing terminal 3 (S12: Yes), the acquisition unit 111 acquires the second information transmitted from the information processing terminal 3 via the communication unit 10 (S13). On the other hand, if the user has not selected a predetermined item on the information processing terminal 3 (S12: No), the acquisition unit 111 acquires only the first information.

[0066] Next, determination unit 112 determines the operation details of washing machine 2 based on the first information (or both the first information and the second information) acquired by acquisition unit 111 (S14). Then, presentation unit 113 displays the operation details of washing machine 2 determined by determination unit 112 on display unit 32 (here, display unit 32 of information processing terminal 3), thereby presenting the operation details of washing machine 2 to the user (S15).

[0067] Thereafter, when communication unit 10 receives an instruction signal transmitted from information processing terminal 3, i.e., when an execution input is made at information processing terminal 3 (S16: Yes), processing unit 11 transmits a control signal to washing machine 2 via communication unit 10 to instruct washing machine 2 to operate according to the operation content selected by the user (S17). On the other hand, when an execution input is not made at information processing terminal 3 (S16: No), the processing of information processing system 1 ends.

[0068] Next, an example of the operation of the information processing terminal 3 according to the first embodiment will be described with reference to Fig. 8. Fig. 8 is a flowchart showing an example of the operation of the information processing terminal 3 according to the first embodiment.

[0069] First, when the process of creating operation details for a new washing machine 2 is started, the control unit 34 causes the display unit 32 to display a decision screen P1 including the first area A1, in other words, the first area A1 (S21). Then, the input accepting unit 33 accepts input of the first information by accepting an input by a user operation (S22). In the first embodiment, the input accepting unit 33 accepts input of the first to fourth items as the first information.

[0070] If the user has selected a predetermined item (S23: Yes), the control unit 34 further displays the second area A2 on the decision screen P1 (S24). The input accepting unit 33 then accepts input by the user's operation, thereby accepting input of the second information (S25). On the other hand, if the user has not selected a predetermined item (S23: No), the control unit 34 does not display the second area A2 on the decision screen P1. In this case, the input accepting unit 33 does not accept input of the second information.

[0071] If the user has selected a predetermined item (S23: Yes), the communication unit 31 transmits the first information and the second information to the information processing system 1 (S26). On the other hand, if the user has not selected a predetermined item (S23: No), the communication unit 31 transmits only the first information to the information processing system 1 (S27).

[0072] Thereafter, when the communication unit 31 receives a signal including the determined operation details of the washing machine 2 sent from the information processing system 1, the control unit 34 displays the processing result R1 on the determination screen P1, thereby displaying the determined operation details of the washing machine 2 on the display unit 32 (S28).

[0073] [3. Advantages] The following describes advantages of information processing system 1 according to embodiment 1. As already mentioned, the technology of recognizing a voice uttered by a user by voice recognition and suggesting washing machine operation details by referring to the recognized information such as the type of laundry and the degree of soiling has the problem that it is necessary to prompt the user to input voice again or to inquire of the user about necessary information, which tends to increase the processing time required to determine washing machine operation details.

[0074] In contrast, in information processing system 1 according to embodiment 1, the operation details of washing machine 2 are determined based on at least one of first information indicating one or more items selected by the user from a plurality of items displayed on display unit 32 (here, display unit 32 of information processing terminal 3), and second information indicating text T1 input by the user and displayed on display unit 32. Therefore, in information processing system 1 according to embodiment 1, the user can determine the operation details of washing machine 2 simply by selecting one or more desired items from the plurality of displayed items or inputting desired operation details as text T1. Therefore, information processing system 1 according to embodiment 1 has the advantage of being able to easily determine the operation details of washing machine 2 while reducing processing man-hours, without having to prompt the user to input information again or query the user for necessary information.

[0075] Furthermore, the above technology has a problem in that it cannot be realized by simply updating the software in a washing machine 2 that does not have a microphone or a speaker. In contrast, the information processing system 1 according to the first embodiment can be realized by simply updating the software even in a washing machine 2 that does not have a microphone or a speaker, and has the advantage of not incurring additional component costs.

[0076] (Embodiment 2) Hereinafter, an overall configuration including information processing system 1 according to embodiment 2 will be described with reference to FIG. 9. FIG. 9 is a block diagram showing an overall configuration including information processing system 1 according to embodiment 2. Embodiment 2 differs from embodiment 1 in that washing machine 2A has the functions of information processing terminal 3 according to embodiment 1. Specifically, washing machine 2A includes function unit 21, communication unit 22, display unit 32, input acceptance unit 33, and control unit 34. Communication unit 22 has the same functions as communication unit 31 of information processing terminal 3. Below, descriptions of points common to embodiment 1 will be omitted as appropriate.

[0077] In the second embodiment, the initial screen P0, the decision screen P1, the execution screen P2, and the edit screen P3 in the first embodiment are displayed on the display unit 32 of the washing machine 2A as shown in Fig. 10. Fig. 10 is an example of a screen displayed on the display unit 32 of the washing machine 2A according to the second embodiment. In the example shown in Fig. 10, the decision screen P1 including the first area A1 is displayed on the display unit 32 of the washing machine 2A.

[0078] In the second embodiment, the user can input at least one of the first information and the second information by operating washing machine 2A instead of operating information processing terminal 3. In the second embodiment, communication unit 22 (communication unit 31) of washing machine 2A, instead of information processing terminal 3, transmits only the first information or both the first information and the second information to information processing system 1.

[0079] As described above, in the second embodiment, washing machine 2A has the function of information processing terminal 3, and therefore information processing terminal 3 is not necessary.

[0080] [4. Modifications] As described above, the embodiments have been described as examples of the technology disclosed in this application. However, the technology in this disclosure is not limited to these, and can be applied to the embodiments in which modifications, substitutions, additions, omissions, etc. are made as appropriate. Furthermore, it is also possible to combine the components described in the above embodiments to create new embodiments.

[0081] Therefore, modifications of each embodiment will be exemplified below.

[0082] 11 , the control unit 34 of the information processing terminal 3 may display the decision screen P1 including the second area A2 on the display unit 32, and then display the first area A1 on the display unit 32. In other words, the information processing terminal 3 may prompt the user to input the second information and then prompt the user to input the first information.

[0083] Fig. 11 is a diagram showing another example of the decision screen P1 displayed on the display unit 32. In the example shown in Fig. 11(a), the decision screen P1 first displays the second area A2. In the example shown in Fig. 11(a), the user has input text T1 including the character string "I want to wash gently."

[0084] When the text T1 is input, a first area A1 is further displayed on the determination screen P1 as shown in Fig. 11(b). In the example shown in Fig. 11(b), an area A12 for prompting the user to select a second item is displayed as the first area A1. Note that the reason why an area A11 for prompting the user to select a first item is not displayed as the first area A1 is because the text T1 includes a character string suggesting that the washing machine 2 is running a wash cycle.

[0085] Thereafter, when the user has completed inputting the first information, the determination screen P1 further displays the processing result R1, as shown in (c) of Fig. 11, in the same manner as in Embodiment 1. Note that the process of selecting the third and fourth items will not be described here.

[0086] Furthermore, for example, in each of the above embodiments, processing unit 11 of information processing system 1 may transmit a control signal to washing machine 2, 2A without presenting the determined operation details of washing machine 2, 2A to the user. In other words, processing unit 11 may start operation of washing machine 2, 2A without inquiring of the user as to whether or not to operate washing machine 2, 2A according to the determined operation details.

[0087] Furthermore, for example, in each of the above embodiments, determination unit 112 of information processing system 1 may be realized by a trained model that is machine-learned to input at least one of the first information and the second information and output operation details of washing machine 2, 2A that are suitable for the user. In this case, the trained model may be a general-purpose model or a dedicated model that is machine-learned for each user. Furthermore, if feedback data, such as whether the user adopted the determined operation details of washing machine 2, 2A, can be obtained, the trained model may be retrained using the feedback data.

[0088] In addition, for example, in each of the above embodiments, the information processing system 1 is targeted at the washing machine 2, 2A with a drying function, but is not limited to this. For example, the information processing system 1 may be targeted at a washing machine without a drying function.

[0089] Furthermore, for example, in each of the above embodiments, the information processing system 1 is realized by a server, but this is not limited to this. For example, the information processing system 1 may be realized by an information processing terminal 3. In this case, a server is not required.

[0090] Furthermore, for example, in each of the above embodiments, the information processing system 1 is realized as a single device, but it may be realized by multiple devices. When the information processing system 1 is realized by multiple devices, the components of the information processing system 1 may be distributed among the multiple devices in any manner. In other words, the present disclosure may be realized by cloud computing or edge computing.

[0091] Furthermore, for example, in each of the above embodiments, all or some of the components of the information processing system 1 of the present disclosure may be configured with dedicated hardware, or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU (Central Processing Unit) or a processor reading and executing a software program recorded on a recording medium such as an HDD (Hard Disk Drive) or semiconductor memory.

[0092] Furthermore, the components of the information processing system 1 according to the present disclosure may be configured with one or more electronic circuits. Each of the one or more electronic circuits may be a general-purpose circuit or a dedicated circuit.

[0093] The one or more electronic circuits may include, for example, a semiconductor device, an integrated circuit (IC), or a large-scale integration (LSI). The IC or LSI may be integrated on a single chip or on multiple chips. Although the IC or LSI is referred to here as an IC or LSI, the name may vary depending on the degree of integration, and may be called a system LSI, a very large-scale integration (VLSI), or an ultra-large-scale integration (ULSI). A field programmable gate array (FPGA), which is programmed after the LSI is manufactured, can also be used for the same purpose.

[0094] Furthermore, the general or specific aspects of the present disclosure may be realized as a system, device, method, integrated circuit, or computer program. Alternatively, the computer program may be stored on a non-transitory computer-readable recording medium such as an optical disc, HDD, or semiconductor memory. For example, the present disclosure may be realized as a program for causing a computer to execute the information processing method of each of the above embodiments. Furthermore, the program may be recorded on a non-transitory computer-readable recording medium such as a CD-ROM, or may be distributed via a communication channel such as the Internet.

[0095] As described above, the embodiments have been described as examples of the technology in the present disclosure, and the accompanying drawings and detailed descriptions have been provided for that purpose.

[0096] Therefore, the components shown in the accompanying drawings and detailed description may include not only essential components for solving the problem, but also components that are not essential for solving the problem in order to illustrate the above technology. Therefore, the fact that these non-essential components are shown in the accompanying drawings or detailed description should not be interpreted as immediately indicating that these non-essential components are essential.

[0097] Furthermore, since the above-described embodiments are intended to illustrate the technology of the present disclosure, various modifications, substitutions, additions, omissions, etc. may be made within the scope of the claims or their equivalents.

[0098] (Summary) As described above, the information processing method according to the first aspect acquires at least one of first information indicating one or more selected items among a plurality of items related to the operation of washing machine 2, 2A displayed on display unit 32, and second information indicating text T1 displayed on display unit 32 and including an input character string related to the operation of washing machine 2, 2A (S11, S12, S13). In the information processing method, the operation content of washing machine 2, 2A is determined based on at least one of the acquired first information and second information (S14).

[0099] This has the advantage that it is not necessary to prompt the user to input again or to inquire about necessary information from the user, and it is easy to determine the operation details of the washing machines 2, 2A while reducing the number of processing steps.

[0100] In addition, for example, in the information processing method according to the second aspect, first information is acquired (S11) in the first aspect, and if a predetermined item different from the plurality of items is selected (S12: Yes), second information is further acquired (S13). In the information processing method, the operation details of the washing machine 2, 2A are determined based on both the acquired first information and second information (S14).

[0101] This has the advantage that a variety of information that cannot be covered by simply obtaining the first information can be obtained as the second information, making it easier to determine the operation details of the washing machine 2, 2A that are more suitable for the user.

[0102] Furthermore, for example, in the information processing method according to the third aspect, a control signal instructing the washing machine 2, 2A to operate in accordance with the operation content of the washing machine 2, 2A determined in the first or second aspect is transmitted to the washing machine 2, 2A.

[0103] This allows the user to start the operation of the washing machine 2, 2A without setting the operation details on the washing machine 2, 2A, which has the advantage of making it easier to avoid a situation where the washing machine 2, 2A starts operating with operation details that the user does not intend due to the user setting part of the operation details incorrectly.

[0104] Furthermore, for example, in the information processing method according to the fourth aspect, the determined operation details of the washing machines 2, 2A are displayed on the display unit 32 in any one of the first to third aspects.

[0105] This has the advantage that the user can understand the determined operation details of the washing machines 2 and 2A.

[0106] Also, for example, in the information processing method according to the fifth aspect, when a change input for changing at least a part of the operation contents of the washing machines 2 and 2A displayed on the display unit 32 is received in the fourth aspect, the operation contents of the washing machines 2 and 2A are changed in accordance with the change input.

[0107] This allows at least a part of the operation of the washing machines 2 and 2A to be changed according to the user's wishes, which has the advantage of making it easier to determine the operation of the washing machines 2 and 2A that is more suitable for the user.

[0108] Also, for example, in the information processing method according to the sixth aspect, when an execution input for executing the operation content of the washing machine 2, 2A displayed on the display unit 32 is received in the fourth or fifth aspect, a control signal instructing the washing machine 2, 2A to operate according to the operation content is transmitted to the washing machine 2, 2A.

[0109] This has the advantage that the user can confirm the determined operation details of the washing machines 2 and 2A before transmitting a control signal to the washing machines 2 and 2A, making it easier to avoid situations where the washing machines 2 and 2A start operating with operation details that the user does not intend.

[0110] Furthermore, for example, a program according to a seventh aspect causes one or more processors to execute the information processing method according to any one of the first to sixth aspects.

[0111] This has the advantage that it is not necessary to prompt the user to input again or to inquire about necessary information from the user, and it is easy to determine the operation details of the washing machines 2, 2A while reducing the number of processing steps.

[0112] Furthermore, for example, information processing system 1 according to the eighth aspect includes acquiring unit 111 and determining unit 112. Acquiring unit 111 acquires at least one piece of information from among first information indicating one or more selected items from among a plurality of items related to the operation of washing machine 2, 2A displayed on display unit 32, and second information indicating text T1 displayed on display unit 32 and including an input character string related to the operation of washing machine 2, 2A. Determining unit 112 determines the operation content of washing machine 2, 2A based on at least one piece of information from among the acquired first information and second information.

[0113] This has the advantage that it is not necessary to prompt the user to input again or to inquire about necessary information from the user, and it is easy to determine the operation details of the washing machines 2, 2A while reducing the number of processing steps.

[0114] Furthermore, for example, information processing terminal 3 according to a ninth aspect includes display unit 32, control unit 34, and communication unit 31. Control unit 34 causes display unit 32 to display at least one of first area A1 prompting the user to select one or more items from a plurality of items related to the operation of washing machine 2 and second area A2 prompting the user to input text T1 including a character string related to the operation of washing machine 2. Communication unit 31 transmits at least one piece of information out of first information indicating the one or more selected items and second information indicating the input text T1 to information processing system 1, which determines the operation content of washing machine 2 based on the at least one piece of information.

[0115] This has the advantage that it is not necessary to prompt the user to input again or to inquire about necessary information from the user, and it is easy to determine the operation details of the washing machines 2, 2A while reducing the number of processing steps.

[0116] The present disclosure is applicable to a system that determines the operation details of a washing machine, etc.

[0117] REFERENCE SIGNS LIST 1 Information processing system 111 Acquisition unit 112 Decision unit 2, 2A Washing machine 3 Information processing terminal 31 Communication unit 32 Display unit 34 Control unit A1 First area A2 Second area T1 Text

Claims

1. An information processing method comprising: acquiring at least one piece of information from among first information indicating one or more selected items from among a plurality of items related to the operation of a washing machine displayed on a display unit; and second information indicating text displayed on the display unit and including an input string of characters related to the operation of the washing machine; and determining the operation content of the washing machine based on at least one piece of acquired first information and second information.

2. The information processing method of claim 1, further comprising: acquiring the first information; and, when a predetermined item different from the plurality of items is selected, further acquiring the second information; and determining the operation details of the washing machine based on both the acquired first information and the acquired second information.

3. The information processing method according to claim 1 or 2, further comprising transmitting a control signal to the washing machine instructing the washing machine to operate in accordance with the determined operation content.

4. The information processing method according to claim 1 or 2, wherein the determined operation details of the washing machine are displayed on the display unit.

5. The information processing method according to claim 4, wherein, when a change input for changing at least a part of the operation contents of the washing machine displayed on the display unit is received, the operation contents of the washing machine are changed in accordance with the change input.

6. The information processing method according to claim 4, wherein, when an execution input for executing the operation content of the washing machine displayed on the display unit is received, a control signal instructing the washing machine to operate with the operation content is sent to the washing machine.

7. A program that causes one or more processors to execute the information processing method according to claim 1 or 2.

8. An information processing system comprising: an acquisition unit that acquires at least one piece of information from among first information indicating one or more selected items from among a plurality of items related to the operation of a washing machine displayed on a display unit, and second information indicating text displayed on the display unit and including an input string related to the operation of the washing machine; and a determination unit that determines the operation content of the washing machine based on at least one piece of information from among the acquired first information and second information.

9. An information processing terminal comprising: a display unit; a control unit that causes the display unit to display at least one of a first area that prompts the user to select one or more items from a plurality of items related to the operation of the washing machine, and a second area that prompts the user to input text including a character string related to the operation of the washing machine; and a communication unit that transmits at least one of the first information indicating the one or more selected items and the second information indicating the input text to an information processing system that determines the operation details of the washing machine based on the at least one piece of information.

Images