Washing support system and washing support program

Abstract

To support washing so as to match actual conditions by grasping the dirt on a washing object more accurately and in detail, regarding a washing machine.SOLUTION: A washing support system has a washing machine for washing laundry which is a washing object, and a user terminal which is used by a user of the washing machine, and supports washing of a washing object. The washing support system includes: an imaging part 230 for directly imaging the washing object; a dirt determination part 32 for comparing image data of the imaged washing object with basic data stored beforehand, and for determining presence / absence of the washing object; a washing course determination part 33 for, in the case where there is dirt on the washing object, specifying the degree of dirt on the washing object, and for determining a washing course showing the content of washing based on the degree of dirt; and an output part for outputting the determined washing course.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a technique for determining dirt on objects to be washed in a washing machine, including clothes and a washing tub. [Background technology]

[0002] Washing machines are required to grasp the dirt on the objects to be washed, such as the laundry such as clothes and the washing machine body including the washing tub. For example, if the dirt on the laundry cannot be accurately grasped, the washing will be performed far from the actual dirt. Also, if the dirt on the washing machine body cannot be grasped, the laundry will become dirty and the washing machine will not perform to its full potential.

[0003] Patent Document 1 discloses a washing machine that is provided with an imaging device that captures an image of the inside of the washing tub, and is controlled with operation details that are specified using the results of image processing on the captured image. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 04-244193 Summary of the Invention [Problem to be solved by the invention]

[0005] Here, in Patent Document 1, "the degree of dirt on the laundry is determined based on the color and transparency of the water in the inner tub 2" of the washing machine (paragraph 0018). In other words, the dirt on the laundry, which is the clothes, is indirectly determined. In addition, the dirt on the outside of the washing tub of the washing machine cannot be determined. For this reason, Patent Document 1 may not be able to accurately determine the dirt on the object to be washed in the washing machine. For example, even if the laundry is not very dirty, if the washing tub is dirty, the water in the washing tub may become dirty. In this case, the washing may be unnecessarily strong or the washing time may be extended. In addition, the degree of dirt may differ between the inside and outside of the washing tub. In this case, if the outside is dirtier, the determination result of the inside is used, which means that the dirt on the outside cannot be adequately addressed.

[0006] Therefore, an object of the present invention is to provide a washing machine that can grasp the dirt on the object to be washed more accurately and in more detail, and can provide washing support that is suited to the actual situation. [Means for solving the problem]

[0007] In order to solve the above problems, the present invention directly measures or photographs the dirt on the object to be washed, and judges the dirt using the result. More specifically, the laundry assistance system has a washing machine that washes the laundry to be washed and a user terminal used by the user of the washing machine, and includes an image capturing unit that directly captures the laundry, a dirt judging unit that compares the image data of the captured laundry with basic data stored in advance to judge whether the laundry is dirty, and an output unit that outputs information related to the judged dirt.

[0008] The present invention also includes a laundry support method using the laundry support system, and each of the devices and subcombinations that constitute the laundry support system. Furthermore, the present invention also includes a laundry support method using the laundry support system, a program for causing each of the devices to function as a computer, and a storage medium that stores the program. Furthermore, the present invention also includes a technology for supporting the cleaning of a washing tub. Effect of the Invention

[0009] According to the present invention, it is possible to grasp the dirt on the object to be washed in a washing machine more accurately and in detail, and to support washing suited to the actual situation. [Brief description of the drawings]

[0010] [Figure 1] 1 is a system configuration diagram of a cleaning support system in one embodiment of the present invention. [Diagram 2] 1 is a functional block diagram of a user terminal 1 in one embodiment of the present invention. [Diagram 3] FIG. 2 is a functional block diagram relating to an information processing function of the washing machine 2 in one embodiment of the present invention. [Figure 4] FIG. 2 is a functional block diagram of a user terminal 1 according to the first embodiment. [Diagram 5] FIG. 2 is a hardware configuration diagram of a user terminal 1 in the first embodiment. [Figure 6] FIG. 11 is a diagram showing laundry information 180 used in the first embodiment. [Figure 7] FIG. 11 is a diagram showing washing machine management information 190 used in the first embodiment. [Figure 8] 2 is a functional block diagram relating to an information processing function of the washing machine 2 in the first embodiment. FIG. [Figure 9] FIG. 2 is a schematic cross-sectional view of a washing machine 2 in a first embodiment. [Figure 10] 1 is a flowchart showing a flow of a laundry support process in the first embodiment. [Figure 11] FIG. 11 is a functional block diagram of a user terminal 1 according to a second embodiment. [Figure 12] FIG. 11 is a hardware configuration diagram of a user terminal 1 in a second embodiment. [Figure 13] FIG. 11 is a diagram showing washing machine management information 190-1 used in the second embodiment. [Figure 14] FIG. 11 is a functional block diagram relating to an information processing function of the washing machine 2 in the second embodiment. [Figure 15] FIG. 11 is a schematic cross-sectional view of a washing machine 2 in a second embodiment. [Figure 16]13 is a flowchart showing the flow of a tank cleaning support process in the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described. In this embodiment, dirt on a washing object related to a washing machine is determined. The washing object includes a washing object such as clothes and a washing tub (particularly the outside thereof). In this way, this embodiment supports washing related to a washing machine, including washing of laundry and washing of the washing tub.

[0012] FIG. 1 is a system configuration diagram of the washing support system in this embodiment. The washing support system of this embodiment has a user terminal 1, a washing machine 2, a washing support device 3, and a consumables sales device 6, which are connected to each other via a router 4 and a network 5. However, the washing support device 3 is not a required component, and the washing support system can be configured with at least the user terminal 1 and the washing machine 2. Therefore, the washing support system (broken line part in FIG. 1) configured with the user terminal 1 and the washing machine 2 will be described below, and then the configuration including the washing support device 3 will be described. In addition, the consumables sales device 6 is a device for selling consumables related to the washing machine 2, such as detergent, tank cleaner, and net, and its contents will be described in Example 2 described later. For this reason, the description here will be omitted.

[0013] First, the user terminal 1 is used by a user who wishes to have a washing machine washed, and has a function of managing and operating the washing machine 2. Here, FIG. 2 is a functional block diagram of the user terminal 1 in this embodiment. In FIG. 1, the user terminal 1 has a communication unit 11, a dirt determination unit 12, a washing course determination unit 13, a control command unit 14, an input unit 15, an output unit 16, a memory unit 17, and an image capture unit 18. The communication unit 11 has a function of communication via the router 4 and the network 5 and a short-range wireless communication function. As a result, the user terminal 1 can communicate with the washing machine 2.

[0014] Furthermore, the dirt determination unit 12 determines the degree of dirt on the object to be washed using an image of the object to be washed captured by the image capture unit 18 or the image capture unit 230 of the washing machine 2, which will be described later. The dirt determination unit 12 uses pre-stored information to determine the degree of dirt. For example, the dirt determination unit 12 compares basic information indicating a state in which the object to be washed can be determined to be free of dirt with the image of the object to be washed. If the difference between these is equal to or greater than a threshold value, it is determined that dirt is present.

[0015] More preferably, the dirt determination unit 12 identifies the object to be washed, identifies a threshold value corresponding to the object to be washed, and uses this to determine whether or not the object is dirty. The presence or absence of dirt indicates the possibility that special washing beyond normal washing is necessary. In this case, the information on the object to be washed is used. The object to be washed includes objects to be washed such as clothes and the washing tub (particularly the outside thereof). For this reason, the photographing unit 18 and the photographing unit 230 of the washing machine 2 can be installed or moved to a position where they can directly photograph these objects.

[0016] Furthermore, the washing course determination unit 13 determines the washing course indicating the washing content according to the presence or absence of dirt determined. In this case, the washing course determination unit 13 changes the washing content depending on whether the amount is less than the threshold or more than the threshold, but if the amount is less than the threshold, it may determine that washing is unnecessary. Here, if dirt is present, changing the washing content depending on the washing conditions such as the water used will enable washing that is more suited to the actual situation. For this reason, it is more desirable for the washing course determination unit 13 to specify the washing course taking into account the washing conditions. Note that this washing includes washing the laundry and cleaning the washing tub of the washing machine 2.

[0017] Furthermore, the control command unit 14 creates a control command according to the washing course determined by the washing course determination unit 13. This control command is notified to the washing machine 2 via the communication unit 11, and the washing machine 2 executes washing according to the determined washing course. Note that the control command unit 14 preferably further has a function of creating a control command in response to an operation by a user.

[0018] Furthermore, the input unit 15 accepts various operations from the user. Furthermore, the output unit 16 outputs various information such as the degree of dirt and the determined washing course. The input unit 15 and the output unit 16 can be integrated. Furthermore, the storage unit 17 stores information used for processing in each of the above-mentioned units. In this embodiment, the storage unit 17 stores basic information, washing target information, and washing machine management information.

[0019] Here, the basic information is an example of information used for judgment by dirt judgment unit 12, and indicates a state in which it can be judged that the object to be washed is not dirty. The washing object information is information about the object to be washed, such as clothes and the washing tub, and is used to judge the dirt on the object to be washed. Furthermore, the washing machine management information is information for managing the type (model), individual washing machine, user, etc. of the washing machine. For this reason, the washing machine management information may be managed as the washing object information. Furthermore, the photographing unit 18 is capable of directly photographing the object to be washed. Note that the photographing unit 18 may be realized by a sensor capable of detecting dirt, in addition to a camera.

[0020] Next, the configuration of the washing machine 2 will be described. Fig. 3 is a functional block diagram relating to the information processing function of the washing machine 2 in this embodiment. As shown in Fig. 3, the washing machine 2 has a control unit 210, a communication unit 220, an image capturing unit 230, a display operation unit 240, and an operation unit 250. These are connected to each other via a communication path. Each configuration will be described below.

[0021] First, the control unit 210 creates and outputs a control signal for implementing the functions of the washing machine 2, such as cleaning and washing, and controls the operation of the washing machine 2. For this purpose, the control unit 210 has a dirt determination unit 211, a cleaning course determination unit 212, and a control signal creation unit 213. The dirt determination unit 211 and the cleaning course determination unit 212 have the same functions as the dirt determination unit 12 and the cleaning course determination unit 13, respectively. Furthermore, the control signal creation unit 213 creates a control signal for executing the corresponding cleaning course according to the cleaning course determined by the cleaning course determination unit 212 or the control command created by the control command unit 14. The control unit 210 can be realized by an MPU (Micro-Processing Unit), and each of the dirt determination unit 211, the cleaning course determination unit 212, and the control signal creation unit 213 can be realized by dedicated hardware or software such as a program.

[0022] The communication unit 220 also has a function of communicating via the router 4 and the network 5 and a function of short-distance wireless communication. The communication unit 220 notifies the user terminal 1 of image data (or data converted from the image data) captured by the image capture unit 230, and receives control commands from the user terminal 1. The image capture unit 230 can be installed or moved to a position where it can directly capture an image of the object to be washed. For this reason, the image capture unit 230 captures at least one of the clothes or the like put in and the outside of the washing tub. For example, the image capture unit 230 can be configured with both an image capture unit for the clothes or the like put in and an image capture unit for the outside of the washing tub. The image capture unit 230 can be realized by various sensors other than a camera.

[0023] In addition, the display operation unit 240 receives operations for the washing machine 2 from a user, and outputs the washing course to be executed, the stain determination result, etc. The operation unit 250 operates according to the washing course. For example, the operation unit 250 performs various washing and cleaning functions, such as executing a washing course, according to a control signal from the control unit 210.

[0024] Here, in the user terminal 1 and the washing machine 2, the dirt determination unit 12, the washing course determination unit 13, and the photographing unit 18 have the same functions as the dirt determination unit 211, the washing course determination unit 212, and the photographing unit 230. Therefore, it is sufficient that at least one of the user terminal 1 and the washing machine 2 has these functions. In other words, it is sufficient that the entire washing support system has these functions. That is, the washing support system of this embodiment having the user terminal 1 and the washing machine 2 has an image capturing unit that directly captures an object to be washed related to the washing machine 2, and a dirt determining unit that determines whether the captured object to be washed is dirty. More preferably, the washing support system has a washing course determining unit that determines a washing course indicating the washing content according to the determined dirt, and an operating unit that operates according to the determined washing course. The basic information, washing object information, and washing machine management information may be stored in the washing machine 2.

[0025] Next, an example of a cleaning support system using the cleaning support device 3 will be described. As shown in FIG. 1, the cleaning support device 3 is connected to a network 5 and realized by a server operated by a manufacturer of the washing machine 2 or the like. The cleaning support device 3 has a communication unit 31, a dirt determination unit 32, a cleaning course determination unit 33, a control command unit 34, and a storage unit 35. The communication unit 31 communicates with at least one of the user terminal 1 and the washing machine 2 via the network 5 and the router 4. The communication unit 31 accepts an image of the object to be cleaned taken from the user terminal 1 or the washing machine 2. When accepting an image from the user terminal 1, the image may be taken by the user terminal 1, or may be taken by the washing machine 2 and passed through the user terminal 1. This also applies to the case where an image is accepted from the washing machine 2.

[0026] Moreover, the dirt determination unit 32, the washing course determination unit 33, and the control command unit 34 have the same functions as the dirt determination unit 12, the washing course determination unit 13, and the control command unit 14, respectively. Therefore, it is sufficient that at least one of the washing support device 3, the user terminal 1, and the washing machine 2 has these. Therefore, the processing in this embodiment may be executed by the user terminal 1, the washing machine 2, and the washing support device 3 in cooperation with each other, or by two of these devices in cooperation with each other, or may be executed by any one of the devices.

[0027] Furthermore, storage unit 35 stores basic information, cleaning target information, and washing machine management information. Note that this information may be omitted if it is stored in user terminal 1 or washing machine 2. Furthermore, in storage unit 35, it is preferable that the washing machine management information is information about a plurality of washing machines and users.

[0028] This concludes the description of this embodiment, but in this embodiment, it is possible to grasp the dirt on the object to be washed more accurately and in detail, and to support washing that is suited to the actual situation. Below, examples that are specific examples of this embodiment will be described. EXAMPLES

[0029] Example 1 shows an example of handling laundry such as clothes as the object to be washed. The configuration of the laundry support system of Example 1 includes at least a user terminal 1 and a washing machine 2, as in the embodiment, and may include a washing support device 3. In Example 1, an example is described in which the user terminal 1 and the washing machine 2 cooperate to process in order to support the washing of laundry, but the processing subject of Example 1 is not limited to this.

[0030] The details of the first embodiment will be described below. In the first embodiment, the result of detecting the laundry being put into the washing tub is used to directly photograph the laundry. Also, areas that are heavily soiled (concentrated) are identified. The configuration for this purpose will be described. FIG. 4 is a functional block diagram of the user terminal 1 in the first embodiment. Compared to the configuration in FIG. 2, the washing course determination unit 13 is changed to a washing course determination unit 13-1, and a putting-in detection unit 101 and an area identification unit 102 are added. The following mainly describes these differences.

[0031] First, the stain determination unit 12 has the same function as in Fig. 2, but the target of the determination is laundry. Also, the washing course determination unit 13-1 determines a washing course indicating the contents of the washing as a cleaning course. Here, the washing course is not limited to a series of operations / operations (washing operations) expressed as so-called operation courses, etc., but may be a course that specifies a part of the washing operation, such as specifying the amount of detergent or the number of rinses.

[0032] Furthermore, the input detection unit 101 detects that the laundry has been input into the washing tub of the washing machine 2. Using this detection result, the image of the laundry is started. Here, when water is injected into the washing machine 2 and washing starts, the image of the laundry is taken through the "water (detergent is added)", so that the dirt on the laundry cannot be determined accurately. Therefore, the input detection unit 101 detects the input of the laundry so that the image can be taken before the water is injected. For this reason, "the input of the laundry" in this specification may be before the laundry and water are mixed in the washing tub, and may be before the laundry is physically entered into the washing tub. Therefore, it is preferable that the input detection unit 101 also detects the input of water.

[0033] In order to achieve the above functions, the input detection unit 101 detects in response to an operation on the input unit 15 by the user or a notification from the washing machine 2. Note that since the photographing on the user terminal 1 can also be performed by an operation by the user, the input detection unit 101 may be omitted.

[0034] Furthermore, the part specifying unit 102 specifies a part of the laundry that is heavily soiled (concentratedly soiled). This result is used to determine a washing course, or the result is notified to the user.

[0035] Next, an example of the implementation of the user terminal 1 will be described. Fig. 5 is a hardware configuration diagram of the user terminal 1 in the embodiment 1. In Fig. 5, the user terminal 1 has a camera 110, a touch panel 120, a processing device 130, a communication device 140, and a storage device 150, which are connected to each other via a communication path.

[0036] First, the camera 110 is an example of the photographing unit 18 in FIG. 4, and photographs the laundry. In the first embodiment, the camera photographs the laundry when the laundry is put in. The touch panel 120 also serves as the input unit 15 and the output unit 16 in FIG. 4, and receives instructions and operations from the user and displays various information. The touch panel 120 may be configured as an input device and an output device. The processing device 130 can be realized by a processor such as a CPU (Central Processing Unit), and executes calculations according to a laundry assistance program 160 stored in the storage device 150 described later. The communication device 140 corresponds to the communication unit 11 in FIG. 4, and communicates with the washing machine 2 and the like. This communication may be performed via the router 4 or the network 5, or directly via short-distance wireless communication or the like.

[0037] 4, and stores laundry assistance program 160, basic information 170, laundry information 180, and washing machine management information 190. However, some of these may be omitted and these functions may be implemented in washing machine 2 or washing assistance device 3. Storage device 150 may be realized by a main storage device such as a memory and a secondary storage device (storage medium) that is a so-called storage. The secondary storage device may be realized by an external HDD (Hard Disk Drive), SSD (Solid State Drive), memory card, or the like.

[0038] The laundry assistance program 160 is composed of a dirt determination module 161, a laundry course determination module 162, a control command module 163, an insertion detection module 164, and a part identification module 165, for each function. Each of these modules may be realized as an individual program or a partial combination.

[0039] Here, the configuration shown in FIG. 4 that executes the same functions as each module is as follows. Dirt determination module 161: dirt determination unit 12 Washing course determination module 162: Washing course determination unit 13-1 Control command module 163: control command unit 14 Insertion detection module 164: Insertion detection unit 101 Part identification module 165: Part identification unit 102 Therefore, the processing device 130 executes the processes of the stain determination unit 12, the washing course determination unit 13-1, the control command unit 14, the input detection unit 101 and the part identification unit 102 in accordance with the washing assistance program 160.

[0040] Here, the laundry assistance program 160 may be realized as one function of a washing machine management program that also performs maintenance of the washing machine 2, or may be realized as one function of a home appliance management program (integrated application) that also manages other home appliances.

[0041] Next, the basic information 170 is information showing the clean state of each laundry item such as clothes, and can be realized as an image of the laundry after washing or at the time of purchase. Catalog data or the like may also be used as the image of the clothes. The basic information 170 is managed for each laundry item, and by using this, the laundry that was photographed or its type can be identified.

[0042] Moreover, laundry information 180 is information about laundry, and is used to determine the dirt of the laundry object. Fig. 6 is a diagram showing the laundry information 180 used in the first embodiment. As shown in Fig. 6, the laundry information 180 has items of material, component parts, threshold (1) / washing course, and threshold (2) / washing course for each laundry.

[0043] Laundry is an item that identifies the type or individual. In FIG. 6, T-shirts and dress shirts are described as examples of "clothing", but this is not limited to these. For example, non-clothing items such as curtains are also included. Furthermore, material indicates the material of the laundry. Note that the material item may also describe the washing method (dry, hang to dry in the shade, etc.) determined by the material, etc. Furthermore, component parts indicate the parts that make up the laundry. These parts are used to identify areas where dirt is concentrated.

[0044] Moreover, the threshold (1) / washing course and the threshold (2) / washing course are items used to determine the washing course for each washing condition (water used). That is, they are items that correspond to a threshold indicating the degree of dirt and a washing course when the degree is equal to or greater than the threshold. As a result, the washing course is specified depending on whether the difference in dirt determined as the basic information 170 is equal to or greater than the threshold. In the first embodiment, two thresholds are used according to the washing conditions, which are an example of the cleaning conditions, but the number is not limited to two, and may be one, or may be three or more. The one threshold means that the washing conditions are not particularly taken into consideration. The washing conditions may be the characteristics of the water used (tap water / remaining hot water and room temperature / warm water). In the example of FIG. 6, a threshold is also set for each part, but this is not limited to this, and may be configured only with the threshold for the laundry.

[0045] Moreover, washing machine management information 190 is information for managing washing machine 2. FIG. 7 is a diagram showing washing machine management information 190 used in Example 1. As shown in FIG. 7, washing machine management information 190 has items of ID, washing course, and user for each type (model). Type (model) indicates the type (model) of washing machine 2. ID is identification information for identifying an individual washing machine 2. User is an item for managing users, etc., and in addition to user name and address, a management number, etc. are recorded.

[0046] The basic information 170 and laundry information 180, and the basic information 170 to washing machine management information 190 may be managed as one piece of information.

[0047] Next, the washing machine 2 of the first embodiment will be described. Fig. 8 is a functional block diagram relating to the information processing function of the washing machine 2 in the first embodiment. In the configuration of Fig. 8, compared with Fig. 3, the washing course determination unit 212 is changed to a washing course determination unit 212-1, and an insertion detection unit 214, a part identification unit 215, and an insertion sensor 260 are added. The following description will focus on these differences.

[0048] First, the stain determination unit 211 has the same function as in FIG. 3, but the target of the determination is laundry. Also, the washing course determination unit 212-1 determines a washing course indicating the contents of the washing as a cleaning course. That is, the washing course determination unit 13-1 has the same function as the washing course determination unit 212-1. Also, the input detection unit 214 detects the input of laundry into the washing tub of the washing machine 2, similar to the input detection unit 101. However, the input detection unit 214 detects according to an operation on the display operation unit 240 by the user, a notification from the user terminal 1, or a detection result of the input sensor 260.

[0049] Similarly to part identifying unit 102, part identifying unit 215 identifies a part of the laundry that is heavily soiled (concentratedly soiled). Furthermore, input sensor 260 is a sensor that detects that laundry is input into the washing tub, and can be realized by an ultrasonic sensor, a photoelectric sensor, a laser sensor, or the like. Similarly to part identifying unit 102, input detection unit 214 can be omitted. Similarly, input sensor 260 can also be omitted. Furthermore, control unit 210 may store at least one of basic information 170 to washing machine management information 190.

[0050] Next, the structure of the washing machine 2 will be described. FIG. 9 is a schematic diagram showing a cross section of the washing machine 2 in the first embodiment. FIG. 9 shows a hardware configuration as an implementation example of FIG. 8, taking a so-called drum-type washing machine as an example of the washing machine 2. In FIG. 9, the washing machine 2 has a control board 21, a communication IF (interface) 22, a camera 23, a display operation panel 24, an operating mechanism 25, a photoelectric sensor 26, a washing tub 27, and an input port 28. Here, the control board 21 controls the operation of the washing machine 2, and is an example of the control unit 210 in FIG. 8. The communication IF 22 communicates with the user terminal 1 and the like, and is an example of the communication unit 220 in FIG. 8. The camera 23 photographs the laundry, and is an example of the photographing unit 230 in FIG. 8. The camera 23 faces the washing tub 27 and can photograph the laundry being input. In particular, since FIG. 9 shows an example of a drum-type washing machine, it is desirable to install the camera facing downward of the washing tub 27 in which the laundry is accumulated. Furthermore, when photographing is being performed by photographing section 230 including camera 23, it is desirable for control section 210 to perform control so as to inhibit predetermined functions such as pouring water and rotating the washing tub.

[0051] Display operation panel 24 receives operations for washing machine 2 from a user and outputs the washing course to be executed, the result of the dirt determination, and the like, and is an example of display operation unit 240 in FIG. 8. Note that the output on display operation panel 24 may be performed by voice. Operating mechanism 25 is realized by a power source and a motor, and operates according to a control signal from control board 21, and is an example of operating unit 250 in FIG. 8. Washing tub 27 is connected to operating mechanism 25 and rotates during washing and drying according to the operation of the motor.

[0052] Photoelectric sensor 26 is provided near input port 28, detects input of laundry, and is an example of input sensor 260. Note that communication IF 22, camera 23, and photoelectric sensor 26 may be configured with a sealed structure such as packing for waterproofing.

[0053] Next, the process flow of the first embodiment will be described. FIG. 10 is a flowchart showing the flow of the laundry support process in the first embodiment. Here, the description will be given using the functional block configurations of FIG. 4 and FIG. 8. First, in step S21, the input detection unit 214 of the washing machine 2 determines whether or not the input of laundry into the washing tub has been detected. For this purpose, in the first embodiment, the input detection unit 214 receives a detection result indicating that laundry has been input from the input sensor 260, and uses this to make a determination. As a result, if the laundry has been input (Y), the process proceeds to step S22. If the laundry has not been input (N), the process continues in this step.

[0054] Also, in step S22, photographing unit 230 starts photographing the put-in laundry and acquires the image data. For this purpose, control signal creation unit 213 creates a control signal for controlling photographing and notifies photographing unit 230, and photographing unit 230 photographs in accordance with this. Also, in step S23, control signal creation unit 213 inhibits the operation of washing machine 2. Here, it is desirable for control signal creation unit 213 to inhibit operations that may affect photographing by photographing unit 18, such as pouring water into the washing tub and rotating the washing tub. Also, in order to perform the inhibition, control signal creation unit 213, for example, creates an inhibition signal for inhibition and notifies operation unit 250 of this, or ignores an operation instruction from display operation unit 240 or the like.

[0055] In step S24, the control signal creation unit 213 determines whether or not shooting has been completed by the shooting unit 230. As a result, if shooting has been completed (Y), the process proceeds to step S25. If shooting has not been completed (N), the process continues from step S23 onwards.

[0056] In addition, in step S25, the control signal generating unit 213 ends the inhibition control of step S23. To this end, the control signal generating unit 213, for example, generates an inhibition end signal that ends the inhibition and notifies the operation unit 250 of the inhibition end signal, or enables the operation instruction from the display operation unit 240 or the like to be accepted.

[0057] In step S26, communication unit 220 notifies user terminal 1 of the image data captured in step S22 and thereafter. With the above, the processing on the washing machine 2 side is temporarily terminated, and processing on user terminal 1 is executed thereafter. The processing on the washing machine 2 side may be executed as follows. First, image capture unit 230 may continuously capture images of the inside of the washing tub, and validate or record the image data from when the laundry is put in until the end of image capture. In addition, instead of the end of image capture in step S24, a forced start of operation may be set as a condition.

[0058] In step S11, the communication unit 11 of the user terminal 1 receives image data from the washing machine 2. In step S12, the stain determination unit 12 compares the received image data with the basic information to determine whether the laundry is stained or not. The presence or absence of stain indicates the possibility that a special wash beyond normal washing is required. For this purpose, the stain determination unit 12 performs image processing on the image data to identify the type of laundry. Next, the stain determination unit 12 compares the basic information of the identified laundry with the received image data. The stain determination unit 12 then determines whether the laundry is stained or not based on the difference between the two. For example, if the difference is equal to or greater than a certain value, it is determined that the laundry is stained. If the laundry is stained as a result of this, the process proceeds to step S13. If the laundry is not stained, the process proceeds to step S16.

[0059] In step S13, the washing course determination unit 13-1 checks whether there is a part where dirt is concentrated using the result of image processing on the received image data, and identifies the concentrated part. At this time, the washing course determination unit 13-1 identifies a part where dirt is concentrated compared to other parts or a part that is more dirty than a predetermined level.

[0060] In step S14, the washing course determination unit 13-1 specifies the washing conditions and the corresponding thresholds. For this purpose, the washing course determination unit 13-1 specifies the washing conditions from the operation on the input unit 15, the notification from the washing machine 2, and the contents previously set in the storage unit 17. Then, the washing course determination unit 13-1 specifies the previously specified laundry, washing conditions, and thresholds corresponding to the part where dirt is concentrated from the laundry information 180. As a result, the washing course determination unit 13-1 specifies the thresholds for the entire laundry and the thresholds for the part where dirt is concentrated. Here, the washing course determination unit 13-1 may specify the thresholds for the "constituent part" in the laundry information 180 corresponding to the "whole" when dirt is not concentrated, and may specify the thresholds for the "constituent part" corresponding to the "part" when dirt is not concentrated. Moreover, the thresholds for the "whole" and the "part" may be specified regardless of the presence or absence of dirt concentration. In the laundry information 180 shown in FIG. 6, the washing condition at threshold (1) is the use of tap water, and the washing condition at threshold (2) is the use of remaining hot water, which are different values ​​from each other.

[0061] In step S15, the washing course determination unit 13-1 determines a washing course using the threshold value specified as the value indicating the dirt. For this purpose, the washing course determination unit 13-1 may use the difference in step S12 as the value indicating the dirt, or may use other indicators. If the difference is equal to or greater than the threshold, the washing course determination unit 13-1 determines a washing course associated with the specified threshold from the laundry information 180. Note that, when the threshold values ​​for "whole" and "part" are specified, the washing course determination unit 13-1 preferably determines a washing course corresponding to the "part", but may specify either one by other logic. For example, the washing course determination unit 13-1 may determine a washing course that puts less strain on the fabric according to the material of the laundry. As described above, in steps S13 to S15, the washing course determination unit 13-1 determines the degree of the concentration of dirt on the laundry, and determines a washing course indicating the contents of the laundry based on the degree of the concentration of dirt on the laundry.

[0062] In addition, a process to be performed when it is determined that there is no washing course in step S12 will be described. In step S16, the washing course determination unit 13-1 determines the standard course, which is a normal course, as the washing course. In the above steps S13 to S16, the washing course determination unit 13-1 determines the washing course.

[0063] Then, in step S17, control command unit 14 creates a control command for executing the determined washing course. In response to this, in step S18, communication unit 11 notifies washing machine 2 of the control command. In addition, in step S19, output unit 16 displays information indicating the determined washing course. Note that step S18 may be executed on the condition that the user consents to input unit 15.

[0064] Here, in the first embodiment, steps S13 to S18 may be omitted, and the presence or absence of dirt determined in step S12 may be displayed in step S19. In this manner, in the first embodiment, information regarding the dirt determined in step S12 is output in step S19. This output may be performed by the display operation unit 240 of the washing machine 2.

[0065] Next, the subsequent processing of washing machine 2 will be described. First, in step S27, communication unit 220 of washing machine 2 accepts the notified control command. In response to this, in step S28, control signal creation unit 213 creates a control signal for executing the washing course determined in accordance with the control command, and outputs it to operation unit 250. Then, in step S29, operation unit 250 executes the corresponding washing course, and the laundry is washed.

[0066] The process from step S17 onwards may be carried out as follows. First, before step S17, output unit 16 displays the determined washing course, as in step S19. Next, input unit 15 accepts the designation of a washing course with reference to the displayed washing course. Then, the process from step S18 to step S27 onwards is carried out. The designation of a washing course may be carried out by display operation unit 240 of washing machine 2. Then, in step S28, control signal creation unit 213 creates a control signal for executing the designated washing course. In this way, in the first embodiment, the determined washing course is displayed, and the execution can be carried out according to the user's operation.

[0067] In addition, in the first embodiment, the above-mentioned threshold value may be updated using a learning function. For this purpose, after washing, the laundry is photographed, and the stain determination unit 12 or the stain determination unit 211 determines the stain after washing. As a result, if stain remains, that is, if it is determined as "present" in step S12, the corresponding threshold value is adjusted downward. In addition to this, the washing course determination unit 13-1 or the washing course determination unit 212-1 may determine a washing course, and if this is the same as before washing, the corresponding threshold value may be adjusted downward. In this way, the threshold value can be learned and updated by utilizing the stain determination and the determination of the washing course.

[0068] In the first embodiment, the user terminal 1 and the washing machine 2 cooperate to execute the above-mentioned process, but each processing entity is not limited to the above description. For example, the process may be executed by either the user terminal 1 or the washing machine 2, or a part of the process may be executed by the other device. This concludes the description of the first embodiment. According to the first embodiment, it is possible to avoid taking an image through water containing detergent, and it is possible to support the execution of a wash that is more in line with the actual state of the laundry. EXAMPLES

[0069] Next, a second embodiment will be described in which the washing tub is cleaned as a cleaning for a washing machine. In the second embodiment, a tub cleaning support system including at least a user terminal 1 and a washing machine 2 is configured as a cleaning support system. The following mainly describes the differences from the first embodiment. First, FIG. 11 is a functional block diagram of a user terminal 1 in the second embodiment. In the configuration of FIG. 11, compared to FIG. 4 in the first embodiment, the washing course determination unit 13-1 is changed to a tub cleaning course determination unit 13-2, and the input detection unit 101, the part identification unit 102, and the photographing unit 18 are omitted. In addition, a consumables ordering unit 103 is added. The following mainly describes these differences.

[0070] First, the dirt determination unit 12 has the same function as that of the first embodiment (FIG. 4), but the target of the determination is the washing tub 27. In particular, the outside of the washing tub 27 is the target. In addition, the tub cleaning course determination unit 13-2 determines a tub cleaning course that indicates the content of the tub cleaning, including the necessity or non-necessity. Here, the tub cleaning course includes the necessity or non-necessity, tub cleaning (automatic cleaning) realized as a function of the washing machine 2, cleaning by a maintenance person, etc. In addition, the second embodiment may be realized in combination with the first embodiment, and therefore may be configured to include at least a part of the above-mentioned replaced or omitted configuration. This also applies hereinafter.

[0071] In addition, the consumables ordering unit 103 executes processing related to ordering consumables such as a tub cleaner used in the washing machine 2, based on the remaining amount, the operation history, and instructions from the user.

[0072] Next, an example of implementing the user terminal 1 in the second embodiment will be described. Fig. 12 is a hardware configuration diagram of the user terminal 1 in the second embodiment. In the configuration in Fig. 12, the camera 110 is omitted compared to Fig. 5 in the first embodiment. That is, the user terminal 1 in the second embodiment has a touch panel 120, a processing device 130, a communication device 140, and a storage device 150, which are connected to each other via a communication path. Each of these configurations is similar to that in the first embodiment.

[0073] 5, and is a program for supporting tub cleaning. In tub cleaning support program 160-1, washing course determination module 162 is changed to tub cleaning course determination module 166, and input detection module 164 and part identification module 165 are omitted. Also, consumables ordering module 167 is added. Furthermore, as information, laundry information 180 is omitted, and the contents of washing machine management information 190-1 are changed.

[0074] Here, the tank cleaning course determination module 166 is a configuration corresponding to the tank cleaning course determination unit 13-2 in Fig. 11. Furthermore, the consumables ordering module 167 is a configuration corresponding to the consumables ordering unit 103 in Fig. 11. Note that the consumables ordering module 167 may be realized by a general shopping application separate from the tank cleaning support program 160-1.

[0075] Next, washing machine management information 190-1 will be described. FIG. 13 is a diagram showing washing machine management information 190-1 used in Example 2. Washing machine management information 190-1 in Example 2 is used to manage washing machine 2 and to determine its tub cleaning course. Furthermore, in Example 2, it is also used to order a tub cleaning agent, which is an example of a consumable item. However, ordering a tub cleaning agent is not essential and can be omitted.

[0076] For this purpose, the washing machine management information 190-1 has the items of ID, standard information (1) / tub cleaning course, standard information (2) / tub cleaning course, user, and tub cleaning agent for each type (model). Here, the type (model), ID, and user are the same items as those in the first embodiment. Also, the standard information (1) / tub cleaning course and the standard information (2) / tub cleaning course are items used to determine the tub cleaning course for each tub cleaning condition (water to be used). That is, they are items that associate the standard information indicating the degree of dirt in the washing tub with the tub cleaning course to be executed in that case. More specifically, the tub cleaning course is determined using a combination of the difference between before and during (after) the tub cleaning and the value during (after) the tub cleaning. The smaller the difference, the smaller the change in dirt in the washing tub, and the larger the value during (after) the tub cleaning, the more dirt is determined to remain. Therefore, the effect of the tub cleaning and the degree of remaining dirt can be grasped by these combinations. Furthermore, as in the first embodiment, the tub cleaning condition may be 1 to 3 or more.

[0077] Therefore, in the second embodiment, this combination is used to determine the tub cleaning course, including whether or not re-tub cleaning is required. As a modified example of the second embodiment, the degree of dirt in the washing tub as determined by the combination may be displayed. This display may be performed together with the determination of the tub cleaning course. Here, in the second embodiment, the electrical conductivity (electrical conductivity) indicating the ease with which the water in the washing tub passes electricity is used as the difference indicating the degree of dirt in the washing tub or the value during (after) cleaning. The higher this conductivity is, the greater the dirtiness can be determined to be.

[0078] Here, the tank cleaning course includes a case where re-tank cleaning is not required. In the second embodiment, when the tank cleaning is performed, the dirt is judged, and the necessity of "re-tank cleaning" is judged. Therefore, when the judgment is made at a timing other than the tank cleaning, it is not necessary to judge whether "re-tank cleaning" is required.

[0079] Additionally, the tub cleaner is an item used for inventory management of the tub cleaner used in the washing machine in question, particularly for ordering. For this purpose, the name of the tub cleaner used (tub cleaner A), the remaining amount, and the standard ordering amount are recorded. The remaining amount indicates the remaining amount of tub cleaner reserved by the user. The standard ordering amount is used to order the corresponding tub cleaner when the remaining amount reaches the standard ordering amount. Note that the tub cleaner item may be omitted.

[0080] Next, a washing machine 2 of Example 2 will be described. Fig. 14 is a functional block diagram relating to the information processing function of the washing machine 2 in Example 2. In the configuration of Fig. 14, compared to Fig. 8 of Example 1, washing course determination unit 212-1 is changed to tub cleaning course determination unit 212-2, and input detection unit 214, part identification unit 215 and photographing unit 230 are omitted. In addition, water quality sensor 270 is added. The following description will focus on these differences.

[0081] First, the dirt determination unit 211 has the same function as that of the first embodiment (FIG. 8), but the target of the determination is the washing tub 27. In particular, the outside of the washing tub 27 is the target. Also, the tub cleaning course determination unit 13-2 determines a tub cleaning course that indicates the contents of the tub cleaning, including whether or not it is necessary. Here, the tub cleaning course includes whether or not it is necessary, as described above.

[0082] Water quality sensor 270 is a sensor that detects the water quality in the tub, and can be realized by an electrical conductivity sensor or the like. Using the detection result, the dirt of the washing tub can be determined. Control unit 210 may also store at least one of basic information 170 and washing machine management information 190-1.

[0083] Next, the structure of the washing machine 2 will be described. FIG. 15 is a schematic diagram showing a cross section of the washing machine 2 in the second embodiment. FIG. 15 shows a hardware configuration as an implementation example of FIG. 14, taking a so-called vertical washing machine as an example of the washing machine 2. In FIG. 15, the washing machine 2 has a control board 21, a communication IF (interface) 22, a display operation panel 24, an operating mechanism 25, an electric conductivity sensor 29, a washing tub 27, and an input port 28. Here, the components other than the electric conductivity sensor 29 are the same as those in the first embodiment. The electric conductivity sensor 29 is an example of the water quality sensor 270, and detects the electric conductivity of the water in the washing tub 27. In the second embodiment, when the washing tub 27 is washed, the water is scooped up to the top by the rotation of the washing tub 27, and the electric conductivity sensor 29 detects the electric conductivity of this water. The communication IF 22 and the water quality sensor 270 may be configured with a sealed structure such as a packing for waterproofing.

[0084] Next, a process flow of the second embodiment will be described. FIG. 16 is a flowchart showing a process flow of the tub cleaning support process in the second embodiment. Here, the process will be described using the functional block configurations of FIG. 11 and FIG. 14. First, in step S201, water is injected into washing tub 27 of washing machine 2. This is done by operating unit 250 in accordance with a control signal from control signal creation unit 213 in response to a user's operation or the like, and in order to perform tub cleaning or the like.

[0085] In step S202, the conductivity sensor 29 detects the conductivity of the injected water. Then, in step S203, the operation unit 250 executes tub cleaning according to the control signal from the control signal creation unit 213. At this time, in step S204, the conductivity sensor 29 detects the conductivity of the water during the tub cleaning. Here, the conductivity sensor 29 detects the conductivity of the water stirred up by the rotation of the washing tub 27.

[0086] Then, the communication unit 220 notifies the user terminal 1 of the conductivities detected in steps S202 and S204.

[0087] In step S101, the communication unit 11 of the user terminal 1 receives the notified electrical conductivity. In response to this, in step S102, the dirt determination unit 12 calculates the difference in the notified electrical conductivity. Then, the dirt determination unit 12 determines the combination of the difference and the electrical conductivity during washing as the dirt in the washing tub 27. The presence or absence of dirt is determined according to this combination.

[0088] In step S103, the tub cleaning course determination unit 13-2 determines the cleaning / washing conditions. To this end, the tub cleaning course determination unit 13-2 determines the tub cleaning conditions from an operation on the input unit 15, a notification from the washing machine 2, or contents previously set in the storage unit 17.

[0089] Then, in step S104, the tank cleaning course determination unit 13-2 compares the dirt determined in step S102 with the reference information of the identified tank cleaning conditions. Using this result, the tank cleaning course determination unit 13-2 determines whether tank cleaning is necessary again. If tank cleaning is not necessary again as a result, the process proceeds to step S105. If it is necessary, the process proceeds to step S106.

[0090] In step S105, output unit 16 displays that washing tub 27 is not dirty and that tub cleaning is not necessary. Here, it may display that the tub cleaning performed in step S203 was effective. In this case, tub cleaning course determination unit 13-2 executes the course when the difference calculated in step S102 is equal to or greater than a predetermined value.

[0091] In addition, in step S106, tub cleaning course determination unit 13-2 determines a tub cleaning course based on the dirt determined in step S102, by using washing machine management information 190-1.

[0092] Then, in step S107, control command unit 14 creates a control command for executing the determined tub cleaning course. In response to this, in step S108, communication unit 11 notifies washing machine 2 of the control command. In addition, in step S109, output unit 16 displays information indicating the determined tub cleaning course. Note that step S108 may be executed on the condition that the user consents to input unit 15.

[0093] Next, the subsequent processing of washing machine 2 will be described. First, in step S206, communication unit 220 of washing machine 2 accepts the notified control command. In response to this, in step S207, control signal creation unit 213 creates a control signal for executing the tub cleaning course determined in response to the control command, and outputs it to operation unit 250. Then, in step S208, operation unit 250 executes the corresponding tub cleaning course, and laundry is washed.

[0094] The process from step S107 onwards may be carried out as follows. First, before step S107, output unit 16 displays the determined tub cleaning course, as in step S109. Next, input unit 15 accepts the designation of the tub cleaning course with reference to the displayed washing course. Then, the process from step S108 to step S206 onwards is carried out. The designation of the tub cleaning course may be carried out by display operation unit 240 of washing machine 2. Then, in step S207, control signal creation unit 213 creates a control signal for executing the designated tub cleaning course. In this way, in the second embodiment as well, the determined tub cleaning course is displayed, and its execution can be realized according to the user's operation.

[0095] In the second embodiment, a tank cleaning agent ordering / purchase process for ordering and purchasing a tank cleaning agent, which is an example of a consumable product, may be performed. The details of this process will be described below.

[0096] For this purpose, the control signal creation unit 213 of the washing machine 2 detects the number of times the tub has been cleaned and the remaining amount of the tub cleaner from a sensor in a storage unit (not shown) for the tub cleaner. The timing for this is preferably after the tub cleaner in step S208, but is not limited to this. Then, the communication unit 220 notifies the user terminal 1 of the remaining amount of the tub cleaner.

[0097] Also, communication unit 11 of user terminal 1 accepts the remaining amount of tub cleaning agent. In response to this, consumables ordering unit 103 updates the remaining amount of "tub cleaning agent" in washing machine management information 190-1. Then, consumables ordering unit 103 judges whether the remaining amount is below the ordering reference amount. This means a judgment of whether ordering tub cleaning agent, that is, purchasing, is necessary. As a result, if the remaining amount is below the ordering reference amount, consumables ordering unit 103 displays a confirmation screen on output unit 16 for whether or not to order tub cleaning agent. For example, consumables ordering unit 103 displays a confirmation notice such as "Do you want to purchase XX L (units) of tub cleaning agent?"

[0098] Then, when an input indicating an order is required is received from the input unit 15, the consumables ordering unit 103 transmits an order instruction to the consumables selling device 6 using the communication unit 11. This order instruction may be transmitted via the cleaning support device 3. Note that it is preferable that the input unit 15 receives the type, quantity, delivery date, etc. of the tank cleaner from the user. As a result, the consumables selling device 6 executes a sales process of the tank cleaner to the user.

[0099] This concludes the description of the process of the second embodiment. In the second embodiment, the above-mentioned reference information may be updated using a learning function, as in the case of the threshold value in the first embodiment. According to the second embodiment, the tub cleaning can be performed accurately and efficiently. This is because the dirt of the washing tub is judged using the water quality at the time of the tub cleaning, and the necessity of ordering a tub cleaning agent is judged at the timing of the tub cleaning.

[0100] Although the description of each embodiment is finished above, the present invention is not limited to these. For example, the processing subject is not limited to the above-mentioned examples. Furthermore, cleaning is not limited to washing or tub cleaning, and can be applied to washing machine maintenance, etc. Furthermore, it can be applied to washing machines, dryers, etc. in addition to washing machines. Furthermore, at least some of the functions of the first and second embodiments may be combined. Furthermore, the cleaning support device 3 may execute at least some of the above-mentioned processes. [Explanation of symbols]

[0101] 1...user terminal, 11...communication unit, 12...dirt determination unit, 13...washing course determination unit, 13-1...washing course determination unit, 13-2...tub cleaning course determination unit, 14...control command unit, 15...input unit, 16...output unit, 17...storage unit, 18...photographing unit, 101...insertion detection unit, 102...part identification unit, 103...consumables ordering unit, 170...basic information, 180...laundry information, 190...washing machine management information, 2...washing machine, 210...control unit, 211...dirt determination unit, 212...washing Course determination unit, 212-1...washing course determination unit, 212-2...tub cleaning course determination unit, 213...control signal creation unit, 214...loading detection unit, 215...part identification unit, 220...communication unit, 230...photography unit, 240...display operation unit, 250...operation unit, 260...loading sensor, 270...water quality sensor, 3...cleaning support device, 31...communication unit, 32...dirt determination unit, 33...cleaning course determination unit, 34...control command unit, 4...router, 5...network, 6...consumables sales device

Claims

1. A laundry assistance system having a washing machine for washing laundry and a user terminal used by a user of the washing machine, An imaging unit that directly images the laundry; a stain determination unit for determining whether or not the laundry is stained by comparing image data of the photographed laundry with basic data stored in advance; A laundry assistance system having an output unit that outputs information regarding the determined stain.

2. The laundry assistance system according to claim 1 , Further, a washing course determination unit is provided for determining a degree of dirt on the laundry when the laundry is dirty, and determining a washing course indicating the contents of the washing based on the degree of dirt, The output unit outputs the washing course as information regarding the stain.

3. The laundry assistance system according to claim 2, moreover, An input detection unit that detects input of laundry into the washing machine; A control unit for controlling the operation of the washing machine, The photographing unit photographs the laundry when the insertion is detected, The control unit of the laundry assistance system suppresses operation of the washing machine that may affect image capture by the image capture unit until image capture by the image capture unit is completed.

4. The laundry assistance system according to claim 3, The control unit is a washing support system that inhibits the injection of water into the washing tub of the washing machine and the rotation of the washing tub.

5. The laundry assistance system according to claim 3, The laundry support system wherein the laundry course determination unit identifies an area of ​​the laundry where dirt is concentrated.

6. The laundry assistance system according to claim 3, The washing course determination unit determines the washing course using a pre-stored threshold value.

7. The laundry assistance system according to claim 6, The washing course determination unit of the washing assistance system uses a plurality of threshold values ​​according to washing conditions.

8. The laundry assistance system according to claim 7, The washing conditions indicate characteristics of water to be used for the washing.

9. The laundry assistance system according to claim 2, The laundry assistance system further includes a control unit that controls the operation of the washing machine according to the determined washing course.

10. The laundry assistance system according to claim 1 , Further, a water quality sensor is provided for detecting the water quality in the washing tub of the washing machine, The dirt determination unit determines dirt in the washing tub using the water quality.

11. A laundry assistance program for communicating with a washing machine that washes laundry to be washed and for causing a user terminal used by a user of the washing machine to function as a computer, comprising: a stain determination unit for determining whether or not the laundry is stained by comparing image data of the laundry directly photographed by the photographing unit with basic data stored in advance; A laundry assistance program that functions as an output unit that outputs information regarding the determined stain.

12. The laundry assistance program according to claim 11, Furthermore, the user terminal is caused to function as a washing course determination unit that, when the laundry is soiled, identifies the degree of soiling of the laundry and determines a washing course indicating the contents of the laundry based on the degree of soiling; The output unit outputs the washing course as information regarding the stain.

13. The laundry assistance program according to claim 12, Furthermore, the user terminal An input detection unit that detects input of laundry into the washing machine; The washing machine is operated as a control unit. The photographing unit photographs the laundry when the insertion is detected, The control unit is a laundry assistance program that suppresses operation of the washing machine that affects the image capture by the image capture unit until the image capture by the image capture unit is completed.

14. The laundry assistance program according to claim 13, The control unit is a washing support program that inhibits the injection of water into the washing tub of the washing machine and the rotation of the washing tub.

15. The laundry assistance program according to claim 13, The washing course determination unit is a washing support program that identifies an area of ​​the laundry where dirt is concentrated.

16. The laundry assistance program according to claim 13, The washing assistance program, wherein the washing course determination unit determines the washing course using a pre-stored threshold value.

17. 17. The laundry assistance program according to claim 16, The washing course determination unit is a washing assistance program that uses a plurality of thresholds according to washing conditions.

18. 18. The laundry assistance program according to claim 17, The washing conditions indicate the characteristics of water to be used for the washing.

19. The laundry assistance program according to claim 12, Further, the laundry assistance program has a control unit that controls the operation of the washing machine according to the determined laundry course.

20. The laundry assistance program according to claim 11, The washing machine has a water quality sensor that detects the water quality in the washing tub, The dirt determination unit determines dirt in the washing tub using the water quality.

Images