Washing machine for detecting foreign substance and control method thereof

Abstract

A washing machine is disclosed. The washing machine according to the present disclosure may comprise: a drum; a camera; a weight sensor for detecting the weight of laundry accommodated in the drum; a memory for storing instructions; and at least one processor including processing circuitry, wherein the instructions, when executed individually or collectively by the at least one processor, cause the washing machine to: acquire at least one first image by capturing, through the camera, an image of the laundry introduced into the drum through a laundry loading opening in a state in which a door for opening and closing the laundry loading opening is opened; and when the door is closed, determine whether to execute a foreign substance detection function for identifying whether a foreign substance is present in the drum, by using information acquired on the basis of at least one of a state at a time point at which the door is opened, the weight sensor, and the at least one first image.

Description

Washing machine for detecting foreign substances and control method thereof

[0001] The present disclosure relates to a washing machine that detects foreign substances and a method for controlling the same.

[0002] When the washing machine performs a wash cycle, foreign materials such as tissues or paper may be contained in the drum. These foreign materials may be attached to the laundry or present in the pockets of the laundry.

[0003] If laundry is washed with foreign substances, the washing process may not be performed properly due to the foreign substances. Additionally, if foreign substances enter the interior of the washing machine outside the drum, it may cause the washing machine to malfunction.

[0004] To prevent such inconvenience and malfunctions, the need arose for a method to identify whether foreign substances are present in the drum before washing is performed.

[0005] A washing machine according to the present disclosure comprises a drum, a camera, a weight sensor for detecting the weight of laundry contained in the drum, a memory for storing instructions, and at least one processor including a processing circuitry, wherein when the instructions are executed individually or collectively by the at least one processor, the washing machine captures laundry being fed into the drum through the laundry input port with the camera while the door for opening and closing the laundry input port is open to obtain at least one first image, and when the door is closed, determines whether to execute a foreign object detection function to identify whether there is foreign object in the drum using information obtained based on at least one of the state at the time when the door was open, the weight sensor, and the at least one first image.

[0006] The above information may include at least one of the following: the weight of the laundry obtained through the weight sensor, the number of pockets of the laundry obtained from at least one first image, the time the door remained open until the door was closed, the number of laundry not recognized in at least one first image, and the laundry capacity obtained based on the weight of the laundry.

[0007] When the above instructions are executed individually or collectively by the at least one processor, the washing machine may identify a score for executing the foreign substance detection function based on the acquired information, decide to execute the foreign substance detection function based on whether the score is greater than or equal to a preset value, and decide not to execute the foreign substance detection function based on whether the score is less than the preset value.

[0008] When the above instructions are executed individually or collectively by the at least one processor, the washing machine may rotate the drum and photograph the inside of the drum through the camera to obtain at least one second image based on the determination to execute the foreign object detection function, identify whether there is a foreign object inside the drum based on the at least one second image, and perform a washing operation on the laundry based on the determination not to execute the foreign object detection function.

[0009] When the above instructions are executed individually or collectively by the at least one processor, the washing machine may identify the rotation time of the drum based on the number of pockets of the laundry, rotate the drum based on the rotation time, identify the cycle for acquiring the at least one second image using the camera based on the weight of the laundry, and acquire the at least one second image based on the cycle while the drum is rotating.

[0010] When the above instructions are executed individually or collectively by the at least one processor, the washing machine may identify that the drum rotation time is a first time based on the number of pockets of the laundry being less than or equal to a first number, identify that the drum rotation time is a second time greater than the first time based on the number of pockets of the laundry being greater than the first number and less than or equal to a second number, and identify that the drum rotation time is a third time greater than the second time based on the number of pockets of the laundry being greater than the second number and less than or equal to a third number.

[0011] When the above instructions are executed individually or collectively by the at least one processor, the washing machine may identify that the cycle is a first cycle based on the weight of the laundry being less than or equal to a first weight, identify that the cycle is a second cycle longer than the first cycle based on the weight of the laundry being greater than the first weight and less than or equal to a second weight, and identify that the cycle is a third cycle longer than the second cycle based on the weight of the laundry being greater than the second weight and less than or equal to a third weight.

[0012] When the above instructions are executed individually or collectively by the at least one processor, the washing machine may terminate the rotation of the drum based on the fact that the rotation time is less than or equal to a preset time and the identified rotation time has elapsed since the drum started rotating, provide hot air into the drum while the drum is rotating based on the fact that the rotation time is greater than the preset time and the preset time has elapsed since the drum started rotating, and terminate the rotation of the drum and the supply of the hot air based on the fact that the rotation time has elapsed since the drum started rotating.

[0013] When the above instructions are executed individually or collectively by the at least one processor, the washing machine may provide a notification indicating the presence of the foreign substance when it is identified that the foreign substance is inside the drum based on the execution of the foreign substance detection function, and perform a washing operation on the laundry when it is identified that the foreign substance is not inside the drum based on the execution of the foreign substance detection function.

[0014] In addition, a control method for a washing machine according to the present disclosure may include the step of obtaining at least one first image by photographing laundry being fed into a drum through a laundry input opening while the door for opening and closing the laundry input opening is open, and the step of determining whether to execute a foreign substance detection function to identify whether there is foreign substance in the drum by using information obtained based on at least one of the state at the time when the door was open, the weight sensor, and the at least one first image when the door is closed.

[0015] In addition, in a non-transient computer-readable recording medium that stores one or more instructions executed by a processor of a washing machine to perform an operation, the operation may include the step of obtaining at least one first image by photographing laundry being fed into a drum through a laundry input opening with a door that opens and closes the laundry input opening, and the step of determining whether to execute a foreign substance detection function to identify whether there is foreign substance in the drum by using information obtained based on at least one of the state at the time when the door was open, a weight sensor, and the at least one first image when the door is closed.

[0016] FIG. 1 is a drawing for explaining the appearance of a washing machine according to one embodiment of the present disclosure.

[0017] FIG. 2 is a block diagram illustrating the configuration of a washing machine according to one embodiment of the present disclosure.

[0018] FIG. 3 is a block diagram illustrating the detailed configuration of a washing machine according to one embodiment of the present disclosure.

[0019] FIG. 4 is a flowchart illustrating a control method for a washing machine according to one embodiment of the present disclosure.

[0020] FIG. 5 is a drawing for explaining a method in which a washing machine according to one embodiment of the present disclosure automatically photographs laundry.

[0021] FIG. 6 is a table showing information about laundry according to one embodiment of the present disclosure.

[0022] FIG. 7 is a table for explaining the conditions for performing a foreign substance detection mode according to one embodiment of the present disclosure.

[0023] FIG. 8 is a drawing for explaining a method of detecting foreign substances using the rotation of a drum according to one embodiment of the present disclosure.

[0024] FIG. 9 is a table for explaining a foreign substance detection function according to one embodiment of the present disclosure.

[0025] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments.

[0026] In relation to the description of the drawings, similar reference numerals may be used for similar or related components.

[0027] The singular form of the noun corresponding to the item may include one or multiple items, unless the relevant context clearly indicates otherwise.

[0028] In this document, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "at least one of A, B, or C" may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof.

[0029] The term “and / or” includes a combination of multiple related described components or any of the multiple related described components.

[0030] Terms such as "first," "second," or "first" or "second" may be used simply to distinguish a component from another corresponding component and do not limit the components in other aspects (e.g., importance or order).

[0031] Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0032] Terms such as “include” or “have” are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in this document, and do not preclude the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0033] When it is said that one component is “connected,” “combined,” “supported,” or “in contact” with another component, this includes not only cases where the components are directly connected, combined, supported, or in contact, but also cases where they are indirectly connected, combined, supported, or in contact through a third component.

[0034] When it is said that a component is located “on” another component, this includes not only cases where one component is in contact with the other, but also cases where another component exists between the two components.

[0035] A washing machine according to various embodiments can perform washing, rinsing, spin-drying, and drying operations. A washing machine is an example of a clothing processing device, and a clothing processing device is a concept that encompasses a device for washing clothing (clothing to be washed, clothing to be dried), a device for drying clothing, and a device capable of performing both washing and drying of clothing.

[0036] Washing machines according to various embodiments may include a top-loading washing machine in which a laundry inlet for loading or unloading laundry is provided to face upward, or a front-loading washing machine in which a laundry inlet is provided to face forward. Washing machines according to various embodiments may include washing machines with loading methods other than top-loading washing machines and front-loading washing machines.

[0037] In the case of a top-loading washing machine, laundry can be washed using a water flow generated by a rotating body such as a pulsator. In the case of a front-loading washing machine, laundry can be washed by rotating the drum to repeatedly raise and lower the laundry. A front-loading washing machine may include a washing machine capable of drying laundry contained inside the drum. The washing machine capable of drying may include a hot air supply device for supplying high-temperature air into the drum and a condensation device for removing moisture from the air discharged from the drum. As an example, the washing machine capable of drying may include a heat pump device. Washing machines according to various embodiments may include washing machines with washing methods other than those described above.

[0038] A washing machine according to various embodiments may include a housing that accommodates various components inside. The housing may be provided in the form of a box with a laundry input opening formed on one side.

[0039] The washing machine may include a door for opening and closing a laundry input. The door may be rotatably mounted to the housing by means of a hinge. At least a portion of the door may be made transparent or translucent so that the interior of the housing is visible.

[0040] The washing machine may include a tub provided inside the housing to store water. The tub is provided in a roughly cylindrical shape with a tub opening formed on one side, and may be positioned inside the housing such that the tub opening corresponds to the laundry inlet.

[0041] The tub can be connected to the housing by a damper. The damper can absorb vibrations generated during the rotation of the drum and attenuate vibrations transmitted to the housing.

[0042] The washing machine may include a drum designed to accommodate laundry.

[0043] The drum may be positioned inside the tub such that a drum opening provided on one side corresponds to a laundry inlet and a tub opening. Laundry may pass through the laundry inlet, the tub opening, and the drum opening in sequence to be received inside the drum or withdrawn from the drum.

[0044] The drum can rotate inside the tub and perform respective actions according to the washing, rinsing, and / or spin-drying cycles. A number of holes are formed in the cylindrical wall of the drum so that water stored in the tub can flow into the interior of the drum or out of the exterior of the drum.

[0045] The washing machine may include a drive unit configured to rotate the drum. The drive unit may include a drive motor and a rotating shaft for transmitting the driving force generated by the drive motor to the drum. The rotating shaft may pass through the tub and be connected to the drum.

[0046] The drive unit can rotate the drum in the forward or reverse direction to perform each operation according to the washing, rinsing, and / or spin-drying or drying cycles.

[0047] The washing machine may include a water supply device configured to supply water to the tub. The water supply device may include a water supply pipe and a water supply valve provided in the water supply pipe. The water supply pipe may be connected to an external water source. The water supply pipe may extend from the external water source to a detergent dispenser and / or the tub. Water may be supplied to the tub through the detergent dispenser. Water may be supplied to the tub without passing through the detergent dispenser.

[0048] The water supply valve can open or close the water supply pipe in response to an electrical signal from the control unit. The water supply valve can allow or block the supply of water from an external water source to the tub. The water supply valve may include, for example, a solenoid valve that opens and closes in response to an electrical signal.

[0049] The washing machine may include a detergent dispenser configured to supply detergent to the tub. The detergent dispenser may include a manual detergent dispenser in which the user must add the detergent to be used for each wash cycle, and an automatic detergent dispenser that stores a large amount of detergent and automatically dispenses a predetermined amount during a wash cycle. The detergent dispenser may include a detergent container for storing detergent. The detergent dispenser may be configured to supply detergent into the tub during the water supply process. Water supplied through the water supply pipe may be mixed with the detergent by passing through the detergent dispenser. The water mixed with the detergent may be supplied into the tub. The term "detergent" is used as a collective term for pre-wash detergent, main wash detergent, fabric softener, bleach, etc., and the detergent container may be divided into a pre-wash detergent storage area, a main wash detergent storage area, a fabric softener storage area, and a bleach storage area.

[0050] The washing machine may include a drainage device configured to discharge water contained in a tub to the outside. The drainage device may include a drain pipe extending from the bottom of the tub to the outside of the housing, a drain valve provided in the drain pipe to open and close the drain pipe, and a pump provided on the drain pipe. The pump may pump water from the drain pipe to the outside of the housing.

[0051] The washing machine may include a control panel disposed on one side of the housing. The control panel may provide a user interface for the user to interact with the washing machine. The user interface may include at least one input interface and at least one output interface.

[0052] At least one input interface can convert sensory information received from a user into an electrical signal.

[0053] At least one input interface may include a power button, an operation button, a course selection dial (or course selection button), and a wash / rinse / spin setting button. At least one input interface may include, for example, a tact switch, a push switch, a slide switch, a toggle switch, a micro switch, a touch switch, a touch pad, a touch screen, a jog dial, and / or a microphone.

[0054] At least one output interface can visually or audibly convey information related to the operation of the washing machine to the user.

[0055] For example, at least one output interface can convey information to the user regarding the washing course, the washing machine's operating time, and washing settings, rinse settings, and spin settings. Information regarding the operation of the washing machine may be output via a screen, indicator, voice, etc. At least one output interface may include, for example, a Liquid Crystal Display (LCD) panel, a Light Emitting Diode (LED) panel, a speaker, etc.

[0056] The washing machine may include a communication module for communicating with an external device via wired and / or wireless means.

[0057] The communication module may include at least one of a short-range communication module or a long-range communication module.

[0058] The communication module can transmit data to external devices (e.g., servers, user devices, and / or home appliances) or receive data from external devices. For example, the communication module can establish communication with servers and / or user devices and / or home appliances and transmit and receive various types of data.

[0059] To this end, the communication module may support the establishment of a direct (e.g., wired) or wireless communication channel between external devices, and the performance of communication through the established communication channel. According to one embodiment, the communication module may include a wireless communication module (e.g., a cellular communication module, a short-range wireless communication module, or a GNSS (global navigation satellite system) communication module) or a wired communication module (e.g., a LAN (local area network) communication module, or a power line communication module). The corresponding communication module among these communication modules may communicate with an external device through a first network (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a long-range communication network such as a computer network (e.g., a LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips).

[0060] A short-range wireless communication module may include, but is not limited to, Bluetooth communication modules, BLE (Bluetooth Low Energy) communication modules, Near Field Communication modules, WLAN (Wi-Fi) communication modules, Zigbee communication modules, infrared (IrDA, infrared Data Association) communication modules, WFD (Wi-Fi Direct) communication modules, UWB (ultrawideband) communication modules, Ant+ communication modules, microwave (uWave) communication modules, etc.

[0061] The remote communication module may include a communication module that performs various types of remote communication and may include a mobile communication unit. The mobile communication unit transmits and receives wireless signals with at least one of a base station, an external terminal, and a server on a mobile communication network.

[0062] In one embodiment, the communication module can communicate with external devices, such as a server, a user device, or other home appliances, through a nearby access point (AP). The access point (AP) can connect a local area network (LAN) to which the washing machine or user device is connected to a wide area network (WAN) to which the server is connected. The washing machine or user device can be connected to the server through the wide area network (WAN). The control unit can control various components of the washing machine (e.g., drive motor, water supply valve). The control unit can control various components of the washing machine to perform at least one operation, including water supply, washing, rinsing, and / or spin-drying, according to user input. For example, the control unit can control the drive motor to adjust the rotation speed of the drum or control the water supply valve of the water supply device to supply water to the tub.

[0063] The control unit may include hardware such as a CPU or memory, and software such as a control program. For example, the control unit may include an algorithm for controlling the operation of components within the washing machine, at least one memory for storing data in the form of a program, and at least one processor for performing the aforementioned operation using data stored in at least one memory. The memory and the processor may each be implemented as separate chips. The processor may include one or more processor chips or one or more processing cores. The memory may include one or more memory chips or one or more memory blocks. Additionally, the memory and the processor may be implemented as a single chip.

[0064] FIG. 1 is a drawing for explaining the appearance of a washing machine (100) according to the present disclosure.

[0065] Referring to FIG. 1, the washing machine (100) may include a housing (10) that accommodates various components inside. The housing (10) may be provided in the form of a box with a laundry input opening formed on one side.

[0066] The washing machine (100) may include a door (11) for opening and closing a laundry input opening. The door (11) may be rotatably mounted to the housing (10) by a hinge. At least a portion of the door (11) may be made transparent or translucent so that the interior of the housing (10) is visible.

[0067] The washing machine (100) may include a tub (20) provided inside the housing (10) to store water. The tub (20) may be provided in a roughly cylindrical shape with a tub opening formed on one side, and may be placed inside the housing (10) such that the tub opening corresponds to a laundry inlet.

[0068] The tub (20) can be connected to the housing (10) by a damper. The damper can absorb vibrations generated when the drum (30) rotates and attenuate vibrations transmitted to the housing (10).

[0069] A washing machine (100) may include a drum (30) provided to accommodate laundry. The drum (30) may be positioned inside a tub (20) such that a drum opening provided on one side corresponds to a laundry inlet and a tub opening. Laundry may pass through the laundry inlet, the tub opening, and the drum opening in sequence to be accommodated inside the drum (30) or withdrawn from the drum (30).

[0070] The drum (30) can rotate inside the tub and perform each operation according to washing, rinsing, and / or spin-drying cycles. A plurality of through holes are formed in the cylindrical wall of the drum (30) so that water stored in the tub (20) can flow into the interior of the drum (30) or flow out of the drum (30).

[0071] The washing machine (100) may include a drive unit (135) configured to rotate the drum (30). The drive unit (135) can rotate the drum (30) in the forward or reverse direction to perform each operation according to washing, rinsing, and / or spin-drying, or drying cycles.

[0072] For example, when the drum (30) is rotated by the drive unit (135), dirt on the laundry placed inside the drum (30) can be removed from the laundry during the process of friction with the water stored in the tub (20). According to one example, the drive unit (135) may include a drive motor (136) and a rotating shaft for transmitting the driving force generated by the drive motor (13) to the drum (30). The rotating shaft may pass through the tub (20) and be connected to the drum (30). The drive motor (136) is provided on the rear of the tub (20) and can generate rotational force and provide it to the drum (30).

[0073] The washing machine (100) may include a water supply device (130) configured to supply water to a tub (20).

[0074] The water supply device (130) can supply water supplied from an external water source to the tub (20). For example, the water supply device (130) may include a water pipe connected to an external water source. The water pipe may extend from the external water source to the detergent supply device (50).

[0075] The detergent dispensing device (50) may include a manual detergent dispensing device in which the user must dispense the detergent to be used each time laundry is done, and an automatic detergent dispensing device that stores a large amount of detergent and automatically dispenses a predetermined amount of detergent during laundry. The detergent dispensing device (50) may include a detergent container for storing detergent.

[0076] The detergent supply device (50) may be configured to supply detergent into the tub (20) during the water supply process. Water mixed with detergent may be supplied into the tub (20). The term detergent is used to encompass pre-wash detergent, main wash detergent, fabric softener, bleach, etc., and the detergent container may be divided into a pre-wash detergent storage area, a main wash detergent storage area, a fabric softener storage area, and a bleach storage area.

[0077] The washing machine (100) may include a drainage device (125) configured to discharge water contained in a tub (20) to the outside. The drainage device (125) may include a drain pipe extending from the bottom of the tub (20) to the outside of the housing (10), a drain valve provided in the drain pipe to open and close the drain pipe, and a drain pump provided on the drain pipe.

[0078] For example, the drain pipe can supply water used for cleaning to the tub (20) and guide it to the pump room. The pump room is provided with a drain pump, and the drain pump can pump the water stored in the pump room and discharge the water to the outside of the housing (10) through the drain pipe.

[0079] The washing machine (100) may include a control panel (60) disposed on one side of the housing. The control panel (60) may provide a user interface for the user to interact with the washing machine. The user interface may include at least one input interface (145) and at least one output interface (150).

[0080] At least one input interface (145) may include a power button, an operation button, a course selection dial (or course selection button), and a wash / rinse / spin setting button. At least one input interface (145) may include, for example, a tact switch, a push switch, a slide switch, a toggle switch, a micro switch, a touch switch, a touch pad, a touch screen, a jog dial, and / or a microphone.

[0081] At least one output interface (150) can visually or audibly convey information related to the operation of the washing machine (100) to the user.

[0082] For example, at least one output interface (150) can transmit information to the user regarding the washing course, the operating time of the washing machine, and washing settings / rinse settings / spin settings. Information regarding the operation of the washing machine can be output via a screen, an indicator, voice, etc. At least one output interface (190) may include, for example, a Liquid Crystal Display (LCD) panel, a Light Emitting Diode (LED) panel, a speaker, etc.

[0083] The control unit may include hardware such as a CPU or memory, and software such as a control program. For example, the control unit may include an algorithm for controlling the operation of components within the washing machine (100), at least one memory (110) for storing data in the form of a program, and at least one processor (120) for performing the aforementioned operation using data stored in at least one memory. The memory and the processor may each be implemented as separate chips. The processor may include one or more processor chips or one or more processing cores. The memory may include one or more memory chips or one or more memory blocks. Additionally, the memory and the processor may be implemented as a single chip.

[0084] If the washing machine (100) is a washing machine that also serves as a dryer, the washing machine (100) can perform drying of the laundry after performing washing and rinsing.

[0085] Specifically, the washing machine (100) can control the drive motor (136) to an ON state when the drying process starts. The ON state may mean a state in which a preset drive voltage is supplied to the drive motor (136).

[0086] Additionally, the washing machine (100) can provide hot air to the drum (30) using a hot air supply device (137). The hot air supply device may be described as a heater.

[0087] Additionally, the washing machine (100) may be equipped with a blower fan (40) to generate a flow of hot air. By operating a drive motor that simultaneously drives the drum (30) and the blower fan (40), the hot air circulates through the drum (30) and the airflow path, thereby drying the laundry.

[0088] The washing machine (100) can obtain an image of the laundry by photographing the laundry being fed into the drum through the laundry input port using a camera. Additionally, when the door (11) is closed, the washing machine (100) can identify the possibility of foreign matter being present in the drum (30) by using the time the door remained open until it was closed, the weight of the laundry, and information about the laundry identified from the acquired image. In the present disclosure, the foreign matter may be trash or objects that are not subject to washing. For example, the foreign matter may include tissue paper, paper, USB, card, etc.

[0089] The washing machine (100) can perform a foreign substance detection operation if it identifies that there is a possibility that foreign substances exist in the drum (30). Specific details regarding this will be described later.

[0090] FIG. 2 is a drawing for explaining the configuration of a washing machine according to at least one embodiment of the present disclosure.

[0091] A washing machine (100) according to the present disclosure (100) may include a camera (105), a memory (110), a weight sensor (115), and at least one processor (120).

[0092] The camera (105) is configured to photograph laundry. The camera (105) may be attached to the inside of the door (110) of the washing machine (100) and near the space where the hot air supply device (137) is located. The location where the camera (105) is attached is not limited to this and may be attached to various spaces. Additionally, two or more cameras (105) may be attached. The camera (105) can photograph laundry placed inside the drum based on the control of the processor (120).

[0093] The memory (110) may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a non-volatile memory including at least one of ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, a magnetic disk, and an optical disk, and a volatile memory such as RAM (Random Access Memory) or SRAM (Static Random Access Memory).

[0094] Specifically, various software modules for operating a washing machine (100) according to various embodiments of the present disclosure may be stored in the memory (110), and at least one processor (120) may control the operation of the washing machine (100) by executing the various software modules stored in the memory (110). That is, the memory (110) is accessed by at least one processor (120), and reading / writing / modifying / deleting / updating of data by at least one processor (120) may be performed.

[0095] Meanwhile, in the present disclosure, the term memory (120) may be used to include memory (110), ROM, RAM, or a memory card (e.g., micro SD card, memory stick) mounted in the washing machine (100) within at least one processor (120).

[0096] In addition, various information necessary within the scope of achieving the purpose of the present disclosure may be stored in the memory (110), and the information stored in the memory (110) may be updated as it is received from an external device or input by a user.

[0097] A weight sensor (115) may be used to detect the weight of laundry contained in a drum (30). The weight sensor (115) may be attached to the drum (30) to measure the weight of the laundry present in the drum (30). However, the method of measuring the weight of the laundry is not limited to using a weight sensor (115) and may also use a Hall sensor. If the sensor (110) is a Hall sensor, the washing machine (100) may operate a drive motor (136) to rotate the drum. At least one processor (120) may detect a change in current or voltage occurring during the rotation of the motor to estimate the weight loaded in the drum.

[0098] Specifically, the heavier the weight of the laundry contained in the drum (30), the greater the magnitude of the current or voltage applied to the drive motor (136). At least one processor (120) can identify the difference in the current or voltage applied to the drive motor (136) as the drum rotates, and identify the weight corresponding to the difference in current or voltage as the weight of the laundry present in the drum.

[0099] The processor (120) can control the overall operation of the washing machine (100). Specifically, the processor (120) can control the overall operation of the washing machine (100) by being connected to each component of the washing machine (100). For example, the processor (120) can control the operation of the washing machine (100) by being electrically connected to the weight sensor (115) and the memory (110). The processor (120) may include one or more of a CPU (Central Processing Unit), GPU (Graphics Processing Unit), APU (Accelerated Processing Unit), MIC (Many Integrated Core), DSP (Digital Signal Processor), NPU (Neural Processing Unit), hardware accelerator, or machine learning accelerator. The processor (120) can control one or any combination of other components of the washing machine (100) and can perform operations or data processing related to communication. The processor (120) can execute one or more programs or instructions stored in the memory of the washing machine (100) (e.g., 110 in FIG. 2). For example, the processor (120) can perform a method according to one embodiment of the present disclosure by executing one or more instructions stored in the memory (110).

[0100] When a method according to one embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by a single processor or by a plurality of processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to one embodiment, the first operation, the second operation, and the third operation may all be performed by a first processor, or the first operation and the second operation may be performed by a first processor (e.g., a general-purpose processor) and the third operation may be performed by a second processor (e.g., an artificial intelligence dedicated processor).

[0101] The processor (120) may be implemented as a single-core processor including one core, or as one or more multicore processors including multiple cores (e.g., homogeneous multicore or heterogeneous multicore). When at least one processor (130) is implemented as a multicore processor, each of the multiple cores included in the multicore processor may include internal processor memory such as cache memory or on-chip memory, and a common cache shared by multiple cores may be included in the multicore processor. Additionally, each of the multiple cores included in the multicore processor (or some of the multiple cores) may independently read and execute program instructions for implementing a method according to one embodiment of the present disclosure, or all (or some) of the multiple cores may be linked together to read and execute program instructions for implementing a method according to one embodiment of the present disclosure.

[0102] When a method according to one embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one of the plurality of cores included in a multi-core processor, or may be performed by a plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to one embodiment, the first operation, the second operation, and the third operation may all be performed by a first core included in a multi-core processor, or the first operation and the second operation may be performed by a first core included in a multi-core processor and the third operation may be performed by a second core included in a multi-core processor.

[0103] In the embodiments of the present disclosure, a processor may mean a system-on-chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, GPU, APU, MIC, DSP, NPU, hardware accelerator, or machine learning accelerator, but the embodiments of the present disclosure are not limited thereto.

[0104] FIG. 3 is a block diagram for explaining the detailed configuration of a washing machine (100) according to an embodiment of the present disclosure.

[0105] Referring to FIG. 3, the washing machine (100) may include a camera (105), a memory (110), a weight sensor (115), a drainage device (125), a water supply device (130), a drive unit (135), a drive motor (136), a hot air supply device (137), a drum (30), a blower fan (40), a detergent supply device (50), a moisture discharge unit (60), a communication interface (140), an input interface (145), and an output interface (150).

[0106] However, such configurations are exemplary, and it is understood that in carrying out the present disclosure, new configurations may be added or some configurations may be omitted in addition to such configurations. Meanwhile, detailed descriptions of configurations shown in FIG. 3 that overlap with configurations shown in FIG. 1 and FIG. 2 will be omitted.

[0107] The drive unit (135) can drive the drive motor (136) based on a drive control signal generated by the processor (120).

[0108] The drive motor (136) receives power to generate driving force, and the drive motor (136) can transmit the generated driving force to the drum (30) and the blower fan (40).

[0109] The drum (30) may refer to a drying container that accommodates a drying object. The drum (30) may be rotated by the driving force generated by the driving motor (136).

[0110] The blower fan (40) may refer to a fan that circulates high-temperature air supplied to the drum of the washing machine (100). Specifically, the blower fan (40) may rotate to circulate the air inside the drum supplied with a heat source by receiving a drive control signal generated by the processor (130).

[0111] The driving unit (160) can drive the hot air supply device (137) to supply a heat source to the drum by receiving a driving control signal generated by the processor (130).

[0112] The hot air supply device (137) can supply a heat source to the drum (30).

[0113] The hot air supply device (137) may include a heater that emits heat inside.

[0114] Additionally, the hot air supply device (137) may be implemented using a gas-type heat source supply method or an electric-type heat source supply method. The gas-type method may refer to a method of heating air using gas. The electric-type method may refer to a method of heating air using electricity. The electric-type method may be a method using at least one of a hot air supply device or a heat pump. The hot air supply device may be a method of supplying a heat source using a heating wire, etc. The heat pump may be a method of supplying a heat source using a refrigerant. The heat pump may be composed of an evaporator, a compressor, and a condenser. Specifically, the evaporator may evaporate the refrigerant in a liquid state into a gaseous state. Then, the refrigerant in a gaseous state may be transferred to the compressor. The compressor may compress the refrigerant to a high temperature and high pressure state. Then, the compressed refrigerant may be transferred to the condenser. The condenser may perform a heat exchange operation from the compressed refrigerant to extract heat, and may heat and discharge high-temperature air using the extracted heat. The discharged high-temperature air may be supplied to the drum (30) of the washing machine (100). The refrigerant, having had heat removed by the condenser, can be transferred to the evaporator and circulated.

[0115] The moisture discharge unit (60) can discharge moisture from inside the washing machine (100). Depending on the moisture discharge method, the washing machine (100) may be of a vent type (hot air exhaust method) or a condensing type (hot air dehumidification method). The vent type may be a method of discharging moisture and dust to the outside of the washing machine (100). The condensing type can filter dust through a filter and convert moisture into condensate by passing it through a condenser (heat exchanger). The condensate may be discharged to the outside of the washing machine (100) or stored in the inner drum of the washing machine (100).

[0116] The communication interface (140) can perform data communication with an electronic device under the control of the processor (120). The electronic device may include a server, a home appliance, a mobile device (e.g., a smartphone, a tablet PC, a wearable device, etc.).

[0117] For example, the communication interface (140) may include a communication circuit capable of performing data communication between a washer dryer (100) and an electronic device using at least one of a data communication method including wired LAN, wireless LAN, Wi-Fi, Wi-Fi Direct, Bluetooth, ZigBee, WFD (Wi-Fi Direct), infrared communication (IrDA, infrared Data Association), BLE (Bluetooth Low Energy), NFC (Near Field Communication), Wibro (Wireless Broadband Internet), WiMAX (World Interoperability for Microwave Access), SWAP (Shared Wireless Access Protocol), WiGig (Wireless Gigabit Alliances, WiGig) and RF communication.

[0118] The input interface (145) includes circuitry. The input interface (180) receives user input and can transmit the user input to the processor (120). For example, the input interface (145) can receive various user inputs for setting or selecting various functions supported by the washing machine (100).

[0119] The input interface (145) may include various types of input devices.

[0120] According to one example, the input interface (145) may include a physical button. The physical button may include a function key or a dial button. The physical button may be implemented as one or more keys.

[0121] According to one example, the input interface (145) can receive user input using a touch method. For example, the input interface (145) can be implemented as a touch screen capable of performing the function of a display (151).

[0122] According to one example, the input interface (145) can receive user voice using a microphone. The processor (120) can perform a function corresponding to the user voice using voice recognition. For example, the processor (120) can convert the user voice into text data using a Speech To Text (STT) function, obtain control command data based on the text data, and perform a function corresponding to the user voice based on the control command data. According to an embodiment, the STT function may be performed on an external server.

[0123] The output interface (150) may include a display (151) and a speaker (152).

[0124] The display (151) can display various screens. The processor (120) can display various notifications, messages, information, etc. related to the operation of the washing machine (100) on the display (151).

[0125] The display (151) may be implemented as a display including a self-emissive element or as a display including a non-emissive element and a backlight. For example, the display (151) may be implemented as various types of displays such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, an LED (Light Emitting Diodes) display, a micro LED display, a Mini LED display, a QLED (Quantum dot light-emitting diodes) display, etc.

[0126] The speaker (152) can output an audio signal. The processor (120) can output warning sounds, notification messages, response messages corresponding to user input, etc. related to the operation of the washing machine (100) through the speaker (152).

[0127] FIG. 4 is a flowchart illustrating a method for controlling a washing machine (100) according to at least one embodiment of the present disclosure. A processor (120) may perform at least one of the operations of FIG. 4. For example, when instructions stored in memory (110) are executed individually or collectively by the processor (120), the washing machine (100) may be made to perform the operations of FIG. 4.

[0128] In operation 410, the washing machine (100) can obtain at least one first image (hereinafter referred to as the first image) by photographing laundry introduced into the drum (30) through the laundry input port using a camera (105). The explanation of operation 410 is based on FIG. 5.

[0129] FIG. 5 is a drawing for explaining a method in which a washing machine according to one embodiment of the present disclosure automatically photographs laundry.

[0130] Referring to FIG. 5, the washing machine (100) can detect when laundry is put into the drum (30). Specifically, when laundry is put into the drum (30), the washing machine (100) can identify a change in the weight of the drum (30) using a weight sensor (115) attached to the drum (30). The washing machine (100) can identify that laundry is put into the drum (30) whenever the weight of the drum (30) increases.

[0131] The washing machine (100) can obtain a first image by photographing the inside of the drum (30) through a camera (105) whenever it identifies a change in the weight of the drum (30). In the present disclosure, the first image may be an image of the laundry contained in the drum (30) after the laundry is placed into the drum (30). That is, the washing machine (100) can obtain an image of the laundry placed into the drum (30) by photographing the inside of the drum (30). Thus, the washing machine (100) can obtain an image of the laundry whenever the user (1) places laundry into the drum (30).

[0132] Meanwhile, the method by which the washing machine (100) acquires an image of the laundry is not limited to this, and the washing machine (100) may receive an image of the laundry taken through a communication interface (140). For example, the washing machine (100) may receive an image of the laundry taken by a user (1) using a terminal device through the communication interface (140). Additionally, the washing machine (100) may receive an image taken by a user (1) using a terminal device from a server through the communication interface (140). The washing machine (100) may store the acquired laundry image in memory (110).

[0133] In operation 420, when the door is closed, the washing machine (100) can determine whether to execute the foreign object detection function using information obtained based on at least one of the door's open state, weight sensor, and first image.

[0134] The washing machine (100) can identify the closing of the door. For example, a locking device sensor may be attached to the door of the washing machine (100). The washing machine (100) can identify the closing of the door based on a signal transmitted by the door locking device when the door is closed. Additionally, a Hall sensor may be attached to the door of the washing machine (100). If the washing machine (100) uses a Hall sensor, it can identify the closing of the door based on the strength of the magnetic field generated when a magnet embedded in the door and the Hall sensor come close together. The method by which the washing machine (100) identifies the closing of the door is not limited to this, and the closing of the door can be identified through various methods.

[0135] The washing machine (100) can determine whether to execute the foreign object detection function when the door is closed and user input for performing washing is received. The foreign object detection function may be a function in which the washing machine (100) rotates the drum (30) to detect foreign objects. Specific details regarding the foreign object detection function will be described later.

[0136] The washing machine (100) can receive user input for performing washing through an input interface (145). For example, the washing machine (100) can receive user input through a button attached to the housing (10) of the washing machine (100). Additionally, the washing machine (100) can receive user voice for performing washing through a microphone. Additionally, the washing machine (100) can receive user input for performing washing through a communication interface (140). For example, the washing machine (100) can receive user input from a user terminal device or server through the communication interface (140).

[0137] When user input is received, the washing machine (100) can obtain information about the laundry based on at least one of the door opening state, weight sensor (115), and image of the laundry.

[0138] Specifically, the laundry information may include at least one of the weight of the laundry obtained through the weight sensor (115), the number of pockets of the laundry obtained from the first image, the time the door remained open until the door was closed, the number of laundry not recognized in the image, and the laundry capacity obtained based on the weight of the laundry.

[0139] Information on the door's open state may include the time during which the door remains open until the door is closed. The time during which the door remains open until the door is closed may be the time from when laundry is placed into the drum (30) until the time the door is closed. That is, the washing machine (100) may identify the time from when laundry is placed into the drum (30) and a change in the weight of the drum (30) is detected until the time the door is closed as the time during which the door remains open.

[0140] In addition, as described above, the washing machine (100) can obtain the weight of the laundry placed into the drum (30) using a weight sensor (115). The washing machine (100) may identify the weight of each piece of laundry whenever laundry is placed into the drum (30), and may also identify the weight after the laundry is placed into the drum (30) and the door is closed.

[0141] The washing machine (100) may identify the ratio of laundry to the washing capacity based on the weight of the laundry. The washing capacity may refer to the weight of laundry that the washing machine can wash at once. For example, if the washing capacity is 20 kg, the washing machine (100) can wash up to 20 kg of laundry at a time. In this case, if the weight of the laundry is 10 kg, the washing machine (100) may identify the ratio of laundry to the washing capacity as 50%.

[0142] The washing machine (100) can identify at least one of the number of pockets of the laundry, the material of the laundry, and the color of the laundry from the first image.

[0143] Specifically, the washing machine (100) can identify the number of pockets and the material of the laundry using an artificial intelligence model. The artificial intelligence model may be a model trained to identify the material and the presence or absence of pockets of the laundry in an image. The artificial intelligence model may be stored in memory (110).

[0144] The washing machine (100) can identify the number of pockets and the material of the laundry by inputting a first image into an artificial intelligence model. The material of the laundry may be the material of the fibers that make up each piece of laundry. For example, the material of the laundry may include cotton, polyester, denim, silk, etc. The method by which the washing machine (100) identifies the number of pockets and the material of the laundry is not limited to using an artificial intelligence model. For example, the washing machine (100) may identify the number of pockets of the laundry based on the number of pockets of the laundry entered by the user into a dedicated app. Additionally, the washing machine (100) may identify the material of the laundry based on the material of the laundry entered by the user into a dedicated app.

[0145] The washing machine (100) can classify the information obtained about the laundry for each laundry item and store it in memory (110).

[0146] Specifically, the washing machine (100) can store in memory (110) the weight of each laundry item when it is put into the drum, and the color, material, presence or absence of pockets, and number of pockets of the laundry item identified based on an image of each laundry item.

[0147] For example, referring to FIG. 6, the washing machine (100) can store information about the first laundry and the second laundry in memory (100).

[0148] The washing machine (100) can identify the weight of the first laundry when it is put into the drum (30) as 1 kg and use an artificial intelligence model to identify that the color of the first laundry is black and the material is denim. Additionally, the washing machine (100) can identify the number of pockets of the first laundry using an artificial intelligence model. For example, the number of pockets of the first laundry may be 4. Additionally, the washing machine (100) can identify the weight of the second laundry when it is put into the drum (30) as 0.3 kg and use an artificial intelligence model to identify that the color of the second laundry is gray, the material is cotton, and it has no pockets.

[0149] When user input for performing washing is received by the washing machine (100), the washing machine (100) can acquire an image by using a camera (105) to perform additional shooting of the inside of the drum (30). The image may be an image of laundry contained inside the drum (30). The washing machine (100) can use the acquired image to identify laundry that was not identified from the first image and the number of laundry items. Specifically, the washing machine (100) can use an artificial intelligence model to identify the material of the laundry included in the acquired image. The washing machine (100) can identify laundry items whose material included in the acquired image is different from the material of the laundry obtained through the first image. The washing machine (100) can identify laundry items whose material is different from the material of the laundry obtained through the first image as laundry items that were not identified from the first image.

[0150] The number of laundry items that the washing machine (100) failed to identify from the first image may be a factor that influences whether the foreign substance detection function is executed. Details regarding this will be described later.

[0151] The washing machine (100) can identify a score for executing a foreign substance detection function based on the acquired information.

[0152] Specifically, information for calculating scores for each of the following may be stored in memory (110): the weight of the laundry, the presence or absence of pockets in the laundry, the time the door remains open, the number of unrecognized laundry items, and the ratio of the laundry capacity to the maximum laundry capacity. Each score may be set at the time of manufacturing or initial use of the washing machine (100), or may be set and changed by user input.

[0153] For example, the heavier the weight of the laundry, the higher the score may be. Additionally, the score for laundry with pockets may be higher than the score for laundry without pockets. The washing machine (100) can identify the score of the laundry based on the total weight of the laundry and the presence or absence of pockets of the laundry loaded into the drum (30). For example, if a pocket is identified in at least one of the laundry items among all the laundry items loaded into the drum (30), the washing machine (100) can identify the score for executing the foreign object detection function as the first score. On the other hand, if a pocket is not identified in all the laundry items loaded into the drum (30), the washing machine (100) can identify the score for executing the foreign object detection function as the second score.

[0154] Additionally, the washing machine (100) can identify the score for executing the foreign substance detection function as the third score if the weight of the laundry is less than a preset first value. The washing machine (100) can identify the score for executing the foreign substance detection function as the fourth score if the weight of the laundry is greater than or equal to a preset first value and less than a second value. The washing machine (100) can identify the score for executing the foreign substance detection function as the fifth score if the weight of the laundry is greater than or equal to a preset second value. The third score may be lower than the fourth score, and the fourth score may be lower than the fifth score.

[0155] In the example described above, it was explained that a score for the laundry is calculated based on the weight of the laundry and the presence or absence of a pocket, but the present disclosure is not limited thereto. For example, the washing machine (100) may calculate a score by additionally considering conditions regarding external variables in which there is a possibility that foreign substances may be contained in the drum (30), in addition to conditions regarding the laundry (e.g., weight of the laundry and presence or absence of a pocket).

[0156] For example, the washing machine (100) can identify a score based on at least one of the time the door is kept open, the number of unrecognized laundry items, and the ratio of the laundry capacity to the maximum laundry capacity. For example, the washing machine (100) can identify a value obtained by adding a score for conditions regarding external variables to a score identified based on the weight of the laundry and the presence or absence of pockets, if the time the door is kept open is longer than a preset time, the number of unrecognized laundry items is longer than a preset number, or the laundry accounts for a preset ratio of the laundry capacity (e.g., 90%).

[0157] For example, the washing machine (100) can identify the score for executing the foreign object detection function as the 6th score if the time the door remains open is longer than a preset time. The washing machine (100) can identify the score for executing the foreign object detection function as the 7th score if the number of unrecognized laundry items is longer than a preset number (e.g., 3 items). Additionally, the washing machine (100) can identify the score for executing the foreign object detection function as the 8th score if the laundry items are longer than a preset ratio of the washing capacity.

[0158] The washing machine (100) can identify a score based on acquired information, and if the sum of the scores is greater than or equal to a preset value, it can identify that a foreign substance detection operation is executed.

[0159] On the other hand, the washing machine (100) can identify that the foreign substance detection function is not executed if the sum of the scores is less than a preset value. In the example described below, the preset value is assumed to be 2 points.

[0160] For example, referring to FIG. 7, the washing machine (100) can identify that the score is 1 point if the weight of the laundry is less than 1 kg and there is a pocket. The washing machine (100) can identify that the score for executing the foreign object detection function is 0 points if the weight of the laundry is less than 1 kg and there is no pocket.

[0161] Additionally, the washing machine (100) can identify that if the weight of the laundry is 1 kg or more and less than 5 kg and there is a pocket, the score for executing the foreign object detection function is 2 points. The washing machine (100) can identify that if the weight of the laundry is 1 kg or more and less than 5 kg and there is no pocket, the score for executing the foreign object detection function is 1 point.

[0162] In addition, the washing machine (100) can identify that if the weight of the laundry exceeds 5 kg and there is a pocket, the score for executing the foreign object detection function is 4 points.

[0163] The washing machine (100) can identify that the foreign object detection function is executed when the laundry is 1 kg or more and less than 5 kg and has pockets, and when the weight of the laundry is 2 kg or more, the identified score is 2 points or more, which is a preset value.

[0164] On the other hand, the washing machine (100) can identify that the foreign object detection function is not executed when the laundry is less than 1 kg, or when the laundry is 1 kg or more and less than 5 kg and there are no pockets, because the identified score is less than 2 points, which is a preset value.

[0165] However, even if the score of the laundry is less than a preset value, if it is identified that the score is greater than or equal to the preset value by satisfying additional point conditions, the washing machine (100) can identify that it is executing a foreign object detection function. For example, if the laundry weighs 1 kg or less, has pockets, and the washing machine door has been open for a preset time (e.g., 10 minutes) or longer, the washing machine (100) can identify the score for executing the foreign object detection function as 2 points. In this case, the washing machine (100) can identify that the score is greater than or equal to the preset value and can identify that it is executing a foreign object detection function.

[0166] In operation 430-N, 460, if the washing machine (100) identifies that it is not performing a foreign object detection function, it can perform a washing operation. If the washing machine (100) identifies that there are no foreign objects in the drum (30) when the score of the laundry is less than or equal to a preset value, it can perform water supply and detergent dispensing.

[0167] On the other hand, if the washing machine (100) is identified as performing a foreign object detection function in operation 430-Y, 440, the drum (30) can be rotated and the inside of the drum can be photographed to obtain at least one second image (hereinafter referred to as the second image).

[0168] FIG. 8 is a drawing for explaining a method of detecting foreign substances using the rotation of a drum (30) according to one embodiment of the present disclosure.

[0169] Referring to 810 in FIG. 8, foreign matter may be present between the laundry before the drum (30) rotates. If foreign matter is present between the laundry, the washing machine (100) may have difficulty detecting the foreign matter through the camera (105).

[0170] Referring to 820 in FIG. 8, the washing machine (100) can rotate the drum (30) to move foreign substances present between the laundry items out of the laundry. While the drum (30) is rotating, the washing machine (100) can use a camera (105) to obtain an image of the laundry items placed inside the drum (30).

[0171] The washing machine (100) can identify the rotation time of the drum (30) based on the number of pockets of laundry and rotate the drum (30) based on the rotation time. At this time, the more pockets there are, the longer the rotation time of the drum (30) can be.

[0172] Specifically, the washing machine (100) can identify that the rotation time of the drum (30) is the first time if the number of laundry bags is less than or equal to the first number. The washing machine (100) can identify that the rotation time of the drum (30) is the second time, which is greater than the first time, if the number of laundry bags is greater than the first number and less than or equal to the second number. Additionally, the washing machine (100) can identify that the rotation time of the drum (30) is the third time, which is greater than the second time, if the number of laundry bags is greater than the second number and less than or equal to the third number.

[0173] For example, referring to FIG. 9, the washing machine (100) can rotate the drum (30) for 2 minutes when there are 4 or fewer pockets. Also, the washing machine (100) can rotate the drum (30) for 2 minutes and 30 seconds when there are more than 4 pockets and 8 or fewer pockets. Also, the washing machine (100) can rotate the drum (30) for 3 minutes when there are more than 8 pockets.

[0174] The washing machine (100) identifies a cycle for acquiring a second image using a camera (105) based on the weight of the laundry, and can acquire a second image based on the cycle while the drum (30) is rotating. At this time, the heavier the weight of the laundry, the longer the cycle for acquiring the second image may be. When the cycle is reached, the washing machine (100) can acquire an image of the laundry inside the drum (30) using the camera (105).

[0175] Specifically, the washing machine (100) can identify that if the weight of the laundry is less than or equal to a first weight, the cycle for acquiring the second image is the first cycle. The washing machine (100) can identify that if the weight of the laundry is greater than the first weight and less than or equal to a second weight, the cycle is the second cycle, which is longer than the first cycle. Additionally, the washing machine (100) can identify that if the weight of the laundry is greater than the second weight and less than or equal to a third weight, the cycle is the third cycle, which is longer than the second cycle.

[0176] For example, referring to FIG. 9, the washing machine (100) can acquire a second image every 30 seconds if the weight of the laundry is less than 1 kg. Additionally, the washing machine (100) can acquire a second image every 45 seconds if the weight of the laundry is 1 kg or more and less than 5 kg. The washing machine (100) can acquire a second image every 60 seconds if the weight of the laundry is 5 kg or more.

[0177] In addition, when the washing machine (100) rotates the drum (30), it can supply hot air into the drum (30) using a hot air supply device (137) to move foreign substances out of the laundry.

[0178] Specifically, the washing machine (100) can stop the rotation of the drum (30) when the rotation time of the drum (30) is less than or equal to a preset time and the identified rotation time has elapsed since the drum (30) started rotating.

[0179] The washing machine (100) can supply hot air into the drum (30) while the drum (30) is rotating when the rotation time of the drum (30) is greater than the preset time and the preset time has elapsed since the drum (30) started rotating. Additionally, the washing machine (100) can stop the rotation of the drum (30) and the supply of hot air when the rotation time has elapsed since the drum (30) started rotating.

[0180] For example, the preset time may be set at the time of manufacturing or initial use of the washing machine (100), or may be set and changed by user input. For example, the preset time may be 2 minutes. If the rotation time of the drum (30) is 2 minutes and 30 seconds, the washing machine (100) may supply hot air to the drum (30) from the point when 2 minutes have elapsed since the drum (30) started rotating. On the other hand, if the rotation time of the drum (30) is 2 minutes, it is shorter than the preset time. Therefore, the washing machine (100) may not supply hot air to the drum (30), and when the rotation time has elapsed, it may terminate the rotation of the drum (30) and the supply of hot air.

[0181] In operation 450, the washing machine (100) can identify whether there is foreign matter inside the drum (30) based on the second image.

[0182] The washing machine (100) can identify whether there is foreign matter inside the drum (30) whenever it acquires a second image. That is, the washing machine (100) can identify whether there is foreign matter in the drum (30) at the same frequency as the frequency of acquiring the aforementioned second image.

[0183] The washing machine (100) can identify foreign substances in the second image based on the color and material of the laundry among the information of the laundry.

[0184] Specifically, the washing machine (100) can identify the material and color of an object included in the second image using an artificial intelligence model. The object may include not only laundry but also foreign substances. The washing machine (100) can compare the material and color of the object identified in the first image and the second image, respectively. The washing machine (100) can identify an object in the second image that has a color and material different from the color and material of the laundry in the first image.

[0185] Additionally, the type of fabric may be stored in memory (110). The washing machine (100) can identify whether an object identified from a second image is composed of fabric based on the stored type of fabric. If the material of the identified object does not correspond to any of the stored types of fabric, the washing machine (100) can identify the identified object as not being composed of fabric. Additionally, if the washing machine (100) identifies the identified object as having a size smaller than a laundry bag and identifies it as not being composed of fabric, the washing machine (100) can identify the identified object as a foreign substance.

[0186] If foreign matter is detected within the rotation time of the drum (30), the washing machine (100) may stop the rotation of the drum (30) and provide a notification indicating that there is foreign matter.

[0187] Specifically, the washing machine (100) can display a notification on the display (151) indicating that there is foreign matter. Additionally, the washing machine (100) may transmit the notification to a user terminal device or server via a communication interface (140).

[0188] If the washing machine (100) does not detect foreign matter until the rotation time of the drum (30) ends, it can identify that there is no foreign matter in the drum (30).

[0189] When the washing machine (100) identifies that there is no foreign matter inside the drum (30) based on the execution of the foreign matter detection function, it can terminate the foreign matter detection function and perform a washing operation on the laundry.

[0190] Through the aforementioned operation, the user can detect the presence of foreign matter before the washing machine performs washing, and by removing the foreign matter before washing, the user can increase washing efficiency and prevent the washing machine from malfunctioning.

[0191] The artificial intelligence-related functions according to the present disclosure can be operated through a processor (120) and a memory (110).

[0192] The processor (120) may be composed of one or more processors. In this case, the one or more processors may be a general-purpose processor such as a CPU, AP, DSP, etc., a graphics-dedicated processor such as a GPU, VPU (Vision Processing Unit), or an artificial intelligence-dedicated processor such as an NPU.

[0193] One or more processors control the processing of input data according to predefined operation rules or artificial intelligence models stored in memory (110). Alternatively, if one or more processors are dedicated artificial intelligence processors, the dedicated artificial intelligence processors may be designed with a hardware structure specialized for processing a specific artificial intelligence model. The predefined operation rules or artificial intelligence models are characterized by being created through learning.

[0194] Here, "created through learning" means that a basic artificial intelligence model is trained using multiple learning data by a learning algorithm, thereby creating a predefined rule of operation or an artificial intelligence model configured to perform a desired characteristic (or objective). Such learning may be performed on the device itself where the artificial intelligence according to the present disclosure is executed, or it may be performed through a separate server and / or system. Examples of learning algorithms include, but are not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning.

[0195] An artificial intelligence model can be composed of multiple neural network layers. Each of the multiple neural network layers has multiple weight values ​​and performs neural network operations through calculations between the results of previous layers and the multiple weights. The multiple weights possessed by the multiple neural network layers can be optimized based on the learning results of the artificial intelligence model. For example, the multiple weights can be updated during the learning process so that the loss or cost values ​​obtained by the artificial intelligence model are reduced or minimized.

[0196] Artificial neural networks may include deep neural networks (DNNs), such as, but are not limited to, Convolutional Neural Networks (CNNs), Deep Neural Networks (DNNs), Recurrent Neural Networks (RNNs), Restricted Boltzmann Machines (RBMs), Deep Belief Networks (DBNs), Bidirectional Recurrent Deep Neural Networks (BRDNNs), Generative Adversarial Networks (GANs), or Deep Q-Networks.

[0197] Meanwhile, various embodiments of the present disclosure may be implemented in a recording medium readable by a computer or a similar device using software, hardware, or a combination thereof. In some cases, the embodiments described herein may be implemented as the processor itself. According to software implementation, embodiments such as the procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein.

[0198] Meanwhile, computer instructions for performing processing operations of a washing machine (100) according to various embodiments of the present disclosure described above may be stored in a non-transitory computer-readable medium. When computer instructions stored in such a non-transitory computer-readable medium are executed by a processor of a specific device, they cause the specific device to perform processing operations in a washing dryer (100) according to various embodiments described above.

[0199] A non-transient computer-readable medium refers to a medium that stores data semi-permanently and can be read by a device, unlike media that store data for a short period of time such as registers, caches, and memory. Specific examples of non-transient computer-readable media include CDs, DVDs, hard disks, Blu-ray discs, USBs, memory cards, and ROMs.

[0200] Although the present invention has been described above with reference to the attached drawings, the scope of the present invention is determined by the claims set forth below and should not be interpreted as being limited to the aforementioned embodiments and / or drawings. Furthermore, it should be clearly understood that improvements, changes, and modifications to the invention described in the claims that are obvious to those skilled in the art are also included within the scope of the present invention.

Claims

1. In a washing machine including a drum, camera; A weight sensor for detecting the weight of laundry contained in the drum; Memory for storing instructions; and at least one processor including processing circuitry; and When the above instructions are executed individually or collectively by the at least one processor, the washing machine, While the door for opening and closing the laundry input port is open, laundry being fed into the drum through the laundry input port is photographed through the camera to obtain at least one first image, and A washing machine that, when the door is closed, determines whether to execute a foreign substance detection function to identify whether there is a foreign substance in the drum using information obtained based on at least one of the state at the time the door was open, the weight sensor, and at least one first image.

2. In Paragraph 1, The above information is, A washing machine comprising at least one of the following: the weight of the laundry obtained through the weight sensor, the number of pockets of the laundry obtained from at least one first image, the time during which the door remains open until the door is closed, the number of laundry not recognized in the at least one first image, and the washing capacity obtained based on the weight of the laundry.

3. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the washing machine, Based on the information obtained above, identify a score for executing the foreign substance detection function, and A washing machine that determines to execute the foreign substance detection function based on whether the score is greater than or equal to a preset value, and determines not to execute the foreign substance detection function based on whether the score is less than the preset value.

4. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the washing machine, Based on the decision to execute the above foreign substance detection function, the drum is rotated and the inside of the drum is photographed through the camera to obtain at least one second image, and based on the at least one second image, whether there is a foreign substance inside the drum is identified. A washing machine that performs a washing operation on the laundry based on the determination not to execute the above foreign substance detection function.

5. In Paragraph 4, When the above instructions are executed individually or collectively by the at least one processor, the washing machine, Identify the rotation time of the drum based on the number of pockets of the laundry, and rotate the drum based on the rotation time. A washing machine that identifies a cycle for acquiring at least one second image using the camera based on the weight of the laundry, and acquires the at least one second image based on the cycle while the drum is rotating.

6. In Paragraph 5, When the above instructions are executed individually or collectively by the at least one processor, the washing machine, Based on the fact that the number of pockets of the laundry is less than or equal to the first number, the rotation time of the drum is identified as the first time, and Based on the fact that the number of pockets of the laundry is greater than the first number and less than or equal to the second number, the rotation time of the drum is identified as a second time that is greater than the first time, and A washing machine that identifies the rotation time of the drum as being a third time greater than the second time, based on the fact that the number of pockets of the laundry is greater than the second number and less than or equal to the third number.

7. In Paragraph 5, When the above instructions are executed individually or collectively by the at least one processor, the washing machine, Based on the fact that the weight of the laundry is less than or equal to the first weight, the cycle is identified as the first cycle, and Based on the fact that the weight of the laundry is greater than the first weight and less than or equal to the second weight, the cycle is identified as a second cycle that is longer than the first cycle, and A washing machine that identifies that the cycle is a third cycle longer than the second cycle, based on the fact that the weight of the laundry is greater than the second weight and less than or equal to the third weight.

8. In Paragraph 5, When the above instructions are executed individually or collectively by the at least one processor, the washing machine, Based on the fact that the above rotation time is less than or equal to a preset time and that the identified rotation time has elapsed after the drum has started to rotate, the rotation of the drum is terminated, and A washing machine that supplies hot air into the drum while the drum is rotating based on the fact that the above rotation time is greater than the above preset time and the above preset time has elapsed after the drum has started to rotate, and terminates the rotation of the drum and the supply of the hot air based on the fact that the above rotation time has elapsed after the drum has started to rotate.

9. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the washing machine, If it is identified that the foreign substance is present inside the drum based on the execution of the above foreign substance detection function, a notification is provided to indicate the presence of the foreign substance. A washing machine that performs a washing operation on the laundry when it is identified that there is no foreign substance inside the drum based on the execution of the above foreign substance detection function.

10. In a method for controlling a washing machine, A step of obtaining at least one first image by photographing laundry being fed into a drum through a laundry input while the door for opening and closing the laundry input is open; and A control method comprising: a step of determining whether to execute a foreign substance detection function to identify whether there is a foreign substance in the drum using information obtained based on at least one of the state at the time when the door was open, the weight of the laundry, and at least one of the at least one first image when the door is closed.

11. In Paragraph 10, The above information is, A control method comprising at least one of the weight of the laundry, the number of pockets of the laundry obtained from at least one first image, the time during which the door remains open until the door is closed, the number of laundry not recognized in at least one first image, and a laundry capacity obtained based on the weight of the laundry.

12. In Paragraph 10, The step of identifying whether the above foreign substance detection function is executed is: A step of identifying a score for executing the foreign substance detection function based on the information obtained above; A step of determining to execute the foreign substance detection function based on the fact that the above score is greater than or equal to a preset value; and A control method comprising: a step of determining not to execute the foreign substance detection function if the above score is less than the above preset value.

13. In Paragraph 10, Based on the decision to execute the above foreign substance detection function, the drum is rotated and the inside of the drum is photographed to obtain at least one second image, and based on the at least one second image, whether there is a foreign substance inside the drum is identified. A washing machine that performs a washing operation on the laundry based on the determination not to execute the above foreign substance detection function.

14. In Paragraph 13, The step of acquiring at least one second image is, A step of identifying the rotation time of the drum based on the number of pockets of the laundry; A step of rotating the drum based on the above rotation time; A step of identifying a cycle for acquiring at least one second image using the camera based on the weight of the laundry; and A control method comprising the step of acquiring at least one second image based on the cycle while the drum is rotating.

15. In Paragraph 13, The step of identifying the rotation time of the drum above is, A step of identifying that the rotation time of the drum is a first time based on the fact that the number of pockets of the laundry is less than or equal to a first number; A step of identifying that the rotation time of the drum is a second time greater than the first time, based on the fact that the number of pockets of the laundry is greater than the first number and less than or equal to the second number; and A control method comprising the step of identifying that the rotation time of the drum is a third time greater than the second time, based on the fact that the number of pockets of the laundry is greater than the second number and less than or equal to the third number.

Images