Household appliance, method of operating a household appliance and storage medium

Abstract

The disclosure relates to a home appliance, an operating method thereof, and a storage medium. The method of operating a home appliance includes displaying a user interface screen including a first area including a product tab menu and a widget tab menu and a second area for displaying information based on one of the product tab menu and the widget tab menu, receiving a signal based on a user input associated with one or more electronic products connected to the home appliance, and changing a configuration of the first area or the second area based on the received signal.

Description

Technical Field

[0001] This disclosure relates to a household appliance and its operating method, and more particularly to a household appliance that can improve user convenience, an operating method of the household appliance, and a storage medium for storing the method of operating the household appliance. Background Technology

[0002] Household appliances can be appliances used in homes or office buildings, such as clothing handling equipment (e.g., washing machines, dryers, etc.), refrigerators, air conditioners, cooking appliances, etc.

[0003] For example, garment handling equipment can refer to equipment that processes garments and performs operations such as washing, tumble drying, and tumble drying. Garment handling equipment can be, for example, a washing machine or detergent that washes clothes or bedding using the emulsification of detergent, the water flow generated by the rotation of the washing tub or pulsator, and the mechanical force applied by the pulsator; a dryer that dries garments by supplying hot or cold air; and a refurbisher that removes wrinkles from garments by applying steam. Garment handling equipment can also be implemented as a multi-functional washing machine / dryer combination (or a washer-dryer combo).

[0004] With the advancement of home appliance performance, various functions have been added to home appliances.

[0005] In addition, home appliances, especially multifunctional products such as washing machines, dryers, and garment care equipment, are becoming increasingly digitalized and intelligent, and are equipped with displays for user interaction.

[0006] Such displays can provide product status information or control settings, and have recently evolved to provide a variety of information to enhance user convenience.

[0007] However, most existing product display screens offer a fixed layout of information and functions (or features), which is inconvenient for users because they must learn the location and operation of all functions when using the product for the first time.

[0008] For example, in the case of washing machines, all functions such as process selection, temperature control, and spin dry intensity settings are arranged in fixed locations, which can be cumbersome because users have to search for the desired function every time. Similarly, dryers or combination washer-dryers provide the same interface regardless of product status or usage, making it difficult to use the functions intuitively.

[0009] Therefore, in order to effectively utilize various functions, users must learn the structure of the user interface or the location of functions in advance, and even when desired functions, new functions, or context-specific recommended functions are available, users find it difficult to intuitively identify and use these functions. This increased learning burden is a barrier to product use and feature utilization.

[0010] Furthermore, while features may be necessary in a particular product state or under specific circumstances, their accessibility may be reduced because they are mixed with other unnecessary features.

[0011] As disclosed in Korean Patent Publication No. 10-2024-0043573, which is incorporated herein by reference, a separate product switching button is used to switch between the dryer and washing machine functions during use. However, as the number of connected electronic appliances increases, this switching via the button must be performed multiple times, causing inconvenience to the user. Furthermore, frequent product switching operations may lead to power consumption issues.

[0012] Furthermore, as the number of connected electronic devices increases, it may be difficult for users to visually check which device is being controlled.

[0013] In addition, providing uniform information without considering user context will reduce user satisfaction.

[0014] Therefore, despite recent technological attempts to improve user experience (UX) and increase feature accessibility, technologies that provide flexible information display and feature configuration based on product usage are still insufficient. Summary of the Invention

[0015] The purpose of this disclosure is to address the above and other issues.

[0016] Another objective of this disclosure is to provide a household appliance and its operation method that can improve user convenience.

[0017] Another object of this disclosure is to provide a home appliance and its operation method that enhances information visibility and allows for easy identification of various functions and services.

[0018] Another object of this disclosure is to provide a household appliance and a method thereof for operating which improves ease of use by providing various services and functions through small parts.

[0019] Another objective of this disclosure is to allow users to efficiently use desired functions through product tabs for performing detailed controls on a specific product and gadget tabs for providing various functionalities.

[0020] Another objective of this disclosure is to allow users to use home appliances intuitively and efficiently by adaptively providing functionality based on user scenarios.

[0021] Another objective of this disclosure is to enable users to utilize the functions more intuitively and flexibly by adaptively adjusting the information configuration, arrangement, and button functions of the widgets according to the context on the display screen.

[0022] Another objective of this disclosure is to provide a smarter and more personalized user experience.

[0023] Another object of this disclosure is to provide a household appliance and a method of operating the same, which can easily and quickly perform desired tasks by adaptively reconfiguring its functions based on usage without having to learn fixed information.

[0024] Another object of this disclosure is to provide a household appliance and a method of operating the same, which can dynamically change the information content, arrangement, and layout of small parts when the product usage conditions or specific conditions are met, thereby allowing users to immediately view the information most suitable for the current situation and quickly access the necessary functions.

[0025] Another object of this disclosure is to provide a home appliance and its operation method that can intuitively perform the desired function without additional menu navigation.

[0026] Another objective of this disclosure is to provide an intuitive user experience based on the layout of the connected products.

[0027] The purpose of this disclosure is not limited to the foregoing, and other purposes not stated herein will be clearly understood by those skilled in the art from the following description.

[0028] According to one aspect of this disclosure, the above and other objectives can be achieved by providing a household appliance and a method of operating the same, wherein the user interface screen is actively configured to enhance user convenience.

[0029] According to another aspect of this disclosure, a household appliance is provided, the household electronics including a display configured to display a user interface screen.

[0030] According to another aspect of this disclosure, a method of operating a home appliance is provided, the method comprising: displaying a user interface screen on a display, the user interface screen including a first area and a second area, the first area including a product tab menu and a widget tab menu, the second area for displaying information based on one of the product tab menu and the widget tab menu; receiving a signal based on user input associated with one or more electronic products connected to the home appliance; and changing the configuration of the first area or the second area of ​​the displayed user interface screen based on the received signal.

[0031] Embodiments of this disclosure include the ability to change the configuration of information displayed in a product tab menu and a second area based on signals received from one or more electronic products.

[0032] Embodiments of this disclosure include activating a product tab menu corresponding to the power-on of a product in one or more electronic products, wherein the activated product tab menu is displayed visually distinct from other product tab menus.

[0033] Embodiments of this disclosure include displaying information comprising one or more content items in a second area based on a selection from a product tab menu.

[0034] Embodiments of this disclosure include: wherein one or more content items include information on at least the status or function of an electronic product corresponding to a selected product tab menu.

[0035] Embodiments of this disclosure include: wherein one or more content items include processes for operating one or more electronic products arranged in a preset order, and performing automatic process optimization includes reordering the processes based on usage patterns of the one or more electronic products.

[0036] Embodiments of this disclosure include displaying information in a second area, the information including at least one widget associated with at least one of one or more electronic products included in a product tab menu.

[0037] Embodiments of this disclosure include: wherein at least one component includes a command button that corresponds to a function of at least one of one or more electronic products, and causes the function of at least one electronic product to be executed in response to receiving touch input via the command button.

[0038] Embodiments of this disclosure include: wherein, based on the requirement for detailed settings of a function to be executed, a product tab menu of at least one electronic product is activated in a first area, and a detailed settings screen for the function of at least one electronic product is displayed in a second area.

[0039] Embodiments of this disclosure include: wherein, based on the execution of a function, detailed settings of the function are not required, and information related to the execution of the function is displayed in a widget.

[0040] Embodiments of this disclosure include: at least one widget includes a command button, and in response to a selection received via the command button, a detailed screen corresponding to the widget is displayed in a second area.

[0041] Embodiments of this disclosure include: receiving a selection of a widget tab menu; and arranging at least one widget displayed in a second area based at least on a relevance order of a specific electronic product, a relevance order based on a specific operation process, a preset priority, or the order in which widgets were downloaded.

[0042] Embodiments of this disclosure include: wherein at least one component includes a plurality of command buttons, and wherein the arrangement of the plurality of command buttons varies based on the arrangement of at least one of one or more electronic products.

[0043] Embodiments of this disclosure include: displaying a background image in at least one widget, wherein the background image may be a still image or a moving image representing the function of the widget.

[0044] Embodiments of this disclosure include displaying command buttons related to the function of the widget displayed in the second area.

[0045] Embodiments of this disclosure include displaying a widget in a second area relating to an executed function of one of a plurality of electronic products, and displaying a progress bar that visually indicates the operation time and progress status of the executed function.

[0046] Embodiments of this disclosure include displaying a product tab menu based on the registration of additional products to a home appliance.

[0047] Embodiments of this disclosure include a product tab menu arranged based on a preset order or state of at least one of one or more electronic products.

[0048] In embodiments of this disclosure, the user interface screen may include a first area, which includes a product tab menu and a widget tab menu.

[0049] In embodiments of this disclosure, the user interface screen may include a second area displaying information based on either a product tab menu or a widget tab menu.

[0050] In embodiments of this disclosure, the display may change a portion of the configuration of the user interface screen based on signals received from one or more electronic devices connected to the display.

[0051] In embodiments of this disclosure, the display can change the configuration of the product tab menu and the information displayed in the second area based on the products connected to it and the signals received from the connected products.

[0052] According to another aspect of this disclosure, a non-transitory computer-readable storage medium is provided that stores instructions, which, when executed by one or more processors, cause the one or more processors to: display a user interface screen including a first area and a second area, the first area including a product tab menu and a widget tab menu, the second area for displaying information based on one of the product tab menu and the widget tab menu; receive signals based on user input associated with one or more electronic products connected to a home appliance; and change the configuration of the first or second area of ​​the displayed user interface screen based on the received signals.

[0053] According to another aspect of this disclosure, a method for operating a home appliance is provided, the method comprising: displaying a user interface screen including a widget; receiving touch input via a command button included in the widget; determining whether the command button is related to a function of an electronic product connected to the home appliance; displaying a detailed settings screen for the function of the electronic product based on the fact that the command button is related to a function of the electronic product and that the related function requires detailed settings to be executed; and enabling the function to be executed at the electronic product and displaying information related to the execution of the function of the electronic product based on the fact that the command button is related to a function of the electronic product and that the related function does not require detailed settings to be executed.

[0054] In one embodiment, the user interface screen may include a first area and a second area, the first area including a product tab menu and a widget tab menu, and the widget being displayed in the second area when the widget tab menu is selected.

[0055] In one embodiment, displaying a detailed settings screen may include activating a product tab menu for a specific electronic product and displaying the detailed settings screen.

[0056] In one embodiment, displaying execution information may include displaying execution information in a widget tab menu.

[0057] Embodiments of this disclosure include displaying a detailed screen corresponding to a widget in a widget tab menu when the command button is not related to the function of a specific electronic product.

[0058] In one embodiment, a particular electronic product may be an electronic product connected to a display or an electronic product previously controlled via a user interface screen.

[0059] In one embodiment, multiple widgets may be displayed, and the order of the widgets may vary depending on whether the electronics connected to the display are in operation.

[0060] In one embodiment, when one or more electronic products connected to the display are in operation, the widgets associated with the operating electronic products may be arranged in forward order, and when no electronic products are in operation, the most recently used or frequently used widgets may be arranged in forward order.

[0061] According to another embodiment, a home appliance is provided, the home appliance including: a display, one or more processors, and a memory storing instructions, which, when executed by the one or more processors, cause the one or more processors to: cause the display to show a user interface screen, the user interface screen including a first area and a second area, the first area including a product tab menu and a widget tab menu, the second area for displaying information based on one of the product tab menu and the widget tab menu; receive signals based on user input associated with one or more electronic products connected to the home appliance; and change the configuration of the first area or the second area of ​​the displayed user interface screen based on the received signals.

[0062] According to another embodiment, the instructions further cause one or more processors to: cause a display to show information in a second area, the information including at least one widget associated with at least one of one or more electronic products included in a product tab menu, wherein the at least one widget includes a command button corresponding to a function of at least one of the one or more electronic products; receive touch input via the command button; activate the product tab menu of at least one electronic product in a first area based on detailed settings of the function required to perform the function, and cause the display to show a detailed settings screen of the function of at least one electronic product in the second area; and cause the function of at least one electronic product to be performed according to the detailed settings received via the detailed settings screen.

[0063] According to at least one embodiment of this disclosure, user convenience can be improved by adaptively configuring the user interface screen.

[0064] According to at least one embodiment of this disclosure, the visibility of information can be enhanced, and various functions and services can be easily identified.

[0065] According to at least one embodiment of this disclosure, ease of operation can be enhanced by providing various services and functions via widgets.

[0066] According to at least one embodiment of this disclosure, by adaptively providing functionality based on user scenarios, users can use home appliances more intuitively and efficiently.

[0067] According to at least one embodiment of this disclosure, by adaptively adjusting the information configuration, arrangement, and button functions of widgets on the display screen according to the context, users can utilize the functions more intuitively and flexibly.

[0068] According to at least one embodiment of this disclosure, a more intelligent and personalized user experience can be provided.

[0069] According to at least one embodiment of this disclosure, desired tasks can be performed easily and quickly by features that can be adaptively reconfigured based on usage, without having to learn fixed information.

[0070] According to at least one embodiment of this disclosure, since the information content, arrangement, and layout of the widget are dynamically changed when product usage conditions or specific conditions are met, users can immediately view the information most suitable for the current situation and quickly access the required functions, thereby effectively reducing the power consumption of the display.

[0071] According to at least one embodiment of this disclosure, the desired function can be performed intuitively without the need for additional menu navigation.

[0072] According to at least one embodiment of this disclosure, an intuitive user experience can be provided based on the arrangement of the connected products.

[0073] According to at least one embodiment of this disclosure, it is possible to visually identify which product is being controlled via the current screen.

[0074] Furthermore, various other effects will be disclosed directly or implicitly in the following detailed description of the embodiments of this disclosure. Attached Figure Description

[0075] Figure 1 This is a perspective view of a household appliance according to an embodiment of the present disclosure.

[0076] Figure 2 This is a simplified internal block diagram of a household appliance according to an embodiment of the present disclosure.

[0077] Figure 3 A control panel of a household appliance according to an embodiment of the present disclosure is shown.

[0078] Figures 4 to 7 These are diagrams depicting various embodiments of the present disclosure.

[0079] Figure 8 This is a flowchart illustrating a method of operating a household appliance according to an embodiment of the present disclosure.

[0080] Figure 9 This is a flowchart illustrating a method of operating a household appliance according to an embodiment of the present disclosure.

[0081] Figures 10 to 26 These are diagrams depicting various embodiments of the present disclosure.

[0082] Figure 27 This is a flowchart illustrating a method of operating a household appliance according to an embodiment of the present disclosure. Detailed Implementation

[0083] Reference will now be made in detail to embodiments of the present disclosure, examples of which are illustrated in the accompanying drawings. However, the present disclosure may be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein.

[0084] For clarity and simplicity in describing this disclosure, descriptions of parts irrelevant to the description have been omitted. Throughout the specification, identical or nearly identical parts are indicated by the same reference numerals.

[0085] Furthermore, regarding the constituent elements or components used in the following description, the suffixes "module" and "unit" are used or combined with each other only for ease of preparation of the instruction manual, and do not have or indicate different meanings from each other. Therefore, the suffixes "module" and "unit" can be used interchangeably.

[0086] Although the terms “first,” “second,” etc., may be used in this document to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another.

[0087] Meanwhile, the household appliances described herein can be single electronic products (examples of which include clothing handling equipment (such as washing machines, dryers, etc.), refrigerators, air conditioners, and cooking appliances) or composite electronic products connected to multiple electronic appliances.

[0088] In the following text, the household appliance will be described by way of example as a composite garment processing device that includes two garment processing equipment products.

[0089] Figure 1 This is a perspective view of a household appliance according to an embodiment of the present disclosure, illustrating an example of a composite clothing processing device.

[0090] Reference Figure 1 In one embodiment of this disclosure, the garment processing apparatus 1 includes a first processing device 10 and a second processing device 20. The first processing device 10 and the second processing device 20 can be various types of garment processing apparatus, such as a washing machine for washing clothes or a dryer for drying clothes.

[0091] In one example Figure 1The diagram illustrates the state in which the control panel 220 is mounted on a garment processing device 1 according to an embodiment of the present disclosure. The garment processing device 1 according to an embodiment of the present disclosure may include the control panel 220, which is disposed between a first front panel 112 and a second front panel 122, and is signal-connected to a first processing device 10 and a second processing device 20.

[0092] The control panel 220 may be disposed between the first front panel 112 and the second front panel 122. The control panel 220 may be signal-connected to at least one of the first processing device 10 and the second processing device 20.

[0093] The front surface of the control panel 220 may be exposed to the outside to define the front surface of the garment handling device 1 according to an embodiment of the present disclosure together with the first front panel 112 and the second front panel 122.

[0094] The control panel 220 may be signal-connected to at least one of the first processing device 10 and the second processing device 20. The control panel 220 may include: a display 221 located on the front surface of the control panel to display the status or condition of the first processing device 10 and / or the second processing device 20; and input buttons 222 for inputting operation commands of the first processing device 10 and / or the second processing device 20.

[0095] Electrical components may be located inside the control panel 220, i.e., behind the front surface. These electrical components may be electrically connected to the first processing device 10 and / or the second processing device 20, thereby exchanging status (or condition) information or control signals with the first processing device 10 and / or the second processing device 20.

[0096] For example, electrical components may include a controller for the first processing device 10 and a controller for the second processing device 20, may include an integrated controller that controls both the first processing device 10 and the second processing device 20, may include a panel controller that is operatively connected to the controller for the first processing device 10 and the controller for the second processing device 20, or may be controlled by the controller for the first processing device 10 and the controller for the second processing device 20 without separate controllers.

[0097] Furthermore, the first processing device 10 and the second processing device 20 can be controlled by a separate server. At least one of the first processing device 10 and the second processing device 20 may include a communication module for communicating with the server. The first processing device 10 and the second processing device 20 can transmit data collected from the product, such as sensing data and user manipulation signals, to the server. The first processing device 10 and the second processing device 20 can receive control signals from the server and operate according to the received control signals.

[0098] The control panel 220 can be located between the first clothing inlet 16 and the second clothing inlet 26. That is, in one embodiment of this disclosure, the control panel 220 can be located between the first cabinet door 17 and the second cabinet door 27.

[0099] In one embodiment of this disclosure, since the control panel 220 is located between the first clothing inlet 16 and the second clothing inlet 26, between the first cabinet door 17 and the second cabinet door 27, or between the first front panel 112 and the second front panel 122, it can be ensured that the control panel 220 is located in a position that is convenient for the user to inspect and operate the control panel 220.

[0100] For example, when the first processing device 10 and the second processing device 20 are provided with corresponding control panels, since the first processing device 10 is located above the second processing device 20, the control panel of the first processing device 10 may be in a position that is inconvenient for the user to operate.

[0101] Furthermore, since control panels are provided on the first processing device 10 and the second processing device 20 respectively, it may be inconvenient for the user to operate the first processing device 10 and the second processing device 20 together.

[0102] In contrast, the garment processing device 1 according to an embodiment of the present disclosure is provided with a single control panel 220 connected to both the first processing device 10 and the second processing device 20, thereby enabling the user to conveniently operate the first processing device 10 and the second processing device 20 together.

[0103] Figure 2 This is a simplified internal block diagram of a household appliance according to an embodiment of the present disclosure.

[0104] Reference Figure 2 Each device product 10, 20 included in the garment processing equipment 1 may include a sensor unit 250, a control panel 220, a memory 230, a communication module 260, and a processor 210 configured to control overall operation. These are components that are typically included in each product 10, 20, and the detailed configuration may vary depending on the characteristics of the appliance 10, 20. Furthermore, each product 10, 20 may include components for performing predetermined operations and its driver 240.

[0105] The first processing device 10 may correspond to a dryer for drying clothes and may include a motor configured to power a first rotatably arranged drum 12. The dryer's drive 240 may include a motor driver, such as an inverter, configured to drive the motor.

[0106] The second processing device 20 may correspond to a washing machine (or washing machine) for washing clothes, and may include a second drum 22 and a tub 24 configured to receive clothes therein, and a motor configured to power the second drum 22. The driver 240 of the washing machine may include a motor driver (such as an inverter) configured to drive the motor, a pump driver configured to drive various pumps, etc.

[0107] Meanwhile, the type, number, and installation location of the sensors included in the sensor unit 250 can vary depending on the type of each product 10, 20.

[0108] The memory 230 can store control data used to control the operation of products 10 and 20, as well as operational data generated or sensed during operation. The memory 230 can store execution programs for each function, data for operation control, and data to be transmitted and received.

[0109] refer to Figure 3 The control panel 220 can be used as an interface device and may include components for providing information to the user and receiving user control commands.

[0110] The control panel 220 may include a display 221. Furthermore, in some embodiments, the control panel 220 may include at least one input unit, such as a button, switch, or touch input element.

[0111] For example, the display 221 can be configured as a touchscreen and can display a user interface screen and receive user touch input. Additionally, the control panel 220 may include one or more input buttons 222.

[0112] Display 221 can visually display predetermined information. For example, display 221 can output status information of the garment handling device 1, sensing data sensed by sensors, and guidance information for guiding specific operations / functions.

[0113] The display 221 can be implemented as a touch screen or used as an input unit.

[0114] The user interface provided by the display 221 can reflect the combination, arrangement and operating conditions of the connected products 10, 20.

[0115] When a user command or predetermined data is entered in response to the operation of the input unit, the control panel 220 can transmit the input data to the processor 210.

[0116] Processor 210 can control products 10 and 20 according to user commands, etc.

[0117] Processor 210 can be an integrated controller for products 10 and 20.

[0118] Alternatively, processor 210 may correspond to a controller disposed in at least one of products 10 and 20. For example, the first processing device 10 and the second processing device 20 may each include a controller for controlling operation. Processor 210 may correspond to the controller of products 10 and 20 and may control the operation of each product 10 and 20.

[0119] The corresponding controllers can communicate with each other. In some cases, at least one controller can be used as a higher-level controller configured to control another controller or appliance.

[0120] Alternatively, either product 10 or 20 may not have a separate controller installed therein, and may operate under the control of a controller installed on a printed circuit board (PCB) located inside another appliance.

[0121] Meanwhile, the processor 210 can be implemented as part of a functional block of the controller, and any controller may include multiple processors 210. Multiple processors 210 can be arranged together in a predetermined space or mounted together on a PCB. Alternatively, a portion of the multiple processors 210 can be mounted on another PCB.

[0122] Products 10 and 20 can communicate with other devices, mobile terminals, etc., via communication module 260. The communication module 260 of at least one of products 10 and 20 may include a wireless communication module for wireless communication with mobile terminals, servers, etc. Furthermore, at least one of products 10 and 20 may include multiple communication modules employing different communication schemes.

[0123] The communication module 260 may include a transmitter 261 configured to send predetermined data to another device. Furthermore, products 10 and 20 may include a receiver 262 configured to receive predetermined data from another device. The transmitter 261 and receiver 262 may be integrated and configured as a transceiver.

[0124] Figure 3 A control panel of a household appliance according to an embodiment of the present disclosure is shown.

[0125] refer to Figure 3 The display 221 and input buttons 222 can be located in front of the control panel 220. For example, the input buttons 222 may include a first button 310 for powering on or off and a second button 320 for performing or pausing operations.

[0126] The monitor 221 can be located in the center of the control panel 220, and the first button 310 and the second button 320 can be located on the left and right sides of the monitor 221, respectively.

[0127] Control panel 220 can receive all control commands from products 10 and 20.

[0128] The first button 310 may include a first up button 310a located on the upper side and a first down button 310b located on the lower side. The first up button 310a located on the upper side may correspond to a first processing device 10 (e.g., a dryer) located on the upper side, and the first down button 310b located on the lower side may correspond to a second processing device 20 (e.g., a washing machine or washer) located on the lower side.

[0129] When input is received on the first up button 310a, the first processing device 10 can be turned on. When input is received again on the first up button 310a, the first processing device 10 can be turned off.

[0130] When input is received on the first button 310b, the second processing device 20 can be turned on. When input is received again on the first button 310b, the second processing device 20 can be turned off.

[0131] The second button 320 may include a second up button 320a located on the upper side and a second down button 320b located on the lower side.

[0132] When input is received on the second up button 320a, the first processing device 10 can perform a predetermined operation. For example, when one of the multiple drying operation processes displayed on the display 221 is selected and input is received on the second up button 320a, the first processing device 10 can execute the selected drying operation process.

[0133] When input is received on the second button 320b, the second processing device 20 can perform a predetermined operation. For example, when one of the multiple washing operation processes displayed on the display 221 is in a focused (selected) state and input is received on the second button 320b, the second processing device 20 can execute the selected washing operation process.

[0134] The display 221 can be implemented as a touchscreen to receive touch input, thereby minimizing the number of input buttons 222. Furthermore, by reducing the number of input buttons 222, the size of the display 221 in the control panel 220 can be increased.

[0135] Meanwhile, at least some of the input buttons 222 can be implemented as touch-based UI elements within the display 221, and users can execute commands by touching the buttons on the UI.

[0136] For example, the second button 320, the second up button 320a, and the second down button 320b corresponding to the execution button can be replaced by virtual buttons (UI elements) displayed in the display 221, and the user can input execution commands by making touch input on the display 221.

[0137] Display 221 can display a user interface screen.

[0138] Figures 4 to 7 The figure is mentioned in the description of a method of operating a household appliance according to an embodiment of the present disclosure.

[0139] Figure 4 An example layout of the user interface screen is shown.

[0140] refer to Figure 4 The user interface screen 400 may include a first area 410 located on the upper side and a second area 420 located on the lower side.

[0141] The first area 410 may be a navigation area in which tab menus 411, 412 and 413 are displayed.

[0142] The second area 420 can be the main information area, in which a screen is displayed based on the tab menu items selected from the tab menus 411, 412 and 413.

[0143] Tab menus 411, 412, and 413 may include product tab menus 411 and 412 and widget tab menu 413.

[0144] Product tab menus 411 and 412 may include items for selecting connected products 10 and 20. For example, refer to Figure 4 The product tab menus 411 and 412 may include a washing machine product tab menu item 411 corresponding to the second processing device 20 and a washing machine product tab menu item 412 corresponding to the first processing device 10.

[0145] Product tab menus 411 and 412 may include items corresponding to products 10 and 20 that are physically connected to control panel 220.

[0146] Alternatively, product tab menus 411 and 412 may include items corresponding to products 10 and 20 electrically connected to control panel 220. Product tab menus 411 and 412 may include items corresponding to products 10 and 20 electrically connected to display 221.

[0147] The term "electrical connection" can refer to a state in which two or more components (e.g., parts, circuits, etc.) are connected to enable the transmission of current, signals, or power. An electrical connection typically involves a physical connection that allows the transmission of signals or power. For example, an electrical connection can be implemented using conductors, semiconductor devices, or wires with specific patterns.

[0148] In some embodiments, the product tab menus 411, 412 may also include items corresponding to products communicatively connected to at least one of the first processing device 10, the second processing device 20, and the control panel 220.

[0149] Communication connections transmit and receive data via electrical signals, and therefore typically include an electrical connection. However, in the case of wireless communication, a wireless communication connection can exist without an electrical or physical connection.

[0150] At the same time, when powered on (started up), the menu order (or sequence) of the product tabs can be arranged so that products physically connected to the control panel 220 are placed first.

[0151] Additionally, products with similar functions, such as washing machines / dryers / styling machines or ovens / stoves / microwave ovens / ventilation hoods, can be arranged close to each other.

[0152] The product tab menu can be arranged based on at least one of the electronic products generated in sequence or electrically connected to the display. An indicator 414 may also be provided in the first area 410. For example, the indicator 414 may indicate Wi-Fi communication connection status, door lock status, etc.

[0153] The user interface screen 400 may also include a third area 430. The user interface screen 400 may include a first area 410 at the top, a second area in the middle, and a third area 430 at the bottom.

[0154] The arrangement of the first area 410, the second area 420 and the third area 430 is merely illustrative, and the positions of the first area 410, the second area 420 and the third area 430 can be freely changed.

[0155] For example, the first region 410 may be located below the second region 420, or the third region 430 may be located above the second region 420.

[0156] In addition, the first area 410 can be arranged on the left, the second area in the middle, and the third area on the right.

[0157] Since the second region 420 displays at least one piece of content, the second region 420 can have a larger area than the first region 410 or the third region 430.

[0158] The third area 430 may be a toolbar area, including, for example, a button 431 for switching to all processes (a list) on the entire process screen (or, in the case of other device types, content related to the function of the electronic product, such as a recipe list for cooking-related equipment), and displaying buttons 432 for quick settings and actions (such as booking, remote control, and setup).

[0159] Option buttons corresponding to the detailed settings of the corresponding process can be displayed in the third area 430.

[0160] At the same time, although the term "process" is exemplified in this specification as being related to the function of an electronic product, it can be applied to the function of each electronic product.

[0161] For example, in addition to the process, at least one of the following can be provided for setting each electronic product: menus, detailed settings, and product status (or condition). For example, in the case of an oven, at least one piece of information, such as a recipe or recipe settings, can be displayed. In another example, for a refrigerator, temperature information for each compartment can be displayed.

[0162] Simultaneously, for the entire process, processes can be additionally created or activated when selecting a process. For this option, since basic settings such as appliance management are fixed, processes (or loops, menus) that can be changed by the user can be disabled or deleted. Also, the information displayed in the second area 420 and the third area 430 of the user interface screen can differ.

[0163] The process information on the second area 420 may include process name, status information (operation status of the relevant appliance), planned completion time, weight, remaining time, and a description of the process operation based on the relevant appliance. Simultaneously, still or moving images representing information about the relevant process (menu) (operation information, food images, etc.) can be displayed in the background of the second area 420.

[0164] In the third region 430, when selecting an entire process, information such as the process name can be provided.

[0165] Users can touch and select any of the product tab menus 411, 412 or the widget tab menu 413.

[0166] In the second area 420, information based on the menu items selected from the product tab menus 411, 412 and the widget tab menu 413 can be displayed.

[0167] Simultaneously, the display 221 can be configured with the user interface screen 400 based on the communication connection of the products 10 and 20. The display 221 can also be configured with the user interface screen 400 based on the electrical connection of the products 10 and 20. The display 221 can connect to other components of the products 10 and 20 to send and receive signals. For example, the display 221 can send signals corresponding to touch input to the processor 210. Furthermore, the display 221 can receive control commands, status information, etc., from the processor 210.

[0168] Display 221 configures the user interface screen 400 based on the received signals. Display 221 can configure the user interface screen 400 based on signals associated with and received from the connected products 10 and 20.

[0169] For example, the display 221 can receive signals from the electrically connected products 10 and 20 regarding the power-on / power-off status and operating status of the connected products 10 and 20, and can configure a user interface screen corresponding to the received status.

[0170] Furthermore, when touch input or other input is present on input buttons 310 and 320, display 221 can configure the user interface screen in response to the corresponding input.

[0171] In addition, the display 221 can be configured with a user interface screen under the control of the processor 210.

[0172] The display 221 can variably display the configuration of information displayed in the product tab menus 411, 412 and the second area 420 according to the connected products 10, 20 and the received signals.

[0173] For example, when two products 10, 20 are physically or electrically connected, such as a washing machine and a dryer or a dual oven (upper oven and lower oven), the product tab menus 411, 412 may include two tab menu items. When either of the two product tabs is selected, the second area 420 of the display 221 or the entire screen may display a detailed screen corresponding to the selected product.

[0174] The detailed screen can display all electronic products on a single screen according to their operating status, and the display layout can be based on the actual product placement location.

[0175] For example, when the dryer is placed on top and the washing machine is placed at the bottom, the detail screen can display the screen corresponding to the dryer facing upwards and the screen corresponding to the washing machine facing downwards. In the case of a single product such as a washing machine, dryer, or washer-dryer combo, a product tab menu can be displayed, and when the product tab menu is selected, the second area 420 of the display 221 or the entire screen can display the detail screen of the single product.

[0176] Additionally, when the widgets tab menu 413 is selected, the second area 420 of the display 221 or the entire screen can display the widgets screen.

[0177] Figure 5 An example of a user interface screen 500 is shown when the widget tab menu 413 is selected, illustrating the widget screen.

[0178] refer to Figure 5 When selecting the widgets tab menu 413, multiple widgets 510, 520, 530 and 540 can be displayed in the second area 420.

[0179] Meanwhile, the backgrounds of widgets 510, 520, 530, and 540 can display image information related to the corresponding functions, and can output still images or moving images (or videos).

[0180] Content can refer to information or messages to be delivered to users, and can be objects that users read, view, listen to, or experience. Widgets can be user interface (UI) components (interface tools) that enable users to view, manipulate, and interact with content. In other words, widgets can be used as tools or frameworks for displaying or manipulating content and can support interaction with users.

[0181] Widgets can be considered a special type of content. Widgets allow information and functionality to be presented in a specific location without opening the application. Widgets enable users to quickly obtain necessary information or conveniently use specific functions.

[0182] By providing useful services and functions in the form of widgets, ease of use can be improved. Furthermore, by categorizing and displaying functions as widgets, information visibility can be enhanced and various functions and services can be easily identified.

[0183] When the number of widgets 510, 520, 530, and 540 is large, only some widgets 510, 520, and 530 can be displayed on the display screen 500a. In this case, the user can scroll left and right to navigate the undisplayed area 500b.

[0184] To help users navigate the widget, a scrollbar 590 can be displayed in the second area 420.

[0185] When the widget tab menu 413 is selected, the information displayed in the second area 420 based on products 10 and 20 included in the product tab menus 411 and 412 may include at least one of widgets 510, 520, 530, and 540.

[0186] The multiple widgets 510, 520, 530, and 540 may include widgets associated with at least one product included in the product tab menus 411 and 412. That is, at least one of the widgets 510, 520, 530, and 540 may include a widget associated with the first processing device 10, a widget associated with the second processing device 20, and a widget associated with both the first processing device 10 and the second processing device 20.

[0187] For example, refer to Figure 5 The widgets 510, 520, 530, and 540 may include a quick setup widget 510 associated with both the first processing device 10 and the second processing device 20, a washing machine management widget 520 associated with the second processing device 20, a dryer management widget 530 associated with the first processing device 10, and a smart diagnostic widget 540 associated with both the first processing device 10 and the second processing device 20.

[0188] In addition, widgets can include those unrelated to a specific product. For example, weather widgets, clock widgets, timer widgets, stock widgets, etc., can be provided.

[0189] Widgets 510, 520, 530, and 540 can be default widgets installed during manufacturing. The arrangement order of multiple widgets 510, 520, 530, and 540 can vary based on user settings input or user usage patterns. At least some of the default widgets can be set to be non-removable.

[0190] In addition, users can download widgets using app stores or home appliance control apps. The clothing handling device 1 can download pre-selected widgets and apply them to the user interface screen.

[0191] When touch input is received on any of widgets 510, 520, 530, and 540, the touched widget can be selected.

[0192] Additionally, at least some of the components 510, 520, 530, and 540 may include command buttons for predetermined functions. When touch input is received on a command button, the garment handling device 1 can execute the function corresponding to the command button under the control of the processor 210.

[0193] For example, the quick settings widget 510 may include command buttons 511, 512, and 513, which allow settings to be quickly applied to the first processing device 10 without screen switching (or with only one screen switching). Furthermore, the quick settings widget 510 may include command buttons 514, 515, and 516, which allow settings to be quickly applied to the second processing device 20 without screen switching (or with only one screen switching).

[0194] When there is touch input on a command button 513, the settings corresponding to the command button 513 can be immediately applied to the first processing device 10.

[0195] When the command button 521 of the washing machine management widget 520 and the command button 531 of the dryer management widget 530 are selected, the sterilization / management function of the corresponding appliance can be executed, or a screen for setting the sterilization / management function can be provided.

[0196] The intelligent diagnostic widget 540 may include command buttons 541 and 542 corresponding to the respective products 10 and 20.

[0197] Meanwhile, among the multiple widgets 510, 520, 530, and 540, widgets 510 and 540 related to the connected products may include multiple command buttons. In this case, the arrangement of the multiple command buttons can vary depending on the arrangement of the connected products 10 and 20, so that the command buttons can intuitively indicate the products associated with them.

[0198] For example, in the quick setup widget 510, command buttons 511, 512 and 513 corresponding to the first processing device 10 located on the upper side can be displayed facing upwards, and command buttons 514, 515 and 516 corresponding to the second processing device 20 located on the lower side can be displayed facing downwards.

[0199] Furthermore, in the intelligent diagnostic component 540, a command button 541 corresponding to the first processing device 10 located on the upper side can be displayed facing upwards, and a command button 542 corresponding to the second processing device 20 located on the lower side can be displayed facing downwards.

[0200] At the same time, when there is input on the command button via the widget, it can operate in different ways depending on different conditions.

[0201] This operation can vary depending on whether the command button is related to the function of a specific electronic product and whether detailed settings are required.

[0202] When touch input is present on the command button included in the widget, if the command button is related to the function of a specific electronic product and detailed settings of the function of the specific electronic product are required, the display 221 can activate the product tab menu of the specific electronic product and display the detailed settings screen of the function of the specific electronic product.

[0203] When a function requires detailed settings, providing a detailed settings screen first can minimize user operations and screen transitions.

[0204] When touch input is present on the command button included in the widget, if the command button is related to the function of a specific electronic product and detailed settings of the function of the specific electronic product are not required, the display 221 can display execution information about the function of the specific electronic product in the widget tab menu.

[0205] When no detailed settings are required, the corresponding electronic product can immediately execute the function.

[0206] Display 221 can provide execution information of the function being performed within the current widget tab menu screen without switching to the product tab menu screen.

[0207] Additionally, execution information can be provided in a pop-up format. Alternatively, execution information can be displayed in a corresponding widget.

[0208] At the same time, when there is touch input on the command button included in the widget, if the command button is not related to the function of a specific electronic product, the display 221 can display a detailed screen corresponding to the widget.

[0209] When it's not a function setting for a specific home appliance (such as appliance registration), a detail screen can be applied within the widget tab. Additionally, a detail screen can also be displayed when the widget is accessed via smart diagnostics, providing detailed information (weather), or when the user moves to a webpage (third-party app).

[0210] For example, in the case of a weather widget, display 221 can show a detailed screen related to the weather.

[0211] At the same time, when there is input on the command button related to product control, the relevant product tab menu can be activated, and the screen can be switched to the product tab menu screen.

[0212] Alternatively, when a quick action is expected, such as in the quick setup widget 510, the corresponding function can be executed directly within the widget without screen switching.

[0213] Additionally, pop-up windows can be provided for command buttons on widgets unrelated to product control (such as the Smart Diagnostics Widget 540).

[0214] Even when command buttons have the same display format, distinguishing the product control user interface from other user interfaces on the display can enhance the intuitive user experience and enable efficient product control.

[0215] When either of the product tab menus 411 and 412 is selected, the second area 420 of the display 221 or the entire screen can display a detailed screen corresponding to the selected product.

[0216] Figure 6 An example of a user interface screen 500 is shown when either of the product tab menus 411 and 412 is selected, showing a detailed screen corresponding to the selected product.

[0217] refer to Figure 6 The detailed screen 600 may include a first area 610, a second area 620, and a third area 630.

[0218] The product tab menu and the widget tab menu can be displayed in the first area 610, and one or more contents (content items) 621, 622 and 623 based on the selected product tab menu can be displayed in the second area 620.

[0219] In addition, all process buttons 631 and buttons 632 for quick settings and actions (such as scheduling, remote control, and settings) can be displayed in the third area 630.

[0220] Additionally, one or more of the contents 621, 622, and 623 may include at least one of the status or function of the electronic product corresponding to the selected product tab menu.

[0221] One or more of the content 621, 622 and 623 may include the operation process (or content related to the function of each product, such as a recipe list).

[0222] For example, when the washing machine product tab menu item 411 corresponding to the second processing device 20 is selected, multiple washing operation processes can be displayed in the second area 620.

[0223] When the dryer product tab menu item 412 corresponding to the first processing device 10 is selected, multiple drying operation processes can be displayed in the second area 620.

[0224] Meanwhile, among multiple operation processes, the operation process displayed in the center can be selected as the current process. The previous and next processes can be displayed to the left and right of the selected operation process in the center.

[0225] When the number of content items 621, 622, and 623 is large, only some of them can be displayed in the detail screen 600. Users can scroll left and right to navigate the content not displayed.

[0226] To help users navigate the content, page 690 can be displayed in the third area 630.

[0227] Page 690 indicates which page in the total number of pages is currently displayed. Page 690 can display page information for the current process.

[0228] Page 690 is displayed when selecting the product tab menu 411, 412. Additionally, a scroll bar 590 is displayed when selecting the widget tab menu 413. Therefore, selections to the product tab menus 411, 412 and the widget tab menu 413 can be displayed distinctly, and their different operation methods can be intuitively indicated.

[0229] Meanwhile, the input method used to select or execute one or more of the contents 621, 622, and 623 may be different from the input method used for any one of the widgets 510, 520, 530, and 540.

[0230] One or more items 621, 622 and 623 can be selected or executed by inputting the second button 320, and multiple widgets 510, 520, 530 and 540 can be executed by touch input.

[0231] For example, when one of the multiple drying operation processes displayed on the display 221 is selected and there is input on the second button 320a, the selected drying operation process among the multiple drying operation processes can be executed.

[0232] Alternatively, when one of the multiple washing operation processes is selected and there is input on the second button 320b, the selected washing operation process among the multiple washing operation processes can be executed.

[0233] Input to multiple widgets 510, 520, 530, and 540 can be performed based on the widget being touched or an object located within the touch area of ​​the widget.

[0234] Figure 7 (a) shows an example of a conventional user interface based on existing technology. Figure 7(b) illustrates a user interface according to an embodiment of this disclosure.

[0235] Reference Figure 7 In (a), conventional household appliances in the prior art are controlled based on physical buttons 720, and the display 710 is merely a limited means of providing current status information. Furthermore, because many physical buttons 720 need to be provided, the screen size of the display 710 is relatively small.

[0236] Furthermore, depending on the type of household appliances and the installation environment, there may be limitations in increasing the size of the display 710 in many cases, making it difficult to provide various information intuitively.

[0237] In particular, when a household appliance is a composite device that includes multiple electrical products, there may be even greater difficulties.

[0238] For example, it may be difficult to intuitively identify which appliance the current screen is providing information to in a short period of time.

[0239] Furthermore, as the number of connected appliances or services increases, it may become inconvenient for users to exercise the desired controls.

[0240] According to embodiments of this disclosure, functionality and information can be provided by differentiating between product tabs and widget tabs. For example, product tabs can provide a user interface related to detailed product control. Widget tabs can provide quick control and service functions, and users can freely add functional services as needed.

[0241] Figure 7 (b) shows an example user interface screen 730, on which multiple widgets 731 and 732 are displayed when a widget tab is selected.

[0242] In some cases, as the number of widgets / processes increases, it may become difficult to check and select the desired function / process. Furthermore, when controlling each electrical product, several steps may need to be performed for detailed control.

[0243] Simply increasing screen size may not fundamentally solve the problems of functional accessibility and user experience (UX).

[0244] Typically, in some user interface designs, when more information is displayed on one screen, users may become confused due to information overload, or it may become more difficult to find the necessary information.

[0245] Moreover, if the functionality is spread across an enlarged screen, the user's gaze may move more slowly, and the sequence of actions (user flow) may become more complex, making it take longer to achieve the desired functionality.

[0246] Furthermore, since household appliances typically have limited dimensions, increasing the display size within the limited dimensions of a household appliance reduces the space available to provide the appliance's functionality, thus potentially limiting the extent to which the display size can be increased.

[0247] Furthermore, if a widescreen is only used to display a large amount of information, it may be perceived by users as a meaningless waste of space, thus reducing the overall user experience.

[0248] Furthermore, when using traditional products with existing technologies, users must learn and use information and functions that are designed to be fixed.

[0249] This disclosure enables intuitive use of functionality by allowing for variable reconfiguration of the functionality based on usage.

[0250] Therefore, embodiments of this disclosure dynamically configure the user interface screen based on the state and current situation of each product. That is, the information, arrangement, and layout of the widgets can be changed when the product is used or when specific conditions occur, thereby facilitating easy reconfiguration of information and enabling quick and convenient access to functions.

[0251] For example, the sorting criteria for widgets can be configured to differ based on whether the product is in operation. When the product is in operation, widgets related to the product can be listed, and when the product is not in operation, recently used or frequently used widgets can be listed.

[0252] For example, when scrolling (sliding) through main content such as processes, you can specify and align the content in the center to accurately indicate the selected process and prevent errors.

[0253] The sorting criteria for the widgets can vary depending on whether the electronic product connected to the display 221 (or the electronic product with the display 221 or the most recently controlled electronic product) is in operation.

[0254] When one or more electronic products connected to the display 221 are in operation, the small parts associated with the operating electronic products can be arranged preferentially, for example, at the front of the sequence.

[0255] When no electronic products are in operation, the most recently used or frequently used small parts can be prioritized, for example, placed at the beginning of the sequence.

[0256] Furthermore, instead of assigning broad functions to buttons included in widgets, the roles of buttons can be assigned differently based on the concept of the corresponding widget, resulting in a usage flow that fits the context.

[0257] For example, buttons for widgets related to basic controls can be configured to perform the function of controlling the relevant product. Buttons for widgets related to detailed controls can be configured to guide the user to product tabs. Buttons for widgets unrelated to service or product function settings can be configured to directly provide the functions corresponding to the buttons within the widget.

[0258] Figure 8 This is a flowchart illustrating a method of operating a household appliance according to an embodiment of the present disclosure.

[0259] refer to Figure 8 When the product is turned on (S810), the display 221 can receive signals from the turned-on product or processor 210 (S820).

[0260] When at least one of the connected products 10 and 20 is turned on (S810), the display 221 can display a user interface screen (S840).

[0261] In this configuration, the display 221 can configure the user interface screen 400 based on the received signals (S830). The display 221 can configure the user interface screen based on signals associated with the connected products 10 and 20 and signals received from the connected products 10 and 20.

[0262] For example, the display 221 can receive signals about the power-on / power-off status and operation status of the connected products 10 and 20, and can configure the user interface screen according to the corresponding status.

[0263] Furthermore, when there is touch input or input on the input buttons 310 and 320, the display 221 can configure the user interface screen in response to the corresponding input.

[0264] The display 221 can display a user interface screen, which includes a first area and a second area. The first area includes a product tab menu and a widget tab menu, and the second area displays information based on either the product tab menu or the widget tab menu (S840).

[0265] The display 221 can change a portion of its configuration based on signals received from the connected products 10 and 20 (S830), and can display a user interface screen according to the changed configuration (S840). For example, the configuration of the information displayed in the product tab menus 411 and 412 and the second area 420 can be changed.

[0266] Furthermore, the display 221 can change the configuration of the information displayed in the product tab menus 411, 412 and the second area 420 according to the connected products 10, 20 and the signals received from the products 10, 20 (S830), and can display the user interface screen according to the changed information configuration (S840).

[0267] For example, when one or more products are turned on (S820), the display 221 can activate the product tab menu corresponding to the turned-on product in the product tab menu (S830), and can display a user interface screen including information corresponding to the activated product tab menu (S840).

[0268] Since activating a specific product signifies the user's intention to control it, the product tab menu corresponding to the activated product can be activated (S830), and the user interface screen for that product can be prioritized (S840). Therefore, the status or function of the relevant product can be controlled quickly and efficiently with minimal manipulation. Furthermore, efficient screen switching prevents unnecessary screen transitions and minimizes power consumption.

[0269] The active product tab menu can have a different display state than the remaining product tab menus. That is, the active product tab menu can be displayed to distinguish it from the deactivated product tab menu by at least one of the following: display state color, size, and shape.

[0270] Figure 9 This is a flowchart illustrating a method of operating a household appliance according to an embodiment of the present disclosure.

[0271] refer to Figure 9 The first product can be turned on (S910). The household appliance can be a composite device that includes multiple products. Here, the first product can correspond to the product that is turned on first among the multiple products. For example, the household appliance can be a clothing processing device 1 that includes a first processing device 10 and a second processing device 20. When there is an input on the first upper button 310a while the first processing device 10 and the second processing device 20 are closed, the first processing device 10 can be turned on first.

[0272] When the first product is turned on (S910), the display 221 can be activated and display the user interface related to the first product (S920).

[0273] For example, the product tab menu corresponding to the first processing device 10 can be activated and displayed when selected in the first area 410. Furthermore, the detail screen corresponding to the first processing device 10 can be displayed in the second area 420.

[0274] After this, the second product can be turned on (S930). For example, the second processing device 20 can be turned on when the first processing device 10 is turned on and there is input on the first button 310b.

[0275] When the second product is started (S930), the display 221 can be activated and display the user interface related to the second product (S940). For example, the product tab menu corresponding to the second processing device 20 can be activated and displayed when selected in the first area 410, and the selected product tab menu can be switched from the first processing device 10 to the second processing device 20. In addition, the detail screen corresponding to the second processing device 20 can be displayed in the second area 420.

[0276] At the same time, when the first product is turned off while the second product is turned on (S950), the user interface associated with the first product can be disabled (S960).

[0277] Subsequently, when the second product is turned off (S970), the display 221 can also be turned off (S980).

[0278] Meanwhile, in the state where only the first product is on and the second product is off (S930), when the first product is turned off (S990), the display 221 can be turned off (S980).

[0279] Figures 10 to 26 The figures mentioned in the description of a method of operating a household appliance according to embodiments of the present disclosure illustrate various user interfaces.

[0280] In this disclosure, the form or order of widgets or content can be variably or adaptively configured according to the specific use case of the product. In other words, effective information and functions can be provided based on the current state of the product, and the functions required under the product conditions can be prioritized to improve usability. Furthermore, functions can be highlighted and provided according to their usage frequency or importance.

[0281] In addition, widgets or content can be created based on the specific use case of the product.

[0282] Figure 10 and Figure 11 The examples show how widgets or content change in form and layout depending on the changing conditions.

[0283] When performing product functions, a progress bar can be generated along with product operation time information.

[0284] Figure 10 (a) shows an example of the washing machine part 1010 before performing a standard washing process. Figure 10(b) shows an example of the washing machine part 1020 during a standard washing process.

[0285] Before executing a standard washing process, the washing machine widget 1010 may display, within a first dimension, at least one of the following: the name of the selected standard washing process, the estimated time required, and the operation buttons. This may correspond to the entire displayed widget or certain text areas within the widget.

[0286] Users can select the "All Processes" option within the washing machine widget 1010 to choose another washing process before executing the standard washing cycle. Furthermore, even after executing the standard washing cycle, users can select the "All Processes" option within the washing machine widget 1010 to cancel the standard washing cycle or choose another washing process.

[0287] In addition, in response to the execution of a specific electronic product's function, a widget related to the function being executed can be displayed, and a progress bar can be generated to visually indicate the operation time information and progress status of the function being executed.

[0288] After receiving a command for process operation, the washing machine widget 1020, after executing a standard washing process, can display the name of the standard washing process being executed. Furthermore, the size of the washing machine widget 1020 can be reduced from a first size to a second size, and a progress bar 1030 can be displayed on one side of the widget 1020 along with the product operation time. The product operation time is displayed on the progress bar 1030 in a third size smaller than the second size, allowing the user to intuitively identify the progress status.

[0289] For example, the progress bar 1030 can be displayed on the bottom of the washing machine widget 1020. Alternatively, the progress bar 1030 can be displayed on the top, left, or right side of the washing machine widget 1020. Figure 11 (a) shows an example of the upper oven widget 1110 before performing the hot air or convection function, which uses a fan to circulate hot air inside the oven to ensure even cooking. Figure 11 (b) shows an example of the upper oven component 1120 after the hot air function has been performed.

[0290] Before the hot air function is activated, the upper oven widget 1110 can display the name of the selected hot air function and the estimated temperature.

[0291] During the hot air function, the upper oven widget 1120 can display the name of the hot air function being performed. Furthermore, as the size of the upper oven widget 1120 decreases, a progress bar 1030 containing product operation time information is displayed on the lower side of the upper oven widget 1120, allowing the user to intuitively identify the progress status.

[0292] When certain conditions are met, command buttons related to the widget's functions can be generated.

[0293] Figure 12 (a) shows an example of a weather widget 1010. When the weather widget 1010 is displayed, a recommendation process button 1230 related to at least one of the products connected to the physical / electrical / communication ground can be displayed when certain weather conditions are met.

[0294] refer to Figure 12 (b) The weather widget 1220 is displayed in a reduced size corresponding to the size of the recommended progress button 1230. The recommended progress button 1230 may be displayed below the reduced weather widget 1220.

[0295] The "Recommended Processes" button (1230) can not only recommend specific processes, but also serve as a shortcut button for recommended processes, allowing users to execute recommended processes with minimal operations. For example, ... Figure 12 As shown in (b), the recommended process button 1230 can be a shortcut to execute a clothes drying process based on information provided by the weather widget 1220.

[0296] Figure 13 (a) shows an example of detergent part 1310 and fabric softener part 1320. Figure 13 (b) shows the detergent component 1330 and fabric softener component 1340 when the remaining amount threshold is reached.

[0297] When the remaining amount threshold is reached, the detergent widget 1330 and fabric softener widget 1340 can respectively display a shortage notification message for the corresponding detergent or fabric softener, as well as a button for ordering more products. Therefore, users can not only check if the detergent or fabric softener level is low, but also order the missing product with minimal operations.

[0298] Beyond the examples related to washing machines, the embodiments can also be applied to ordering consumable products such as water purifiers or dishwashers. For instance, when a remaining quantity threshold is reached, as in the example above, an order button for the associated consumable product (e.g., water filter, air filter, etc.) can be generated in the widget.

[0299] According to another embodiment, when additional products are connected, the widget functionality can be separated and displayed.

[0300] Figure 14 An exemplary user interface for a garment handling device configured as a washer-dryer combo is shown, and Figure 15 An exemplary user interface is shown when an additional washing device is added to the bottom of the garment handling device.

[0301] refer to Figure 14 The quick settings widget 1410 can display six quick settings items for the washing machine.

[0302] refer to Figure 15 When an additional washing device (e.g., a small washer) is connected, the quick setting widget 1510 can display three quick settings for the additional washing device. Therefore, the number of quick settings for the washing device can be reduced to three. As the number of additional connected appliances increases, the number of setting icons corresponding to each product within a specific widget can be reduced.

[0303] Furthermore, the placement of quick settings can vary depending on the arrangement of the connected washer-dryer combo and additional washing equipment, thus intuitively indicating which product the command button is associated with.

[0304] Reference Figure 14 The intelligent diagnostic widget 1420 displays a button for performing intelligent diagnostics on the washer-dryer combo.

[0305] Reference Figure 15 When an additional washing device is connected, the smart diagnostic widget 1520 can display buttons for performing smart diagnostics on the washer-dryer combo and for performing smart diagnostics on the additional connected washing device.

[0306] Furthermore, in the intelligent diagnostic component 1520, command buttons corresponding to the washer-dryer combo unit arranged on the upper side can be provided facing upwards, and command buttons corresponding to the additional washing equipment arranged on the lower side can be provided facing downwards.

[0307] Command buttons can be located anywhere adjacent to the button, not just below it.

[0308] At the same time, when registering additional products, a product tab menu corresponding to the registered additional products can be automatically generated.

[0309] In the case of widgets that share common functions with products that are physically, electrically, or communicatively connected, when registering additional products, command buttons corresponding to the additional registered products can be created.

[0310] For reference Figures 10 to 15 As described, by adaptively providing functionality based on user scenarios, users can use home appliances in an intuitive and efficient manner.

[0311] When the display 221 adaptively adjusts the information configuration, arrangement, and button functions of the widgets according to the context, it allows users to utilize these functions more intuitively and flexibly.

[0312] When product usage conditions or specific circumstances are met, the information content, layout, and arrangement of widgets can be dynamically changed, allowing users to immediately view the information most suitable for the current situation and quickly access necessary functions.

[0313] Furthermore, the user interface screen can be adaptively configured as needed, thereby improving user convenience. For example, the order of widgets / content can be changed to provide more important and relevant functions and information. Therefore, without needing to learn fixed information, users can easily and quickly perform desired tasks through functions that are adaptively reconfigured based on usage.

[0314] When displaying multiple widgets, the widgets can be arranged based on at least one of the following: the relevance order of a specific electronic product, the relevance order of a specific operation process, a preset priority, and the order of downloaded widgets.

[0315] For example, when the widget tab menu 413 is selected during product control, multiple widgets displayed in the second area 420 can be arranged in an order highly relevant to the product being controlled.

[0316] By moving widgets associated with the product the user currently intends to operate to the front of the layout sequence, features that enable easy and quick execution of desired tasks can be prioritized, resulting in a smarter and more personalized user experience.

[0317] Furthermore, when the widget tab menu 413 is selected during the control of a specific operation process, the multiple widgets displayed in the second area 420 can be arranged in an order highly relevant to the specific operation process.

[0318] In other embodiments, multiple widgets can be sorted or arranged according to set priorities and the user's download order.

[0319] Figure 16 and Figure 17 An example is shown where the arrangement order of the widgets can be changed depending on the situation.

[0320] refer to Figure 16The user interface screen 1600 can display the quick setup widget 1610, the washer management widget 1620, the dryer management widget 1630, and the smart diagnostics widget 1640. The arrangement order of widgets 1610, 1620, 1630, and 1640 can be based on the default setting order or user-defined settings.

[0321] Depending on the size of the display 221 and the widget, a certain widget 1640 may not be displayed on the initial screen, such as Figure 16 and Figure 17 The shaded area is shown in the image. Additionally, a small widget 1630 can be partially displayed on the initial screen.

[0322] Because widgets 1630 and 1640, which have a lower setup order, are located in area 1650 that can be accessed via scrolling, it may be difficult or impossible to inspect and perform some or all of the widgets on the initial screen.

[0323] According to one situation, such as Figure 17 As shown, the user interface screen 1700 can be changed.

[0324] For example, when a product error occurs or predetermined diagnostic conditions are met, the intelligent diagnostic widget 1640 can be placed in the foreground to quickly begin the diagnostic process.

[0325] When the smart diagnostic widget 1640 moves to the front, the other widgets 1610, 1620, and 1630 can be moved back one position. Therefore, on the initial screen, the washing machine management widget 1620 can be partially displayed, while the dryer management widget 1630 can be omitted.

[0326] When necessary, users can scroll to access the undisplayed area 1750.

[0327] At the same time, when the number of times the washing machine or dryer is used reaches the reference number, the washing machine management component 1620 or the dryer management component 1630 can be moved to the front.

[0328] Figure 18 This illustrates the situation where new widgets are created.

[0329] When specific audio or video content is played by entering an entertainment widget, a "Play Now" widget 1830 can be generated and displayed in the widget area for quick inspection.

[0330] When playing specific audio or video content, the previously displayed widgets 1810 and 1820 can be moved back to ensure space 1850 in the foremost position and display the "Play Now" widget 1830.

[0331] Furthermore, the functionality of buttons can vary depending on the function of the widget. The workflow for using command buttons within a widget can also vary depending on the widget's function or theme. Therefore, unnecessary steps can be minimized, allowing for intuitive use of the functions.

[0332] refer to Figure 19 (a) Widgets 1910 and 1920 may include command buttons 1911 and 1921, respectively.

[0333] refer to Figure 19 (b) When the function of widgets 1910 and 1920 is a simple setting, feedback 1930 is provided within the widget tab screen for that setting.

[0334] For example, when the functions of widgets 1910 and 1920 are simple settings, the relevant settings can be applied when input is received on command buttons 1911 and 1921 without screen switching, and feedback in the form of notifications 1930 can be provided to the user.

[0335] refer to Figure 20 In (a) and (b), when an input unrelated to product function operation is performed on widget 2010 and widget 2010 corresponds to a type used to provide relevant details, the widget detail screen 2020 can be entered.

[0336] In addition, when the functions related to the widget require the appliance's program settings, you can switch the screen to the product tab to display the screen for setting up the appliance's program.

[0337] refer to Figure 21 (a) Widget 2110 may include command button 2111, and widget 2120 may include command buttons 2121 and 2122.

[0338] refer to Figure 21 (b) In the widget tab menu 413, the screen can switch to the product tab menu 411 corresponding to the input command button in command buttons 2111, 2121, and 2122. Alternatively, the screen can switch to the details screen 2130 corresponding to the product in command buttons 2111, 2121, and 2122.

[0339] At the same time, considering the physical characteristics of the product, the buttons within the widget can be displayed in a separated manner.

[0340] For example, refer to Figure 22 (a) The induction cooker component 2210 can arrange its internal objects with reference to the layout of the cooking area of ​​the induction cooker.

[0341] refer to Figure 22 (b) The refrigerator component 2220 may arrange its internal objects by taking into account the arrangement of the upper and lower compartments (e.g., the refrigerator compartment and the freezer compartment).

[0342] Reference Figure 22 (c) The dishwasher component 2230 can arrange its internal objects based on the arrangement positions of the top arm, upper arm, bottom arm, etc.

[0343] Figure 23 This shows an example of the process list editing screen. Figure 23 (a) shows an example of the washing machine's process editing screen 2310, while Figure 23 (b) shows an example of the process list editing screen 2320 for the dryer.

[0344] One or more items (or content items) displayed in the second area 420 when selecting product tab menus 411 and 412 may include the operation process.

[0345] The process list editing screen 2310 includes list items, which include checkboxes 2311 and process names 2312.

[0346] Items in the process list can be indicated as selected processes, unselected (cleared) processes, or required processes (not editable or inspectable).

[0347] Figure 23 An example is shown in which process 2316, selected by the user via checkbox 2311, is located between the required processes (standard wash and AI wash) 2315 and the required process (tub cleaning) 2317.

[0348] In the process list, the unselected process 2318 can be placed after the selected processes (including the required processes) 2315, 2316 and 2317.

[0349] Additionally, users can drag and drop one of the selected processes 2315, 2316, and 2317 to move them in the desired order.

[0350] Meanwhile, in the second region 420, processes 2315, 2316 and 2317 can be arranged according to the order in which the selected processes 2315, 2316 and 2317 are arranged in the process list.

[0351] Additionally, users can enable automatic process optimization. When this feature is enabled, the order of processes can be automatically changed based on the user's usage patterns.

[0352] At the same time, selecting the All Processes option 431 can provide a user interface screen that includes a list of all processes.

[0353] In the process list, processes can be arranged in a single column or multiple columns.

[0354] Menu objects for process filtering, such as "All" and "Recently Used," can be displayed on one side of the list. For example, when entering the All Processes screen, the "All" object (set as the default) can be automatically selected, and information corresponding to all processes can be displayed. When the user selects "Recently Used," only a predetermined number of recently used processes can be displayed through filtering. Menu items for process filtering (such as "All" and "Recently Used") can include topic labels. When an object with a topic label is touched, processes that meet the corresponding criteria can be selectively displayed.

[0355] Figures 24 to 26 The screen associated with the active product tab is displayed. Figure 24 An example of screen 2400 provided during the AI ​​drying process is shown.

[0356] refer to Figure 24 In the first area 2410, the progress (loop or menu) information of the product associated with the active product tab 2412 can be displayed in the second area 2420 within the tab menus 2411, 2412 and 2413.

[0357] In the second area 2420, information including the name of the operation process being executed 2421, the total time required 2422, and the current progress status 2423 can be displayed.

[0358] In addition, detailed (status) information 2425 of the loop being executed can be displayed in the second area 2420.

[0359] The current progress status 2423 can be displayed as a progress bar.

[0360] Detailed (status) information 2425 can be displayed above the progress bar.

[0361] Simultaneously, option buttons 2431 can be displayed in the third area 2430. Option buttons 2431 allow users to view detailed options for the currently running loop and to set input settings.

[0362] Figure 25 and Figure 26 User interface screens 2500 and 2600, respectively, are shown as the standard washing operation proceeds.

[0363] The washing machine product tab menu 2511 can be activated in the first area 2510. The option button 2531 can be displayed in the third area 2530.

[0364] The name of the operation process being executed (2521), the total time required (2522), information about the current progress status (2523), and detailed (status) information about the ongoing loop (2525) can be displayed in the second area (2520).

[0365] Detailed (status) information for the ongoing cycle 2525 can display the various stages of the washing process based on detailed option values.

[0366] refer to Figure 25 The detailed (status) information 2525 of the ongoing cycle can display one of the stages (such as washing 2525a, soaking 2525b and preliminary washing 2525c).

[0367] Figure 26 An example of the user interface screen 2600 is shown when the rinsing phase has been started.

[0368] refer to Figure 26 Depending on the set number of rinses, the detailed (status) information 2625 of the ongoing cycle can display one of the following: 3 rinses remaining 2625a, 2 rinses remaining 2625b, and 1 rinse remaining 2625c.

[0369] Figure 27 This is a flowchart illustrating a method of operating a household appliance according to an embodiment of the present disclosure.

[0370] refer to Figure 27 The display 221 can display a user interface screen including widgets (S2710).

[0371] For example, a user interface screen that includes widgets can be referenced above. Figure 5 User interface screens, etc.

[0372] For reference Figures 5 to 22 As described, at least one widget may contain a command button.

[0373] When multiple widgets are displayed, the order of the widgets can vary depending on whether the electronic product connected to the display 221 is in operation.

[0374] For example, when one or more electronic products connected to display 221 are in operation, the widgets associated with the operating electronic products can be arranged at the front of the sequence. When no electronic products are in operation, the most recently used or frequently used widgets can be arranged at the front of the sequence.

[0375] When a touch input is received on a command button included in the widget (S2720), the processor 210 can determine whether the conditions are met (S2730, S2740).

[0376] First, the processor 210 can determine whether the command button is associated with the function of a specific electronic product (S2730). Here, the specific electronic product can be an electronic product connected to the display 221 or an electronic product previously controlled via the user interface screen.

[0377] When the command button is related to a function of a specific product (yes at S2730), the processor 210 can determine whether the relevant function needs detailed settings (S2740).

[0378] The command button can be operated in different ways depending on whether the command button is related to the function of a specific electronic product (S2730) and whether detailed settings are required (S2740).

[0379] When the command button is related to the function of a specific electronic product (yes at S2730), and the related function requires detailed settings (yes at S2740), the display 221 can display a detailed settings screen for the function of the specific electronic product (S2750).

[0380] The display 221 can activate the product tab menu of a specific electronic product (S2745) and can display a detailed settings screen (S2750).

[0381] When the command button is related to the function of a specific electronic product (yes at S2730) and the relevant function does not require detailed settings (no at S2740), the display 221 can display execution information about the function of the specific electronic product (S2760).

[0382] The steps for displaying execution information can be shown in the widget tab menu. In other words, the display 221 can directly display the execution information in the current widget tab menu screen without switching to the screen corresponding to the product tab menu of a specific electronic product.

[0383] Execution information can be provided as a pop-up, or it can be displayed in the corresponding widget.

[0384] In contrast, when the command button is not related to the function of a specific electronic product (no at S2730), the display 221 can show a detail screen corresponding to the widget in the widget tab menu. For example, when the input is not related to the function of a home appliance (such as home appliance registration, smart diagnostic widget, providing detailed information (e.g., weather), or navigating to a webpage (third-party application)), a detail screen can be displayed (S2770).

[0385] For features requiring detailed settings, a detailed settings screen can be provided first. For features that do not require detailed settings, the feature can be executed directly, and execution information about the feature's execution can be provided. Therefore, user operations and screen transitions can be minimized.

[0386] Even when command buttons have the same display format, they can operate differently depending on their respective functions, thereby improving the user experience and achieving efficient product control.

[0387] While preferred embodiments of the present disclosure have been shown and described herein, the disclosure is not limited to the specific embodiments described above. It should be understood that various modifications and alterations can be made by those skilled in the art without departing from the spirit and scope of the disclosure as defined by the appended claims. Therefore, such modifications, alterations, and their equivalents should be considered to be included within the scope of this disclosure.

[0388] The foregoing description may be implemented as one or more computer programs, or as one or more combinations of computer programs, in a computer-readable storage medium.

[0389] The functionality of the components disclosed herein can be implemented by circuitry or processing circuitry including general-purpose processors, application-specific processors, integrated circuits, application-specific integrated circuits (ASICs), conventional circuitry, and / or combinations thereof. The circuitry can be a processor configured or programmed to perform the disclosed functionality.

[0390] A processor, including transistors and other circuitry, can be considered a processing circuit or circuit system. As used herein, the terms "circuit," "unit," or "device" can refer to hardware that performs or is programmed to perform the functions described in the detailed description. Hardware can be the hardware disclosed herein or other known hardware, and can be hardware programmed or configured to perform the functions described in the detailed description of the specification. When the hardware is a processor that can be considered a circuit type, the circuit, device, or unit can be software used to configure the hardware and / or the processor in conjunction with the hardware. Furthermore, the computer storage medium can be a non-transitory computer storage medium, which can be executed, for example, by a cloud server-based system.

[0391] Furthermore, the data described in the specification can be computed or executed in various environments such as cloud server-based systems, on-device systems, and distributed server systems (multiple servers). Data can be processed distributedly in a cloud server or executed locally by the on-device processor, and the results of processing in each environment can be stored in non-volatile memory.

[0392] A server (or server system) can be configured to send output data for display on a specific electronic device, home appliance, or user monitor. In another example, a server can be configured as a set of computer-readable instructions, such as one or more computer programs that constitute the output data. Computer programs can be written in any type of programming language and in any programming paradigm, such as declarative, procedural, assembly, object-oriented, data-oriented, functional, or imperative. Computer programs can be written to perform one or more other functions and operate in a computing environment (e.g., on a physical device, a virtual machine, or across multiple devices). Therefore, the functions described herein can be implemented by computer programs, for example, executed by a system, engine, module, or model.

[0393] Server computing devices can be implemented on one or more devices having one or more processors at one or more locations. User computing devices or server computing devices can be communicatively connected to one or more storage devices via a network. Storage devices can be a combination of volatile and non-volatile memory and can reside in the same or different physical locations as the computing devices. For example, storage devices can include various storage drives, such as drives, solid-state drives, magnetic tape drives, optical storage, memory cards, ROM, RAM, DVDs, or CD-ROMs, or readable media within drives. In other words, storage devices can be any type of non-transitory computer storage device capable of storing long-term dedicated data.

[0394] Electronic devices (such as home appliances) and server computing devices can be connected to one or more storage devices via a network. The storage devices can be a combination of volatile and non-volatile memory and may or may not reside in the same physical location as the computing devices.

[0395] Server computing devices may include one or more processors and memory. The memory stores information accessible to the processor and may include data that can be processed, stored, or modified by processor-executable instructions. The memory may include volatile and non-volatile memory. The processor may include a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), an application-specific integrated circuit (ASIC), or a tensor processing unit (TPU).

[0396] Instructions can be configured to perform specific operations when executed by a processor and can be stored as object code or in an interpretable script format. Such instructions can be used to implement a system and can be executed on a local or remote processor. Data can be retrieved, stored, or modified according to instructions and can be structured in database, JSON, YAML, or XML formats.

[0397] Electronic devices, including home appliances and hubs, can be configured similarly to server computing devices. In addition to processors, memory, instructions, and data, such electronic devices may also include user input and output devices. The server computing device can transmit data to the electronic device, and the electronic device can display at least a portion of the received data via a display. Furthermore, communication and data transmission between the server computing device and the electronic device can be performed via networks such as Bluetooth, Wi-Fi, wired or wireless networks, and various protocols and connectivity methods can be used to support direct or indirect communication between the computing devices.

Claims

1. A method for operating a household appliance, the method comprising: The user interface screen includes a first area and a second area. The first area includes a product tab menu and a widget tab menu. The second area is used to display information based on one of the product tab menu and the widget tab menu. Receive signals based on user input associated with one or more electronic products connected to the home appliance; as well as The configuration of the first or second area of ​​the displayed user interface screen is changed based on the received signal.

2. The method according to claim 1, further comprising activating a product tab menu in the product tab menu corresponding to the power-on of a product among the one or more electronic products, and in, The activated product tab menu is displayed visually distinct from other product tab menus.

3. The method of claim 1, further comprising displaying information including one or more content items in the second area based on the selection of the product tab menu, and in, The one or more content items include information on at least the status or function of the electronic product corresponding to the selected product tab menu.

4. The method of claim 1, further comprising displaying in the second area information including at least one widget associated with at least one of the one or more electronic products included in the product tab menu.

5. The method according to claim 4, wherein, The at least one component includes a command button corresponding to the function of the at least one electronic product in the one or more electronic products, and The method also includes performing the function of the at least one electronic product in response to receiving touch input via the command button.

6. The method according to claim 4, wherein, The method further includes: Since the execution of the aforementioned function requires detailed settings for that function, the method also includes: Activate the product tab menu of the at least one electronic product in the first area, and display a detailed settings screen for the functions of the at least one electronic product in the second area; and The widget displays information related to the execution of the function.

7. The method according to claim 4, wherein, The at least one widget includes a command button, and the method further includes displaying a detailed screen corresponding to the widget in the second area in response to a selection received via the command button.

8. The method according to claim 4, further comprising: Receive selections from the widget's tab menu; as well as The at least one widget displayed in the second area is arranged based at least on the relevance order of a specific electronic product, the relevance order of a specific operation process, a preset priority, or the order of downloaded widgets.

9. A household appliance, said household appliance comprising: monitor; One or more processors; as well as A memory storing instructions that, when executed by the one or more processors, cause the one or more processors to: The display shows a user interface screen, which includes a first area and a second area. The first area includes a product tab menu and a widget tab menu, and the second area is used to display information based on one of the product tab menu and the widget tab menu. Receive signals based on user input associated with one or more electronic products connected to the home appliance; and The configuration of the first or second area of ​​the displayed user interface screen is changed based on the received signal.

10. A non-transitory computer-readable storage medium storing instructions for operating a household appliance, the instructions causing the one or more processors, when executed, to: The user interface screen includes a first area and a second area. The first area includes a product tab menu and a widget tab menu. The second area is used to display information based on one of the product tab menu and the widget tab menu. Receive signals based on user input associated with one or more electronic products connected to the home appliance; as well as The configuration of the first or second area of ​​the displayed user interface screen is changed based on the received signal.

Images