Electronic device and control method thereof

Abstract

An electronic device is disclosed. The electronic device includes: a display, which is set on the front surface of the electronic device; a memory; a communication interface, which includes a circuit; and a processor, which is used to provide a board screen on the display, when an image is received through the communication interface, identify the display size of the image based on the resolution information of the image, add the image to the board screen based on the identified display size, when a first touch input for the image is detected, adjust at least one of the display position or the display size of the image to correspond to the first touch input, and when a second touch input for the board screen is detected, add a drawing object corresponding to the second touch input to the board screen.

Description

Technical Field

[0001] The present disclosure relates to a home appliance and a control method thereof, and more particularly, to a home appliance including a display and a control method thereof. Background Art

[0002] As electronic technology develops, various types of electronic devices are being developed and distributed.

[0003] In particular, various home appliances recently distributed to homes can transmit and receive data with each other by combining the Internet of Things technology, and through such transmission and reception of data, the use of home appliances has also become diversified.

[0004] In the case of a refrigerator, in addition to its conventional role of storing food, it can also serve as a hub for providing information to family members. For example, a refrigerator can include a display and provide news, recipes, schedules, etc. to family members.

[0005] However, although conventional home appliances provide information through displays combined with the Internet of Things, the home appliances only provide news, recipes, etc. within a template with a limited format. In addition, conventional home appliances have a problem in that there are limitations in the format in which users can freely add images, sketches, etc.

[0006] Therefore, there has arisen a need for a technology of freely adding and editing a schedule, an image, a to-do list, etc. through a display included in a home appliance. Summary of the invention

[0007] Technical issues

[0008] The present disclosure is to solve the above-mentioned needs, and an object of the present disclosure is to provide a home appliance and a control method thereof, which add an image, a sketch, a drawing, etc. to the home appliance through a board screen.

[0009] Technical Solution

[0010] A household appliance according to the present disclosure for achieving the above-mentioned purpose includes a display arranged on the front surface of the household appliance, a memory, a communication interface including a circuit, and a processor, wherein the processor is configured to: provide a board screen on the display; based on receiving an image through the communication interface, identify the display size of the image based on the resolution information of the image, and add the image to the board screen based on the identified display size; based on detecting a first touch input to the image, adjust at least one of the display position or display size of the image to correspond to the first touch input; and based on detecting a second touch input to the board screen, add a drawing object corresponding to the second touch input to the board screen, wherein the processor stores information of the image added to the board screen and information of the drawing object in the memory.

[0011] Here, the information of the image may include at least one of the file path of the image, the file type of the image, coordinate information of the image added to the board screen, or size information of the image, and the information of the drawing object may include at least one of the shape information of the drawing object or coordinate information of the drawing object added to the board screen.

[0012] In addition, the processor can capture the board screen and obtain a captured image of the board screen according to an event arriving at a predetermined cycle or an event of selecting a storage menu, and control the communication interface to send the captured image, image information, and drawing object information to the server.

[0013] In addition, the processor may store information of the board screen provided on the display in the memory based on receiving a command for providing a new board screen, and then provide the new board screen through the display, and the information of the board screen may include at least one of a captured image of the board screen, information of the image, or information of a drawing object.

[0014] Here, the processor may transmit information of the board screens stored in the memory to the server through the communication interface based on the number of board screens stored in the memory exceeding a threshold number.

[0015] In addition, the processor can provide an icon for executing any one of a plurality of applications included in the memory on the board screen, and based on a user command to select the icon being input, control the display to display an execution screen of the application corresponding to the selected icon in an area on the board screen.

[0016] In addition, the memory can store corresponding user identification information and user device information corresponding to multiple users, and the processor can identify text corresponding to the drawing object, identify at least one user among the multiple users based on the text and the stored user identification information, and send information related to the drawing object through the communication interface based on the user device information corresponding to the identified user.

[0017] Furthermore, the processor may recognize text corresponding to the drawing object, and change the drawing object into a text object of a predetermined font based on the recognized text.

[0018] Furthermore, the processor may control the display to display a captured image corresponding to the stored board screen and a list including information on a generation time point and a storage time point of the stored board screen based on receiving a command for loading information of the board screen stored in the memory.

[0019] In addition, the home appliance may include a sensor, and the processor may control the display to display the board screen before the display is turned off based on the stored information of the board screen, based on detecting a user through the sensor in a standby mode in which the display is turned off.

[0020] At the same time, a control method for a household appliance according to an embodiment of the present disclosure includes the following steps: providing a board screen on a display set on the front surface of the household appliance; based on receiving an image, identifying the display size of the image based on resolution information of the image; adding the image to the board screen based on the identified display size; based on detecting a first touch input to the image, adjusting at least one of the display position or display size of the image to correspond to the first touch input; based on detecting a second touch input to the board screen, adding a drawing object corresponding to the second touch input to the board screen; and storing information of the image added to the board screen and information of the drawing object.

[0021] Here, the information of the image may include at least one of the file path of the image, the file type of the image, coordinate information of the image added to the board screen, or size information of the image, and the information of the drawing object may include at least one of the shape information of the drawing object or coordinate information of the drawing object added to the board screen.

[0022] In addition, the control method may include the following steps: capturing the board screen and acquiring a captured image of the board screen according to an event arriving at a predetermined cycle or an event of selecting a storage menu; and sending the captured image, image information, and drawing object information to a server.

[0023] In addition, the control method may include the following steps: based on receiving a command for providing a new board screen, storing information of the board screen provided on the display, and then providing the new board screen through the display. Here, the information of the board screen may include at least one of a captured image of the board screen, information of the image, or information of a drawing object.

[0024] In addition, the control method may include the step of transmitting information of the board screen stored in the home appliance to the server based on the number of board screens stored in the home appliance exceeding a threshold number.

[0025] Furthermore, the control method may include providing an icon for executing any one of a plurality of applications on the board screen, and displaying an execution screen of an application corresponding to the selected icon in an area on the board screen based on a user command to select the icon being input.

[0026] At the same time, the household appliance can store corresponding user identification information and user device information corresponding to multiple users, and the control method according to the embodiment of the present disclosure may include the following steps: identifying text corresponding to the drawing object, identifying at least one user among the multiple users based on the text and the stored user identification information, and sending information related to the drawing object based on the user device information corresponding to the identified user.

[0027] Furthermore, the control method may include the steps of recognizing text corresponding to the drawing object, and changing the drawing object into a text object of a predetermined font based on the recognized text.

[0028] In addition, the control method may include the following steps: based on receiving a command for loading information of a board screen stored in the home appliance, displaying a captured image corresponding to the stored board screen and a list including information about a generation time point and a storage time point of the stored board screen.

[0029] Furthermore, the control method may include the step of displaying the board screen before the display is turned off based on the stored information of the board screen, based on detecting a user through a sensor provided in the home appliance in a standby mode in which the display is turned off.

[0030] Advantageous Effects of the Invention

[0031] According to various embodiments of the present disclosure as described above, instead of adding an image, a sketch, or the like within a template having limitations in terms of format, a user can freely add various types of objects on a display. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 is a schematic diagram showing the appearance of a home appliance according to an embodiment of the present disclosure.

[0033] Figure 2 is a block diagram showing a configuration of a home appliance according to an embodiment of the present disclosure.

[0034] Figure 3 is a block diagram illustrating a detailed configuration of a home appliance according to an embodiment of the present disclosure.

[0035] Figure 4 is a schematic diagram for explaining a panel screen and an image according to an embodiment of the present disclosure.

[0036] Figure 5 is a schematic diagram for explaining a drawing object according to an embodiment of the present disclosure.

[0037] Figure 6 is a schematic diagram for explaining information about an object according to an embodiment of the present disclosure.

[0038] Figure 7 is a schematic diagram for explaining information on a board screen according to an embodiment of the present disclosure.

[0039] Figure 8 is a schematic diagram for explaining icons according to an embodiment of the present disclosure.

[0040] Fig. 9 is a schematic diagram for explaining a home appliance and a server according to an embodiment of the present disclosure.

[0041] Fig.10 is a schematic diagram for illustrating a home appliance and a user device according to an embodiment of the present disclosure.

[0042] Fig.11 2 is a schematic diagram for explaining a board screen list according to an embodiment of the present disclosure.

[0043] Fig.12 is a flowchart for illustrating a control method of a home appliance according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0044] Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.

[0045] As the terms used in the embodiments of the present disclosure, taking into account the functions described in the present disclosure, currently widely used general terms are selected as much as possible. However, these terms may change according to the intentions of those skilled in the art in the relevant field, previous court decisions or the emergence of new technologies. In addition, in certain cases, there are terms specified by the applicant himself, in which case the meanings of these terms will be described in detail in the relevant description of the present disclosure. Accordingly, the terms used in the present disclosure should be defined based on the meaning of the terms and the overall content of the present disclosure, and cannot be defined solely based on the names of the terms.

[0046] In this specification, expressions such as "having", "may have", "including" and "may include" should be interpreted as indicating the existence of such features (for example, elements such as values, functions, operations and components), and these expressions are not intended to exclude the existence of additional features.

[0047] Furthermore, the expression “at least one of A and / or B” should be interpreted as meaning any one of “A” or “B” or “A and B”.

[0048] In addition, the expressions "first", "second", etc. used in this specification may be used to describe various elements, regardless of any order and / or degree of importance. Moreover, such expressions are only used to distinguish one element from another element and are not intended to limit these elements.

[0049] At the same time, the description in the present disclosure that an element (e.g., a first element) is "(operably or communicatively) coupled to / coupled to" or "connected to" another element (e.g., a second element) should be interpreted as including the following two cases: one element is directly coupled to another element; and one element is coupled to another element through yet another element (e.g., a third element).

[0050] In addition, singular expressions include plural expressions unless clearly defined differently in the context. In addition, in the present disclosure, terms such as "including" and "consisting of" should be interpreted as indicating the presence of such features, quantities, steps, operations, elements, components, or combinations thereof described in the specification, but do not preclude the possibility of the presence or addition of one or more other features, quantities, steps, operations, elements, components, or combinations thereof.

[0051] In addition, in the present disclosure, a "module" or "component" performs at least one function or operation and can be implemented as hardware or software, or a combination of hardware and software. Further, in addition to the "module" or "component" that needs to be implemented as specific hardware, multiple "modules" or "components" can be integrated into at least one module and implemented as at least one processor (not shown).

[0052] Meanwhile, in this specification, the term "user" may refer to a person using an electronic device or a device using an electronic device (eg, an artificial intelligence electronic device).

[0053] Hereinafter, embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings.

[0054] Figure 1 is a schematic diagram showing the appearance of a home appliance 100 according to an embodiment of the present disclosure.

[0055] The household appliance 100 according to various embodiments of the present specification may include, for example, a smart phone, a tablet PC, a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop PC, a netbook, a workstation, a server, a PDA, a portable multimedia player (PMP), an MP3 player, a medical device, a camera, or a wearable device. Here, the wearable device may include at least one of the following items: an accessory type device (e.g., a watch, a ring, a bracelet, an anklet, a necklace, glasses, contact lenses, or a head-mounted device (HMD)), a device integrated with fabric or clothing (e.g., electronic clothing), a body attachment device (e.g., a skin pad or a tattoo), or an implantable circuit. In addition, in some embodiments, the household appliance 100 may include at least one of the following items: for example, a television, a digital video disk (DVD) player, an audio device, a refrigerator, an air conditioner, a cleaner, an oven, a microwave oven, a washing machine, an air purifier, a set-top box, a home automation control panel, a security control panel, a media box (e.g., a Samsung Home Sync Controller), ... TM , Apple TV TM or Google TV TM ), game consoles (e.g., Xbox TM , PlayStation TM ), electronic dictionary, electronic key, camera or electronic photo frame.

[0056] In the following, for the sake of convenience, the household appliance 100 is limited to a refrigerator for explanation, but this is only one embodiment, and the present disclosure is obviously not limited thereto. In addition, it is obvious that the household appliance 100 according to the embodiment of the present disclosure can be implemented as various forms of household appliances 100, which can provide a screen through the display 110.

[0057] Reference Figure 1 , the home appliance 100 may include a main body whose front surface is opened, a storage chamber formed inside the main body and in which food is refrigerated and / or preserved, and a door which opens and closes the opened front surface of the main body.

[0058] Here, the main body may form an appearance of the home appliance 100. The main body may include an inner cabinet forming a storage room and an outer cabinet combined with the inner cabinet and forming an appearance of the main body.

[0059] The storage room can be divided into a plurality of storage rooms by horizontal partitioning and vertical partitioning. For example, the storage room can be divided into an upper storage room and a lower storage room, and shelves, closed containers, etc. can be arranged in the storage room.

[0060] The storage room can be opened and closed by the door. For example, one area of ​​the upper storage room can be opened and closed by the upper first door, and the remaining area of ​​the upper storage room can be opened and closed by the upper second door. In addition, one area of ​​the lower storage room can be opened and closed by the lower first door, and the remaining area can be opened and closed by the lower second door.

[0061] The door may include a handle so that the door can be easily opened and closed. For example, a handle may be formed long in the up-down direction between the first door at the top and the second door at the top, and a handle may be formed long in the up-down direction between the first door at the bottom and the second door at the bottom.

[0062] In particular, the home appliance 100 according to an embodiment of the present disclosure may include a display 110 disposed on a front surface. Figure 1 , the display 110 may be provided in one area of ​​the front surface of the door. The home appliance 100 according to the embodiment of the present disclosure may provide various screens through the display 110. Hereinafter, various screens provided through the display 110 will be described.

[0063] Figure 2 is a block diagram showing a configuration of a home appliance according to an embodiment of the present disclosure.

[0064] Reference Figure 2 , the home appliance 100 includes a display 110 , a memory 120 , a communication interface 130 and a processor 140 .

[0065] The display 110 may be implemented as various forms of displays, such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a plasma display panel (PDP), etc. In the display 110, a driving circuit and a backlight unit, etc., which may be implemented in forms such as a-si TFT, low temperature polysilicon (LTPS) TFT, organic TFT (OTFT), etc., may also be included together. Meanwhile, the display 110 may also be implemented as a touch screen combined with a touch sensor, a flexible display, a 3D display, etc.

[0066] In addition, the display 110 according to the embodiment of the present disclosure may include not only a display panel for outputting an image, but also a frame for accommodating the display panel. In particular, the frame according to the embodiment of the present disclosure may include a touch sensor for detecting user interaction. In the following, for ease of description, the display 110 will be described based on the assumption that it is implemented as a touch screen display.

[0067] The display 110 according to the embodiment of the present disclosure can receive a user's touch input and send an electrical signal corresponding to the received touch input to the processor 140. For example, the display 110 can detect the user's touch on the display 110 according to a change in resistance value or a change in electrostatic capacity, and send an electrical signal corresponding to the coordinates of the touch point to the processor 140. Then, the processor 140 can identify the coordinates of the user's touch point based on the received electrical signal. At the same time, this is only an embodiment, and the display 110 can obviously be implemented as a touch screen display including various forms of touch panels that can detect user touches.

[0068] For user convenience, the display 110 according to the embodiment of the present disclosure can be installed on the door. For example, the display 110 can be set on any one of the first door or the second door of the upper part for opening and closing the upper storage chamber. At the same time, this is just an embodiment, and the present disclosure is not limited thereto. For example, the display 110 can obviously be set on any one of the first door or the second door of the lower part.

[0069] The memory 120 stores various data, such as an operating system (O / S) software module for operating the home appliance 100, various multimedia contents, etc. In particular, the memory 120 can store information about the board screen and images, drawing objects, etc. added to the board screen. A detailed description of the board screen will be made later.

[0070] The communication interface 130 including circuits is a component for communicating with various types of external devices according to various types of communication methods. In particular, the communication interface 130 can communicate with user terminal devices, servers, etc., and transmit and receive various data such as images, texts, etc.

[0071] The processor 140 controls the overall operation of the home appliance 100 .

[0072] According to an embodiment of the present disclosure, the processor 140 may be implemented as a digital signal processor (DSP), a microprocessor, and a time controller (TCON). However, the present disclosure is not limited thereto, and the processor 140 may include one or more of a central processing unit (CPU), a microcontroller unit (MCU), a microprocessing unit (MPU), a controller, an application processor (AP), a graphics processing unit (GPU), or a communication processor (CP) and an ARM processor, or may be defined by terms. In addition, the processor 140 may be implemented as a system on chip (SoC) or a large-scale integrated circuit (LSI) in which a processing algorithm is stored, or implemented in the form of a field programmable gate array (FPGA). The processor 140 may perform various functions by executing computer executable instructions stored in the memory 120. The processor 140 accesses the memory 120 and performs booting by using the O / S stored in the memory 120. Then, the processor 140 performs various operations by using various programs, content data, etc. stored in the memory 120.

[0073] In particular, the processor 140 may provide a board screen through the display 110. Here, the board screen refers to a screen to which various still images, moving images, memos, drawings (or sketches), or applications, etc. may be added without being restricted by format and position. For example, in the past, a screen may add contents such as memos, drawings, and images only to a predetermined area based on a specific template, but a board screen refers to a screen to which various contents may be freely added without being restricted by position, such as a whiteboard.

[0074] Here, the board screen may also be referred to as a home board, a display screen, a main screen, etc., but in the following, for the sake of convenience of explanation, it will be collectively referred to as a board screen.

[0075] If an image is received through the communication interface 130, the processor 140 according to an embodiment of the present disclosure may identify the display size of the image based on the resolution information of the image, and add the image to the board screen based on the identified size. Figure 4 Provide detailed explanation on this.

[0076] Figure 4 is a schematic diagram for explaining a panel screen and an image according to an embodiment of the present disclosure.

[0077] Reference Figure 4, the board screen 10 according to an embodiment of the present disclosure may provide only the minimum objects before adding the image 20. For example, the processor 140 may provide the current time, location, temperature, etc. through the board screen 10. Then, if the image 20 is received, the processor 140 may add the image 20 to the board screen 10. Here, the processor 140 may set the display size of the image 20 based on the resolution information of the received image 20. For example, if the resolution of the image 20 is 4K (3840×2160), the processor 140 may change the size of the image 20 to a predetermined first size and add the image 20 to the board screen 10. For another example, if the resolution of the image 20 is FHD (1920×1080), the processor 140 may change the size of the image 20 to a predetermined second size and add the image 20 to the board screen 10. Here, the predetermined first size may be relatively larger than the predetermined second size.

[0078] The processor 140 according to an embodiment of the present disclosure may add the received image 20 to any position on the board screen 10. As another example, the processor 140 may add the received image 20 to a predetermined position on the board screen 10. Meanwhile, as will be described below, the processor 140 may obviously adjust the position or size of the image 20 on the board screen 10 differently according to a touch input for the image 20.

[0079] Reference Figure 4 , if a first touch input for image 20 is detected, the processor 140 may adjust at least one of the position or size of image 20 to correspond to the first touch input. For example, if the first touch input is a pinch, the processor 140 may enlarge the size of image 20 to correspond to the pinch input. As another example, if the first touch input is an expansion, the processor 140 may reduce the size of image 20 to correspond to the expansion input. In addition, if the first touch input is a drag, the processor 140 may adjust the position of image 20 to correspond to the drag input. Here, a pinch may refer to a touch input in which two fingers of a user are brought close to each other, and an expansion may refer to a touch input in which two fingers of a user are moved away from each other.

[0080] Then, the processor 140 may display, through the board screen 10 , the image 20 ′ in which at least one of a position or a size is adjusted according to the first touch input.

[0081] Meanwhile, the processor 140 according to an embodiment of the present disclosure may limit the number of images 20 added to the board screen 10. For example, if a plurality of images exceeding a predetermined number are added to the board screen 10, the processor 140 may provide an alarm or notification. Meanwhile, this is only one embodiment, and the processor 140 may obviously add a plurality of images to the board screen 10 without a limit on the number.

[0082] return Figure 2 , if a second touch input to the board screen 10 is detected, the processor 140 according to an embodiment of the present disclosure may add a drawing object corresponding to the second touch input to the board screen 10. Figure 5 Provide detailed explanation on this.

[0083] Figure 5 is a schematic diagram for explaining a drawing object according to an embodiment of the present disclosure.

[0084] Reference Figure 5 , if the second touch input is a drag, the processor 140 may generate a drawing object 30 to correspond to the drag input of the predetermined thickness and the predetermined color. Here, the drag may refer to a touch input in which the user's finger moves continuously without being disconnected. The processor 140 according to an embodiment of the present disclosure may display a UI for changing the predetermined thickness and the predetermined color in one area on the board screen 10. Obviously, the touch may be performed by a touch pen or the like instead of the user's finger. Meanwhile, the second touch input may be various forms of touch input other than the drag, such as translation, sliding, flicking, etc., and the processor 140 may generate a drawing object 30 corresponding to such various forms of touch input.

[0085] return Figure 2 , the processor 140 according to an embodiment of the present disclosure may store information of the image 20 added to the board screen 10 and information of the drawing object 30 in the memory 120. Figure 6 The information about the image 20 and the information about the drawing object 30 are described in detail.

[0086] Figure 6 is a schematic diagram for explaining information about an object according to an embodiment of the present disclosure.

[0087] Reference Figure 6 , the processor 140 may include at least one of the following items as information of the image 20 added to the board screen 10: an identification number (object_id) of the image 20, a file path (data_source_id, data_source_file), coordinate information (x, y) of the image 20 added to the board screen 10, or size information (width, height, angle) of the image 20.

[0088] Here, the image 20 may be an image 20 received from an external electronic device (not shown) communicating with the home appliance 100. For example, if the home appliance 100 is implemented as a refrigerator, the refrigerator may register user terminal devices of each family member of the home where the refrigerator is located. Then, the refrigerator may add the image (still image, moving image, etc.) received from the registered user device to the board screen 10.

[0089] According to an embodiment of the present disclosure, the processor 140 may include at least one of the following items as information of the drawing object 30 added to the board screen 10: an identification number (object_id) of the drawing object 30, shape information (frame_style) of the drawing object 30, coordinate information (x, y) of the drawing object 30, or size information (width, height, angle) of the drawing object 30.

[0090] at the same time, Figure 6 The information about the object shown is not limited to the information about the image 20 and the drawing object 30. For example, the memory 120 may obviously store information about various forms of objects, memos, applications, texts, etc. that can be added to the board screen 10.

[0091] return Figure 2 , if a command for providing a new board screen is received, the processor 140 according to an embodiment of the present disclosure may store information about the board screen 10 provided on the display 110 in the memory 120 and then provide the new board screen through the display 110. Here, the information about the board screen 10 may include at least one of the following items: a captured image about the board screen 10, information about the image 20 added to the board screen 10, or information about the drawing object 30. Figure 7 Provide detailed explanation on this.

[0092] Figure 7 is a schematic diagram for explaining information on a board screen according to an embodiment of the present disclosure.

[0093] refer to Figure 7, the information about the board screen 10 may include at least one of the following items: an identification number (board_id) of the board screen 10, a generation time point (create_time) of the board screen 10, a storage time point or a last update time point (update_time) of the board screen 10, a captured image (thumbnail_path) about the board screen 10, or information (object_id_list) of an object added to the board screen 10. Here, the captured image may refer to a thumbnail image of the board screen 10. The processor 140 according to an embodiment of the present disclosure may transmit the captured image of the board screen 10 to an external electronic device through the communication interface 130. Here, the external electronic device may refer to a user terminal device of a family member of the home where the home appliance 100 is located.

[0094] The command for providing a new board screen 10′ may be a command for storing the board screen 10 being displayed through the display 110 in the memory 120 and generating a new board screen 10′. When receiving the command, the processor 140 may store the board screen 10 and information about the board screen 10 currently being provided through the display 110 in the memory 120, and provide the new board screen 10′ through the display 110. Here, the new board screen 10′ may refer to a board screen to which only basic objects (e.g., current time, weather, etc.) are added without adding an image 20, a drawing object 30, a memo, an application, etc.

[0095] return Figure 2 , the processor 140 may provide an icon for executing any one of a plurality of application programs included in the memory 120 on the panel screen 10. Figure 8 Provide detailed explanation on this.

[0096] Figure 8 is a schematic diagram for explaining icons according to an embodiment of the present disclosure.

[0097] Reference Figure 8 , the processor 140 may display an icon 50 for executing an application on the board screen 10. Here, it is apparent that the icon 50 may be located not only in a predetermined area on the board screen 10 but also in all areas on the board screen 10. For example, if a user's touch to the icon 50 is input, the processor 140 may move the icon 50 to a position corresponding to the touch. The icon 50 may be positioned to overlap another object (e.g., the image 20, the drawing object 30, the memo 40, etc.).

[0098] If a user command to select the icon 50 is input, the processor 140 according to an embodiment of the present disclosure may display an execution screen of an application corresponding to the selected icon 50 in one area on the board screen 10. For example, if an icon corresponding to a music application is selected, the processor 140 may display the music application in one area on the board screen 10 and execute the application. The processor 140 may provide the application execution screen through one area on the board screen 10, not through a new screen.

[0099] If a touch input is received for the application execution screen, the processor 140 according to an embodiment of the present disclosure may adjust at least one of the position or size of the application execution screen to correspond to the touch input. For example, if the touch input is pinching or spreading, the processor 140 may enlarge or reduce the application execution screen. As another example, if the touch input is dragging, the processor 140 may adjust the position of the application execution screen to a position corresponding to the dragging.

[0100] return Figure 2 , the processor 140 according to an embodiment of the present disclosure may capture the board screen 10 according to an event in which a predetermined cycle arrives or an event in which a storage menu is selected, and acquire a captured image of the board screen 10. Then, the processor 140 may control the communication interface 130 to send the captured image, information of the image 20, and information of the drawing object 30 to the server. Fig. 9 Provide detailed explanation on this.

[0101] Fig. 9 is a schematic diagram for explaining a home appliance and a server according to an embodiment of the present disclosure.

[0102] Reference Fig. 9 , the processor 140 according to an embodiment of the present disclosure may store a plurality of panel screens 10-1, 10-2 in the memory 120. For example, the memory 120 may store information about a first panel screen 10-1 generated in the past and information about a second panel screen 10-2 currently being displayed.

[0103] If the currently displayed panel screen is the second panel screen 10-2, the processor 140 may store information about the second panel screen 10-2 in the memory 120 according to an event in which a predetermined cycle arrives. Here, it is apparent that the predetermined cycle may be set differently according to the setting of the manufacturer or the setting of the user (e.g., a cycle of one hour, a cycle of one day, etc.). As another example, if an event occurs in which a storage menu is selected according to a user command, the processor 140 may store information about the currently displayed second panel screen 10-2 in the memory 120. Here, the information about the second panel screen 10-2 may include a captured image obtained by capturing the second panel screen 10-2, information about the image 20 added to the second panel screen 10-2, and information about the drawing object 30 added to the second panel screen 10-2. Meanwhile, this is only an embodiment, and the present disclosure is not limited thereto. For example, it is apparent that both the information of the memo 40 and the information of the icon 50 may be included, and the generation time point, the storage time point, etc. of the second panel screen 10-2 may also be included.

[0104] Then, the processor 140 may control the communication interface 130 to transmit information about the board screen 10 to the server 200. For example, the processor 140 may transmit a captured image of the board screen 10, information of the image 20 added to the board screen 10, and information of the drawing object 30 to the server 200.

[0105] As another example, if the number of the board screens 10 stored in the memory 120 exceeds a threshold number, the processor 140 may control the communication interface 130 to transmit the information of the board screens stored in the memory 120 to the server 200. For example, it may be assumed that the memory 120 can store ten board screens 10-1, 10-2, ..., 10-10. If the number of the plurality of board screens stored in the memory 120 exceeds ten, the processor 140 may control the communication interface 130 to transmit the information of the plurality of corresponding board screens 10-1, 10-2, ..., 10-10 to the server 200. Meanwhile, this is only one embodiment, and the present disclosure is not limited thereto. For example, if it is identified that the remaining capacity of the memory 120 is less than the threshold capacity, the processor 140 may control the communication interface 130 to transmit the information of the board screens stored in the memory 120 to the server 200.

[0106] return Figure 2 , the processor 140 according to an embodiment of the present disclosure may recognize text corresponding to the drawing object 30. Then, the processor 140 may change the drawing object 30 into a text object of a predetermined font based on the recognized text, and add the text object to the board screen 10. Fig.10 Provide detailed explanation on this.

[0107] Fig.10 is a schematic diagram for illustrating a home appliance and a user device according to an embodiment of the present disclosure.

[0108] Reference Fig.10 , if a second touch input to the board screen 10 is detected, the processor 140 according to an embodiment of the present disclosure may add a drawing object 30 corresponding to the second touch input to the board screen 10. Then, the processor 140 may recognize text corresponding to the drawing object 30. For example, the processor 140 may recognize text corresponding to the drawing object 30 added to the board screen 10 based on various character recognition algorithms. Fig.10 , the processor 140 may perform optical character recognition (OCR) on the drawing object 30 and recognize the text "HAPPY BIRTHDAY John". Here, OCR is one embodiment of a character recognition algorithm, and the character recognition algorithm is not limited thereto. As another example, obviously, the processor 140 may recognize the text included in the drawing object 30 based on Tensorflow, various machine learning models, etc.

[0109] Then, the processor 140 may acquire a text object of a predetermined font based on the recognized text. The processor 140 may change the drawing object 30 to the acquired text object. Here, it is obvious that the predetermined font may be changed to various fonts according to user settings.

[0110] The memory 120 according to an embodiment of the present disclosure may store user identification information and user device information corresponding to a plurality of respective users.

[0111] As an example, the home appliance 100 may be used by a plurality of users. When the home appliance 100 is installed at home, all family members may be users of the home appliance 100. The home appliance 100 according to an embodiment of the present disclosure may store identification information corresponding to a plurality of corresponding users (eg, family members).

[0112] Here, the identification information may include a user profile and a name, title, nickname, acronym, etc. for identifying the user. According to an embodiment of the present disclosure, the home appliance 100 may register a user based on the user identification information. Then, the home appliance 100 may store user device information corresponding to a plurality of corresponding users. Here, the user device information may include identification information and authentication information required for the home appliance 100 to communicate with a device corresponding to a specific user.

[0113] The processor 140 according to the embodiment of the present disclosure can identify a specific user among multiple users based on the user identification information, and obtain user device information corresponding to the identified user. Then, the processor 140 can communicate with the device of the specific user based on the obtained user device information.

[0114] The processor 140 according to an embodiment of the present disclosure may recognize text corresponding to the drawing object 30, and recognize at least one user among the plurality of users based on the recognized text and the user identification information. For example, if the recognized text is "John", the processor 140 may recognize "John" among the plurality of users based on the user profile included in the user identification information.

[0115] Then, the processor 140 may communicate with the user terminal device 300 of "John" based on the user device information corresponding to "John". The processor 140 may transmit the drawing object 30 to the user terminal device 300 corresponding to the identified user. Fig.10 , the processor 140 may control the communication interface 130 to send information related to the drawing object 30 including "HAPPY BIRTHDAY John" to the user terminal device 300 of "John". The user terminal device 300 may display the received drawing object 30'. Meanwhile, this is merely one embodiment, and the processor 140 may recognize text included in the image 20, memo 40, icon 50, etc., in addition to the drawing object 30, and recognize the user and user device corresponding to the recognized text. Then, the processor 140 may send the object (e.g., image 20, memo 40, icon 50, etc.) to the device of the recognized user.

[0116] The processor 140 according to an embodiment of the present disclosure may delete or edit a user registered at the home appliance 100, or add a new user. For example, in the case of adding a new user, the processor 140 may receive or receive input of identification information of the new user. Then, the processor 140 may receive device information of the new user and store the information in the memory 120.

[0117] return Figure 2 , if a command for loading information of the board screen 10 stored in the memory 120 is received, the processor 140 according to an embodiment of the present disclosure may control the display 110 to display a captured image corresponding to the stored board screen 10 and a list including information on a generation time point and a storage time point of the board screen 10. Fig.11 Provide detailed explanation on this.

[0118] Fig.11 2 is a schematic diagram for explaining a board screen list according to an embodiment of the present disclosure.

[0119] The memory 120 according to an embodiment of the present disclosure may store a plurality of board screens 10-1, 10-2, ..., 10-10. Then, if a command for calling the board screen 10 stored in the memory 120 is received, the processor 140 may display information about the board screen 10 in the form of a list.

[0120] Reference Fig.11 , the processor 140 may provide information about the first panel screen 10-1 to information about the fourth panel screen 10-4 in the form of a list. For example, the information about the first panel screen 10-1 may include a thumbnail image (or captured image) of the first panel screen 10-1, a generation date (or generation time point) of the first panel screen 10-1, and a last storage date (or last update time point).

[0121] The processor 140 according to an embodiment of the present disclosure may arrange the list in ascending or descending order based on any one of a generation time point or a last update time point of the board screen 10 and display the list.

[0122] Figure 3 is a block diagram illustrating a detailed configuration of a home appliance according to an embodiment of the present disclosure.

[0123] according to Figure 3 , the home appliance 100 includes a display 110, a memory 120, a communication interface 130, a processor 140, a sensor 150, an audio device 160, a camera 170, a dispenser 180, and a cooling component 190. Figure 3 Of the components shown, Figure 2 Detailed description of components that overlap will be omitted.

[0124] The display 110 may provide various content screens that can be provided by the home appliance 100. Here, the content screen may include various contents such as images, moving images, text, music, etc., an application execution screen including various contents, a graphical user interface (GUI) screen, etc.

[0125] The display 110 may be implemented in various forms, such as a liquid crystal display (LCD), an organic light emitting diode (OLED), a liquid crystal on silicon (LCoS), a digital light processing (DLP), a micro LED, a quantum dot (QD) display panel, etc., but is not limited thereto. In addition, the display may be implemented as a flexible display, a transparent display, etc., depending on circumstances.

[0126] In addition, the display 110 according to the embodiment of the present disclosure may include not only a display panel for outputting an image, but also a frame for accommodating the display panel. In particular, the frame according to the embodiment of the present disclosure may include a touch sensor (not shown) for detecting user interaction.

[0127] Meanwhile, the display 110 provided on the home appliance 100 can display various screens generated by the graphics processing unit. The home appliance 100 may include the display 110 as a component, but the home appliance 100 may also obviously send a signal corresponding to the screen to an external device connected via an interface (not shown), and display various screens through the display of the external device. For example, the display 110 may display the screen of the external device through a mirroring function.

[0128] In particular, the display 110 may display an image 20 , a drawing object 30 , a memo 40 , an icon 50 for executing an application, etc., received from an external electronic device according to the control of the processor 140 .

[0129] The memory 120 may be implemented as an internal memory included in the processor 140, such as a ROM (e.g., an electrically erasable programmable read-only memory (EEPROM)), a RAM, etc., or as a memory separate from the processor 140. In this case, the memory 120 may be implemented in the form of a memory embedded in the home appliance 100, or in the form of a memory that can be attached to or detached from the home appliance 100, depending on the purpose of the stored data. For example, in the case of data for operating the home appliance 100, the data may be stored in a memory embedded in the home appliance 100, and in the case of data for an extended function of the home appliance 100, the data may be stored in a memory that can be attached to or detached from the home appliance 100. Meanwhile, in the case of a memory embedded in the home appliance 100, the memory may be implemented as at least one of a volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM), etc.) or a non-volatile memory (e.g., one-time programmable ROM (OTPROM), programmable ROM (PROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash memory or NOR flash memory, etc.), hard disk drive, or solid state drive (SSD)). In the case of a memory that can be attached to or detached from the home appliance 100, the memory may be implemented in the form of a memory card (e.g., compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), multimedia card (MMC), etc.), an external memory (e.g., USB memory) connectable to a USB port, etc.

[0130] The processor 140 controls the overall operation of the home appliance 100 by using various programs stored in the memory 120 .

[0131] Specifically, the processor 140 includes a RAM, a ROM, a main CPU, first to nth interfaces, and a bus.

[0132] The RAM, the ROM, the main CPU, and the first to nth interfaces may be connected to one another through a bus.

[0133] In the ROM, an instruction set for system booting and the like is stored. When a power-on instruction is input and power is supplied, the main CPU copies an O / S stored in the memory 120 to the RAM according to the instruction stored in the ROM, and boots the system by executing the O / S. When the booting is completed, the main CPU copies various application programs stored in the memory 120 to the RAM, and performs various operations by executing the application programs copied in the RAM.

[0134] The main CPU accesses the memory 120 and performs booting by using the O / S stored in the memory 120. Then, the main CPU performs various operations by using various programs, content data, etc. stored in the memory 120.

[0135] The first to nth interfaces are connected to the above-mentioned various components. One of the interfaces may be a network interface connected to an external device through a network.

[0136] At the same time, the processor 140 can perform a graphics processing function (video processing function). For example, the processor 140 can generate a screen including various objects such as icons, images and texts by using an operating unit (not shown) and a rendering unit (not shown). Here, the operating unit (not shown) can operate attribute values ​​such as coordinate values, shapes, sizes and colors according to the layout of the screen based on the received control command, wherein the corresponding object will be displayed by these attribute values. In addition, the rendering unit (not shown) can generate a screen with various layouts including objects based on the attribute values ​​operated in the operating unit (not shown). In addition, the processor 140 can perform various image processing on the video data, such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, etc.

[0137] At the same time, the processor 140 can perform processing on the audio data. Specifically, the processor 140 can perform various processing on the audio data, such as decoding or amplification, noise filtering, etc.

[0138] The communication interface 130 is a component for communicating with various types of external devices according to various types of communication methods. The communication interface 130 includes a Wi-Fi module, a Bluetooth module, an infrared communication module, and a wireless communication module, etc. Here, each communication module can be implemented in the form of at least one hardware chip.

[0139] The processor 140 may communicate with various types of external devices by using the communication interface 130. Here, the external devices may include a display device such as a TV, an image processing device such as a set-top box, an external server, a control device such as a remote controller, an audio output device such as a Bluetooth speaker, a lighting device, a home appliance such as a smart vacuum cleaner and a smart refrigerator, a server such as an IoT home manager, and the like.

[0140] The Wi-Fi module and the Bluetooth module communicate by using the Wi-Fi method and the Bluetooth method, respectively. When using the Wi-Fi module or the Bluetooth module, various types of connection information such as SSID and session key are first sent and received, and communication connection is performed using these information, and then various types of information can be sent and received.

[0141] The infrared communication module communicates according to an Infrared Data Association (IrDA) technology that wirelessly transmits data to a near field by using infrared rays between visible light and millimeter waves.

[0142] The wireless communication module may include at least one communication chip, which communicates according to various wireless communication protocols other than the above-mentioned communication methods, such as Zigbee, third-generation mobile communication technology (3G), third-generation partnership project (3GPP), long-term evolution (LTE), advanced long-term evolution (LTE-A), fourth-generation mobile communication technology (4G), fifth-generation mobile communication technology (5G), etc.

[0143] In addition to the above, the communication interface 130 may include at least one of a local area network (LAN) module, an Ethernet module, or a wired communication module that performs communication by using a twisted pair cable, a coaxial cable, an optical cable, or the like.

[0144] According to an embodiment of the present disclosure, the communication interface 130 may communicate with external devices such as a remote controller and an external server using the same communication module (eg, a Wi-Fi module).

[0145] According to another embodiment of the present disclosure, the communication interface 130 can use different communication modules (e.g., Wi-Fi modules) to communicate with external devices such as remote controllers and external servers. For example, the communication interface 130 can use at least one of an Ethernet module or a Wi-Fi module to communicate with an external server, and use a BT module to communicate with an external device such as a remote controller. However, this is only one embodiment, and in the case of communicating with multiple external devices or external servers, the communication interface 130 can use at least one communication module of various communication modules.

[0146] The home appliance 100 according to an embodiment of the present disclosure may include a sensor 150. Here, the sensor 150 may detect various signals according to the arrangement position, purpose, etc. of the home appliance 100.

[0147] As an example, the household appliance 100 may include an opening and closing detection sensor located on the main body or the door, and detect the opening and closing of the door through the opening and closing detection sensor. In addition, the household appliance 100 can detect the intensity when the door is opened or closed. For example, the sensor 150 can detect the shaking degree of the main body or the door, the size of the noise occurring when opening or closing, and the processor 140 can detect the intensity of opening or closing the door based on the shaking, noise, etc. detected at the sensor 150. At the same time, this is only an embodiment, and the household appliance 100 can obviously detect the opening and closing of the door by including various types of sensors 150.

[0148] The home appliance 100 according to an embodiment of the present disclosure may detect a user through the sensor 150 provided on the front surface. As an example, the sensor 150 may detect a neighboring user within a threshold distance, and the processor 140 may perform an operation corresponding to the detected user.

[0149] The home appliance 100 may include a wake-up function that is automatically activated when a user approaches within a specific range. For example, if a user approaches within a specific range, the display 110 may be activated. The processor 140 may control the display 110 to display the board screen 10 before the display 110 is turned off based on the information of the board screen 10 stored in the memory 120.

[0150] In addition, when a certain time has passed after the user has gone beyond a certain range, the processor 140 may deactivate the display 110. That is, the display 110 may be in an off state.

[0151] As another example, the household appliance 100 may include an internal temperature sensor (not shown) for detecting the internal temperature of the main body. For example, the internal temperature sensor may be installed in a plurality of corresponding storage chambers (e.g., an upper storage chamber, a lower storage chamber, etc.), and detect the temperature of the plurality of corresponding storage chambers and send an electrical signal corresponding to the detected temperature to the processor 140. The processor 140 may then perform an operation corresponding to the detected temperature. As an example, the processor 140 may perform an operation for controlling the internal temperature, an operation for providing the internal temperature through the display 110, etc. Here, each internal temperature sensor may include a thermistor whose resistance varies with temperature.

[0152] The audio device 160 may include a speaker that converts an electrical signal received from the processor 140 into an audio signal and outputs the converted audio signal. When a predetermined event occurs, the processor 140 according to an embodiment of the present disclosure may output an audio signal through the audio device 160. For example, the home appliance 100 may include a briefing mode, and the processor 140 may control the audio device 160 to output the current time, the current location, the weather corresponding to the current location, a to-do list application, etc. during the briefing mode operation. As another example, if the door is opened for a time greater than or equal to a threshold time, the home appliance 100 may control the audio device 160 to output a beep sound.

[0153] The camera 170 may capture an image and convert the image into an electrical signal and transmit the signal to the processor 140 .

[0154] The camera 170 may include a plurality of optical diodes that convert optical signals into electrical signals, and the plurality of optical diodes may be arranged two-dimensionally. The camera 170 may include a charge coupled device (CCD) image sensor or a complementary metal oxide semiconductor (CMOS) image sensor, in which the plurality of optical diodes are arranged two-dimensionally.

[0155] In particular, the camera 170 may be disposed inside the storage compartment and acquire an image of food stored in the storage compartment. Then, the processor 140 may control the display 110 to display the image of food acquired from the camera 170.

[0156] If the home appliance 100 is implemented as a refrigerator according to an embodiment of the present disclosure, the refrigerator may include a dispenser 180 and a cooling member 190 .

[0157] The dispenser 180 may discharge water or ice according to a user input. The home appliance 100 may provide water or ice to the outside through the dispenser 180 without opening or closing a door.

[0158] The dispenser 180 may include a dispenser lever receiving a user's command to discharge water or ice, a dispenser nozzle to discharge water or ice, and a dispenser display panel to display an operation state of the dispenser 180 .

[0159] The dispenser 180 according to the embodiment of the present disclosure may be installed on the outside of the main body or the door. Figure 1 As shown, the dispenser 180 may be installed on the first door of the upper portion. Meanwhile, the present disclosure is not limited thereto, and the dispenser 180 may obviously be disposed in a region of the main body or the door in various ways.

[0160] The cooling part 190 may provide cool air to the storage chamber. The cooling part 190 may maintain the temperature of the storage chamber within a specific range by utilizing evaporation of a refrigerant.

[0161] The cooling part 190 may include a compressor compressing gaseous refrigerant, a condenser converting the compressed gaseous refrigerant into a liquid state, an expander decompressing the liquid refrigerant, and an evaporator converting the decompressed liquid refrigerant into a gaseous state.

[0162] The cooling part 190 may cool the air inside the storage compartment by using a phenomenon in which liquid refrigerant absorbs heat energy in surrounding air when the refrigerant is converted into a gaseous state.

[0163] However, this is only one embodiment, and the cooling part 190 is not necessarily limited to include a compressor, a condenser, an expander, and an evaporator. For example, the cooling part 190 may include a Peltier element using the Peltier effect. The Peltier effect refers to a situation where, when an electric current is caused to flow in a contact surface where different types of metals are in contact with each other, a heat generation phenomenon occurs in one metal and an endothermic phenomenon occurs in another metal. The cooling part 190 may cool the air inside the storage compartment by using the Peltier element.

[0164] As another example, the cooling part 190 may include a magnetic cooling device using a magnetocaloric effect. The magnetocaloric effect refers to a situation where a specific substance (magnetocaloric substance) generates heat when it is magnetized and absorbs heat when it is demagnetized. The cooling part 190 may cool the air inside the storage compartment by using a magnetic cooling device.

[0165] The home appliance 100 according to an embodiment of the present disclosure may include a user interface and an input / output interface.

[0166] The user interface (not shown) may be implemented as a device such as a button, a touch pad, a mouse, and a keyboard, or may be implemented as a touch screen capable of performing both the above-mentioned display function and the operation input function. Here, the button may be various types of buttons, such as a mechanical button, a touch pad, a scroll wheel, etc., which are formed in any area such as a front surface portion, a side surface portion, a rear surface portion, etc., of the exterior of the main body, door, etc. of the home appliance 100.

[0167] The input / output interface (not shown) may be an interface of any one of a high-definition multimedia interface (HDMI), a mobile high-definition link (MHL), a universal serial bus (USB), a display port (DP), a thunderbolt interface, a video graphics array (VGA) port, an RGB port, a D-subminiature (D-SUB), or a digital visual interface (DVI). Meanwhile, although the description is made by assuming that the home appliance 100 is a refrigerator, it is obvious that the home appliance 100 may be implemented as a display device, and the display device may be implemented to be connected to the refrigerator through an input / output interface provided on the display device, and to be attached to or separated from an area of ​​the refrigerator.

[0168] At the same time, the household appliance 100 can receive a user voice signal from an external device including a microphone. In this case, the received user voice signal can be a digital voice signal, but can also be an analog voice signal, depending on the embodiment. For example, the household appliance 100 can receive the user voice signal through a wireless communication method such as Bluetooth and Wi-Fi. Here, the external device can be implemented as a remote control device or a smart phone.

[0169] The home appliance 100 may transmit a voice signal to an external server to perform voice recognition on a voice signal received from an external device.

[0170] In this case, the communication module for communicating with the external device and the external server can be implemented as one module, or as separate modules. For example, the communication module can communicate with the external device by using a Bluetooth module, and communicate with the external server by using an Ethernet modem or a Wi-Fi module.

[0171] Meanwhile, according to an embodiment, the home appliance 100 may additionally include a tuner and a demodulation part.

[0172] The tuner (not shown) may tune a channel selected by a user or all pre-stored channels among a Radio Frequency (RF) signal received through an antenna and receive an RF broadcast signal.

[0173] The demodulation section (not shown) may receive a digital IF (DIF) signal converted at the tuner and demodulate the signal, and perform channel demodulation and the like.

[0174] Fig.12 is a flowchart for illustrating a control method of a home appliance according to an embodiment of the present disclosure.

[0175] In the control method of the home appliance according to the embodiment of the present disclosure, in operation S1210, a panel screen is provided on a display provided on a front surface of the home appliance.

[0176] Then, if the image is received, a display size of the image is recognized based on resolution information of the image in operation S1220.

[0177] Then, in operation S1230, the image is added to the board screen based on the identified display size. Then, if a first touch input for the image is detected, at least one of a display position or a display size of the image is adjusted to correspond to the first touch input in operation S1240.

[0178] If a second touch input with respect to the board screen is detected, a drawing object corresponding to the second touch input is added to the board screen in operation S1250.

[0179] Then, in operation S1260, information of the image added to the board screen and information of the drawing object are stored.

[0180] Here, the information of the image includes at least one of the file path of the image, the file type of the image, the coordinate information of the image added to the board screen, or the size information of the image, and the information of the drawing object includes at least one of the shape information of the drawing object or the coordinate information of the drawing object added to the board screen.

[0181] The control method according to the embodiment of the present disclosure may include the following steps: according to an event arriving at a predetermined period or an event of selecting a storage menu, capturing the board screen and obtaining a captured image of the board screen, and sending the captured image, image information and drawing object information to a server.

[0182] The control method according to an embodiment of the present disclosure may include the following steps: based on receiving a command for providing a new board screen, storing information of a board screen provided on a display, and then providing the new board screen through the display. Here, the information of the board screen may include at least one of a captured image of the board screen, information of the image, or information of a drawing object.

[0183] The control method according to an embodiment of the present disclosure may include the step of transmitting information of the board screen stored in the home appliance to the server based on the number of board screens stored in the home appliance exceeding a threshold number.

[0184] The control method according to an embodiment of the present disclosure may include the following steps: providing an icon for executing any one of a plurality of applications on a board screen, and based on a user command to select an icon being input, displaying an execution screen of the application corresponding to the selected icon in an area on the board screen.

[0185] In addition, the household appliance can store corresponding user identification information and user device information corresponding to multiple users, and the control method according to the embodiment of the present disclosure may include the following steps: identifying text corresponding to the drawing object, identifying at least one user among the multiple users based on the text and the stored user identification information, and sending information related to the drawing object based on the user device information corresponding to the identified user.

[0186] The control method may include the steps of recognizing text corresponding to the drawing object, and changing the drawing object into a text object of a predetermined font based on the recognized text.

[0187] In addition, the control method may include the following steps: based on receiving a command for loading information of a board screen stored in the home appliance, displaying a captured image corresponding to the stored board screen and a list including information about a generation time point and a storage time point of the stored board screen.

[0188] The control method according to an embodiment of the present disclosure may include the following steps: based on detecting a user through a sensor provided in the home appliance in a standby mode in which a display is in an off state, displaying a board screen before the display is turned off based on stored information of the board screen.

[0189] Meanwhile, the methods according to the aforementioned various embodiments of the present disclosure may be implemented in the form of an application program that can be installed on a conventional electronic device.

[0190] Furthermore, the methods according to the aforementioned various embodiments of the present disclosure may be implemented only by software upgrade or hardware upgrade of a conventional electronic device.

[0191] Furthermore, the aforementioned various embodiments of the present disclosure may be performed by an embedded server provided on the electronic device or an external server of at least one of the electronic device or the display device.

[0192] At the same time, according to an embodiment of the present disclosure, the various embodiments described above may be implemented as software including instructions stored in a machine-readable storage medium, which can be read by a machine (e.g., a computer). A machine refers to a device that calls instructions stored in a storage medium and is capable of operating according to the called instructions, and the device may include an electronic device according to the above embodiment (e.g., electronic device A). In the case where the instructions are executed by a processor, the processor may perform the functions corresponding to the instructions by itself, or perform the functions corresponding to the instructions by using other components under its control. The instructions may include code generated or executed by a compiler or interpreter. A storage medium that can be read by a machine may be provided in the form of a non-temporary storage medium. Here, the term "non-temporary" only means that the storage medium does not include a signal and is tangible, and does not indicate whether the data is stored in the storage medium semi-permanently or temporarily.

[0193] In addition, according to the embodiments of the present disclosure, the methods according to the aforementioned various embodiments of the present disclosure may be provided while being included in a computer program product. The computer program product may be traded between a seller and a buyer as a commodity. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or may be downloaded through an application store (e.g., a PLAYSTORE). TM ) Online distribution. In the case of online distribution, at least a part of the computer program product may be at least temporarily stored in a storage medium (e.g., a memory of a manufacturer's server, an application store's server, or a relay server), or temporarily generated.

[0194] In addition, each component (e.g., module or program) according to the above-mentioned various embodiments may be composed of a single entity or multiple entities, and some of the above-mentioned subcomponents may be omitted, or different subcomponents may be further included in the various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into one entity to perform the same or similar functions as the functions performed by each component before integration. According to various embodiments, the operations performed by a module, program, or another component may be performed sequentially, in parallel, repeatedly, or in a heuristic manner, or at least some operations may be performed in a different order, omitted, or different operations may be added.

[0195] In addition, although the preferred embodiments of the present disclosure have been shown and described, the present disclosure is not limited to the above-mentioned specific embodiments, and it is obvious that various modifications can be made by a person skilled in the art of the present disclosure without departing from the main idea of ​​the present disclosure as claimed in the attached claims. In addition, these modifications should not be interpreted independently of the technical ideas or prospects of the present disclosure.

Claims

1. A household appliance comprising: a display disposed on a front surface of the household appliance; A memory storing corresponding user identification information and user device information corresponding to a plurality of users; a communications interface, the communications interface comprising circuitry; and A processor, the processor being configured to: providing a panel screen on said display, Based on receiving an image through the communication interface, identifying a display size of the image based on resolution information of the image, and adding the image to the panel screen based on the identified display size, Based on detecting a first touch input to the image, adjusting at least one of a display position or a display size of the image to correspond to the first touch input, and based on detecting a second touch input to the board screen, adding a drawing object corresponding to the second touch input to the board screen, wherein the processor stores information of the image added to the panel screen and information of the drawing object in the memory, Wherein, the processor is further configured to: identifying text corresponding to the drawing object, identifying at least one user from the plurality of users based on the text and the stored user identification information, and Based on the user device information corresponding to the identified user, information related to the drawing object is sent through the communication interface.

2. The household appliance according to claim 1, wherein: The image information includes: at least one of a file path of the image, a file type of the image, coordinate information of the image added to the panel screen, or size information of the image, and The information of the drawing object includes: At least one of shape information of the drawing object or coordinate information of the drawing object added to the board screen.

3. The household appliance according to claim 1, wherein: The processor is configured to: According to an event arriving at a predetermined period or an event of selecting a storage menu, the board screen is captured and a captured image of the board screen is acquired, and the communication interface is controlled to send the captured image, information of the image and information of the drawing object to a server.

4. The household appliance according to claim 1, wherein: The processor is configured to: based on receiving a command for providing a new panel screen, storing information of the panel screen provided on the display in the memory, and then providing the new panel screen through the display, and The board screen information includes: At least one of a captured image of the board screen, information of the image, or information of the drawing object.

5. The household appliance according to claim 4, wherein: The processor is configured to: Based on the number of board screens stored in the memory exceeding a threshold number, information of the board screens stored in the memory is transmitted to a server through the communication interface.

6. The household appliance according to claim 1, wherein: The processor is configured to: providing an icon for executing any one of a plurality of application programs included in the memory on the panel screen, and Based on a user command selecting the icon being input, the display is controlled to display an execution screen of an application corresponding to the selected icon in one area on the panel screen.

7. The household appliance according to claim 1, wherein: The processor is configured to change the drawing object into a text object of a predetermined font based on the recognized text.

8. The household appliance according to claim 1, wherein: The processor is configured to: Based on receiving a command for loading information of a board screen stored in the memory, the display is controlled to display a captured image corresponding to the stored board screen and a list including information on a generation time point and a storage time point of the stored board screen.

9. The household appliance according to claim 1, comprising: sensor, The processor is configured to: Upon detection of a user by the sensor in a standby mode in which the display is in an off state, the display is controlled to display a board screen before the display is turned off based on the stored information of the board screen.

10. A method for controlling a household appliance, wherein the household appliance includes corresponding user identification information and user device information corresponding to a plurality of users, the method comprising: providing a panel screen on a display disposed on a front surface of the home appliance; Based on the received image, identifying a display size of the image based on resolution information of the image; adding the image to the board screen based on the identified display size; Based on detecting a first touch input directed to the image, adjusting at least one of a display position or a display size of the image to correspond to the first touch input; based on detecting a second touch input to the board screen, adding a drawing object corresponding to the second touch input to the board screen; as well as storing information of the image added to the panel screen and information of the drawing object, Wherein, the method further comprises: identifying text corresponding to the drawing object, identifying at least one user from the plurality of users based on the text and the stored user identification information, and Based on the user device information corresponding to the identified user, information related to the drawing object is transmitted.

11. The control method according to claim 10, wherein: The image information includes: at least one of a file path of the image, a file type of the image, coordinate information of the image added to the panel screen, or size information of the image, and The information of the drawing object includes: At least one of shape information of the drawing object or coordinate information of the drawing object added to the board screen.

12. The control method according to claim 10, comprising: capturing the panel screen and acquiring a captured image of the panel screen according to an event arriving at a predetermined period or an event of selecting a storage menu; as well as The captured image, the information of the image, and the information of the drawing object are transmitted to a server.

13. The control method according to claim 10, comprising: storing information of the board screen provided on the display and then providing the new board screen through the display based on receiving a command for providing a new board screen, The information on the board screen includes: At least one of a captured image of the board screen, information of the image, or information of the drawing object.

14. The control method according to claim 13, comprising: Based on the number of the board screens stored in the home appliance exceeding a threshold number, information of the board screens stored in the home appliance is transmitted to a server.

Images