Electronic device

Abstract

An electronic device is disclosed. An electronic device capable of being detachably attached to an electronic device holder according to the present disclosure may comprise: a display; at least one Hall sensor configured to sense sensing information according to attachment of the electronic device holder; and a controller configured to determine a type of the electronic device holder on the basis of the sensing information sensed by the at least one Hall sensor, and to display, on the display, a screen matching the determined type of the electronic device holder.

Description

electronic devices

[0001] The present disclosure relates to an electronic device. More specifically, it relates to a modular electronic device that can be used by replacing various electronic device holders.

[0002] Electronic devices are used in a wide variety of applications and environments, and accordingly, their configurations or attachment structures need to vary to suit their intended use or installation type. However, since general electronic devices are often manufactured with a monolithic structure, there is a problem in that it is difficult to modify them to fit the environment or purpose desired by the user, or to easily combine them with other devices.

[0003] In particular, for electronic devices attached to wearables or peripherals, coupling stability varies depending on the structure or shape of the holder, and the range of use is limited due to a structure that is compatible only with specific holders. This compatibility issue not only reduces product usability but also leads to inefficiency, requiring the separate design and production of multiple dedicated models during the manufacturing stage.

[0004] To overcome these limitations, technology that implements electronic devices with a modular structure, allowing them to be selectively attached or replaced depending on the usage environment, has recently been gaining attention. Modular devices offer the advantage of improved assembly and maintainability, as their components remain separate yet maintain stable electrical and mechanical connections when combined.

[0005] However, to be compatible with various types of electronic device holders, simply modularizing the coupling structure is insufficient; an additional recognition or adaptive structure is required to respond appropriately to the shape or attachment method of each holder. Therefore, design technology for modular electronic devices is necessary that enables stable attachment to various electronic device holders while improving assembly and compatibility.

[0006] The present disclosure aims to solve the aforementioned problems and other problems.

[0007] Another objective may be to provide an electronic device capable of recognizing the type of electronic device holder.

[0008] Another objective may be to provide electronic devices that offer a personalized user experience tailored to the user's situation.

[0009] Another objective may be to provide an electronic device that determines the user's situation and performs a corresponding action.

[0010] According to one aspect of the present disclosure for achieving the above-described purpose, an electronic device is provided that comprises: a display; at least one Hall sensor that detects sensing information upon attachment of the electronic device holder; and a controller that determines the type of the electronic device holder based on the sensing information detected from the at least one Hall sensor and displays a screen matching the determined type of the electronic device holder on the display.

[0011] The effects of the electronic device according to the present disclosure are described as follows.

[0012] According to at least one of the embodiments of the present disclosure, an electronic device capable of recognizing the type of electronic device holder can be provided.

[0013] According to at least one of the embodiments of the present disclosure, an electronic device that provides a personalized user experience tailored to the user's situation can be provided.

[0014] According to at least one of the embodiments of the present disclosure, an electronic device can be provided that determines the situation of a user and performs a corresponding operation.

[0015] Further scopes of the applicability of the present disclosure will become apparent from the following detailed description. However, since various changes and modifications within the spirit and scope of the present disclosure are clearly understood by those skilled in the art, specific embodiments, such as the detailed description and preferred embodiments of the present disclosure, should be understood as being given merely as examples.

[0016] Figure 1 is a block diagram simply illustrating the configuration of an electronic device and an electronic device holder.

[0017] FIGS. 2 to 4 are a perspective view and an exploded view illustrating the configuration of an electronic device.

[0018] FIGS. 5 to 24 are drawings illustrating an electronic device that recognizes an electronic device holder and outputs a corresponding screen.

[0019] FIGS. 25 to 29 are drawings illustrating the basic operation of an electronic device.

[0020] FIGS. 30 to 32 are drawings illustrating the operation of an electronic device generating a checklist and outputting a warning notification for missing items or abnormal items.

[0021] FIGS. 33 to 38 are drawings for explaining an operation of learning user-related information and, when user input is detected, outputting information corresponding to the user input based on the learned information.

[0022] FIGS. 39 to 43 are drawings for explaining the operation of controlling an external device.

[0023] FIGS. 44 to 46 are drawings for explaining the operation of outputting a response corresponding to the user situation in response to user input.

[0024] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Identical or similar components regardless of drawing symbols are given the same reference number, and redundant descriptions thereof will be omitted.

[0025] The suffixes “module” and “part” for components used in the following description are assigned or used interchangeably solely for the ease of drafting the specification, and do not inherently possess distinct meanings or roles.

[0026] In addition, when describing the embodiments disclosed in this specification, if it is determined that a detailed description of related prior art may obscure the essence of the embodiments disclosed in this specification, such detailed description is omitted. Furthermore, the attached drawings are intended only to facilitate understanding of the embodiments disclosed in this specification, and the technical concept disclosed in this specification is not limited by the attached drawings; it should be understood that they include all modifications, equivalents, and substitutions that fall within the concept and technical scope of this disclosure.

[0027] Terms including ordinal numbers, such as first, second, etc., may be used to describe various components, but said components are not limited by said terms. These terms are used solely for the purpose of distinguishing one component from another.

[0028] When a component is described as being “coupled,” “fixed,” “mounted,” “connected,” or “linked” with another component, another component may exist between that component and the other component. When a component is described as being “directly coupled,” “directly fixed,” “directly mounted,” “directly connected,” or “directly linked” to another component, there may not be another component existing between them.

[0029] A singular expression includes a plural expression unless the context clearly indicates otherwise.

[0030] In this application, terms such as “comprising” or “having” are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0031] The directional indications of Up (U), Down (D), Left (Le), Right (Ri), Front (F), and Rear (R) shown in the drawings are for convenience of explanation only and do not limit the technical concepts disclosed in this specification.

[0032]

[0033] Figure 1 is a block diagram simply illustrating the configuration of an electronic device and an electronic device holder.

[0034] Referring to FIG. 1, the electronic device (1) may include a controller (10), memory (11), battery (410), Hall sensor (223), input interface (12), output interface (13), communication interface (14) and / or position information sensor (15).

[0035] The controller (10) can control the overall operation of the electronic device (1). The controller (10) may include at least one processor and, using the included processor, can control the overall operation of the aerosol generating device (1000). Here, the processor may be a general processor such as a CPU (central processing unit). Additionally, the processor may be a dedicated device such as an ASIC or another hardware-based processor.

[0036] The controller (10) can perform any one of the multiple functions of the electronic device (1). For example, the controller (10) can perform any one of the multiple functions of the electronic device (1) according to the state of each component of the electronic device (1), user commands received through the input interface (12) and output interface (13), etc.

[0037] The memory (11) can store programs for each signal processing and control within the controller (10), and can store processed data and data to be processed.

[0038] For example, memory (11) stores applications designed for the purpose of performing various tasks that can be processed by the controller (10), and can selectively provide some of the stored applications upon request by the controller (10).

[0039] The memory (11) may include at least one of volatile memory (e.g., DRAM, SRAM, SDRAM, etc.) or non-volatile memory (e.g., flash memory, hard disk drive (HDD), solid-state drive (SSD), etc.).

[0040] The memory (11) may include an artificial intelligence model for determining the user's situation based on user input, sensor data, surrounding environment information, etc. The artificial intelligence model may be a lightweight model stored in the device's memory.

[0041] The artificial intelligence model is an LLM pre-trained from large-scale text data that can understand the semantics and context of natural language and perform various language generation and processing tasks. The prompts of the artificial intelligence model may include at least one of text or an image.

[0042] The controller (10) can determine control commands corresponding to the user's situation through an artificial intelligence model. Additionally, the controller (10) can be linked with an external server or a cloud-based large-scale artificial intelligence model through a communication interface (14), thereby enabling situation judgment and operation control. Therefore, by selectively performing local artificial intelligence processing or external artificial intelligence linkage processing depending on whether the controller (10) is connected to a network environment, the accuracy of situation recognition and user experience can be improved.

[0043] The battery (410) can supply power used for the operation of the electronic device (1) under the control of the controller (10). The battery (410) can supply power to other components provided in the electronic device (1), such as a communication module included in the communication interface (14), a camera (213, 214) included in the input interface (12), a microphone (211, 212), a display (100) included in the output interface (13), a speaker (420), etc.

[0044] The battery (410) may be a rechargeable battery or a disposable battery. For example, the battery (410) may be composed of a lithium-ion battery, a lithium-polymer (Li-Polymer) battery, a lithium-ion phosphate battery, etc., but is not limited thereto. For example, the battery (410) may be composed of a lithium cobalt oxide (LiCoO2) battery, a lithium titanate battery, etc.

[0045] The electronic device (1) may further include a charging terminal (502, see FIG. 2) into which power supplied from the outside is input. For example, a charging terminal (502, see FIG. 2) may be formed on one side of the back cover (500) of the electronic device (1), and the aerosol generating device (1000) may charge the battery (410) using power supplied through the charging terminal (502, see FIG. 2). At this time, the charging terminal may be composed of a wired terminal for USB communication, a pogo pin, etc.

[0046] A Hall sensor (223) can detect changes in magnetic force of an electronic device holder (2). For example, the Hall sensor (223) can detect changes in magnetic force according to changes in distance between the electronic device holder (2) and the electronic device (1). When the electronic device (1) is attached to the electronic device holder (2), the controller (10) can determine the type of the electronic device holder (2) from the magnetic force signal of the electronic device holder (2) received from the Hall sensor (223).

[0047] The input interface (12) may include a camera (213, 214) and / or a microphone (211, 212). The camera (213, 214) can detect external conditions of the electronic device (1). The controller (10) can determine user input, external conditions, etc. in response to external condition signals received from the camera (213, 214).

[0048] The output interface (13) may include a display (100) and / or a speaker (420). The display (100) may output a screen. For example, the display (100) may be an OLED panel. The display (100) may include a touch panel for receiving touch input. The speaker (420) may output sound.

[0049] The communication interface (14) may include at least one communication module for communication with an external device and / or server. For example, the communication interface (14) may include a communication module for wired communication such as USB (universal serial bus). For example, the communication interface (14) may include a communication module for wireless communication such as Wi-Fi (wireless fidelity), Bluetooth, Bluetooth Low Energy (BLE), Zigbee, and NFC (near field communication). For example, the communication interface (14) may include a wireless LAN (Wi-Fi) module, a cellular communication module using a mobile communication network (LTE, 5G, etc.), or a communication module such as NB-IoT or LoRa for low-power long-distance communication for transmitting and receiving data with an external server.

[0050] The location information sensor (15) may be a sensor for detecting the real-time location of the electronic device (1). For example, the location information sensor (15) may be a sensor that uses a satellite navigation system such as GPS, GLONASS, Galileo, or BeiDou. In some cases, the location information sensor (15) may include a location estimation module that uses cell-ID positioning, Wi-Fi positioning, or short-range wireless signal measurement.

[0051] The electronic device holder (2) may include a Hall magnet for magnetic recognition of a Hall sensor (223). A detailed description thereof will be provided in FIGS. 6 to 24.

[0052] FIGS. 2 to 4 are a perspective view and an exploded view illustrating the configuration of an electronic device.

[0053] Referring to FIG. 2, the electronic device (1) may be equipped with a display (100), a main frame (310), a first camera (213), a second camera (214) and / or a button (314).

[0054] The direction in which the display (100) outputs the screen can be referred to as the front (+z). The direction opposite to the front (+z) can be referred to as the rear (-z). The direction in which the first camera is located on the display (100) can be referred to as the top (+y). The direction opposite to the top (+y) can be referred to as the bottom (-y). The direction in which the button is facing on the display (100) can be referred to as the left or left (+x). The direction opposite to the left or left (+x) can be referred to as the right or right (-x).

[0055] Figure 3 is an exploded view of an electronic device (1).

[0056] Referring to FIG. 3, the electronic device (1) may include a display (100), a main board (210), a first microphone (211), a second microphone (212), a first camera (213), a second camera (214), a sub board (220), an antenna (230), a main frame (310), a first frame (320), a second frame (330), a battery (410), a speaker (420), a vibrator (430), and / or a back cover (500).

[0057] The display (100) can be coupled to the front of the main frame (310). The display (100) can output a screen to the front. For example, the display (100) may be an Organic Light Emitting Display (OLED). The display (100) may include a touch panel for receiving touch input.

[0058] The main board (210) may be located between the display (100) and the back cover (500). The main board (210) may be located between the display (100) and the second frame (330).

[0059] A first microphone (211) and / or a second microphone (212) may be mounted on the main board (210). The first microphone (211) may face the second microphone (212) with respect to the board (210). The second microphone (212) may be located on the opposite side of the first microphone (211) with respect to the board (210).

[0060] A first camera (213) and / or a second camera (214) may be mounted on the main board (210). The first camera (213) may be mounted on the upper side of the main board (210). The second camera (214) may be mounted on the main board (210) adjacent to the first camera (213). The main board (210) may be a Printed Circuit Board (PCB).

[0061] The main frame (310) may include a first camera hole (311), a second camera hole (312), a button hole (313), and / or a button (314). The main frame (310) may be positioned between the display (100) and the back cover (500). The display (100) may be coupled to the front of the main frame (310). The back cover (500) may cover the rear of the main frame (310).

[0062] The first camera (213) may be placed in the first camera hole (311) of the main frame (310). The first camera hole (311) may be aligned with the first camera (213). The first camera hole (311) may be formed on the first surface (A1) of the main frame (310) facing the display (100). The first camera (213) may be placed on the first surface (A1) of the main frame (310) facing the display (100). The first camera hole (311) may be placed on the upper side of the main frame (310). The optical axis of the first camera (213) may be oriented forward. For example, the optical axis of the first camera (213) may be oriented in a first direction toward the display from the back cover (500).

[0063] The second camera (214) may be placed in the second camera hole (312) of the main frame (310). The second camera hole (312) may be aligned with the second camera (214). The second camera hole (311) may be formed on the second surface (A2) adjacent to the first surface (A1) of the main frame (310). The second camera (214) may be placed on the second surface (A2) adjacent to the first surface (A1) of the main frame (310). The optical axis of the second camera (214) may be directed toward a second direction that intersects the first direction. For example, the optical axis of the second camera (214) may be directed toward the side of the electronic device (1).

[0064] By having the optical axis of the first camera (213) and the optical axis of the second camera (214) face different directions, the range of external situation recognition through the first and second cameras (213, 214) can be widened.

[0065] The main frame (310) may include a button hole (313). A button (314) may be inserted into the button hole (313). The button (314) may be inserted into the button hole (313) and electrically connected to a sub-board (220). The main frame (310) may be made of aluminum.

[0066] The first frame (320) can be coupled to the main frame (310). For example, the first frame (320) can be fixed to the main frame (310) by a press fit. The main substrate (210) can be coupled to the main frame (310). For example, the main substrate (210) can be coupled to the main frame (310) via screws. The first frame (320) can support at least one of the first camera (213) and / or the second camera (214). The first frame may be an injection-molded product. The first frame may be made of plastic material.

[0067] The second frame (330) can be coupled to the battery (410). The second frame (330) can be positioned between the substrate (210) and the battery (410). The second frame (330) can separate the substrate (210) and the battery (410). The second frame may be an injection-molded product. The second frame may be made of plastic material.

[0068] The battery (410) may be located between the second frame (330) and the sub-substrate (220). The battery (410) may supply power required to operate the electronic device (1).

[0069] The speaker (420) may be located on one side of the battery (410). The speaker (420) may be in contact with the back cover (500). The speaker (420) may be in contact with the speaker cover (503) of the back cover (500). The speaker (420) may be mounted on the sub-board (220). The speaker (420) may output sound. The speaker (420) may output sound toward the back cover (500).

[0070] The vibrator (430) may be located on one side of the battery (410). The vibrator (430) may be fixed to the second frame (330). The vibrator (430) may be mounted on the sub-substrate (220). The vibrator (430) may output vibration.

[0071] The sub-substrate (220) may include a magnet hole (221) and / or a hall substrate (222). The sub-substrate (220) may be located between the battery (410) and the back cover (500). The sub-substrate (220) may be electrically connected to the main board (210). The sub-substrate (220) may be a Flexible Printed Circuit Board (FPCB) board. The first and second microphones (211, 212) and the first and second cameras (213, 214) may be mounted on the main board (210). The battery (410), speaker (420), and vibrator (430) may be mounted on the sub-substrate (220). Accordingly, the wires connecting from each component to the main board (210) and the sub-substrate (220) may be simplified.

[0072] The magnet hole (221) may correspond to the shape of the first magnet (501) of the back cover (500). For example, the magnet hole (221) may be a circular hole. The area of ​​the magnet hole (221) may be larger than the cross-sectional area of ​​the first magnet (501) corresponding to the shape of the magnet hole (221).

[0073] The Hall Substrate (222) may surround the Magnet Hole (221). The Hall Substrate (222) may be equipped with a Hall Sensor (223, see FIG. 3). The Hall Substrate (222) may come into contact with the cover portion (505) of the back cover (500). The Hall Substrate (222) may not overlap with the first magnet (501). The Hall Substrate (222) may not come into contact with the first magnet (501). The Hall Substrate (222) may be spaced apart from the first magnet (501). Through this, noise caused by the first magnet (501) and deterioration of recognition of the Hall sensor (Hall Sensor, 223, see FIG. 3) can be prevented.

[0074] The antenna (230) may be located on the lower side of the sub-substrate (220). The antenna (230) may be mounted on the main substrate (210). The antenna (230) may be electrically connected to the main substrate (210). The antenna (230) may be adjacent to the microphone (212).

[0075] The back cover (500) may include a first magnet (501), a charging pin (502), a speaker cover (503), a groove (504) and / or a cover portion (505).

[0076] The first magnet (501) may be a magnet for attaching the electronic device (1) to the electronic device holder. The first magnet (501) may provide a first magnetic force. The first magnet (501) may provide a first magnetic force to the electronic device holder. For example, the first magnet (501) may be circular. The first magnet (501) may be aligned with a magnet hole (221).

[0077] The charging pin (502) may come into contact with the main board (210). The charging pin (502) may be electrically connected to the main board (210). The charging pin (502) may include a charging magnet for connecting a charger. The charging pin (502) may be a Pogo Pin. Meanwhile, the charging pin (502) may be referred to as a second charging terminal (502).

[0078] A groove (504) may be formed in the cover portion (505) of the back cover (500). The groove (504) may be formed by being recessed in the direction from the sub-substrate (220) toward the back cover (500). The groove (504) may be aligned with a Hall sensor (223, see FIG. 3). For example, the groove (504) may correspond to the shape of the Hall sensor (223, see FIG. 3). For example, the groove (504) may be a U-shaped groove.

[0079] The cover portion (505) may refer to the part of the back cover (500) excluding the first magnet (501), charging pin (502), speaker cover (503), and groove (504).

[0080] Referring to FIG. 4, the electronic device (1) may include a Hall sensor (223). For example, the Hall sensor (223) may include first to third Hall sensors (2231, 2232, 2233). The Hall sensor (223) may be located between a sub-substrate (220, see FIG. 2) and a back cover (500). The Hall sensor (223) may detect magnetic force. For example, the Hall sensor (223) may detect magnetic force behind the back cover (500). For example, the Hall sensor (223) may detect changes in magnetic force behind the back cover (500). Accordingly, the type of electronic device holder (2) coupled to the electronic device (1) can be recognized.

[0081] FIG. 5 is a diagram for explaining the operation of an electronic device (1) that determines the type of electronic device holder (2) and outputs a matching UI.

[0082] The electronic device (1) can obtain sensing information detected from a Hall sensor (223). (S1001) The Hall sensor (223) can detect the magnetic force of the electronic device holder (2). For example, the Hall sensor (223) can detect the magnetic force of the Hall magnet of the electronic device holder (2).

[0083] The electronic device (1) can determine whether information regarding the electronic device holder (2) corresponding to the sensing information is stored in the memory (11). (S1003) For example, the electronic device (1) can determine whether information regarding the type of the electronic device holder (2) corresponding to the sensing information is stored in the memory (11). The electronic device (1) can determine the type of the electronic device holder (2) based on whether information regarding the type of the electronic device holder (2) is stored in the memory (11).

[0084] The electronic device (1) can output a screen that matches the type of holder determined in operation S1003 through the display (100). (S1005) For example, the electronic device (1) can set the functions of the electronic device (1) according to the determined type of holder. The functions of the electronic device (1) may include at least one of volume, whether to use a speaker, whether to use a camera or microphone, and whether to output a screen. For example, the electronic device (1) can set the operation of the electronic device (1) according to the determined type of holder. For example, the electronic device (1) can display a UI (User Interface) that matches the determined type of holder through the display (100).

[0085] FIGS. 6 to 24 are drawings illustrating the combination and sensing position of an electronic device (1) and an electronic device holder (2), and the output screen of an electronic device corresponding to the electronic device holder (2).

[0086] FIGS. 6 to 8 are drawings for explaining how an electronic device (1) is coupled to a watch-type electronic device holder (2).

[0087] Referring to FIG. 6, the electronic device (1) can be coupled to the electronic device holder (2).

[0088] The electronic device holder (2) may include a holder (611) and / or a watch strap (612).

[0089] The watch strap (612) can be attached to the holder (611).

[0090] The watch strap (612) may include a first strap (6121), a second strap (6122), and / or a fastening part (6123). One end of the first strap (6121) may be coupled to a holder (611). One end of the second strap (6122) may be coupled to a holder (611). The first strap (6121) and the second strap (6122) may face each other with respect to the holder (611). The first strap (6121) may be located on the opposite side of the second strap (6122) with respect to the holder (611). The fastening part (6123) may secure the first strap (6121) and the second strap (6122). For example, the fastening part (6123) may be secured to the other end of the first strap (6121) and the other end of the second strap (6122). For example, the fastening part (6123) can be fixed in the middle of the first strap (6121) and the middle of the second strap (6122).

[0091] The electronic device holder may include a second magnet (6112) and / or a Hall Magnet (6113).

[0092] The second magnet (6112) can provide a second magnetic force opposite to the first magnetic force. For example, the second magnet (6112) can provide an attractive force to the first magnet (501, see FIG. 3). For example, the second magnet (6112) and the first magnet (501, see FIG. 3) can attract each other. The shape of the second magnet (6112) can correspond to the shape of the first magnet (501, see FIG. 3).

[0093] The Hall Magnet (6113) may be configured to correspond to the Hall Sensor (223, see FIG. 3) of the electronic device (1). The Hall Sensor (223, see FIG. 4) can detect the magnetic force of the Hall Magnet (6113). Through this, the type of electronic device holder can be recognized. For example, the electronic device (1) can recognize a watch-type electronic device holder by recognizing the magnetic force of the Hall Magnet (6113).

[0094] Referring to FIG. 7, the Hall Magnet (6113) may correspond to the first Hall Sensor (2231) of the electronic device (1). For example, the Hall Magnet (6113) may be placed at a position corresponding to the first Hall Sensor (2231) of the electronic device (1).

[0095] When the controller (10) receives first sensing information from the first Hall sensor, it can determine the type of electronic device holder (2) that matches the first sensing information to be a watch type.

[0096] Referring to FIG. 8, the controller (10) can display a screen matching a watch-type electronic device holder (2) on the display (100) based on the fact that the type of the electronic device holder (2) is determined to be a watch type. For example, the controller (10) can display a watch screen (801) on the display (100) based on the fact that the type of the electronic device holder (2) is determined to be a watch type.

[0097] FIGS. 9 and 10 are drawings for explaining how an electronic device (1) is coupled to a necklace-type electronic device holder (2).

[0098] Referring to FIG. 9, the electronic device holder (2) may include a holder (621) and / or a necklace part (622).

[0099] The necklace part (622) can be attached to the holder (621).

[0100] The necklace portion (622) may include a strap holder (6221) and / or a necklace strap (6222).

[0101] One end of the strap holder (6221) can be connected to the holder (621). A necklace hole through which a necklace strap (6222) passes can be formed adjacent to the other end of the strap holder (6221).

[0102] The electronic device holder may include a second magnet (6212) and / or a Hall Magnet (6213).

[0103] The second magnet (6212) can provide a second magnetic force opposite to the first magnetic force. For example, the second magnet (6212) can provide an attractive force to the first magnet (501, see FIG. 3). For example, the second magnet (6212) and the first magnet (501, see FIG. 3) can attract each other. The shape of the second magnet (6212) can correspond to the shape of the first magnet (501, see FIG. 3).

[0104] The Hall Magnet (6213) may be configured to correspond to the Hall Sensor (223, see FIG. 4) of the electronic device (1). The Hall Sensor (223, see FIG. 4) can detect the magnetic force of the Hall Magnet (6213). Through this, the type of electronic device holder can be recognized. For example, the electronic device (1) can recognize a necklace-type electronic device holder by recognizing the magnetic force of the Hall Magnet (6213).

[0105] Referring to FIG. 10, the Hall Magnet (6113) may correspond to the second Hall Sensor (2232) of the electronic device (1). For example, the Hall Magnet (6113) may be placed at a position corresponding to the second Hall Sensor (2232) of the electronic device (1).

[0106] When the controller (10) receives second sensing information from the second Hall sensor (2232), it can determine the type of electronic device holder (2) that matches the second sensing information to be a necklace type.

[0107] The controller (10) can display a screen that matches the necklace-type electronic device holder (2) on the display (100) based on the fact that the type of the electronic device holder (2) is determined to be a necklace type. For example, the controller (10) can display a basic screen (2601, see FIG. 26) on the display (100) based on the fact that the type of the electronic device holder (2) is determined to be a necklace type.

[0108] FIGS. 11 to 13 are drawings for explaining how an electronic device (1) is coupled to a speaker-type electronic device holder (2).

[0109] Referring to FIG. 11, the electronic device holder (2) may include a holder (631) and / or a holder speaker (632).

[0110] The holder (631) can be combined with the holder speaker (632).

[0111] The holder (631) may include a fixing pin (6311), a first charging terminal (6312), a holding plate (6313) and / or a rotating plate (6313).

[0112] The first charging terminal (6312) may be formed on the holding plate (6313). The first charging terminal (6312) may be electrically contacted with the second charging terminal (502, see FIG. 3). The first charging terminal (6312) may supply power to the second charging terminal (502, see FIG. 3). The shape of the first charging terminal (6312) may correspond to the shape of the second charging terminal (502, see FIG. 3).

[0113] The holding plate (6313) can be coupled to the rotating plate (6314). The electronic device (1) can be seated on the holding plate (6313). The electronic device (1) can be coupled to the holding plate (6313). For example, the holding plate (6313) can be formed integrally with the rotating plate (6314).

[0114] Referring to FIG. 12, the Hall Magnet (6113) may correspond to the first Hall sensor and the third Hall sensor (2231, 2233) of the electronic device (1). For example, the Hall Magnet (6113) may be placed at a position corresponding to the first Hall sensor and the third Hall sensor (2231, 2233) of the electronic device (1).

[0115] When the controller (10) receives third sensing information from the first Hall sensor and the third Hall sensor (Hall Sensor, 2231, 2233), it can determine the type of electronic device holder (2) that matches the third sensing information to be a speaker type.

[0116] Referring to FIG. 13, the controller (10) can display a screen matching a speaker-type electronic device holder (2) on the display (100) based on the fact that the type of the electronic device holder (2) is determined to be a speaker type. For example, the controller (10) can display a music playback control screen (1301) on the display (100) based on the fact that the type of the electronic device holder (2) is determined to be a speaker type.

[0117] FIGS. 14 to 16 are drawings for explaining how an electronic device (1) is coupled to a remote control type electronic device holder (2).

[0118] Referring to FIG. 14, the electronic device holder may include a holder (641) and / or a button portion (642).

[0119] The button part (642) can be coupled to the holder (641).

[0120] The holder (641) may include a first charging terminal (6412).

[0121] The first charging terminal (6412) can be electrically contacted with the second charging terminal (502, see FIG. 3). The first charging terminal (6412) can supply power to the second charging terminal (502, see FIG. 3). The shape of the first charging terminal (6412) can correspond to the shape of the second charging terminal (502, see FIG. 3).

[0122] The button section (642) may include a plurality of buttons (6421). When the electronic device (1) is coupled to the holder (641), the electronic device (1) can receive user input through the button section (642). When the electronic device (1) receives user input through the button section (642), it can transmit a signal corresponding to the user input to the outside.

[0123] Referring to FIG. 15, the Hall Magnet (6113) may correspond to the third Hall Sensor (2233) of the electronic device (1). For example, the Hall Magnet (6113) may be placed at a position corresponding to the third Hall Sensor (2233) of the electronic device (1).

[0124] When the controller (10) receives fourth sensing information from the third Hall sensor (Hall Sensor, 2233), it can determine the type of electronic device holder (2) that matches the fourth sensing information to be a remote control type.

[0125] Referring to FIG. 16, the controller (10) can display a screen matching a remote control type electronic device holder (2) on the display (100) based on the fact that the type of the electronic device holder (2) is determined to be a remote control type. For example, the controller (10) can display an external device control screen (e.g., OTT selection screen, 1601) on the display (100) based on the fact that the type of the electronic device holder (2) is determined to be a remote control type.

[0126] FIGS. 17 and 18 are drawings for explaining how an electronic device (1) is coupled to a clip-type electronic device holder (2).

[0127] Referring to FIG. 17, the electronic device holder may include a first clip magnet (651) and / or a second clip magnet (652).

[0128] The first clip magnet (651) can provide a second magnetic force opposite to the first magnetic force. For example, the first clip magnet (651) can provide an attractive force to the first magnet (501, see FIG. 3). For example, the first clip magnet (651) and the first magnet (501, see FIG. 3) can attract each other.

[0129] The second clip magnet (651) can provide a first magnetic force. For example, the second clip magnet (652) can provide an attractive force to the first clip magnet (651). For example, the second clip magnet (652) and the first clip magnet (651) can attract each other. The first clip magnet (651) can be attached to the rear of the electronic device (1). The second clip magnet (652) can be located behind the first clip magnet (651).

[0130] Referring to FIG. 18, the Hall Magnet (6113) may correspond to the first to third Hall Sensors (2231, 2232, 2233) of the electronic device (1). For example, the Hall Magnet (6113) may be placed at a position corresponding to the first to third Hall Sensors (2231, 2232, 2233) of the electronic device (1).

[0131] When the controller (10) receives fifth sensing information from the first to third Hall sensors (Hall Sensor, 2231, 2232, 2233), it can determine the type of electronic device holder (2) that matches the fifth sensing information to be a clip type.

[0132] The controller (10) can display a screen that matches the clip-type electronic device holder (2) on the display (100) based on the fact that the type of the electronic device holder (2) is determined to be a clip type. For example, the controller (10) can display a basic screen (2601, see FIG. 26) on the display (100) based on the fact that the type of the electronic device holder (2) is determined to be a clip type.

[0133] FIGS. 19 to 21 are drawings for explaining how an electronic device (1) is coupled to a charging dock-type electronic device holder (2).

[0134] Referring to FIG. 19, the electronic device holder may include a holder (661) and / or a charging line (662).

[0135] The holder (661) may include a second magnet (6611), a first charging terminal (6613) and / or a hall magnet (6614).

[0136] The second magnet (6611) can provide a second magnetic force opposite to the first magnetic force. For example, the second magnet (6611) can provide an attractive force to the first magnet (501, see FIG. 3). For example, the second magnet (6611) and the first magnet (501, see FIG. 3) can attract each other. The shape of the second magnet (6611) can correspond to the shape of the first magnet (501, see FIG. 3).

[0137] The first charging terminal (6613) can be electrically contacted with the second charging terminal (502, see FIG. 3). The first charging terminal (6613) can supply power to the second charging terminal (502, see FIG. 3). The shape of the first charging terminal (6613) can correspond to the shape of the second charging terminal (502, see FIG. 3).

[0138] The Hall Magnet (6615) may be configured to correspond to the Hall Sensor (223, see FIG. 4) of the electronic device (1). The Hall Sensor (223, see FIG. 4) can detect the magnetic force of the Hall Magnet (6615). Through this, the type of electronic device holder can be recognized. For example, the electronic device (1) can recognize a charging dock-type electronic device holder by recognizing the magnetic force of the Hall Magnet (6615).

[0139] The charging cable (662) can supply power to the holder (661).

[0140] Referring to FIG. 20, the Hall Magnet (6113) may correspond to the first and second Hall Sensors (2231, 2232) of the electronic device (1). For example, the Hall Magnet (6113) may be placed at a position corresponding to the first and second Hall Sensors (2231, 2232) of the electronic device (1).

[0141] When the controller (10) receives sixth sensing information from the first and second Hall sensors (Hall Sensor, 2231, 2232), it can determine the type of electronic device holder (2) that matches the sixth sensing information to be a charging dock type.

[0142] Referring to FIG. 21, the controller (10) can display a screen matching a charging dock type electronic device holder (2) on the display (100) based on the fact that the type of the electronic device holder (2) is determined to be a charging dock type. For example, the controller (10) can display a charging screen (2101) on the display (100) based on the fact that the type of the electronic device holder (2) is determined to be a charging dock type.

[0143] FIGS. 22 to 24 are drawings for explaining how an electronic device (1) is coupled to a headset-type electronic device holder (2).

[0144] Referring to FIG. 22, the electronic device holder (2) may include a holder (631) and / or a holder speaker (632).

[0145] The electronic device holder may include a first speaker part (671), a second speaker part (672) and / or a connection part (673).

[0146] The first speaker part (671) may include a holder (6711) and / or a first speaker (6712).

[0147] The electronic device (1) can be attached to the holder (6711). The electronic device (1) can be coupled to the holder (6711).

[0148] The first speaker (6712) can output sound.

[0149] The second speaker section (672) may include a button section (6721) and / or a second speaker (6722).

[0150] The second speaker (6722) can output sound.

[0151] The first speaker section (671) and the second speaker section (672) can face each other. The first speaker (6712) and the second speaker (6722) can face each other. The direction in which the first speaker (6712) outputs sound can face the direction in which the second speaker (6722) outputs sound.

[0152] The connecting part (673) can connect the first speaker part (671) and the second speaker part (672).

[0153] Referring to FIG. 23, the Hall Magnet (6113) may correspond to the second Hall Sensor and the third Hall Sensor (2232, 2233) of the electronic device (1). For example, the Hall Magnet (6113) may be placed at a position corresponding to the second Hall Sensor and the third Hall Sensor (2232, 2233) of the electronic device (1).

[0154] When the controller (10) receives the seventh sensing information from the second Hall sensor and the third Hall sensor (Hall Sensor, 2232, 2233), it can determine the type of electronic device holder (2) that matches the seventh sensing information to be a headset type.

[0155] Referring to FIG. 24, the controller (10) can display a screen matching a headset-type electronic device holder (2) on the display (100) based on the fact that the type of the electronic device holder (2) is determined to be a headset type. For example, the controller (10) can display a music playback control screen (2401) on the display (100) based on the fact that the type of the electronic device holder (2) is determined to be a headset type.

[0156] FIGS. 25 to 29 are drawings for explaining the basic operation of an electronic device (1).

[0157] Referring to FIG. 25, in operation S1005, the electronic device (1) can determine the type of electronic device holder (2) and display a screen matching the determined electronic device holder (2) through the display (100).

[0158] Referring to FIG. 26, the electronic device (1) can display a basic screen when the type of the electronic device holder (2) is a clip type or a necklace type. The basic screen can alternately display one of the first basic screen (2601) or the second basic screen (2602).

[0159] Referring again to FIG. 25, the electronic device (1) can detect user input. (S2501) For example, the electronic device (1) can detect user input through a touch panel, a microphone (211, 212) or a camera (213, 214).

[0160] Referring to FIG. 27, the electronic device (1) can display an input receiving screen (2701) while detecting user input.

[0161] Referring again to FIG. 25, the electronic device (1) can determine the situation of the user based on detecting user input. (S2503) For example, the electronic device (1) can determine the situation of the user through at least one of a microphone (211, 212), a camera (213, 214), or an artificial intelligence model based on detecting user input.

[0162] Referring to FIG. 28, the electronic device (1) may display a work screen through a display when determining the user's situation or performing an operation related to an external device. When the electronic device (1) is determining the user's situation, it may display a first work screen (2801) through a display (100). When the electronic device (1) is determining the user's situation related to music, it may display a second work screen (2802) through a display (100). When the electronic device (1) is determining the user's situation related to an external device, it may display a third work screen (2803) through a display (100).

[0163] Referring again to FIG. 25, the electronic device (1) can perform a corresponding operation according to the judgment result. (S2505) A detailed explanation regarding the performance of the operation of the electronic device (1) will be explained in FIG. 30 and below. In operation S2505, the controller (10) can perform a corresponding operation according to the judgment result.

[0164] The electronic device (1) can output operation information of the operation performed according to the judgment result through at least one of the display (100) or the speaker (420). (S2507)

[0165] Referring to FIG. 29, while the electronic device (1) outputs operation information, an operation screen (2901) can be output on the display (100).

[0166] FIGS. 30 to 33 are drawings for explaining the operation of an electronic device (1) according to an embodiment of the present invention.

[0167] Referring to FIG. 30, the electronic device (1) can detect an action execution input through at least one of a touch panel or a microphone (211, 212). (S3001) For example, the electronic device (1) can receive a touch input through the touch panel and then receive an action execution input through the microphone (211, 212). For example, the electronic device (1) can receive an action execution input through the microphone (211, 212).

[0168] Based on receiving an action execution input, the electronic device (1) can generate a checklist containing multiple item items or abnormal item items and store it in memory (11). (S3003) For example, the electronic device (1) can generate a checklist containing multiple item items or abnormal item items through an artificial intelligence model and store it in memory (11). The checklist may include at least one of multiple item items or abnormal item items that are arbitrarily generated by the artificial intelligence model by determining the user's situation. For example, based on the action execution input, the electronic device (1) can determine that the user's situation is in the travel preparation stage and generate a checklist containing multiple item items required for travel preparation or abnormal item items that cannot be stored in a suitcase through an artificial intelligence model and store it in memory (11).

[0169] The electronic device (1) can detect a first user input through a camera (213, 214). (S3005) The first user input may include an image of the user captured through the camera (213, 214). For example, the first user input may include an image of the user putting an item into a carrier.

[0170] The electronic device (1) can compare an item detected by the first user input with a plurality of item items or an abnormal item item of the checklist. (S3007) For example, the electronic device (1) can determine whether the item detected by the first user input is identical to one of the plurality of item items and an abnormal item item of the checklist.

[0171] The electronic device (1) can determine that an abnormal item has been detected if the item detected by the first user input is identical to one of the abnormal item items in the checklist. (S3009)

[0172] The electronic device (1) can output a warning notification through at least one of the display (100) or the speaker (420) based on the condition of the abnormal item item of the checklist being satisfied. (S3011)

[0173] Referring to FIG. 31, the electronic device (1) can output a warning screen (3101) through the display (100) based on the condition of the item of the item of the checklist being satisfied.

[0174] Referring again to FIG. 30, the electronic device (1) can check one of the multiple item items of the checklist if the item detected by the first user input is identical to one of the multiple item items of the checklist. (S3013)

[0175] Referring to FIG. 32, the electronic device (1) can output a check screen (3201) through the display (100) based on checking one of the multiple item items of the checklist. After outputting the check screen (3201) through the display (100), the electronic device (1) can output a multiple item item screen (3202) of the checklist. For example, after outputting the check screen (3201) through the display (100), the electronic device (1) can output a multiple item item screen (3202) of the checklist after 2 seconds.

[0176] Referring again to FIG. 30, the electronic device (1) can determine whether the conditions for all item items of the checklist are satisfied. (S3015)

[0177] The electronic device (1) can output a completion notification through at least one of the display (100) or the speaker (420) when the conditions for all item items of the checklist are met. (S3017)

[0178] Referring to FIG. 33, the electronic device (1) can detect a second user input. (S3301) For example, the electronic device (1) can detect the second user input through a microphone (211, 212). The second user input may be an input for outputting whether there is an unchecked item among a plurality of item items of a checklist.

[0179] The electronic device (1) can determine whether the conditions for all item items of the checklist are satisfied in the S3015 operation.

[0180] In the S3303 operation, the electronic device (1) can output a missing item notification if there are unchecked item items among the item items of the checklist. For example, if there are unchecked item items among the item items of the checklist, the electronic device (1) can output a missing item notification through at least one of the display (100) or the speaker (420).

[0181] FIGS. 34 to 35 are drawings for explaining the operation of an electronic device (1) according to another embodiment of the present invention.

[0182] Referring to FIG. 34, the electronic device (1) can receive a learning input through at least one of a touch panel or a microphone (211, 212). (S3401) For example, the electronic device (1) can receive a learning input through the microphone (211, 212) after receiving a touch input through the touch panel. For example, the electronic device (1) can receive a learning input through the microphone (211, 212).

[0183] The electronic device (1) can obtain user-related information based on receiving learning input. (S3403) For example, the electronic device (1) can obtain user-related information by detecting external conditions through the camera (213, 214). For example, the electronic device (1) can obtain information about products included in a captured image of an external device screen through the camera (213, 214). The external device may be a medium that outputs images, such as a TV module or a tablet.

[0184] Referring to FIG. 35, the electronic device (1) can output a learning screen (3501) through a display (100) while acquiring user-related information.

[0185] Referring again to FIG. 34, the electronic device (1) can detect a first user input through at least one of a touch panel or a microphone (211, 212). (S3405) At this time, the first user input may be an input for searching for a product included in a captured image. Based on the first user input, the electronic device (1) can obtain a search result for a product included in a captured image from a server.

[0186] The electronic device (1) can output information corresponding to user input. (S3407) For example, the electronic device (1) can output search results for acquired products through at least one of a display (100) or a speaker (420).

[0187] FIGS. 36 to 37 are drawings for explaining the operation of an electronic device (1) according to another embodiment of the present invention.

[0188] Referring to FIG. 36, an electronic device (1) can receive a learning input. (S3601) For example, the electronic device (1) can receive the learning input through at least one of a touch panel or a microphone (211, 212). For example, the electronic device (1) can receive a learning input through the microphone (211, 212) after receiving a touch input through the touch panel. For example, the electronic device (1) can receive the learning input through the microphone (211, 212).

[0189] Based on receiving a learning input, the electronic device (1) can obtain information about a target location included in a captured image of the screen of an external device through a camera (213, 214). (S3603)

[0190] The electronic device (1) can detect user input. (S3605) For example, the electronic device (1) can detect user input through at least one of a touch panel or a microphone (211, 212). For example, the electronic device (1) can receive user input through the microphone (211, 212) after receiving touch input through the touch panel. For example, the electronic device (1) can receive user input through the microphone (211, 212). The user input may be an input for route guidance from the real-time location of the electronic device (1) detected by the location information sensor (15) to the destination location.

[0191] The electronic device (1) can obtain a path from the real-time location of the electronic device (1) to a destination location. (S3607) For example, the electronic device (1) can receive real-time location information of the electronic device (1) from a location information sensor (15) and obtain search results for the destination location from a server. For example, the electronic device (1) can obtain a path from the real-time location of the electronic device (1) to a destination location through an artificial intelligence model.

[0192] The electronic device (1) can output information corresponding to user input. (S3609) The electronic device (1) can output a path from the real-time location of the electronic device (1) to a destination location through at least one of a display (100) or a speaker (420).

[0193] Referring to FIG. 37, the electronic device (1) can output a path guidance (3701) from the real-time location of the electronic device (1) to the destination location through the display (100).

[0194] FIG. 38 is a flowchart for explaining the operation of an electronic device (1) according to another embodiment of the present invention.

[0195] The electronic device (1) can receive learning input. (S3801) For example, the electronic device (1) can receive learning input through at least one of a touch panel or a microphone (211, 212). For example, the electronic device (1) can receive learning input through the microphone (211, 212) after receiving touch input through the touch panel. For example, the electronic device (1) can receive learning input through the microphone (211, 212).

[0196] The electronic device (1) can obtain appearance information regarding a first external person detected through a camera (213, 214) based on a learning input. (S3803) For example, the electronic device (1) can obtain appearance information regarding a first external person included in an image detected through a camera (213, 214).

[0197] The electronic device (1) can match information regarding the first external person and information regarding appearance and clothing based on the second user input and store them in memory (11). (S3805) For example, the electronic device (1) can match information regarding the first external person and information regarding appearance and clothing based on the second user input, which is voice input received through the microphone (211, 212), and store them in memory (11). The second user input may be a voice input for inputting information regarding the first external person. For example, the second user input may be a voice input for inputting information such as the name, title, or nickname of the first external person.

[0198] The electronic device (1) can detect a first user input. (S3807) The electronic device (1) can detect the first user input through at least one of a touch panel or a microphone (211, 212). The first user input may be an input for searching for information about a second external person detected through a camera (213, 214).

[0199] The electronic device (1) can determine whether the appearance information of the second external person and the first external person are the same. (S3809) For example, the electronic device (1) can determine whether the appearance information of the second external person included in the image detected through the camera (213, 214) and the appearance information of the first external person stored in the memory (11) are the same.

[0200] The electronic device (1) can output information regarding the first external person through at least one of a display (100) or a speaker (420) based on the fact that the appearance information of the second external person and the first external person is the same. (S3811) For example, the electronic device (1) can output information regarding the first external person stored in memory (11) through at least one of a display (100) or a speaker (420) based on the fact that the appearance information of the second external person and the first external person is the same.

[0201] FIGS. 39 to 40 are drawings for explaining the operation of an electronic device (1) according to another embodiment of the present invention.

[0202] Referring to FIG. 39, the electronic device (1) can detect an operation execution input. (S3901) For example, the electronic device (1) can receive an operation execution input through at least one of a touch panel or a microphone (211, 212). For example, the electronic device (1) can receive a touch input through the touch panel and then receive an operation execution input through the microphone (211, 212). For example, the electronic device (1) can receive an operation execution input through the microphone (211, 212). The operation execution input may be an input for preparing an operation of an external device. For example, the external device may be a washing machine. For example, the operation execution input may be an input for preparing an operation of a washing machine.

[0203] The electronic device (1) can generate a warning list containing multiple warning item items based on the reception of an operation execution input and store it in memory (11). (S3903) For example, the electronic device (1) can generate a warning list containing multiple warning item items through an artificial intelligence model based on the reception of an operation execution input and store it in memory (11). The warning list may be a list arbitrarily generated by the artificial intelligence model by determining the user's situation. For example, the warning list may be multiple item items including items that cannot be washed in a washing machine or items that are at risk of color transfer when mixed with other items.

[0204] The electronic device (1) can detect a first user input. (S3905) For example, the electronic device (1) can receive a first user input including an image of the user captured through a camera (213, 214). For example, the first user input may be detecting an image of the user putting an item into a washing machine through the camera (213, 214).

[0205] The electronic device (1) can determine whether to check each item item of the warning list based on the captured image. (S3907) For example, if an item corresponding to each item item of the warning list is placed in an external device based on the captured image, the electronic device (1) can determine that each item item of the warning list is checked. For example, if an item corresponding to each item item of the warning list is placed in a washing machine based on the captured image, the electronic device (1) can determine that each item item of the warning list is checked.

[0206] The electronic device (1) can output a warning notification through at least one of the display (100) or the speaker (420) based on each item item of the warning list being checked. (S3909)

[0207] The electronic device (1) can acquire information about multiple item items located inside an external device based on a captured image and determine a recommended mode of the external device corresponding to the multiple item items through an artificial intelligence model. (S3911) For example, the electronic device (1) can acquire information about multiple item items located inside a washing machine based on a captured image and determine a recommended mode of the washing machine corresponding to multiple laundry items through an artificial intelligence model.

[0208] The electronic device (1) can determine whether the recommended mode is stored in the memory of an external device. (S3913)

[0209] If the electronic device (1) does not have the recommended mode stored in the memory of the external device, it can transmit a recommended mode download signal to the external device. (S3915) For example, if the electronic device (1) does not have the recommended mode stored in the memory of the washing machine, it can transmit a recommended mode download signal to the washing machine.

[0210] Referring to FIG. 40, while an external device is downloading a recommended mode, the electronic device (1) can output a recommended mode download screen (4001) through a display (100).

[0211] Referring again to FIG. 39, the electronic device (1) can determine whether a second user input is detected when a recommended mode is stored in the memory of an external device. (S3917) For example, the electronic device (1) can determine whether a second user input, which is an input for the operation of an external device, is detected through at least one of a touch panel or a microphone (211, 212) when a recommended mode is stored in the memory of an external device. For example, the electronic device (1) can determine whether a second user input, which is an input for the operation of a washing machine, is detected through at least one of a touch panel or a microphone (211, 212) when a recommended mode is stored in the memory of an external device.

[0212] The electronic device (1) can transmit a recommended mode operation signal to an external device based on the detection of a second user input. (S3919)

[0213] FIGS. 41 to 43 are drawings for explaining the operation of an electronic device (1) according to another embodiment of the present invention.

[0214] Referring to FIG. 41, the electronic device (1) can detect an action execution input. (S4101) For example, the electronic device (1) can receive an action execution input through at least one of a touch panel or a microphone (211, 212). For example, the electronic device (1) can receive a touch input through the touch panel and then receive an action execution input through the microphone (211, 212). For example, the electronic device (1) can receive an action execution input through the microphone (211, 212). The action execution input may be an input for turning on the power of an external device.

[0215] The electronic device (1) can detect user input. (S4103) For example, the electronic device (1) can detect user input including an image of the user captured through a camera (213, 214). The user input may be the detection of a user's gesture to control an external device through the camera (213, 214). For example, the external device may be a medium that outputs a screen, such as a TV or a tablet.

[0216] The electronic device (1) can determine whether information corresponding to user input is stored in memory (11). (S4105) For example, the electronic device (1) can determine whether information corresponding to a user gesture detected through the camera (213, 214) is stored in memory (11).

[0217] The electronic device (1) can output a screen corresponding to user input through a display (100) based on information corresponding to user input being stored in a memory (11). (S4107)

[0218] Referring to FIG. 42, the electronic device (1) can output first to fourth gesture screens (4201, 4202, 4203, 4204) through a display (100) based on information corresponding to user input being stored in a memory (11). For example, the first gesture screen (4201) may be a screen corresponding to detecting the positional movement of the user's hand through cameras (213, 214). The electronic device (1) may transmit a cursor movement signal displayed on the display of an external device to an external device in response to the first gesture screen (4201). For example, the second gesture screen (4202) may be a screen corresponding to detecting an image of the user's thumb and index finger touching through cameras (213, 214). The electronic device (1) may transmit a content selection signal to an external device in response to the second gesture screen (4201). For example, the third gesture screen (4203) may be a screen that detects an image of the user's hand moving up and down after detecting an image of the user's hand touching the user's thumb and index finger through the camera (213, 214). The electronic device (1) may transmit a volume control signal to an external device in response to the third gesture screen (4203). For example, the fourth gesture screen (4204) may be a screen that detects an image of the hand moving back and forth through the camera (213, 214). The electronic device (1) may transmit a back signal to an external device in response to the fourth gesture screen (4204). The back signal may be a signal to recall the previous screen displayed on the external device's display.

[0219] Referring again to FIG. 41, the electronic device (1) can transmit a signal corresponding to user input to an external device. (S4109) For example, the electronic device (1) can transmit a cursor movement signal displayed on the display of the external device to the external device in response to the first gesture screen (4201). For example, the electronic device (1) can transmit a content selection signal to the external device in response to the second gesture screen (4201). For example, the electronic device (1) can transmit a volume control signal to the external device in response to the third gesture screen (4203). For example, the electronic device (1) can transmit a back signal to the external device in response to the fourth gesture screen (4204).

[0220] FIG. 43 is a flowchart for explaining the operation of an electronic device (1) according to another embodiment of the present invention.

[0221] The electronic device (1) can detect user input. (S4301) For example, the electronic device (1) can detect user input through at least one of a camera (213, 214) or a microphone (211, 212). The user input may be voice input for searching for products included in a captured image of the screen of an external device.

[0222] The electronic device (1) can obtain search results for products included in a captured image taken via a server. (S4303)

[0223] The electronic device (1) can transmit product search result information obtained through the communication interface (14) to an external device. (S4305)

[0224] FIGS. 44 to 45 are drawings for explaining the operation of an electronic device (1) according to another embodiment of the present invention.

[0225] Referring to FIG. 44, the electronic device (1) can detect user input. (S4401) For example, the electronic device (1) can detect user input through at least one of a camera (213, 214) or a microphone (211, 212). User input may be a user entering a question requesting a response through the microphone (211, 212).

[0226] The electronic device (1) can determine the situation of the user. (S4403) For example, the electronic device (1) can obtain a response result to a question through an artificial intelligence model in response to user input.

[0227] The electronic device (1) can output a screen corresponding to the user situation through the display (100). (S4405)

[0228] Referring to FIG. 45, the electronic device (1) may output one of the first to fifth emotion expression screens (4501, 4502, 4503, 4504, 4505) through the display (100) in response to a determined user situation. For example, the first emotion expression screen (4501) may express the emotion of 'anger'. For example, the second emotion expression screen (4502) may express the emotion of 'encouragement'. For example, the third emotion expression screen (4503) may express the emotion of 'sadness'. For example, the fourth emotion expression screen (4504) may express the emotion of 'confessional'. For example, the fifth emotion expression screen (4505) may express the emotion of 'joy'.

[0229] Referring again to FIG. 44, the electronic device (1) can output a response corresponding to the user situation. (S4407) For example, the electronic device (1) can output a response result obtained through an artificial intelligence model corresponding to the user situation through a speaker (420).

[0230] FIG. 46 is a flowchart for explaining the operation of an electronic device (1) according to another embodiment of the present invention.

[0231] Referring to FIG. 46, an electronic device can receive an action execution input (S4601). For example, the electronic device (1) can receive an action execution input through at least one of a touch panel or a microphone (211, 212). For example, the electronic device (1) can receive a touch input through the touch panel and then receive an action execution input through the microphone (211, 212). For example, the electronic device (1) can receive an action execution input through the microphone (211, 212). The action execution input may be an input that activates a function to detect an image through the camera (213, 214) of the electronic device.

[0232] The electronic device (1) can detect user input based on receiving an action execution input. (S4603) For example, the electronic device (1) can receive user input including an image of the user captured through a camera (213, 214) based on receiving an action execution input.

[0233] The electronic device (1) can obtain search results for information about products included in the captured image through the server. (S4605)

[0234] The electronic device (1) can output information search results regarding a product through at least one of a display (100) or a speaker (420). (S4607)

[0235]

[0236] According to FIGS. 1 to 46, an electronic device holder (2) and a detachable electronic device (1) according to one embodiment of the present invention may include: a display (100); at least one Hall sensor (223) that detects sensing information based on the attachment of the electronic device holder (2); and a controller (10) that determines the type of the electronic device holder (2) based on the sensing information detected from the at least one Hall sensor (223) and displays a screen matching the determined type of the electronic device holder (2) on the display (100).

[0237] The electronic device (1) further includes a memory (11) that stores sensing information and identification information of the electronic device holder (2), and the controller (10) can determine the type of the electronic device (1) that matches the sensed sensing information from the memory (11).

[0238] The above at least one Hall sensor (223) comprises: a first Hall sensor (2231); a second Hall sensor (2232) spaced apart from the first Hall sensor (2231); and a third Hall sensor (2233) spaced apart from the first Hall sensor (2231) and the second Hall sensor (2232). The controller (10) can determine the type of a first electronic device holder (2) that matches the first sensing information when first sensing information is received from the first Hall sensor (2231), and determine the type of a second electronic device holder (2) that matches the second sensing information when second sensing information is received from the second Hall sensor (2232).

[0239] The electronic device (1) further comprises: a communication interface (14) capable of communicating with an external device or server; a camera (213, 214) for recognizing external conditions; a microphone (211, 212); a speaker (420) for outputting sound; a touch panel provided on the display (100); or at least one of a memory (11) for storing an artificial intelligence model, and the controller (10) can: determine the situation of the user based on detecting a first user input, perform an action corresponding to the determined situation of the user through the artificial intelligence model, and output operation information of the performed action through at least one of the display (100) or the speaker (420).

[0240] The controller (10) receives an operation execution input through at least one of the touch panel or the microphone (211, 212), generates a checklist including a plurality of item items from the received operation execution input through the artificial intelligence model and stores it in the memory (11), receives a first user input including an image of the user taken through the camera (213, 214), determines whether to check each item item of the checklist based on the captured image, and when the check of all item items of the checklist is completed, outputs a completion notification through at least one of the display (100) or the speaker (420).

[0241] The above checklist further includes an item of an abnormal item, and the controller (10) determines whether the item of an abnormal item in the checklist is checked based on the captured image, and based on whether the item of an abnormal item is checked, outputs a warning notification through at least one of the display (100) or the speaker (420).

[0242] The controller (10) can determine whether each item item of the checklist is checked based on detecting a second user input through the microphone (211, 212), and if there is an item item that is not checked among the item items of the checklist, it can output a missing item notification through at least one of the display (100) or the speaker (420).

[0243] The controller (10) can receive a learning input through at least one of the touch panel or the microphone (211, 212), and based on receiving the learning input, obtain information about a product included in a captured image of the screen of the external device through the camera (213, 214), obtain a search result for the product from the server based on the first user input which is an input for searching for the product, and output the search result information about the product through at least one of the display (100) or the speaker (420).

[0244] The electronic device (1) further includes a location information sensor (15) that detects the real-time location of the electronic device (1), and the controller (10) receives a learning input through at least one of the touch panel or the microphone (211, 212), and based on receiving the learning input, obtains information regarding the target location included in a captured image of the screen of the external device through the camera (213, 214), obtains a search result regarding the target location from the server based on the first user input which is an input for searching regarding the target location, and can output a path from the real-time location of the electronic device (1) to the target location through at least one of the display (100) or the speaker (420).

[0245] The controller (10) can receive a learning input through at least one of the touch panel or the microphone (211, 212), acquire appearance information of a first external person detected through the camera (213, 214) based on receiving the learning input, match the appearance information of the first external person with the appearance information based on a second user input which is a voice input for inputting the information of the first external person and store it in the memory (11), determine whether the appearance information of the second external person detected through the camera (213, 214) is the same as the appearance information of the first external person stored in the memory (11) based on a first user input which is an input for searching for information of the second external person, and output the information of the first external person through at least one of the display (100) or the speaker (420) based on the fact that the appearance information of the first external person and the second external person is the same.

[0246] The controller (10) receives an operation execution input through at least one of the touchpad or the microphone (211, 212), and based on the reception of the operation execution input, generates a warning list including a plurality of warning item items through the artificial intelligence model and stores it in the memory (11), receives a first user input including an image of the user taken through the camera (213, 214), determines whether each item item of the warning list is checked based on the captured image, and based on the fact that each item item of the warning list is checked, outputs a warning notification through at least one of the display (100), the speaker (420), or the external device.

[0247] The above controller (10) can: acquire information about a plurality of item items located inside the external device based on the captured image, determine a recommendation mode of the external device corresponding to the plurality of item items through the artificial intelligence model, and if the recommendation mode is not stored in the memory of the external device, transmit a recommendation mode download signal to the external device, and if the recommendation mode is stored in the memory of the external device, transmit a recommendation mode operation signal of the external device based on a second user input which is an input for the operation of the external device.

[0248] The controller (10) can: determine whether information corresponding to the first user input is stored in the memory (11) based on detecting the first user input, which is an input for the operation of the external device, through at least one of the camera (213, 214) or the microphone (211, 212), and based on whether information corresponding to the first user input is stored in the memory (11), transmit a signal corresponding to the first user input to the external device.

[0249] The first user input is a voice input for searching for a product included in a captured image of the screen of the external device, and the controller (10) can: capture the captured image through the camera (213, 214), obtain a search result for the product included in the captured image through the server, and transmit the obtained search result to the external device through the communication interface (14).

[0250] The controller (10) can: receive an operation execution input through the microphone (211, 212), receive a first user input including an image of the user captured through the camera (213, 214) based on receiving the operation execution input, obtain a search result regarding a product included in the captured image through the server, and output the search result regarding the product through at least one of the display (100) or the speaker (420).

[0251]

[0252] Some or other embodiments of the present disclosure described above are not exclusive or distinct from one another. Some or other embodiments of the present disclosure described above may be used in combination or combined for their respective configurations or functions.

[0253] For example, this means that configuration A described in a specific embodiment and / or drawing and configuration B described in another embodiment and / or drawing can be combined. That is, even if the combination between configurations is not directly described, it means that combination is possible, except in cases where it is described that combination is impossible.

[0254] The foregoing detailed description should not be interpreted restrictively in all respects and should be considered exemplary. The scope of the invention shall be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the invention are included within the scope of the invention.

Claims

1. In an electronic device holder and a detachable electronic device, display; At least one Hall sensor that detects sensing information upon attachment of the electronic device holder; and Based on the sensing information detected from at least one Hall sensor, the type of the electronic device holder is determined, and An electronic device comprising a controller that displays a screen on the display that matches the type of the electronic device holder determined above.

2. In Paragraph 1, The above electronic device is: It further includes a memory that stores sensing information and identification information of the electronic device holder, The above controller is: An electronic device that determines the type of the electronic device that matches the sensing information detected from the memory.

3. In Paragraph 1, The above at least one Hall sensor is: First Hall Sensor; A second Hall sensor spaced apart from the first Hall sensor; and It includes a third Hall sensor spaced apart from the first Hall sensor and the second Hall sensor, and The above controller is: When first sensing information is received from the first Hall sensor, the type of the first electronic device holder matching the first sensing information is determined, and An electronic device that determines the type of a second electronic device holder that matches the second sensing information when the second sensing information is received from the second Hall sensor.

4. In Paragraph 1, A communication interface capable of communicating with an external device or server; A camera that recognizes external conditions; microphone; A speaker that outputs sound; A touch panel provided on the above display; or It further includes at least one of the memories storing the artificial intelligence model, and The above controller is: Based on detecting the first user input, the user's situation is determined, and Performing an action corresponding to the user's situation determined above through the above artificial intelligence model, and An electronic device that outputs operation information of the above-performed operation through at least one of the display or the speaker.

5. In Paragraph 4, The above controller is: Receiving an operation execution input through at least one of the touch panel or the microphone, and A checklist including multiple item items is generated from the received action execution input through the above artificial intelligence model and stored in the memory, Receiving the first user input including an image of the user captured through the camera, Based on the above-mentioned captured image, determine whether each item of the above-mentioned checklist is checked, and An electronic device that outputs a completion notification through at least one of the display or the speaker when the check of all item items of the above checklist is completed.

6. In Paragraph 5, The above checklist further includes items of defective goods, and The above controller is: Based on the above-mentioned captured image, determine whether the abnormal item item of the above-mentioned checklist is checked, and An electronic device that outputs a warning notification through at least one of the display or the speaker based on checking the above-mentioned abnormal item item.

7. In Paragraph 5, The above controller is: Based on detecting a second user input through the microphone, it is determined whether each item item of the checklist is checked, and An electronic device that outputs a missing item notification through at least one of the display or the speaker when there is an unchecked item among the item items of the above checklist.

8. In Paragraph 4, The above controller is: Receiving learning input through at least one of the touch panel or the microphone, and Based on receiving the above learning input, information about a product included in a captured image of the screen of the external device through the camera is obtained, and Based on the first user input, which is an input for searching for the above product, a search result for the above product is obtained from the server, and An electronic device that outputs search result information for the product through at least one of the above display or the above speaker.

9. In Paragraph 4, It further includes a location information sensor that detects the real-time location of the above electronic device, The above controller is: Receiving learning input through at least one of the touch panel or the microphone, and Based on receiving the above learning input, information regarding a target location included in a captured image of the screen of the external device through the camera is obtained, and Based on the first user input, which is an input for searching regarding the above-mentioned destination location, a search result for the above-mentioned destination location is obtained from the server, and An electronic device that outputs a path from a real-time location of the electronic device to a destination location through at least one of the display or the speaker.

10. In Paragraph 4, The above controller is: Receiving learning input through at least one of the touch panel or the microphone, and Based on receiving the above learning input, information regarding the appearance of a first external person detected through the camera is obtained, and Based on a second user input, which is a voice input for inputting information regarding the first external person, the information regarding the first external person and the appearance information are matched and stored in the memory, and Based on a first user input, which is an input for searching information regarding a second external person, determining whether the appearance information of the second external person detected through the camera is identical to the appearance information of the first external person stored in the memory, and An electronic device that outputs information regarding the first external person through at least one of the display or the speaker, based on the fact that the appearance information of the first external person and the second external person is the same.

11. In Paragraph 4, The above controller is: Receiving operation execution input through at least one of the touchpad or the microphone, and Based on the reception of the above operation execution input, a warning list including a plurality of warning item items is generated through the artificial intelligence model and stored in the memory, and Receiving the first user input including an image of the user captured through the camera, Based on the above-mentioned captured image, determine whether each item in the above-mentioned warning list is checked, and An electronic device that outputs a warning notification through at least one of the display, the speaker, or the external device based on each item item of the above warning list being checked.

12. In Paragraph 11, The above controller is: Based on the above-mentioned captured image, information regarding a plurality of item items located inside the external device is obtained, and Determining the recommendation mode of the external device corresponding to the plurality of item items through the above artificial intelligence model, and If the above recommended mode is not stored in the memory of the external device, a download signal for the above recommended mode is transmitted to the external device, and An electronic device that transmits a recommendation mode operation signal of the external device based on a second user input, which is an input for the operation of the external device, when the recommendation mode is stored in the memory of the external device.

13. In Paragraph 4, The above controller is: Based on detecting the first user input, which is an input for the operation of the external device through at least one of the camera or the microphone, determining whether information corresponding to the first user input is stored in the memory, and An electronic device that transmits a signal corresponding to the first user input to the external device based on information corresponding to the first user input being stored in the memory.

14. In Paragraph 4, The above first user input is: It is a voice input for searching for products included in a captured image of the screen of the above external device, and The above controller is: The above-mentioned captured image is taken through the above-mentioned camera, and A search result for the product included in the captured image taken above is obtained through the above server, and An electronic device that transmits the search results obtained above to the external device through the communication interface above.

15. In Paragraph 4, The above controller is: Receive operation execution input through the above microphone, and Based on receiving an action execution input, the first user input including an image of the user captured through the camera is received, and Acquire search results regarding products included in the captured image through the above server, and An electronic device that outputs search results regarding the product through at least one of the above display or the above speaker.

Images