Electronic device providing hands-free function and method for controlling same

Abstract

An electronic device is disclosed. The electronic device comprises: a communication interface; one or more processors including processing circuitry; and a memory storing instructions, wherein the instructions, when individually or collectively executed by the one or more processors, instruct the electronic device to perform a first hands-free function, which includes: when a first BLE packet is received through the communication interface, identifying a first external device on the basis of identification information included in the first BLE packet; when the first external device is identified as a pre-registered device, transmitting a second BLE packet through the communication interface; performing a first connection between the electronic device and the first external device when a connection request is received from the first external device in response to transmission of the second BLE packet; and controlling the electronic device to output a first notification to be outputted from the first external device, on the basis of the first connection between the electronic device and the first external device.

Description

Electronic device providing hands-free function and method for controlling the same

[0001] The present invention relates to an electronic device and a control method thereof, and more particularly, to an electronic device providing a hands-free function and a control method thereof.

[0002] Hands-free functionality may refer to the ability of a user to respond to various notifications (e.g., phone calls or short message service (SMS) messages) received by a user terminal device (e.g., mobile phone, smartphone, tablet computer, laptop computer, wearable device, smart home appliance, Internet of Things (IoT) device, etc.) without directly touching the user terminal device.

[0003] For example, if a user's terminal device receives a notification while connected to a vehicle, the hands-free feature allows the user to respond to the notification (e.g., answer or reject a call) via the vehicle's voice-based interface. This allows the user to respond to the notification without distraction while driving (e.g., without taking their hands off the steering wheel).

[0004] For example, if a user's terminal device receives a notification while connected to a vehicle, the hands-free feature allows the user to respond to the notification (e.g., answer or reject a call) via the vehicle's voice-based interface. This allows the user to respond to the notification without distraction while driving (e.g., without taking their hands off the steering wheel).

[0005] Therefore, further improvements are needed in the hands-free function to provide a UI that can respond to notifications received by a user terminal device currently connected to the electronic device as well as notifications from multiple user terminal devices installed around the electronic device.

[0006] An electronic device according to an aspect of the present disclosure includes a communication interface, one or more processors including processing circuitry, and a memory storing instructions, wherein the instructions, when individually or collectively executed by the one or more processors, cause the electronic device to perform a first hands-free function, which causes the electronic device to: identify a first external device based on identification information included in a first BLE packet when a first BLE packet is received through the communication interface; transmit a second BLE packet through the communication interface when the first external device is identified as a pre-registered device; perform a first connection between the electronic device and the first external device when a connection request is received through the communication interface from the first external device in response to transmission of the second BLE packet; and control the electronic device to output a first notification to be output from the first external device based on the first connection between the electronic device and the first external device.

[0007] A method for controlling an electronic device according to an embodiment of the present disclosure includes: when a first BLE packet is received, identifying a first external device based on identification information included in the first BLE packet; when the first external device is identified as a pre-registered device, transmitting a second BLE packet; when a connection request is received from the first external device according to transmission of the second BLE packet, performing a first connection between the electronic device and the first external device; and, based on the first connection between the electronic device and the first external device, executing a first hands-free function for controlling the electronic device to output a first notification to be output from the first external device.

[0008] According to an aspect of the present disclosure, a computer-readable non-transitory storage medium stores instructions. The computer-readable instructions, when executed by one or more processors of an electronic device, cause the electronic device to execute a first hands-free function, which includes: when a first BLE packet is received, identifying a first external device based on identification information included in the first BLE packet; when the first external device is identified as a pre-registered device, transmitting a second BLE packet; when a connection request is received from the first external device in response to transmission of the second BLE packet, performing a first connection between the electronic device and the first external device; and controlling the electronic device to output a first notification to be output from the first external device based on the first connection between the electronic device and the first external device.

[0009] A system according to an aspect of the present disclosure may include a first external device, a second external device, and an electronic device. The electronic device may receive a first BLE packet, including first identification information, identify the first external device based on the first identification information, transmit a second BLE packet after the first external device is identified as a pre-registered device, perform a first connection between the electronic device and the first external device when a connection request is received from the first external device based on the transmission of the second BLE packet, and execute a first wireless function to control the electronic device to output a first notification that is scheduled to be output by the first external device based on the first connection between the electronic device and the first external device.

[0010] Additional aspects may be set out in part in this description, may be clarified in part in the description, or may be learned through practice of the presented implementation.

[0011] The above and other aspects, features and advantages of specific implementations of this disclosure can be more clearly understood by reference to the drawings provided with the following description.

[0012] FIG. 1 is a drawing for explaining a hands-free function according to an embodiment of the present disclosure.

[0013] FIG. 2 is a block diagram showing the configuration of a display device according to an embodiment of the present disclosure.

[0014] FIG. 3 is a diagram for explaining a user terminal device and a display device that transmits and receives BLE advertising packets according to an embodiment of the present disclosure.

[0015] FIG. 4 is a sequence diagram illustrating a display device that displays a notification received by a user terminal device according to an embodiment of the present disclosure.

[0016] FIG. 5 is a sequence diagram illustrating a method for registering a user terminal device in a display device according to an embodiment of the present disclosure.

[0017] FIG. 6 is a drawing for explaining a display device that receives an mDNS query from a user terminal device and transmits an mDNS response to the user terminal device according to an embodiment of the present disclosure.

[0018] FIG. 7 is a sequence diagram illustrating a display device displaying a notification received by a user terminal device logged in with an account different from an account logged in to the display device according to an embodiment of the present disclosure.

[0019] FIG. 8 is a sequence diagram illustrating a method for activating a hands-free function of a display device through a user terminal device logged in with the same account as the account logged in to the display device according to an embodiment of the present disclosure.

[0020] FIG. 9 is a sequence diagram illustrating a method for activating a hands-free function of a display device through a user terminal device logged in with an account different from an account logged in to the display device according to an embodiment of the present disclosure.

[0021] FIG. 10 is a sequence diagram illustrating a method for activating a hands-free function of a display device according to an embodiment of the present disclosure.

[0022] FIG. 11 is a drawing for explaining a display device according to an embodiment of the present disclosure.

[0023] FIG. 12 is a flowchart for explaining a method for controlling a display device according to an embodiment of the present disclosure.

[0024] Hereinafter, the present disclosure will be described in detail with reference to the attached drawings.

[0025] The terms used in the embodiments of this disclosure have been selected from widely used, current terms, taking into account the functions of this disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of this disclosure.

[0026] In this specification, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a feature (e.g., a number, function, operation, or component such as a part), and do not exclude the presence of additional features.

[0027] Phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, C", "at least one of A, B, or C" as used in the text may include one or all possible combinations of the items listed in each phrase.

[0028] As used herein, the expressions “first,” “second,” “first,” or “second,” etc., may describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0029] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that the component may be directly coupled to the other component, or may be connected through another component (e.g., a third component).

[0030] Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as "comprise" or "consist of" are intended to indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0031] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, multiple "modules" or multiple "parts" may be integrated into at least one module and implemented as at least one processor (not shown), excluding any "modules" or "parts" that need to be implemented as specific hardware.

[0032] When terms like "one implementation," "an implementation," or "an example implementation" are used in this disclosure, it means that a specific function, structure, or characteristic is described in connection with that implementation. Therefore, throughout this disclosure, terms like "in one implementation," "in an implementation," or "in an example implementation" may, but do not necessarily, refer to the same implementation. The implementations described herein are example implementations, and thus, this disclosure is not limited thereto and may be implemented in various other forms.

[0033] The specific order or hierarchy of blocks in the process / flowchart should be understood as an illustration to illustrate an exemplary approach. The order or hierarchy of blocks may be rearranged according to design preference. Additionally, some blocks may be combined or omitted. The attached claims present block elements in a sample order, but are not limited to a specific order or hierarchy.

[0034] The implementations described in this disclosure may be illustrated and depicted as blocks depicted in the drawings, each performing a specific function or functions. These blocks may be referred to herein as "units" or "modules," or may be referred to by names such as devices, logic circuits, controllers, counters, comparators, generators, converters, and the like. These blocks may be physically implemented as analog and / or digital circuits, such as logic gates, integrated circuits, microprocessors, microcontrollers, memory circuits, passive electronic components, active electronic components, optical components, and the like.

[0035] In this disclosure, the articles "a" and "an" are intended to include one or more items and can be used interchangeably with "one or more." When referring to only one item, expressions such as "one" are used. For example, the term "a processor" can refer to a single processor or multiple processors. When a processor is described as performing a specific task and then performing additional tasks, the multiple tasks can be performed by a single processor, one of multiple processors, or a combination of multiple processors.

[0036] In this specification, the term user may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0037] Hereinafter, embodiments of the present disclosure will be described in more detail with reference to the attached drawings.

[0038] FIG. 1 is a drawing for explaining a hands-free function according to an embodiment of the present disclosure.

[0039] Referring to FIG. 1, an electronic device (100) according to an embodiment of the present disclosure communicates with a user terminal device (200) and can display a notification (or alert) received by the user terminal device (200).

[0040] For example, when a user terminal device (200) connected to the electronic device (100) wired / wirelessly and directly / indirectly receives a notification, the electronic device (100) can display the notification received by the user terminal device (200) so that the user recognizes it.

[0041] For example, when a user terminal device (200) receives a notification including a call, a message, etc., the electronic device (100) can execute a hands-free function that displays the notification received by the user terminal device (200) so that the user can respond to the notification (e.g., answer / reject a call, read a message, reply to a message, etc.) without touching (or physically contacting) the user terminal device (200).

[0042] The related display device could only display notifications received by one of the user terminal devices currently connected to the display device among multiple user terminal devices located around the display device, and could not display notifications received by the remaining user terminal devices.

[0043] The related display device only displays notifications received by one user terminal device that is logged in with the same account as the account currently logged in to the display device, and cannot display notifications received by the remaining user terminal devices that are logged in with accounts different from the account currently logged in to the display device.

[0044] According to an embodiment, the electronic device (100) may display a notification received by a user terminal device (200) that is not currently connected to the electronic device (100) or a user terminal device (200) that is logged in to an account different from the account currently logged in to the electronic device (100).

[0045] According to an embodiment, the electronic device (100) may be implemented as a TV, but is not limited thereto, and may be applied to any device having a display function, such as a video wall, a large format display (LFD), a digital signage, a digital information display (DID), a projector display, etc. In addition, the electronic device (100) may be implemented as various types of displays, such as a liquid crystal display (LCD), an organic light-emitting diode (OLED), a liquid crystal on silicon (LCoS), a digital light processing (DLP), a quantum dot (QD) display panel, a quantum dot light-emitting diodes (QLED), a micro light-emitting diodes (μLED), a mini LED, etc.

[0046] According to an embodiment, the user terminal device (200) may be implemented as various types of external devices such as a TV, a PC, a laptop PC, a mobile phone, a tablet PC, a PDA, an MP3 (Picture Expect Group (MPEG)-1 audio layer 3) player, a kiosk, an electronic picture frame, a table display device, etc. If the user terminal device (200) is implemented as a portable type device such as a mobile phone, a tablet PC, a PDA, an MP3 player, a laptop PC, etc., it may be named a mobile device, but in the present disclosure, it will be collectively referred to as the user terminal device (200).

[0047] FIG. 2 is a block diagram showing the configuration of an electronic device according to an embodiment of the present disclosure.

[0048] According to an embodiment of the present disclosure, an electronic device (100) includes a communication interface (110) and one or more processors (120).

[0049] It goes without saying that, depending on the embodiment, the communication interface (110) may be implemented as various interfaces depending on the implementation example of the electronic device (100). For example, the communication interface (110) may communicate with a plurality of robots (200), charging stations (300), etc. through a communication method such as Bluetooth, AP-based Wi-Fi (Wireless LAN network), Zigbee, wired / wireless LAN (Local Area Network), WAN (Wide Area Network), Ethernet, IEEE 1394, HDMI (High-Definition Multimedia Interface), USB (Universal Serial Bus), MHL (Mobile High-Definition Link), AES / EBU (Audio Engineering Society / European Broadcasting Union), optical, coaxial, etc. According to an example, the communication interface may communicate with other electronic devices, external servers, and / or remote control devices.

[0050] According to an embodiment, the communication interface (110) may include a first communication interface and a second communication interface.

[0051] For example, the first communication interface can communicate with a user terminal device (200), an external server, etc., through a wireless communication method such as Bluetooth, AP-based Wi-Fi (Wi-Fi, Wireless LAN network), etc., and the second communication interface can communicate with an external device (e.g., a source device) through a wired / wireless communication method such as HDMI (High-Definition Multimedia Interface), USB (Universal Serial Bus), DP (DisplayPort), Thunderbolt, etc.

[0052] In an embodiment, one or more processors (120) control the overall operation of the electronic device (100). Specifically, one or more processors (120) may be connected to each component of the electronic device (100) to control the overall operation of the electronic device (100).

[0053] One or more processors (120) may perform operations of the electronic device (100) according to various embodiments of the present disclosure by executing at least one instruction stored in a memory.

[0054] The one or more processors (120) may include one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an Accelerated Processing Unit (APU), a Many Integrated Core (MIC), a Digital Signal Processor (DSP), a Neural Processing Unit (NPU), a hardware accelerator, or a machine learning accelerator. The one or more processors (120) may control one or any combination of other components of the electronic device, and may perform operations related to communication or data processing. The one or more processors (120) may execute one or more programs or instructions stored in a memory. For example, the one or more processors (120) may perform a method according to an embodiment of the present disclosure by executing one or more instructions stored in a memory.

[0055] When a method according to an embodiment of the present disclosure includes multiple operations, the multiple operations may be performed by one processor or by multiple processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor (e.g., a general-purpose processor) and the third operation may be performed by the second processor (e.g., an artificial intelligence-dedicated processor).

[0056] One or more processors (120) may be implemented as a single core processor including one core, or may be implemented as one or more multicore processors including multiple cores (e.g., homogeneous multicores or heterogeneous multicores). When one or more processors (120) are implemented as a multicore processor, each of the multiple cores included in the multicore processor may include an internal processor memory, such as a cache memory or an on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. In addition, each of the multiple cores (or some of the multiple cores) included in the multicore processor may independently read and execute a program instruction for implementing a method according to an embodiment of the present disclosure, or all (or some) of the multiple cores may be linked to read and execute a program instruction for implementing a method according to an embodiment of the present disclosure.

[0057] When a method according to an embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one core among a plurality of cores included in a multi-core processor, or may be performed by a plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by a first core included in the multi-core processor, or the first operation and the second operation may be performed by a first core included in the multi-core processor, and the third operation may be performed by a second core included in the multi-core processor.

[0058] In embodiments of the present disclosure, one or more processors (120) may mean a system on a chip (SoC) in which other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, a GPU, an APU, a MIC, a DSP, an NPU, a hardware accelerator, or a machine learning accelerator, but embodiments of the present disclosure are not limited thereto.

[0059] According to an embodiment, one or more processors (120) may receive a first BLE packet through the communication interface (110) and transmit a second BLE packet. For example, one or more processors (120) may receive a first BLE advertising packet through the communication interface (110) and transmit a second BLE advertising packet. For convenience, the first BLE packet is limited to the first BLE advertising packet and the second BLE packet is limited to the second BLE advertising packet in the following description. However, the present disclosure is not limited thereto, and the first BLE packet and the second BLE packet may mean various other communication messages. According to an embodiment, one or more processors (120) may communicate with a user terminal device (200) (e.g., a first user terminal device) that outputs a first BLE advertising packet and display a notification (e.g., a first notification) received by the user terminal device (200).

[0060] According to an embodiment, the notification may include a system message output by the user terminal device (200) to provide information to the user of the user terminal device (200).

[0061] For example, the user terminal device (200) can output text message (Short Message Service) notifications, phone call notifications, application push notifications, etc. as notifications.

[0062] For example, when a sender writes a text message and sends it to a Short Message Service Center (SMSC), the SMSC can route the text message written by the sender to the network to which the recipient, i.e., the user terminal device (200), is connected. According to an embodiment, when the user terminal device (200) receives a text message from a cell tower (or base station), the user terminal device (200) can output a text message notification as a notification.

[0063] For example, if an application installed on the user terminal device (200) is registered with a push notification service (e.g., Firebase Cloud Messaging (FCM), Apple Push Notification service (APNs), etc.) according to the user's settings, the user terminal device (200) can receive a unique identifier (e.g., push token) for receiving push notifications.

[0064] Information (or events) can be generated as push notifications from the application's server (or a third-party service providing the application) and transmitted to the user terminal device (200) based on a unique identifier. According to an embodiment, when a push notification is received from the application's server, the user terminal device (200) can provide the push notification as a notification.

[0065] Depending on the embodiment, the notification may include various forms of notifications for the user terminal device (200) to provide information to the user, in addition to text message (Short Message Service) notifications, phone notifications, and application push notifications.

[0066] FIG. 3 is a diagram for explaining a user terminal device and a display device that transmits and receives BLE advertising packets according to an embodiment of the present disclosure.

[0067] Referring to FIG. 3, when a first BLE advertising packet is received through a communication interface (110), one or more processors (120) can identify a first user terminal device (200-1) that outputs (or broadcasts) a first BLE advertising packet based on identification information included in the first BLE advertising packet.

[0068] According to an embodiment, the first BLE advertising packet may include identification information of the first user terminal device (200-1). For example, the identification information of the first user terminal device (200-1) may include the name of the first user terminal device (200-1), manufacturer information, a Universally Unique Identifier (UUID), etc. The first BLE advertising packet may include identification information according to an AD (Advertising Data) structure.

[0069] According to an embodiment, the first user terminal device (200-1) may output a first BLE advertising packet at a preset interval (e.g., millisecond [ms] interval).

[0070] According to an embodiment, one or more processors (120) may control the communication interface (110) to output (or broadcast) a second BLE advertising packet when a first BLE advertising packet is received.

[0071] According to an embodiment, one or more processors (120) may connect to the first user terminal device (200-1) when a connection request is received from the first user terminal device (200-1) in response to transmission of the second BLE advertising packet.

[0072] According to an embodiment, one or more processors (120) may execute a hands-free function that displays a first notification received by a first user terminal device (200-1). According to an embodiment, the hands-free function may include various functions corresponding to hands-free.

[0073] According to an embodiment, a first user terminal device (200-1) outputs a first notification, and one or more processors (120) can execute a function corresponding to hands-free to output the first notification from the electronic device (100).

[0074] Referring to FIG. 3, one or more processors (120) may be connected to a second user terminal device (200-2) and may display a second notification received by the second user terminal device (200-2).

[0075] For example, a second user terminal device (200-2) may output a second notification, and one or more processors (120) may execute a function corresponding to hands-free to output the second notification from the electronic device (100).

[0076] One or more processors (120) receive a first BLE advertising packet output (or broadcast) by a first user terminal device (200-1) while connected to a second user terminal device (200-2), and can display a first notification received by the first user terminal device (200-1) while connected to the first user terminal device (200-1).

[0077] FIG. 4 is a sequence diagram illustrating a display device that displays a notification received by a user terminal device according to an embodiment of the present disclosure.

[0078] Referring to FIG. 4, when the first user terminal device (200-1) receives the first notification (e.g., a phone call) (S410), the first user terminal device (200-1) can broadcast the first BLE advertising packet (S420).

[0079] According to an embodiment, one or more processors (120) may broadcast a second BLE advertising packet when a first BLE advertising packet is received through a communication interface (110) (S430).

[0080] For example, one or more processors (120) may identify the first user terminal device (200-1) based on the identification information of the first user terminal device (200-1) included in the first BLE advertising packet, and if the first user terminal device (200-1) is a pre-registered device, may broadcast the second BLE advertising packet (S430).

[0081] As another example, one or more processors (120) may not broadcast the second BLE advertising packet if the first user terminal device (200-1) is an unregistered device.

[0082] According to an embodiment, the second BLE advertising packet may include identification information of the electronic device (100). For example, the identification information of the electronic device (100) may include the name of the electronic device (100), manufacturer information, a Universally Unique Identifier (UUID), etc. The second BLE advertising packet may include identification information according to an AD (Advertising Data) structure.

[0083] According to an embodiment, when a second BLE advertising packet is received, the first user terminal device (200-1) may transmit (e.g., unicast) a connection request signal to the electronic device (100) based on the identification information of the electronic device (100) included in the second BLE advertising packet (S440).

[0084] According to an embodiment, when a connection request signal is received, one or more processors (120) perform a connection with a first user terminal device (200-1) and can receive data corresponding to a first notification (or information about the first notification) from the first user terminal device (200-1) (S450).

[0085] According to an embodiment, when data corresponding to the first notification (or information about the first notification) is received (S450), one or more processors (120) may execute a hands-free function for displaying the first notification (S460).

[0086] When a user input for a first notification is received (S470), one or more processors (120) can transmit a response to the first notification (e.g., answering / rejecting a call, reading a message, replying to a message, etc.) according to the user input to the first user terminal device (200-1) (S480).

[0087] According to an embodiment, one or more processors (120) may output the voice of the caller received through the first user terminal device (200-1) in step S480, and may receive the voice of the user (i.e., the recipient) and transmit it to the first user terminal device (200-1).

[0088] In step S430 of FIG. 4, one or more processors (120) broadcast a second BLE advertising packet if the first user terminal device (200-1) is a pre-registered device, and do not broadcast a second BLE advertising packet if the first user terminal device (200-1) is an unregistered device. Therefore, the first user terminal device (200-1) must be pre-registered with the electronic device (100) before receiving the first notification to execute a hands-free function that displays the first notification.

[0089] FIG. 5 is a sequence diagram illustrating a method for registering a user terminal device in a display device according to an embodiment of the present disclosure.

[0090] Steps S510 to S590 illustrated in FIG. 5 include an initial setup step between the electronic device (100) and the first user terminal device (200-1) prior to step S410.

[0091] According to an embodiment, if the account logged into the electronic device (100) (or the account activated in the electronic device (100)) and the account logged into the first user terminal device (200-1) (or the account activated in the first user terminal device (200-1)) are the same, since the electronic device (100) and the first user terminal device (200-1) are already registered in the account, at step S430 of FIG. 4, one or more processors (120) can identify the first user terminal device (200-1) as a previously registered device. That is, the account of the electronic device 100 can match the account of the first user terminal device 200-1.

[0092] According to an embodiment, if the account logged into the electronic device (100) and the account logged into the first user terminal device (200-1) are the same, the first user terminal device (200-1) may receive a user input for switching the hands-free function between the first user terminal device (200-1) and the electronic device (100) to an activated state (S510), and transmit information about the user input to an external server (300) (e.g., an account management server, etc.). For example, in step S510, the first user terminal device (200-1) may receive a command for activating a function corresponding to the hands-free function between the first user terminal device (200-1) and the electronic device (100).

[0093] For example, the first user terminal device (200-1) can receive a user input to activate a hands-free function (or call switching function) with an electronic device (100) previously registered within an account through an application.

[0094] According to an embodiment, the external server (300) may transmit a control command to activate the hands-free function between the first user terminal device (200-1) and the electronic device (100) based on information about the electronic device (100) previously registered in the account logged into the first user terminal device (200-1) (S530). For example, in step S530, the external server (300) may transmit a command to the electronic device (100) to execute a function corresponding to the hands-free function between the first user terminal device (200-1) and the electronic device (100).

[0095] According to an embodiment, one or more processors (120) may activate a hands-free function between the first user terminal device (200-1) and the electronic device (100) according to a control command received from an external server (300) at step S530. For example, one or more processors (120) may execute a function corresponding to hands-free between the first user terminal device (200-1) and the electronic device (100) according to a command received from an external server (300) at step S530.

[0096]

[0097] According to an embodiment, if an account logged into the electronic device (100) is different from an account logged into the first user terminal device (200-1), the first user terminal device (200-1) can receive information about the electronic device (100) from a second user terminal device (200-2) logged into which the same account as the account logged into the electronic device (100) is logged.

[0098] According to an embodiment, the first user terminal device (200-1) may receive a user input for registering the first user terminal device (200-1) to the electronic device (100) based on information about the electronic device (100) received from the second user terminal device (200-2) (S510).

[0099] For example, the first user terminal device (200-1) may receive a user input (e.g., a user input that turns on a call switching function) to activate a hands-free function between the first user terminal device (200-1) and the electronic device (100) based on information about the electronic device (100) received from the second user terminal device (200-2).

[0100] According to an embodiment, when a user input for registering the first user terminal device (200-1) to the electronic device (100) is received (S510), the first user terminal device (200-1) can transmit information about the user input to an external server (300) (S520).

[0101] According to an embodiment, the external server (300) may transmit a control command to the electronic device (100) for registering the first user terminal device (200-1) to the electronic device (100) that is already registered to the account logged into the second user terminal device (200-2) based on information about the user input (S530). For example, the information about the user input may include information about the electronic device (100) received from the second user terminal device (200-2) and information about a user input for activating a hands-free function between the first user terminal device (200-1) and the electronic device (100).

[0102] According to an embodiment, one or more processors (120) may activate a hands-free function between the first user terminal device (200-1) and the electronic device (100) according to a control command received from an external server (300) at step S530.

[0103]

[0104] According to an embodiment, the first user terminal device (200-1) may transmit a registration request (or pairing request) to the electronic device (100) (S540). For example, the first user terminal device (200-1) may transmit a registration request signal (or pairing request signal) to the electronic device (100).

[0105] One or more processors (120) can transmit a pairing request signal to the first user terminal device (200-1) based on a registration request signal received from the first user terminal device (200-1) (S550).

[0106] According to an embodiment, one or more processors (120) display a pairing confirmation pop-up (S560), and the first user terminal device (200-1) may also display a pairing confirmation pop-up (S570). The 'pairing confirmation pop-up' used herein may include a graphical and / or auditory notification that can be seen and / or heard by the user, indicating that a pairing request has been received and requesting confirmation of the pairing request. For example, the pairing confirmation pop-up may include a graphical window composed of text and / or images, and may be displayed over another active graphical window of the display. In an implementation, the pairing confirmation pop-up may include graphical input elements (e.g., buttons, checkboxes, text boxes, etc.) that the user may use to indicate confirmation (acceptance) and / or rejection of the pairing request.

[0107] When one or more processors (120) receive a confirmation input for each of the pairing confirmation pop-up displayed by the electronic device (100) and the pairing confirmation pop-up displayed by the first user terminal device (200-1) (S580), the first user terminal device (200-1) can be registered.

[0108] It is not limited to the above-described examples, and it is of course possible for one or more processors (100) to register the first user terminal device (200-1) when the first user terminal device (200-1) is paired with the electronic device (100) in various ways.

[0109] FIG. 6 is a drawing for explaining a display device that receives an mDNS query from a user terminal device and transmits an mDNS response to the user terminal device according to an embodiment of the present disclosure.

[0110] Referring to FIG. 6, each of the electronic device (100) and the second user terminal device (200-2) can be connected to an access point (AP) (400).

[0111] For example, an electronic device (100), a first user terminal device (200-1) of user A, and a second user terminal device (200-2) of user B may each be connected to an access point provided in a home. However, the present disclosure is not limited in this respect. For example, the first user terminal device 200-1 and the second user terminal device 200-2 may be connected to the same network in different locations (e.g., a cafe, a restaurant, an office and / or business place, a park, etc.).

[0112] According to an embodiment, if the account logged into the electronic device (100) is the account of user A, one or more processors (120) may display the first notification received by the first user terminal device (200-1).

[0113] Additionally, if the electronic device (100) and the first user terminal device (200-1) are currently connected, one or more processors (120) can display the first notification received by the first user terminal device (200-1).

[0114] According to an embodiment of the present disclosure, when a second user terminal device (200-2) logged in with an account (e.g., an account of user B) different from an account logged in to the electronic device (100) (e.g., an account of user A) receives a second notification, one or more processors (120) may be connected to the second user terminal device (200-2) to display the second notification.

[0115] Additionally, according to an embodiment of the present disclosure, when a second user terminal device (200-2) that is not currently connected to the electronic device (100) receives a second notification, one or more processors (120) may be connected to the second user terminal device (200-2) and display the second notification.

[0116] According to an embodiment, when an mDNS (Multicast DNS) query is received from a second user terminal device (200-2), one or more processors (120) may control a communication interface (110) to transmit an mDNS response to the second user terminal device (200-2).

[0117] According to an embodiment, after transmitting an mDNS response, when data corresponding to a second notification (or information about the second notification) is received from an external server (300) in response to transmitting the mDNS response, the one or more processors (120) may execute a hands-free function of displaying a second notification based on the data corresponding to the second notification (or information about the second notification).

[0118] FIG. 7 is a sequence diagram illustrating a display device displaying a notification received by a user terminal device logged in with an account different from an account logged in to the display device according to an embodiment of the present disclosure.

[0119] Referring to FIG. 7, when the second user terminal device (200-2) receives the second notification (S710), it can multicast an mDNS query to search for an electronic device (100) among the devices connected to the access point (400) (S720).

[0120] According to an embodiment, when an mDNS query is received, one or more processors (120) may multicast an mDNS response (S730). According to an embodiment, one or more processors (120) may multicast an mDNS response including identification information of a second user terminal device (200-2).

[0121] According to an embodiment, the second user terminal device (200-2) receives an mDNS response, and if the mDNS response includes identification information of the second user terminal device (200-2), data corresponding to the second notification (or information about the second notification) can be transmitted to an external server (300) (S740).

[0122] According to an embodiment, when data corresponding to a second notification (or information about the second notification) is received from an external server (300) (S750), one or more processors (120) may execute a hands-free function for displaying the second notification (S760).

[0123] When a user input for a second notification is received (S770), one or more processors (120) can transmit a response to the second notification (e.g., answering / rejecting a call, reading a message, replying to a message, etc.) according to the user input to the second user terminal device (200-2) (S780).

[0124] According to an embodiment, one or more processors (120) may output the voice of the caller received through the second user terminal device (200-2) in step S780, and may receive the voice of the user (i.e., the recipient) and transmit it to the second user terminal device (200-2).

[0125] Referring to FIG. 7, the account logged into the electronic device (100) may be an account of user A, and the account logged into the second user terminal device (200-2) may be an account of user B.

[0126] According to an embodiment of the present disclosure, one or more processors (120) may be connected to the second user terminal device (200-2) to display the second notification even if the second user terminal device (200-2) receives the second notification from an account (e.g., an account of user B) different from the account logged in to the electronic device (100) (e.g., an account of user A).

[0127] A method of multicasting an mDNS response including identification information of a second user terminal device (200-2) in response to receiving an mDNS query by one or more processors (120) according to an embodiment will be described in detail with reference to FIGS. 8 and 9.

[0128] FIG. 8 is a sequence diagram illustrating a method for activating a hands-free function of a display device through a user terminal device logged in with the same account as the account logged in to the display device according to an embodiment of the present disclosure.

[0129] Steps S810 to S830 illustrated in FIG. 8 include an initial setup step between the electronic device (100) and the second user terminal device (200-2) prior to step S710.

[0130] Referring to FIG. 8, if the account logged into the electronic device (100) (or the account activated in the electronic device (100)) and the account logged into the second user terminal device (200-2) (or the account activated in the second user terminal device (200-2)) are the same (e.g., the account of user B), the electronic device (100) and the second user terminal device (200-2) are pre-registered within the account, and the second user terminal device (200-2) can receive a user input for switching the hands-free function between the second user terminal device (200-2) and the electronic device (100) to an activated state (S810).

[0131] According to an embodiment, when a user input for switching the hands-free function between the second user terminal device (200-2) and the electronic device (100) to an activated state is received (S810), the second user terminal device (200-2) can transmit information about the user input to an external server (300) (S820).

[0132] According to an embodiment, an external server (300) may transmit a control command to the electronic device (100) to activate the hands-free function between the second user terminal device (200-2) and the electronic device (100) based on information about the user input (S830). According to an embodiment, the control command may include identification information about the second user terminal device (200-2).

[0133] As described in FIG. 7, one or more processors (130) can multicast information about a second user terminal device (200-2) included in a control command received in step S830 by including it in an mDNS response (S730).

[0134] FIG. 9 is a sequence diagram illustrating a method for activating a hands-free function of a display device through a user terminal device logged in with an account different from an account logged in to the display device according to an embodiment of the present disclosure.

[0135] Steps S910 to S940 illustrated in FIG. 9 include an initial setup step between the electronic device (100) and the second user terminal device (200-2) prior to step S710.

[0136] Referring to FIG. 9, the account logged into the electronic device (100) (or the account activated in the electronic device (100)) and the account logged into the second user terminal device (200-2) (or the account activated in the second user terminal device (200-2)) may be different (for example, the account logged into the electronic device (100) may be an account of user A, and the account logged into the second user terminal device (200-2) may be an account of user B).

[0137] According to an embodiment, a first user terminal device (200-1) can transmit information about an electronic device (100) to a second user terminal device (200-2) (S910).

[0138] For example, if the account logged into the first user terminal device (200-1) and the account logged into the electronic device (100) are the same (for example, the account logged into the first user terminal device (200-1) is the account of user A), and if a request for information about the electronic device (100) is received from the second user terminal device (200-2), the first user terminal device (200-1) can transmit information about the electronic device (100) to the second user terminal device (200-2) in response to the request.

[0139] According to an embodiment, the second user terminal device (200-2) may display a UI (User Interface) for registering the second user terminal device (200-2) to the electronic device (100) based on information about the electronic device (100), or a UI for switching the hands-free function between the second user terminal device (200-2) and the electronic device (100) to an activated state.

[0140] According to an embodiment, the second user terminal device (200-2) may receive a user input for the UI (e.g., a user input for activating a hands-free function between the second user terminal device (200-2) and the electronic device (100) (S920).

[0141] According to an embodiment, when a user input for switching the hands-free function between the second user terminal device (200-2) and the electronic device (100) to an activated state is received (S920), the second user terminal device (200-2) may transmit information about the user input to an external server (300) (S930). According to an embodiment, when a user input for registering the second user terminal device (200-2) to the electronic device (100) is received (S920), the second user terminal device (200-2) may transmit information about the user input to an external server (300) (S930).

[0142] According to an embodiment, an external server (300) may transmit a control command to the electronic device (100) to activate the hands-free function between the second user terminal device (200-2) and the electronic device (100) based on information about the user input (S940). According to an embodiment, the control command may include identification information about the second user terminal device (200-2).

[0143] As described in FIG. 7, one or more processors (130) can multicast information about a second user terminal device (200-2) included in a control command received in step S940 by including it in an mDNS response (S730).

[0144] Returning to FIG. 2, according to an embodiment of the present disclosure, the electronic device (100) may further include memory.

[0145] According to an embodiment, the memory may store data required for various embodiments of the present disclosure. Depending on the data storage purpose, the memory may be implemented as a memory embedded in the electronic device (100) or as a memory that can be attached or detached to the electronic device (100).

[0146] For example, data for driving an electronic device (100) may be stored in a memory embedded in the electronic device (100), and data for an extended function of the electronic device (100) may be stored in a memory that can be attached or detached to the electronic device (100).

[0147] In the case of memory embedded in an electronic device (100), it may be implemented in the form of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD)).

[0148] In the case of a memory that can be attached or detached to an electronic device (100), it can be implemented in the form of a memory card (e.g., CF (compact flash), SD (secure digital), Micro-SD (micro secure digital), Mini-SD (mini secure digital), xD (extreme digital), MMC (multi-media card), etc.), an external memory that can be connected to a USB port (e.g., USB memory), etc. However, the present disclosure is not limited in this respect.

[0149] According to an embodiment, the memory may store a computer program including at least one instruction or instructions for controlling the electronic device (100).

[0150] According to an embodiment of the present disclosure, the electronic device (100) may further include a microphone.

[0151] According to an embodiment, one or more processors (120) may receive a voice signal through a microphone and identify a user input corresponding to the voice signal. According to an embodiment, the electronic device (100) may also receive the voice signal through a remote control or a microphone provided in a user terminal device (200).

[0152] For example, one or more processors (120) may broadcast a BLE advertising packet when a user input is identified based on a voice signal received through a microphone that activates a hands-free function (or call switching function) with a first user terminal device (200-1).

[0153] According to an embodiment, when one or more processors (120) receive a connection request signal (e.g., a pairing request signal) from the first user terminal device (200-1) in response to a broadcast of a BLE advertising packet, the one or more processors (120) may pair with the first user terminal device (200-1) and register the first user terminal device (200-1) (e.g., register the first user terminal device (200-1) to an account logged into the display device (100).

[0154] According to an embodiment, one or more processors (120) are connected to a second user terminal device (200-2), and even if they are not connected to a first user terminal device (200-1), when the first user terminal device (200-1) receives a first notification (S410 of FIG. 4), the first notification can be displayed (S460) and a response to the first notification can be transmitted to the first user terminal device (200-1) through steps S420 to S450 shown in FIG. 4 (S480).

[0155] According to an embodiment, the electronic device (100) may be implemented as an electronic device such as, in addition to a TV, a set-top box, a cloud server, an over-the-top media service (OTT) server, a streaming service (e.g., Samsung Gaming Hub), a home automation control panel, a security control panel, a media box (e.g., Samsung HomeSync™, Apple TV™, or Google TV™), a game console (e.g., Xbox™, PlayStation™, Switch™), an electronic dictionary, an electronic key, a camcorder, or an electronic picture frame. However, the present invention is not limited thereto, and the electronic device (100) may include at least one of a TV, a user terminal device, a tablet PC, a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop PC, a netbook computer, a workstation, a server, a PDA, a portable multimedia player (PMP), an MP3 player, a medical device, a camera, a virtual reality (VR) implementation device, a spatial computing device, or a wearable device. Here, it is to be understood that the wearable device may be implemented as at least one of an accessory type (e.g., a watch, a ring, a bracelet, an anklet, a necklace, glasses, contact lenses, or a head-mounted device (HMD)), a fabric or clothing-integrated type (e.g., an electronic garment), a body-attached type (e.g., a skin pad or tattoo), or a bio-implantable circuit.

[0156] According to an embodiment, the electronic device (100) is implemented as a mobile robot, and the mobile robot may include a display (e.g., a projector display). A detailed description thereof will be provided with reference to FIG. 11.

[0157] In some embodiments, the mobile robot may identify the location of each of multiple users within a home through sensors (e.g., cameras, etc.).

[0158] According to an embodiment, when a first user terminal device (200-1) corresponding to user A among multiple users receives a first notification, the mobile robot may move to the location of user A within the home (e.g., move or be propelled and / or relocated through self-movement) and display the first notification.

[0159] For example, when a first user terminal device (200-1) in which a user A's account is logged in receives a first notification (S410 of FIG. 4), one or more processors (120) can move a mobile robot to the user A's location within the home and then display the first notification through steps S420 to S450 shown in FIG. 4 (S460).

[0160] For example, when a second user terminal device (200-2) to which the account of user B is logged in receives a second notification (S710 of FIG. 7), one or more processors (120) can move a mobile robot to the location of user B within the home and then display the second notification through steps S720 to S750 shown in FIG. 7 (S760).

[0161] FIG. 10 is a sequence diagram illustrating a method for activating a hands-free function of a display device according to an embodiment of the present disclosure.

[0162] According to an embodiment, one or more processors (120) may activate (or execute) a hands-free function according to a command (e.g., user input) that activates a function corresponding to the hands-free function of the display device (100) (S1001).

[0163] According to an embodiment, one or more processors (120) output (or broadcast) a first BLE advertising packet (S1002), and a first user terminal device (200-1) that has received the first BLE advertising packet output by the electronic device (100) can output a second BLE advertising packet.

[0164] According to an embodiment, when one or more processors (120) receive a second BLE advertising packet output by a first user terminal device (200-1), they may transmit a pairing request signal to the first user terminal device (200-1) (S1004).

[0165] According to an embodiment, each of the electronic device (100) and the first user terminal device (200-1) may output a pairing confirmation pop-up (S1005, S1006).

[0166] According to an embodiment, when a confirmation is input for a pairing confirmation pop-up output by an electronic device (100) (S1007) and a confirmation is input for a pairing confirmation pop-up output by a first user terminal device (200-2) (S1008), one or more processors (120) can complete pairing between the electronic device (100) and the first user terminal device (200-2).

[0167] For example, one or more processors (120) may register a first user terminal device (200-1) to execute a function corresponding to hands-free communication between the electronic device (100) and the first user terminal device (200-1).

[0168] According to an embodiment, when the first user terminal device (200-1) receives information about the first notification (or data corresponding to the first notification) from the server (300) (S1009), the first user terminal device (200-1) can transmit a command to the electronic device (100) to activate a function corresponding to the hands-free of the electronic device (100) (S1010).

[0169] According to an embodiment, when a command to activate a function corresponding to hands-free is received, one or more processors (120) can execute a function corresponding to hands-free (S1011).

[0170] Meanwhile, one or more processors (120) may ignore a command to activate a function corresponding to hands-free if a function corresponding to hands-free is already being executed.

[0171] According to an embodiment, when information about a first notification (or data corresponding to the first notification) is received from a first user terminal device (200-1) (S1012), one or more processors (120) may output a first notification (S1013).

[0172] According to an embodiment, when a user input for a first notification (e.g., a user input for responding to the first notification (e.g., receiving, replying, confirming, etc.)) is received (S1014), one or more processors (120) may transmit a response to the first notification to the server (300) (S1015).

[0173] According to an embodiment, one or more processors (120) may transmit a user input for a first notification to a first user terminal device (200-1), thereby appropriately responding to the first notification. For example, the first notification to be output to the first user terminal device (200-1) may be responded to even if the user does not directly touch (or manipulate) the first user terminal device (200-1).

[0174] For example, if the first notification is a text message (Short Message Service) notification, one or more processors (120) of the electronic device (100) may control the first user terminal device (200-1) to display the text message or transmit a response (or reply) corresponding to the text message to the sender based on a user input.

[0175] For example, if the first notification is a phone call notification, one or more processors (120) of the electronic device (100) may control the first user terminal device (200-1) to transmit a user input (e.g., the user's voice) received through a microphone provided in the electronic device (100) to the caller in response to the phone call notification based on a user input, and may also output the caller's voice through a speaker provided in the electronic device (100). However, the present invention is not limited thereto, and one or more processors (120) may also control the first user terminal device (200-1) to reject the phone call notification based on a user input.

[0176] For example, if the first notification is an application push notification, one or more processors (120) may control the first user terminal device (200-1) to operate the application based on user input for the application push notification.

[0177] FIG. 11 is a drawing for explaining a display device according to an embodiment of the present disclosure.

[0178] Referring to FIG. 11, according to an embodiment, an electronic device (100) may be implemented as a mobile robot including a display (e.g., a projector display). For example, the mobile robot may include a driving unit including a motor, a wheel, a brake, etc., and may move independently within a space (e.g., within a home) using the driving unit. According to an embodiment, the mobile robot may perform a simultaneous localization and mapping (SLAM) operation to obtain map information corresponding to the space, and may identify the location of the mobile robot and the location of a user (e.g., user A) within the space.

[0179] According to an embodiment, the mobile robot includes a projector display and can output a first notification to be output to a first user terminal device (200-1) or a second notification to be output to a second user terminal device (200-2) on a projection surface by executing a function corresponding to hands-free.

[0180] Depending on the embodiment, the projection surface may be part of the physical space where the image (e.g., various types of images including first and second notifications, etc.) is output, or may be a separate screen. For example, the projection surface may include a wall surface, a floor surface, etc. adjacent to the user.

[0181] According to an embodiment, a mobile robot is equipped with a PTZ (Pan, Tilt, Zoom) motor, and can output an image to a projection surface by appropriately controlling the PTZ motor. Here, the PTZ motor may include a motor that can rotate in a pan (horizontal direction, left and right direction) direction and a motor that can rotate in a tilt (vertical direction, up and down) direction.

[0182] According to an embodiment, the mobile robot can output an image by performing lens shift, color matching, edge blending, keystone correction, leveling correction (horizontal correction), focus correction, etc.

[0183] For example, one or more processors (120) of the mobile robot may perform keystone correction so that the image (e.g., the first node, the second node, etc.) has a trapezoidal shape, so that the image becomes a rectangle or a square shape. For example, one or more processors (120) of the mobile robot may perform leveling correction so that the angle of the image rotates so that the image becomes horizontal. For example, one or more processors (120) of the mobile robot may perform focus correction so that the image is in focus, for example, based on the distance between the mobile robot and the projection surface.

[0184] FIG. 12 is a flowchart for explaining a method for controlling a display device according to an embodiment of the present disclosure.

[0185] According to an embodiment of the present disclosure, a method for controlling an electronic device identifies a first user terminal device based on identification information included in the first BLE advertising packet when a first BLE advertising packet is received (S1210).

[0186] The control method transmits a second BLE advertising packet if the first user terminal device is a pre-registered device (S1220).

[0187] The control method executes a hands-free function that connects to the first user terminal device and displays a first notification received by the first user terminal device when a connection request signal is received from the first user terminal device in response to transmission of the second BLE advertising packet (S1230).

[0188] A control method according to an embodiment of the present disclosure may further include a step of switching a hands-free function with a second user terminal device to an activated state when a control command for switching a hands-free function with a second user terminal device, which displays a second notification to be output to the second user terminal device (or a second notification received by the second user terminal device), is received from an external server, and a step of registering the second user terminal device by pairing with the second user terminal device when a registration request signal is received from the second user terminal device.

[0189] A control method according to an embodiment of the present disclosure may further include a step of displaying a third notification received by a third user terminal device when a third user terminal device connected to an electronic device receives a third notification, and the step S1230 of executing a hands-free function may include a step of executing a hands-free function of displaying a first notification received by the first user terminal device when a connection request signal is received from the first user terminal device.

[0190] A first user terminal device according to an embodiment of the present disclosure may transmit a first BLE advertising packet upon receiving a first notification.

[0191] A control method according to an embodiment of the present disclosure further includes a step of transmitting an mDNS (Multicast DNS) response to a second user terminal device when an mDNS query is received from the second user terminal device, and a step of executing a hands-free function of displaying (or outputting) a second notification based on data corresponding to the second notification (or information about the second notification) received by the second user terminal device from an external server in response to transmission of the mDNS response, wherein the second user terminal device can transmit data corresponding to the second notification (or information about the second notification) to the external server so that the data is transmitted to the electronic device when the mDNS response includes identification information of the second user terminal device.

[0192] A second user terminal device according to an embodiment of the present disclosure may transmit an mDNS query to an electronic device upon receiving a second notification.

[0193] A control method according to an embodiment of the present disclosure further includes a step of switching a hands-free function with a second user terminal device to an activated state when a control command for activating a hands-free function with a second user terminal device is received from an external server, wherein the control command may include identification information of the second user terminal device.

[0194] The step of switching the hands-free function to an activated state with a second user terminal device according to an embodiment of the present disclosure may include a feature in which, if the account logged into the electronic device and the account logged into the second user terminal device are the same, the electronic device previously registered to the account logged into the second user terminal device receives a control command corresponding to a user input for switching the hands-free function to an activated state.

[0195] The step of switching the hands-free function to an activated state with respect to a second user terminal device according to an embodiment of the present disclosure includes a feature in which, if an account logged into the electronic device is different from an account logged into the second user terminal device, the electronic device receives a control command corresponding to a user input for switching the hands-free function to an activated state based on information about an electronic device previously registered to an account logged into the first user terminal device, and the information about the electronic device is transmitted from the first user terminal device to the second user terminal device, and the account logged into the electronic device and the account logged into the first user terminal device may be the same.

[0196] Step S1230 of executing a hands-free function according to an embodiment of the present disclosure may include a step of displaying a first notification according to the hands-free function and a step of controlling a first user terminal device to transmit a response to the first notification according to a user input for the first notification.

[0197] However, it goes without saying that the various embodiments of the present disclosure can be applied not only to electronic devices, but also to various types of electronic devices that include a display function.

[0198] Meanwhile, the various embodiments described above may be implemented in a computer-readable recording medium or similar device using software, hardware, or a combination thereof. In some cases, the embodiments described herein may be implemented by the processor itself. In a software implementation, embodiments, such as the procedures and functions described herein, may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein.

[0199] Meanwhile, computer instructions for performing processing operations of an electronic device according to various embodiments of the present disclosure described above may be stored in a non-transitory computer-readable medium. When the computer instructions stored in such a non-transitory computer-readable medium are executed by a processor of a specific device, the computer instructions cause the specific device to perform processing operations in the electronic device according to various embodiments described above.

[0200] A non-transitory computer-readable medium refers to a medium that permanently stores data and can be read by a device, rather than a medium that stores data for a short period of time, such as a register, cache, or memory. Specific examples of non-transitory computer-readable media include CDs, DVDs, hard disks, Blu-ray discs, USBs, memory cards, and ROMs.

[0201] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. In electronic devices, communication interface; one or more processors including processing circuitry; and memory for storing instructions; The above instructions, when individually or collectively executed by the one or more processors, cause the electronic device to: When a first BLE packet is received through the communication interface, the first external device is identified based on the identification information included in the first BLE packet, When the first external device is identified as a pre-registered device, a second BLE packet is transmitted through the communication interface, When a connection request is received from the first external device through the communication interface in accordance with the transmission of the second BLE packet, a first connection is performed between the electronic device and the first external device, An electronic device that executes a first hands-free function to control the electronic device to output a first notification to be output from the first external device based on a first connection between the electronic device and the first external device.

2. In paragraph 1, The above instructions, when individually or collectively executed by the one or more processors, cause the electronic device to: When a control command for activating a second hands-free function with a second external device of the electronic device is received from the server through the communication interface, a second connection between the electronic device and the second external device is performed, Executes a second hands-free function with the second external device so that the electronic device outputs a second notification to be output to the second external device based on the second connection between the electronic device and the second external device, An electronic device that, when a registration request is received from the second external device through the communication interface, pairs with the second external device and registers the second external device.

3. In paragraph 1, The above instructions, when individually or collectively executed by the one or more processors, cause the electronic device to: An electronic device that executes a third hands-free function that controls the electronic device to output the third notification to be output to the third external device when a third external device connected to the electronic device through the communication interface receives data corresponding to a third notification to be output to the third external device.

4. In paragraph 1, The above first external device is, An electronic device that transmits the first BLE packet when receiving data corresponding to the first notification.

5. In paragraph 1, The above instructions, when individually or collectively executed by the one or more processors, cause the electronic device to: When an mDNS (Multicast DNS) query is received from a second external device, an mDNS response including second identification information of the second external device is transmitted to the second external device through the communication interface, When data corresponding to the second notification received by the second external device is received from the server in response to transmission of the mDNS response, a second hands-free function is executed to control the electronic device to output the second notification based on the data corresponding to the second notification. The second external device is, An electronic device that transmits data corresponding to the second notification to the server so that data corresponding to the second notification is transmitted to the electronic device.

6. In paragraph 5, The second external device is, An electronic device that, upon receiving data corresponding to the second notification, transmits the mDNS query to the electronic device.

7. In paragraph 5, The above instructions, when individually or collectively executed by the one or more processors, cause the electronic device to: When a control command for activating a second hands-free function of the electronic device with the second external device is received from the server, the second hands-free function of the electronic device with the second external device is executed, An electronic device, wherein the control command includes identification information of the second external device.

8. In paragraph 7, The above instructions, when individually or collectively executed by the one or more processors, cause the electronic device to: An electronic device, wherein, if a first account logged into the electronic device and a second account logged into the second external device are the same, the electronic device receives a command corresponding to a user input for activating the second hands-free function of the electronic device with the second external device, which is registered to the second account.

9. In paragraph 7, The above instructions, when individually or collectively executed by the one or more processors, cause the electronic device to: If the third account logged into the electronic device is different from the second account logged into the second external device, the electronic device receives the command corresponding to the user input for activating the first hands-free function according to the information of the electronic device previously registered to the first account logged into the first external device. Information on the above electronic device, is transmitted from the first external device to the second external device, An electronic device, wherein the third account logged into the electronic device is the same as the first account.

10. In paragraph 1, The above instructions, when individually or collectively executed by the one or more processors, cause the electronic device to: An electronic device that transmits a response corresponding to the first notification to the first external device through the communication interface according to a user input for the first notification.

11. In a method for controlling an electronic device, When a first BLE packet is received, a step of identifying a first external device based on identification information included in the first BLE packet; A step of transmitting a second BLE packet when the first external device is identified as a pre-registered device; When a connection request is received from the first external device in response to transmission of the second BLE packet, performing a first connection between the electronic device and the first external device; and A control method comprising: a step of executing a first hands-free function for controlling the electronic device to output a first notification to be output from the first external device based on a first connection between the electronic device and the first external device; 12. In paragraph 11, The above control method is, When a control command for activating a second hands-free function with a second external device of the electronic device is received from a server, a step of performing a second connection between the electronic device and the second external device; A step of executing a second hands-free function with the second external device so that the electronic device outputs a second notification to be output to the second external device based on a second connection between the electronic device and the second external device; and A control method further comprising: a step of pairing with the second external device and registering the second external device when a registration request is received from the second external device.

13. In paragraph 11, The above control method is, A control method further comprising: a step of executing a third hands-free function for controlling the third external device to output the third notification to be outputted when a third external device connected to the electronic device receives data corresponding to the third notification to be outputted to the third external device; 14. In paragraph 11, The above first external device is, A control method for transmitting the first BLE packet when data corresponding to the first notification is received.

15. In a storage medium storing computer-readable instructions, the instructions, when executed by one or more processors of an electronic device, cause the electronic device to: When a first BLE packet is received through the communication interface, the first external device is identified based on the identification information included in the first BLE packet, If the first external device is identified as a pre-registered device, a second BLE packet is transmitted, When a connection request is received from the first external device in response to transmission of the second BLE packet, a first connection is performed between the electronic device and the first external device, A storage medium that causes a first hands-free function to be executed to control the electronic device to output a first notification to be output from the first external device based on a first connection between the electronic device and the first external device.

Images