Electronic device for providing internet of things-based service, and operating method therefor
The server-based method addresses the issue of excessive IoT device notifications by delivering messages only to active devices when users are present, improving user experience and reducing resource waste.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- SAMSUNG ELECTRONICS CO LTD
- Filing Date
- 2025-12-23
- Publication Date
- 2026-07-02
AI Technical Summary
The increasing number of IoT devices in smart home environments generates an overwhelming number of notification messages, leading to user stress and unnecessary costs due to repeated notifications, even when devices are powered off or locked.
A server-based method that determines user presence and device activity to selectively deliver notification messages only to active devices when users are present, avoiding redundant notifications.
Reduces user stress and minimizes unnecessary data transmission by intelligently managing notification delivery based on user presence and device activity, enhancing user experience and reducing resource consumption.
Smart Images

Figure KR2025022641_02072026_PF_FP_ABST
Abstract
Description
Electronic device providing Internet of Things-based services and method of operation thereof
[0001] One embodiment of the present disclosure relates to an electronic device that provides an Internet of Things (IoT) based service and a method of operating the same.
[0002] The Internet is evolving from a human-centered connection network where humans generate and consume information into an Internet of Things (IoT) network that exchanges and processes information among distributed components, such as objects. IoE (Internet of Everything) technology can be cited as an example where big data processing technology, through connections with cloud servers, is combined with IoT technology.
[0003] To implement IoT technology, technological elements such as sensing technology, wired and wireless communication and network infrastructure, service interface technology, and security technology are required; consequently, various technologies such as sensor networks, machine-to-machine (M2M) communication, and machine-type communication (MTC) are being researched recently for connecting objects.
[0004] In an IoT environment, intelligent Internet technology (IT) services can be provided that create new value for human life by collecting and analyzing data generated from connected objects. Through the convergence and integration of existing IT technologies with various industries, IoT technology can be applied to a wide range of services, such as smart home services, smart building services, smart city services, smart car services or connected car services, smart grid services, healthcare services, smart home appliance services, and advanced medical services.
[0005] Among the various services based on IoT technology, a representative service is smart home service (e.g., Samsung TM It can be a SmartThings service. In a smart home service, the electronic device managing the smart home service (e.g., a manager device (e.g., a smartphone)) is an IoT-based application (e.g., a smart home application (e.g., Samsung TM You can control and / or manage external electronic devices (e.g., IoT devices (e.g., smart home devices)) such as televisions (TVs), speakers, and / or refrigerators through the SmartThings application.
[0006] As such smart home services and related industries expand, not only is the number of interconnected devices (electronic devices and / or external electronic devices) increasing, but the types of interconnected devices are also growing. Since various multiple devices are interconnected and transmit necessary notification messages to users, handling notification messages generated from multiple devices in IoT-based services, such as smart home services, can be a critical factor in user experience.
[0007] In particular, as the number of IoT devices increases in IoT-based services, the number of notification messages generated based on user presets and needs can increase exponentially. Specifically, each IoT device may seek to provide various meaningful notification messages to the user to satisfy the user scenarios provided by that device. If a user connects IoT devices over a relatively long period, the user may eventually continuously receive standardized notification messages based on the configured method.
[0008] For example, in the case of a doorbell, if motion is detected by the doorbell, a notification message corresponding to the detected motion (e.g., a motion detection notification message) may be provided (e.g., displayed) on the TV. If multiple motions are detected by the doorbell, multiple notification messages corresponding to the multiple motions may be provided on the TV. Such multiple notification messages can not only interfere with the user's viewing of the TV but also provide a poor user experience, to the extent that it leads the user to have very negative thoughts about the notification service.
[0009] For example, when washing is finished at night, a notification message announcing the end of washing can be transmitted to the user's electronic device and external electronic devices (e.g., external electronic devices capable of providing notification messages (e.g., external electronic devices capable of displaying notification messages), and as the number of external electronic devices providing notification messages increases, the number of notification messages announcing the end of washing also increases, so the user may consider the duplicate notification messages announcing the end of washing itself as a very significant stress factor.
[0010] As such, with the widespread adoption of IoT-based services and the increasing number of devices (e.g., electronic devices or other external electronic devices) capable of providing (or displaying) information related to the status of external electronic devices (e.g., IoT devices), multiple notification messages of various forms may be provided, and an excessive number of notification messages can act as a stress factor for users. Furthermore, even for notification messages that are generated repeatedly based on a set data format, there may be a problem in that unnecessary costs must be incurred to continuously extract image data or transmit video data.
[0011] For example, regarding a doorbell, if a notification message occurs repeatedly even though the user is not currently watching TV (e.g., the TV is powered off) or is not looking at the smartphone screen (e.g., the smartphone is powered off or the smartphone is in a locked state) (e.g., even though it is impossible for the TV or smartphone to display image data or video data), it may be required to store image data or video data corresponding to the repeated notification messages. The locked state may include a state where the smartphone display is turned off or / or the display is locked.
[0012] In particular, since notification messages are transmitted even to IoT devices that are powered off or to smartphones that are powered off or locked, scheduled notification messages may be provided (or displayed) all at once when the IoT device is subsequently powered on or the smartphone is powered on or unlocked, even though the valid period for providing notifications to the user has already expired. These notification messages provided all at once may become unnecessary for the user.
[0013] According to one embodiment of the present disclosure, a method of a server (108; 230) providing a service related to the Internet of Things (IoT) may include receiving a first notification message from a first device among one or more devices (102; 220) located in space that are associated with a user account registered to the service provided by the server.
[0014] According to one embodiment of the present disclosure, the method may include an operation to determine the location of at least one user associated with the user account based on the reception of the first notification message.
[0015] According to one embodiment of the present disclosure, if all of the at least one users are not present in the space, the first notification message may be provided to at least one mobile device of all of the at least one users.
[0016] According to one embodiment of the present disclosure, the method may include, when the at least one user is present in the space, identifying a first candidate device and a second candidate device to output the first notification message among devices that are active in the space and connected to the server, based on the type of the first notification message.
[0017] According to one embodiment of the present disclosure, the method may include an operation that causes the first candidate device to output the first notification message when the at least one user is present in the space.
[0018] According to one embodiment of the present disclosure, the method may include an operation of refraining from causing the second candidate device to output the first notification message when the first notification message is acknowledged by the at least one user within a time period.
[0019] According to one embodiment of the present disclosure, the method may include an operation that causes the second candidate device to output the first notification message if the first notification message is not acknowledged by the at least one user within the time period.
[0020] According to one embodiment of the present disclosure, a server (108; 230) providing services related to the Internet of Things (IoT) may include a communication circuit (402), one or more processors (404) including processing circuitry, and a memory (406) for storing instructions.
[0021] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the server may cause the server to receive a first notification message from a first device among one or more devices (102; 220) located in space, which are associated with a user account registered to a service provided by the server, through the communication circuit.
[0022] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the server may cause the server to determine the location of at least one user associated with the user account based on the reception of the first notification message.
[0023] According to one embodiment of the present disclosure, if all of the at least one users are not present in the space, the first notification message may be provided to at least one mobile device of all of the at least one users.
[0024] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the server may cause the server to identify a first candidate device and a second candidate device to output the first notification message among the devices that are active in the space and connected to the server, based on the type of the first notification message, when the at least one user is present in the space.
[0025] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by one or more processors, the server may cause the first candidate device to output the first notification message.
[0026] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the server may cause the second candidate device to refrain from outputting the first notification message when the first notification message is acknowledged by the at least one user within a time period.
[0027] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the server may cause the second candidate device to output the first notification message if the first notification message is not acknowledged by the at least one user within the time period.
[0028] According to one embodiment of the present disclosure, a storage medium for storing at least one instruction readable by a computer may be provided.
[0029] According to one embodiment of the present disclosure, the at least one instruction may cause the server to perform at least one operation when executed individually or collectively by one or more processors (404) including the processing circuitry of the server (108; 230).
[0030] According to one embodiment of the present disclosure, the at least one operation may include receiving a first notification message from a first device among one or more devices (102; 220) located in space associated with a user account registered to a service provided by the server.
[0031] According to one embodiment of the present disclosure, the at least one operation may include an operation to determine the location of at least one user associated with the user account based on the reception of the first notification message.
[0032] According to one embodiment of the present disclosure, if all of the at least one users are not present in the space, the first notification message may be provided to at least one mobile device of all of the at least one users.
[0033] According to one embodiment of the present disclosure, the at least one operation may include, when the at least one user is present in the space, identifying a first candidate device and a second candidate device to output the first notification message among the devices that are active in the space and connected to the server, based on the type of the first notification message.
[0034] According to one embodiment of the present disclosure, the at least one operation may include an operation that causes the first candidate device to output the first notification message.
[0035] According to one embodiment of the present disclosure, the at least one operation may include an operation of refraining from causing the second candidate device to output the first notification message when the first notification message is acknowledged by the at least one user within a time period.
[0036] According to one embodiment of the present disclosure, the at least one operation may include an operation that causes the second candidate device to output the first notification message if the first notification message is not acknowledged by the at least one user within the time period.
[0037] FIG. 1 is a block diagram schematically illustrating an electronic device in a network environment according to one embodiment.
[0038] FIG. 2 is a diagram illustrating a process for providing IoT services in a wireless communication network according to one embodiment.
[0039] FIG. 3 is a block diagram schematically illustrating the internal structure of an external electronic device according to one embodiment.
[0040] FIG. 4 is a block diagram schematically illustrating the internal structure of a server according to one embodiment.
[0041] FIG. 5 is a diagram illustrating a process for providing IoT services in a wireless communication network according to one embodiment.
[0042] Figure 6 is a diagram illustrating notification messages that occur repeatedly while providing IoT services in a wireless communication network.
[0043] Figure 7 is a diagram illustrating notification messages that occur repeatedly while providing IoT services in a wireless communication network.
[0044] FIG. 8a is a flowchart schematically illustrating the operation process of an electronic device according to one embodiment.
[0045] FIG. 8b is a flowchart schematically illustrating the operation process of an electronic device according to one embodiment.
[0046] FIG. 9 is a diagram illustrating a process for providing IoT services in a wireless communication network according to one embodiment.
[0047] FIG. 10 is a diagram illustrating a process for providing IoT services in a wireless communication network according to one embodiment.
[0048] FIG. 11 is a flowchart schematically illustrating the operation process of a server according to one embodiment.
[0049] An embodiment of the present disclosure will be described in detail below with reference to the attached drawings. In describing an embodiment of the present disclosure, if it is determined that a detailed description of related known functions or configurations could unnecessarily obscure the essence of the embodiment, such detailed description will be omitted. Furthermore, the terms described below are defined considering the functions in an embodiment of the present disclosure, and these may vary depending on the intentions or conventions of the user or operator. Therefore, their definitions should be based on the content throughout this specification.
[0050] It should be noted that technical terms used in this specification are used merely to describe specific embodiments and are not intended to limit the embodiments of this disclosure. Alternatively, unless specifically defined otherwise in this specification, technical terms used in this specification shall be interpreted in the sense generally understood by those skilled in the art to which this disclosure pertains, and shall not be interpreted in an overly broad or overly narrow sense. Furthermore, if a technical term used in this specification is an incorrect technical term that fails to accurately express the spirit of this disclosure, it shall be understood as being replaced by a technical term that can be correctly understood by those skilled in the art. Alternatively, general terms used in an embodiment of this disclosure shall be interpreted according to their prior definitions or according to the context, and shall not be interpreted in an overly narrow sense.
[0051] Alternatively, singular expressions used in this specification include plural expressions unless the context clearly indicates otherwise. In this application, terms such as "composed of" or "comprising" should not be interpreted as necessarily including all of the various components or operations described in the specification, and should be interpreted as meaning that some of the components or operations may not be included, or that additional components or operations may be included.
[0052] Alternatively, terms including ordinal numbers, such as first, second, etc., as used herein may be used to describe various components, but said components shall not be limited by said terms. Such terms are used solely for the purpose of distinguishing one component from another. For example, without departing from the scope of the present disclosure, the first component may be named the second component, and similarly, the second component may be named the first component.
[0053] When it is stated that one component is "connected" or "connected" to another component, it may be directly connected or connected to that other component, or there may be other components in between. On the other hand, when it is stated that one component is "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between.
[0054] Hereinafter, an embodiment according to the present disclosure will be described in detail with reference to the attached drawings. Identical or similar components regardless of drawing symbols are given the same reference number, and redundant descriptions thereof will be omitted. Alternatively, in describing an embodiment of the present disclosure, if it is determined that a detailed description of related prior art may obscure the essence of the present disclosure, such detailed description will be omitted. Furthermore, it should be noted that the attached drawings are intended only to facilitate an easy understanding of the concept of the present disclosure and should not be interpreted as limiting the concept of the present disclosure. The concept of the present disclosure should be interpreted as extending to all modifications, equivalents, and substitutions in addition to the attached drawings.
[0055] Hereinafter, in one embodiment of the present disclosure, an electronic device will be described as an example, but the electronic device may be referred to as a terminal, mobile station, mobile equipment (ME), user equipment (UE), user terminal (UT), subscriber station (SS), wireless device, handheld device, or access terminal (AT). Alternatively, in one embodiment of the present disclosure, the electronic device may be a device equipped with communication functions, such as a mobile phone, personal digital assistant (PDA), smartphone, wireless modem, or laptop.
[0056] FIG. 1 is a block diagram schematically illustrating an electronic device (101) in a network environment (100) according to one embodiment.
[0057] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).
[0058] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.
[0059] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence is performed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.
[0060] The processor (120) may include processing circuitry. The number of processors (120) may be one or more. For example, the processor (120) may have the structure of a multi-core processor such as a dual core, quad core, or hexa core.
[0061] The processor (120) can control the operations of the electronic device (101) by executing instructions stored in memory (130). For example, the processor (120) may correspond to a plurality of processors that divide and collectively perform a plurality of operations among the processors.
[0062] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).
[0063] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0064] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0065] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.
[0066] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.
[0067] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).
[0068] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0069] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)) (tablet and / or smartwatch). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0070] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0071] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.
[0072] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0073] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).
[0074] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0075] It should be noted that the communication module (190) may also be referred to as a "communication circuit," and thus the communication module (190) and the communication circuit (190) may be used interchangeably as needed. The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., a LAN (local area network) communication module, or a power line communication module). The corresponding communication module among these communication modules may communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, Wi-Fi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips).The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network, such as a first network (198) or a second network (199), using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).
[0076] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.
[0077] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).
[0078] According to one embodiment, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.
[0079] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.
[0080] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0081] FIG. 2 is a diagram illustrating a process for providing IoT services in a wireless communication network (200) according to one embodiment.
[0082] Referring to FIG. 2, the wireless communication network (200) may be an IoT network. The IoT network may be a network based on IoT technology, for example, a smart home network.
[0083] According to one embodiment, an electronic device (101) (e.g., the electronic device (101) of FIG. 1) controls and / or manages external electronic devices (e.g., IoT devices) (e.g., the electronic device (102) of FIG. 1) based on IoT technology, and an IoT service (e.g., Samsung TM Can provide SmartThings services.
[0084] According to one embodiment, the hub (210) may be located in a set space (e.g., home and / or office).
[0085] According to one embodiment, a server (230) (e.g., the server (108) of FIG. 1) can register (or onboard) external electronic device(s) (220) using IoT services and remotely control the registered external electronic device(s) (220). The server (230) can remotely control the external electronic device(s) (220) in conjunction with the electronic device (101).
[0086] According to one embodiment, the external electronic device(s) (220) may be a device that provides IoT services in conjunction with the electronic device (101), the hub (210), and / or the server (230). According to one embodiment, the external electronic device(s) (220) may be an IoT device (e.g., home appliances such as a television (TV), light, air conditioner, blind, air purifier, camera, oven, and / or speaker). According to one embodiment, the external electronic device(s) (220) may be located in a set space. In one embodiment, other external electronic devices (e.g., an application market server) may be present in the wireless communication network (200).
[0087] According to one embodiment, the server (230) can receive data from external electronic device(s) (220). According to one embodiment, the server (230) can communicate with the electronic device (101), the hub (210), and / or the external electronic device(s) (220) via the Internet. The server (230) can communicate with other external electronic devices registered with the other server by interacting with another server (not shown) that provides IoT services. In one embodiment, the server (230) may include one or more servers.
[0088] According to one embodiment, the hub (210) can communicate with external electronic device(s) (220) based on any one of various communication methods. Various communication methods may include Zigbee and / or Z-Wave methods. According to one embodiment, the hub (210) can communicate with external electronic device(s) (220) via a LAN.
[0089] According to one embodiment, external electronic device(s) (220) may be located in various spaces within the wireless communication network (200) (e.g., living room, family room, kitchen, entrance, laundry storage, and / or first to Nth office, kitchen, and entrance)) and may communicate with the electronic device (101) through a server (230).
[0090] According to one embodiment, the external electronic device(s) (220) may include various types of electronic devices that operate based on IoT services. In one embodiment, the external electronic device(s) (220) may include a sensor or a switch for sensing the surrounding environment. The external electronic device(s) (220) may operate based on user input or operate automatically when a set condition is satisfied.
[0091] According to one embodiment, the electronic device (101) receives data from external electronic device(s) (220) and can display a screen corresponding to the received data. According to one embodiment, the electronic device (101) can use an IoT-based application (e.g., Samsung) to control external electronic device(s) (220) placed in various spaces within a wireless communication network (200) to control the external electronic device(s). TM When the SmartThings application is executed, it can output a user interface (UI) related to the executing IoT-based application.
[0092] FIG. 3 is a block diagram schematically illustrating the internal structure of an external electronic device (220) according to one embodiment.
[0093] Referring to FIG. 3, an external electronic device (220) (e.g., the electronic device (102) of FIG. 1) may be a device that implements IoT-based services in a wireless communication network (e.g., an IoT network). For example, the IoT network may be a network based on IoT technology, for example, a smart home network, and the IoT-based services may be Samsung TM It could be a SmartThings service.
[0094] An external electronic device (220) (e.g., an IoT device) may include antennas (301), a communication circuit (302), a processor (304), a memory (306), an interface (308), and / or an output module (310). The output module (310) may include a visual output device and / or an auditory output device. In one embodiment, the visual output device is an output device that outputs a notification message in a visual manner and may include, for example, a display, a light-emitting diode (LED), and / or a projector. In one embodiment, the auditory output device is an output device that outputs a notification message in an auditory manner and may include, for example, a speaker.
[0095] The external electronic device (220) may be a device that supports long term evolution (LTE), Zigbee, Z-Wave, Wi-Fi, Bluetooth low energy (BLE), UWB, and / or GPS. The external electronic device (220) may include an electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 2), a hub (e.g., the hub (210) of FIG. 2), and / or a server (e.g., the server (108) of FIG. 1, and / or the server (230) of FIG. 2)) and a communication circuit (302) that transmits and receives signals using one or more antennas (301). In one embodiment, the server may include one or more servers.
[0096] According to one embodiment, the communication circuit (302) may include a plurality of communication circuits, and the plurality of communication circuits may include communication circuits based on LTE, BLE, UWB, Zigbee, Z-Wave, and / or Wi-Fi. According to one embodiment, the external electronic device (220) may not include separate communication circuits based on each of LTE, BLE, UWB, Zigbee, Z-Wave, and / or Wi-Fi, but may include a communication circuit based on at least two of LTE, BLE, UWB, Zigbee, Z-Wave, and / or Wi-Fi, or all of LTE, BLE, UWB, Zigbee, Z-Wave, and / or Wi-Fi. According to one embodiment, a communication circuit based on at least two of LTE, BLE, UWB, Zigbee, Z-Wave, and / or Wi-Fi methods, or all of LTE, BLE, UWB, Zigbee, Z-Wave, and / or Wi-Fi methods may be a communication circuit (302).
[0097] The external electronic device (220) may include an interface (308) that provides a wired and / or wireless interface for communicating with components outside the network.
[0098] The external electronic device (220) may include a processor (304) that can be implemented with one or more single-core processors or one or more multi-core processors, and a memory (306) that stores instructions for the operation of the external electronic device (220).
[0099] In one embodiment, the processor (304) may include a processing circuit. The number of processors (304) may be one or more. For example, the processor (304) may have the structure of a multi-core processor such as a dual-core, quad-core, or hexa-core.
[0100] The processor (304) can control the operations of the external electronic device (220) by executing instructions stored in the memory (306). For example, the processor (304) may correspond to a plurality of processors that divide and collectively perform a plurality of operations among the processors.
[0101] According to one embodiment, the memory (306) is for running an application (e.g., Samsung) for running an IoT-based service. TM Images, user information, documents, databases, or related data for providing a UI related to a SmartThings application can be stored. According to one embodiment, when the application for executing an IoT-based service is executed under the control of the processor (304), the output module (310) can display a UI related to the application being executed.
[0102] FIG. 4 is a block diagram schematically illustrating the internal structure of a server (230) according to one embodiment.
[0103] Referring to FIG. 4, a server (230) (e.g., server (108) of FIG. 1 or server (230) of FIG. 2) provides IoT-based services (e.g., Samsung) in a wireless communication network (e.g., IoT network). TM It may be a device that implements a smartthings service. For example, the server (230) may include one or more servers.
[0104] The server (230) may include a communication circuit (402), a processor (404), a memory (406), an interface (408), and / or a display (410). The communication circuit (402), the processor (404), the memory (406), the interface (408), and / or the display (410) may each be implemented similarly or substantially identically to the communication circuit (302), the processor (304), the memory (306), the interface (308), and / or the output module (310) described in FIG. 3, and thus a detailed description thereof is omitted.
[0105] FIG. 5 is a diagram illustrating a process for providing IoT services in a wireless communication network according to one embodiment.
[0106] Referring to FIG. 5, the wireless communication network (500) may be an IoT network. The IoT network may be a network based on IoT technology, for example, a smart home network.
[0107] As illustrated in FIG. 5, a wireless communication network (e.g., a smart home network) includes multiple spaces. The multiple spaces may include spaces with the same global positioning system (GPS) location and spaces with different GPS locations. In FIG. 5, it is assumed that the GPS location of the home (500) and the GPS location of the office (550) are different.
[0108] In one embodiment, the GPS locations of multiple spaces included in the home (500) (e.g., living room (501), family room (502), kitchen (503), entrance (504), and laundry room (505)) are the same, but the spatial locations may be different. In one embodiment, the spatial location may indicate the location for each of the multiple spaces when a space having the same GPS location is divided into multiple spaces. For example, the GPS locations of the living room (501), family room (502), kitchen (503), entrance (504), and laundry room (505) included in the home (500) are the same, but the spatial locations of the living room (501), family room (502), kitchen (503), entrance (504), and laundry room (505) may be different.
[0109] In one embodiment, the GPS locations of a plurality of spaces included in the office (550) (e.g., a first office (551), a second office (552), a kitchen (553), an entrance (554), and a third office (555)) may be the same, and the spatial locations of the first office (551), the second office (552), the kitchen (553), the entrance (554), and the third office (555) may be different.
[0110] In one embodiment, a plurality of external electronic devices (511, 512, 513, 514, 515, 516, 517) (e.g., the electronic device (102) of FIG. 1 or the external electronic device(s) (220) of FIG. 2) may exist in the home (900). The plurality of external electronic devices (511, 512, 513, 514, 515, 516, 517) may be IoT devices, and as shown in FIG. 5, at least one IoT device may be placed in each of the living room (501), family room (502), kitchen (503), entrance (504), and laundry room (505) included in the home (500). For example, a light (511) and a TV (512) may be placed in the living room (501), a light (513) may be placed in the family room (502), a TV (515) may be placed in the kitchen (503), a door sensor (514) and a motion sensor (516) may be placed in the entrance (504), and a moisture sensor (517) may be placed in the laundry room (505).
[0111] In one embodiment, a plurality of external electronic devices (561, 562, 563, 564, 565, 566, 567) (e.g., the electronic device (102) of FIG. 1 or the external electronic device(s) (220) of FIG. 2) may exist in the office (550). The plurality of external electronic devices (561, 562, 563, 564, 565, 566, 567) may be IoT devices, and as shown in FIG. 5, at least one IoT device may be placed in each of the first office (551), second office (552), kitchen (553), entrance (554), and third office (555) included in the office (550). For example, a light (561) and a TV (562) may be placed in the first office (551), a light (563) may be placed in the second office (552), a TV (565) may be placed in the kitchen (553), a door sensor (564) and a motion sensor (566) may be placed in the entrance (554), and a motion sensor (567) may be placed in the third office (555).
[0112] In one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 2) may provide (e.g., display) notification messages corresponding to various events occurring in relation to the operations of external electronic devices (511, 512, 513, 514, 515, 516, 517, 561, 562, 563, 564, 565, 566, 567) in external electronic devices (511, 512, 513, 514, 515, 516, 517, 561, 562, 563, 564, 565, 566, 567) included in an IoT network.
[0113] In one embodiment, some of the external electronic devices (511, 512, 513, 514, 515, 516, 517, 561, 562, 563, 564, 565, 566, 567) may provide (e.g., display) notification messages to other external electronic devices by control of the electronic device (or by setting of the electronic device). The external electronic devices providing notification messages to other external electronic devices may have the capability to provide notification messages, such as a display, for example, and may be a TV, a wall pad, or a home camera device.
[0114] Figure 6 is a diagram illustrating notification messages that occur repeatedly while providing IoT services in a wireless communication network.
[0115] Referring to FIG. 6, the wireless communication network may be an IoT network. The IoT network may be a network based on IoT technology, for example, a smart home network. In the IoT network, an electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 2) may provide (e.g., display) notification messages corresponding to various events occurring in relation to the operations of external electronic devices (e.g., the electronic device (102) of FIG. 1 or the external electronic device (220) of FIG. 2 or FIG. 3) that are subscribed to an IoT-based service.
[0116] Some of the external electronic devices may provide (e.g., display) notification messages to other external electronic devices by control of the electronic device (or by setting of the electronic device). The external electronic devices that provide notification messages to other external electronic devices may have the ability to provide notification messages, such as a display, and may be, for example, a TV, a wall pad, or a home camera device.
[0117] As illustrated in FIG. 6, the home camera device includes multiple cameras installed in configured spaces among multiple spaces within an IoT network, and can provide videos captured by the multiple cameras. In this way, while the home camera device is providing videos captured by the multiple cameras, if motion is detected at the doorbell, a notification message corresponding to the detected motion (e.g., a motion detection notification message) may be provided (e.g., displayed) by the home camera device. If multiple movements are detected at the doorbell, multiple notification messages corresponding to the multiple movements may be provided by the home camera device. Additionally, while the home camera device is providing videos captured by the multiple cameras, if the doorbell rings, a notification message corresponding to the ringing of the doorbell (e.g., a doorbell ringing notification message) may be provided (e.g., displayed) by the home camera device. If multiple doorbell rings are detected at the doorbell, multiple notification messages corresponding to the multiple doorbell rings may be provided by the home camera device.
[0118] Such multiple notification messages can not only interfere with the user's ability to view videos captured by multiple cameras, but can also provide a poor experience to the user, to the extent that the user may have very negative thoughts about the notification service. For example, while the home camera device is providing videos (610, 620) captured by two cameras, the motion detection notification message (630) provided when motion is detected at the doorbell and the multiple doorbell ringing messages (640) provided when the doorbell rings can particularly interfere with the user's ability to view the video (620), and thus provide a poor experience to the user, to the extent that the user may have very negative thoughts about the notification service.
[0119] Figure 7 is a diagram illustrating notification messages that occur repeatedly while providing IoT services in a wireless communication network.
[0120] Referring to FIG. 7, the wireless communication network may be an IoT network. The IoT network may be a network based on IoT technology, for example, a smart home network. In the IoT network, an electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 2) may provide (e.g., display) notification messages corresponding to various events occurring in relation to the operations of external electronic devices (e.g., the electronic device (102) of FIG. 1 or the external electronic device (220) of FIG. 2 or FIG. 3) that are subscribed to an IoT-based service.
[0121] Some of the external electronic devices may provide (e.g., display) notification messages to other external electronic devices by control of the electronic device (or by setting of the electronic device). The external electronic devices that provide notification messages to other external electronic devices may have the ability to provide notification messages, such as a display, and may be, for example, a TV, a wall pad, or a home camera device.
[0122] As illustrated in FIG. 7, when motion is detected from the doorbell while the user is watching TV, a notification message corresponding to the detected motion (e.g., a motion detection notification message) may be provided on the TV (e.g., displayed). When multiple motions are detected from the doorbell, multiple notification messages corresponding to the multiple motions may be provided on the TV. Additionally, when the doorbell rings while the user is watching TV, a notification message corresponding to the ringing of the doorbell (e.g., a doorbell ringing notification message) may be provided on the TV (e.g., displayed). When multiple doorbell rings are detected from the doorbell, multiple notification messages corresponding to the multiple doorbell rings may be provided on the TV.
[0123] Such multiple notification messages can not only interfere with the user watching TV, but also provide a poor experience to the user, to the extent that the user may have very negative thoughts about the notification service. For example, motion detection notification messages (710) provided when motion is detected at the doorbell while the user is watching TV, and multiple doorbell ringing messages (720) provided when the doorbell rings, can particularly interfere with the user checking the screen (730), and thus provide a poor experience to the user, to the extent that the user may have very negative thoughts about the notification service.
[0124] Among the various services based on IoT technology, a representative service is smart home service (e.g., Samsung TM It can be a SmartThings service. In a smart home service, the electronic device managing the smart home service (e.g., a manager device (e.g., a smartphone)) is an IoT-based application (e.g., a smart home application (e.g., Samsung TM You can control and / or manage external electronic devices (e.g., IoT devices (e.g., smart home devices)) such as televisions (TVs), speakers, and / or refrigerators through the SmartThings application.
[0125] As such smart home services and related industries expand, not only is the number of interconnected devices (electronic devices and / or external electronic devices) increasing, but the types of interconnected devices are also growing. Since various multiple devices are interconnected and transmit necessary notification messages to users, handling notification messages generated from multiple devices in IoT-based services, such as smart home services, can be a critical factor in user experience.
[0126] In particular, as the number of IoT devices increases in IoT-based services, the number of notification messages generated based on user presets and needs can increase exponentially. Specifically, each IoT device may seek to provide various meaningful notification messages to the user to satisfy the user scenarios provided by that device. If a user connects IoT devices over a relatively long period, the user may eventually continuously receive standardized notification messages based on the configured method.
[0127] For example, in the case of a doorbell, if motion is detected by the doorbell, a notification message corresponding to the detected motion (e.g., a motion detection notification message) may be provided (e.g., displayed) on the TV. If multiple motions are detected by the doorbell, multiple notification messages corresponding to the multiple motions may be provided on the TV. Such multiple notification messages can not only interfere with the user's viewing of the TV but also provide a poor user experience, to the extent that it leads the user to have very negative thoughts about the notification service.
[0128] For example, when washing is finished at night, a notification message announcing the end of washing can be transmitted to the user's electronic device and external electronic devices (e.g., external electronic devices capable of providing notification messages (e.g., external electronic devices capable of displaying notification messages), and as the number of external electronic devices providing notification messages increases, the number of notification messages announcing the end of washing also increases, so the user may consider the duplicate notification messages announcing the end of washing itself as a very significant stress factor.
[0129] For example, the notifications currently provided by IoT-based services may be as follows.
[0130] (1) Doorbell ringing notification
[0131] (2) Doorbell motion detection notification
[0132] (3) CCTV camera motion detection notification
[0133] (4) CCTV camera sound detection notification
[0134] (5) Washing machine wash completion notification
[0135] (6) Dryer drying complete notification
[0136] As such, with the widespread adoption of IoT-based services and the increasing number of devices (e.g., electronic devices or other external electronic devices) capable of providing (or displaying) information related to the status of external electronic devices (e.g., IoT devices), multiple notification messages of various forms may be provided, and an excessive number of notification messages can act as a stress factor for users. Furthermore, even for notification messages that are generated repeatedly based on a set data format, there may be a problem in that unnecessary costs must be incurred to continuously extract image data or transmit video data.
[0137] For example, regarding a doorbell, if a notification message occurs repeatedly even though the user is not currently watching TV (e.g., the TV is powered off) or is not looking at the smartphone screen (e.g., the smartphone is powered off or the smartphone is in a locked state) (e.g., even though it is impossible for the TV or smartphone to display image data or video data), it may be required to store image data or video data corresponding to the repeated notification messages. The locked state may include a state where the smartphone display is turned off or / or the display is locked.
[0138] In particular, since notification messages are transmitted even to IoT devices that are powered off or to smartphones that are powered off or locked, scheduled notification messages may be provided (or displayed) all at once when the IoT device is subsequently powered on or the smartphone is powered on or unlocked, even though the valid period for providing notifications to the user has already expired. These notification messages provided all at once may become unnecessary for the user.
[0139] Accordingly, the present disclosure may provide an electronic device, a method, and a storage medium that provide notification messages corresponding to notifications generated from external electronic devices based on the types and / or characteristics of external electronic devices (e.g., IoT devices) held by a user in an IoT-based service and whether the user is present in a corresponding space.
[0140] The present disclosure may provide an electronic device for selecting an external electronic device that provides (or displays) notification messages corresponding to notifications generated from external electronic devices based on the user's situation and the status of the external electronic devices in an IoT-based service, and a method and a storage medium thereof.
[0141] The present disclosure may provide an electronic device that provides (or displays) notification messages corresponding to notifications occurring in external electronic devices based on the capability of an external electronic device selected to provide (or display) notification messages corresponding to notifications occurring in external electronic devices in an IoT-based service, and a method and a storage medium thereof.
[0142] According to one embodiment of the present disclosure, an electronic device (101) may include a communication circuit (190), one or more processors (120) including a processing circuitry, and a memory (130) for storing instructions.
[0143] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by one or more processors, the electronic device may be caused to select at least one second external electronic device among the second external electronic devices that outputs a notification message corresponding to the notification, based at least on the type of notification for announcing information related to the operation of a first external electronic device among a plurality of external electronic devices (102; 220) registered in an Internet of Things (IoT) based service, types of output devices included in second external electronic devices other than the first external electronic device among the plurality of external electronic devices, and operating states of the second external electronic devices, whether a user is present in a space where the IoT based service is provided, and biometric information of the user.
[0144] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the electronic device may cause the output method for the notification message to be set based at least on the type of output device included in the at least one second external electronic device, wherein the output method for the notification message may be related to whether the notification message is output in a visual manner and / or an auditory manner, and the frequency at which the notification message is output.
[0145] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the electronic device may cause the electronic device to transmit a first message through the communication circuit to the at least one second external electronic device, the first message comprising information indicating that the at least one second external electronic device is selected to output the notification message and information related to the output method for the notification message.
[0146] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the electronic device may cause the first external electronic device to transmit a second message containing information indicating that the at least one second external electronic device is selected to output the notification message through the communication circuit.
[0147] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the electronic device may cause the output method for the notification message to be set as at least part of an operation for setting the output method for the notification message based on the type of output device included in the at least one second external electronic device, the type of the notification, the operating states, whether the user is present in the space where the IoT-based service is provided, and the user's biometric information.
[0148] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the electronic device may cause the frequency at which the notification message is output to be set above a threshold frequency, based on the type of output device included in the at least one second external electronic device, the type of the notification, the operating states, whether the user is present in the space where the IoT-based service is provided, and the biometric information of the user, as at least part of the operation of setting an output method for the notification message, the type of the notification is an emergency notification including a disaster notification indicating that a disaster has occurred and a security notification indicating that a security-related situation has occurred, or a user notification requiring intervention by the user.
[0149] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the electronic device may cause the output method for the notification message to be set to the visual method to display the notification message through the visual output device based on the type of output device included in the at least one second external electronic device, or the output method for the notification message to be set to the auditory method to output the notification message through the auditory output device based on the type of output device included in the at least one second external electronic device to be an auditory output device.
[0150] According to one embodiment of the present disclosure, the operating state of the second external electronic device may include a sleep state in which the second external electronic device is not used during a set period and an awake state other than the sleep state.
[0151] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the electronic device may cause at least one of the second external electronic devices whose operating state is the awake state to be selected as the at least one second external electronic device as at least part of the operation of selecting the at least one second external electronic device.
[0152] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the electronic device may cause the user to select, as at least one second external electronic device, the user wearing or possessing the second external electronic device among the second external electronic devices as at least one second external electronic device, based on the fact that the user is not present in the space where the IoT-based service is provided.
[0153] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the electronic device may cause the user to select at least one of the second external electronic devices, wherein the type of output device of the second external electronic devices is an auditory output device, as at least one second external electronic device, based on the fact that the user is present in the space where the IoT-based service is provided and the user's biometric information indicates that the user is exercising.
[0154] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the electronic device may cause the frequency at which the notification message is output to be set above a threshold frequency, based on the type of output device included in the at least one second external electronic device, the type of the notification, the operating states, whether the user is present in the space where the IoT-based service is provided, and the biometric information of the user, as at least part of the operation of setting an output method for the notification message, the biometric information of the user indicates that the user is sleeping, and the type of the notification is an emergency notification including a disaster notification indicating that a disaster has occurred and a security notification indicating that a security-related situation has occurred, or a user notification requiring intervention by the user.
[0155] According to one embodiment of the present disclosure, the notification message may include an identifier (ID) identifying the at least one second external electronic device, a type of the notification, a time when the notification occurred, an address of the first external electronic device, information related to the operation of the first external electronic device, and a description of the information related to the operation of the first external electronic device.
[0156] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the electronic device may cause to receive, through the communication circuit, a third message from the first external electronic device, after transmitting the second message, the third message including information indicating that the at least one second external electronic device outputting the notification message has been changed and information related to the changed at least one second external electronic device.
[0157] According to one embodiment of the present disclosure, an electronic device (102; 220) may include a communication circuit (302), one or more processors (304) including a processing circuitry, and a memory (306) for storing instructions.
[0158] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by one or more processors, the electronic device may be caused to receive, through the communication circuit, a first message including information indicating that a plurality of external electronic devices (102; 220) registered with an Internet of Things (IoT)-based service among the electronic devices are selected to output a notification message corresponding to a notification for announcing information related to the operation of a second external electronic device, and information related to the output method for the notification message, wherein the output method for the notification message relates to whether the notification message is output in a visual manner and / or an auditory manner and the frequency at which the notification message is output, and the second external electronic device may be registered with the IoT-based service.
[0159] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the electronic device may cause the electronic device to receive the notification message from the second external electronic device through the communication circuit.
[0160] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the electronic device may cause the received notification message to be output based on an output method for the notification message.
[0161] According to one embodiment of the present disclosure, the type of the notification, the types of output devices included in the third external electronic devices other than the second external electronic device among the plurality of external electronic devices, and the operating states of the third external electronic devices and the electronic device, whether a user is present in a space where the IoT-based service is provided, and at least based on the user's biometric information, the electronic device among the third external electronic devices and the electronic device may be selected to output the notification message.
[0162] According to one embodiment of the present disclosure, the output method for the notification message may be set based at least on the type of output device included in the electronic device.
[0163] According to one embodiment of the present disclosure, the output method for the notification message may be configured based on the type of output device included in the electronic device, the type of the notification, the operating states, whether the user is present in the space where the IoT-based service is provided, and the user's biometric information.
[0164] According to one embodiment of the present disclosure, the frequency at which the notification message is output may be set to be greater than or equal to a threshold frequency, based on whether the type of notification is an emergency notification including a disaster notification indicating the occurrence of a disaster and a security notification indicating the occurrence of a security-related situation, or a user notification requiring user intervention.
[0165] According to one embodiment of the present disclosure, based on the type of output device included in the electronic device being a visual output device, the output method for the notification message is configured to display the notification message through the visual output device, or based on the type of output device included in the electronic device being an auditory output device, the output method for the notification message may be configured to output the notification message through the auditory output device.
[0166] According to one embodiment of the present disclosure, the operating state of the electronic device includes a sleep state in which the electronic device is not used for a set period and an awake state other than the sleep state, and based on the operating state of the electronic device being the awake state, the electronic device may be selected to output the notification message.
[0167] According to one embodiment of the present disclosure, the electronic device may be selected to output the notification message based on the fact that the user is wearing or carrying the electronic device and the user is not present in the space where the IoT-based service is provided.
[0168] According to one embodiment of the present disclosure, the type of output device included in the electronic device is an auditory output device, and the electronic device may be selected to output the notification message based on the fact that the user is present in a space where the IoT-based service is provided and the user's biometric information indicates that the user is exercising.
[0169] According to one embodiment of the present disclosure, the frequency at which the notification message is output may be set to be greater than or equal to a threshold frequency, based on the fact that the user’s biometric information indicates that the user is sleeping, and the type of notification is an emergency notification including a disaster notification indicating that a disaster has occurred and a security notification indicating that a security-related situation has occurred, or a user notification requiring the user’s intervention.
[0170] According to one embodiment of the present disclosure, the notification message may include an identifier (ID) identifying the electronic device, a type of the notification, a time when the notification occurred, an address of the second external electronic device, information related to the operation of the second external electronic device, and a description of the information related to the operation of the second external electronic device.
[0171] According to one embodiment of the present disclosure, a server (108; 230) providing services related to the Internet of Things (IoT) may include a communication circuit (402), one or more processors (404) including processing circuitry, and a memory (406) for storing instructions.
[0172] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the server may cause the server to receive a first notification message from a first device among one or more devices (102; 220) located in space, which are associated with a user account registered to a service provided by the server, through the communication circuit.
[0173] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the server may cause the server to determine the location of at least one user associated with the user account based on the reception of the first notification message.
[0174] According to one embodiment of the present disclosure, if all of the at least one users are not present in the space, the first notification message may be provided to at least one mobile device of all of the at least one users.
[0175] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the server may cause the server to identify a first candidate device and a second candidate device to output the first notification message among the devices that are active in the space and connected to the server, based on the type of the first notification message, when the at least one user is present in the space.
[0176] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by one or more processors, the server may cause the first candidate device to output the first notification message.
[0177] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the server may cause the second candidate device to refrain from outputting the first notification message when the first notification message is acknowledged by the at least one user within a time period.
[0178] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the server may cause the second candidate device to output the first notification message if the first notification message is not acknowledged by the at least one user within the time period.
[0179] According to one embodiment of the present disclosure, based on a predetermined priority, the order in which the first candidate device outputs the first notification message may be determined to precede the order in which the second candidate device outputs the first notification message.
[0180] According to one embodiment of the present disclosure, the predetermined priority may be based on the order in which the devices that are activated and connected to the server in the space are activated, or on the preference of at least one user for the devices that are activated and connected to the server in the space.
[0181] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the server may identify a third candidate device to output the first notification message among the devices that are activated and connected to the server in the space, based on the biometric information of the at least one user, when the at least one user is present in the space, and cause the third candidate device to output the first notification message.
[0182] According to one embodiment of the present disclosure, based on the biometric information of the at least one user indicating that the at least one user is exercising, an auditory type output device among the devices that are activated and connected to the server in the space may be selected as the third candidate device.
[0183] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by one or more processors, the server may set the frequency at which the first notification message is output above a threshold frequency, based on whether the type of notification data included in the first notification message is an emergency notification or a user notification, as at least part of the operation that causes the first candidate device to output the first notification message, - wherein the emergency notification includes a disaster notification indicating that a disaster has occurred and a security notification indicating that a security-related situation has occurred, and the user notification includes a notification requiring user intervention - and cause the first candidate device to output the first notification message above the threshold frequency.
[0184] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the server may, as at least part of the operation causing the third candidate device to output the first notification message, set the frequency at which the first notification message is output above a threshold frequency based on the biometric information of the at least one user indicating that the at least one user is sleeping and the type of notification data included in the first notification message being an emergency notification or a user notification, - wherein the emergency notification includes a disaster notification indicating that a disaster has occurred and a security notification indicating that a security-related situation has occurred, and the user notification includes a notification requiring user intervention - and cause the third candidate device to output the first notification message above the threshold frequency.
[0185] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the server may, as at least part of an operation that causes the first candidate device to output the first notification message, convert the notification data included in the first notification message into auditory notification data including audio data—wherein the visual notification data includes image data and / or video data—and cause the first candidate device to output the first notification message including the converted auditory notification data.
[0186] According to one embodiment of the present disclosure, when the instructions are executed individually or collectively by the one or more processors, the server may identify, when the at least one user is present in the space, a device having an output capability designated to output the first notification message among the devices that are active and connected to the server in the space as a fourth candidate device to output the first notification message, and cause the fourth candidate device to output the first notification message.
[0187] According to one embodiment of the present disclosure, based on the fact that the notification data included in the first notification message is visual notification data including image data and / or video data, the fourth candidate device may include a device including a visual type output device.
[0188] According to one embodiment of the present disclosure, based on the fact that the notification data included in the first notification message is auditory notification data including audio data, the fourth candidate device may include a device including an auditory type output device.
[0189] FIG. 8a is a flowchart schematically illustrating the operation process of an electronic device according to one embodiment.
[0190] Referring to FIG. 8a, an electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 2) (e.g., one or more processors including processing circuitry) (e.g., the processor (120) of FIG. 1) can, in operation 811, select at least one second external electronic device that outputs a notification message corresponding to the notification among the second external electronic devices, based at least on the type of notification for notifying information related to the operation of the first external electronic device among a plurality of external electronic devices (e.g., the electronic device (102) of FIG. 1 or the external electronic device (220) of FIG. 2 or FIG. 3) registered in an IoT-based service in a wireless communication network (e.g., an IoT network), types of output devices included in the second external electronic devices other than the first external electronic device among the plurality of external electronic devices, operating states of the second external electronic devices, whether the user is present in the space where the IoT-based service is provided, and the user's biometric information. In one embodiment, the electronic device may select at least one second external electronic device that outputs a notification message based on a set cycle, or when an event occurs (or as needed), or whenever a notification occurs. In one embodiment, the first external electronic device may be any one of a plurality of external electronic devices and may be a device that generates (or creates) a notification (e.g., a notification generating device). The at least one second external electronic device may be a device (e.g., a notification output device) that outputs (e.g., provides) a notification message corresponding to a notification generated by the first external electronic device among the external electronic devices excluding the first external electronic device among the plurality of external electronic devices.
[0191] In one embodiment, the type of notification may be set according to situations such as emergency situations and normal situations. In one embodiment, the electronic device may set how a notification message is output to the user (e.g., whether to provide it) based on the type of notification (e.g., whether to output the notification message visually, and / or output the notification message audibly, and whether to output the notification message at a threshold frequency or higher). In one embodiment, the type of notification may include emergency notifications, including disaster notifications indicating the occurrence of a disaster and security notifications indicating the occurrence of a security-related situation; user notifications requiring user intervention; critical notifications based on importance set by the user; and / or normal notifications.
[0192] In one embodiment, the type of output device included in the second external electronic device may include a visual output device and / or an auditory output device. In one embodiment, the visual output device is an output device that outputs a notification message in a visual manner and may include, for example, a display, a light-emitting diode (LED), and / or a projector. In one embodiment, the auditory output device is an output device that outputs a notification message in an auditory manner and may include, for example, a speaker.
[0193] In one embodiment, the operating state of the second external electronic device may include a sleep state in which the second external electronic device is not used during a set period and / or an awake state other than the sleep state. In one embodiment, the electronic device may select at least one second external electronic device to output a notification message corresponding to the notification of the first external electronic device by considering the operating states of a plurality of second external electronic devices. In one embodiment, the electronic device may select at least one of the second external electronic devices in the awake state among the plurality of second external electronic devices as the at least one second external electronic device to output a notification message. In one embodiment, if the second external electronic device is in the sleep state, the electronic device may select at least one second external electronic device to output a notification message corresponding to the notification of the first external electronic device by considering the time when the second external electronic device was last used.
[0194] In one embodiment, the electronic device may select at least one second external electronic device to output a notification message corresponding to a notification of the first external electronic device, taking into account the operation currently being performed by the second external electronic device when the second external electronic device is in an awake state. In one embodiment, the electronic device may select at least one second external electronic device to output a notification message corresponding to a notification of the first external electronic device based on whether the operation currently being performed by the second external electronic device is an operation corresponding to the main function of the second external electronic device. For example, if the second external electronic device is a washing machine, the main function of the second external electronic device may be a washing function; if the second external electronic device is a dryer, the main function of the second external electronic device may be a washing function; if the second external electronic device is an audio player, the main function of the second external electronic device may be a music playback function; if the second external electronic device is a video player, the main function of the second external electronic device may be a video playback function; if the second external electronic device is a refrigerator, the main function of the second external electronic device may be a refrigeration function and / or a freezing function; and if the second external electronic device is a cooking device, the main function of the second external electronic device may be a cooking function.
[0195] In one embodiment, the electronic device may be configured to wake up a second external electronic device in a sleep state, even if the second external electronic device is in a sleep state, if the device is suitable (or optimal) for a notification generated by a first external electronic device, and to have the woken-up second external electronic device output a notification message. In one embodiment, after selecting at least one second external electronic device to output a notification message, the electronic device may change the at least one second external electronic device to output a notification message based on the changed operating state if the operating state of at least one second external electronic device changes thereafter.
[0196] In one embodiment, the electronic device may select at least one second external electronic device to output a notification message corresponding to a notification of the first external electronic device based on whether the user is present in a space where an IoT-based service is provided. In one embodiment, the electronic device may select at least one second external electronic device (e.g., a wearable device) (e.g., a smart watch, and / or a smart ring) among a plurality of second external electronic devices that the user wears or possesses as the at least one second external electronic device to output a notification message based on whether the user is present in a space where an IoT-based service is provided.
[0197] In one embodiment, the electronic device may select at least one second external electronic device to output a notification message based on the user's biometric information when the user is present in a space where an IoT-based service is provided. In one embodiment, the electronic device may select at least one second external electronic device to output a notification message when the user's biometric information indicates that the user is exercising, wherein the type of the output device is an auditory output device.
[0198] In one embodiment, the electronic device can verify the user's biometric information through a plurality of external electronic devices. In one embodiment, some or a plurality of the plurality of external electronic devices may include at least one sensor, camera, and / or microphone capable of acquiring the user's biometric information. In one embodiment, the at least one sensor may include a gyroscope sensor, an accelerometer sensor, a heart rate monitoring (HRM) sensor, a gesture sensor, a barometric pressure sensor, a magnetic sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, and / or a humidity sensor. In one embodiment, the HRM sensor may include an electrocardiography (ECG) sensor, a photoplethysmogram (PPG) sensor, and / or a heart rate measurement sensor.
[0199] In one embodiment, a sleep state (e.g., a state in which the user is sleeping) can be determined based on sensing values obtained through a gyroscope sensor, an accelerometer sensor, and / or a geomagnetic sensor. For example, a processor of an external electronic device may obtain sensing values through a gyroscope sensor, an accelerometer sensor, and / or a geomagnetic sensor at a set interval (e.g., 20 minutes), and if each of the sensing values obtained through the gyroscope sensor, the accelerometer sensor, and / or geomagnetic sensor is below a set threshold value, the user state may be determined to be in a sleep state.
[0200] In one embodiment, a waking state (e.g., a non-sleep state transitioned from a sleep state) can be identified based on sensing values obtained through a gyroscope sensor, an accelerometer sensor, and / or a geomagnetic sensor. For example, a processor of an external electronic device may acquire sensing values through a gyroscope sensor, an accelerometer sensor, and / or a geomagnetic sensor at set intervals while the user state is in a sleep state, and if each of the sensing values obtained through the gyroscope sensor, the accelerometer sensor, and / or geomagnetic sensor is greater than or equal to a set threshold value, the user state may be identified as a waking state.
[0201] In one embodiment, the exercise state can be determined based on sensing values obtained through a gyroscope sensor, an accelerometer sensor, and / or a heart rate sensor. For example, a processor of an external electronic device obtains sensing values through a gyroscope sensor, an accelerometer sensor, and / or a heart rate sensor at a set interval (e.g., 1 minute), and if each of the sensing values obtained through the gyroscope sensor, the accelerometer sensor, and / or heart rate sensor is greater than or equal to a set threshold, the user state can be determined as an exercise state.
[0202] In one embodiment, the electronic device may select at least one second external electronic device to output a notification message based at least on the user's biometric information. In one embodiment, the electronic device may select at least one second external electronic device to output a notification message based on the user's biometric information and the type of notification. In one embodiment, the electronic device may select at least one second external electronic device to output a notification message when the user's biometric information indicates that the user is sleeping, or when the type of notification from the first external electronic device is an emergency notification including disaster notifications and security notifications, or a user notification. For example, when the user's biometric information indicates that the user is sleeping, the electronic device may select at least one of the second external electronic devices whose output device type is an auditory output device as the at least one second external electronic device to output a notification message.
[0203] An electronic device that selects at least one second external electronic device among the second external electronic devices that outputs a notification message corresponding to a notification may, in operation 813, set a method of outputting the notification message based at least on the type of output device included in the at least one second external electronic device. In one embodiment, the method of outputting the notification message may be related to whether the notification message is output in a visual manner and / or an auditory manner, and the frequency at which the notification message is output. In one embodiment, the electronic device may set a method of outputting the notification message based on the type of output device included in the at least one second external electronic device, the type of notification of the first external electronic device, the operating states of a plurality of second external electronic devices, whether the user is present in a space where an IoT-based service is provided, and the user's biometric information.
[0204] In one embodiment, the electronic device may set the frequency of outputting notification messages to be greater than or equal to a threshold frequency when the type of notification is an emergency notification including a disaster notification indicating the occurrence of a disaster and a security notification indicating the occurrence of a security-related situation, or a user notification requiring user intervention. Alternatively, when the type of notification is not an emergency notification or a user notification, the electronic device may set the frequency of outputting notification messages to a threshold frequency or to be less than a threshold frequency. In this way, the frequency of outputting notification messages can be adjusted based on the importance of the type of notification, which can reduce user fatigue caused by the repetitive output of unnecessary notification messages.
[0205] In one embodiment, if the type of output device included in at least one second external electronic device is a visual output device, the electronic device may set the output method for the notification message to be visual so as to display the notification message through the visual output device. In one embodiment, if the type of output device included in at least one second external electronic device is an auditory output device, the electronic device may set the output method for the notification message to be auditory so as to output the notification message through the auditory output device. In this way, the electronic device can efficiently output the notification message by adaptively setting the output method of the notification message according to the type of output device included in at least one second external electronic device selected to output the notification message of the first external electronic device.
[0206] In one embodiment, the electronic device may select at least one of the second external electronic devices, wherein the type of the output device is an auditory output device among the second external electronic devices, as the at least one second external electronic device to output a notification message, based on the fact that the user is present in a space where an IoT-based service is provided and the user's biometric information indicates that the user is exercising. For example, when the user is exercising, even if the notification message is output in a visual manner, it may be impossible (or difficult) for the user to check the notification, so at least one of the second external electronic devices, wherein the type of the output device is an auditory output device among the second external electronic devices, may be selected as the at least one second external electronic device to output a notification message so that the notification message can be output in an auditory manner.
[0207] In one embodiment, the electronic device may set the frequency at which a notification message is output to be greater than a threshold frequency, based on the fact that the user's biometric information indicates that the user is sleeping, and the type of notification is an emergency notification including a disaster notification indicating the occurrence of a disaster and a security notification indicating the occurrence of a security-related situation, or a user notification requiring user intervention. For example, since it may be impossible (or difficult) for the user to check the notification when the user is sleeping, the electronic device may be configured to output the notification message at a frequency greater than the threshold frequency. Alternatively, since it may be impossible (or difficult) for the user to check the notification even if the notification message is output in a visual manner when the user is sleeping, at least one of the second external electronic devices whose output device type is an auditory output device may be selected as the at least one second external electronic device to output the notification message, so that the notification message can be output in an auditory manner.
[0208] An electronic device that sets an output method for a notification message based at least on the type of output device included in at least one second external electronic device may, in operation 815, transmit a first message to at least one second external electronic device, the first message including information indicating that at least one second external electronic device is selected to output a notification message and information related to the output method for a notification message. In one embodiment, the information indicating that the notification message is selected to output a notification message may include the address of a first external electronic device that is a notification generating device that generates a notification.
[0209] An electronic device that has transmitted a first message to at least one second external electronic device may, in operation 817, transmit a second message to the first external electronic device that includes information indicating that at least one second external electronic device is selected to output a notification message. In one embodiment, the information indicating that at least one second external electronic device is selected to output a notification message may include an identifier (ID) that identifies at least one second external electronic device.
[0210] FIG. 8b is a flowchart schematically illustrating the operation process of an electronic device according to one embodiment.
[0211] Referring to FIG. 8b, in a wireless communication network (e.g., an IoT network), an electronic device registered to an IoT-based service (e.g., the electronic device (102) of FIG. 1 or the external electronic device (220) of FIG. 2 or 3) (e.g., one or more processors including processing circuitry) (e.g., the processor (3040) of FIG. 3) in operation 861, through a communication circuit (e.g., the communication circuit (302) of FIG. 3), receives from a first external electronic device (e.g., the electronic device (101) of FIG. 1 or 2)) a plurality of external electronic devices registered to an IoT-based service (e.g., the electronic device (102) of FIG. 1 or the external electronic device (220) of FIG. 2 or 3) and a second external electronic device (e.g., the electronic device (102) of FIG. 1 or the external electronic device of FIG. 2 or 3) among the electronic devices that is registered to an IoT-based service A first message may be received that includes information indicating that a notification message corresponding to a notification is selected to be output for informing information related to the operation of the device (220), and information related to the output method for the notification message. In one embodiment, the first message and the information included in the first message may be implemented similarly or substantially identically to those described in FIG. 8a, and thus redundant descriptions may be omitted. In one embodiment, the second external electronic device may be a notification generating device that generates (or creates) a notification and transmits a notification message corresponding to the generated notification. In one embodiment, the electronic device may be a notification output device that receives the notification message transmitted by the second external electronic device and provides (or outputs) the received notification message.In one embodiment, the first external electronic device may be a device that selects an electronic device to output a notification message corresponding to a notification generated by a second external electronic device among a plurality of external electronic devices subscribed to an IoT-based service.
[0212] An electronic device that has received a first message from a first external electronic device may, in operation 863, receive a notification message from a second external electronic device through a communication circuit. In one embodiment, the notification message may include an identifier (ID) identifying the electronic device, a type of notification, a time when the notification occurred, an address of the second external electronic device, information related to the operation of the second external electronic device, and a description of the information related to the operation of the second external electronic device. In one embodiment, the notification message may further include a category of the second external electronic device and a snapshot of the status of surrounding external electronic devices around the second external electronic device. In one embodiment, the category of the second external electronic device may include, for example, a TV, a speaker, an air conditioner, a refrigerator, and / or a washing machine. In one embodiment, the snapshot of the status of surrounding external electronic devices may include information related to the operating status of the surrounding external electronic devices. In one embodiment, the description of information related to the operation of the second external electronic device may include an explanation of the notification of the second external electronic device. The description of information related to the operation of the second external electronic device may include a first description and a second description. In one embodiment, the first description may include an abbreviated description of information related to the operation of the second external electronic device. In one embodiment, the first description may include a detailed description of information related to the operation of the second external electronic device. For example, if the first description is "Movement detected," the second description may be "Movement of a car and a person was detected on the roadway. A total of 3 people were detected."
[0213] An electronic device that receives a notification message from a second external electronic device may, in operation 865, output the received notification message based on an output method for a notification message included in the first message. In one embodiment, the output method for a notification message may be implemented similarly to or substantially identical to that described in FIG. 8a, and thus redundant descriptions may be omitted.
[0214] FIG. 9 is a diagram illustrating a process for providing IoT services in a wireless communication network according to one embodiment.
[0215] Referring to FIG. 9, an electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 2) may configure a notification method for outputting a notification message to inform information related to the operation of a first external electronic device among a plurality of external electronic devices (e.g., the electronic device (102) of FIG. 1 or the external electronic device (220) of FIG. 2 or FIG. 3) registered in an IoT-based service in a wireless communication network (e.g., an IoT network) in operation 900. In one embodiment, the notification method may include a device to output a notification message corresponding to the notification (e.g., a notification output device) and a method for outputting a notification message from the device to output the notification message. In one embodiment, the notification output device may include at least one of a second external electronic device other than the first external electronic device among a plurality of external electronic devices registered in an IoT-based service. In one embodiment, the electronic device may select at least one second external electronic device that outputs a notification message corresponding to a notification among the second external electronic devices, based at least on the type of notification for informing information related to the operation of the first external electronic device, the types of output devices included in the second external electronic devices, the operating states of the second external electronic devices, whether the user is present in a space where an IoT-based service is provided, and the user's biometric information. In one embodiment, the first external electronic device may be any one of a plurality of external electronic devices and may be a device that generates (or creates) a notification (e.g., a notification generating device). The at least one second external electronic device may be a device that outputs (e.g., provides) a notification message corresponding to a notification generated by the first external electronic device among the external electronic devices excluding the first external electronic device among the plurality of external electronic devices (e.g., a notification output device).An electronic device that selects at least one second external electronic device among the second external electronic devices that outputs a notification message corresponding to a notification can set an output method for the notification message based at least on the type of output device included in the at least one second external electronic device. In one embodiment, the output method for the notification message may be related to whether the notification message is output in a visual manner and / or an auditory manner, and the frequency at which the notification message is output.
[0216] In one embodiment, the electronic device may configure a notification method based on a set cycle, when an event occurs (or as needed), or whenever a notification occurs. In one embodiment, the electronic device may configure a notification method whenever a notification occurs from a first external electronic device. In one embodiment, the electronic device may configure a notification method when notifications occur continuously (e.g., when notifications occur more than a threshold number of times). In one embodiment, the electronic device may configure a notification method based on user settings.
[0217] Operation 900 may include operations 901 to 906. In one embodiment, the electronic device may, in operation 901, check the type of notification of the first external electronic device and select at least one second external electronic device that outputs a notification message based on the type of notification of the first external electronic device. The operation of selecting at least one second external electronic device that outputs a notification message based on the type of notification of the first external electronic device may be implemented similarly or substantially identically to that described in FIG. 8a, and thus redundant description thereof may be omitted.
[0218] In one embodiment, the electronic device may, in operation 902, identify a plurality of external electronic devices registered in an IoT-based service (e.g., IoT devices owned by the electronic device) (e.g., second external electronic devices registered in an IoT-based service) and select at least one second external electronic device that outputs a notification message. In one embodiment, operation 902 may be an operation of identifying the types of output devices included in the second external electronic devices registered in the IoT-based service. The operation of selecting at least one second external electronic device that outputs a notification message based on the types of output devices included in the second external electronic devices may be implemented similarly or substantially identically to that described in FIG. 8a, and thus the redundant description thereof may be omitted.
[0219] In one embodiment, the electronic device may, in operation 903, check the states of the second external electronic devices (e.g., the operating states of the second external electronic devices) and, based on the states of the second external electronic devices, select at least one second external electronic device that outputs a notification message. The operation of selecting at least one second external electronic device that outputs a notification message based on the states of the second external electronic devices may be implemented similarly or substantially identically to that described in FIG. 8a, and thus redundant description thereof may be omitted.
[0220] In one embodiment, the electronic device can identify recommended notification methods in operation 904 and finally extract a notification method in operation 906. In one embodiment, the electronic device can adjust (or configure) the notification method based on a set cycle, or when an event occurs (or as needed), or whenever a notification occurs, as in operation 905.
[0221] An electronic device configured to have a notification method for a first external electronic device may, in operation 900, transmit information regarding the configured notification method to at least one second external electronic device. In one embodiment, the electronic device may, in operation 900, transmit a first message to at least one second external electronic device, which includes information indicating that at least one second external electronic device is selected to output a notification message and information related to a method for outputting a notification message. In one embodiment, the information indicating that the device is selected to output a notification message may include the address of the first external electronic device, which is a notification generating device that generates a notification. The operation of the electronic device transmitting the first message to at least one second external electronic device may be implemented similarly to or substantially identical to that described in FIG. 8a, and thus redundant descriptions thereof may be omitted.
[0222] An electronic device configured to provide a notification method for a first external electronic device may, in operation 900, transmit a second message to the first external electronic device that includes information indicating that at least one second external electronic device is selected to output a notification message. In one embodiment, the information indicating that at least one second external electronic device is selected to output a notification message may include an ID identifying at least one second external electronic device. The operation of the electronic device transmitting the second message to the first external electronic device may be implemented similarly or substantially identically to that described in FIG. 8a, and thus redundant descriptions thereof may be omitted.
[0223] Meanwhile, the first external electronic device generating the notification may, in operation 910, transmit a notification message corresponding to the notification to at least one second external electronic device that outputs a notification message corresponding to the notification based on a second message received from the electronic device. In one embodiment, the notification message may include an ID identifying the first external electronic device, a type of notification, a time when the notification occurred, an address of the first external electronic device, information related to the operation of the first external electronic device, and a description of the information related to the operation of the first external electronic device. In one embodiment, the notification message may further include a category of the first external electronic device and a snapshot of the status of surrounding external electronic devices around the first external electronic device. In one embodiment, the category of the first external electronic device may include, for example, a TV, a speaker, an air conditioner, a refrigerator, and / or a washing machine. In one embodiment, the snapshot of the status of surrounding external electronic devices may include information related to the operation status of the surrounding external electronic devices. In one embodiment, the description of information related to the operation of the first external electronic device may include an explanation of the notification of the first external electronic device. The description of information related to the operation of the first external electronic device may include a first description and a second description. In one embodiment, the first description may include an abbreviated description of information related to the operation of the first external electronic device. In one embodiment, the first description may include a detailed description of information related to the operation of the first external electronic device. For example, if the first description is "Movement detected," the second description may be "Movement of a car and a person has been detected on the roadway. A total of 3 people were detected."In one embodiment, the description of information related to the operation of the first external electronic device may further include a third description, and the third description may further include situation information obtained (or collected) by the first external electronic device.
[0224] Operation 910 may include operations 911 to 914. In operation 911, the first external electronic device may identify at least one second external electronic device to output a notification message based on the second message. Even if at least one second external electronic device to output a notification message of the first external electronic device is determined by the electronic device, the first external electronic device may change the device to output the notification message of the first external electronic device as needed, and in this case, may transmit information about the device to output the notification message of the first external electronic device to the electronic device. In one embodiment, in operation 911, the first external electronic device may identify the types of output devices included in at least one second external electronic device to output a notification message. The first external electronic device, having identified the types of output devices included in at least one second external electronic device to output a notification message, may determine the form of information related to the operation of the first external electronic device to be included in the notification message based on the identified types of output devices. For example, information related to the operation of the first external electronic device can be implemented in various forms such as video, audio, and / or images.
[0225] The first external electronic device, which has determined the form of information related to the operation of the first external electronic device to be included in the notification message, may determine the frequency of outputting the notification message based on the second message in operation 912. In one embodiment, the first external electronic device may set the frequency of outputting the notification message above a threshold frequency based on whether the type of notification is an emergency notification including a disaster notification indicating the occurrence of a disaster and a security notification indicating the occurrence of a security-related situation, or a user notification requiring user intervention. For example, in the case of a notification (e.g., user notification) such as a notification generated by an outsider directly operating a switch, such as when a doorbell rings, it may be required to set the frequency of outputting the notification message above a threshold frequency so that the user can recognize the corresponding situation. For example, in the case of a motion detection notification (e.g., security notification), it may be required to set the frequency of outputting the notification message above a threshold frequency so that the user can recognize the corresponding situation. However, even in the case of security notifications such as motion alerts, the frequency at which notification messages are displayed may be further adjusted depending on whether the user is present in the space where the IoT-based service is provided. For example, if the first external electronic device is a cooking device, for notifications where it is important to provide the status of cooked food in the form of an image, such as a cooking completion notification (e.g., user notification), it may be required to set the frequency at which notification messages are displayed above a threshold frequency so that the user can recognize the corresponding situation.
[0226] A first external electronic device that has determined the frequency of outputting a notification message may, in operation 913, determine a method of providing (or displaying or outputting) the notification message based on the second message. In one embodiment, the first external electronic device may determine whether to output (or provide, or display) the notification message in a visual manner and / or output it in an auditory manner. In one embodiment, if the first external electronic device decides to output the notification message in a visual manner, it may output the notification message through a second external electronic device that includes a visual output device (e.g., a display) among the output devices of at least one second external electronic device to output the notification message. If the operating state of the second external electronic device that includes the visual output device is in a sleep state, the first external electronic device may wake up the second external electronic device so that the second external electronic device outputs the notification message visually.
[0227] In one embodiment, when the operating state of the second external electronic device including a visual output device is in a sleep state, the first external electronic device does not need to include visual data (e.g., video, and / or image) corresponding to the notification in the notification message, and therefore the first external electronic device may not include visual data in the notification message. For example, if the device to output the notification message is a TV and the TV is in a sleep state or the TV is powered off, the first external electronic device may generate auditory data (e.g., audio data) and include it in the notification message so that the notification message can be output through another device owned by the user (or registered with an IoT-based service).
[0228] In one embodiment, even though the second message indicates that the notification message is set to be output in a visual manner, the first external electronic device may change the device for outputting the notification message to output the notification message in an auditory manner as needed, and in this case, information about the device for outputting the notification message of the first external electronic device may be transmitted to the electronic device. Alternatively, even though the second message indicates that the notification message is set to be output in an auditory manner, the first external electronic device may change the device for outputting the notification message to output the notification message in a visual manner as needed, and in this case, information about the device for outputting the notification message of the first external electronic device may be transmitted to the electronic device.
[0229] A first external electronic device that has determined a method for providing (or displaying or outputting) a notification message may, in operation 914, determine at least one second external electronic device (e.g., at least one IoT device) to provide (or display or output) a notification message. In one embodiment, the first external electronic device may determine at least one second external electronic device to output a notification message based on the operations performed in operations 911 through 913. Alternatively, the first external electronic device may determine the device that most recently outputted a notification message, a device existing around the first external electronic device, and / or a device set by the user as at least one second electronic device to output a notification message. Alternatively, the first external electronic device may determine other devices owned by the user (or registered with an IoT-based service) sequentially as at least one second electronic device to output a notification message.
[0230] A first external electronic device that has determined at least one second external electronic device to output a notification message may, in operation 920, perform a notification display preparation and determination operation. Operation 920 may include operations 921 through 925. In operation 921, the first external electronic device may determine whether a user (e.g., a member) is present in a space where an IoT-based service is provided. The operation of determining whether a user is present in a space where an IoT-based service is provided may be implemented similarly or substantially identically to that described in FIG. 8a and FIG. 8b, and thus redundant descriptions may be omitted herein.
[0231] In operation 922, the first external electronic device can verify the biometric information of a user (e.g., a member). The operation of verifying the user's biometric information can be implemented similarly or substantially identically to that described in FIG. 8a and FIG. 8b, and thus the redundant description may be omitted here.
[0232] In operation 923, the first external electronic device can finally determine at least one second external electronic device to output a notification message based on whether the user is present in a space where an IoT-based service is provided and the user's biometric information.
[0233] In operation 924, the first external electronic device can determine the output method for the notification message from at least one second external electronic device that is finally selected.
[0234] In operation 925, the first external electronic device may decide to regenerate content for a notification message so that the notification message can be output based on an output method determined by at least one second external electronic device finally selected. For example, if the determined output method is an auditory output method, the notification data generated as an image may be converted into a text form so that it can be output through a speaker and transmitted to at least one second external electronic device finally selected via the notification message. For example, if the determined output method is an auditory output method, the notification data generated as a video clip may be converted into a text form so that it can be output through a speaker and transmitted to at least one second external electronic device finally selected via the notification message.
[0235] FIG. 10 is a diagram illustrating a process for providing IoT services in a wireless communication network according to one embodiment.
[0236] Referring to FIG. 10, the process of providing an IoT service illustrated in FIG. 10 may be implemented similarly to or substantially identical to the process of providing an IoT service described in FIG. 9, and thus the redundant description thereof may be omitted here. However, while FIG. 9 describes the case where operation 910 (or operations 911 to 914) is performed by a first external electronic device as an example, operation 1010 (or operations 1011 to 1014) may be performed by at least one second external electronic device, which is a platform and a notification display device, in addition to the first external electronic device which is a notification generating device, and FIG. 9 describes the case where operation 920 (or operations 921 to 925) is performed by a first external electronic device as an example, operation 1020 (or operations 1021 to 1025) may be performed by at least one second external electronic device, which is a platform and a notification display device, in that respect, it may differ.
[0237] Additionally, since operation 1010 can be performed by at least one second external electronic device, which is a platform and a notification display device, as well as by the first external electronic device, or the platform, or at least one second external electronic device, as in operation 1015, may decide to regenerate content for a notification message so as to output a notification message based on an output method determined by at least one second external electronic device finally selected. For example, if the determined output method is an auditory output method, the notification data generated as an image may be converted into a text form so as to be output through a speaker and transmitted to at least one second external electronic device finally selected via a notification message. For example, if the determined output method is an auditory output method, the notification data generated as a video clip may be converted into a text form so as to be output through a speaker and transmitted to at least one second external electronic device finally selected via a notification message.
[0238] In one embodiment, when displaying extracted notification data, the extracted notification data alone may be insufficient to generate a notification message suitable for the user (e.g., optimal for the user). For example, when initially extracting notification data, the data may be extracted based on image notifications, but in the operation determining the notification display, outputting it as an image notification may not be suitable (e.g., based on currently used IoT devices), and providing the notification message in the form of voice data may be more appropriate. In this case, even if the data was not extracted during the notification generation operation, a data generation operation to display a new type of notification may be performed. In this case, the currently held notification data may be compared with content that needs to support new notification display, and based on the comparison result, data required by the IoT device requiring new support may be generated, or a request may be made to provide the data required by the IoT device requiring new support.
[0239] When a newly supported IoT device generates necessary data, the IoT device may request data analysis from the server or generate necessary data (e.g., data required to provide notification messages) based on its own data analysis logic.
[0240] For example, if it is required to provide a notification message from a speaker device, the notification data received by the speaker device may be an image. For instance, in a situation where a motion detection event occurs at a doorbell, the image may correspond to a scene where a car is parked on the street and two people are walking on the sidewalk. Since the speaker device is a device that does not include a display, it may be impossible to provide notification data in the form of an image to the user. For instance, the speaker device may compare its capabilities with the received image data and determine that it is impossible to provide image-based notification data to the user. In this case, the speaker device can provide the notification message to the user by generating text that describes the image data and converting the generated text back into a notification message in the form of voice data. For instance, the speaker device can analyze the received image data and generate voice data corresponding to the analyzed image data. Then, the speaker device can output the generated voice data in the form of a voice message, for instance, "There is a car parked on the street and two people are walking on the sidewalk."
[0241] In one embodiment, if there are two or more users using an IoT-based service, one user may leave a text message or a voice message to another user. In this case, when processing the text message or voice message on the platform, instead of converting it into content of a configured method, a method of processing the data according to the characteristics of the wireless communication network environment may be provided. In one embodiment, a method of processing data may be provided based on the types of IoT devices existing in the wireless communication network (e.g., TV and / or speaker), whether the IoT devices are display-capable devices, and / or whether the IoT devices include only speakers. In one embodiment, a method of processing data may be provided based on whether a user (or users) using the IoT-based service is using the IoT devices, whether TV content is running, whether the TV is in a sleep state (or idle state) and whether a notification message can be provided (or output) to the speaker. In one embodiment, a method of processing data may be provided based on whether the speaker device is playing a sound source service, or when the speaker device is not playing a sound source. In one embodiment, it can be determined whether to output a message directly through a speaker device based on whether the user is present in a space where an IoT-based service is provided, or to provide notification data in the form of a memo to the speaker device to output a notification message when the user enters a space where an IoT-based service is provided, or to store a message in the speaker device based on whether the user is present in a space where an IoT-based service is provided.
[0242] FIG. 11 is a flowchart schematically illustrating the operation process of a server according to one embodiment.
[0243] Referring to FIG. 11, a server (e.g., the server (108) of FIG. 1 or the server (230) of FIG. 4) (e.g., one or more processors including processing circuitry) (e.g., the processor (404) of FIG. 4)) may provide services related to IoT. In operation 1111, the server may receive a first notification message from a first device (e.g., the electronic device (102) of FIG. 1, the external electronic devices (220) of FIG. 2, or the external electronic device (220) of FIG. 3) located in space, which is associated with a user account registered to a service provided by the server (e.g., an IoT-related service or an IoT-based service) through a communication circuit (e.g., the communication circuit (402) of FIG. 4) in operation 1111. In one embodiment, the first notification message may be a notification message generated by the first device. In one embodiment, the space may include various spaces such as a home and / or an office.
[0244] Upon receiving the first notification message, the server can determine the location of at least one user associated with a user account in operation 1113. In one embodiment, the location of at least one user associated with a user account can be determined through at least one mobile device of at least one user (e.g., the electronic device (101) of FIG. 1 or FIG. 2) or through a set sensor and / or camera. In one embodiment, the server can determine the location of at least one mobile device of at least one user as the location of at least one user. In one embodiment, the server can determine the location of at least one user based on a signal confirmed through a sensor. In one embodiment, the sensor may be located at a set location within the space, and thus the server can determine the set location where the sensor is located as the location of at least one user based on a signal confirmed through the sensor. In one embodiment, the server can determine the location of at least one user based on a signal confirmed through a camera. In one embodiment, the camera may be located at a set location within the space, and thus the server can determine the set location where the sensor is located as the location of at least one user based on a signal confirmed through the camera. In FIG. 11, the location of at least one user is identified through at least one mobile device of at least one user, or through a set sensor and / or camera, as an example, but the method of identifying the location of at least one user may not be limited to this.
[0245] A server that has determined the location of at least one user associated with a user account can determine, in operation 1115, whether at least one user exists in the space.
[0246] If all of at least one user is present in the space (Operation 1115-Example), the server may identify a first candidate device and a second candidate device to output a first notification message in Operation 1117. In one embodiment, at least one of the first candidate device and the second candidate device may be a device other than the first device among one or more devices located in the space, and / or may be separate devices.
[0247] A server that has identified a first candidate device and a second candidate device to output a first notification message may, in operation 1119, cause the first candidate device to output the first notification message. In one embodiment, based on a predetermined priority, the order in which the first candidate device outputs the first notification message may be determined to precede the order in which the second candidate device outputs the first notification message. In one embodiment, the predetermined priority may be based on the order in which devices that are active in the space and connected to the server are activated, or based on the preference of at least one user for devices that are active in the space and connected to the server. In one embodiment, the distances between devices that are active in the space and connected to the server and at least one user may be less than a threshold distance.
[0248] In one embodiment, an operation that causes a first candidate device to output a first notification message may include an operation of setting the frequency at which the first notification message is output above a threshold frequency based on whether the type of notification data included in the first notification message is an emergency notification or a user notification, and an operation that causes the first candidate device to output the first notification message above the threshold frequency. In one embodiment, the emergency notification may include a disaster notification indicating that a disaster has occurred and a security notification indicating that a security-related situation has occurred. In one embodiment, the user notification may include a notification requiring user intervention.
[0249] In one embodiment, the operation of causing the first candidate device to output a first notification message may include, based on the fact that the notification data included in the first notification message is visual notification data and the output device included in the first candidate device includes an auditory type output device, an operation of converting the notification data into auditory notification data including audio data, and an operation of causing the first candidate device to output a first notification message including the converted auditory notification data. In one embodiment, the visual notification data may include image data and / or video data.
[0250] In one embodiment, a first notification message output by a first candidate device may include an identifier for identifying the first candidate device, a type of notification data, a time when the notification data occurred, an address of the first candidate device, and / or a description describing the operation of the first candidate device.
[0251] The electronic device that caused the first candidate device to output the first notification message may, in operation 1121, check whether the first notification message is acknowledged by at least one user within a time period. If the first notification message is acknowledged by at least one user within a time period (operation 1121-yes), the server may, in operation 1123, refrain from causing the second candidate device to output the first notification message. Thus, by refraining from causing the second candidate device to output the first notification message as the first notification message is acknowledged by at least one user within a time period, the case where the first notification message is unnecessarily duplicated can be prevented.
[0252] If the first notification message is not acknowledged by at least one user within a time period (Operation 1121-No), the server may cause the second candidate device to output the first notification message in Operation 1125.
[0253] If at least one user is not present in the space (Operation 1115-No), the server may cause the first notification message to be provided to at least one mobile device of at least one user in Operation 1127. In this case, even though at least one user is not present in the space, the first notification message is output to at least one mobile device of at least one user, so that at least one user may confirm that the first notification message has occurred.
[0254] Additionally, if at least one user is present in the space, the server may identify a third candidate device to output a first notification message among the devices active in the space and connected to the server, based on the biometric information of at least one user, and cause the third candidate device to output the first notification message. In one embodiment, if the biometric information of at least one user indicates that at least one user is exercising, the server may select an auditory type output device among the devices active in the space and connected to the server as the third candidate device.
[0255] In one embodiment, the operation of causing the third candidate device to output the first notification message may include setting the frequency at which the first notification message is output above a threshold frequency based on at least one user's biometric information indicating that at least one user is sleeping and the type of notification data included in the first notification message being an emergency notification or a user notification, and causing the third candidate device to output the first notification message above the threshold frequency. In one embodiment, the emergency notification may include a disaster notification indicating that a disaster has occurred and a security notification indicating that a security-related situation has occurred. In one embodiment, the user notification may include a notification requiring user intervention.
[0256] Additionally, if at least one user is present in the space, the server identifies a device among the devices active in the space and connected to the server that has an output capability designated to output a first notification message as a fourth candidate device to output the first notification message, and may cause the fourth candidate device to output the first notification message. In one embodiment, based on the notification data included in the first notification message being visual notification data including image data and / or video data, the fourth candidate device may include a device including a visual type output device. In one embodiment, based on the notification data included in the first notification message being auditory notification data including audio data, the fourth candidate device may include a device including an auditory type output device.
[0257] According to one embodiment of the present disclosure, a method of an electronic device (101) may include, at least based on the type of notification for announcing information related to the operation of a first external electronic device among a plurality of external electronic devices (102; 220) registered in an internet of things (IoT)-based service, types of output devices included in second external electronic devices other than the first external electronic device among the plurality of external electronic devices, operating states of the second external electronic devices, whether a user is present in a space where the IoT-based service is provided, and biometric information of the user, selecting at least one second external electronic device among the second external electronic devices that outputs a notification message corresponding to the notification.
[0258] According to one embodiment of the present disclosure, the method may set an output method for the notification message based at least on the type of output device included in the at least one second external electronic device, wherein the output method for the notification message may be related to whether the notification message is output in a visual manner and / or an auditory manner, and the frequency at which the notification message is output.
[0259] According to one embodiment of the present disclosure, the method may include the operation of transmitting a first message to the at least one second external electronic device, the first message including information indicating that the at least one second external electronic device is selected to output the notification message and information related to the output method for the notification message.
[0260] According to one embodiment of the present disclosure, the method may include the operation of transmitting a second message to the first external electronic device, the second message including information indicating that the at least one second external electronic device is selected to output the notification message.
[0261] According to one embodiment of the present disclosure, an operation of setting an output method for the notification message based at least on the type of output device included in the at least one second external electronic device may include an operation of setting an output method for the notification message based on the type of output device included in the at least one second external electronic device, the type of the notification, the operating states, whether the user is present in the space where the IoT-based service is provided, and the biometric information of the user.
[0262] According to one embodiment of the present disclosure, an operation to set an output method for a notification message based on the type of output device included in the at least one second external electronic device, the type of the notification, the operating states, whether the user is present in the space where the IoT-based service is provided, and the biometric information of the user may include an operation to set the frequency at which the notification message is output above a threshold frequency based on whether the type of the notification is an emergency notification including a disaster notification indicating that a disaster has occurred and a security notification indicating that a security-related situation has occurred, or a user notification requiring intervention by the user.
[0263] According to one embodiment of the present disclosure, an operation of setting an output method for the notification message based at least on the type of output device included in the at least one second external electronic device may include setting the output method for the notification message to display the notification message through the visual output device based on the type of output device included in the at least one second external electronic device being a visual output device, or setting the output method for the notification message to output the notification message through the auditory output device based on the type of output device included in the at least one second external electronic device being an auditory output device.
[0264] According to one embodiment of the present disclosure, the operating state of the second external electronic device may include a sleep state in which the second external electronic device is not used during a set period and an awake state other than the sleep state.
[0265] According to one embodiment of the present disclosure, the operation of selecting the at least one second external electronic device may include the operation of selecting at least one of the second external electronic devices whose operating state among the second external electronic devices is the awake state as the at least one second external electronic device.
[0266] According to one embodiment of the present disclosure, the operation of selecting the at least one second external electronic device may include selecting the at least one second external electronic device that the user wears or possesses among the second external electronic devices as the at least one second external electronic device, based on the fact that the user is not present in the space where the IoT-based service is provided.
[0267] According to one embodiment of the present disclosure, the operation of selecting the at least one second external electronic device may include selecting at least one of the second external electronic devices, wherein the type of the output device among the second external electronic devices is an auditory output device, as the at least one second external electronic device, based on the fact that the user is present in a space where the IoT-based service is provided and the user's biometric information indicates that the user is exercising.
[0268] According to one embodiment of the present disclosure, an operation to set an output method for the notification message based on the type of output device included in the at least one second external electronic device, the type of the notification, the operating states, whether the user is present in the space where the IoT-based service is provided, and the user's biometric information may include an operation to set the frequency at which the notification message is output above a threshold frequency based on the user's biometric information indicating that the user is sleeping and the type of the notification being an emergency notification including a disaster notification indicating that a disaster has occurred and a security notification indicating that a security-related situation has occurred, or a user notification requiring the user's intervention.
[0269] According to one embodiment of the present disclosure, the notification message may include an identifier (ID) identifying the at least one second external electronic device, a type of the notification, a time when the notification occurred, an address of the first external electronic device, information related to the operation of the first external electronic device, and a description of the information related to the operation of the first external electronic device.
[0270] According to one embodiment of the present disclosure, the method may include, after transmitting the second message, receiving a third message from the first external electronic device, the third message including information indicating that the at least one second external electronic device outputting the notification message has been changed, and information related to the changed at least one second external electronic device.
[0271] According to one embodiment of the present disclosure, a method of an electronic device (102; 220) may include receiving a first message from a first external electronic device (101) that includes information indicating that the electronic device is selected to output a notification message corresponding to a notification for announcing information related to the operation of a second external electronic device among a plurality of external electronic devices (102; 220) registered in an internet of things (IoT)-based service and information related to a method of outputting the notification message, wherein the method of outputting the notification message may be related to whether the notification message is output in a visual manner and / or an auditory manner, and the frequency at which the notification message is output.
[0272] According to one embodiment of the present disclosure, the method may include the operation of receiving the notification message from the second external electronic device.
[0273] According to one embodiment of the present disclosure, the method may include an operation of outputting the received notification message based on an output method for the notification message.
[0274] According to one embodiment of the present disclosure, the type of the notification, the types of output devices included in the third external electronic devices other than the second external electronic device among the plurality of external electronic devices, and the operating states of the third external electronic devices and the electronic device, whether a user is present in a space where the IoT-based service is provided, and at least based on the user's biometric information, the electronic device among the third external electronic devices and the electronic device may be selected to output the notification message.
[0275] According to one embodiment of the present disclosure, the output method for the notification message may be set based at least on the type of output device included in the electronic device.
[0276] According to one embodiment of the present disclosure, the output method for the notification message may be set based on the type of output device included in the electronic device, the type of the notification, the operating states, whether the user is present in the space where the IoT-based service is provided, and the user's biometric information.
[0277] According to one embodiment of the present disclosure, the frequency at which the notification message is output may be set to be greater than or equal to a threshold frequency, based on whether the type of notification is an emergency notification including a disaster notification indicating the occurrence of a disaster and a security notification indicating the occurrence of a security-related situation, or a user notification requiring user intervention.
[0278] According to one embodiment of the present disclosure, based on the type of output device included in the electronic device being a visual output device, the output method for the notification message is configured to display the notification message through the visual output device, or based on the type of output device included in the electronic device being an auditory output device, the output method for the notification message may be configured to output the notification message through the auditory output device.
[0279] According to one embodiment of the present disclosure, the operating state of the electronic device includes a sleep state in which the electronic device is not used for a set period and an awake state other than the sleep state, and based on the operating state of the electronic device being the awake state, the electronic device may be selected to output the notification message.
[0280] According to one embodiment of the present disclosure, the electronic device may be selected to output the notification message based on the fact that the user is wearing or carrying the electronic device and the user is not present in the space where the IoT-based service is provided.
[0281] According to one embodiment of the present disclosure, the type of output device included in the electronic device is an auditory output device, and the electronic device may be selected to output the notification message based on the fact that the user is present in a space where the IoT-based service is provided and the user's biometric information indicates that the user is exercising.
[0282] According to one embodiment of the present disclosure, the frequency at which the notification message is output may be set to be greater than or equal to a threshold frequency, based on the fact that the user's biometric information indicates that the user is sleeping and the type of notification is an emergency notification including a disaster notification indicating that a disaster has occurred and a security notification indicating that a security-related situation has occurred, or a user notification requiring the user's intervention.
[0283] According to one embodiment of the present disclosure, the notification message may include an identifier (ID) identifying the electronic device, a type of the notification, a time when the notification occurred, an address of the second external electronic device, information related to the operation of the second external electronic device, and a description of the information related to the operation of the second external electronic device.
[0284] According to one embodiment of the present disclosure, a method of a server (108; 230) providing a service related to the Internet of Things (IoT) may include receiving a first notification message from a first device among one or more devices (102; 220) located in space that are associated with a user account registered to the service provided by the server.
[0285] According to one embodiment of the present disclosure, the method may include an operation to determine the location of at least one user associated with the user account based on the reception of the first notification message.
[0286] According to one embodiment of the present disclosure, if all of the at least one users are not present in the space, the first notification message may be provided to at least one mobile device of all of the at least one users.
[0287] According to one embodiment of the present disclosure, the method may include, when the at least one user is present in the space, identifying a first candidate device and a second candidate device to output the first notification message among devices that are active in the space and connected to the server, based on the type of the first notification message.
[0288] According to one embodiment of the present disclosure, the method may include an operation that causes the first candidate device to output the first notification message when the at least one user is present in the space.
[0289] According to one embodiment of the present disclosure, the method may include an operation of refraining from causing the second candidate device to output the first notification message when the first notification message is acknowledged by the at least one user within a time period.
[0290] According to one embodiment of the present disclosure, the method may include an operation that causes the second candidate device to output the first notification message if the first notification message is not acknowledged by the at least one user within the time period.
[0291] According to one embodiment of the present disclosure, based on a predetermined priority, the order in which the first candidate device outputs the first notification message may be determined to precede the order in which the second candidate device outputs the first notification message.
[0292] According to one embodiment of the present disclosure, the predetermined priority may be based on the order in which the devices that are activated and connected to the server in the space are activated, or on the preference of at least one user for the devices that are activated and connected to the server in the space.
[0293] According to one embodiment of the present disclosure, the method may further include: identifying a third candidate device to output the first notification message among the devices that are activated and connected to the server in the space, based on the biometric information of the at least one user when the at least one user is present in the space; and causing the third candidate device to output the first notification message.
[0294] According to one embodiment of the present disclosure, based on the biometric information of the at least one user indicating that the at least one user is exercising, an auditory type output device among the devices that are activated and connected to the server in the space may be selected as the third candidate device.
[0295] According to one embodiment of the present disclosure, the operation of causing the first candidate device to output the first notification message may include, based on the type of notification data included in the first notification message being an emergency notification or a user notification, setting the frequency at which the first notification message is output above a threshold frequency, - wherein the emergency notification includes a disaster notification indicating that a disaster has occurred and a security notification indicating that a security-related situation has occurred, and the user notification includes a notification requiring user intervention - and the operation of causing the first candidate device to output the first notification message above the threshold frequency.
[0296] According to one embodiment of the present disclosure, the operation of causing the third candidate device to output the first notification message may include: setting the frequency at which the first notification message is output at a threshold frequency or higher based on the biometric information of the at least one user indicating that the at least one user is sleeping and the type of notification data included in the first notification message being an emergency notification or a user notification, - wherein the emergency notification includes a disaster notification indicating that a disaster has occurred and a security notification indicating that a security-related situation has occurred, and the user notification includes a notification requiring user intervention - and the operation of causing the third candidate device to output the first notification message at a threshold frequency or higher.
[0297] According to one embodiment of the present disclosure, the operation of causing the first candidate device to output the first notification message may include, based on the fact that the notification data included in the first notification message is visual notification data and the output device included in the first candidate device includes an auditory type output device, the operation of converting the notification data into auditory notification data including audio data—wherein the visual notification data includes image data and / or video data—and the operation of causing the first candidate device to output the first notification message including the converted auditory notification data.
[0298] According to one embodiment of the present disclosure, the first notification message output by the first candidate device may include an identifier for identifying the first candidate device, a type of the notification data, a time when the notification data occurred, an address of the first candidate device, and / or a description describing the operation of the first candidate device.
[0299] According to one embodiment of the present disclosure, the method may further include, when at least one user is present in the space, identifying a device having an output capability designated to output the first notification message among the devices that are activated and connected to the server in the space as a fourth candidate device to output the first notification message, and causing the fourth candidate device to output the first notification message.
[0300] According to one embodiment of the present disclosure, based on the fact that the notification data included in the first notification message is visual notification data including image data and / or video data, the fourth candidate device may include a device including a visual type output device.
[0301] According to one embodiment of the present disclosure, based on the fact that the notification data included in the first notification message is auditory notification data including audio data, the fourth candidate device may include an auditory type output device.
[0302] According to one embodiment of the present disclosure, the distances between the devices that are activated and connected to the server in the space and the at least one user may be less than a threshold distance.
[0303] According to one embodiment of the present disclosure, the location of the at least one user may be determined through the at least one moving device, or a set sensor and / or camera.
[0304] According to one embodiment of the present disclosure, a storage medium is provided for storing at least one instruction readable by a computer, and said at least one instruction may cause said electronic device to perform at least one operation when executed individually or collectively by one or more processors (120) including processing circuitry of an electronic device (101).
[0305] According to one embodiment of the present disclosure, the at least one operation may include, based at least on the type of notification for announcing information related to the operation of a first external electronic device among a plurality of external electronic devices (102; 220) registered in an Internet of Things (IoT) based service, types of output devices included in second external electronic devices other than the first external electronic device among the plurality of external electronic devices, operating states of the second external electronic devices, whether a user is present in a space where the IoT based service is provided, and biometric information of the user, an operation of selecting at least one second external electronic device among the second external electronic devices that outputs a notification message corresponding to the notification.
[0306] According to one embodiment of the present disclosure, the at least one operation includes an operation of setting an output method for the notification message based at least on the type of output device included in the at least one second external electronic device, wherein the output method for the notification message may be related to whether the notification message is output in a visual manner and / or an auditory manner, and the frequency at which the notification message is output.
[0307] According to one embodiment of the present disclosure, the at least one operation may include the operation of transmitting a first message to the at least one second external electronic device, the first message including information indicating that the at least one second external electronic device is selected to output the notification message and information related to the output method for the notification message.
[0308] According to one embodiment of the present disclosure, the at least one operation may include the operation of transmitting a second message to the first external electronic device, the second message including information indicating that the at least one second external electronic device is selected to output the notification message.
[0309] According to one embodiment of the present disclosure, a storage medium for storing at least one instruction readable by a computer may be provided.
[0310] According to one embodiment of the present disclosure, the at least one instruction may cause the server to perform at least one operation when executed individually or collectively by one or more processors (404) including the processing circuitry of the server (108; 230).
[0311] According to one embodiment of the present disclosure, the at least one operation may include receiving a first notification message from a first device among one or more devices (102; 220) located in space associated with a user account registered to a service provided by the server.
[0312] According to one embodiment of the present disclosure, the at least one operation may include an operation to determine the location of at least one user associated with the user account based on the reception of the first notification message.
[0313] According to one embodiment of the present disclosure, if all of the at least one users are not present in the space, the first notification message may be provided to at least one mobile device of all of the at least one users.
[0314] According to one embodiment of the present disclosure, the at least one operation may include, when the at least one user is present in the space, identifying a first candidate device and a second candidate device to output the first notification message among the devices that are active in the space and connected to the server, based on the type of the first notification message.
[0315] According to one embodiment of the present disclosure, the at least one operation may include an operation that causes the first candidate device to output the first notification message.
[0316] According to one embodiment of the present disclosure, the at least one operation may include an operation of refraining from causing the second candidate device to output the first notification message when the first notification message is acknowledged by the at least one user within a time period.
[0317] According to one embodiment of the present disclosure, the at least one operation may include an operation that causes the second candidate device to output the first notification message if the first notification message is not acknowledged by the at least one user within the time period.
[0318] The electronic device according to one embodiment disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. The electronic device according to the embodiment of this document is not limited to the aforementioned devices.
[0319] One embodiment of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.
[0320] The term "module" as used in an embodiment of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to an embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0321] One embodiment of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.
[0322] According to one embodiment, the method according to one embodiment disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0323] According to one embodiment, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to one embodiment, one or more of the components or operations among the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to one embodiment, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. A method of a server (108; 230) providing services related to the Internet of Things (IoT), The operation of receiving a first notification message from a first device among one or more devices (102; 220) located in space associated with a user account registered to a service provided by the server above; An operation to determine the location of at least one user associated with the user account based on the reception of the first notification message; If all of the above at least one user are not present in the space, the first notification message is provided to at least one mobile device of all of the above at least one user, and If at least one user is present in the space: An operation to identify a first candidate device and a second candidate device to output the first notification message among devices that are active in the space and connected to the server, based on the type of the first notification message. An operation that causes the first candidate device to output the first notification message, and An operation to refrain from causing the second candidate device to output the first notification message when the first notification message is confirmed by the at least one user within a time period, and The method comprising an operation that causes the second candidate device to output the first notification message if the first notification message is not acknowledged by the at least one user within the time period.
2. In Paragraph 1, The method in which, based on a predetermined priority, the order in which the first candidate device outputs the first notification message is determined to precede the order in which the second candidate device outputs the first notification message.
3. In Paragraph 2, The above predetermined priority is: The method based on the order in which the devices activated and connected to the server in the space are activated, or based on the preference of at least one user for the devices activated and connected to the server in the space.
4. In Paragraph 1, If at least one user is present in the space: An operation to identify a third candidate device to output the first notification message among the devices that are activated and connected to the server in the space, based on the biometric information of at least one user; and The above third candidate device further includes an operation that causes the above first notification message to be output, and A method in which an auditory type output device among the devices that are activated and connected to the server in the space is selected as the third candidate device based on the biometric information of at least one user indicating that the at least one user is exercising.
5. In Paragraph 1, The action that causes the first candidate device to output the first notification message is: An operation to set the frequency at which the first notification message is output above a threshold frequency, based on whether the type of notification data included in the first notification message is an emergency notification or a user notification, - where the emergency notification includes a disaster notification indicating the occurrence of a disaster and a security notification indicating the occurrence of a security-related situation, and the user notification includes a notification requiring user intervention - ; and The method comprising an operation that causes the first candidate device to output the first notification message at a frequency greater than the threshold frequency.
6. In Paragraph 4, The action that causes the third candidate device to output the first notification message is: An operation to set the frequency at which the first notification message is output above a threshold frequency, based on the biometric information of at least one user indicating that the at least one user is sleeping and the type of notification data included in the first notification message being an emergency notification or a user notification, - where the emergency notification includes a disaster notification indicating that a disaster has occurred and a security notification indicating that a security-related situation has occurred, and the user notification includes a notification requiring user intervention - ; and The method comprising an operation that causes the third candidate device to output the first notification message at a frequency greater than the threshold frequency.
7. In any one of paragraphs 1 through 4, The action that causes the first candidate device to output the first notification message is: Based on the fact that the notification data included in the first notification message is visual notification data and the output device included in the first candidate device includes an auditory type output device, the operation of converting the notification data into auditory notification data including audio data - where the visual notification data includes image data and / or video data - ; and The method comprising an operation that causes the first candidate device to output the first notification message containing the converted auditory notification data.
8. In Paragraph 7, The first notification message output by the first candidate device is: Identifier for identifying the above-mentioned first candidate device, Type of the above notification data, The time when the above notification data occurred, The address of the first candidate device, and / or The method comprising a description explaining the operation of the first candidate device.
9. In Paragraph 1, If at least one user is present in the space: An operation of identifying a device having an output performance designated to output the first notification message among the devices that are activated and connected to the server in the above space as a fourth candidate device to output the first notification message; and The above-mentioned fourth candidate device further includes an operation that causes the above-mentioned first notification message to be output, and Based on the fact that the notification data included in the first notification message is visual notification data including image data and / or video data, the fourth candidate device includes a device including a visual type output device, or Based on the fact that the notification data included in the first notification message is auditory notification data including audio data, the method comprises a device including an auditory type output device, wherein the fourth candidate device is an auditory type output device.
10. In any one of paragraphs 1 through 9, The method wherein the distances between the devices that are activated and connected to the server in the above space and the at least one user are less than a threshold distance.
11. In any one of paragraphs 1 through 10, The method wherein the location of at least one user is confirmed through at least one mobile device, or a set sensor and / or camera.
12. In a server (108; 230) that provides services related to the Internet of Things (IoT), Communication circuit (402); One or more processors (404) including processing circuitry; and The server includes a memory (406) for storing instructions, and when the instructions are executed individually or collectively by one or more processors: Through the communication circuit above, a first notification message is received from a first device among one or more devices (102; 220) located in space that are associated with a user account registered to a service provided by the server, and Based on the reception of the first notification message, the location of at least one user associated with the user account is determined, and If all of the above at least one user are not present in the space, the first notification message is provided to at least one mobile device of all of the above at least one user, and If at least one user is present in the space: Based on the type of the first notification message, among the devices that are active in the space and connected to the server, a first candidate device and a second candidate device to output the first notification message are identified, and The first candidate device causes the first notification message to be output, and If the first notification message is confirmed by at least one user within a time period, the second candidate device is prevented from causing the first notification message to be output, and The server that causes the second candidate device to output the first notification message if the first notification message is not acknowledged by the at least one user within the time period.
13. In Paragraph 12, When the above instructions are executed individually or collectively by the one or more processors, the server: If at least one user is present in the space: Based on the biometric information of at least one user, a third candidate device to output the first notification message among the devices that are activated and connected to the server in the space is identified, and The above third candidate device causes the output of the above first notification message, and A server in which an auditory type output device among the devices that are activated and connected to the server in the space is selected as the third candidate device, based on the biometric information of at least one user indicating that the at least one user is exercising.
14. In Paragraph 12, When the above instructions are executed individually or collectively by the one or more processors, the server, as at least as part of an operation that causes the first candidate device to output the first notification message: Based on the type of notification data included in the first notification message being an emergency notification or a user notification, the frequency at which the first notification message is output is set to be greater than or equal to a threshold frequency, - where the emergency notification includes a disaster notification indicating the occurrence of a disaster and a security notification indicating the occurrence of a security-related situation, and the user notification includes a notification requiring user intervention - and The server that causes the first candidate device to output the first notification message at a frequency greater than the threshold frequency.
15. In a storage medium storing at least one instruction readable by a computer, When the above at least one instruction is executed individually or collectively by one or more processors (404) including the processing circuitry of the server (108; 230), the server causes the server to perform at least one operation, and The above at least one operation is: The operation of receiving a first notification message from a first device among one or more devices (102; 220) located in space associated with a user account registered to a service provided by the server above; An operation to determine the location of at least one user associated with the user account based on the reception of the first notification message; If all of the above at least one user are not present in the space, the first notification message is provided to at least one mobile device of all of the above at least one user, and If at least one user is present in the space: An operation to identify a first candidate device and a second candidate device to output the first notification message among devices that are active in the space and connected to the server, based on the type of the first notification message. An operation that causes the first candidate device to output the first notification message, and An operation to refrain from causing the second candidate device to output the first notification message when the first notification message is confirmed by the at least one user within a time period, and The storage medium including an operation that causes the second candidate device to output the first notification message if the first notification message is not acknowledged by the at least one user within the time period.