Electronic device and control method thereof

Abstract

An electronic device is disclosed. The electronic device includes: a display; a sensor; the transportation device is used for moving the electronic device; a memory storing at least one instruction; and one or more processors connected to the display, the sensor, the transport device, and the memory, in which the at least one instruction, when executed by at least one processor, causes the electronic device to identify a setting state of a no-disturbing mode for each of a plurality of users using the electronic device, and when a pre-configured event occurs, executing an operation corresponding to the event for the user who does not set the no-disturbing mode.

Description

TECHNICAL FIELD

[0001] The disclosure relates to an electronic device and a control method thereof. More particularly, the disclosure relates to an electronic device in which a do-not-disturb mode can be set for each user and a control method thereof. BACKGROUND

[0002] Recently, an electronic device can provide various services. However, according to circumstances, an operation in a service providing process can become a disturbance to a user, and thus a setting of a do-not-disturb mode (or a stop of a notification) is supported.

[0003] However, since such a do-not-disturb mode is applied in a device unit, it is difficult to perform an appropriate operation in a case where a plurality of users use one device.

[0004] The above information is presented as background information only to assist with an understanding of the disclosure. No determination has been made, and no assertion is made, as to whether any of the above might be applicable as prior art with regard to the disclosure. SUMMARY

[0005] TECHNICAL SOLUTION Aspects of the disclosure are to address at least the above-mentioned problems and / or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the disclosure is to provide an electronic device in which a do-not-disturb mode can be set for each user and a control method thereof.

[0006] Additional aspects will be set forth in part in the description which follows, and in part will become apparent to those skilled in the art upon examination of the following description and / or can be learned by practice of the presented embodiments.

[0007] According to an aspect of the disclosure, an electronic device is provided. The electronic device includes a display, a sensor, a movement device that moves the electronic device, a memory that stores at least one instruction, and at least one processor connected with the display, the sensor, the movement device, and the memory, wherein the at least one instruction, when executed by the at least one processor, causes the electronic device to identify a setting state of a do-not-disturb mode for each of a plurality of users using the electronic device, and based on a predetermined event occurrence, perform an operation corresponding to the event for a user for which the do-not-disturb mode is not set.

[0008] The at least one processor can perform the operation corresponding to the event in the do-not-disturb mode based on identifying a user for which the do-not-disturb mode is set around the electronic device.

[0009] The at least one processor can control the mobile device such that the electronic device moves to a surrounding of a first user based on an event of providing an image to the first user for which a do-not-disturb mode is not set, and control the display to display an image corresponding to the event.

[0010] The at least one processor can control the mobile device such that the electronic device moves to a position in a surrounding area of the first user that does not fall under a gaze area of a second user for which a do-not-disturb mode is set based on identifying that the second user is located within a predetermined distance.

[0011] The electronic device further includes a speaker, and the at least one processor can control the mobile device such that the electronic device moves to a surrounding of a first user for which a do-not-disturb mode is not set based on an event of providing predetermined information to the user, and control the speaker to output a sound corresponding to the event.

[0012] The at least one processor can reduce an output volume of a sound corresponding to the event based on identifying that a second user for which a do-not-disturb mode is set is located within a predetermined distance, and control the speaker to output the sound corresponding to the event at the reduced output volume.

[0013] The at least one processor can determine the output volume based on a distance from the second user, and control the display to display visual information corresponding to the sound to be output based on the determined output volume being lower than an identifiable volume of the first user.

[0014] The at least one processor can control the mobile device such that the electronic device moves to a surrounding of a first user based on an event of moving to the surrounding of the first user for which a do-not-disturb mode is not set, and control the mobile device such that the electronic device moves in a movement route that pulls away from a second user for which a do-not-disturb mode is set by a predetermined distance based on identifying the second user during the moving.

[0015] The at least one processor can set a movement route for moving to a surrounding of a first user based on an event of moving to the surrounding of the first user for which a do-not-disturb mode is not set, and control the mobile device such that the electronic device moves along the set movement route, and in a section of the movement route in which a distance from a second user for which a do-not-disturb mode is set becomes within a predetermined distance, control the mobile device such that the electronic device moves by reducing a moving speed of the electronic device.

[0016] The at least one processor can obtain a gaze area of a second user, and set a movement route such that the movement route is not included in the gaze area.

[0017] The electronic device further includes a microphone, and the sensor includes a camera, and the at least one processor can identify a speaker by using a voice input through the microphone and an image photographed through the camera, and set a do-not-disturb mode for the identified speaker or a user included in the voice command based on the input voice command.

[0018] The sensor includes a camera, and the at least one processor can identify a user by using an image photographed through the camera, and set a do-not-disturb mode for the identified user based on a posture of the user being a predetermined posture.

[0019] The electronic device further includes a communication device that communicates with a user terminal device, and the at least one processor receives setting information related to a do-not-disturb mode for a user of the user terminal device from the user terminal device, and sets a do-not-disturb mode for the user based on the received setting information.

[0020] The setting information related to the do-not-disturb mode includes information on whether to apply the do-not-disturb mode for each of a plurality of types of notifications.

[0021] The electronic device further includes a communication device that communicates with a user terminal device, and identifies a distance to the user terminal device and a user of the user terminal device, and performs an operation of the electronic device in a do-not-disturb mode based on the user of the user terminal device being a user for which a do-not-disturb mode is set and the distance to the user terminal device being within a predetermined distance.

[0022] The memory includes map information of a space in which the electronic device is located, and the at least one processor identifies a space in which a user for which a do-not-disturb mode is set is located among a plurality of spaces in the map, and operates in a do-not-disturb mode in the space in which the user for which the do-not-disturb mode is set is located.

[0023] The at least one processor can control the display so that, based on a volume or an image corresponding to a do-not-disturb mode being displayed to a first user for which a do-not-disturb mode is not set, information that a user for which a do-not-disturb mode is set is located around is displayed.

[0024] The at least one processor can control the display so that, based on a user for which a do-not-disturb mode is set approaching the electronic device within a predetermined distance, a user interface window that asks to release the do-not-disturb mode is displayed.

[0025] According to another aspect of the disclosure, a control method of a movable electronic device is provided. The control method includes storing settings of a do-not-disturb mode for each of a plurality of users using the movable electronic device, and based on a predetermined event occurring, performing an operation corresponding to the event for a first user for which the do-not-disturb mode is not set, and while performing the operation corresponding to the event, based on a second user for which the do-not-disturb mode is set being recognized around the electronic device, performing the operation corresponding to the event in the do-not-disturb mode.

[0026] According to another aspect of the disclosure, one or more non-transitory computer-readable recording media storing one or more computer programs including computer executable instructions that, when executed by one or more processors of the movable electronic device, alone or in combination, cause the movable electronic device to perform operations is provided. The operations include storing settings of a do-not-disturb mode for each of a plurality of users using the electronic device, and based on a predetermined event occurring, performing an operation corresponding to the event for a first user for which the do-not-disturb mode is not set, and while performing the operation corresponding to the event, based on a second user for which the do-not-disturb mode is set being recognized around the electronic device, performing the operation corresponding to the event in the do-not-disturb mode.

[0027] Other aspects, advantages, and salient features of the disclosure will become apparent to those skilled in the art from the following detailed description, taken in conduction with the accompanying drawings. BRIEF DESCRIPTION OF DRAWINGS

[0028] The above and other aspects, features, and advantages of certain embodiments of the disclosure will be more apparent from the following description taken in conjunction with the accompanying drawings, in which: Figure 1 is a diagram for illustrating an operation of an electronic device according to an embodiment of the disclosure; Figure 2 is a diagram for illustrating a form of an electronic device according to an embodiment of the disclosure; Figure 3 is a block diagram for illustrating a configuration of an electronic device according to an embodiment of the disclosure; Figure 4 is a block diagram for illustrating a configuration of an electronic device according to an embodiment of the disclosure; Figure 5 is a diagram illustrating an example of a user interface window for setting a do-not-disturb mode according to an embodiment of the disclosure; Figure 6 is a diagram illustrating an operation of an electronic device in a case where some of a plurality of users set a do-not-disturb mode according to an embodiment of the disclosure; Figure 7 is a diagram for illustrating a moving operation of an electronic device in a case where some of a plurality of users set a do-not-disturb mode according to an embodiment of the present disclosure; Figure 8 is a diagram for illustrating a moving operation of an electronic device in a case where some of a plurality of users set a do-not-disturb mode according to an embodiment of the present disclosure; Figure 9 is a diagram for illustrating a moving operation of an electronic device in a case where some of a plurality of users set a do-not-disturb mode according to an embodiment of the present disclosure; Figure 10 is a diagram for illustrating a display operation of an electronic device in a case where some of a plurality of users set a do-not-disturb mode according to an embodiment of the present disclosure; Figure 11 is a diagram for illustrating a moving operation of an electronic device in a case where some of a plurality of users set a do-not-disturb mode according to an embodiment of the present disclosure; Figure 12 is a diagram for illustrating a display operation of an electronic device in a case where some of a plurality of users set a do-not-disturb mode according to an embodiment of the present disclosure; Figure 13 is a diagram for illustrating a display operation of an electronic device in a case where some of a plurality of users set a do-not-disturb mode according to an embodiment of the present disclosure; Figure 14 is a diagram for illustrating a moving operation of an electronic device in a case where some of a plurality of users set a do-not-disturb mode according to an embodiment of the present disclosure; Figure 15 is a diagram for illustrating a moving operation of an electronic device in a case where some of a plurality of users set a do-not-disturb mode according to an embodiment of the present disclosure; Figure 16 is a diagram for illustrating a user recognition operation according to an embodiment of the present disclosure; Figure 17 is a diagram for illustrating an example of a method of releasing a do-not-disturb mode according to an embodiment of the present disclosure; Figure 18 is a diagram for illustrating an example of a method of releasing a do-not-disturb mode according to an embodiment of the present disclosure; Figure 19 is a diagram for illustrating an example of a user interface window displaying a state of a do-not-disturb mode for each user according to an embodiment of the present disclosure; Figure 20 is a diagram for illustrating an example of a method of releasing a do-not-disturb mode according to an embodiment of the present disclosure; Figure 21This is an illustration of an example of a user interface window that notifies another person of the state of a Do Not Disturb mode according to an embodiment of this disclosure; Figure 22 This is an illustration of an example of a user interface window for setting a do-not-disturb mode according to an embodiment of the present disclosure; Figure 23 This is a diagram illustrating a control method for an electronic device according to an embodiment of the present disclosure; Figure 24 This is a flowchart illustrating the display operation in Do Not Disturb mode according to embodiments of the present disclosure; Figure 25 This is a flowchart illustrating the setting state of changing the Do Not Disturb mode according to embodiments of the present disclosure; and Figure 26 This is a flowchart illustrating the driving operation in Do Not Disturb mode according to an embodiment of the present disclosure.

[0029] Throughout the accompanying drawings, the same reference numerals are used to denote the same elements. Detailed Implementation

[0030] The following description, with reference to the accompanying drawings, is provided to aid in a full understanding of the various embodiments of this disclosure as defined by the claims and their equivalents. It includes various specific details to aid understanding, but these details should be considered exemplary only. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the various embodiments described herein without departing from the scope and spirit of this disclosure. Furthermore, for clarity and brevity, descriptions of well-known functions and constructions may be omitted.

[0031] The terms and words used in the following description and claims are not limited to their literal meaning, but are used by the inventors only to enable a clear and consistent understanding of this disclosure. Therefore, it will be clear to those skilled in the art that the following description, which provides various embodiments of this disclosure, is for illustrative purposes only and is not intended to limit the purpose of this disclosure as defined by the appended claims and their equivalents.

[0032] It will be understood that, unless the context explicitly indicates otherwise, the singular forms “a,” “an,” and “the” include plural references. Thus, for example, a reference to “component surface” includes a reference to one or more such surfaces.

[0033] Furthermore, detailed explanations of known functions or features in determining the embodiments may unnecessarily obscure the spirit of this disclosure, such detailed explanations will be omitted.

[0034] Furthermore, the following embodiments can be modified in various different forms, and the scope of the technical concept of this disclosure is not limited to the following embodiments. Rather, these embodiments are provided to make this disclosure more thorough and complete, and to fully convey the technical concept of this disclosure to those skilled in the art.

[0035] Furthermore, the terminology used in this disclosure is for the purpose of explaining particular embodiments only and is not intended to limit the scope of this disclosure. Additionally, singular expressions include plural expressions unless clearly defined differently in the context.

[0036] Furthermore, in this disclosure, expressions such as “have,” “may have,” “include,” and “may include” indicate the presence of such characteristics (e.g., elements such as numbers, functions, operations, and components), and do not exclude the presence of additional characteristics.

[0037] In addition, in this disclosure, expressions such as “A or B”, “at least one of A and / or B” or “one or more of A and / or B” can include all possible combinations of the listed items. For example, “A or B”, “at least one of A and B” or “at least one of A or B” can refer to all of the following cases: (1) including at least one A, (2) including at least one B, or (3) including at least one A and at least one B.

[0038] Furthermore, the expressions “first,” “second,” etc., used in this disclosure can describe various elements regardless of any order and / or importance. Moreover, these expressions are used only to distinguish one element from another and are not intended to limit the elements.

[0039] Furthermore, the description of an element (e.g., a first element) being "(operably or communicatively) coupled to" or "being coupled to" another element (e.g., a second element) in this disclosure should be interpreted as including cases where an element is directly coupled to another element and cases where an element is coupled to another element through yet another element (e.g., a third element).

[0040] Conversely, a description that an element (e.g., the first element) is "directly coupled" or "directly connected" to another element (e.g., the second element) can be interpreted as implying that there is no other element (e.g., the third element) between the two elements.

[0041] Furthermore, as appropriate, the expression “configured as” as used in this disclosure may be used interchangeably with other expressions such as “suitable for,” “capable of,” “designed for,” “suitable for,” “manufactured as,” and “capable of.” Additionally, the term “configured as” does not necessarily mean that the device is “specifically designed for” in terms of hardware.

[0042] Conversely, in some cases, the phrase "a device configured to..." can mean that the device is "capable" of performing operations together with another device or component. For example, the phrase "a processor configured to perform A, B, and C" can refer to a dedicated processor (e.g., an embedded processor) for performing the respective operations, or a general-purpose processor (e.g., a CPU or application processor) that can perform the respective operations by executing one or more software programs stored in a memory device.

[0043] Furthermore, in embodiments of this disclosure, a "module" or "component" may perform at least one function or operation and may be implemented as hardware or software, or as a combination of hardware and software. In addition to "modules" or "components" that need to be implemented as specific hardware, multiple "modules" or "components" may be integrated into at least one module and implemented as at least one processor.

[0044] Furthermore, operations performed by modules, programs, or other components according to various embodiments may be performed sequentially, in parallel, repeatedly, or heuristically. Alternatively, at least some of the operations may be performed in a different order or omitted, or other operations may be added.

[0045] Furthermore, various elements and areas in the accompanying drawings are shown schematically. Therefore, the technical concept of this disclosure is not limited to the relative dimensions or spacing shown in the drawings.

[0046] Furthermore, electronic devices according to various embodiments of this disclosure may include at least one of, for example, a smartphone, a tablet PC, a desktop PC, or a laptop PC.

[0047] Furthermore, in some embodiments, the electronic device may include, for example, a television, a digital video disc (DVD) player, a stereo, a refrigerator, an air conditioner, a vacuum cleaner, an oven, a microwave oven, a washing machine, an air purifier, a robotic cleaner, a set-top box, a home automation control panel, a security control panel, or a media box (e.g., Samsung HomeSync). TM Apple TV TM or Google TV TM ), game consoles (e.g., Xbox) TM PlayStation TM ( ), at least one of the following: electronic dictionary, electronic key, camera, or electronic photo frame.

[0048] In the following, embodiments according to the present disclosure will be described in detail with reference to the accompanying drawings, so that those skilled in the art to which this disclosure pertains can readily implement the disclosure.

[0049] It should be understood that the boxes and combinations of flowcharts in each flowchart can be executed by one or more computer programs including instructions. One or more computer programs can be stored entirely in a single memory device, or one or more computer programs can be divided into different parts stored in multiple different memory devices.

[0050] Any function or operation described herein may be processed by a processor or a combination of processors. A processor or a combination of processors is circuitry that performs processing and includes circuitry such as an application processor (AP, e.g., a central processing unit (CPU)), a communication processor (CP, e.g., a modem), a graphics processing unit (GPU), a neural processing unit (NPU) (e.g., an artificial intelligence (AI) chip), a Wi-Fi chip, a Bluetooth® chip, a global positioning system (GPS) chip, a near field communication (NFC) chip, a connectivity chip, a sensor controller, a touch controller, a fingerprint sensor controller, a display driver integrated circuit (IC), an audio codec chip, a universal serial bus (USB) controller, a camera controller, an image processing IC, a microprocessor unit (MPU), a system-on-a-chip (SoC), an integrated circuit (IC), and the like.

[0051] Figure 1 It is a diagram used to illustrate the operation of an electronic device according to an embodiment of the present disclosure.

[0052] Reference Figure 1 The diagram illustrates multiple users 10 and 20. These users can each have different states related to the electronic device 100. For example, the first user 10 might be in a normal state, i.e., a state where notifications can be provided. However, the second user 20 might be in a state where the user does not want to be disturbed, because the user is focused on a specific activity.

[0053] In a traditional environment, in order for the second user 20 to prevent interference from the electronic device 100, the user 20 must stop the function of the electronic device 100 (e.g., set it to mute, disable the robot's operation, or put the robot into a sleep state).

[0054] If the function of electronic device 100 is stopped as described above, the second user 20 will not be disturbed. However, other users 10 besides the second user 20 may not be able to use the function of electronic device 100.

[0055] Furthermore, if the first user 10 cancels the shutdown of the function described above to use the electronic device 100, the second user 20 may be interfered with by the operation of the electronic device 100.

[0056] To address this issue, this disclosure includes support for a Do Not Disturb mode for each user. Here, Do Not Disturb mode may also be referred to as notification blocking mode, focus mode, access blocking mode, etc.

[0057] For example, in the scenario shown, if a Do Not Disturb mode is set for the second user 20 but not for the first user 10, the electronic device 100 can perform an operation corresponding to the request of the first user 10.

[0058] However, when a second user 20, who has set to Do Not Disturb mode, is nearby, the electronic device 100 can perform operations in a restricted state while providing notifications (or services) to the first user 10, so that the notification does not disturb the second user 20. For example, the electronic device 100 can perform operations such as outputting notification content while reducing the volume, or displaying an image 30 in an area not visible from the second user 20's gaze. Here, a notification is an operation that displays specific information to the user as sound and / or a message, and can provide information such as when a specific time has arrived or when a specific situation has occurred. Furthermore, the above operations can be applied not only to providing specific information, but also to performing processing such as content reproduction and music reproduction.

[0059] In the following text, for ease of explanation, operations in the normal state will be referred to as operations in normal mode, and operations in states different from normal mode will be referred to as operations in do-not-disturb mode.

[0060] Here, operations in Do Not Disturb mode may include using a lower volume than in normal mode, displaying an image while avoiding the gaze direction of the user who has set Do Not Disturb mode, and reducing movement speed or avoiding approaching the surrounding area (or within a predetermined distance from the user who has set Do Not Disturb mode). These will be described below. Figures 6 to 22 Each detailed operation is explained in detail.

[0061] According to this disclosure, the electronic device 100 can set a do-not-disturb mode for each user, so users who have not set a do-not-disturb mode can use the functions of the electronic device 100, thereby improving user convenience.

[0062] Furthermore, in the presence of users in the surrounding environment who have set up Do Not Disturb mode, the electronic device 100 can perform operations while minimizing the impact on those users, thus minimizing the inconvenience for users who have set up Do Not Disturb mode.

[0063] Figure 2 This is a diagram illustrating the form of an electronic device according to an embodiment of the present disclosure.

[0064] Reference Figure 2 The diagram shows an electronic device 100 in a movable form. However, this is only an example of the form shown, and the electronic device 100 may have a different shape than that shown.

[0065] Electronic device 100 may include a display 120 on its front surface.

[0066] The display 120 in the example shown is a projector type that projects and displays images. Therefore, the electronic device 100 can display images by projecting them onto a wall or the ground, etc.

[0067] In the following description, the display 120 will be assumed to project images in the form of a projector. However, in actual implementations, the display 120 may also be implemented as a component that displays images on a specific surface of the electronic device 100 (e.g., a liquid crystal display (LCD), an organic light-emitting diode (OLED), a micro light-emitting diode (LED), etc.), rather than in the form of a projector. Furthermore, in the example shown, a display 120 is arranged on the front surface of the electronic device 100, but in actual implementations, multiple displays may be arranged on the electronic device 100.

[0068] The electronic device 100 may include a drive mechanism (e.g., a motor, wheels) for movement, and movement is performed by using the provided drive mechanism. Furthermore, while the example shown illustrates and explains the movement of the electronic device 100 using wheels, in practical implementations, using another device in the form of tracks is also feasible for the user, and in cases where the electronic device 100 is implemented as a drone or the like, installing propellers instead of wheels is also feasible.

[0069] Furthermore, in the example shown, the electronic device 100 itself includes a drive mechanism, but the drive mechanism can be a separate device. For example, the electronic device 100 can be combined with a movable device such as a robotic cleaner, and can be mounted on the robotic cleaner and operated by controlling the movement of the robotic cleaner.

[0070] Furthermore, the form shown for electronic device 100 is merely an example, and electronic device 100 can be implemented in various forms. The specific components constituting electronic device 100 will be described below with reference to… Figure 3 Describe it.

[0071] Figure 3 This is a block diagram illustrating the configuration of an electronic device according to embodiments of the present disclosure.

[0072] Reference Figure 3The electronic device 100 may include a memory 110, a display 120, a sensor 130, a mobile device 140, and a processor 150.

[0073] The memory 110 can store data required for various embodiments. The memory 110 can be implemented as a memory embedded in the electronic device 100, or as a memory that can be attached to or removed from the electronic device 100, depending on the use of the stored data.

[0074] For example, in the case of data used to operate the electronic device 100, the data may be stored in a memory embedded in the electronic device 100, and in the case of data used for extended functions of the electronic device 100, the data may be stored in a memory that can be attached to or removed from the electronic device 100.

[0075] Furthermore, in the case of memory embedded in electronic device 100, the memory can be implemented as at least one of volatile memory (e.g., dynamic random access memory (RAM) (DRAM), static RAM (SRAM) or synchronous dynamic RAM (SDRAM)).

[0076] Furthermore, in the case of a memory that can be attached to or removed from an electronic device 100, the memory can be implemented in the form of a memory card (e.g., Compact Flash (CF), Secure Digital (SD), Micro-SD, Mini-SD, xD, Multimedia Card (MMC), etc.) and an external memory (e.g., a USB memory) that can be connected to a USB port.

[0077] The memory 110 may include various instructions required for the operation of the processor 150. Here, the instructions may include instructions for identifying a projection area that can be projected in the surrounding environment, instructions for processing changes in the projection area, instructions for trapezoidal distortion correction, instructions for user speech recognition or speech processing, instructions for processing images, instructions for controlling the movement of the electronic device 100, instructions for managing a do-not-disturb mode for each user, etc.

[0078] The memory 110 can store map information. Here, the map information is information about the space where the electronic device 100 is located, and can be information about a space divided into multiple zones. For example, if the electronic device 100 is located in a home, the map information can be generated based on a floor plan of the home. Such map information can be generated directly by the electronic device 100, or it can receive and use map information generated in another electronic device (e.g., a robotic cleaner).

[0079] Here, the memory 110 can also store additional information for each space using information from the map information. Furthermore, the memory 110 can store information about the location of a user who has set a do-not-disturb mode. For example, in an environment with spaces such as a living room, room 1, room 2, and room 3, if a user with a do-not-disturb mode set is identified as being in room 1, the memory 110 can store information that room 1 is a space where disturbances are prohibited.

[0080] Furthermore, memory 110 can store information about projection areas that can be used when projecting images in each space. For example, the display 120 according to this disclosure can be a projector that operates in projection mode. In this case, projection areas that can project images can be identified and used each time, but since the spaces in a home do not change significantly, the projection areas identified in the initial search process can be stored in memory 110 and used in later operations.

[0081] Furthermore, multiple projection areas can be included for a specific space. For example, in an environment with spaces such as a living room, room 1, room 2, and room 3, where the living room has four projection areas and room 1 has two projection areas, the memory 110 can store information about each projection area (e.g., information about the location where the electronic device 100 should be located to use the projection area, information about the projection direction in that location, etc.). A more detailed explanation of this will follow... Figure 13 As described in the text.

[0082] The display 120 can display images. Furthermore, the display 120 according to this disclosure can be a projector type, projecting images in the form of images. For example, a projector-type display can project images onto a projection area using a light source such as a lamp or LED. For example, the display 120 can project light corresponding to the image using a mirror, lens, etc. The projected light can thus form an image on the projection area.

[0083] The advantage of using this type of projector is that it allows for a large screen to be provided to the user using a small device. In other words, it achieves the effect of providing a relatively large image to the user while reducing the size of the electronic device 100. Furthermore, in practical implementation, if the electronic device 100 can be made relatively large, it can be in the form of a display such as an LCD or OLED. Moreover, it is possible to include both a projector-type display and a display such as an LCD or OLED.

[0084] Sensor 130 can detect the surrounding environment of electronic device 100. For example, sensor 130 may include at least one of a camera, a time-of-flight (ToF) sensor, a LiDAR sensor, etc., and can generate information for searching the space around electronic device 100 or identifying a user.

[0085] The mobile device 140 is a component for moving the electronic device 100. For this purpose, the mobile device 140 may include a motor, wheels, etc., and the electronic device 100 is moved by the movement of the wheels.

[0086] Furthermore, when the aforementioned display 120 is configured as a projection-type projector, the mobile device 140 can adjust the projection direction of the electronic device 100. For example, the mobile device 140 can adjust the projection direction of the electronic device 100 by means of... Figure 2 The orientation of the display 120 can be adjusted by changing the position of the main body of the electronic device 100, or the projection format can be adjusted by changing the position of the lens or reflector inside the display 120.

[0087] Here, projection direction refers to the direction in which the image is projected, and it can also be referred to as the direction the electronic device 100 faces, the projection direction, the display direction, etc. In the following text, for ease of explanation, it will be expressed as changing the projection direction, but it can also be expressed as changing the projection area. Here, changing the projection area refers to changing the center point of the projection area, not changing the screen size while maintaining the center point of the projection area.

[0088] The processor 150 controls the overall operation of the electronic device 100. Specifically, the processor 150 can be connected to each component of the electronic device 100 (e.g., memory 110, display 120, sensor 130, mobile device 140) and control the overall operation of the electronic device 100.

[0089] Processor 150 may be implemented as a digital signal processor (DSP), a microprocessor, and a time controller (TCO, no) for processing digital signals. However, this disclosure is not limited thereto, and processor 150 may include one or more of a central processing unit (CPU), a microcontroller unit (MCU), a microprocessor unit (MPU), a controller, an application processor (AP), a graphics processing unit (GPU), or a communication processor (CP), and an ARM processor, or as defined by these terms. Furthermore, at least one processor 150 may be implemented as a system-on-a-chip (SoC) or a large-scale integrated circuit (LSI) in which processing algorithms are stored, or in the form of a field-programmable gate array (FPGA). Furthermore, at least one processor 150 may perform various functions by executing computer-executable instructions stored in memory. Additionally, at least one processor 150 may include multiple processors (e.g., CPU+GPU, CPU+DSP).

[0090] The processor 150 can identify the setting status of the Do Not Disturb mode for each of the multiple users using the electronic device 100. Specifically, the Do Not Disturb mode for each user can be set via voice command as described above, or information set in the user's terminal device can be provided to and used by the electronic device 100. Here, the setting status can consist of a single level (i.e., the status regarding whether the Do Not Disturb mode is applied), or it can consist of multiple levels. This will be discussed later. Figure 22 Such an example is described in the text.

[0091] Furthermore, if a predetermined event occurs, the processor 150 can perform an operation corresponding to the event to a user who has not set a do-not-disturb mode. Here, the predetermined event may include situations where a notification needs to be received, a call from a specific user, or the input of an instruction to perform a specific function.

[0092] For such operations, if movement is required, the processor 150 can control the mobile device 140 to move to the location where a specific event will be performed. Here, the processor 150 can identify whether there is a user with Do Not Disturb mode set on the movement route, and if a user with Do Not Disturb mode set is identified, the processor 150 can set a movement route in a direction that creates a predetermined distance from the user.

[0093] Furthermore, if it is impossible to move at a predetermined distance from a user who has set to Do Not Disturb mode, the processor 150 can control the movement of the mobile device 140 by reducing its speed if it is traveling along a feasible route while remaining within the predetermined distance of the user. Additionally, while setting the route as described above, the processor 150 can also set a route that prevents the electronic device 100 from moving within the user's gaze area, taking into account the user's gaze direction (or gaze area) in Do Not Disturb mode. Figures 7 to 9 , Figure 14 and Figure 15 The text describes this operation in detail.

[0094] If the electronic device 100 moves to the aforementioned position, the processor 150 can execute an operation corresponding to the event. Here, the predetermined event may be an operation such as outputting a notification as sound or displaying an image.

[0095] In this situation, if a user with Do Not Disturb mode set is detected nearby, the processor 150 can perform the above operations without affecting the user with Do Not Disturb mode set. That is, if a user with Do Not Disturb mode set is nearby, the processor 150 can perform the above events in Do Not Disturb mode. For example, the processor 150 can output sound and / or images by outputting sound at a lower volume than before, or by displaying an image in an area that avoids the gaze area of ​​a user with Do Not Disturb mode set.

[0096] As described above, the electronic device 100 according to this disclosure manages a do-not-disturb mode for each user, thus the electronic device 100 can provide services to other users who have not set a do-not-disturb mode. Furthermore, if a user with a do-not-disturb mode set is identified near the electronic device 100 while providing the service described above, the electronic device 100 adjusts the volume or position of the image to minimize the impact on the user, thereby providing services that can satisfy each of multiple users.

[0097] In addition, Figure 3 This document only shows and explains simple components of the electronic device 100; however, in actual implementation, additional components not shown may be used. The following will refer to... Figure 4 Describe an explanation of this aspect.

[0098] Figure 4 This is a block diagram illustrating the configuration of an electronic device according to embodiments of the present disclosure.

[0099] Reference Figure 4 The electronic device 100 may include a memory 110, a display 120, a sensor 130, a mobile device 140, a processor 150, a communication device 160, a microphone 170, and a speaker 180.

[0100] Because of the above Figure 3 The memory 110, display 120, sensor 130, mobile device 140 and processor 150 have been explained. Therefore, in the following text, explanations of the same operations will be omitted, and only the additional operations will be explained.

[0101] Sensor 130 is a sensor used to identify at least one of the surrounding environment or a user of electronic device 100. For example, sensor 130 may include a first camera 131, a second camera 133, and a ToF sensor 135.

[0102] The first camera 131 can be located on the front surface of the electronic device 100 and capture images of the area located on the front side of the electronic device 100. Here, the first camera 131 can be arranged adjacent to the display 120 and capture images in the same direction as the projection direction.

[0103] Therefore, the image captured by the first camera 131 can be used to identify whether the display 120 is projected normally onto the projection area, or to determine the projection area.

[0104] Furthermore, the images captured by the first camera 131 can be used to identify users. For example, the images can be used to identify the speaker who inputs a voice command or a user who has set a do-not-disturb mode. Therefore, the processor 150 can identify the speaker, the user who has set a do-not-disturb mode, or the user's location by using the images captured by the first camera 131.

[0105] Furthermore, if the identified user has already set up Do Not Disturb mode and the user approaches within a predetermined distance of the electronic device 100, the processor 150 can control the display 120 to show the Do Not Disturb mode setting. If the user requests to deactivate Do Not Disturb mode after such a display, the processor 150 can deactivate the Do Not Disturb mode setting for the user. This request can be input as a voice command and can be executed through interaction with the electronic device 100.

[0106] Furthermore, the images captured by the first camera 131 can be used to identify the user's state. For example, if a user is sleeping on a sofa or in bed, the generation of notifications may be inconvenient. Therefore, if the processor 150 identifies that the user is sleeping based on the images captured by the first camera 131, it can set a Do Not Disturb mode for the sleeping user. Since this setting is not performed at the user's request, the processor 150 can deactivate the Do Not Disturb mode for the user if the user wakes up after the sensor is detected.

[0107] Furthermore, the aforementioned actions of setting and disabling Do Not Disturb mode via sleep mode can also be performed by capturing an image, and can be based on information about the user's lifestyle. For example, processor 150 can store information about the user's sleep patterns, and if the current time is the user's sleep time, processor 150 can set the Do Not Disturb mode. In practical implementation, processor 150 can directly set the Do Not Disturb mode based on the aforementioned patterns, or if the aforementioned patterns are recognized, processor 150 can directly display a message notifying the user that the Do Not Disturb mode can be set in that mode, or display such a message on the user's terminal device, or set the Do Not Disturb mode upon the user's request.

[0108] Furthermore, the images captured by the first camera 131 can be used to detect the position or movement of objects (or people) in the projection area. For example, if the display 120 is implemented as a projector, since the light emitted by the projector is of a fairly high intensity, it may affect the user's vision if the user is directly facing the projected light.

[0109] Therefore, the processor 150 can detect whether a person is located in the projection area of ​​the projected image based on an image captured at the first camera 131 or an image or sensor value input from an additional sensor (e.g., a PIR sensor). If a person is detected in the projection area, the processor 150 can control the display 120 to stop the projection operation.

[0110] The second camera 133 can be located on the rear surface of the electronic device 100 and capture images of the area located on the rear surface of the electronic device 100. Here, the second camera 133 is located on the opposite surface of the projection area of ​​the display 120, so it can capture images of the user viewing the images.

[0111] Therefore, the images captured by the second camera 133 can be used to analyze the user's posture and gaze. Thus, the processor 150 can identify the state of the user using the electronic device 100 by using the images captured by the second camera 133. Optionally, the processor 150 can identify the presence of another user besides the current user by using the images captured by the second camera 133. Furthermore, if the other identified user is in Do Not Disturb mode, the processor 150 can perform specific operations in Do Not Disturb mode, or perform an operation to deactivate the Do Not Disturb mode of the other detected user.

[0112] Furthermore, the images captured by the second camera 133 can be used to identify whether a person, such as a user, is approaching the area where the image is displayed. For example, the processor 150 can use the images captured by the second camera 133 to identify whether someone is approaching the front of the electronic device 100 (e.g., the projection area). If such approach is identified, the processor 150 can activate a hazard detection operation (i.e., an operation to detect the position or movement of an object (or person) in the projection area).

[0113] Furthermore, images captured at the first camera 131 or the second camera 133 can be used to detect user gestures. For example, the electronic device 100 can receive input not only via voice commands such as user voice, but also via control commands expressed through user gestures. In this case, the processor 150 can recognize the user's gestures using images captured at the first camera 131 or the second camera 133, and execute events corresponding to the recognized gestures.

[0114] The ToF sensor 135 is a three-dimensional sensor that identifies the dimension or spatial information of an object by calculating the distance that light emitted at an infrared (IR) wavelength travels back after being reflected, based on time. By using this ToF sensor, distances such as those between walls and the ground can be identified more accurately. In this ToF sensor 135, the output signal can be used to determine the projection area. Furthermore, the processor 150 can determine the projection area by combining the signal values ​​(or images) provided by the first camera 131 and the ToF sensor 135.

[0115] Furthermore, while the example shown includes multiple cameras, in a practical implementation, only one camera may be included, and the ToF sensor may be omitted. In addition to the cameras and ToF sensor mentioned above, other sensors may include distance sensors (e.g., Radar, LiDAR, IR sensors, ultrasonic sensors, etc.), depth cameras, geomagnetic sensors, drop detection sensors, gyroscope sensors for detecting angular velocity, encoders for identifying movement speed, etc.

[0116] The communication device 160 is a component that performs communication with various types of external devices according to various communication methods. The communication device 160 may include a Wi-Fi module, a Bluetooth module, an infrared communication module, an ultra-wideband (UWB) module, and a wireless communication module, etc. Here, each communication module can be implemented as at least one hardware chip.

[0117] The Wi-Fi module and Bluetooth module communicate via Wi-Fi and Bluetooth methods, respectively. When using either the Wi-Fi or Bluetooth module, various types of connection information, such as Service Set Identifier (SSID) and session keys, are first sent and received. A connection is established for communication using this information, and thereafter, various types of information can be sent and received.

[0118] The infrared communication module performs communication based on the Infrared Data Association (IrDA) technology, which wirelessly transmits data to the near field using infrared light between visible light and millimeter waves.

[0119] Ultra-wideband (UWB) modules are modules that support wireless communication that transmits large amounts of information at low power over a bandwidth that is much wider than traditional spectrum.

[0120] The wireless communication module may include at least one communication chip, which performs communication according to various wireless communication standards (such as Zigbee, 3G, 3GPP, LTE, LTE-A, 4G, 5G, etc.) other than the communication methods described above.

[0121] According to an embodiment, the communication device 160 can use the same communication module (e.g., a Wi-Fi module) to communicate with a user terminal device or another electronic device. Furthermore, the processor 150 can use the communication device 160 to calculate the distance to a specific user's user terminal device. For example, the communication device 160 can perform communication with the user terminal device using a peer-to-peer (P2P) communication method, and calculate the distance between the user terminal device and the communication device (i.e., the electronic device) by using signal strength during the communication process. Additionally, the processor 150 can receive device information from the user terminal device (or information required to identify the user of the user terminal device) and identify the user of the user terminal device. Through such processing, if the user of the user terminal device is a user who has set a do-not-disturb mode, and the distance to the user terminal device is within a predetermined distance, the processor 150 can operate in do-not-disturb mode.

[0122] The above process illustrates and explains how users can be identified by images captured by cameras, etc. However, in practice, users can also be identified by communication distance with their user terminal devices.

[0123] Furthermore, to more accurately identify the distance to the user terminal device, electronic device 100 can use another electronic device. For example, electronic device 100 can identify the user's location by being provided with information about the distance to the user terminal device from another electronic device located away from electronic device 100, and by adding this information to the processor 150 with information about the distance to the user terminal device identified in the current device (i.e., by using triangulation). Alternatively, electronic device 100 can identify the correct location of the user terminal device not by measuring the distance at one location, but by measuring the distance at multiple locations; that is, by measuring the distance at a first location, then moving to a second location and measuring the distance again.

[0124] The communication device 160 can receive information from the server regarding the setting status of the Do Not Disturb mode for each user. Optionally, the communication device 160 can also receive information from each user regarding the setting status of the Do Not Disturb mode for each user. For example, the setting of a user's Do Not Disturb mode can be comprehensively managed for each user's terminal device by a separate server or the like. Without using a separate server, the communication device 160 can receive Do Not Disturb mode setting information for each user's terminal device from the user's terminal device. Conversely, if the above information is managed at the server, the communication device 160 can receive integrated information from multiple users from the server (or a home server, etc.).

[0125] Here, the setting state can consist of whether Do Not Disturb mode should be activated for each user. Optionally, the setting state can also include whether Do Not Disturb mode will be applied for each of multiple notification types (or notification formats), or the application level of Do Not Disturb mode. For example, if a notification using sound is inconvenient for the user, but the user can accept a notification using visual methods (e.g., displaying the message in an image), then Do Not Disturb mode can be applied to notifications via sound, but not to notifications via messages. Optionally, various types of notifications can exist, and the following form of application is also possible: Do Not Disturb mode is applied only to a specific notification within the notifications, and Do Not Disturb mode is not applied to other notifications.

[0126] The communication device 160 can receive maps. For example, the communication device 160 can receive a map of the space where the electronic device 100 is located via a robotic cleaner or a home server.

[0127] Specifically, the foregoing explained that the electronic device 100 operates in Do Not Disturb mode based on the distance to a user who has set the Do Not Disturb mode. Specifically, it was explained that if the distance to a user who has set the Do Not Disturb mode is within a specific distance, the electronic device 100 operates in Do Not Disturb mode. However, in practical implementation, the above operation can be performed on a spatial unit rather than on a specific distance. For example, this disclosure can be implemented such that in a space having rooms 1, 2, 3, etc., if a user who has set the Do Not Disturb mode is located in room 3, the electronic device 100 operates in Do Not Disturb mode only in room 3, and does not operate in Do Not Disturb mode in other spaces.

[0128] Furthermore, in practical implementation, this disclosure can be used by combining room units and distance. For example, if there is no significant distance difference between rooms, even if a do-not-disturb mode is set for room 3, a loud sound output in front of room 3 may cause interference to the user who has set the do-not-disturb mode. Therefore, processor 150 can consider all of the following: the space where the user with the do-not-disturb mode is located, the space where the electronic device is located, and the distance between the user and the electronic device, and determine whether the electronic device 100 will operate in do-not-disturb mode when performing an operation corresponding to a request from another user who has not set the do-not-disturb mode.

[0129] Furthermore, when applying the space division described above, the processor 150 can consider the state of the space where the user in the Do Not Disturb mode is located. For example, the state in which external sounds are transmitted to a specific space can be changed depending on whether the room door is open or closed. Therefore, the processor 150 can adjust the application state of the Do Not Disturb mode by considering the space where the user in the Do Not Disturb mode is located and the characteristics of that space. Here, as described above, the characteristics of the space may include the open / closed state of the room door, the size of the space, etc.

[0130] Furthermore, the communication device 160 can receive content. The processor 150 can control the communication device 160 to receive content based on user instructions for reproducing the content. When content is received, the processor 150 can control the display 120 to display an image corresponding to the received content, and control the speaker 180 to output voice corresponding to the received content.

[0131] Furthermore, the communication device 160 can receive event information. For example, if it receives event information from a home server notifying it of a visitor's arrival, the processor 150 can determine the user to whom it will be notified based on the received event information. For instance, if it is identified that user 1, user 2, and user 3 are in the current space and user 1 has set a do-not-disturb mode, the processor 150 can determine that the notification will be sent to user 2 or user 3. Here, if there is a priority for receiving notifications for each user, the electronic device 100 can determine the user to whom it will be notified based on the priority.

[0132] Furthermore, the communication device 160 can send information about the Do Not Disturb mode. For example, if a specific user has set up a Do Not Disturb mode, the processor 150 can control the communication device 160 to notify other users' terminal devices of the Do Not Disturb mode setting status, thus informing other users that a Do Not Disturb mode has been set for that user. Optionally, the processor 150 can control the communication device 160 to send the information to a home server that manages the status of users' Do Not Disturb modes.

[0133] The microphone 170 can receive the user's voice when it is active. For example, the microphone 170 can be integrated into the upper or front surface, side surface, or other parts of the electronic device 100. The microphone 170 may include various components, such as a microphone that collects the user's voice in analog form, an amplifier circuit that amplifies the collected user's voice, an A / D conversion circuit that samples the amplified user's voice and converts it into a digital signal, and a filter circuit that removes noise components from the converted digital signal.

[0134] When a user's voice is input through such a microphone 170, the processor 150 can recognize the user's voice content and perform operations corresponding to the voice content.

[0135] For example, if a user utters a command to call electronic device 100, processor 150 can recognize the call command by using the voice command input through microphone 170. Here, processor 150 can recognize the speaking location identified by microphone 170, or identify the user or the user's location by using an image captured at sensor 130, and control mobile device 140 to move electronic device 100 to a location around the user who made the call.

[0136] If a user utters a voice command requesting a speech ban, the processor 150 can recognize the user's speech intent by using the voice command input through the microphone 170, identify the speaker by analyzing the characteristics of the voice (or the user's face in an image captured by a camera, etc.), and set a speech ban mode for the identified speaker. Conversely, if the user utters a voice command to deactivate the speech ban mode, the processor 150 can identify the speaker and deactivate the speech ban mode for that speaker.

[0137] Furthermore, in practical implementation, users can not only set their own speech prohibition mode, but also set a speech prohibition mode for another user. For example, a parent caring for a child can set a speech prohibition mode for the child. In this case, the processor 150 can set a speech prohibition mode for the object identified in the speech recognition by performing speech recognition on the spoken words. Conversely, the processor 150 can deactivate the speech prohibition mode for a specific object based on the result of speech recognition.

[0138] The speaker 180 can output sound. Specifically, the speaker 180 can be a component that outputs not only various types of audio data corresponding to the content, but also various types of notification sounds or voice messages, etc. Furthermore, the speaker 180 can output result information corresponding to the speech recognition operation described below.

[0139] Furthermore, during the notification output process described above, if a user with Do Not Disturb mode set in the surrounding environment is identified, the processor 150 can reduce the notification output volume as described above. Here, the processor 150 can identify the distance from the user with Do Not Disturb mode set, determine the volume corresponding to the identified distance, and output the sound at the determined output volume.

[0140] Furthermore, if a user viewing the notification has difficulty recognizing a notification with a defined output volume, the processor 150 can control the display 120 to display visual information corresponding to the notification. Here, the processor 150 can control the display 120 to display information such as the volume being reduced due to a user in Do Not Disturb mode being nearby. The visual information can be text corresponding to the notification's voice, and if an image is being reproduced, it can be a caption for the image.

[0141] The above text illustrates and explains that when a Do Not Disturb mode is set for a specific user, notifications will not be sent to that user. Furthermore, notifications can be categorized into multiple steps, and the above operation can be applied only to ordinary notifications. In cases related to emergencies such as earthquakes or fires, the electronic device 100 can operate without the Do Not Disturb mode.

[0142] In addition, Figure 4 The accompanying drawings illustrate an electronic device that includes various additional components; however, the electronic device may be implemented with some of the components shown omitted. Furthermore, although not shown in the drawings, the electronic device may also include other components (e.g., a vacuum cleaner for suction, etc.).

[0143] Figure 5 This is an illustration of an example of a user interface window for setting a do-not-disturb mode according to an embodiment of the present disclosure.

[0144] Reference Figure 5 The user interface window 200 may include selection areas 210, 220, 230, and 240 that the user can select.

[0145] The first selection area 210 is a selection area used to set the Do Not Disturb mode. The user can select the first selection area 210, and the information regarding the user's Do Not Disturb mode settings can be provided to the electronic device 100 (or home server). Furthermore, in practice, after selecting the first selection area 210, the user can set the endpoint of the Do Not Disturb mode through a window that receives settings for the endpoint of the Do Not Disturb mode.

[0146] The second selection area 220 is used to set the personal time the user is currently spending. If the second selection area 220 is selected, information about the user's personal time mode can be provided to the electronic device 100 (or home server). Furthermore, if the second selection area 220 is selected after the user has set a Do Not Disturb mode, the Do Not Disturb mode can be deactivated.

[0147] The third selection area 230 is a selection area used to set the user's current work time. Operations in the third selection area 230 can be similar to those in the second selection area 220. Furthermore, in the case where the user sets or uses work time as a Do Not Disturb mode, if the third selection area 230 is selected, information indicating that the user has set the Do Not Disturb mode can be provided to the electronic device 100 (or home server).

[0148] The fourth selection area 240 is used to set the selection area where the user is spending their sleep time. If the fourth selection area 240 is selected, the user terminal device can send a notification to the electronic device 100 (or the home server) indicating that the electronic device 100 has been set to Do Not Disturb mode.

[0149] Furthermore, while the above section showed a user interface window that allows various selections based on user behavior, in a real implementation, a screen displaying settings solely for Do Not Disturb mode could be shown. An explanation of this will follow later. Figure 19 and Figure 22The description is in the middle.

[0150] Furthermore, while the above text shows and explains how to independently set a user's Do Not Disturb mode in the electronic device 100, operations such as setting the Do Not Disturb mode can be performed by interlocking with the user's terminal device.

[0151] For example, even if the user does not set a separate Do Not Disturb mode for the electronic device 100, that is, if the user sets a Do Not Disturb mode for his / her user terminal device, information about that setting can be provided to the electronic device 100, and even if the user does not set a separate Do Not Disturb mode for the electronic device 100, a Do Not Disturb mode can be set in the electronic device 100 by interlocking with the above-mentioned setting operation.

[0152] Figure 6 This is a diagram illustrating the operation of an electronic device when some of the multiple users have set a Do Not Disturb mode, according to an embodiment of the present disclosure.

[0153] Reference Figure 6 The image shows a map of the space where the electronic device 100 is located. In the example shown, three users 601, 602, and 603 are located in this space.

[0154] In this environment, suppose the first user 601 and the second user 602 have set up Do Not Disturb mode. For example, the first user may have set up Do Not Disturb mode because he / she is reading, and the second user may have set up Do Not Disturb mode because he / she is working.

[0155] This do-not-disturb mode can be entered by each user via voice commands to the electronic device 100, and as... Figure 5 As explained in the document, Do Not Disturb mode can be set on each user's terminal device.

[0156] When an electronic device is used by multiple users as described above, each user's activity status may be different. That is, inconvenience may occur if some users (e.g., the first user) have set a Do Not Disturb mode, but a third user cannot use the electronic device 100.

[0157] In this respect, a Do Not Disturb mode can be set for each user in this disclosure, so that even if a particular user sets a Do Not Disturb mode, another user who does not set a Do Not Disturb mode can still use the electronic device 100.

[0158] In such an environment, a third user 603 can call an electronic device 100 and issue a voice command requesting the playback of a song. The electronic device 100 can then move to the vicinity of the third user 603 in response to the call. The electronic device 100 can then reproduce the music in response to the request from the third user 603.

[0159] Furthermore, if the electronic device 100 moves to a position far from the first user 601 and the second user 602 in order to reproduce the music, and thus determines that the music currently being output does not affect the first user 601 and the second user 602, then the electronic device 100 may output the music at the volume requested by the third user 603 (or a predetermined volume).

[0160] However, if the distance between the electronic device 100 and the first user 601 or the distance between the electronic device 100 and the second user 602 is within a predetermined distance, the electronic device 100 can output music at a volume that neither the first user 601 nor the second user 602 can hear.

[0161] Here, electronic device 100 can provide a guidance message to third user 603: since there is a user in the vicinity who has set to Do Not Disturb mode, music is output by lowering the volume. Such a guidance message can be output as sound or as visual information (i.e., a message).

[0162] Furthermore, if a new user's call is generated while the electronic device 100 is performing an operation based on a third user's request, the electronic device 100 can determine whether to execute the request.

[0163] For example, if a new fourth user (not shown) issues a voice command “Show me the cooking recipe!”, and the operation requested by the third user has already stopped, the electronic device 100 can move to the vicinity of the fourth user.

[0164] However, if a new user's request is generated while the operation based on the third user's request has not yet stopped, the electronic device 100 can determine whether to perform the operation based on the new request.

[0165] For example, electronic device 100 can identify the user making the new request and determine whether the identified user has a higher priority in using electronic device 100 than the third user. If the fourth user has a higher priority, electronic device 100 can provide the third user with a notification message that the music playback has been stopped due to the fourth user's call, and move to the vicinity of the fourth user.

[0166] If no separate priority is set, or if users have the same priority, the electronic device 100 may direct the third user to the presence of a call from the fourth user and ask if the current operation can be stopped, and determine whether to move based on whether the third user allows it.

[0167] In this situation, electronic device 100 can identify whether there is a device that can alternatively perform the current work, and if, as a result of the identification, there is another device that can perform the operation corresponding to the request of the third user, electronic device 100 can make the request be executed in the other device. For example, if there is a TV, speaker, etc. that can output sound around the third user 603, electronic device 100 can perform control so that the device (e.g., the speaker) continues to output the music being reproduced in electronic device 100.

[0168] Furthermore, if the third user prohibits movement, the electronic device 100 can send a notification message to the fourth user's user terminal device, which informs the electronic device 100 that movement is not permitted because the third user is currently in use.

[0169] Furthermore, as shown and explained above, electronic device 100 can move directly to the user's vicinity and perform corresponding operations upon the user's request. However, electronic device 100 may respond to the user's request without directly performing a specific operation, but instead control another electronic device to perform an event corresponding to the user's request.

[0170] For example, if a third user requests the reproduction of music, the electronic device 100 can control a speaker device located near the third user to output music. Alternatively, if the electronic device 100 directly outputs music due to a third user's request and generates a request from a fourth user, the electronic device 100 can cause surrounding speaker devices to perform the output.

[0171] Furthermore, where the electronic device 100 does not need to move directly to perform the work requested by the fourth user, the electronic device 100 can perform the fourth user's request while maintaining its current position. For example, if a display device is present around the fourth user, the electronic device 100 can search for recipes according to the fourth user's request and display the search results on the display device.

[0172] Figure 7 This is a diagram illustrating the movement operation of an electronic device when some of the multiple users have set a Do Not Disturb mode, according to an embodiment of the present disclosure.

[0173] Reference Figure 7Multiple users 10 and 20 are located in a specific space. In the following description, it will be explained by assuming that the first user 10 is a user who has not set Do Not Disturb mode, and the second user 20 is a user who has set Do Not Disturb mode.

[0174] In such an environment, the first user 10 can issue a voice command to call the electronic device 100. If the voice command to call the electronic device 100 is input through a microphone, the electronic device 100 can identify the speaker of the input voice command based on speech analysis of the speech input through the microphone or an image captured by a camera. Here, if the electronic device 100 includes multiple microphones, the electronic device 100 can estimate the location of the speaker by analyzing the wavelengths of the sounds input through the multiple microphones.

[0175] When the speaker's position, etc., is estimated as described above, the electronic device 100 can move to the estimated position. The following will refer to... Figure 8 and Figure 9 Explain the specific operation that determines the direction of movement.

[0176] Figure 8 and Figure 9 This is a diagram illustrating the mobile operation of an electronic device when some of the multiple users have set a Do Not Disturb mode, according to various embodiments of the present disclosure.

[0177] As described above, in order not to disturb users who have set up Do Not Disturb mode, the electronic device 100 should move while maintaining a specific distance or greater from the user who has set up Do Not Disturb mode.

[0178] Reference Figure 8 and Figure 9 If the electronic device 100 is unable to move while maintaining a specific distance or greater from the user 20 who has set to Do Not Disturb mode due to obstacles, the electronic device 100 can move by using a route taken within a predetermined distance from the user 20 who has set to Do Not Disturb mode.

[0179] Furthermore, during the aforementioned movement, the electronic device 100 can perform the movement by reducing its speed within a predetermined distance from the user, thereby minimizing noise generated during the movement.

[0180] The speed change can consist of three levels, such as high-speed movement, low-speed movement, and stop. In this case, the electronic device 100 can move by: moving at high speed when the user moves a predetermined distance or more away, moving at low speed within the predetermined distance, and moving at high speed again if the user moves a predetermined distance or more away again.

[0181] Furthermore, the electronic device 100 can perform the above operations by changing speed in three or more levels instead of two. For example, the aforementioned low-speed movement can be divided into multiple levels, and the aforementioned predetermined distance can also be divided into multiple distances, and can have a form in which the speed changes in stages according to the distance from the user who has set the Do Not Disturb mode.

[0182] Figure 10 This is a diagram illustrating the display operation of an electronic device when some of the multiple users have set a do-not-disturb mode, according to an embodiment of the present disclosure.

[0183] Reference Figure 10 The first user 10 can execute voice commands requesting the output of an image.

[0184] To perform such an operation, the electronic device 100 can search for the space where the image will be projected. This projection area can be pre-defined as multiple areas, or it can be searched for and used at a time when a user requests it.

[0185] Here, the projection area refers to the area where the image in the projection form is projected, and it can be referred to as the projection direction facing the electronic device 100, the projection area, the display area, the screen area, etc.

[0186] For example, if there are two areas (e.g., 1010, 1020) in the space where the electronic device 100 is located, the electronic device 100 can select an area from these two areas that will not affect the user who has set the Do Not Disturb mode, and project the image into the selected area.

[0187] In the example shown, the location in the area where the first user 10 is located that is advantageous for viewing the image is the first area 1010. However, displaying an image in the first area 1010 may have an impact on the second user 20. Therefore, the electronic device 100 can determine the second area 1020, which is not within the second user's viewing area among multiple areas, as the area where the image will be displayed.

[0188] In this situation, the electronic device 100 can provide a message notifying that it is difficult to display an image in front of the first user 10 (i.e., the first area 1010). Furthermore, while it has been shown and explained above that an image can be projected in another area away from the second user 20's gaze, when the second user 20 is in a do-not-disturb mode, the electronic device 100 can recommend viewing the image in a space other than that space.

[0189] Figure 11 This is a diagram illustrating the movement operation of an electronic device when some of the multiple users have set a Do Not Disturb mode, according to an embodiment of the present disclosure.

[0190] Reference Figure 11 Multiple users 10 and 20 are located around electronic device 100. The first user 10 can set a Do Not Disturb mode for another user 20 who is not themselves. Optionally, electronic device 100 can recognize the state of user 20 and automatically set a Do Not Disturb mode based on the recognized state.

[0191] In such an environment, if an event occurs that should provide a notification to the first user, the electronic device 100 can perform an operation to move around the first user 10.

[0192] Here, in order not to disturb the second user 20 who has set to Do Not Disturb mode, the electronic device 100 can approach the first user 10 by using a route that maintains a predetermined distance from the second user 20. Furthermore, if it is unavoidable to move across a predetermined distance from the second user 20, the electronic device 100 can move by reducing its speed within that predetermined distance.

[0193] When the electronic device 100 is positioned around the first user 10 through such operation, the electronic device 100 can output a notification message corresponding to the event that has occurred as sound or image. Here, taking into account the distance from the second user 20, the electronic device 100 can output sound while reducing the volume, or display the message in an area not reached by the second user 20's gaze.

[0194] Furthermore, while the above description shows and explains that the above operations are performed only on humans, in actual implementation, the electronic device 100 can perform the above operations on animals located in space.

[0195] For example, if you have a dog at home and the dog is sleeping, you can move while avoiding the dog. Furthermore, if you detect an animal in your path while moving, you can change your route or move while slowing down.

[0196] Figure 12 This is a diagram illustrating the display operation of an electronic device when some of the multiple users have set a do-not-disturb mode, according to an embodiment of the present disclosure.

[0197] Reference Figure 12 The diagram is used to show the image projection area when a first user 10 without Do Not Disturb mode and a second user 20 with Do Not Disturb mode set are in the same space.

[0198] As shown in the figure, the gaze areas 9 and 21 of each user 10 and 20 can have an angle of approximately 120 degrees based on the user center.

[0199] Therefore, if the image projected by the electronic device 100 is located within the gaze region 21 of the second user 20, the second user 20 may be disturbed by the image. Therefore, if a request for image projection is input from the first user 10, the electronic device 100 can identify each user's gaze (or posture) and identify each user's gaze region.

[0200] For example, electronic device 100 can identify the gaze direction (or head direction, torso direction) of each user and identify a fan-shaped gaze area with a predetermined angle (e.g., 120 degrees) based on the identified gaze direction (or head direction).

[0201] Then, the electronic device 100 can project the image 1220 within the gaze area 1210, which is the gaze area where only the first user 10 can view the image. Furthermore, taking into account the gaze area 1210, which is the gaze area where only the first user 10 can view the image, and the gaze direction of the first user 10, the electronic device 100 can determine a suitable position and size, and display the image at the determined position and size.

[0202] Furthermore, considering not only the image displayed in the projection of the image, but also the gray area around the image, the electronic device 100 can exclude the gray area from the gaze of the second user 20.

[0203] Furthermore, in the example shown, it is assumed that the gaze regions of the two users overlap. However, if the gaze regions of the two users do not overlap, the area where the image will be projected can be determined by further expanding the gaze range of user 20 who has set to Do Not Disturb mode.

[0204] For example, the gaze direction described above is based on the assumption that the user is facing forward, but if the user rotates their neck (or head), the gaze direction can be expanded. Therefore, when determining the gaze direction (or gaze area) of a second user, the rotation radius of the second user's head (or neck) can be considered to determine the area for projection. If the rotation radius of the head is considered, and if there is no area for projection or the area for projection becomes very small, the area for projection can be determined by considering only the gaze area as described above.

[0205] Figure 13 This is a diagram illustrating the display operation of an electronic device when some of the multiple users have set a do-not-disturb mode, according to an embodiment of the present disclosure.

[0206] Reference Figure 13 The electronic device 100 according to this disclosure is movable and can project images by a projection method.

[0207] Furthermore, in order to project images at various heights or angles, the electronic device 100 can adjust the projection direction of the image. For example, the electronic device 100 can rotate the main body on which the projector (or display) is arranged, and adjust the angle of the projected image by changing the orientation of the main body. For example, the electronic device 100 can adjust the projection direction of the electronic device 100 by various methods, such as adjusting the height of the suspension connecting the front and rear wheels of the main body, or adjusting the display angle in the main body.

[0208] Furthermore, the electronic device 100 can adjust the display height or angle of the image by adjusting the angle of the lens or reflector in the projector. Additionally, in the implementation example, the angle can be adjusted by combining two methods (e.g., the angle of the lens and the orientation of the subject).

[0209] As described above, since images can be projected at various angles and directions, the electronic device 100 can project images into various areas within a space.

[0210] For example, as shown in the figure, electronic device 100 can acquire four projection areas in space. The acquisition of these projection areas can be performed by scanning the surrounding space based on user commands for displaying images, as described above, or spatial information generated from previous scanning operations can be used. For example, electronic device 100 can acquire areas with a predetermined color, in which obstacles are not located in the space, and with an area greater than or equal to a specific size as the aforementioned projection areas.

[0211] In the following description, we assume that four projection areas are obtained by scanning the surrounding space as described above (1310). In such an environment, if a first user 10 (without Do Not Disturb mode set) and a second user 20 (with Do Not Disturb mode set) are in such an environment, and the first user 10 inputs a command to display an image, the electronic device 100 can exclude projection areas located within the second user 20's gaze area (first priority, third priority) from the multiple projection areas, and determine one of the remaining projection areas (second priority, fourth priority) as the area where the image will be projected (1320). For example, in the example shown, the projection areas of the first and third priorities are located within the second user's gaze area, so the electronic device 100 can determine one of the second or fourth priorities as the projection area. Here, since the second priority has a higher priority than the fourth priority, the electronic device 100 can determine that the image will be projected into the projection area of ​​the second priority.

[0212] When the area for projection is determined as above, the electronic device 100 can move to a position suitable for projecting an image on the determined area, and at that position, project the image onto the determined projection area (1330).

[0213] Furthermore, sound output is also necessary during the reproduction of content such as movies. If a second user 20, who has set a do-not-disturb mode as shown in the figure, is nearby, sound output may be impossible. In this case, the electronic device 100 can perform speech-to-text (STT) processing on the sound of the displayed content and display text instead of sound, or display subtitle information provided by the user-selected content (e.g., activate the subtitle function or display subtitles).

[0214] Furthermore, the example shown illustrates that there exists a projection area beyond the viewing range of the second user 20 within multiple projection areas, and an image is projected through this projection area. However, in the absence of a projection area beyond the viewing range of the second user 20, the electronic device 100 may, upon the user's request, not directly perform the display of the image, but instead determine a method to perform the display on the user terminal device of the user making the request. Optionally, the electronic device 100 may display a message requesting movement to another space that is not the aforementioned space.

[0215] Figure 14 This is a diagram illustrating the movement operation of an electronic device when some of the multiple users have set a Do Not Disturb mode, according to an embodiment of the present disclosure.

[0216] Figure 15 This is a diagram illustrating the movement operation of an electronic device when some of the multiple users have set a Do Not Disturb mode, according to an embodiment of the present disclosure.

[0217] Figure 14 and Figure 15 It is a diagram used to illustrate the movement of electronic devices when some of the users have set a Do Not Disturb mode.

[0218] Reference Figure 14 The system locates the first user 10, who has not set Do Not Disturb mode, and the second user 20, who has set Do Not Disturb mode.

[0219] If a first user 10 calls an electronic device 100, and a second user 20 is located between the first user 10 and the electronic device 100 in such an environment, then the electronic device 100 can... Figure 14 The movement shown is performed while maintaining a distance equal to a predetermined distance based on the position of the second user 20. This predetermined distance may be based on the sound (or noise dB) generated during the movement of the electronic device 100. In other words, the predetermined distance may be the distance at which a user in Do Not Disturb mode, with the electronic device 100 moved a predetermined distance or further, cannot perceive the sound generated by the movement of the electronic device 100.

[0220] In this regard, the predetermined distance can be set differently for each type of electronic device 100. Furthermore, each user may have different noise sensitivities. For example, some people may be sensitive to even low noise levels, while others may be insensitive to noise. Therefore, the electronic device 100 can store information about the noise sensitivity of each user and can use a distance corresponding to that noise sensitivity.

[0221] As described above, when the electronic device 100 moves in response to a call from the first user 10, if a second user 20 with a Do Not Disturb mode set is identified, the electronic device 100 can identify a predetermined distance based on a pre-acquired noise sensitivity, and can use the electronic device 100 to travel a route while maintaining the identified predetermined distance.

[0222] Furthermore, various movement routes for the electronic device 100 are possible if the electronic device 100 only needs to maintain a predetermined distance. For example, in the example shown, various routes are possible, such as the electronic device 100 moving to the rear of the second user 20 and moving to the front of the second user 20.

[0223] In this situation, electronic device 100 can avoid the second user's gaze area among multiple routes, or use the route where electronic device 100 is included in the gaze area for the shortest time.

[0224] If as Figure 15 The electronic device 100 shown does not have a route that can be moved at a predetermined distance from the second user 20. That is, if the distance is blocked by a wall or the current position is a passage, the electronic device 100 can determine the route of movement within a specific distance from the second user 20.

[0225] Furthermore, when moving along the route, if the distance to the second user 20 is within a predetermined distance, the electronic device 100 can reduce its moving speed, thereby reducing noise generated by the movement. Then, if the distance to the user increases again, the electronic device 100 can move to the first user 10 at its original driving speed.

[0226] Furthermore, the speed change described above can be in a step-by-step form. Alternatively, the speed change can be linear. For example, a step-by-step speed change can be used if no noise is generated by the speed change. Conversely, if noise is generated during the step-by-step speed change, a method of linearly increasing or decreasing the speed can be used.

[0227] Figure 16 This is a diagram illustrating user identification operations according to embodiments of the present disclosure.

[0228] Specifically,Figure 16 This explains how to operate when the Do Not Disturb mode is directly set on the electronic device 100.

[0229] Reference Figure 16 In operation 1610, the user can set a Do Not Disturb mode via voice. Here, the electronic device 100 can receive the content of the voice through a microphone and recognize that it is a Do Not Disturb mode setting operation through voice recognition of the content of the voice.

[0230] Here, in order to identify who is being targeted by the Do Not Disturb mode, in operation 1620, the electronic device 100 may consider voice recognition, facial recognition, subject time, etc. to identify the speaker.

[0231] This identification can be based on pre-stored information for each user 11, 12, 13, and in operation 1630, it can be determined which of the pre-stored users the identified user is.

[0232] When a Do Not Disturb mode is set for a specific user among the pre-stored users as described above, in operation 1640, a Do Not Disturb mode can be set for that user.

[0233] If Do Not Disturb mode is set as described above, electronic device 100 can send a notification message to users other than the user who set Do Not Disturb mode through each user's user terminal device, indicating that Do Not Disturb mode has been set.

[0234] Furthermore, while the above explanation explained how to set a speaker to Do Not Disturb mode based on the user's words, in actual implementation, it is possible to set another object besides the speaker. For example, for a child who cannot yet speak, his / her parents, rather than the child, can say "Set Do Not Disturb mode for the child!", and the electronic device 100 can set Do Not Disturb mode for the child 11, 12, 13 according to the voice command without needing to analyze the speaker separately.

[0235] Furthermore, in practice, another person can restrictively set the speech prohibition mode. As mentioned above, the speech prohibition mode can be set for children, or it can be set only for animals that are not human.

[0236] Furthermore, while the above explanation clarifies the setting of a Do Not Disturb mode for pre-registered users, if the user requesting the Do Not Disturb mode is not a registered user, the electronic device 100 may ignore the command or, depending on the settings, register the user as a new user. Optionally, the electronic device 100 may perform a confirmation process, such as receiving confirmation from another user registering a new user or confirming that a new user has permission to use the electronic device 100.

[0237] Figure 17This is a diagram illustrating an example of a method for disabling Do Not Disturb mode according to an embodiment of the present disclosure.

[0238] Reference Figure 17 In operation 1710, the state of calling an electronic device while the user has set a speech-prohibited mode is illustrated. For example, the user can speak the calling name of the electronic device. Such calling names can be set differently. Furthermore, although calling an electronic device via the user's voice is shown, in actual implementation, the electronic device can also be called using a remote control that can control the electronic device, a user terminal device, etc.

[0239] If such a call is generated, in operation 1720, electronic device 100 can identify the user and display a message, or output a notification that its current Do Not Disturb mode has been set.

[0240] In response to displaying a message or outputting a notification as described above, if the Do Not Disturb mode setting is canceled via voice or interactive input, then in operation 1730, the electronic device 100 can cancel the Do Not Disturb mode for the user who made the request.

[0241] The above text shows and explains how to deactivate Do Not Disturb mode by requiring additional confirmation from the user. However, in practice, if a user's call or a request for a specific action is entered, Do Not Disturb mode can be deactivated without a separate confirmation process.

[0242] Figure 18 This is a diagram illustrating an example of a method for disabling Do Not Disturb mode according to an embodiment of the present disclosure.

[0243] Reference Figure 18 This demonstrates the operation when a user approaches an electronic device 100 while the user has set a speech mute mode.

[0244] If a user approaches within a specific distance, in operation 1810, the electronic device 100 can display a notification message that a Do Not Disturb mode has been set for the current user.

[0245] Users who recognize such messages can request to undo Do Not Disturb mode via voice command or other interaction, and electronic device 100 can respond to such requests to undo Do Not Disturb mode for users.

[0246] Furthermore, while the above description illustrates and explains the setting state of the electronic device 100 displaying a do-not-disturb mode in response to the approach of a specific user, in actual implementation, the electronic device 100 may move to another area in response to the user's approach, thus not interfering with the user's movement. Moreover, after the user approaches, the electronic device 100 may maintain that position for a predetermined period of time, or, if a voice command requesting a specific operation is spoken, the electronic device 100 may perform the aforementioned operation to deactivate the do-not-disturb mode.

[0247] Figure 19 This is an illustration of an example of a user interface window displaying the state of a Do Not Disturb mode for each user, according to an embodiment of the present disclosure.

[0248] Reference Figure 19 The user interface window 1900 displays the status of the Do Not Disturb mode for each of the multiple users.

[0249] Specifically, the user interface window 1900 includes a user information area 1910 and a status display area 1920.

[0250] User information area 1910 is the area that displays the user of the electronic device.

[0251] The status display area 1920 is an area that indicates whether each user's Do Not Disturb mode is set in the position corresponding to each user's name (or nickname, etc.).

[0252] As described above, the user interface window 1900 comprehensively displays the Do Not Disturb mode settings for each user, allowing users to easily identify the status of other users. Furthermore, users can directly change their Do Not Disturb status on the user interface window 1900.

[0253] Additionally, if a specific user's Do Not Disturb status is maintained for a predetermined time or longer, the user interface window 1900 may display a message (1930) notifying the specific user that the Do Not Disturb status has been maintained for a long time.

[0254] Furthermore, in the illustrated example, an example is presented in which, if a particular user's Do Not Disturb state has been maintained for a long time, a user interface window 1900 that can be displayed on each user terminal device is used, making the user interface window 1900 recognizable to other users. However, in a practical implementation, the electronic device 100 may send a message to the user terminal device corresponding to the user who requested Do Not Disturb for a predetermined time or longer, notifying that the current setting has been maintained for a long time.

[0255] Furthermore, the user interface window 1900 described above can be generated at the electronic device 100 and provided to the user terminal device. Alternatively, the user interface window 1900 can be generated by a home server (or a separate server) that continuously manages the user's do-not-disturb mode status and provided to the user terminal device.

[0256] Figure 20 This is a diagram illustrating an example of a method for disabling Do Not Disturb mode according to an embodiment of the present disclosure.

[0257] Furthermore, while examples of canceling Do Not Disturb mode through user requests have been shown and explained above, Do Not Disturb mode can be canceled not only in the above situations, but also without a direct request from the user.

[0258] Reference Figure 20 User 10, who has not set Do Not Disturb mode, and user 20, who has set Do Not Disturb mode, are both in a specific space. This explains the situation where the first user is watching content, and the second user 20', who has set Do Not Disturb mode, subsequently joins and watches content together.

[0259] In this state, if the second user's Do Not Disturb mode setting is maintained, operations such as stopping the output of content to the first user or changing the projection direction to a direction different from the second user's viewing direction should be performed.

[0260] However, when the movement of the second user 20 can be interpreted as the second user 20 watching content with the first user 10, the electronic device 100 can deactivate the Do Not Disturb mode setting for the second user 20 if the second user 20 is watching specific content with the first user.

[0261] When the Do Not Disturb mode setting for the second user 20 is lifted as described above, the electronic device 100 can perform operations such as lifting restrictions on the audio output of the content or expanding the projection area.

[0262] Figure 21 This is an illustration of an example of a user interface window that notifies another person of the state of a Do Not Disturb mode according to an embodiment of this disclosure.

[0263] Reference Figure 21 This is an example of a user interface window 2100 that can be displayed when a person with Do Not Disturb mode set is near their surroundings.

[0264] It can be recognized that the user interface window 2100 displays information 2110 that the sound is not output because the person in the Do Not Disturb mode is nearby and the corresponding image.

[0265] Therefore, users can identify the state where the volume is reduced or no sound is output based on message 2110.

[0266] Furthermore, if such a message is displayed, the user can control the electronic device 100 to provide a message to nearby users who have set up Do Not Disturb mode, requesting that they cancel Do Not Disturb mode, or request that content be displayed in another space that is not the current space.

[0267] In the first scenario, electronic device 100 can send a message to another user who has set up Do Not Disturb mode, requesting that the current user cancel Do Not Disturb mode. If the user who has set up Do Not Disturb mode cancels Do Not Disturb mode by sending the above message, electronic device 100 can increase the volume of the content or output sound.

[0268] In the second case, the electronic device 100 can determine the optimal location by considering the location of the user who has set the Do Not Disturb mode (i.e., without affecting the location of the user who has set the Do Not Disturb mode), and suggest that the user who is currently watching the content move to the determined location.

[0269] Figure 22 This is an illustration of an example of a user interface window for setting a do-not-disturb mode according to an embodiment of the present disclosure.

[0270] Reference Figure 22 This shows an example of a user interface window 2200 displayed on a user terminal device when the Do Not Disturb mode includes multiple levels instead of a single level.

[0271] User interface window 2200 indicates multiple Do Not Disturb modes.

[0272] For example, in Do Not Disturb mode, you can disable interference only for notifications and movement, or you can disable interference for all states such as projection and proximity.

[0273] Furthermore, the example shown illustrates two levels of settings, but in actual implementations, it is possible to set the levels in greater detail, and to set interference blocking for each operation or each type of notification.

[0274] Figure 23 This is a diagram illustrating a control method for an electronic device according to an embodiment of the present disclosure.

[0275] Reference Figure 23 In operation S2310, a do-not-disturb mode setting is stored for each of the multiple users using the electronic device. This do-not-disturb mode for each user can be based on the user's voice command or on information set in each user's terminal device.

[0276] Then, in operation S2320, it is determined whether a predetermined event has occurred. For example, a predetermined event could be a call from a specific user or a request to perform a specific operation. Furthermore, a predetermined event could be the arrival of a predetermined notification time or receiving notification information via the home network. Moreover, the aforementioned calls can be not only calls directly input through the microphone of electronic device 100, but also calls input through the microphone of a user terminal device. For example, if the calling name of the electronic device is "Partner," the user can input the voice command "Call Partner!" using the user terminal device. If such a voice command is input, the user terminal device can provide electronic device 100 with notification that such a call has been performed.

[0277] If an event occurs, the electronic device 100 can perform an operation corresponding to the event for the first user who has not set a do-not-disturb mode. Here, in operation S2330, the electronic device 100 can first identify whether the second user who has set a do-not-disturb mode is in the surrounding environment before performing the operation corresponding to the aforementioned event. For example, for such identification regarding the presence of the second user, an image captured by a camera inside the electronic device 100 can be used, or information such as the distance to the second user's user terminal device can be used.

[0278] If it is detected that the electronic device 100 has moved a predetermined distance or further away from the second user who has set to Do Not Disturb mode, then in operation S2340, the electronic device 100 can perform the work or notification operation requested by the first user in normal mode.

[0279] Conversely, when a second user in Do Not Disturb mode is within a predetermined distance, in operation S2350, electronic device 100 can perform the work or notification operation requested by the first user in Do Not Disturb mode. That is, electronic device 100 can perform operations such as outputting sound at a lower volume than in normal mode, or displaying an image so that the image is not displayed in the second user's viewing area.

[0280] Furthermore, if it is difficult to perform the operation according to the first user's request, the electronic device 100 may display a message notifying the presence of a user in the vicinity who has set a Do Not Disturb mode. Additionally, the electronic device 100 may display an inquiry message asking whether the requested operation can be performed in another space besides the current one.

[0281] As described above, in the control method of the electronic device according to the embodiments of this disclosure, other users can use the electronic device even when a specific user has set a Do Not Disturb mode. Furthermore, when performing an operation based on a user's request, if the user who has set a Do Not Disturb mode is nearby, the operation can be performed in Do Not Disturb mode, or the user requesting the specific operation can be asked to move to another space, thus minimizing interference with the user who has set a Do Not Disturb mode.

[0282] Figure 24 This is a flowchart illustrating the display operation in Do Not Disturb mode according to embodiments of the present disclosure.

[0283] Reference Figure 24 In operation S2405, the second user can set a Do Not Disturb mode. This setting can be executed via voice command or settings on the user's terminal device. Furthermore, the aforementioned settings on the user's terminal device can be not only the Do Not Disturb mode settings for electronic device 100, but also the Do Not Disturb mode settings for the user's terminal device itself. That is, if the user sets a Do Not Disturb mode that restricts the operation of their terminal device, electronic device 100 can automatically set a Do Not Disturb mode for the user by interlocking with this setting.

[0284] When a Do Not Disturb mode is set for a specific user as described above, the location of the user who has set the Do Not Disturb mode is obtained in operation S2410. For example, the location of the user who has set the Do Not Disturb mode can be identified by using an image taken at the electronic device 100 or by using the distance between the user's user terminal devices.

[0285] When Do Not Disturb mode is set and the user's location is identified as described above, in operation S2415, the electronic device 100 can set an area within a predetermined distance of the user's current location as a no-interference zone. Furthermore, if the electronic device 100 has map information including information about multiple rooms, it can set no-interference zones on a room-by-room basis.

[0286] In this state, during operation S2420, the electronic device 100 can provide services corresponding to the request of the first user.

[0287] Here, in operation S2425, the electronic device 100 can identify whether the location for performing the operation requested by the first user is within a predetermined distance from the second user who has set a do-not-disturb mode. If the distance is increased, the electronic device 100 can perform the operation according to the request of the first user, and if the location is within the predetermined distance but not in the same space, in operation S2455, the electronic device 100 can perform the operation at a lower volume than in normal mode.

[0288] Furthermore, if a second user is identified in the current space according to the user's request in operation S2425, the electronic device 100 can identify the gaze direction (or head direction) of the first and second users in operations S2430 and S2435. For example, the electronic device 100 can identify the gaze direction of the two users by taking pictures of the two users with a camera and by using the captured images.

[0289] When two gaze directions are identified, in operation S2440, the electronic device 100 can determine the projection area that is not included in the gaze direction of the second user but is included in the gaze direction of the first user.

[0290] Furthermore, if the size of the determined projection area is smaller than the predetermined size, or if the projection area cannot be determined in operation S2445-No, the electronic device 100 may determine that the first user's request cannot be executed in the current state, and in operation S2450, reproduce the image on the first user's user terminal device or notify the user to move to another space.

[0291] If the projection area is determined, in operation S2455, the electronic device 100 can display an image on the determined projection area.

[0292] Figure 25 This is a flowchart illustrating the setting state of changing Do Not Disturb mode according to embodiments of the present disclosure.

[0293] Reference Figure 25 In operation S2505, the second user can set a Do Not Disturb mode. When a Do Not Disturb mode is set for a specific user as described above, in operation S2510, the location of the user who set the Do Not Disturb mode is obtained. When the Do Not Disturb mode is set and the user's location is identified as described above, in operation S2515, the electronic device 100 can set an area within a predetermined distance based on the user's current location as an interference-prohibited zone. Because of the above... Figure 24 The operations in S2505-S2515 are explained in the text, so repeated explanations will be omitted.

[0294] First, the operation will be explained in the case where a request related to music reproduction is input from a first user. For example, if a user requests the reproduction of music, in operation S2520, the electronic device 100 can perform the reproduction of the requested music.

[0295] Here, in operation S2525, the electronic device 100 can identify whether the location for performing the operation requested by the first user is within a predetermined distance from the second user who has set a do-not-disturb mode. If the distance is increased, the electronic device 100 can perform the operation according to the first user's request and operate at a normal volume. If they are not in the same space but within the predetermined distance, in operation S2530, the electronic device 100 can perform the operation at a lower volume than in normal mode. This criterion can be a distance standard, or it can be determined based on the distance between the electronic device 100 and the second user, the current volume, etc., and whether the sound is audible to the second user.

[0296] If the current volume is determined to be a volume that the second user can hear, then in operation S2530, the electronic device 100 can perform an operation to reduce the output volume.

[0297] Furthermore, in operation S2535, it can be further determined whether the determined output volume can be heard by the first user. For example, if the volume is reduced to account for the second user, but cannot be heard by the first user, the second user may not be able to recognize whether an operation requested by the second user is being performed.

[0298] Therefore, in operation S2540, the electronic device 100 can perform operations such as displaying a message to the first user that the volume has been reduced, or requesting the first user to move to another location, or requesting permission from the first user or the second user to increase the volume.

[0299] Furthermore, if the first user's request is a call to electronic device 100, then electronic device 100 can move to the vicinity of the first user in response to the first user's request. Moreover, in the example shown, it is explained that electronic device 100 moves to the vicinity of the first user in response to the first user's request; however, if the first user's request is to move to a specific location, electronic device 100 can move to a specific space according to the first user's request.

[0300] Furthermore, if, during operation S2560-, a second user who has set a Do Not Disturb mode is identified during the aforementioned movement, then in operation S2565, the electronic device 100 can move while maintaining a predetermined distance from the second user, or perform movement in a Do Not Disturb mode with adjusted movement speed during the movement. The following will... Figure 26The document provides a detailed description of the operation.

[0301] Figure 26 This is a flowchart illustrating the driving operation in Do Not Disturb mode according to an embodiment of the present disclosure.

[0302] Reference Figure 26 In operation S2605, the second user can set a Do Not Disturb mode. If a Do Not Disturb mode is set for a specific user as described above, then in operation S2610, the location of the user who set the Do Not Disturb mode is obtained. When the Do Not Disturb mode is set and the user's location is identified as described above, in operation S2615, the electronic device 100 can set an area within a predetermined distance based on the user's current location as an interference-prohibited zone. Because of the above... Figure 24 The operations in S2605-S2615 are explained in the text, so repeated explanations will be omitted.

[0303] Furthermore, if the first user's request is a call to electronic device 100, then in operation S2620, electronic device 100 can move to the first user's surrounding environment in response to the first user's request. Moreover, in the example shown, it is explained that electronic device 100 moves to the first user's surroundings in response to the first user's request; however, if the first user's request is to move to a specific location, electronic device 100 can move to a specific space according to the first user's request.

[0304] Furthermore, if a second user with a Do Not Disturb mode set is identified during the aforementioned movement in operation S2625-Yes, then in operation S2640, the electronic device 100 can determine whether it can move along the movement route while maintaining a predetermined distance or greater from the second user. If, in operation S2630-Yes, it is possible to move along the movement route while maintaining a predetermined distance or greater from the second user, then in operation S2635, the electronic device 100 moves while maintaining a predetermined distance from the second user.

[0305] If, in operation S2630-No, it is impossible to move along the path while maintaining a predetermined distance or greater distance from the second user, then in operation S2640, the electronic device 100 can identify whether it is possible to move in a direction opposite to the second user's gaze direction.

[0306] If it is not possible to move in the direction opposite to the gaze direction, in operation S2645, the electronic device 100 can temporarily release the drive restriction area and move by reducing speed.

[0307] If movement in the opposite direction to the gaze direction is possible, then in operations S2650 and S2655, the electronic device 100 can obtain the gaze directions of both users, and in operation S2660, movement is performed by setting a movement route to avoid the gaze direction of the second user. Here, within a predetermined distance from the second user, the electronic device 100 can move by reducing its movement speed, and if the electronic device 100 moves away from the second user by a distance greater than or equal to a certain distance, then in operation S2665, the electronic device 100 can move at a normal speed.

[0308] Furthermore, the methods of at least some of the above embodiments of the present disclosure can be implemented in the form of an application that can be installed on a conventional electronic device.

[0309] Furthermore, at least some of the methods in the various embodiments of this disclosure can be implemented using only software or hardware upgrades of conventional electronic devices.

[0310] Furthermore, at least some of the methods in the various embodiments of this disclosure described above can be executed by an embedded server disposed on an electronic device or by an external server of at least one of the electronic devices.

[0311] Furthermore, according to embodiments of this disclosure, the various embodiments described above can be implemented as software including instructions stored in a machine-readable storage medium, which can be read by a machine (e.g., a computer). A machine refers to a device that invokes instructions stored in the storage medium and can operate according to the invoked instructions, and the device may include an electronic device (e.g., electronic device A) according to embodiments of this disclosure. Where the instructions are executed by a processor, the processor may perform the function corresponding to the instructions itself, or by using other components under its control. Instructions may include code generated or executed by a compiler or interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" simply means that the storage medium is tangible and does not include signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is semi-permanently stored in the storage medium and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer for temporarily storing data.

[0312] Furthermore, according to embodiments, the methods according to the various embodiments described in this disclosure can be provided while being included in a computer program product. A computer program product refers to a product that can be traded between a seller and a buyer. The computer program product can be distributed in the form of a machine-readable storage medium (e.g., an optical disc read-only memory (CD-ROM)) or through an app store (e.g., the Play Store). TMThis can be done directly online (e.g., downloading or uploading) or distributed between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable application) may be stored, at least temporarily, on a storage medium readable by a machine such as the memory of a manufacturer's server, an app store's server, or a relay server, or may be temporarily generated.

[0313] It should be understood that various embodiments of the present disclosure according to the claims in the specification can be implemented in hardware, software, or a combination of hardware and software.

[0314] Any such software may be stored in a non-transitory computer-readable storage medium. The non-transitory computer-readable storage medium stores one or more computer programs (software modules) comprising computer-executable instructions that, when executed individually or jointly by one or more processors of an electronic device, cause the electronic device to perform the methods of this disclosure.

[0315] Any such software may be stored in the form of volatile or non-volatile memory (such as a storage device like read-only memory (ROM), whether erasable or rewritable), or in the form of memory such as random access memory (RAM), memory chips, devices, or integrated circuits, or on optically or magnetically readable media (such as, for example, compact discs (CDs), digital versatile discs (DVDs), magnetic disks, or magnetic tapes). It will be understood that storage devices and storage media are various embodiments of non-transitory machine-readable storage suitable for storing one or more computer programs comprising instructions that, when executed, implement various embodiments of this disclosure. Therefore, various embodiments provide programs comprising code for implementing the apparatus or methods claimed in any of the claims of this specification, and non-transitory machine-readable storage for storing such programs.

[0316] Although this disclosure has been shown and described with reference to various embodiments thereof, those skilled in the art will understand that various changes in form and detail may be made therein without departing from the spirit and scope of this disclosure as defined by the appended claims and their equivalents.

Claims

1. An electronic device, comprising: monitor; sensor; Mobile device, moving the electronic device; Memory, storing at least one instruction; as well as At least one processor is connected to the display, the sensor, the mobile device, and the memory. Wherein, the at least one instruction, when executed by the at least one processor, causes the electronic device to perform the following operations: Identify the Do Not Disturb mode setting status for each of the multiple users using the electronic device, and Based on the occurrence of a predetermined event, perform the corresponding operation for users who have not set Do Not Disturb mode.

2. The electronic device according to claim 1, wherein, When executed by the at least one processor, the electronic device also performs the following operations: Based on identifying a user in Do Not Disturb mode around the electronic device, perform an operation corresponding to the event in Do Not Disturb mode.

3. The electronic device according to claim 1, wherein, When executed by the at least one processor, the electronic device also performs the following operations: Based on the occurrence of an event that provides an image to a first user who has not set a do-not-disturb mode, the mobile device is controlled to move the electronic device to the vicinity of the first user; as well as Control the display to show an image corresponding to the event.

4. The electronic device according to claim 3, wherein, When executed by the at least one processor, the electronic device also performs the following operations: Based on the identification that a second user with Do Not Disturb mode set is within a predetermined distance, the mobile device is controlled to move the electronic device to a position in the area surrounding the first user that does not fall into the second user's field of vision.

5. The electronic device according to claim 1, further comprising: speaker, Wherein, the at least one instruction, when executed by the at least one processor, also causes the electronic device to perform the following operations: Based on the occurrence of an event that provides predetermined information to a user, the mobile device is controlled to move to the vicinity of a first user who has not set a do-not-disturb mode, and Control the speaker to output a sound corresponding to the event.

6. The electronic device according to claim 5, wherein, When executed by the at least one processor, the electronic device also performs the following operations: Based on the identification that a second user in Do Not Disturb mode is within a predetermined distance, the output volume of the sound corresponding to the event is reduced; and The speaker is controlled to output a sound corresponding to the event at a reduced output volume.

7. The electronic device according to claim 6, wherein, When executed by the at least one processor, the electronic device also performs the following operations: The output volume is determined based on the distance from the second user; and Based on the determination that the output volume is lower than the first user's identifiable volume, the display is controlled to show visual information corresponding to the sound to be output.

8. The electronic device according to claim 1, wherein, When executed by the at least one processor, the electronic device also performs the following operations: Based on an event that occurs where the device moves to the vicinity of a first user who has not set a Do Not Disturb mode, the mobile device is controlled to move to the vicinity of the first user. as well as Based on the identification of a second user who has set a do-not-disturb mode during the movement, the mobile device is controlled to move the electronic device along a route that keeps it at a predetermined distance from the second user.

9. The electronic device according to claim 1, wherein, When executed by the at least one processor, the electronic device also performs the following operations: Based on the occurrence of an event that the device moves to the vicinity of a first user who has not set a Do Not Disturb mode, a movement route for moving to the vicinity of the first user is set, and the device is controlled to move along the set movement route. as well as When the distance to the second user who has set the Do Not Disturb mode on the movement route becomes within a predetermined distance segment, the movement device is controlled to cause the electronic device to move by reducing the movement speed of the electronic device.

10. The electronic device according to claim 9, wherein, When executed by the at least one processor, the electronic device also performs the following operations: Obtain the gaze area of ​​the second user and set a movement route such that the movement route is not included in the gaze area.

11. The electronic device according to claim 1, further comprising: microphone, The sensors include a camera, and Wherein, the at least one instruction, when executed by the at least one processor, also causes the electronic device to perform the following operations: The speaker is identified by using voice input through the microphone and images captured by the camera. Based on the input voice command, set a do-not-disturb mode for the identified speaker or the user included in the voice command.

12. The electronic device according to claim 1, in, The sensors include a camera, and Wherein, the at least one instruction, when executed by the at least one processor, also causes the electronic device to perform the following operations: By using images captured by the camera to identify the user, and Based on the user's posture being a predetermined posture, a do-not-disturb mode is set for the identified user.

13. The electronic device according to claim 1, in, The memory also includes map information of the space where the electronic device is located, and Wherein, the at least one instruction, when executed by the at least one processor, also causes the electronic device to perform the following operations: Identify the spaces in the map information where users have set to Do Not Disturb mode, and the spaces where such users are located. Operate in the space where the user has set Do Not Disturb mode.

14. A control method for a portable electronic device, the control method comprising: Stores settings for a do-not-disturb mode for each of the multiple users using the mobile electronic device; as well as Based on the occurrence of a predetermined event, perform the corresponding operation for the first user who has not set the Do Not Disturb mode. The steps for performing the operation corresponding to the event include: based on the identification of a second user in the vicinity of the mobile electronic device who has set a do-not-disturb mode, performing the operation corresponding to the event in the do-not-disturb mode.

15. A non-transitory computer-readable recording medium storing one or more computer programs, said one or more computer programs comprising computer-executable instructions that, when executed individually or jointly by one or more processors of a portable electronic device, cause the portable electronic device to perform operations, said operations including: The system stores the Do Not Disturb mode settings for each of the multiple users using the mobile electronic device, and Based on the occurrence of a predetermined event, perform the corresponding operation for the first user who has not set the Do Not Disturb mode. The steps for performing the operation corresponding to the event include: based on identifying a second user in the vicinity of the mobile electronic device who has set a do-not-disturb mode, performing the operation corresponding to the event in the do-not-disturb mode.

Images