Method and apparatus for realizing virtual smoke

Abstract

The embodiment relates to a method for controlling an electronic device for implementing virtual smoke in a virtual display device, the method including the steps of monitoring a change in capacitance of the electronic device, predicting a time when virtual smoke will be implemented, and transmitting a control signal including the time when virtual smoke will be implemented to a device that displays a virtual image.

Description

Technical Field

[0001] The following embodiments relate to a method for controlling an electronic device for embodying virtual smoke in a virtual display device.

Background Art

[0002] In recent years, technologies of virtual reality (VR), augmented reality (AR), and mixed reality (MR) that apply computer graphics technology have been developed. Here, virtual reality technology refers to a technology that constructs a virtual space that does not exist in the real world using a computer and then makes the user feel the virtual space as if it were real. Augmented reality or mixed reality technology refers to a technology that adds information generated by a computer on top of the real world for expression, that is, a technology that enables real-time interaction with a user by combining the real world and the virtual world.

[0003] Among them, augmented reality and mixed reality technologies are being utilized in combination with technologies in various fields. In the field of electronic cigarettes, there is an increasing demand for devices that can realize virtual reality or augmented reality services, and various studies are being conducted in this regard.

Summary of the Invention

Problems to be Solved by the Invention

[0004] An embodiment is to detect a change in the distance between an electronic device and a user and predict the timing of embodying virtual smoke.

[0005] An embodiment is to transmit a control signal including the predicted timing of embodying virtual smoke to a virtual reality device, and to embody virtual smoke in virtual reality also at the time when the user exhales, so as to embody virtual smoke without a sense of heterogeneity.

[0006] The problems that this invention aims to solve are not limited to those described above, and any problems not mentioned can be clearly understood by a person with ordinary skill in the art to which this invention pertains from this specification and the accompanying drawings. [Means for solving the problem]

[0007] A control method for an electronic device according to one embodiment includes the steps of monitoring the distance between one side of the electronic device and an object and predicting the time of manifestation of virtual smoke, and transmitting a control signal including the time of manifestation of the virtual smoke to a device that displays a virtual image.

[0008] The step of predicting the time of manifestation of the virtual smoke may include detecting a first time point in time when the distance between one side of the electronic device and the object falls within a first threshold, and detecting a second time point in time after the first time point when the distance between one side of the electronic device and the object exceeds a second threshold.

[0009] The step of predicting the time of manifestation of the virtual smoke may include predicting the time of manifestation of the virtual smoke based on the interval between the first time point and the second time point.

[0010] The step of predicting the time of manifestation of the virtual smoke may include the steps of: predicting the first breathing time based on the interval between the first time and the second time; predicting the time of the second breathing based on the interval between the first time and the second time and the first breathing time; and determining the time of the second breathing as the time of manifestation of the virtual smoke.

[0011] The step of predicting the time of realization of the virtual smoke includes the step of estimating the user's inhalation volume and breathing volume based on the interval between the first time and the second time, wherein the inhalation volume includes the amount of aerosol inhaled by the user through the electronic device when the electronic device and the object are in contact, and the breathing volume includes the amount of air inhaled by the user when the electronic device and the object are not in contact.

[0012] The step of predicting the time of realization of the virtual smoke may include the step of predicting the time of realization of the virtual smoke based on the inhalation volume and the breathing volume.

[0013] The step of predicting the time of manifestation of the virtual smoke may include the step of determining whether the electronic device satisfies predetermined operating conditions, and the step of predicting the time of manifestation of the virtual smoke based on the determination that the electronic device satisfies the operating conditions.

[0014] The aforementioned operating conditions may include at least one of the following: whether the power to the electronic device is turned on or off, and whether the inhalation sensor included in the electronic device is operating.

[0015] The step of transmitting the control signal to a device that displays a virtual image may include the step of transmitting information about the type of virtual smoke and the step of transmitting information about the delay time that occurs in the communication between the electronic device and the device that displays the virtual image.

[0016] This may include a computer program stored on a computer-readable recording medium to be coupled with hardware to perform the aforementioned actions.

[0017] An electronic device according to one embodiment includes a distance detection sensor that monitors the distance between one side of the electronic device and an object, and a processor that predicts the time of manifestation of virtual smoke based on the monitoring results and transmits a control signal including the time of manifestation of the virtual smoke to a device that displays a virtual image.

[0018] The processor can detect a first time point in time when the distance between one side of the electronic device and the object falls within a first threshold, and after the first time point, detect a second time point in time when the distance between one side of the electronic device and the object exceeds a second threshold, thereby predicting the time of manifestation of the virtual smoke.

[0019] The processor can predict the time of realization of the virtual smoke based on the interval between the first time point and the second time point.

[0020] The processor can predict the first breathing time based on the interval between the first time point and the second time point, predict the time of the second breathing based on the interval between the first time point and the second time point and the first breathing time, predict the time of realization of the virtual smoke, and determine the time of the second breathing as the time of realization of the virtual smoke.

[0021] The processor estimates the user's inhalation volume and breathing volume based on the interval between the first time point and the second time point to predict the time of realization of the virtual smoke, wherein the inhalation volume includes the amount of aerosol inhaled by the user through the electronic device when the electronic device and the object are in contact, and the breathing volume includes the amount of air inhaled by the user when the electronic device and the object are not in contact.

[0022] The processor can predict the moment of realization of the virtual smoke based on the inhalation volume and the breathing volume.

[0023] The processor can determine whether the electronic device satisfies predetermined operating conditions, and based on the determination that the electronic device satisfies the operating conditions, it can predict the time of realization of the virtual smoke.

[0024] The aforementioned operating conditions may include at least one of the following: whether the power to the electronic device is turned on or off, and whether the inhalation sensor included in the electronic device is operating.

[0025] The control signal can include a control signal that transmits information regarding the type of virtual smoke and information regarding the delay time that occurs in communication between the electronic device and the device that displays the virtual image.

Advantages of the Invention

[0026] According to an embodiment, it is possible to detect a change in the distance between an electronic device and a user and predict the time point when virtual smoke is embodied.

[0027] According to an embodiment, a control signal including the predicted time point when virtual smoke is embodied is transmitted to a virtual reality device, and virtual smoke can be embodied in virtual reality even when the user exhales an actual aerosol, and virtual smoke without a sense of heterogeneity can be embodied.

[0028] The effects of the present invention are not limited to the effects described above, and effects not mentioned will be clearly understood by those having ordinary knowledge in the technical field to which the present invention pertains from this specification and the attached drawings.

Brief Description of the Drawings

[0029] [Figure 1] It is a diagram for explaining a virtual smoking system. [Figure 2A] It shows the smoking behavior of a user according to an embodiment classified by section. [Figure 2B] It shows in a block diagram the prediction of the time point when virtual smoke is embodied and the realization of virtual smoke in the smoking behavior of a user in a virtual space. [Figure 3] It schematically shows a device for displaying a virtual image. [Figure 4] It shows an example of an electronic device according to an embodiment. [Figure 5A] It shows an electronic device including a distance detection sensor according to an embodiment. [Figure 5B] It is a block diagram showing a method for predicting the time point when virtual smoke is embodied using a distance detection sensor according to an embodiment. [Figure 6A] It shows an electronic device including a capacitance sensor according to an embodiment. [Figure 6B] This is a block diagram showing a method for predicting the moment of appearance of virtual smoke using a capacitance sensor according to one embodiment. [Figure 7A] An electronic device including a direction change sensor according to one embodiment is shown. [Figure 7B] This is a block diagram showing a method for predicting the time of appearance of virtual smoke using an orientation change sensor according to one embodiment. [Figure 8A] An electronic device including a camera according to one embodiment is shown. [Figure 8B] This is a block diagram showing a method for predicting the moment of appearance of virtual smoke using a camera according to one embodiment. [Figure 9A] An electronic device including a pressure sensor and a button according to one embodiment is shown. [Figure 9B] This is a block diagram showing a method for predicting the moment of appearance of virtual smoke using a pressure sensor according to one embodiment. [Figure 10A] This image shows a user wearing a surface electromyography sensor module included in an XR device according to one embodiment. [Figure 10B] This is a block diagram showing a method for predicting the time of appearance of virtual smoke using a surface electromyography sensor according to one embodiment. [Figure 11A] This image shows a user wearing an electroencephalogram (EEG) measurement module included in an XR device according to one embodiment. [Figure 11B] This block diagram shows a method for predicting the moment of appearance of virtual smoke using an electroencephalogram (EEG) measurement module, according to one embodiment. [Figure 12A] An electronic device including a pressure sensor according to one embodiment is shown. [Figure 12B] This is a block diagram showing a method for predicting the time of appearance of virtual smoke using a camera and a pressure sensor according to one embodiment. [Modes for carrying out the invention]

[0030] The specific structural or functional descriptions of the embodiments are disclosed for illustrative purposes only and may be modified in various ways. Therefore, the embodiments are not limited to any particular disclosure, and the scope of this specification includes modifications, equivalents, or substitutions that are part of the technical concept.

[0031] Terms such as "first" or "second" may be used to describe multiple components, but such terms should be interpreted solely for the purpose of distinguishing one component from others. For example, the first component can be named the second component, and similarly, the second component can also be named the first component.

[0032] When it is mentioned that one component is “linked” or “connected” to another component, it should be understood that it is directly linked to or connected to the other component, but that other components may be present in between.

[0033] The terms used herein are used solely to describe specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this specification, terms such as “includes” or “having” indicate the presence of features, figures, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood not to preemptively exclude the possibility of the presence or addition of one or more other features, figures, steps, actions, components, parts, or combinations thereof.

[0034] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as those generally understood by a person of ordinary skill in the art to which this embodiment belongs. Commonly used, predefined terms should be interpreted as having the meaning consistent with their meaning in the context of the relevant art, and not as ideal or overly formal unless expressly defined herein.

[0035] The embodiments will be described in detail below with reference to the attached drawings. In the description with reference to the attached drawings, the same components will be given the same reference numerals regardless of the reference numerals in the drawings, and redundant explanations will be omitted.

[0036] Figure 1 is a diagram illustrating a virtual smoking system according to one embodiment.

[0037] Referring to Figure 1, the virtual smoking system 100 includes a device 110 (hereinafter referred to as the display device) that displays a virtual image and an electronic device 120. A user 10 using the virtual smoking system 100 can wear the display device 110 and smoke via the electronic device 120. "Smoking" refers to heating, combustion, and other actions that cause the release of smoke or aerosol from a smoky substance. In one embodiment, the display device 110 can materialize virtual smoke in conjunction with the user 10's smoking activity via the electronic device 120.

[0038] More specifically, in one embodiment, the electronic device 120 may be named an aerosol generator, an e-cigarette device, or a smoking stick. The structure and specific operation method of the electronic device 120 will be described in detail below with reference to Figure 4.

[0039] In one embodiment, a user smokes using the electronic device 120, and as a result, smoke 142 is generated by the user's breathing. In one embodiment, the electronic device 120 can provide an aerosol to the user 10 by heating the aerosol product inside the electronic device 120 in various ways. For example, the aerosol product may be a stick inserted into the electronic device 120. As a different example, the aerosol product may be a replaceable cartridge inserted into the electronic device 120.

[0040] According to one embodiment, smoke 142 is generated by the user's respiration after inhaling the aerosol provided by the electronic device 120, but is not limited to this. According to another embodiment, the electronic device 120 may only measure the user's smoking behavior through the electronic device 120, in which case smoke 142 may not be generated by the user's respiration, but is not limited to this.

[0041] According to one embodiment, the display device 110 can independently provide virtual reality services or augmented reality services, or it can provide virtual reality services or augmented reality services in conjunction with the electronic device 120 or a third electronic device (e.g., a smartphone) that is wirelessly or wiredly connected to the display device 110. The structure and specific operation method of the display device 110 will be described in detail below with reference to Figure 3.

[0042] Virtual reality or augmented reality is considered to mean a visual simulation that generates a virtual or augmented visual environment. As used herein, the term “virtual reality” includes simulated images that are generated for visualization by the smoker and may include partially or fully simulated environments. The term “augmented reality” as used herein is considered to include a combination of simulated images used to augment a real or “live” environment, where the live image is used in combination with a simulated image overlaid on the live image. As a result of virtual or augmented reality, simulated virtual images are provided to form an interactive environment that can be seen or felt as real, or a live visual image may be augmented with a simulated augmented image. For the sake of explanation below, the space in which virtual or augmented reality is provided will be referred to as virtual space.

[0043] According to one embodiment, the display device 110 is worn by the user at a predetermined position (e.g., on the head) and can provide the user with images. For example, the display device 110 is configured in the form of at least one of glasses, goggles, a helmet, or a hat, but is not limited to these.

[0044] According to one embodiment, the electronic device 120 and the display device 110 may be connected via at least one wireless communication method, either short-range communication or cellular communication. For example, short-range communication may include at least one of Bluetooth®, BLE (Bluetooth Low Energy), or Wi-Fi (e.g., WiFi Direct). For example, cellular communication may include at least one of LTE (Long Term Evolution), LTE-A (LTE Advance), 5G (or NR (New Radio)), CDMA (Code Division Multiple Access), WCDMA® (Wideband CDMA), or GSM® (Global System for Mobile Communication). Alternatively, the electronic device 120 and the display device 110 may be connected via a wired connection based on the USB (Universal Serial Bus) method.

[0045] A virtual smoking system 100 according to one embodiment may further include a playback device 130. For example, the playback device 130 may be a device capable of providing sound to the user, and is not limited to the method of providing sound. The display device 110, the items 120, and the playback device 130 included in the virtual smoking system 100 work together to provide a further enhanced smoking experience to the user 10 using the virtual smoking system 100. In Figure 1, the display device 110 and the playback device 130 are shown separately, but depending on the embodiment, the display device 110 may include the playback device 130.

[0046] A display device 110 according to one embodiment may include one or more auxiliary devices. For example, the display device 110 may include an electroencephalogram (EEG) measurement module, a surface electromyography (EMG) sensor, etc., to enhance the sense of reality of smoking in the virtual space.

[0047] Figure 2A shows a classification of a user's smoking behavior by section according to one embodiment.

[0048] The explanation referring to Figure 1 also applies to the explanation referring to Figure 2A, and any overlapping content is omitted.

[0049] In one embodiment, a user performs a single act of smoking through the process from time t1 to time t4.

[0050] More specifically, referring to Figure 2A, in one embodiment, a user can inhale a smoky substance (e.g., an aerosol) through the electronic device 120 during the D1 interval from time t1 to time t2. The electronic device 120 can generate an aerosol in various ways. Hereinafter, the user's actions during the D1 interval will be referred to as the "smoke inhalation" action. Through the smoke inhalation action, the user can put the electronic device 120 to their mouth and inhale the smoky substance, collecting it in their mouth. During the D1 interval, the user and one side of the electronic device 120 (e.g., the inhalation port or mouthpiece) are in contact.

[0051] In one embodiment, the user inhales the smoke collected in their mouth via inhalation during the D2 interval between time t2 and time t3. Hereinafter, the user's actions during the D2 interval will be referred to as the "inhalation" action (or the "inhalation and hand-lowering" action), and the user separates one side of the electronic device 120 from their lips and lowers their hand while inhaling. During the D2 interval, the user and the electronic device 120 are separated.

[0052] In one embodiment, a user can exhale smoke inhaled through exhalation during the D3 interval between time t3 and time t4. Hereinafter, the user's actions during the D3 interval will be referred to as the "exhalation" action.

[0053] In one embodiment, the length of the D2 interval (inhalation time) can be estimated based on the length of the D1 interval (smoke inhalation time). For example, the length of the D2 interval (inhalation time) is proportional to the length of the D1 interval (smoke inhalation time). For example, if the smoke inhalation time is 1 second, the inhalation time may also be 1 second, and if the smoke inhalation time is 3 seconds, the inhalation time may also be 3 seconds. Alternatively, the inhalation time corresponding to the smoke inhalation time may be predicted using an artificial neural network. For example, the smoke inhalation time may be input to an artificial neural network trained on paired learning data of smoke inhalation time and inhalation time, and the corresponding inhalation time may be predicted. However, the method of estimating the inhalation time based on the smoke inhalation time is not limited to the above examples.

[0054] Being able to predict the length of the D2 interval (inspiratory time) means that we can predict t3 (exhalation time). In other words, by predicting the length of the D2 interval through measuring the length of the D1 interval (smoke inhalation time), and adding the predicted length of the D2 interval to the measured length of the D1 interval, we can predict t3 (exhalation time).

[0055] According to one embodiment, the length of the D3 interval (exhalation time) can be determined based on at least one of the lengths of the D1 interval (smoke inhalation time) and the D2 interval (inhalation time). For example, the length of the D3 interval can be determined to be proportional to the length of the D1 interval or the D2 interval. Based on the predicted t3 (exhalation time) and the length of the D3 interval, time t4 can be predicted.

[0056] According to one embodiment, the user can pre-set information regarding the length of the D3 section in the electronic device 120. For example, the ratio of the length of the D1 section or the length of the D2 section may be set according to the user. A user who wants to maintain a relatively long virtual smoke output time may set a larger ratio.

[0057] Figure 2B is a diagram illustrating the prediction of the moment when virtual smoke will materialize in a user's smoking activity in a virtual space, and how the virtual smoke will be realized.

[0058] The explanations referring to Figures 1 through 2A also apply to the explanations referring to Figure 2B, and redundant content is omitted.

[0059] In one embodiment of the virtual smoking system, the user can experience a virtual or augmented reality of smoking by linking smoking through an electronic device 120 in the real world with a display device 110. More specifically, the display device 110 in one embodiment can materialize virtual smoke in the virtual space at the moment the user actually exhales smoke through the electronic device 120, thereby materializing virtual smoke that does not feel alien.

[0060] In one embodiment, a user performs the act of smoking by repeating the actions D1 to D3 in Figure 2A at least once, and the display device 110 or electronic device 120 can detect or predict the user's inhalation, exhalation, and exhalation of tobacco smoke and materialize virtual smoke. Hereinafter, "materializing virtual smoke" may include determining at least one of the following: the time of materialization of the virtual smoke, its duration, and the external appearance of the virtual smoke (e.g., shape, color).

[0061] Referring to Figure 2B, once smoking by a user according to one embodiment begins 200, the user inhales a smoky substance via the electronic device 120 and collects it in their mouth. Here, the time the user inhales the tobacco smoke (e.g., D1 in Figure 2A) is measured 210. After the user finishes inhaling the smoke, the user performs an inhalation and hand-lowering motion. Here, the time the user inhales and lowers their hand (e.g., D2 in Figure 2A) is measured 220. The display device 110 or electronic device 120 can predict 230 the inhalation and hand-lowering time and the start of the user's exhalation (e.g., t3 in Figure 2A) based on the smoke inhalation time 210. Once the user begins exhaling, the display device 110 can materialize virtual smoke 240 during the time the user exhales (e.g., D3 in Figure 2A). After a predetermined time has elapsed since the start of exhalation, the display device 110 terminates the materialization of the virtual smoke 250.

[0062] Figure 3 schematically shows a device for displaying a virtual image.

[0063] Referring to both Figures 1 and 3, an XR device 310 is shown as an example of a display device 110 according to one embodiment. The XR device 310 includes a screen 320, a camera 330, and a temple portion 340. The XR device 310 may be a device for virtual reality (VR), augmented reality (AR), or the Metaverse, but this embodiment is not limited thereto.

[0064] More specifically, when a user wears the XR device 310, the temple portion 340 of the XR device 310 can be placed over the user's ears. However, the XR device 310 may also include a band instead of the temple portion 340, in which case the band may be worn over the user's head.

[0065] The XR device 310 can provide the user with a virtual reality, augmented reality, or metabus image of cigarette smoke being generated via the screen 320. In one embodiment, the screen 320 may be controlled to be transparent or opaque depending on the purpose of use. When the XR device 310 provides a virtual reality or metabus image, the screen 320 may be controlled to be opaque, and when the XR device 310 provides an augmented reality image, the screen 320 may be controlled to be transparent.

[0066] For example, the screen 320 may be made of a plastic material such as polycarbonate or a glass material, but is not limited thereto. Furthermore, the screen 320 may be coated with at least one of the following: a light-reflecting and glare-preventing coating, an anti-fogging coating, and an ultraviolet-blocking coating.

[0067] The virtual smoking system includes an XR device 310 and an article. The XR device 310 may receive content information from the article. Based on the content information of the article, the XR device 310 can change the image displayed on the screen 320.

[0068] In one embodiment, the screen 320 displays an image representing cigarette smoke, and the XR device 310 may change the image on the screen 320 relating to at least one of the following: the color of the cigarette smoke, the amount of cigarette smoke, and the shape of the cigarette smoke, based on information about the content of the article.

[0069] The camera 330 can scan the real-world surroundings when the user is using the XR device 310, assisting the user in using the XR device 310. The camera 330 may also monitor the user's movements and send control signals to the XR device 310.

[0070] The XR device 310 may have applications installed to provide users with a variety of experiences. For example, a smoking application may be installed to provide users with a smoking experience that closely resembles reality, thereby providing a virtual smoking system. However, this disclosure is not limited to this.

[0071] The XR device 310 may include electronic equipment for detecting or predicting a user's smoking behavior in a virtual smoking system. For example, it may include a surface electromyography sensor or an electroencephalography module to detect a user's smoking behavior. The XR device 310 may also include a communication device for communicating with an object, but this disclosure is not limited thereto.

[0072] Figure 4 shows an example of an electronic device according to one embodiment.

[0073] Referring to Figure 4, the electronic device 400 has the shape of a cigarette. The length and diameter of the electronic device 400 may be substantially the same as the length and diameter of a traditional cigarette. The electronic device 400 may be divided into a first end 410, an intermediate portion 420, and a second end 430. The electronic device 400 corresponds to the electronic device 120 described above with reference to Figure 1.

[0074] The first end portion 410 is a part for recreating the ignition point of a cigarette. The first end portion 410 may include an LED. For example, the first end portion 410 may include a red LED.

[0075] The second end 430 may contain nicotine. In one embodiment, the surface of the second end 430 may be coated with nicotine, or the second end 430 may contain an aerosol product inside. For example, when the aerosol product is heated, an aerosol containing nicotine may be generated. When a user puts the second end 430 of the electronic device 400 into their mouth and inhales the aerosol, nicotine is provided to the user. On the other hand, the second end 430 may further contain a fragrance portion containing a flavoring agent in addition to the aerosol product.

[0076] In one embodiment, the intermediate portion 420 serves to connect the first end portion 410 and the second end portion 430. The total length of the electronic device 400 is determined by the length of the intermediate portion 420, but when manufacturing the electronic device 400, the length of the intermediate portion 420 may be set so that the length of the electronic device 400 corresponds to the length of a typical cigarette.

[0077] In another embodiment, the electronic device 400 may include other electronic equipment or electronic circuits internally (e.g., in the intermediate portion 420) as an electronic device. For example, the electronic device 400 may include sensors for detecting the user's smoking behavior. The sensors may include, for example, sensors for detecting changes in distance, sensors for detecting changes in orientation, sensors for detecting changes in capacitance, and pressure sensors. The electronic device 400 may include other electronic equipment externally to the housing as an electronic device. For example, the electronic device 400 may include a camera for observing the user's smoking behavior. The electronic device 400 may have internal or external buttons for power adjustment functions, smoking pattern learning functions, or smoking detection functions. The electronic device 400 may include a communication device for communicating with the XR device 310 as an electronic device. However, this disclosure is not limited to electronic devices including sensors, cameras, or buttons.

[0078] Figure 5A shows an electronic device that includes a distance detection sensor according to one embodiment.

[0079] The explanations referring to Figures 1-4 also apply to the explanations referring to Figure 5A, and redundant content is omitted.

[0080] Referring to Figure 5A, an electronic device 500 according to one embodiment includes a first end 510, an intermediate portion 520, a second end 530, and a sensor portion 540. The first end 510, the intermediate portion 520, and the second end 530 may each have functions similar to those of the first end 410, the intermediate portion 420, and the second end 430 shown in Figure 4.

[0081] The sensor unit 540 according to one embodiment may include a distance detection sensor according to one embodiment. The distance detection sensor may be located inside or outside the second end portion 530. The distance detection sensor according to one embodiment may be an infrared, lidar, or ultrasonic sensor. However, the distance detection sensor of this disclosure is not limited to the above-mentioned methods.

[0082] Figure 5B is a block diagram showing a method for predicting the time of appearance of virtual smoke using a distance detection sensor according to one embodiment.

[0083] Referring to Figure 5B, when a user according to one embodiment begins smoking 550, a distance detection sensor monitors the distance between an object (e.g., the user's lips) and the electronic device 500 560. The electronic device 500 predicts the time of manifestation of virtual smoke 570 based on the monitoring results of the distance detection sensor. The electronic device 500 transmits a control signal including the predicted time of manifestation of virtual smoke to the display device 110 (or XR device 310) 580. The display device 110 can manifest virtual smoke 590 based on the control signal and provide the user with a smoking experience in a virtual space.

[0084] Referring to both Figures 5A and 5B, the smoking initiation step 550 according to one embodiment includes the step of the user bringing the electronic device 500 to their lips and performing the act of inhalation. The user turns on the power to begin heating the aerosol product in the electronic device 500, and the powered-on electronic device 500 preheats the heater that heats the aerosol product.

[0085] Step 560 of a distance detection sensor according to one embodiment, in which the distance between an object and an electronic device 500 is monitored, includes detecting a first point in time when the object is in contact with the second end 530 of the electronic device 500, and detecting a second point in time when the object is moving away from the second end 530 of the article.

[0086] For example, the step of detecting a first time point may include a distance detection sensor detecting that the second end 530 of the electronic device 500 and the object are within a distance of a first threshold.

[0087] For example, the step of detecting a second time point may include the distance detection sensor detecting that an object has made contact with the second end 530 of the electronic device 500 and has since moved away to a distance exceeding a second threshold.

[0088] Step 570 of predicting the time of realization of virtual smoke based on distance monitoring results according to one embodiment includes the step of predicting the time of realization of virtual smoke based on an interval between a first time and a second time. The first time is the time when the user begins inhaling the smoke. The interval between the first and second time is the time the user inhales the smoke, and the user's first breath time can be predicted based on the smoke inhalation time. The second time is the time when the user begins inhaling. The time of the second breath is predicted based on the interval between the first and second time and the first breath time. The time of the second breath is the time when the user begins exhaling. For example, the time of the second breath can be determined as the time of realization of virtual smoke.

[0089] According to one embodiment, since the user's smoke inhalation time is the interval between the first and second time points, the first breathing time, which is the time the user inhales, can be estimated in the same way as the smoke inhalation time. Subsequently, the electronic device 500 can predict the time of the second breath, which is the time when the user begins exhaling, as the time when the first breathing time has elapsed from the second time point.

[0090] For example, if the time between the first point in time when the object touches the second end 530 and the second point in time when the object is detached from the second end 530 is 1 second, then the first breathing time is estimated to be 1 second, and the time it takes for the user to inhale is also predicted to be 1 second, similar to the first breathing time. As a result, the time of the second breath, which occurs after the first breathing time has elapsed from the second point in time, can be predicted to be 1 second after the object has been separated from the electronic device 500. Therefore, the electronic device 500 can determine the time 1 second after the object has detached as the time of realization of the virtual smoke.

[0091] Step 570 of predicting the time of virtual smoke manifestation based on distance monitoring results according to one embodiment includes estimating the user's inhalation volume and breathing volume based on the interval between a first time point and a second time point. The user's inhalation volume may include the amount of aerosol inhaled by the user through the electronic device 500 when the electronic device 500 is in contact with an object. The user's breathing volume includes the amount of inspiratory air inhaled by the user when the electronic device 500 is not in contact with an object. Based on the estimated breathing volume and inhalation volume, the time of virtual smoke manifestation can be predicted.

[0092] Step 570 of predicting the time of realization of virtual smoke based on monitoring results according to one embodiment includes the step of determining whether the electronic device 500 satisfies predetermined operating conditions, and the step of predicting the time of realization of virtual smoke based on the determination that the electronic device 500 satisfies the operating conditions. The predetermined operating conditions may include at least one of the following: whether the user turns the electronic device 500 on or off, whether the puff sensor included in the electronic device is operating, and whether the pressure sensor included in the electronic device 500 is operating. The detection value of the distance detection sensor may change due to other objects that are not determined objects (e.g., fingers), but the user can enable the distance detection sensor to operate by turning on the power, and the user's inhalation can be detected via the puff sensor or pressure sensor, etc., and the distance detection sensor can be enabled. However, the inhalation sensor of this disclosure is not limited to the puff sensor or pressure sensor.

[0093] The step of transmitting a control signal to the display device 110, including the moment of realization of the virtual smoke according to one embodiment, includes transmitting information about the type of virtual smoke and transmitting information about the delay time that occurs in communication between the electronic device 500 and the display device 110. The type of virtual smoke may vary depending on the user's selection and may vary depending on the aerosol product or other fragrance component built into the second end 530. The control signal may also include information about the user's smoking amount, breathing rate, etc., and this disclosure is not limited thereto.

[0094] If the timing of virtual smoke manifestation does not coincide with the user's actual smoking behavior, or if the precise predicted timing cannot be determined, additional work may be performed to carry out a separate "exhalation prediction detection" process.

[0095] Figure 6A shows an electronic device that includes a capacitance sensor according to one embodiment.

[0096] The explanations referring to Figures 1-4 also apply to the explanations referring to Figure 6A, and any overlapping content is omitted.

[0097] Referring to Figure 6A, an electronic device 600 according to one embodiment includes a first end 610, an intermediate portion 620, a second end 630, and a sensor portion 640. The first end 610, the intermediate portion 620, and the second end 630 have functions similar to the first end 410, the intermediate portion 420, and the second end 430 in Figure 4, respectively.

[0098] The sensor unit 640 according to one embodiment may include a capacitive sensor according to one embodiment. The capacitive sensor may be located inside or outside the second end portion 630. The capacitive sensor according to one embodiment may be a sensor configured based on a capacitor. However, the capacitive sensor of this disclosure is not limited to the above-described method.

[0099] Figure 6B is a block diagram showing a method for predicting the time of appearance of virtual smoke using a capacitance sensor according to one embodiment.

[0100] Referring to Figure 6B, when a user according to one embodiment begins smoking 650, the capacitance sensor monitors 660 the change in capacitance of the capacitance sensor when an object (e.g., the user's lips) comes into contact with the electronic device 600. For example, the capacitance sensor may monitor the change in capacitance.

[0101] According to one embodiment, the electronic device 600 predicts the time of manifestation of virtual smoke based on the monitoring results of the capacitance sensor 670. The electronic device 600 transmits a control signal, including the predicted time of manifestation of virtual smoke, to the display device 110 (or XR device 310) 680. The display device 110 can manifest virtual smoke 690 based on the control signal and provide the user with a smoking experience in a virtual space.

[0102] Referring to both Figures 6A and 6B, a smoking initiation step 650 according to one embodiment includes the step of the user bringing the electronic device 600 into contact with their lips and performing the act of inhalation. The user turns on the power to begin heating the aerosol product in the electronic device 600, and the powered-on electronic device 600 preheats the heater that heats the aerosol product.

[0103] Step 660 of monitoring the capacitance that changes when an object and an electronic device 600 come into contact with a capacitance sensor according to one embodiment includes detecting a first point in time when the object comes into contact with the second end 630 of the electronic device 600, and detecting a second point in time when the object moves away from (or is removed from) the second end 630 of the article.

[0104] For example, the step of detecting the first time point may include the capacitance sensor detecting that the detected capacitance reaches a first threshold when an object comes into contact with the second end 630 of the electronic device 600.

[0105] For example, the step of detecting a second time point may include the capacitance sensor detecting that the capacitance detected when an object is removed after contact with the second end 630 of the electronic device 600 exceeds a second threshold.

[0106] Step 670 of predicting the time of realization of virtual smoke based on the capacitance monitoring results according to one embodiment includes the step of predicting the time of realization of virtual smoke based on the interval between a first time and a second time. The first time is the time when the user begins inhaling the smoke. The interval between the first time and the second time is the time the user inhales the smoke, and the user's first breathing time can be predicted based on the smoke inhalation time. The second time is the time when the user begins inhaling. The time of the second breath can be predicted based on the interval between the first and second time and the first breathing time. The time of the second breath is the time when the user begins exhaling. For example, the time of the second breath can be determined as the time of realization of virtual smoke.

[0107] According to one embodiment, since the user's smoke inhalation time is the interval between the first and second time points, the first breathing time, which is the time the user inhales, can be estimated in the same way as the smoke inhalation time. Subsequently, the electronic device 600 can predict the second breathing time, which is the time when the user begins exhaling, as the time when the first breathing time has elapsed from the second time point.

[0108] For example, if the time between the first point in time when the object touches the second end 630 and the second point in time when the object is detached from the second end 630 is 1 second, then the first breathing time is estimated to be 1 second, and the time it takes for the user to inhale is also predicted to be 1 second, similar to the first breathing time. As a result, the time of the second breath, which occurs after the first breathing time has elapsed from the second point in time, can be predicted to be 1 second after the object has been separated by the electronic device 600. This allows the electronic device 600 to determine the time 1 second after the object has been detached as the time of realization of the virtual smoke.

[0109] Step 670 of predicting the time of virtual smoke manifestation based on capacitance monitoring results according to one embodiment includes the step of estimating the user's inhalation volume and breathing volume based on the interval between a first time point and a second time point. The user's inhalation volume includes the amount of aerosol inhaled by the user through the electronic device 600 when the electronic device 600 is in contact with an object. The user's breathing volume includes the amount of air inhaled by the user when the electronic device 600 is not in contact with an object. Based on the estimated breathing volume and inhalation volume, the time of virtual smoke manifestation can be predicted.

[0110] Step 670 of predicting the time of realization of virtual smoke based on the capacitance monitoring results according to one embodiment includes the step of determining whether the electronic device 600 satisfies predetermined operating conditions, and the step of predicting the time of realization of virtual smoke based on the determination that the electronic device 600 satisfies the operating conditions. The predetermined operating conditions may include at least one of the following: whether the user turns the electronic device 600 on or off, whether the puff sensor included in the electronic device is operating, and whether the pressure sensor included in the electronic device 600 is operating. The detected value of the capacitance sensor may change due to other objects that are not predetermined objects (e.g., fingers), but the capacitance sensor is made to operate only when the user turns the power on or off, and the capacitance sensor is made to operate by detecting the user's inhalation via the puff sensor or pressure sensor, etc. However, the inhalation sensor of this disclosure is not limited to the puff sensor or pressure sensor.

[0111] The step of transmitting a control signal to the display device 110, including the moment of realization of the virtual smoke according to one embodiment, includes transmitting information about the type of virtual smoke and transmitting information about the delay time that occurs in communication between the electronic device 600 and the display device 110. The type of virtual smoke may vary depending on the user's selection, and may also vary depending on the aerosol product or other flavoring component built into the second end 630. The control signal may also include, but is not limited to, information about the user's smoking amount, breathing rate, etc.

[0112] Figure 7A shows an electronic device that includes an orientation change sensor according to one embodiment.

[0113] The explanations referring to Figures 1-4 also apply to the explanations referring to Figure 7A, and redundant content is omitted.

[0114] Referring to Figure 7A, an electronic device 700 according to one embodiment includes a first end 710, an intermediate portion 720, a second end 730, and a sensor portion 740. The first end 710, the intermediate portion 720, and the second end 730 have functions similar to the first end 410, the intermediate portion 420, and the second end 430 shown in Figure 4, respectively.

[0115] The sensor unit 740 according to one embodiment may include an orientation change sensor according to one embodiment. The orientation change sensor may be located inside or outside the second end portion 730. The orientation change sensor according to one embodiment may be a gyro sensor, an acceleration sensor, or a 3DoF / 6DoF sensor, etc. However, the orientation change sensor of this disclosure is not limited to the above-mentioned methods.

[0116] Figure 7B is a block diagram showing a method for predicting the time of appearance of virtual smoke using an orientation change sensor according to one embodiment.

[0117] Referring to Figure 7B, when a user according to one embodiment begins smoking 750, the orientation change sensor monitors the change in orientation between the object (e.g., the user's lips) and the electronic device 700 760.

[0118] According to one embodiment, the electronic device 700 predicts the time of manifestation of virtual smoke based on the monitoring results of the orientation change sensor. The electronic device 700 transmits a control signal, including the predicted time of manifestation of virtual smoke, to the display device 110 (or XR device 310). The display device 110 manifests virtual smoke based on the control signal and can provide the user with a smoking experience in a virtual space.

[0119] Referring to both Figures 7A and 7B, the smoking initiation step 750 according to one embodiment includes the step of the user bringing the electronic device 700 into contact with their lips and performing the act of inhalation. The user turns on the power to begin heating the aerosol product in the electronic device 700, and the powered-on electronic device 700 preheats the heater that heats the aerosol product.

[0120] In one embodiment, the orientation change sensor monitors the orientation change between an object and an electronic device 700. Step 760 includes detecting a first point in time when the object makes contact with the second end 730 of the electronic device 700, and detecting a second point in time when the object moves away from the second end 730 of the article.

[0121] For example, the step of detecting the first time point may include the orientation change sensor detecting that the second end 730 of the electronic device 700 and the object are approaching each other in an orientation within a first threshold, and detecting changes in acceleration while the user brings the electronic device 700 to the object.

[0122] For example, the step of detecting a second time point may include detecting that the object has made contact with the second end 730 of the electronic device 700 and that the object has moved away in a direction exceeding a second threshold, and detecting the change in acceleration while the user removes the electronic device 700 from the object.

[0123] According to one embodiment, the orientation of the electronic device 700 along the x, y, and z axes when the user has their hand down can be compared with the orientation of the electronic device 700 along the x, y, and z axes when the user has the electronic device 700 in contact with an object, and the change in orientation can be measured. When the user moves their hand to move the electronic device 700, the measured acceleration shows a pattern of increasing, then decreasing, and then stopping. By measuring the interval of change in acceleration, the change in orientation can be predicted, and the user's smoking time can be estimated based on the predicted change in orientation.

[0124] Step 770 of predicting the time of realization of virtual smoke based on the monitoring results of azimuth change according to one embodiment includes the step of predicting the time of realization of virtual smoke based on the interval between a first time and a second time. The first time is when the user begins inhaling the smoke. The interval between the first time and the second time is the time the user inhales the smoke, and the user's first breathing time can be predicted based on the smoke inhalation time. The second time is when the user begins inhaling. The time of the second breath can be predicted based on the interval between the first and second time and the first breathing time. The time of the second breath is when the user begins exhaling. For example, the time of the second breath can be determined as the time of realization of virtual smoke.

[0125] According to one embodiment, since the user's smoke inhalation time is the interval between the first and second time points, the first breathing time, which is the time the user inhales, can be estimated in the same way as the smoke inhalation time. Subsequently, the electronic device 700 can predict the time of the second breath, which is the time when the user begins exhaling, as the time when the first breathing time has elapsed from the second time point.

[0126] For example, if the time between the first point in time when the object touches the second end 730 and the second point in time when the object is detached from the second end 730 is 1 second, then the first breathing time is estimated to be 1 second, and the time it takes for the user to inhale is also predicted to be 1 second, similar to the first breathing time. As a result, the time of the second breath, which occurs after the first breathing time has elapsed from the second point in time, is predicted to be 1 second after the object has been separated by the electronic device 700. This allows the electronic device 700 to determine the time 1 second after the object has been separated as the time of realization of the virtual smoke.

[0127] Step 770 of predicting the time of virtual smoke manifestation based on monitoring results according to one embodiment includes estimating the user's inhalation volume and breathing volume based on the interval between a first time point and a second time point. The user's inhalation volume may include the amount of aerosol inhaled by the user through the electronic device 700 when the electronic device 700 is in contact with an object. The user's breathing volume may include the amount of inhaled air by the user when the electronic device 700 is not in contact with an object. Based on the estimated breathing volume and inhalation volume, the time of virtual smoke manifestation can be predicted.

[0128] Step 770 of predicting the time of realization of virtual smoke based on monitoring results according to one embodiment includes the step of determining whether the electronic device 700 satisfies predetermined operating conditions, and the step of predicting the time of realization of virtual smoke based on the determination that the electronic device 700 satisfies the operating conditions. The predetermined operating conditions may include at least one of the following: whether the user turns the electronic device 700 on or off, whether the puff sensor included in the electronic device is operating, and whether the pressure sensor included in the electronic device 700 is operating. The detected value of the orientation change sensor may change due to other objects that are not determined objects (e.g., fingers), but the orientation change sensor is made to operate only when the user turns the power on or off, and the orientation change sensor is made to operate by detecting the user's inhalation via the puff sensor or pressure sensor, etc. However, the inhalation sensor of this disclosure is not limited to the puff sensor or pressure sensor.

[0129] The step of transmitting a control signal, including the virtual smoke manifestation time, to the display device 110 according to one embodiment includes transmitting information about the type of virtual smoke and transmitting information about the delay time that occurs in communication between the electronic device 700 and the display device 110. The type of virtual smoke may vary depending on the user's selection, or it may vary depending on the aerosol product or other flavoring component built into the second end 730. The control signal may also include, but is not limited to, information about the user's smoking amount, breathing rate, etc.

[0130] Figure 8A shows an electronic device including a camera according to one embodiment.

[0131] The explanations referring to Figures 1-4 also apply to the explanations referring to Figure 8A, and redundant content is omitted.

[0132] Referring to Figure 8A, an electronic device 800 according to one embodiment includes a first end 810, an intermediate portion 820, a second end 830, and a camera portion 840. The first end 810, the intermediate portion 820, and the second end 830 have functions similar to the first end 410, the intermediate portion 420, and the second end 430 in Figure 4, respectively.

[0133] The camera unit 840 according to one embodiment may include a camera according to one embodiment. The camera unit 840 may include a camera according to one embodiment. The camera may be located on the surface of the housing of the electronic device 800.

[0134] Figure 8B is a block diagram showing a method for predicting the moment of appearance of virtual smoke using a camera according to one embodiment.

[0135] Referring to Figure 8B, when a user according to one embodiment begins smoking 850, the camera monitors the movement of an object (e.g., the user's lips) 860. The electronic device 800 predicts the time of manifestation of virtual smoke 870 based on the camera's monitoring results. The electronic device 800 transmits a control signal, including the predicted time of manifestation of virtual smoke, to the display device 110 (or XR device 310) 880. The display device 110 can manifest virtual smoke 890 based on the control signal, providing the user with a virtual smoking experience.

[0136] Referring to both Figures 8A and 8B, a smoking initiation step 850 according to one embodiment includes the step of the user bringing the electronic device 800 into contact with their lips and performing the act of inhalation. The user turns on the power to begin heating the aerosol product in the electronic device 800, and the powered-on electronic device 800 preheats the heater that heats the aerosol product.

[0137] Step 860 of a camera according to one embodiment, in which the camera monitors the distance between an object and an electronic device 800, includes detecting a first point in time when the object changes its behavior to make contact with the electronic device 800 at the second end 830 of the electronic device 800, and detecting a second point in time when the object changes its behavior to separate from the electronic device 800 at the second end 830 of the article.

[0138] For example, the step of detecting a first time point may include the camera detecting a first action by which an object brings the second end 830 of the electronic device 800 to its lips and makes contact.

[0139] For example, the step of detecting a second time point may include the camera detecting a second action for the object to be separated at the second end 830 of the electronic device 800.

[0140] Step 870 of predicting the time of realization of virtual smoke based on the monitoring results of a camera according to one embodiment includes the step of predicting the time of realization of virtual smoke based on the interval between a first time and a second time. The first time is the time when the user begins inhaling the smoke. The interval between the first time and the second time is the time the user inhales the smoke, and the user's first breathing time can be predicted based on the smoke inhalation time. The second time is the time when the user begins inhaling. The time of the second breath is predicted based on the interval between the first and second time and the first breathing time. The time of the second breath is the time when the user begins exhaling. For example, the time of the second breath can be determined as the time of realization of virtual smoke.

[0141] According to one embodiment, since the user's smoke inhalation time is the interval between the first and second time points, the first breathing time, which is the time the user inhales, can be estimated in the same way as the smoke inhalation time. Subsequently, the electronic device 800 can predict the time of the second breath, which is the time when the user begins exhaling, as the time when the first breathing time has elapsed from the second time point.

[0142] For example, if the time between the first point in time when the object touches the second end 830 and the second point in time when the object is detached from the second end 830 is 1 second, then the first breathing time is estimated to be 1 second, and the time it takes for the user to inhale is also predicted to be 1 second, similar to the first breathing time. As a result, the point in time for the second breath, which occurs after the first breathing time has elapsed from the second point in time, is predicted to be 1 second after the object has been separated by the electronic device 800. This allows the electronic device 800 to determine the point in time when 1 second has elapsed after the object has been detached as the point in time when the virtual smoke is realized.

[0143] Step 870 of predicting the time of virtual smoke manifestation based on monitoring results according to one embodiment includes estimating the user's inhalation volume and breathing volume based on the interval between a first time point and a second time point. The user's inhalation volume may include the amount of aerosol inhaled by the user through the electronic device 800 when the electronic device 800 is in contact with an object. The user's breathing volume may include the amount of inhaled air by the user when the electronic device 800 is not in contact with an object. Based on the estimated breathing volume and inhalation volume, the time of virtual smoke manifestation can be predicted.

[0144] Step 870 of predicting the time of realization of virtual smoke based on monitoring results according to one embodiment includes the step of determining whether the electronic device 800 satisfies predetermined operating conditions, and the step of predicting the time of realization of virtual smoke based on the determination that the electronic device 800 satisfies the operating conditions. The predetermined operating conditions may include at least one of the following: whether the user turns the electronic device 800 on or off, whether the puff sensor included in the electronic device is operating, and whether the pressure sensor included in the electronic device 800 is operating. The camera's detection of actions may change due to other objects that are not predetermined objects (e.g., fingers), but the camera is designed to operate only when the user turns the power on or off, and to detect the user's inhalation via the puff sensor or pressure sensor, etc., and to activate the camera. However, the inhalation sensor of this disclosure is not limited to the puff sensor or pressure sensor.

[0145] The step of transmitting a control signal to the display device 110, including the moment of realization of the virtual smoke according to one embodiment, includes transmitting information about the type of virtual smoke and transmitting information about the delay time that occurs in communication between the electronic device 800 and the display device 110. The type of virtual smoke may vary depending on the user's selection, or it may vary depending on the aerosol product or other flavoring component built into the second end 830. The control signal may also include, but is not limited to, information about the user's smoking amount, breathing rate, etc.

[0146] Figure 9A shows an electronic device including a pressure sensor and a button according to one embodiment.

[0147] The explanations referring to Figures 1-4 also apply to the explanation for Figure 9A, and redundant content is omitted.

[0148] Referring to Figure 9A, an electronic device 900 according to one embodiment includes a first end 910, an intermediate portion 920, a second end 930, a sensor portion 940, and a button 941. The first end 910, the intermediate portion 920, and the second end 930 can each have functions similar to the first end 410, the intermediate portion 420, and the second end 430 in Figure 4.

[0149] The sensor unit 940 according to one embodiment may include a pressure sensor according to one example. The pressure sensor may be located inside or outside the second end 930. The pressure sensor can measure the pressure generated when the user brings the second end to their lips or bites it for smoking and detect whether the user has inhaled.

[0150] In one embodiment, the button 941 has the function of turning the power of the electronic device 900 on and off, and may also include an input function for storing the user's smoking pattern. The button 941 includes a function to determine, based on the user's input, whether to activate the power function or to store the smoking pattern. For example, it may have the function of turning the power on and off when pressed for a long time, or to store the smoking pattern when pressed for a short time, or it may include a function to transmit a control signal such as changing the type of virtual smoke. However, the button 941 of this disclosure is not limited to the above functions.

[0151] Figure 9B is a block diagram showing a method for predicting the time of appearance of virtual smoke using a pressure sensor according to one embodiment.

[0152] Referring to Figure 9B, when a user according to one embodiment starts smoking 950, the electronic device 900 learns the smoking pattern using a pressure sensor and a button 941. Based on the learned smoking pattern, the electronic device 900 predicts the time of manifestation of virtual smoke 971 and adjusts the volume and concentration of the virtual smoke 972. The electronic device 900 transmits a control signal 980 to the display device 110 (or XR device 310) including the predicted time of manifestation of virtual smoke and the volume and concentration of virtual smoke. Based on the control signal, the display device 110 can manifest virtual smoke 990 and provide the user with a smoking experience in a virtual space.

[0153] Referring to both Figures 9A and 9B, a smoking initiation step 950 according to one embodiment includes the step of the user bringing the electronic device 900 to their lips and performing the act of inhalation. The user turns on the power to begin heating the aerosol product in the electronic device 900, and the powered-on electronic device 900 preheats the heater that heats the aerosol product.

[0154] Step 960 for learning a smoking pattern using a pressure sensor and button 941 according to one embodiment includes detecting a first time point in time when an object comes into contact with the second end 930 of the electronic device 900 and the pressure detected by the pressure sensor is measured as exceeding a first threshold; detecting a second time point in time when the object is separated from the second end 930 after the first time point and the pressure detected by the pressure sensor is measured within a second threshold; and detecting a third time point in time when the button of the electronic device 900 is operated after the second time point.

[0155] In one embodiment of the method for learning a smoking pattern, when the user starts puffing to smoke, the pressure sensor measures and stores the point at which the pressure changes. Then, the point at which the pressure sensor reading returns to normal when the user finishes puffing is stored. The time difference (time duration) between the start and end of the puff is the user's smoke inhalation time, which is similar to the user's inhalation time. Then, when the user exhales the smoke they inhaled, they press a button on the electronic device 900 to input that they are starting to exhale. When the user finishes exhaling, they stop pressing the button. The time difference between the start and end of exhalation is similar to the user's exhalation time. Based on the user's smoking pattern, which has been performed at least once, the electronic device 900 can generate an algorithm for the user's smoking pattern and store the learned smoking pattern based on that algorithm.

[0156] Step 971 of predicting the time of realization of virtual smoke based on a learned smoking pattern according to one embodiment includes the steps of storing the smoking pattern based on intervals between a first time point and a second time point and between a second time point and a third time point, and collecting data for at least one interval between a first time point and a second time point and between a second time point and a third time point.

[0157] Step 971 of predicting the time of virtual smoke manifestation based on a learned smoking pattern according to one embodiment includes predicting the time of virtual smoke manifestation based on an interval between a first time and a second time. The first time is when the user begins inhaling the smoke. The interval between the first and second time is the time the user inhales the smoke, and the user's first breath time can be predicted based on the smoke inhalation time. The second time is when the user begins inhaling. The time of the second breath is predicted based on the interval between the first and second time and the first breath time. The time of the second breath is when the user begins exhaling. For example, the time of the second breath can be determined as the time of virtual smoke manifestation.

[0158] According to one embodiment, since the user's smoke inhalation time is the interval between the first and second time points, the first breathing time, which is the time the user inhales, can be estimated in the same way as the smoke inhalation time. Subsequently, the electronic device 900 can predict the second breathing time, which is the time when the user begins exhaling, as the time when the first breathing time has elapsed from the second time point.

[0159] For example, if the time between the first point in time when the object touches the second end 930 and the second point in time when the object is detached from the second end 930 is 1 second, then the first breathing time is estimated to be 1 second, and the time it takes for the user to inhale is also predicted to be 1 second, similar to the first breathing time. As a result, the point in time for the second breath, which occurs after the first breathing time has elapsed from the second point in time, is predicted to be 1 second after the object has been separated by the electronic device 900. This allows the electronic device 900 to determine the point in time when 1 second has elapsed after the object has been separated as the point in time when the virtual smoke is realized.

[0160] Step 971 of predicting the time of virtual smoke manifestation based on a learned smoking pattern according to one embodiment includes the step of estimating the user's inhalation volume and breathing volume based on the interval between a first time point and a second time point. The user's inhalation volume may include the amount of aerosol inhaled by the user through the electronic device 900 when the electronic device 900 is in contact with an object. The user's breathing volume may include the amount of air inhaled by the user when the electronic device 900 is not in contact with an object. Based on the estimated breathing volume and inhalation volume, the time of virtual smoke manifestation can be predicted.

[0161] Step 971 of predicting the time of realization of virtual smoke based on a learned smoking pattern according to one embodiment includes the step of determining whether the electronic device 900 satisfies predetermined operating conditions, and the step of predicting the time of realization of virtual smoke based on the determination that the electronic device 900 satisfies the operating conditions. The predetermined operating conditions may include at least one of whether the user turns the electronic device 900 on or off, and whether the puff sensor and pressure sensor included in the electronic device 900 are operating. The pressure sensor's detection value may change due to other objects that are not predetermined objects (e.g., fingers), but the pressure sensor is configured to operate only when the user turns the power on or off, and to detect the user's inhalation via the puff sensor or pressure sensor and activate the pressure sensor. However, the inhalation sensor of this disclosure is not limited to the puff sensor or pressure sensor.

[0162] Step 972 of adjusting the volume and concentration of virtual smoke based on a learned smoking pattern according to one embodiment includes the steps of storing data comparing the operating time of the pressure sensor and the operating time of the button 941, and storing the volume and concentration of virtual smoke determined based on the compared data in the learned smoking pattern.

[0163] According to one embodiment, the volume and concentration of virtual smoke can vary depending on the user's smoking pattern. For example, if the user's exhalation time is shorter than their puff time, the volume of virtual smoke can be increased to produce denser smoke. If the user's puff time detected by the pressure sensor is 2 seconds, but the time from pressing the button to releasing it is 1.5 seconds, the volume and concentration of virtual smoke can be adjusted to produce even more smoke and denser smoke. In other words, since the user's puff time is the smoke inhalation time and the user's button activation time is the exhalation time, if the user's exhalation time is shorter than the smoke inhalation time, the display device 110 must produce a larger amount of mist and denser smoke in a shorter time because the user exhaled the same amount of smoke in a shorter period of time.

[0164] The step of transmitting a control signal to the display device 110, including the moment of manifestation of the virtual smoke and the volume and concentration of the virtual smoke according to one embodiment, includes the step of transmitting information regarding the type of virtual smoke and the step of transmitting information regarding the delay time that occurs in communication between the electronic device 900 and the display device 110. The type of virtual smoke may vary depending on the user's selection, and may vary depending on the aerosol product or other flavoring component built into the second end 930. The control signal may also include, but is not limited to, information regarding the user's smoking amount, breathing rate, etc.

[0165] Figure 10A shows a user wearing a surface electromyography sensor module included in an XR device according to one embodiment.

[0166] The explanations referring to Figures 1-4 also apply to the explanations referring to Figure 10A, and any overlapping content is omitted.

[0167] Referring to Figure 10A, the surface electromyography sensor 1000 can analyze the electrical signals emitted while muscles are contracting to understand what actions the user is performing. For example, surface electromyography (sEMG) measures a signal that is a composite of action potentials of motor units generated in the muscles around the surface electrodes, based on a method of measuring electromyographic signals by attaching surface electrodes to the skin. By utilizing this, if a sensor device capable of monitoring muscle movement is connected to the XR device 310 (or display device 110) and the user smokes, it is possible to predict exhalation.

[0168] Figure 10B is a block diagram showing a method for predicting the time of appearance of virtual smoke using a surface electromyography sensor according to one embodiment.

[0169] Referring to Figure 10B, when a user according to one embodiment starts smoking 1050, the XR device 310 receives a signal from the surface electromyography sensor and monitors muscle movement 1060. Based on the monitoring results from the surface electromyography sensor, the XR device 310 predicts the time of manifestation of virtual smoke 1070. Based on the predicted time of manifestation of virtual smoke, the XR device 310 displays a virtual image of cigarette smoke being generated 1080. The XR device 310 can then manifest virtual smoke 1090 to provide the user with a smoking experience in a virtual space.

[0170] Referring to both Figures 10A and 10B, the smoking initiation step 1050 according to one embodiment includes the step of the user performing an inhalation act by bringing the electronic device 400 to their lips. The user turns on the power to the electronic device 400 and preheats the electronic device 400 in order to start its operation.

[0171] Step 1060 of an XR device 310 according to one embodiment, in which the XR device 310 receives a signal from a surface electromyography sensor to monitor muscle movement, includes detecting a first point in time when an object performs a first action in which it moves its muscles to bite and inhale the second end 430 of the electronic device 400, and detecting a second point in time when the object performs a second action in which it moves its muscles to separate from the second end 430 of the electronic device 400.

[0172] For example, the step of detecting the first time point may include a surface electromyography sensor detecting that the object has reached the first action.

[0173] For example, the step of detecting the second time point may include a surface electromyography sensor detecting that the object has reached the second action.

[0174] Step 1070 of predicting the time of virtual smoke manifestation based on the results of surface electromyography monitoring according to one embodiment includes predicting the time of virtual smoke manifestation based on the interval between a first time point and a second time point. The first time point is when the user begins inhaling the smoke. The interval between the first time point and the second time point is the time the user inhales the smoke, and the user's first breath time can be predicted based on the smoke inhalation time. The second time point is when the user begins inhaling. The time of the second breath is predicted based on the interval between the first time point and the second time point and the first breath time. The time of the second breath is when the user begins exhaling. For example, the time of the second breath can be determined as the time of virtual smoke manifestation.

[0175] According to one embodiment, since the user's smoke inhalation time is the interval between the first and second time points, the first breathing time, which is the time the user inhales, can be estimated in the same way as the smoke inhalation time. Subsequently, the XR device 310 can predict the time of the second breath, which is the time when the user begins exhaling, as the time when the first breathing time has elapsed from the second time point.

[0176] For example, if the time between the first point in time when the object touches the second end 430 and the second point in time when the object is detached from the second end 430 is 1 second, then the first breathing time is estimated to be 1 second, and the time it takes for the user to inhale is also predicted to be 1 second, similar to the first breathing time. As a result, the point in time for the second breath, which is after the first breathing time has elapsed from the second point in time, is predicted to be 1 second after the object has been separated by the electronic device 400. This allows the XR device 310 to determine the point in time when 1 second has elapsed after the object has been detached as the point in time when the virtual smoke is realized.

[0177] Step 1070 of one embodiment predicts the time of virtual smoke manifestation based on the results of surface electromyography monitoring, and includes the step of estimating the user's inhalation volume and breathing volume based on the interval between a first time point and a second time point. The user's inhalation volume may include the amount of aerosol inhaled by the user through the electronic device 400 when the electronic device 400 is in contact with an object. The user's breathing volume may include the amount of inhaled air by the user when the electronic device 400 is not in contact with an object. Based on the estimated breathing volume and inhalation volume, the time of virtual smoke manifestation can be predicted.

[0178] Step 1070 of predicting the time of realization of virtual smoke based on monitoring results according to one embodiment includes the step of determining whether the electronic device 400 satisfies predetermined operating conditions, and the step of predicting the time of realization of virtual smoke based on the determination that the electronic device 400 satisfies the operating conditions. The predetermined operating conditions may include at least one of the following: whether the user turns the electronic device 400 on or off, whether the puff sensor included in the electronic device is operating, and whether the pressure sensor included in the electronic device 400 is operating. The detected value of the surface electromyography sensor may change due to the operation of other objects other than the determined object (e.g., talking or chewing), but the surface electromyography sensor is activated only when the user turns the power on or off, and can detect only the electrical signals of muscle movement in response to smoking, and the surface electromyography sensor is activated by detecting the user's inhalation via the puff sensor or pressure sensor, etc. However, the inhalation sensor of this disclosure is not limited to the puff sensor or pressure sensor.

[0179] In one embodiment, the step of transmitting a control signal to the display device 110 includes transmitting information regarding the type of virtual smoke and transmitting information regarding the delay time occurring in communication between the electronic device 400 and the display device 110. The type of virtual smoke may vary depending on the user's selection, and may also vary depending on the aerosol product or other flavoring component incorporated in the second end 430. The control signal may also include, but is not limited to, information regarding the user's smoking volume, breathing volume, etc.

[0180] Figure 11A shows a user wearing an electroencephalogram (EEG) measurement module included in an XR device according to one embodiment.

[0181] The explanations referring to Figures 1-4 also apply to the explanations referring to Figure 11A, and redundant content is omitted.

[0182] Referring to Figure 11A, an electroencephalogram (EEG) measurement module 1100 according to one embodiment is configured as a device for measuring electroencephalogram (EEG) signals, and includes electrodes for detecting EEG signals, an amplifier for amplifying weak EEG signals, and an AD converter for converting the measured analog EEG into a digital signal. When such an EEG measurement device module is attached to an XR device and the smoker smokes, the smoker's brainwaves can be measured and analyzed to predict exhalation. That is, by measuring the brainwaves in response to smoke inhalation and the brainwaves in response to the act of inhaling smoke into the lungs, the amount of inhaled air and the timing of exhalation can be predicted.

[0183] Figure 11B is a block diagram showing a method for predicting the moment of appearance of virtual smoke using an electroencephalogram (EEG) measurement module in one embodiment.

[0184] Referring to Figure 11B, when a user according to one embodiment begins smoking 1150, the XR device 310 receives and monitors the electroencephalogram (EEG) signals related to the movement of an object via the EEG measurement module 1160. Based on the monitoring results from the EEG measurement module, the XR device 310 predicts the time of manifestation of virtual smoke 1170. Based on the predicted time of manifestation of virtual smoke, the XR device 310 displays a virtual image of cigarette smoke being generated 1180. The XR device 310 can then manifest virtual smoke 1190 to provide the user with a smoking experience in a virtual space.

[0185] Referring to both Figures 11A and 11B, the smoking initiation step 1150 according to one embodiment includes the step of the user bringing the electronic device 400 to their lips and performing the act of inhalation. The user turns on the power to begin heating the aerosol product in the electronic device 400, and the powered-on electronic device 400 preheats the heater that heats the aerosol product.

[0186] Step 1160 of an XR device 310 according to one embodiment, in which the XR device 310 receives a signal from an electroencephalogram (EEG) measurement module and monitors the EEG signal, includes detecting a first time point in time when a first signal is produced, which is an EEG signal for performing the action of a user biting and inhaling an object at the second end 430 of the electronic device 400, and detecting a second time point in time when a second signal is produced, which is an EEG signal for performing the action of a user separating the object from the second end 430 of the electronic device 400.

[0187] For example, the step of detecting the first time point may include the electroencephalogram (EEG) measurement module detecting that the EEG signal has reached the first signal.

[0188] For example, the step of detecting the second time point may include the electroencephalogram (EEG) measurement module detecting that the second EEG signal has been reached.

[0189] Step 1170 of predicting the time of realization of virtual smoke based on electroencephalogram (EEG) signal monitoring results according to one embodiment includes the step of predicting the time of realization of virtual smoke based on the interval between a first time point and a second time point. The first time point is the time when the user begins inhaling the smoke. The interval between the first time point and the second time point is the time the user inhales the smoke, and the user's first breath time can be predicted based on the smoke inhalation time. The second time point is the time when the user begins inhaling. The time of the second breath can be predicted based on the interval between the first time point and the second time point and the first breath time. The time of the second breath is the time when the user begins exhaling. For example, the time of the second breath can be determined as the time of realization of virtual smoke.

[0190] According to one embodiment, since the user's smoke inhalation time is the interval between the first and second time points, the first breathing time, which is the time the user inhales, can be estimated in the same way as the smoke inhalation time. Subsequently, the XR device 310 can predict the second breathing time, which is the time when the user begins exhaling, as the time when the first breathing time has elapsed from the second time point.

[0191] For example, if the time between the first point in time when the object touches the second end 430 and the second point in time when the object is detached from the second end 430 is 1 second, then the first breathing time is estimated to be 1 second, and the time it takes for the user to inhale is also predicted to be 1 second, similar to the first breathing time. As a result, the point in time for the second breath, which is after the first breathing time has elapsed from the second point in time, is predicted to be 1 second after the object has been separated by the electronic device 400. This allows the XR device 310 to determine the point in time when 1 second has elapsed after the object has been detached as the point in time when the virtual smoke is realized.

[0192] Step 1170 of one embodiment predicts the time of virtual smoke manifestation based on electroencephalogram (EEG) signal monitoring results, and includes the step of estimating the user's inhalation volume and breathing volume based on the interval between a first time point and a second time point. The user's inhalation volume may include the amount of aerosol inhaled by the user through the electronic device 400 when the electronic device 400 is in contact with an object. The user's breathing volume may include the amount of inhaled air the user breathes when the electronic device 400 is not in contact with an object. Based on the estimated breathing volume and inhalation volume, the time of virtual smoke manifestation can be predicted.

[0193] Step 1170 of predicting the time of realization of virtual smoke based on monitoring results according to one embodiment includes the step of determining whether the electronic device 400 satisfies predetermined operating conditions, and the step of predicting the time of realization of virtual smoke based on the determination that the electronic device 400 satisfies the operating conditions. The predetermined operating conditions may include at least one of the following: whether the user turns the electronic device 400 on or off, whether the puff sensor included in the electronic device is operating, and whether the pressure sensor included in the electronic device 400 is operating. The detected values ​​of the electroencephalogram (EEG) measurement module may change due to other objects that are not predetermined objects (e.g., talking or chewing), but the EEG measurement module is configured to operate only when the user turns the power on or off, and to detect the user's inhalation via the puff sensor or pressure sensor and activate the EEG measurement module. However, the inhalation sensor in this disclosure is not limited to the puff sensor or pressure sensor.

[0194] The step of transmitting a control signal to the display device 110, including the moment of realization of the virtual smoke according to one embodiment, includes transmitting information about the type of virtual smoke and transmitting information about the delay time that occurs in the communication between the electronic device 400 and the display device 110. The type of virtual smoke may vary depending on the user's selection, and may vary depending on the aerosol product or other flavoring component built into the second end 430. The control signal may also include information about the user's smoking amount, breathing rate, etc., and this disclosure is not limited thereto.

[0195] Figure 12A shows an article containing a pressure sensor according to one embodiment.

[0196] The explanations referring to Figures 1-4 also apply to the explanations referring to Figure 12A, and any overlapping content is omitted.

[0197] Referring to Figure 12A, an electronic device 1200 according to one embodiment includes a first end 1210, an intermediate portion 1220, a second end 1230, and a sensor portion 1240. The first end 1210, the intermediate portion 1220, and the second end 1230 may have the same functions as the first end 410, the intermediate portion 420, and the second end 430 in Figure 4, respectively.

[0198] The sensor unit 1240 according to one embodiment may include a pressure sensor according to one embodiment. The pressure sensor may be located inside or outside the second end portion 1230. The pressure sensor according to one embodiment can measure the pressure generated by the user's lips to detect whether or not suction is present.

[0199] Figure 12B is a block diagram showing a method for predicting the time of appearance of virtual smoke using a camera and a pressure sensor according to one embodiment.

[0200] Referring to both Figure 3 and Figure 12B, when a user according to one embodiment begins smoking 1250, the XR device 310 receives camera data 1260 detecting the user's hand movements from the camera 330. The pressure sensor acquires pressure sensor data 1270 when the user bites the second end 1230 with their mouth to smoke. The electronic device 1200 or XR device 310 predicts the time of manifestation of the virtual smoke 1280 based on the received camera data and pressure sensor data. The electronic device 1200 or XR device 310 can transmit a control signal including the time of manifestation of the virtual smoke to the display device 110 1290 to provide the user with a smoking experience in virtual reality.

[0201] Referring to Figures 3, 12A, and 12B, the smoking initiation step 1250 according to one embodiment includes the step of the user bringing the electronic device 1200 to their lips and performing the act of inhalation. The user turns on the power to begin heating the aerosol product in the electronic device 1200, and the powered-on electronic device 1200 preheats the heater that heats the aerosol product.

[0202] In one embodiment, the XR device 310 may have an application installed that monitors the user's hand movements, thereby enabling the detection of the user's smoking behavior data via a camera 330 that monitors the user's hand movements. The camera 330 monitors the situation as the user brings the electronic device 1200 to their mouth, inhales smoke, inhales the smoke into their lungs through inhalation, and then separates the electronic device 1200 from their mouth to exhale the smoke. The data received from the camera 330 and the application installed on the XR device 310 can analyze the user's hand movements as described above to predict the amount of inhaled air and the timing of exhalation.

[0203] According to one embodiment, the operation of the XR device 310, camera 330, and electronic device 1200 is as follows: The XR device 310, on which the smoking device application is installed, and the electronic device 1200 are paired using short-range wireless communication (e.g., Bluetooth®). When the user puts the electronic device 1200 to their mouth to smoke, the application on the XR device 310 can analyze the user's hand movements using images captured by the camera 330 (e.g., camera data). If it is determined through the images from the camera 330 that the electronic device 1200 has reached the mouth and the pressure sensor is activated (e.g., the measured pressure value is above a threshold), it is determined that the user has started smoking. For example, the electronic device 1200 can transmit the pressure value measured by the pressure sensor to the paired XR device 310. After the user has started smoking, the user's act of inhaling smoke into their lungs through inhalation, i.e., the act of separating the electronic device 1200 from their mouth, can be monitored using images from the camera 330. By analyzing the interval between the start of smoking and the start of inhalation, the inhaled volume and inspiratory volume can be estimated, and the timing of exhalation can be measured based on the estimated inhaled volume and inspiratory volume.

[0204] Step 1280 of predicting the time of realization of virtual smoke based on the monitoring results according to one embodiment includes the step of predicting the time of realization of virtual smoke based on the interval between a first time and a second time. The first time is the time when the user begins inhaling the smoke. The interval between the first time and the second time is the time the user inhales the smoke, and the user's first breath time can be predicted based on the smoke inhalation time. The second time is the time when the user begins inhaling. Based on the interval between the first and second time and the first breath time, the time of the second breath can be predicted. The time of the second breath is the time when the user begins exhaling. For example, the time of the second breath can be determined as the time of realization of virtual smoke.

[0205] According to one embodiment, since the user's smoke inhalation time is the interval between the first and second time points, the first breathing time, which is the time the user inhales, can be estimated in the same way as the smoke inhalation time. Subsequently, the electronic device 1200 can predict the time of the second breath, which is the time when the user begins exhaling, as the time when the first breathing time has elapsed from the second time point.

[0206] For example, if the time between the first point in time when the object touches the second end 1230 and the second point in time when the object is detached from the second end 1230 is 1 second, then the first breathing time is estimated to be 1 second, and the time it takes for the user to inhale is also predicted to be 1 second, similar to the first breathing time. As a result, the time of the second breath, which occurs after the first breathing time has elapsed from the second point in time, is predicted to be 1 second after the object has been separated from the electronic device 1200. This allows the electronic device 1200 to determine the time 1 second after the object has been detached as the time of realization of the virtual smoke.

[0207] Step 1280, which predicts the time of virtual smoke manifestation based on monitoring results according to one embodiment, includes the step of estimating the user's inhalation volume and breathing volume based on the interval between a first time point and a second time point. The user's inhalation volume may include the amount of aerosol inhaled by the user through the electronic device 1200 when the electronic device 1200 is in contact with an object. The user's breathing volume may include the amount of inhaled air inhaled by the user when the electronic device 1200 is not in contact with an object. Based on the estimated breathing volume and inhalation volume, the time of virtual smoke manifestation can be predicted.

[0208] Step 1280 of predicting the time of realization of virtual smoke based on the monitoring results according to one embodiment includes the step of determining whether the electronic device 1200 satisfies predetermined operating conditions, and the step of predicting the time of realization of virtual smoke based on the determination that the electronic device 1200 satisfies the operating conditions. The predetermined operating conditions may include at least one of the following: whether the user turns the electronic device 1200 on or off, and whether the puff sensor and pressure sensor included in the electronic device 1200 are operating. The detected value of the pressure sensor may change due to the operation of other objects other than the operation of the determined object (e.g., hand movements other than smoking), but the pressure sensor is configured to operate only when the user turns the power on or off, and the pressure sensor is configured to detect the user's inhalation via the puff sensor or pressure sensor, etc. However, the inhalation sensor of this disclosure is not limited to the puff sensor or pressure sensor.

[0209] The step of transmitting a control signal to the display device 110, including the moment of realization of the virtual smoke according to one embodiment, includes transmitting information about the type of virtual smoke and transmitting information about the delay time that occurs in communication between the electronic device 1200 and the display device 110. The type of virtual smoke may vary depending on the user's selection, and may vary depending on the aerosol product or other flavoring component built into the second end 1230. The control signal may also include, but is not limited to, information about the user's smoking amount, breathing rate, etc.

[0210] If the timing of the virtual smoke manifestation does not coincide with the user's actual smoking behavior, or if the accurate predicted timing cannot be determined, additional work may be performed to carry out a separate "exhalation prediction detection" process.

[0211] The embodiments described above are embodied in hardware components, software components, or combinations of hardware and software components. For example, the devices and components described in these embodiments are embodied using one or more general-purpose or special-purpose computers, such as a processor, controller, ALU (arithmetic logic unit), digital signal processor, microcomputer, FPA (field programmable array), PLU (programmable logic unit), microprocessor, or different devices that execute and respond to instructions. The processing device executes an operating system (OS) and one or more software applications that run on the OS. The processing device also accesses, stores, manipulates, processes, and generates data in response to the execution of the software. For convenience of understanding, the processing device may sometimes be described as being used as a single unit, but a person with ordinary skill in the art will understand that the processing device includes multiple processing elements and / or multiple types of processing elements. For example, the processing device includes multiple processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

[0212] Software includes computer programs, code, instructions, or a combination of one or more of these, which can configure a processing unit to operate as desired, or instruct the processing unit independently or in combination. Software and / or data can be permanently or temporarily embodied in any type of machine, component, physical device, virtual device, computer storage medium or device, or transmitted signal wave, for interpretation by a processing unit or for providing instructions or data to a processing unit. Software can be distributed across a network of computer systems and stored and executed in a distributed manner. Software and data can be stored on a recording medium readable by one or more computers.

[0213] The method according to this embodiment is embodied in the form of program instructions that are implemented via various computer means and recorded on a computer-readable recording medium. The recording medium includes program instructions, data files, data structures, etc., individually or in combination. The recording medium and program instructions may be specifically designed and configured for the purposes of the present invention, or they may be known and usable by those skilled in the art who have technology in the field of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floppy disks, and hardware devices specifically configured to store and execute program instructions, such as ROMs, RAMs, and flash memory. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code executed by a computer using an interpreter or the like.

[0214] The hardware device described above may be configured to operate as one or more software modules to perform the operations shown in the present invention, and vice versa.

[0215] As described above, although embodiments have been illustrated with limited drawings, a person with ordinary skill in the art can apply various technical modifications and variations based on the above description. For example, the described technique may be performed in a different order than described, and / or the described system, structure, apparatus, circuit, and other components may be combined or assembled in a different manner than described, or replaced or substituted by other components or equivalents, and still achieve the desired results.

Claims

1. A method for controlling an electronic device, The steps include monitoring the change in capacitance of the aforementioned electronic device and predicting the moment of realization of virtual smoke, The steps include transmitting a control signal, including the moment of realization of the virtual smoke, to a device that displays a virtual image, Includes, The step of predicting the moment when the virtual smoke materializes is: A step of detecting a first time point in time when the capacitance of the electronic device reaches a first threshold, The steps include detecting a second time point after the first time point in which the capacitance of the electronic device exceeds a second threshold, A step of predicting a first breathing time corresponding to the inhalation time based on the interval corresponding to the smoke inhalation time between the first time point and the second time point, A step of predicting the time of the second breath, which corresponds to the start of exhalation, based on the interval between the first time point and the second time point and the first breath time, The step includes determining the time of the second breath as the time of the realization of the virtual smoke, A method for controlling an electronic device, comprising the step of predicting the first breathing time, which includes predicting the first breathing time corresponding to the smoke inhalation time between a first time point and a second time point, using an artificial neural network trained on learning data with the inhalation time as input and the inspiratory time as output.

2. The control method for an electronic device according to claim 1, wherein the first respiration time is proportional to the interval between the first time point and the second time point.

3. The step of predicting the time of realization of the virtual smoke includes the step of estimating the user's inhalation volume and breathing volume based on the interval between the first time and the second time, The inhalation volume includes the amount of aerosol inhaled by the user through the electronic device while the electronic device and the object are in contact, The method for controlling an electronic device according to claim 1, wherein the breathing volume includes the amount of inhaled air inhaled by the user when the electronic device and the object are not in contact.

4. The method for controlling an electronic device according to claim 3, wherein the step of predicting the time of realization of the virtual smoke includes the step of predicting the time of realization of the virtual smoke based on the inhalation volume and the breathing volume.

5. The step of predicting the moment when the virtual smoke materializes is: The steps include determining whether the electronic device satisfies predetermined operating conditions, Based on the determination that the electronic device satisfies the operating conditions, the steps include predicting the time of realization of the virtual smoke, A method for controlling an electronic device according to claim 1, including the method described in claim 1.

6. The control method for an electronic device according to claim 5, wherein the operating conditions include at least one of whether the power to the electronic device is turned on or off, and whether the inhalation sensor included in the electronic device is operating.

7. The step of transmitting the control signal to a device that displays a virtual image is: A step of conveying information about the type of virtual smoke, The steps include transmitting information regarding the delay time that occurs in communication between the electronic device and the device that displays the virtual image, A method for controlling an electronic device according to claim 1, including the method described in claim 1.

8. A computer program stored on a computer-readable recording medium for use in conjunction with hardware to execute the control method of an electronic device described in any one of claims 1 to 7.

9. A capacitance sensor that monitors the change in capacitance of an electronic device, A processor predicts the moment of realization of virtual smoke based on the results of the monitoring and transmits a control signal including the moment of realization of virtual smoke to a device that displays a virtual image. Includes, The processor predicts the moment of realization of virtual smoke based on the results of the monitoring, The first point in time when the capacitance of the electronic device reaches a first threshold is detected, After the first time point, a second time point is detected in which the capacitance of the electronic device exceeds a second threshold, Based on the interval corresponding to the smoke inhalation time between the first time point and the second time point, predict the first breathing time corresponding to the inhalation time, Based on the interval between the first time point and the second time point and the first respiratory time, predict the time of the second breath corresponding to the start of exhalation, This includes determining the time of the second breath as the time of the realization of the virtual smoke, An electronic device that predicts the first breathing time, including predicting the first breathing time corresponding to the smoke inhalation time between a first time point and a second time point, using an artificial neural network trained on learning data with the inhalation time as input and the inspiratory time as output.

Images