METHOD AND APPARATUS FOR OUTPUTTING VIRTURAL SMOKE IMAGE / VIDEO

Abstract

In order to output a virtual smoke image, the electronic device installs a communication driver and a virtual smoking program stored in a dongle connected to the electronic device, executes the virtual smoking program, receives detection information regarding the status of the aerosol generating device from an aerosol generating device that has established a wireless communication channel with the dongle via the dongle, generates a virtual smoke image based on the detection information, and outputs the virtual smoke image via a display of the electronic device.

Description

[Technical field]

[0001] The following embodiments relate to techniques for implementing virtual smoke in electronic devices. [Background technology]

[0002] In recent years, virtual reality, augmented reality, and mixed reality technologies that apply computer graphics technology have been developed. In this regard, virtual reality technology refers to a technology that uses a computer to create a virtual space that does not exist in the real world and makes the virtual space feel real, while augmented reality or mixed reality technology refers to a technology that adds and expresses information generated by a computer in the real world, that is, a technology that allows interaction with a user in real time by combining the real world and the virtual world.

[0003] Augmented reality and mixed reality technologies are being used in combination with technologies in various fields. In the field of electronic cigarettes, there is an increasing demand for devices that realize virtual reality or augmented reality services, and various research projects are being conducted in response to this demand. Summary of the Invention [Problem to be solved by the invention]

[0004] One embodiment may provide a method for outputting a virtual smoke image performed by an electronic device.

[0005] One embodiment may provide an electronic device for performing the method of outputting a virtual smoke image. [Means for solving the problem]

[0006] A virtual smoke image output method performed by an electronic device according to one embodiment may include an operation of installing a communication driver and a virtual smoking program stored in a dongle from a dongle connected to the electronic device, an operation of executing the virtual smoking program, an operation of receiving detection information regarding the status of an aerosol generating device from an aerosol generating device that has established a wireless communication channel with the dongle via the dongle, an operation of generating a virtual smoke image based on the detection information, and an operation of outputting the virtual smoke image through a display of the electronic device.

[0007] The operation of generating a virtual smoke image based on the detection information may include an operation of determining attributes of the virtual smoke based on the detection information (the attributes of the virtual smoke include at least one of a size, a shape, and a duration of the virtual smoke), and an operation of generating the virtual smoke image based on the attributes of the virtual smoke.

[0008] The operation of outputting the virtual smoke image through the display of the electronic device may include an operation of determining an exhalation point at which a user of the aerosol generating device begins exhaling based on the detection information, and an operation of outputting the virtual smoke image at the exhalation point.

[0009] The operation of determining an exhalation time when a user of the aerosol generating device starts exhaling based on the detection information may include an operation of determining the exhalation time based on a first time when a distance between one side of the aerosol generating device and a part of the user's body reaches within a first threshold, sensed by the aerosol generating device, and a second time after the first time when the distance between the one side of the aerosol generating device and a part of the user's body exceeds a second threshold.

[0010] The operation of determining the exhalation time at which a user of the aerosol generating device begins to exhale based on the detection information may include an operation of determining the exhalation time based on a change in capacitance of the aerosol generating device.

[0011] The operation of determining the exhalation time based on a change in the capacitance of the aerosol generating device may include an operation of determining the exhalation time based on a first time at which a value of the capacitance of the aerosol generating device sensed by the aerosol generating device reaches within a first threshold and a second time after the first time at which the value of the capacitance of the aerosol generating device exceeds a second threshold.

[0012] The data format of the detection information received by the dongle from the aerosol generating device is a wireless signal format, and the data format of the detection information can be converted from the wireless signal format to a USB (universal serial bus) signal format by the dongle.

[0013] The operation of installing the communication driver and the virtual smoking program stored in the dongle from the dongle connected to the electronic device may include an operation of automatically installing the communication driver and the virtual smoking program when the dongle is connected to a USB port of the electronic device.

[0014] The wireless communication channel may be a wireless communication channel based on BLE (Bluetooth low energy), LoRa, EnOcean, RF (radio frequency) communication, Zigbee (registered trademark), or infrared communication.

[0015] An electronic device performing a method for outputting a virtual smoke image according to one embodiment includes a display, a memory, and a processor, and the processor can perform operations of installing a communication driver and a virtual smoking program stored in a dongle connected to the electronic device, executing the virtual smoking program, receiving detection information regarding the status of an aerosol generating device from an aerosol generating device that has established a wireless communication channel with the dongle via the dongle, generating a virtual smoke image based on the detection information, and outputting the virtual smoke image via the display.

[0016] The electronic device may further include a USB port coupled to the dongle. Effect of the Invention

[0017] A method may be provided for outputting a virtual smoke image via a display of an electronic device.

[0018] A method may be provided for communication between the electronic device and the aerosol generating device via the dongle. [Brief description of the drawings]

[0019] [Figure 1] FIG. 1 is a diagram for explaining a virtual smoke image output system according to an embodiment. [Diagram 2] 1A to 1C are diagrams illustrating a user's smoking behavior divided into sections and a method for predicting a user's exhalation time and outputting a virtual smoke image according to an embodiment of the present invention. [Diagram 3] FIG. 1 is a diagram for explaining a virtual smoke image output system according to an embodiment. [Figure 4] 1 is a flowchart of a virtual smoke image output method according to an embodiment. [Diagram 5] FIG. 1 illustrates an example of an aerosol generating device according to one embodiment. [Figure 6] 1 is a flowchart of a virtual smoke image output method according to an embodiment. [Figure 7] 1 is a flowchart of a virtual smoke image output method according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0020] The specific structural or functional description of the embodiment is disclosed for the purpose of illustration only, and can be modified and implemented in various forms. Therefore, the actual implementation is not limited to the specific embodiment disclosed, and the scope of the present specification includes modifications, equivalents, or alternatives included in the technical ideas described in the embodiment.

[0021] Although terms such as first or second may be used to describe various components, these terms should be construed only for the purpose of distinguishing one component from another component, for example, a first component may be named a second component, and similarly, a second component may also be named a first component.

[0022] When a component is referred to as being "coupled" to another component, it may be directly coupled or connected to the other component, but it should be understood that there may be other components in between.

[0023] The singular term includes the plural term unless the context clearly dictates otherwise. In this specification, terms such as "comprise" or "have" are intended to specify the presence of a stated feature, number, step, operation, component, part, or combination thereof, and should not be understood to preclude the presence or additional possibility of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0024] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art. Terms defined in commonly used dictionaries should be interpreted as meanings consistent with the meanings they have in the context of the relevant art, and should not be interpreted as ideal or overly formal meanings unless expressly defined in this specification.

[0025] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. In the description with reference to the accompanying drawings, the same reference numerals are used to designate the same components regardless of the drawing numerals, and duplicated description thereof will be omitted.

[0026] FIG. 1 is a diagram for explaining a virtual smoke image output system according to an embodiment.

[0027] 1, a system 100 for outputting a virtual smoke image can include an electronic device 110 for outputting a virtual smoke image, an aerosol generating device 120, and a dongle 130. A user 10 using the system 100 can wear the electronic device 110 and smoke via the aerosol generating device 120. "Smoking" can refer to heating, burning, and other things that cause the release of smoke or aerosol from a smokable substance. The electronic device 110 according to one embodiment can realize virtual smoke in conjunction with the smoking act of the user 10 via the aerosol generating device 120.

[0028] More specifically, in one embodiment, the aerosol generating device 120 can be named an electronic cigarette device, an inhaler, or a smoking stick. The structure and specific operation method of the aerosol generating device 120 will be described in detail with reference to FIG. 5 below.

[0029] In one embodiment, a user may use the aerosol generating device 120 to engage in the act of smoking, which may result in smoke 142 being generated by the breath of the user 10. In one embodiment, the aerosol generating device 120 may provide an aerosol to the user 10 by heating an aerosol product within the aerosol generating device 120 in a variety of ways. For example, the aerosol product may be a stick that is inserted into the aerosol generating device 120. As another example, the aerosol product may be a replaceable cartridge that is inserted into the aerosol generating device 120.

[0030] According to an embodiment, visually observable smoke 142 may be generated by the breath of the user 10 who inhales the aerosol provided to the aerosol generating device 120, but is not limited thereto. For example, smoke 142 may not be generated by the breath of the user 10.

[0031] According to an example, the virtual smoke image may be output when the user smokes using the aerosol generating device 120 but smoke 142 is not generated. According to an example, the virtual smoke image may be output even when the user does not actually smoke using the aerosol generating device 120. For example, the virtual smoking program of the electronic device 110 may provide a specific mode that can generate and output a virtual smoke image based on detection information received from the aerosol generating device 120. As a result, even if smoke 142 is not visually observed in reality from the exhaled breath of the user 10 who smokes using the aerosol generating device 120, the user 10 can observe the virtual smoke image output by the electronic device 110 through virtual reality or augmented reality. However, the present disclosure is not limited thereto.

[0032] According to an embodiment, the electronic device 110 may provide a virtual reality service or an augmented reality service independently, or may provide a virtual reality service or an augmented reality service in conjunction with the aerosol generating device 120 or a third electronic device (e.g., a smartphone) wirelessly or wiredly connected to the electronic device 110. The structure and operation method of the electronic device 110 will be described in detail with reference to FIG. 3 below.

[0033] Virtual reality or augmented reality is considered to mean visual simulation that creates a virtual or augmented visual environment. As used herein, the term "virtual reality" includes simulated images that are generated for visualization by the smoker and may include a partially or fully simulated environment. The term "augmented reality" as used herein is also considered to include a combination of simulated images used to augment a real or "live" environment, where the live image is used in combination with a simulated image overlaid on the live image. As a result of virtual or augmented reality, a simulated virtual image can be provided or a live visual image can be augmented with a simulated augmented image to form an interactive environment that can be seen and felt with reality. In the following, for convenience of explanation, the space in which virtual reality or augmented reality is provided will be referred to as a virtual space.

[0034] According to an embodiment, the electronic device 110 is worn at a predetermined position (e.g., on the head) of a user and can provide (or output) an image to the user. For example, the electronic device 110 can be configured in the form of at least one of glasses, goggles, a helmet, or a hat, but is not limited thereto.

[0035] According to an embodiment, the aerosol generating device 120 and the electronic device 110 may be connected via a dongle 130. For example, the aerosol generating device 120 and the dongle 130 may be a pair. A user may connect the dongle 130 and the electronic device 110 by inserting the dongle 130 into an interface (e.g., a universal serial bus (USB) port) of the electronic device 110. The dongle 130 may receive power for operation from the electronic device 110. A wireless communication channel may be established between the dongle 130 and the aerosol generating device 120. For example, the wireless communication channel may be a wireless communication channel based on Bluetooth low energy (BLE), LoRa, EnOcean, radio frequency (RF) communication, Zigbee (registered trademark), or infrared communication.

[0036] According to an embodiment, the electronic device 110 can install a communication driver and a virtual smoking program for the dongle 130 using data stored in the dongle 130. The electronic device 110 and the dongle 130 can transmit and receive information via the communication driver. The electronic device 110 can execute the virtual smoking program to generate and output a virtual smoke image.

[0037] According to an embodiment, the dongle 130 may receive detection information related to the state of the aerosol generating device 120 from the aerosol generating device 120 via a wireless communication channel. For example, the detection information related to the state of the aerosol generating device 120 may include one or more of distance information between the aerosol generating device 120 and an object (e.g., a part of the user's body), detection value information of the capacitance sensor of the aerosol generating device 120, orientation change information of the aerosol generating device 120, monitoring information of the camera of the aerosol generating device 120, smoking patterns learned using the pressure sensor and button of the aerosol generating device 120, and camera data and pressure sensor data.

[0038] According to an embodiment, the data format of the detection information received by the dongle 130 from the aerosol generating device 120 is a wireless signal format, and the data format of the detection information may be converted from the wireless signal format to a universal serial bus (USB) signal format by the dongle 130. The electronic device 110 may receive the detection information converted into the USB signal format from the dongle 130. After the virtual smoking program is executed, a virtual smoke image may be generated based on the detection information received from the aerosol generating device 120. The virtual smoke image may be output via a display of the electronic device 110.

[0039] The virtual smoke image output system 100 according to an embodiment may further include a reproduction device 140. For example, the reproduction device 140 may be a device capable of providing sound to the user 10, and the method of providing sound is not limited. The electronic device 110, the aerosol generating device 120, and the reproduction device 140 included in the virtual smoke image output system 100 work together to provide an improved smoking experience to the user 10 using the system 100. Although the electronic device 110 and the reproduction device 140 are illustrated as separate entities in FIG. 1, the electronic device 110 may include the reproduction device 140 according to an embodiment.

[0040] According to an embodiment, the electronic device 110 may include one or more auxiliary devices, such as an electroencephalogram (EEG) measurement module, a surface electromyogram (SEM) sensor, etc., to enhance the realism of the smoking behavior in the virtual space.

[0041] FIG. 2 is a diagram illustrating a user's smoking behavior divided into sections and a method for predicting a user's exhalation time and outputting a virtual smoke image according to an embodiment.

[0042] The description with reference to FIG. 1 can be equally applied to the description with reference to FIG. 2, and duplicate content may be omitted.

[0043] According to an embodiment, a user performs one smoking session from time t1 to time t4.

[0044] More specifically, referring to FIG. 2, a user according to an embodiment may inhale smokable material (e.g., aerosol) through the aerosol generating device 120 in a section D1 between time t1 and time t2. The aerosol generating device 120 may generate aerosol in various ways. Hereinafter, the user's action in section D1 may be referred to as a "smoke inhalation" action, and the user may inhale smokable material by biting the aerosol generating device 120 with the mouth and collecting it in the mouth through the smoke inhalation action. In section D1, the user may be in contact with one side of the aerosol generating device 120 (e.g., the inhalation port or mouthpiece).

[0045] In one embodiment, a user may inhale smoke collected in his / her mouth during a period D2 between time t2 and time t3. Hereinafter, the user's action during period D2 may be referred to as an "inhale" action (or an "inhale and lower hand" action), and the user separates one side of the aerosol generating device 120 from his / her lips and lowers his / her hand while inhaling. During period D2, the user and the aerosol generating device 120 may be in a separated state.

[0046] In one embodiment, the user can exhale the inhaled smoke during the D3 period between time t3 and time t4. Hereinafter, the user's action during the D3 period may be referred to as an "exhale" action.

[0047] The length of the D2 section (inhalation time) according to an embodiment can be estimated based on the length of the D1 section (smoke inhalation time). As an example, the length of the D2 section (inhalation time) can be proportional to the length of the D1 section (smoke inhalation time). For example, when the smoke inhalation time is the first, the inhalation time can also be the first, and when the smoke inhalation time is the third, the inhalation time can also be the third. Alternatively, the inhalation time corresponding to the smoke inhalation time can be predicted using an artificial neural network. For example, the smoke inhalation time can be input to an artificial neural network trained based on paired learning data of the smoke inhalation time and the inhalation time, and the corresponding inhalation time can be predicted. However, the method of estimating the inhalation time based on the smoke inhalation time is not limited to the above example.

[0048] Being able to predict the length of D2 (inhalation time) means being able to predict t3 (exhalation time). In other words, the length of D2 can be predicted by measuring the length of D1 (smoke inhalation time), and t3 (exhalation time) can be predicted by adding the predicted length of D2 to the measured length of D1.

[0049] According to an embodiment, the length of the D3 section (exhalation time) may be determined based on at least one of the length of the D1 section (smoke inhalation time) and the length of the D2 section (inhalation time). For example, the length of the D3 section may be determined to be proportional to the length of the D1 section or the length of the D2 section. The t4 time point may be predicted based on the predicted t3 (exhalation time point) and the length of the D3 section.

[0050] According to an embodiment, a user can set information regarding the length of section D3 in advance in electronic device 110. For example, a ratio to the length of section D1 or the length of section D2 can be set by the user. A user who wishes to maintain a relatively long output time of virtual smoke can set the ratio to be large.

[0051] In the virtual smoking system according to an embodiment, a user can experience virtual reality or augmented reality of smoking by linking smoking in the real world through the aerosol generating device 120 with the electronic device 110. More specifically, the electronic device 110 according to an embodiment can realize virtual smoke in the virtual space at the time when the user exhales real smoke through the aerosol generating device 120, thereby realizing virtual smoke that does not feel foreign.

[0052] A user of the aerosol generating device 120 according to an embodiment repeats the actions D1 to D3 at least once to perform a smoking act, and the electronic device 110 or the aerosol generating device 120 can detect or predict the user's inhalation, inhalation, and exhalation of tobacco smoke to realize virtual smoke. Hereinafter, "realizing virtual smoke" may include determining at least one of the output time of the virtual smoke, i.e., the exhalation time, and the attributes of the virtual smoke. For example, the attributes of the virtual smoke may include one or more of the size, shape, duration, volume, density, and color of the virtual smoke. This is not limited in the present specification.

[0053] Referring to the flowchart of FIG. 2, when a user starts smoking according to an embodiment (200), the user can inhale smokable material through the aerosol generating device 120 and collect it in the mouth. At this time, the time (e.g., D1) during which the user inhales tobacco smoke is measured (210). After that, when the user finishes inhaling smoke, the user performs an inhalation and hand-down action. At this time, the time (e.g., D2) during which the user inhales and hands-down can be measured (220). The electronic device 110 or the aerosol generating device 120 can predict the time during which the user inhales and hands-down and the time of exhalation (e.g., t3) at which the user starts exhaling based on the smoke inhalation time 210. When the user starts exhaling, the electronic device 110 can realize (240) virtual smoke during the time (e.g., D3) during which the user exhales. When a predetermined time has elapsed since the start of exhalation, the electronic device 110 can end (250) the virtual smoke output.

[0054] FIG. 3 is a diagram for explaining a virtual smoke image output system according to an embodiment.

[0055] A system 300 for outputting a virtual smoke image according to an embodiment (e.g., system 100 in FIG. 1 ) may include an electronic device 310 for outputting a virtual smoke image (e.g., electronic device 110 in FIG. 1 ), an aerosol generating device 320 (e.g., aerosol generating device 120 in FIG. 1 ), and a dongle 330 (e.g., dongle 130 in FIG. 1 ). For example, the aerosol generating device 320 and the dongle 330 may be a pair. For example, the aerosol generating device 320 may be an inhaler, such as an electronic cigarette or an inhaler.

[0056] The electronic device 310 according to an embodiment may include a communication unit 311, a processor 312, a memory 313, a display 314, and a USB port 315. The electronic device 310 may be a device for virtual reality, augmented reality, or a metaverse, but the embodiment is not limited thereto.

[0057] The communication unit 311 is connected to the processor 312 and the memory 313 to transmit and receive data. The communication unit 311 can be connected to another external device to transmit and receive data. Hereinafter, an expression of transmitting and receiving "A" can indicate transmitting and receiving "information or data indicating A".

[0058] The communication unit 311 may be realized as a circuitry within the electronic device 310. For example, the communication unit 311 may include an internal bus and an external bus. As another example, the communication unit 311 may be an element that connects the electronic device 310 to an external device (e.g., the dongle 330). The communication unit 311 may be an interface. The communication unit 311 may receive data from the external device (e.g., the dongle 330) and transmit the data to the processor 312 and the memory 313.

[0059] The processor 312 processes data received by the communication unit 311 and data stored in the memory 313. A "processor" may be a data processing device implemented in hardware having circuits with a physical structure for performing desired operations. For example, the desired operations may include code or instructions included in a program. For example, the data processing device implemented in hardware may include a microprocessor, a central processing unit, a processor core, a multi-core processor, a multiprocessor, an application-specific integrated circuit (ASIC), or a field programmable gate array (FPGA).

[0060] The processor 312 executes computer readable code (e.g., software) stored in a memory (e.g., memory 313) and instructions triggered by the processor 312. For example, the processor 312 may execute instructions that cause a virtual smoke image to be output via the display 314.

[0061] The memory 313 stores data received by the communication unit 311 and data processed by the processor 312. For example, the memory 313 may store programs, applications, or software (e.g., a communication driver and a virtual smoking program). The stored programs may be a set of syntaxes that are coded to output a virtual smoke image and are executable by the processor 312.

[0062] According to one embodiment, memory 313 may include one or more of volatile memory, non-volatile memory and random access memory (RAM), flash memory, a hard disk drive, and an optical disk drive.

[0063] The memory 313 stores a set of instructions (e.g., software) that operate the electronic device 310. The set of instructions that operate the electronic device 310 are executed by the processor 312.

[0064] According to one embodiment, the electronic device 310 and the aerosol generating device 320 may be connected via a dongle 330. For example, the dongle 330 may be connected to a USB port 315 of the electronic device 310. A communication driver and a virtual smoking program stored in the dongle 330 may be installed in the electronic device 310 via the dongle 330.

[0065] According to one embodiment, when the dongle 330 is coupled (or inserted or connected) to the USB port 315 of the electronic device 310, the communication driver and the virtual smoking program may be automatically installed in the electronic device 310. For example, the communication driver and the virtual smoking program may be installed or stored in the memory 313.

[0066] According to one embodiment, after the dongle 330 is connected to the USB port 315 of the electronic device 310, if a separate input is received from the user, the communication driver and the virtual smoking program may be installed.

[0067] According to an embodiment, the processor 312 can execute a virtual smoking program. For example, the virtual smoking program can be automatically executed after the virtual smoking program is installed. As another example, the virtual smoking program can be executed when a smoking start signal is received from a user or a smoking start signal is received from the aerosol generating device 320. The processor 312 can generate a virtual smoke image based on detection information regarding the state of the aerosol generating device 320 received from the aerosol generating device 320 via the dongle 330.

[0068] The electronic device 310 may provide a virtual reality, augmented reality, or metaverse image in which tobacco smoke is generated to a user via the display 314. In one embodiment, the display 314 may be controlled to be transparent or opaque depending on the intended use. When the electronic device 310 provides a virtual reality or metaverse image, the display 314 may be controlled to be opaque, and when the electronic device 310 provides an augmented reality image, the display 314 may be controlled to be transparent.

[0069] For example, the display 314 may be made of, but is not limited to, a plastic material such as polycarbonate, or a glass material, and may be coated with at least one of a light reflection and anti-glare coating, an anti-fog coating, and an ultraviolet blocking coating.

[0070] According to an example, the system 300 can further include an article. The electronic device 310 can receive content information about the article from the article. The electronic device 310 can modify an image displayed on the display 314 based on the content information about the article.

[0071] In one embodiment, an image showing tobacco smoke may be displayed on the display 314, and the electronic device 310 may change the image relating to at least one of the color of the tobacco smoke, the amount of the tobacco smoke, and the pattern of the tobacco smoke displayed on the display 314 based on the content information relating to the article.

[0072] The electronic device 310 may further include a camera (not shown) that can scan the actual surroundings when the user uses the electronic device 310 to assist the user in using the electronic device 310.

[0073] The electronic device 310 may be installed with applications to provide a user with various experiences. For example, a smoking application may be installed to provide a virtual space smoking system to provide a user with a smoking experience close to reality. However, the present disclosure is not limited thereto.

[0074] The electronic device 310 may further include a sensor for detecting or predicting a user's smoking behavior in the system 300. For example, the sensor may include a surface electromyogram sensor or an electroencephalogram measuring module attached to the user's skin to detect the user's smoking behavior. The electronic device 310 may include a communication device for communicating with the article. However, the present disclosure is not limited thereto.

[0075] FIG. 4 is a flowchart of a virtual smoke image output method according to an embodiment.

[0076] The following operations 410-450 are performed by the electronic device 310 described above with reference to FIG.

[0077] At operation 410 , the electronic device 310 may install a communication driver and a virtual smoking program stored in the dongle 330 .

[0078] In one embodiment, when the dongle 330 is coupled (or connected) to the USB port 315 of the electronic device 310, the communication driver and the virtual smoking program may be automatically installed.

[0079] In one embodiment, after the dongle 330 is connected to the USB port 315 of the electronic device 310, if a separate input is received from the user, the communication driver and the virtual smoking program may be installed.

[0080] According to one embodiment, the data format of the detection information received by the dongle 330 from the aerosol generating device 320 is a wireless signal format, and the data format of the detection information can be converted from the wireless signal format to a USB signal format by the dongle 330. The electronic device 310 can receive the detection information converted into the USB signal format from the dongle 330 via a communication driver.

[0081] In operation 420, the electronic device 310 can execute the virtual smoking program. For example, the virtual smoking program can be executed automatically after the virtual smoking program is installed. As another example, the virtual smoking program can be executed when a smoking start signal is received from the aerosol generating device 320. As another example, when the virtual smoking program is installed in the electronic device 310, the virtual smoking program can be executed automatically when it is detected that the dongle 330 is connected to the USB port 314 of the electronic device 310. As yet another example, the virtual smoking program can be executed when the electronic device 310 receives a power ON signal from the aerosol generating device 320 after the dongle 330 is connected to the USB port 315 of the electronic device 310.

[0082] In operation 430, the electronic device 310 may receive detection information regarding the state of the aerosol generating device 320. For example, the detection information may include one or more of distance information between the aerosol generating device 320 and an object (e.g., a body part of a user), detection value information of a capacitance sensor of the aerosol generating device 320, orientation change information of the aerosol generating device 320, monitoring information of a camera of the aerosol generating device 320, smoking patterns learned using a pressure sensor and a button of the aerosol generating device 320, and camera data and pressure sensor data. The detection information of the aerosol generating device 320 will be described in further detail with reference to FIG. 5 below.

[0083] In operation 440 , the electronic device 310 may generate a virtual smoke image based on the detection information of the aerosol generating device 320 .

[0084] In one embodiment, the electronic device 310 can determine attributes of the virtual smoke based on the detection information. For example, the attributes of the virtual smoke can include one or more of the size, shape, duration, volume, density, and color of the virtual smoke, which is not limited herein. The electronic device 310 can generate a virtual smoke image based on the attributes of the virtual smoke.

[0085] At operation 450 , the virtual smoke image may be output via a display of the electronic device 310 .

[0086] In one embodiment, the electronic device 310 can determine the exhalation time based on a first time at which the distance between one side of the aerosol generating device 320 and a part of the user's body reaches within a first threshold, as sensed by the aerosol generating device 320, and a second time after the first time at which the distance between one side of the aerosol generating device 320 and a part of the user's body exceeds a second threshold.

[0087] In one embodiment, the electronic device 310 can determine the exhalation time based on a first time at which the capacitance value of the aerosol generating device 320 sensed by the aerosol generating device 320 reaches within a first threshold and a second time after the first time at which the capacitance value of the aerosol generating device 320 exceeds a second threshold.

[0088] In one embodiment, when a virtual smoke image is output, i.e., when an exhalation occurs, if another image is already output through the display of the electronic device 310, the virtual smoke image may be output by being superimposed on the previously output basic image. For example, the electronic device 310 may output an image by superimposing the image using a layer for outputting a basic image and a virtual smoke image layer. The user may observe the superimposed image.

[0089] In one embodiment, the virtual smoke image may be output so as to be composited with other video content scenes, for example, the image may be output so that the virtual smoke appears in a scene within the video.

[0090] Even if a user cannot visually observe smoke in reality, the user can observe smoke through an image in which virtual smoke appears, and can satisfy the sensation of smoking through the observed smoke.

[0091] FIG. 5 is a diagram illustrating an aerosol generating device according to an embodiment.

[0092] Referring to Fig. 5, the aerosol generating device 500 (e.g., the aerosol generating device 120 of Fig. 1 or the aerosol generating device 320 of Fig. 3) can have a cigarette shape. For example, the length and diameter of the aerosol generating device 500 can be substantially the same as the length and diameter of a traditional cigarette-type cigarette, but are not limited to the described embodiment. The aerosol generating device 500 can be divided into a first end 510, a middle portion 520, and a second end 530.

[0093] The first end 510 can be a portion for replicating the lighting portion of a cigarette. The first end 510 can include an LED. For example, the first end 510 can include a red LED.

[0094] The second end 530 may include nicotine. In one embodiment, the surface of the second end 530 may be coated with nicotine, or the second end 530 may include an aerosol product inside. For example, when the aerosol product is heated, an aerosol containing nicotine may be generated. When a user bites the second end 530 of the aerosol generating device 500 and inhales the aerosol, nicotine may be provided to the user. Meanwhile, the second end 530 may further include a flavoring portion containing a flavoring in addition to the aerosol product.

[0095] In one embodiment, the intermediate portion 520 serves to connect the first end 510 and the second end 530. The length of the intermediate portion 520 determines the overall length of the aerosol generating device 500, and the length of the intermediate portion 520 can be set during manufacturing of the aerosol generating device 500 so that the length of the aerosol generating device 500 corresponds to the length of a typical cigarette.

[0096] In another embodiment, the aerosol generating device 500 may include other electronic devices or electronic circuits inside (e.g., the middle part 520) as an electronic device. For example, the aerosol generating device 500 may include a sensor for acquiring detection information regarding the state of the aerosol generating device 500 or detecting a user's smoking behavior. The sensor may include, for example, a sensor for detecting a distance change, a sensor for detecting a direction change, a sensor for detecting a capacitance change, and a pressure sensor. The aerosol generating device 500 may include other electronic devices outside the housing as an electronic device. For example, the aerosol generating device 500 may include a camera for observing a user's smoking behavior. The aerosol generating device 500 may have buttons inside or outside for a power adjustment function, a smoking pattern learning function, or a smoking detection function. The aerosol generating device 500 may include a communication device for communicating with an XR device (e.g., the electronic device 110 in FIG. 1 or the electronic device 310 in FIG. 3) as an electronic device. However, the present disclosure is not limited to aerosol generating devices that include sensors, cameras, or buttons.

[0097] The distance detection sensor according to an embodiment may be located inside or outside the second end 530. The distance detection sensor according to an embodiment may be an infrared type, a lidar type, an ultrasonic type, or the like. However, the distance detection sensor of the present disclosure is not limited to the above types. Hereinafter, a method for determining an exhalation time when a user starts exhaling using the distance detection sensor according to an embodiment will be described in detail.

[0098] When a user according to an embodiment starts smoking, the distance detection sensor may detect the distance between an object (e.g., the user's lips) and the aerosol generating device 500. The aerosol generating device 500 may transmit detection information of the distance detection sensor to the electronic device 110 (or the electronic device 310) via a dongle (e.g., the dongle 130 in FIG. 1 or the dongle 330 in FIG. 3). The electronic device 310 may determine the time of exhalation based on the detection information of the distance detection sensor received from the aerosol generating device 500.

[0099] In one embodiment, the step of starting smoking includes a step in which the user brings the aerosol generating device 500 to his / her lips and inhales. The user can turn on the aerosol generating device 500 to start heating the aerosol product in the aerosol generating device 500, and the turned-on aerosol generating device 500 can preheat a heater that heats the aerosol product.

[0100] According to an embodiment, the step of detecting a distance between an object (e.g., a body part of a user) and the aerosol generating device 500 by the distance detection sensor may include a step of detecting a first time when the object contacts the second end 530 of the aerosol generating device 500 and a step of detecting a second time when the object moves away from the second end 530 of the article. For example, the step of detecting the first time may include the distance detection sensor detecting that the second end 530 of the aerosol generating device 500 and the object approach each other within a distance of a first threshold. For example, the step of detecting the second time may include the distance detection sensor detecting that the object moves away from the second end 530 of the aerosol generating device 500 to a distance exceeding a second threshold after the object contacts the second end 530 of the aerosol generating device 500.

[0101] According to an embodiment, determining the exhalation time when the user starts exhaling includes determining the exhalation time based on an interval between a first time and a second time. The first time may be a time when the user starts smoke inhalation. The interval between the first time and the second time is a time when the user inhales smoke, and the first breathing time of the user may be predicted based on the smoke inhalation time. The second time may be a time when the user starts inhaling. The second breathing time may be predicted based on the interval between the first time and the second time and the first breathing time. The second breathing time may be a time when the user exhales. For example, the second breathing time may be determined as the exhalation time. According to an embodiment, the smoke inhalation time of the user is an interval between the first time and the second time, so the first breathing time, which is the time when the user inhales, may be estimated similarly to the smoke inhalation time. The electronic device 110 may then determine the second breathing time, which is the time when the user starts exhaling, as the time when the first breathing time has elapsed from the second time. For example, if the time from the first time when the object arrives at the second end 530 to the second time when the object is removed from the second end 530 is 1 second, the first breathing time can be estimated to be 1 second, and the time when the user inhales can also be predicted to be 1 second similar to the first breathing time. As a result, the time of the second breathing when the first breathing time has elapsed from the second time can be predicted to be the time when 1 second has elapsed since the object was separated from the aerosol generating device 500. As a result, the electronic device 110 can determine the time when 1 second has elapsed since the object was removed as the time of exhalation.

[0102] The step of determining the exhalation time based on the distance detection information according to an embodiment includes a step of estimating the inhalation amount and the respiration amount of the user based on the interval between the first time and the second time. The inhalation amount of the user may include an inhalation amount of the aerosol inhaled by the user through the aerosol generating device 500 in a state where the aerosol generating device 500 is in contact with an object. The respiration amount of the user may include an inspiration amount inhaled by the user in a state where the aerosol generating device 500 is not in contact with an object. The exhalation time may be determined based on the estimated respiration amount and the inhalation amount. The step of determining the exhalation time based on the detection information according to an embodiment includes a step of determining whether the aerosol generating device 500 satisfies a predetermined operating condition, and a step of determining the exhalation time based on the determination that the aerosol generating device 500 satisfies the operating condition. The predetermined operating condition includes at least one of whether the user turns on / off the aerosol generating device 500, and whether a puff sensor included in the aerosol generating device and a pressure sensor included in the aerosol generating device operate. Although the detection value of the distance detection sensor may change depending on other objects (e.g., a finger, etc.) rather than the specified object, the distance detection sensor can be activated only when the user turns the power on / off, and the distance detection sensor can be activated by detecting the user's inhalation via a puff sensor or a pressure sensor, etc. However, the inhalation sensor of the present disclosure is not limited to a puff sensor or a pressure sensor.

[0103] According to an embodiment, the step of transmitting the detection information to the electronic device 310 via the dongle 330 may include a step of transmitting information on the type of virtual smoke and a step of transmitting information on a delay time generated in communication between the aerosol generating device 500 and the electronic device 310. The type of virtual smoke may be changed according to a user's selection, or may be changed by an aerosol product or other flavoring unit built into the second end 530. The detection information may also include information on the user's smoking amount, breathing amount, etc., and the present disclosure is not limited thereto. If the exhalation time does not match the user's actual smoking behavior or an accurate predicted time cannot be grasped, additional operations may be performed to perform a separate "exhalation prediction detection" processing process.

[0104] The distance capacitance sensor according to an embodiment may be located inside or outside the second end 530. The capacitance sensor according to an embodiment may be a sensor based on a capacitor. However, the capacitance sensor of the present disclosure is not limited to the above method. Hereinafter, a method for determining an exhalation time when a user starts exhaling using the capacitance sensor according to an embodiment will be described in detail.

[0105] When a user according to an embodiment starts smoking, the capacitance sensor may detect the capacitance of the capacitance sensor, which changes when an object (e.g., the user's lips) comes into contact with the aerosol generating device 500. For example, the capacitance sensor may detect a change in capacitance. The aerosol generating device 500 may transmit the detection information of the capacitance sensor to the electronic device 310 via the dongle 330. The electronic device 310 may determine the time of exhalation based on the detection information of the capacitance sensor received from the aerosol generating device 500.

[0106] The step of starting smoking according to one embodiment includes a step in which a user brings the aerosol generating device 500 into contact with the lips and inhales. The user can turn on the aerosol generating device 500 to start heating the aerosol product in the aerosol generating device 500, and the turned-on aerosol generating device 500 can preheat a heater that heats the aerosol product.

[0107] According to an embodiment, the step of detecting a change in capacitance when the object comes into contact with the aerosol generating device 500 by the capacitance sensor may include a step of sensing a first time when the object comes into contact with the second end 530 of the aerosol generating device 500 and a step of sensing a second time when the object moves away (or is removed) from the second end 530 of the article. For example, the step of sensing the first time may include the capacitance sensor sensing that the detected capacitance reaches within a first threshold value when the object comes into contact with the second end 630 of the aerosol generating device 500. For example, the step of sensing the second time may include the capacitance sensor sensing that the detected capacitance exceeds a second threshold value when the object is removed after contacting the second end 530 of the aerosol generating device 500.

[0108] The step of the electronic device 310 determining the exhalation time based on the capacitance detection information according to an embodiment includes a step of determining the exhalation time based on an interval between a first time and a second time. The first time may be a time when the user starts to inhale smoke. The interval between the first time and the second time is a time when the user inhales smoke, and a first breathing time of the user may be predicted based on the smoke inhalation time. The second time may be a time when the user starts to inhale. The second breathing time may be predicted based on the interval between the first time and the second time and the first breathing time. The second breathing time may be a time when the user starts to exhale. For example, the second breathing time may be determined as the exhalation time.

[0109] According to an embodiment, since the smoke inhalation time of the user is the interval between the first time and the second time, the first breathing time, which is the time when the user inhales, can be estimated similarly to the smoke inhalation time. Thereafter, the electronic device 310 can determine the time of the second breathing, which is the time when the user starts exhaling, as the time when the first breathing time has elapsed from the second time. For example, if the time from the first time when the object arrives at the second end 530 to the second time when the object is removed from the second end 530 is 1 second, the first breathing time can be estimated as 1 second, and the time when the user inhales can also be predicted as 1 second similarly to the first breathing time. As a result, the time of the second breathing, which is the time when the first breathing time has elapsed from the second time, can be predicted as the time when 1 second has elapsed since the object was separated from the aerosol generating device 500. As a result, the electronic device 310 can determine the time when 1 second has elapsed since the object was removed as the time of exhalation.

[0110] The step of determining the expiration time based on the capacitance detection information according to an embodiment includes a step of estimating the inhalation volume and the breathing volume of the user based on the interval between the first time and the second time. The inhalation volume of the user may include the inhalation volume of the aerosol inhaled by the user through the aerosol generating device 500 in a state where the aerosol generating device 500 is in contact with an object. The breathing volume of the user may include the inhalation volume of the user in a state where the aerosol generating device 500 is not in contact with an object. The expiration time can be determined based on the estimated breathing volume and the inhalation volume.

[0111] The step of the electronic device 310 determining the time of exhalation based on the capacitance detection information according to an embodiment includes a step of determining whether the aerosol generating device 500 satisfies a predetermined operating condition, and a step of determining the time of exhalation based on the determination that the aerosol generating device 500 satisfies the operating condition. The predetermined operating condition includes at least one of whether the user turns on / off the power of the aerosol generating device 500, and whether the puff sensor and the pressure sensor included in the aerosol generating device operate. Although the detection value of the capacitance sensor may change depending on other objects (e.g., a finger, etc.) instead of the predetermined object, the capacitance sensor can be activated only when the user turns on / off the power, and the capacitance sensor can be activated by detecting the inhalation of the user via the puff sensor or the pressure sensor, etc. However, the inhalation sensor of the present disclosure is not limited to the puff sensor or the pressure sensor.

[0112] The step of transmitting the detection information of the capacitance sensor to the electronic device 310 via the dongle 330 according to an embodiment includes a step of transmitting information about the type of virtual smoke and a step of transmitting information about a delay time generated in communication between the aerosol generating device 500 and the electronic device 310. The type of virtual smoke may be changed according to a user's selection, or may be changed by an aerosol product or other flavoring unit built into the second end 530. The detection information may also include information about the user's smoking amount, breathing amount, etc., and the present disclosure is not limited thereto.

[0113] The distance orientation change sensor according to an embodiment may be located inside or outside the second end 530. The orientation change sensor according to an embodiment may be a sensor such as a gyro sensor, an acceleration sensor, or a 3dof / 6dof sensor. However, the orientation change sensor of the present disclosure is not limited to the above method. Hereinafter, a method for determining an exhalation time when a user starts exhaling using the orientation change sensor according to an embodiment will be described in detail.

[0114] When a user according to an embodiment starts smoking, the orientation change sensor may detect an orientation change between an object (e.g., the user's lips) and the aerosol generating device 500. The aerosol generating device 500 may transmit the detection information of the orientation change sensor to the electronic device 310 via the dongle 330. The electronic device 310 may determine the exhalation time based on the detection information of the orientation change sensor.

[0115] The step of starting smoking according to one embodiment includes a step in which a user brings the aerosol generating device 500 into contact with the lips and inhales. The user can turn on the aerosol generating device 500 to start heating the aerosol product in the aerosol generating device 500, and the turned-on aerosol generating device 500 can preheat a heater that heats the aerosol product.

[0116] According to an embodiment, the step of detecting an orientation change between the object and the aerosol generating device 500 by the orientation change sensor may include detecting a first time when the object contacts the second end 530 of the aerosol generating device 500 and detecting a second time when the object moves away from the second end 530 of the article. For example, the step of detecting the first time may include the orientation change sensor detecting that the second end 530 of the aerosol generating device 500 and the object approach each other in an orientation that is within a first threshold, and detecting a change in acceleration while the user brings the aerosol generating device 500 with the object. For example, the step of detecting the second time may include detecting that the object moves away from the second end 530 of the aerosol generating device 500 in an orientation that exceeds a second threshold after the object contacts the second end 530 of the aerosol generating device 500, and detecting a change in acceleration while the user removes the aerosol generating device 500 from the object.

[0117] According to an embodiment, the orientation change can be measured by comparing the x, y, and z-axis orientations of the aerosol generating device 500 when the user lowers his / her hand with the x, y, and z-axis orientations of the aerosol generating device 500 when the user brings the aerosol generating device 500 into contact with an object. When the user moves his / her hand to move the aerosol generating device 500, the measured acceleration can show a pattern of increasing, decreasing, and stopping. The orientation change can be predicted by measuring the change section of the acceleration, and the user's smoking time can be estimated based on the predicted orientation change.

[0118] The step of the electronic device 310 determining the exhalation time based on the detection information of the orientation change according to an embodiment includes a step of determining the exhalation time based on an interval between a first time and a second time. The first time may be a time when the user starts to inhale smoke. The interval between the first time and the second time is a time when the user inhales smoke, and a first breathing time of the user may be predicted based on the smoke inhalation time. The second time may be a time when the user starts to inhale. The second breathing time may be predicted based on the interval between the first time and the second time and the first breathing time. The second breathing time may be a time when the user starts to exhale. For example, the second breathing time may be determined as the exhalation time.

[0119] According to an embodiment, since the smoke inhalation time of the user is the interval between the first time and the second time, the first breathing time, which is the time when the user inhales, can be estimated similarly to the smoke inhalation time. Thereafter, the electronic device 310 can determine the time of the second breathing, which is the time when the user starts exhaling, as the time when the first breathing time has elapsed from the second time. For example, if the time from the first time when the object arrives at the second end 530 to the second time when the object is detached from the second end 530 is 1 second, the first breathing time can be estimated as 1 second, and the time when the user inhales can also be predicted as 1 second similarly to the first breathing time. As a result, the time of the second breathing, which is the time when the first breathing time has elapsed from the second time, can be predicted as the time when 1 second has elapsed since the object was separated from the aerosol generating device 500. As a result, the electronic device 310 can determine the time when 1 second has elapsed since the object was separated as the time of exhalation.

[0120] According to an embodiment, the step of the electronic device 310 determining the exhalation time based on the detection information includes a step of estimating the inhalation volume and the respiration volume of the user based on the interval between the first time and the second time. The inhalation volume of the user may include the inhalation volume of the aerosol inhaled by the user through the aerosol generating device 500 in a state where the aerosol generating device 500 is in contact with an object. The respiration volume of the user may include the inhalation volume of the user in a state where the aerosol generating device 500 is not in contact with an object. The exhalation time may be determined based on the estimated respiration volume and the inhalation volume.

[0121] The step of determining the exhalation time based on the detection information according to an embodiment includes a step of determining whether the aerosol generating device 500 satisfies a predetermined operating condition, and a step of determining the exhalation time based on the determination that the aerosol generating device 500 satisfies the operating condition. The predetermined operating condition includes at least one of whether the user turns on / off the power of the aerosol generating device 500, and whether the puff sensor included in the electronic device and the pressure sensor included in the aerosol generating device 500 operate. Although the detection value of the orientation change sensor may change due to other objects (e.g., a finger, etc.) rather than the predetermined object, the orientation change sensor can be activated only when the user turns on / off the power, and the orientation change sensor can be activated by detecting the user's inhalation via a puff sensor or a pressure sensor, etc. However, the inhalation sensor of the present disclosure is not limited to a puff sensor or a pressure sensor.

[0122] In one embodiment, the step of transmitting the detection information to the electronic device 310 includes a step of transmitting information regarding the type of virtual smoke and a step of transmitting information regarding a delay time occurring in communication between the aerosol generating device 500 and the electronic device 310. The type of virtual smoke may be changed according to a user's selection, or may be changed by an aerosol product or other flavoring unit built into the second end 530. The detection information may also include information regarding the user's smoking amount, breathing amount, etc., and the present disclosure is not limited thereto.

[0123] The camera according to an embodiment may be located on the surface of the housing of the aerosol generating device 500. Hereinafter, a method for determining the exhalation time when a user starts exhaling using the camera according to an embodiment will be described in detail.

[0124] When a user according to an embodiment starts smoking, the camera can monitor the movement of an object (e.g., the user's lips). The aerosol generating device 500 can transmit the camera monitoring information (i.e., detection information) to the electronic device 310 via the dongle 130. The electronic device 310 can determine the exhalation time based on the camera monitoring information.

[0125] The step of starting smoking according to one embodiment includes a step in which a user brings the aerosol generating device 500 into contact with the lips and inhales. The user can turn on the aerosol generating device 500 to start heating the aerosol product in the aerosol generating device 500, and the turned-on aerosol generating device 500 can preheat a heater that heats the aerosol product.

[0126] In one embodiment, the step of monitoring the distance between the object and the aerosol generating device 500 by the camera may include detecting a first time when the motion of the object changes due to contact of the object with the aerosol generating device 500 at the second end 530 of the aerosol generating device 500 and detecting a second time when the motion of the object changes due to separation of the object from the aerosol generating device 500 by the second end 530 of the article. For example, the step of detecting the first time may include the camera detecting a first motion of the object bringing the second end 530 of the aerosol generating device 500 to the lips for contact. For example, the step of detecting the second time may include the camera detecting a second motion of the object separating from the second end 530 of the aerosol generating device 500.

[0127] The step of the electronic device 310 according to an embodiment determining the exhalation time based on the monitoring information of the camera includes determining the exhalation time based on an interval between a first time and a second time. The first time may be a time when the user starts to inhale smoke. The interval between the first time and the second time is a time when the user inhales smoke, and a first breathing time of the user may be predicted based on the smoke inhalation time. The second time may be a time when the user starts to inhale. A second breathing time may be predicted based on the interval between the first time and the second time and the first breathing time. The second breathing time may be a time when the user starts to exhale. For example, the second breathing time may be determined as the exhalation time.

[0128] According to an embodiment, since the smoke inhalation time of the user is the interval between the first time and the second time, the first breathing time, which is the time when the user inhales, can be estimated similarly to the smoke inhalation time. Thereafter, the electronic device 310 can determine the time of the second breathing, which is the time when the user starts exhaling, as the time when the first breathing time has elapsed from the second time. For example, if the time from the first time when the object arrives at the second end 530 to the second time when the object is removed from the second end 530 is 1 second, the first breathing time can be estimated as 1 second, and the time when the user inhales can also be predicted as 1 second similarly to the first breathing time. As a result, the time of the second breathing, which is the time when the first breathing time has elapsed from the second time, can be predicted as the time when 1 second has elapsed since the object was separated from the aerosol generating device 500. As a result, the electronic device 310 can determine the time when 1 second has elapsed since the object was removed as the time of exhalation.

[0129] According to an embodiment, the step of the electronic device 310 determining the exhalation time based on the monitoring information includes estimating the inhalation volume and the respiration volume of the user based on the interval between the first time and the second time. The inhalation volume of the user may include the inhalation volume of the aerosol inhaled by the user through the aerosol generating device 500 in a state where the aerosol generating device 500 is in contact with an object. The respiration volume of the user may include the inhalation volume of the user in a state where the aerosol generating device 500 is not in contact with an object. The exhalation time may be determined based on the estimated respiration volume and the inhalation volume.

[0130] The step of determining the time of exhalation based on the detection information according to an embodiment includes a step of determining whether the aerosol generating device 500 satisfies a predetermined operating condition, and a step of predicting the time of exhalation based on the determination that the aerosol generating device 500 satisfies the operating condition. The predetermined operating condition includes at least one of whether the user turns on / off the power of the aerosol generating device 500, and whether the puff sensor included in the electronic device and the pressure sensor included in the aerosol generating device 500 operate. Although the operation detected by the camera may change depending on other objects (e.g., a finger, etc.) instead of the predetermined object, the camera can be operated only when the user turns on / off the power, and the camera can be operated by detecting the user's inhalation via a puff sensor or a pressure sensor, etc. However, the inhalation sensor of the present disclosure is not limited to a puff sensor or a pressure sensor.

[0131] The step of transmitting the monitoring information, i.e., the detection information, from the aerosol generating device 500 according to an embodiment to the electronic device 310 includes a step of transmitting information regarding the type of virtual smoke and a step of transmitting information regarding a delay time occurring in communication between the aerosol generating device 500 and the electronic device 310. The type of virtual smoke may be changed according to a user's selection, or may be changed by an aerosol product or other flavoring unit built into the second end 530. The detection information may also include information regarding the user's smoking amount, breathing amount, etc., and the present disclosure is not limited thereto.

[0132] A pressure sensor and a button (not shown) according to an embodiment may be included in the aerosol generating device 500. The pressure sensor may be located inside or outside the second end 530. The pressure sensor may measure the pressure generated when the user brings the second end to the lips or bites it to smoke, and may detect whether the user is inhaling. The button may have a function of turning on / off the power of the aerosol generating device 500, and may include an input function for storing the user's smoking pattern. The button may include a function of determining whether the user's input is an operation of the power function or an operation for storing the smoking pattern. For example, the button may have a function of turning on / off the power when pressed for a long time, a function of storing the smoking pattern when pressed for a short time, or a function of transmitting detection information such as changing the type of virtual smoke. However, the button of the present disclosure is not limited to the above functions.

[0133] In one embodiment, when a user starts smoking, the aerosol generating device 500 can learn the smoking pattern using the pressure sensor and the button. The electronic device 110 can determine the exhalation time based on the learned smoking pattern and determine the volume and concentration of the virtual smoke. The aerosol generating device 500 can transmit the smoking pattern (i.e., the detection information) to the electronic device 110 (or the electronic device 310) via the dongle 130.

[0134] The step of starting smoking according to an embodiment includes a step of a user bringing the aerosol generating device to his lips and inhaling. The user can turn on the aerosol generating device 500 to start heating the aerosol product in the aerosol generating device 500, and the aerosol generating device 500 that has been turned on can preheat a heater that heats the aerosol product. The step of learning a smoking pattern using the pressure sensor and the button according to an embodiment includes a step of detecting a first time when an object contacts the second end 530 of the aerosol generating device 500 and a pressure detection value of the pressure sensor is measured to exceed a first threshold, a step of detecting a second time after the first time when the object is separated from the second end 530 and a pressure detection value of the pressure sensor is measured to be within a second threshold, and a step of detecting a third time after the second time when the button of the aerosol generating device 500 is operated.

[0135] In the method of learning a smoking pattern according to an embodiment, when a user starts puffing to smoke, the time when the pressure changes by the pressure sensor is measured and stored. Then, the time when the detection value of the pressure sensor is restored at the time when the user stops puffing is stored. The time duration between the start and end of puffing is the smoke inhalation time of the user, which is similar to the user's inhalation time. Then, when the user exhales the smoke he or she has inhaled, the user presses a button of the aerosol generating device 500 to input that exhalation is to begin. When the user's exhalation ends, the user stops pressing the button. The time difference between the start and end of exhalation is similar to the user's exhalation time. The aerosol generating device 500 can generate an algorithm for the user's smoking pattern based on the above-mentioned smoking pattern of the user performed at least once, and can store the smoking pattern learned based on the algorithm.

[0136] In one embodiment, storing the smoking pattern includes storing the smoking pattern based on intervals between a first time and a second time and between the second time and a third time, and collecting data regarding the smoking pattern for at least one or more intervals between the first time and the second time and between the second time and the third time.

[0137] The step of the electronic device 310 according to an embodiment determining the exhalation time based on the learned smoking pattern includes determining the exhalation time based on an interval between a first time and a second time. The first time may be a time when the user starts to inhale smoke. The interval between the first time and the second time is a time when the user inhales smoke, and a first breathing time of the user may be predicted based on the smoke inhalation time. The second time may be a time when the user starts to inhale. A second breathing time may be predicted based on the interval between the first time and the second time and the first breathing time. The second breathing time may be a time when the user starts to exhale. For example, the second breathing time may be determined as the exhalation time.

[0138] According to an embodiment, since the smoke inhalation time of the user is the interval between the first time and the second time, the first breathing time, which is the time when the user inhales, can be estimated similarly to the smoke inhalation time. Thereafter, the electronic device 310 can determine the time of the second breathing, which is the time when the user starts exhaling, as the time when the first breathing time has elapsed from the second time. For example, if the time from the first time when the object arrives at the second end 530 to the second time when the object is detached from the second end 530 is 1 second, the first breathing time can be estimated as 1 second, and the time when the user inhales can also be predicted as 1 second similarly to the first breathing time. Thus, the time of the second breathing, which is the time when the first breathing time has elapsed from the second time, can be determined as the time when 1 second has elapsed since the object was separated from the aerosol generating device 500. Thus, the electronic device 310 can determine the time when 1 second has elapsed since the object was separated as the exhalation time.

[0139] According to an embodiment, the step of determining the exhalation time point based on the learned smoking pattern includes a step of estimating the inhalation amount and the breathing amount of the user based on the interval between the first time point and the second time point. The inhalation amount of the user may include the inhalation amount of the aerosol inhaled by the user through the aerosol generating device 500 in a state where the aerosol generating device 500 is in contact with an object. The breathing amount of the user may include the inhalation amount of the air inhaled by the user in a state where the aerosol generating device 500 is not in contact with an object. The exhalation time point may be determined based on the estimated breathing amount and the inhalation amount.

[0140] The step of determining the exhalation time based on the learned smoking pattern according to an embodiment includes a step of determining whether the aerosol generating device 500 satisfies a predetermined operating condition, and a step of predicting the exhalation time based on the determination that the aerosol generating device 500 satisfies the operating condition. The predetermined operating condition includes at least one of whether the user turns on / off the power of the aerosol generating device 500, and whether the puff sensor included in the electronic device and the pressure sensor included in the aerosol generating device 500 operate. Although the detection value of the pressure sensor may change depending on other objects (e.g., a finger, etc.) instead of the predetermined object, the pressure sensor can be activated only when the user turns on / off the power, and the pressure sensor can be activated by detecting the user's inhalation via the puff sensor or the pressure sensor, etc. However, the inhalation sensor of the present disclosure is not limited to the puff sensor or the pressure sensor.

[0141] In one embodiment, determining the volume and density of the virtual smoke based on the learned smoking pattern may include storing data comparing the pressure sensor activation time with the button activation time, and storing the volume and density of the virtual smoke determined based on the compared data in the learned smoking pattern.

[0142] According to an embodiment, the volume and density of the virtual smoke may vary depending on the smoking pattern of the user. For example, if the user's exhalation time is shorter than the user's puff time, the volume of the virtual smoke may be increased to produce thicker smoke. If the user's puff time sensed by the pressure sensor is 2 seconds, but the user presses and releases the button for 1.5 seconds, the volume and density of the virtual smoke may be determined to produce more smoke and thicker smoke. That is, since the user's puff time is the smoke inhalation time and the user's button actuation time is the exhalation time, if the user's exhalation time is shorter than the user's smoke inhalation time, the user exhales an equal amount of smoke in a short time, and therefore the electronic device 110 should produce a larger amount of smoke and thicker smoke in a short time.

[0143] According to an embodiment, the step of transmitting the detection information to the electronic device 310 via the dongle 330 includes a step of transmitting information regarding the type of virtual smoke and a step of transmitting information regarding a delay time occurring in communication between the aerosol generating device 500 and the electronic device 310. The type of virtual smoke may be changed according to a user's selection, or may be changed by an aerosol product or other flavoring unit built into the second end 530. The detection information may also include information regarding the user's smoking amount, breathing amount, etc., and the present disclosure is not limited thereto.

[0144] According to an embodiment, a pressure sensor may be included in the aerosol generating device 500. The pressure sensor may be located inside or outside the second end 530. The pressure sensor may measure the pressure generated by the user's lips to detect inhalation.

[0145] 3 and 5, when a user according to an embodiment starts smoking, the electronic device 310 receives camera data detecting the user's hand movement from a camera (not shown). The pressure sensor may obtain pressure sensor data when the user bites the second end 530 with the mouth to smoke. The electronic device 310 may predict the time of exhalation based on the camera data and pressure sensor data received via the dongle 330, i.e., the detection information.

[0146] In one embodiment, the step of starting smoking includes a step in which the user brings the aerosol generating device 500 to his / her lips and inhales. The user can turn on the aerosol generating device 500 to start heating the aerosol product in the aerosol generating device 500, and the turned-on aerosol generating device 500 can preheat a heater that heats the aerosol product.

[0147] The electronic device 310 according to an embodiment may be installed with an application capable of monitoring the user's hand movements, and thus may detect the user's smoking behavior data through a camera capable of monitoring the user's hand movements. The camera may monitor a situation in which the user brings the aerosol generating device 500 to the mouth to inhale smoke, inhales the smoke into the lungs by inhaling, and then separates the aerosol generating device 500 from the mouth to exhale the smoke. The data received from the camera and the application installed in the electronic device 310 may analyze the user's hand movements as described above to determine the amount of inhalation and the time of exhalation, etc.

[0148] According to an embodiment, the electronic device 310, the camera, and the aerosol generating device 500 operate as follows. The electronic device 310 in which the smoking device application is installed and the aerosol generating device 500 are connected using the dongle 330. When a user brings the aerosol generating device 500 to his / her mouth for smoking, the application of the electronic device 310 can analyze the user's hand movement using an image (e.g., camera data) captured by the camera. If it is determined through the camera image that the aerosol generating device 500 has reached the mouth and the pressure sensor operates (e.g., the measured pressure value is equal to or greater than a threshold), it can be determined that the user has started smoking. For example, the aerosol generating device 500 can transmit a pressure value measured by the pressure sensor to the electronic device 310 via the dongle 330. After the user starts smoking, the user's action of inhaling smoke into the lungs by inhaling, i.e., the action of separating the aerosol generating device 500 from the mouth, can be monitored using the camera image. By analyzing the interval between the start of smoking and the start of inhalation, the inhalation volume and the amount of inhalation can be estimated, and the time of exhalation can be determined based on the estimated inhalation volume and the amount of inhalation.

[0149] According to an embodiment, the step of determining the exhalation time based on the result of the monitoring, i.e., the detection information, includes determining the exhalation time based on an interval between a first time and a second time. The first time may be a time when the user starts to inhale smoke. The interval between the first time and the second time is a time when the user inhales smoke, and the first breathing time of the user may be predicted based on the smoke inhalation time. The second time may be a time when the user starts to inhale. The second breathing time may be predicted based on the interval between the first time and the second time and the first breathing time. The second breathing time may be a time when the user starts to exhale. For example, the second breathing time may be determined as a virtual smoke realization time.

[0150] According to an embodiment, since the smoke inhalation time of the user is the interval between the first time and the second time, the first breathing time, which is the time when the user inhales, can be estimated similarly to the smoke inhalation time. Thereafter, the electronic device 310 can determine the time of the second breathing, which is the time when the user starts exhaling, as the time when the first breathing time has elapsed from the second time. For example, if the time from the first time when the object arrives at the second end 1230 to the second time when the object is removed from the second end 530 is 1 second, the first breathing time can be estimated as 1 second, and the time when the user inhales can also be predicted as 1 second similarly to the first breathing time. As a result, the time of the second breathing, which is the time when the first breathing time has elapsed from the second time, can be predicted as the time when 1 second has elapsed since the object was separated from the aerosol generating device 500. As a result, the electronic device 310 can determine the time when 1 second has elapsed since the object was removed as the time of exhalation.

[0151] According to an embodiment, the step of determining the exhalation time point based on the monitoring result, i.e., the detection information, includes a step of estimating the inhalation amount and the respiration amount of the user based on the interval between the first time point and the second time point. The inhalation amount of the user may include the inhalation amount of the aerosol inhaled by the user through the aerosol generating device 500 in a state where the aerosol generating device 500 is in contact with an object. The respiration amount of the user may include the inhalation amount of the air inhaled by the user in a state where the aerosol generating device 500 is not in contact with an object. The exhalation time point may be predicted based on the estimated respiration amount and the inhalation amount.

[0152] The step of determining the exhalation time based on the above monitoring result, i.e., the detection information according to one embodiment, includes a step of determining whether the aerosol generating device 500 satisfies a predetermined operating condition, and a step of predicting a virtual smoke realization time based on the determination that the aerosol generating device 500 satisfies the operating condition. The predetermined operating condition includes at least one of whether the user turns on / off the power of the aerosol generating device 500, and whether the puff sensor included in the electronic device and the pressure sensor included in the aerosol generating device 500 operate. Although the detection value of the pressure sensor may change depending on the operation of other objects (e.g., not smoking but hand movement, etc.) rather than the operation of the predetermined object, the pressure sensor can be activated only when the user turns on / off the power, and the pressure sensor can be activated by detecting the inhalation of the user via the puff sensor or pressure sensor, etc. However, the inhalation sensor of the present disclosure is not limited to the puff sensor or pressure sensor.

[0153] According to an embodiment, the step of transmitting the camera data and the pressure sensor data to the electronic device 310 via the dongle 330 includes a step of transmitting information about the type of virtual smoke and a step of transmitting information about a delay time generated in communication between the aerosol generating device 500 and the electronic device 310. The type of virtual smoke may be changed according to a user's selection, or may be changed by an aerosol generating product or other flavoring unit built into the second end. The detection information may also include information about the user's smoking amount, breathing amount, etc., and the present disclosure is not limited thereto. If the virtual smoke realization time does not match the user's actual smoking behavior or an accurate prediction time cannot be grasped, additional work may be performed to perform a separate "breath prediction detection" processing process.

[0154] FIG. 6 is a flowchart of a virtual smoke image output method according to an embodiment.

[0155] According to one embodiment, operation 440 described above with reference to FIG. 4 may include the following operations 610 and 620.

[0156] At operation 610, the electronic device 310 can determine attributes of the virtual smoke based on the detection information received from the aerosol generating device 320 (or the aerosol generating device 120 of FIG. 1 or the aerosol generating device 500 of FIG. 5). For example, the attributes of the virtual smoke can include one or more of the size, shape, duration, volume, density, and color of the virtual smoke, which are not limited herein.

[0157] In one embodiment, the size, duration, volume, and concentration of the virtual smoke may be determined to be proportional to the distance information between the aerosol generating device 320 and an object (e.g., a body part of a user), the detection value information of the capacitance sensor of the aerosol generating device 320, the orientation change information of the aerosol generating device 320, the monitoring information of the camera of the aerosol generating device 320, the smoking pattern learned using the pressure sensor and the button of the aerosol generating device 320, and the smoke inhalation time predicted using one or more of the camera data and the pressure sensor data, or the inhalation time based on the smoke inhalation time. For example, if the inhalation time is long, the duration of the virtual smoke may be determined to be the same or proportionally longer.

[0158] In one embodiment, the shape of the virtual smoke may be determined by camera monitoring information. When the camera of the electronic device 310 receives information monitoring the movement of an object, for example, a user's lips, the camera monitoring information may include information about the shape of the lips. For example, when the user's lips are pursed, the shape of the virtual smoke may be determined to be thin and long.

[0159] In one embodiment, the volume, thickness and color of the virtual smoke may be determined by the user's smoking pattern, for example, if the user spends less time exhaling than inhaling smoke, the volume of the virtual smoke may be increased to produce a thicker smoke and the color of the virtual smoke may be determined to be darker.

[0160] In one embodiment, the electronic device 310 can directly receive user input regarding attributes of the virtual smoke. For example, the color of the virtual smoke can be various colors such as blue, purple, etc., depending on the user input, as well as a general neutral color. As another example, the shape of the virtual smoke can be a donut shape.

[0161] In one embodiment, the detection information regarding the state of the aerosol generating device 320 may include pressure sensor data, which may include airflow detection information due to the user's inhalation. If the internal flow air pressure where the pressure sensor of the aerosol generating device 320 is installed is high, the virtual smoke may be determined to be large and long lasting even if the inhalation time is short.

[0162] At operation 620, the electronic device 310 may generate a virtual smoke image based on the attributes of the virtual smoke. In one embodiment, the virtual smoke image may be generated by further adjusting the pre-defined basic attributes based on the attributes of the virtual smoke determined at operation 610.

[0163] FIG. 7 is a flowchart of a virtual smoke image output method according to an embodiment.

[0164] According to one embodiment, operations 450 described above with reference to FIG. 4 may include the following operations 710 and 720.

[0165] In operation 710, the electronic device 310 determines an exhalation time when the user of the aerosol generating device 320 starts exhaling based on the detection information regarding the state of the aerosol generating device 320. The detection information regarding the state of the aerosol generating device 320 may include one or more of distance information between the aerosol generating device 320 and an object (e.g., a body part of the user), detection value information of the capacitance sensor of the aerosol generating device 320, orientation change information of the aerosol generating device 320, monitoring information of the camera of the aerosol generating device 320, smoking patterns learned using the pressure sensor and button of the aerosol generating device 320, and camera data and pressure sensor data.

[0166] In operation 720, the electronic device 310 outputs the virtual smoke image at the time of exhalation. In one embodiment, the virtual smoke image is output via a display of the electronic device 310. In one embodiment, if another image is being previously output via the display of the electronic device 310 at the time the virtual smoke image is output, the virtual smoke image may be output superimposed on the previously output image. In one embodiment, the virtual smoke image may be output so as to be composited with scenes of the other image content.

[0167] The above-described embodiments may be implemented with hardware components, software components, and / or a combination of hardware and software components. For example, the devices, methods, and components described in the embodiments may be implemented using a general-purpose computer or a special-purpose computer, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and software applications executed on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, although it has been described that one processing device is used, a person skilled in the art will appreciate that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, the processing device may include multiple processors or one processor and one controller. Other processing configurations are also possible, such as parallel processors.

[0168] The software may include computer programs, codes, instructions, or a combination of one or more of these, and may configure or instruct the processing device to operate as desired, either individually or collectively. The software and / or data may be permanently or temporarily embodied in some type of machine, component, physical device, virtual device, computer storage medium or device, or transmitted signal wave, to be interpreted by the processing device or to provide instructions or data to the processing device. The software may also be distributed over network-coupled computer systems, and stored or executed in a distributed manner. The software and data may be stored in a computer-readable recording medium.

[0169] The method according to the embodiment may be realized in the form of program instructions executed by various computer means and recorded on a computer-readable medium. The computer-readable medium may store program instructions, data files, data structures, and the like, alone or in combination, and the program instructions recorded on the medium may be those specially designed or constructed for the embodiment or those known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include high-level language codes that can be executed by a computer using an interpreter, as well as machine language codes such as those produced by a compiler.

[0170] The hardware devices described above may be configured to operate as one or more software modules to perform the operations of an embodiment, and vice versa.

[0171] Although the embodiments have been described above with reference to limited drawings, those skilled in the art may apply various technical modifications and variations thereto. For example, the described techniques may be performed in a different order than described, and / or the components of the described systems, structures, devices, circuits, etc. may be combined or combined in a different manner than described, or may be replaced or substituted by other components or equivalents, and still achieve suitable results.

[0172] Therefore, other embodiments, other examples, and equivalents to the claims are within the scope of the following claims.

Claims

1. A method for outputting a virtual smoke image by an electronic device, comprising: Installing a communication driver and a virtual smoking program stored in a dongle from a dongle connected to the electronic device; an operation of establishing a wireless communication channel between the dongle and the aerosol generating device, the dongle and the aerosol generating device being one pair; executing the virtual smoking program when a smoking start signal is received from the aerosol generating device via the dongle; receiving detection information relating to a state of the aerosol generating device from the aerosol generating device via the dongle; generating a virtual smoke image based on the detection information; outputting the virtual smoke image via a display of the electronic device; Including, A method for outputting virtual smoke images.

2. The operation of generating a virtual smoke image based on the detection information includes: determining attributes of the virtual smoke based on the detection information, the attributes of the virtual smoke including at least one of a size, a shape, and a duration of the virtual smoke; and generating the virtual smoke image based on the attributes of the virtual smoke; Including, The virtual smoke image output method according to claim 1 .

3. The act of outputting the virtual smoke image via a display of the electronic device includes: determining an exhalation time when a user of the aerosol generating device starts exhaling based on the detection information; and outputting the virtual smoke image at the time of exhalation; Including, The virtual smoke image output method according to claim 1 .

4. The operation of determining an exhalation time when a user of the aerosol generating device starts exhaling based on the detection information includes: determining the exhalation time based on a first time when a distance between one side of the aerosol generating device and the body part of the user, sensed by the aerosol generating device, reaches within a first threshold, and a second time after the first time when the distance between the one side of the aerosol generating device and the body part of the user exceeds a second threshold; Including, The virtual smoke image output method according to claim 3.

5. The operation of determining an exhalation time when a user of the aerosol generating device starts exhaling based on the detection information includes: determining the exhalation time based on a change in capacitance of the aerosol generating device; Including, The virtual smoke image output method according to claim 3.

6. The act of determining the exhalation time based on a change in capacitance of the aerosol generating device includes: determining the exhalation time based on a first time at which a value of the capacitance of the aerosol generating device, as sensed by the aerosol generating device, falls within a first threshold value, and a second time after the first time at which the value of the capacitance of the aerosol generating device exceeds a second threshold value; Including, The virtual smoke image output method according to claim 5.

7. the data format of the detection information received by the dongle from the aerosol generation device is a wireless signal format; The data format of the detection information is converted from the wireless signal format to a USB (universal serial bus) signal format by the dongle. The virtual smoke image output method according to claim 1 .

8. The operation of installing the communication driver and the virtual smoking program stored on the dongle from the dongle coupled to the electronic device includes: automatically installing the communication driver and the virtual smoking program when the dongle is connected to a USB port of the electronic device. Including, The virtual smoke image output method according to claim 1 .

9. The wireless communication channel includes: A wireless communication channel based on BLE (Bluetooth low energy), LoRa, EnOcean, RF (radio frequency) communication, Zigbee (registered trademark), or infrared communication; The virtual smoke image output method according to any one of claims 1 to 8.

10. An electronic device for performing a method for outputting a virtual smoke image, comprising: A display and Memory, A processor; Including, The processor, installing a communication driver and a virtual smoking program stored in a dongle from a dongle connected to the electronic device; an operation of establishing a wireless communication channel between the dongle and the aerosol generating device, the dongle and the aerosol generating device being a pair; and executing the virtual smoking program when a smoking start signal is received from the aerosol generating device via the dongle; receiving detection information relating to a state of the aerosol generating device from the aerosol generating device via the dongle; generating a virtual smoke image based on the detection information; outputting the virtual smoke image via the display; To carry out electronic equipment.

11. A USB port connected to the dongle Further comprising:

11. The electronic device of claim 10.

Images