Authorization for aerosol-generating devices

Abstract

An aerosol-generating system comprising an aerosol-generating device configured to generate an aerosol from an aerosol-forming substrate in an unlocked state; an image acquisition sensor configured to capture at least one image of a user of the aerosol-generating device; and at least one processor configured to: estimate an age of the user based on the at least one image of the user; determining whether the estimated age of the user is higher than or equal to a threshold; and unlocking the aerosol-generating device when the estimated age is above a threshold.

Description

[0001] The present disclosure relates to an aerosol generating system. In particular, the present disclosure relates to a system for unlocking an aerosol generating device.

[0002] An aerosol generating device may include an electrically operated heat source configured to heat an aerosol-forming substrate to generate an aerosol, such as a nicotine-containing aerosol. However, such electronic devices should not be accessible to unauthorized users. Therefore, there is a need for a system that will only enable authorized users to access electronic devices.

[0003] A user may be authorized to use an aerosol generating device when the user's age is above the legal minimum age. Legal requirements may require verification of the user's age. The user's age may be verified by selling the aerosol generating device only to users who are old enough. For example, the identity of the user may be checked based on an ID card, and the age may be verified based on the ID card. However, such age verification mechanisms are susceptible to fraud attempts, particularly when the ID card is uploaded via an online platform rather than physically checked in the presence of the present owner of the ID card. In addition, such systems for verifying the age of the user may be inefficient or prone to errors. In addition, some commercially available aerosol generating devices may be used in the event of theft by an unauthorized person (in which case the age of the unauthorized person cannot be verified). Therefore, there is a need for an effective and reliable method for verifying a user's authorization to use an aerosol generating device.

[0004] According to one aspect of the present invention, an aerosol generating system is provided, which includes an aerosol generating device, which is configured to generate an aerosol from an aerosol-forming substrate in an unlocked state; an image acquisition sensor, which is configured to capture at least one image of a user of the aerosol generating device; and at least one processor, which is configured to: estimate the age of the user based on the at least one image of the user, determine whether the estimated age of the user is higher than or equal to a threshold, and unlock the aerosol generating device when the estimated age is higher than or equal to the threshold.

[0005] An improved aerosol generating system is provided for unlocking an aerosol generating device by estimating the age of a user based on at least one image of the user, which is used to grant access to an aerosol generating device in a reliable and efficient manner. Specifically, an aerosol generating system that includes an image acquisition sensor and estimates the age of a user based on an image allows access to the aerosol generating device to be limited to authorized users. The aerosol generating device can be in one of at least two states, such as a locked state and an unlocked state. The aerosol generating device can be changed from a locked state to an unlocked state. Alternatively or in addition, the aerosol generating device can be changed from an unlocked state to a locked state. A "locked state" can be a state in which the aerosol generating device is prevented from generating an aerosol from an aerosol-forming substrate or is configured not to generate an aerosol from an aerosol-forming substrate. An "unlocked state" can be a state in which the aerosol generating device is configured to generate an aerosol from an aerosol-forming substrate.

[0006] The step of determining whether the estimated age of the user is above or equal to a threshold may comprise at least one of: outputting an estimated age range for the user; outputting an estimated minimum age and optionally an estimated maximum age for the user; determining that the estimated age of the user is above or equal to the threshold if the estimated minimum age is above or equal to the threshold; and determining an accuracy score indicating the accuracy of the estimate of the age of the user. The aerosol generating device may be unlocked only if the accuracy score is above or equal to the accuracy threshold.

[0007] Furthermore, the aerosol generating system may comprise a microphone configured to record a voice of the user, and the at least one processor may be configured to estimate the age of the user based on the at least one image of the user and the recorded voice of the user.

[0008] An improved system for granting access only to authorized users using multiple authorization levels is provided by estimating the age of a user based on at least one image of the user and the recorded voice of the user. The at least one image of the user may be at least one image of the user's face. The at least one image of the user may be a self-portrait, such as a selfie. The at least one image of the user may be captured according to instructions presented to the user, such as at least one of the distance of the user to the image acquisition sensor, the position of the user or the user's head in at least one image, and / or the orientation of the user or the user's head. The image area of ​​at least one image defining the face of the user may be at least 10%, 20%, 30%, 40%, 50%, 60%, 70% of the total area of ​​the image. At least one image may be captured within 1 hour, 2 hours, 6 hours, 12 hours, 24 hours of determining whether the estimated age of the user is above or equal to a threshold.

[0009] The aerosol generating system may include a mobile computing device of a user, the mobile computing device including an image acquisition sensor. The mobile computing device of the user may be remote from the aerosol generating device. The at least one processor may be configured to convert at least one image of the user into at least one corresponding anonymized pixel map at the mobile computing device, and send the anonymized pixel map from the mobile computing device to a server, and estimate the age of the user at the server based on the anonymized pixel map. The step of converting at least one image of the user into at least one corresponding anonymized pixel map may include at least one of the following: blurring one or more portions of the at least one image (e.g., the image of the at least one image and / or the portion of the image including a face); pixelation (e.g., reducing the resolution) of one or more portions of the at least one image (e.g., those portions of the image including a face); masking (e.g., replacing with a solid color) one or more portions of the at least one image (e.g., those portions of the image including a face). The at least one image of the user may be converted into at least one corresponding pixel map such that the identity of the user cannot be determined from the pixel map. The at least one image of the user may be converted into at least one corresponding anonymized pixel map by using at least one neural network, such as a generative adversarial network. At least one neural network may be used to retrieve information about the age of the user from the anonymized pixel map. The anonymized pixel map may be a feature map of at least one neural network. The feature map may be obtained from a layer of at least one neural network, such as a deep convolutional neural network. The layer may be in the middle of at least one neural network and / or not a layer at the edge of at least one neural network (e.g., the first layer or the last layer).

[0010] At least one of the at least one image of the user and the anonymized pixel map may be deleted after determining the estimated age of the user and / or unlocking the aerosol generating device. Only the anonymized pixel map may be sent to the server. The at least one image of the user may not be sent to the server. The at least one image of the user may be deleted after generating the anonymized pixel map or converting the at least one image of the user into at least one corresponding anonymized pixel map.

[0011] By sending the anonymized pixel map from the mobile computing device to the server and / or by deleting at least one of the at least one image of the user and the anonymized pixel map, personal data may be protected.

[0012] The at least one image of the user may be verified to be authentic by at least one of: determining whether the at least one image of the user has been tampered with by analyzing the at least one image of the user using a neural network for identifying representations of an attack, determining that a detected sound of the user corresponds to the at least one image of the user, and determining muscle movements of the user in at least two of the at least one image of the user.

[0013] According to another aspect of the present invention, a computer-implemented method for unlocking an aerosol generating device is provided, comprising obtaining at least one image of a user of the aerosol generating device, estimating the age of the user based on the at least one image of the user, determining whether the estimated age of the user is above a threshold, and when it is determined that the estimated age is above the threshold, unlocking the aerosol generating device for generating an aerosol from an aerosol-forming substrate.

[0014] An improved method of providing authentication of a user's age via an image capturing sensor is provided by unlocking an aerosol generating device for generating an aerosol from an aerosol-forming substrate when it is determined that the estimated age is above a threshold.

[0015] As used herein, the term "aerosol generating device" refers to a device that interacts with an aerosol-forming substrate to generate an aerosol. The aerosol generating device may interact with one or both of an aerosol generating article comprising an aerosol-forming substrate or a cartridge comprising an aerosol-forming substrate. In some examples, the aerosol generating device may heat the aerosol-forming substrate to promote release of volatile compounds from the substrate. An electrically operated aerosol generating device may include an atomizer, such as an electric heater, to heat the aerosol-forming substrate to form an aerosol.

[0016] As used herein, the term "aerosol-forming substrate disposed in and / or engaged with an aerosol generating device" refers to the combination of an aerosol generating device and an aerosol-forming substrate. When the aerosol-forming substrate forms part of an aerosol generating article, the aerosol-forming substrate disposed in and / or engaged with an aerosol generating device refers to the combination of an aerosol generating device and an aerosol generating article. The aerosol-forming substrate and the aerosol generating device may cooperate to generate an aerosol.

[0017] As used herein, the term "aerosol-forming substrate" refers to a substrate capable of releasing volatile compounds that can form an aerosol. The volatile compounds can be released by heating the aerosol-forming substrate. As an alternative to heating, in some cases, the volatile compounds can be released by chemical reaction or by mechanical stimulation (such as ultrasound). The aerosol-forming substrate can be solid, or can include solid and liquid components. The aerosol-forming substrate can be part of an aerosol-generating article.

[0018] As used herein, the term "aerosol-generating article" refers to an article comprising an aerosol-forming substrate capable of releasing volatile compounds that can form an aerosol. The aerosol may contain nicotine. The aerosol-generating article may be disposable. An aerosol-generating article comprising an aerosol-forming substrate (including tobacco) may be referred to herein as a tobacco rod.

[0019] Aerosol forming substrate can comprise nicotine.Aerosol forming substrate can comprise tobacco, for example, tobacco-containing material containing volatile tobacco flavor compounds, which volatile tobacco flavor compounds are released from aerosol forming substrate when heated.In a preferred embodiment, aerosol forming substrate can comprise homogenized tobacco material, for example cast leaf tobacco.Aerosol forming substrate can comprise both solid component and liquid component.Aerosol forming substrate can comprise tobacco-containing material containing volatile tobacco flavor compounds, which volatile tobacco flavor compounds are released from substrate when heated.Aerosol forming substrate can comprise non-tobacco material.Aerosol forming substrate can also comprise aerosol forming agent.The example of suitable aerosol forming agent is glycerol and propylene glycol.

[0020] The invention is defined in the claims. However, a non-exhaustive list of non-limiting examples is provided below. Any one or more features of these examples may be combined with any one or more features of another example, embodiment or aspect described herein.

[0021] Example Ex1: An aerosol generating system, comprising an aerosol generating device, which is configured to generate an aerosol from an aerosol-forming substrate in an unlocked state; an image acquisition sensor, which is configured to capture at least one image of a user of the aerosol generating device; and at least one processor, which is configured to: estimate the age of the user based on the at least one image of the user, determine whether the estimated age of the user is higher than or equal to a threshold, and unlock the aerosol generating device when the estimated age is higher than the threshold.

[0022] Example Ex2: An aerosol generating system according to Example Ex1, comprising a microphone configured to record the user's voice, wherein the at least one processor is configured to estimate the user's age based on at least one image of the user and the user's recorded voice.

[0023] Example Ex3: An aerosol generating system according to one of Examples Ex1 and Ex2, comprising a mobile computing device of the user, wherein the mobile computing device comprises the image acquisition sensor.

[0024] Example Ex4: An aerosol generating system according to Example Ex3, wherein the at least one processor is configured to convert at least one image of the user into at least one corresponding anonymized pixel map at the mobile computing device, and send the anonymized pixel map from the mobile computing device to a server, wherein the age of the user is estimated at the server based on the anonymized pixel map.

[0025] Example Ex5: An aerosol generating system according to Example Ex4, wherein the at least one processor is configured to delete at least one of the at least one image of the user and the anonymized pixel map after determining the estimated age of the user and / or unlocking the aerosol generating device.

[0026] Example Ex6: An aerosol generating system according to one of Examples Ex1 to Ex5, wherein the age of the user is estimated by using a machine learning model, such as a neural network, preferably a deep neural network.

[0027] Example Ex7: An aerosol generating system according to one of Examples Ex1 to Ex6, wherein the at least one processor is configured to verify that the at least one image of the user is authentic by at least one of the following: determining whether the at least one image of the user has been tampered with by analyzing the at least one image of the user using a neural network for identifying representations of an attack, determining that a detected sound of the user corresponds to the at least one image of the user, and determining muscle movements of the user in at least two of the at least one image of the user.

[0028] Example Ex8: An aerosol generating system according to one of Examples Ex1 to Ex7, wherein the threshold value is predefined, preferably predefined by the manufacturer of the aerosol generating device.

[0029] Example Ex9: An aerosol generating system according to one of Examples Ex1 to Ex8, wherein the threshold is at least N years higher than a first age, the first age being set for authorizing the use of the aerosol generating device, preferably wherein N=1 or greater, 2 or greater, 3 or greater, 4 or greater or 5 or greater, or

[0030] wherein the threshold is a first age threshold, and the first age threshold is one of:

[0031] 18 years or older,

[0032] 19 years or older,

[0033] 20 years or older,

[0034] 25 years or older, and

[0035] 30 years or older.

[0036] Example Ex10: An aerosol generating system according to one of Examples Ex1 to Ex9, wherein the at least one processor is configured to determine a user profile of the user based on at least one image of the user, and optionally wherein the aerosol generating device is configured according to the user profile.

[0037] Example Ex11: An aerosol generating system according to one of Examples Ex1 to Ex10, wherein the at least one processor is configured to verify the identity of the user based on at least one image of the user.

[0038] Example Ex12: The aerosol generating system according to one of Examples Ex1 to Ex11, further comprising an aerosol generating article, the aerosol generating article comprising an aerosol generating substrate.

[0039] Example Ex13: An aerosol-generating system according to Example Ex12, wherein the aerosol-generating substrate comprises nicotine.

[0040] Example Ex14: An aerosol generating system according to one of Examples Ex12 and Ex13, wherein the aerosol generating device is configured to fully or partially receive the aerosol generating substrate and / or wherein a surface of the aerosol generating device is configured to attach to the aerosol generating substrate.

[0041] Example Ex15: An aerosol generating system according to one of Examples Ex1 to Ex14, wherein the aerosol generating device is configured to be in one of a locked state and an unlocked state.

[0042] Example Ex16: An aerosol generating system according to example Ex15, wherein the locked state is a state in which the aerosol generating device is prevented from generating an aerosol from an aerosol-forming substrate.

[0043] Example Ex17: An aerosol generating system according to example Ex15 or example Ex16, wherein unlocking the aerosol generating device when the estimated age is above a threshold comprises instructing the aerosol generating device to transition from a locked state to an unlocked state.

[0044] Example Ex18: An aerosol generating system according to one of Examples Ex1 to Ex17, wherein determining whether the estimated age of the user is above or equal to a threshold comprises outputting an estimated age range of the user.

[0045] Example Ex19: An aerosol generating system according to one of Examples Ex1 to Ex18, wherein determining whether the estimated age of the user is above or equal to a threshold comprises outputting an estimated minimum age.

[0046] Example Ex20: An aerosol generating system according to one of Examples Ex1 to Ex19, wherein determining whether the estimated age of the user is above or equal to a threshold comprises outputting an estimated maximum age of the user.

[0047] Example Ex21: An aerosol generating system according to Example Ex19, wherein determining whether the estimated age of the user is higher than or equal to a threshold comprises determining that the estimated age of the user is higher than or equal to the threshold if an estimated minimum age is higher than or equal to the threshold.

[0048] Example Ex22: An aerosol generating system according to one of Examples Ex1 to Ex21, wherein determining whether the estimated age of the user is above or equal to a threshold comprises determining an accuracy score indicating the accuracy of the estimate of the age of the user.

[0049] Example Ex23: An aerosol generating system according to Example Ex22, wherein the aerosol generating device remains locked when the accuracy score is below an accuracy threshold.

[0050] Example Ex24: An aerosol generating system according to example Ex22, wherein the aerosol generating device is unlocked only if the accuracy score is higher than or equal to an accuracy threshold.

[0051] Example Ex25: An aerosol generating system according to one of Examples Ex1 to Ex24, wherein the at least one image of the user comprises at least one image of the user's face.

[0052] Example Ex26: An aerosol generating system according to one of Examples Ex1 to Ex24, wherein the at least one image of the user comprises a selfie.

[0053] Example Ex27: An aerosol generating system according to one of Examples Ex1 to Ex26, wherein at least one image of the user is captured according to instructions presented to the user.

[0054] Example Ex28: An aerosol generating system according to Example Ex27, wherein the instructions presented to the user include the distance of the user from the image acquisition sensor.

[0055] Example Ex29: An aerosol generating system according to one of Examples Ex27 and Ex28, wherein the instructions presented to the user include the position of the user or the user's head in the at least one image.

[0056] Example Ex30: An aerosol generating system according to one of Examples Ex27 to Ex29, wherein the instructions presented to the user include an orientation of the user or the user's head.

[0057] Example Ex31: An aerosol generating system according to one of Examples Ex1 to Ex30, wherein the image area of ​​at least one image defining the user's face is at least 10%, 20%, 30%, 40%, 50%, 60%, 70% of the total area of ​​the image.

[0058] Example Ex32: An aerosol generating system according to one of Examples Ex1 to Ex31, wherein the at least one image is captured within a time period of 1 hour, 2 hours, 6 hours, 12 hours or 24 hours before determining whether the estimated age of the user is higher than or equal to a threshold.

[0059] Example Ex33: An aerosol generating system according to example Ex3 or any preceding example including example Ex3, wherein the user's mobile computing device is remote from the aerosol generating device.

[0060] Example Ex34: An aerosol generating system according to Example Ex4 or any previous example including Example Ex4, wherein the step of converting at least one image of the user into at least one corresponding anonymized pixel map includes blurring one or more portions of the at least one image.

[0061] Example Ex35: An aerosol generating system according to Example Ex4 or any previous example including Example Ex4, wherein the step of converting at least one image of the user into at least one corresponding anonymized pixel map includes reducing the resolution of one or more portions of the at least one image.

[0062] Example Ex36: An aerosol generating system according to Example Ex4 or any previous example including Example Ex4, wherein the step of converting at least one image of the user into at least one corresponding anonymized pixel map includes masking one or more portions of the at least one image.

[0063] Example Ex37: An aerosol generating system according to one of Examples Ex34 to Ex36, wherein the one or more portions of the at least one image include a face or an image of a face of the user.

[0064] Example Ex38: An aerosol generating system according to example Ex4 or any preceding example including example Ex4, wherein the identity of the user is not determinable from at least one pixel map.

[0065] Example Ex39: An aerosol generating system according to example Ex4 or any previous example including example Ex4, wherein at least one image of the user is converted into at least one corresponding anonymized pixel map by using at least one neural network.

[0066] Example Ex40: An aerosol generating system according to Example Ex39, wherein the at least one neural network is used to retrieve information about the user's age from the anonymized pixel map.

[0067] Example Ex41: An aerosol generating system according to example Ex4 or any previous example including example Ex4, wherein the anonymized pixel map comprises a feature map of at least one neural network.

[0068] Example Ex42: An aerosol generating system according to Example Ex41, wherein the feature map is obtained from a layer of the at least one neural network.

[0069] Example Ex43: An aerosol generating system according to Example Ex42, wherein the layer is not a layer at an edge of the at least one neural network.

[0070] Example Ex44: An aerosol generating system according to one of Examples Ex41 to Ex43, wherein obtaining the feature map comprises a convolution operation of the at least one neural network.

[0071] Example Ex45: An aerosol generating system according to example Ex4 or any preceding example including example Ex4, wherein only the anonymized pixel map is sent to the server.

[0072] Example Ex46: An aerosol generating system according to example Ex4 or any preceding example including example Ex4, wherein at least one image of the user is deleted after converting the at least one image of the user into the at least one corresponding anonymized pixel map.

[0073] Example Ex47: A computer-implemented method for unlocking an aerosol generating device, the method comprising: obtaining at least one image of a user of the aerosol generating device; estimating the age of the user based on the at least one image of the user; determining whether the estimated age of the user is higher than a threshold; and when it is determined that the estimated age is higher than the threshold, unlocking the aerosol generating device for generating an aerosol from an aerosol-forming substrate.

[0074] Example Ex48: The computer-implemented method according to Example Ex47 further includes obtaining voice data of the user, wherein the age of the user is estimated based on at least one image of the user and the obtained voice data of the user.

[0075] Example Ex49: The computer-implemented method according to one of Examples Ex47 and Ex48 further includes: converting at least one image of the user into at least one corresponding anonymized pixel map, and sending the anonymized pixel map to a server for estimating the age of the user, wherein the age of the user is estimated at the server based on the anonymized pixel map.

[0076] Example Ex50: A computer-implemented method according to one of Examples Ex47 to Ex49, further comprising: verifying that at least one image of the user depicts a living person by at least one of the following: determining whether at least one image of the user has been tampered with by analyzing at least one image of the user using a neural network for identifying representations of an attack, determining that a detected sound of the user corresponds to at least one image of the user, and determining muscle movements of the user in at least two of the at least one image of the user.

[0077] Several examples will now be further described with reference to the accompanying drawings, in which:

[0078] Figure 1A shows a schematic diagram of an aerosol generating system according to an aspect;

[0079] Figure 1B shows a schematic diagram of an aerosol generating system according to an aspect;

[0080] Figure 1C shows a schematic diagram of an aerosol generating system according to an aspect; and

[0081] Figure 2 is a flow chart illustrating a method of unlocking an aerosol generating device.

[0082] Figure 1A An aerosol generating system 100 is shown. The aerosol generating system includes an aerosol generating device 120 configured to generate an aerosol from an aerosol-forming substrate. The aerosol generating device 120 may be a heat-not-burn (HNB) device. The aerosol generating system 100 may be used to unlock the aerosol generating device 120 for use by a user 110. The aerosol-forming substrate may be disposed in the aerosol generating device 100 and / or engaged with the aerosol generating device. Alternatively, the aerosol-forming substrate (e.g., liquid in a cartridge) may be attached to the aerosol generating device 120. The aerosol generating system includes an image acquisition sensor 130 configured to capture at least one image of the user 110.

[0083] The image acquisition sensor may be included in the aerosol generating device 120. Alternatively, the image acquisition sensor may be remote from the aerosol generating device 120. For example, the image acquisition sensor may be part of a computing device 130, such as a mobile computing device, such as a smartphone. The computing device 130 and the aerosol generating device 120 may be connected via a first network. The first network may be a wireless network, such as a Bluetooth network.

[0084] The aerosol generating system 100 may include a server 140. The server 140 may be connected to at least one of the aerosol generating device 120 and the computing device 130 via a second network. The second network may be a wireless network, such as a WiFi network.

[0085] The image acquisition sensor may be configured to capture an image or multiple images of the user 110. The image acquisition sensor may be configured to capture depth information or multiple depth values ​​of the user from a single viewpoint or multiple viewpoints. Examples of image acquisition sensors may include LIDAR (Light Detection and Ranging) sensors, wide-angle cameras, action cameras, closed-circuit television (CCTV) cameras, camcorders, digital cameras, camera phones, time-of-flight (ToF) cameras, night vision cameras, image sensors, and / or other image capture devices.

[0086] The at least one captured image may be transmitted to the server 140. Alternatively, the at least one captured image may be converted into at least one corresponding anonymized pixel map, and the at least one anonymized pixel map may be sent to the server 140. The at least one captured image may be converted into at least one corresponding anonymized pixel map at the aerosol generating device 120 or the computing device 130, and the at least one anonymized pixel map may be sent to the server 140 from the aerosol generating device 120 or the computing device 130.

[0087] The user's age may be estimated based on at least one captured image or anonymized pixel map at the server 140. The user's age may be estimated with the aid of a machine learning model, such as a neural network. The neural network may be a deep neural network.

[0088] Whether the estimated age of the user is higher than or equal to a threshold value may be determined by at least one of the aerosol generating device 120, the computing device 130, and the server 140. When the estimated age is higher than the threshold value, the aerosol generating device transitions from the locked state to the unlocked state. The "locked state" may be a state in which the aerosol generating device is prohibited from generating aerosol.

[0089] In an example, determining whether the age is above a threshold is performed at the server 140 or the computing device 130, and the computing device 130 sends a signal to unlock the aerosol generating device 120. The aerosol generating device 120 may be in a first state, such as a locked state in which the aerosol generating device 120 is prohibited or prevented from generating an aerosol. The signal from the computing device 130 may indicate that the aerosol generating device switches or transitions from the locked state to the unlocked state. For example, the aerosol generating device 120 may be sold or purchased in the locked state, in which the aerosol generating device 120 cannot generate an aerosol. Only after transitioning to the unlocked state can the aerosol generating device 120 generate an aerosol from the aerosol-forming substrate.

[0090] The threshold value may be predefined or selected by the manufacturer of the aerosol generating device. The threshold value may be at least N years higher than the first age (or first age threshold value). The threshold value may be set for authorizing the use of the aerosol generating device, where N=1 or greater, 2 or greater, 3 or greater, 4 or greater or 5 or greater. The first age threshold value may be one of the following: 18 years or greater, 19 years or greater, 20 years or greater, 21 years or greater, 25 years or greater, and 30 years or greater.

[0091] At least one of the aerosol generating device 120 and the computing device 130 may include a microphone configured to record the voice or sound of the user 110. The server 140 may be configured to estimate the age of the user based on at least one image of the user and the recorded voice or sound of the user 110.

[0092] At least one of the aerosol generating device 120, the computing device 130, and the server 140 may be configured to verify that at least one image of the user is authentic or depicts a living person. For example, at least one of the aerosol generating device 120, the computing device 130, and the server 140 may perform at least one of the following to verify that at least one image of the user is authentic: (i) determining whether at least one image of the user has been tampered with by analyzing at least one image of the user using a neural network for identifying representations of an attack, (ii) determining that a detected sound of the user corresponds to at least one image of the user, and (iii) determining muscle movements of the user in at least two of the at least one image of the user.

[0093] To protect personal information of user 110 , at least one of the at least one image of the user and the anonymized pixel map may be deleted after determining the estimated age of the user at server 140 and / or at computing device 130 and / or unlocking the aerosol generating device.

[0094] According to one aspect, a user profile of the user is determined based on at least one image of the user 110. The aerosol generating device 120 may be configured according to the user profile. In an example, the user profile may include information about an increased substance content (e.g., nicotine content) of a consumable (e.g., an aerosol-forming substrate) disposed in and / or engaged with the aerosol generating device compared to a different substance content (e.g., flavor content). Additionally or alternatively, the identity of the user 110 may be verified based on at least one image of the user.

[0095] The aerosol generating system 100 may be configured to unlock the aerosol generating device 120. Unlocking the aerosol generating device 120 may comprise, in response to a user action, setting the aerosol generating device 120 to a state in which the aerosol generating device 120 is configured to generate an aerosol from an aerosol-forming substrate.

[0096] exist Figure 1B In the embodiment, the aerosol generating system only includes an aerosol generating device 120 and a computing device 130. The computing device 130 may be configured to execute the Figure 1A In addition, computing device 130 may be configured to execute Figure 1A All actions performed by the server in .

[0097] For example, a user may connect mobile computing device 130 with aerosol generating device 120 via a network, such as a wireless network. After connecting devices 120 and 130, user 110 may take a photo with computing device 130 of user 110. Computing device 130 may be configured to estimate the age of user 110 based on the photo of user 110. Computing device 130 may be configured to determine whether the estimated age of user 110 is above or equal to a threshold. When the estimated age is above the threshold, the computing device may instruct aerosol generating device 120 to unlock itself.

[0098] In an example, an aerosol generating system includes a smart device (e.g., a smartphone) and an aerosol generating device. The aerosol generating device may be locked when it is sold. To unlock it, the user uses the smartphone. The smartphone may be configured to scan the user's face. Once the smartphone estimates the age based on the scan of the face, the aerosol generating device may be automatically unlocked when the estimated age is above a certain threshold.

[0099] In an example, a user of an aerosol generating device, such as a consumer, takes a "selfie" image using a mobile phone or desktop camera and submits the image along with consent that the image can be used to verify the user's age. A pixel map of the user image including the user's face can be generated. The pixel map can include information about the user image in an anonymized manner. Using an artificial intelligence (AI) model, an age estimate for the user image can be provided. After processing of the user image is completed, any image data associated with the user image can be deleted immediately. The solution immediately "forgets" any faces submitted. The estimated age can be returned to the mobile phone or computing device and compared to a threshold that can be determined and / or configured by the manufacturer of the aerosol generating device. The system may not receive, process, or store any biometric data of the user, nor any personal data or identity attributes (e.g., first and last name, address, date of birth) of the user.

[0100] In order to minimize the risk of allowing users below the legal age to access restricted content, such as using an aerosol generating device, the threshold may be configured or set to one year or more above the legal age. Only users with an estimated age equal to or above the threshold may gain access to the restricted content. The threshold may be set to 1 year or more, 2 years or more, 3 years or more, 4 years or more, 5 years or more above the legal age for accessing restricted content, thereby reducing the risk of false positives and improving the overall effectiveness of the solution.

[0101] exist Figure 1C In the embodiment, the aerosol generating system only includes an aerosol generating device 120 and a server 140. The aerosol generating device 120 may be configured to perform the same Figure 1A In one aspect, the aerosol generating device 120 may be configured to perform the same actions or at least some of the actions of the computing device 130. Figure 1A All actions performed by the computing device 130 and the server 140 in.

[0102] For example, the aerosol generating device 120 may include an image acquisition sensor configured to capture at least one image of a user 110 of the aerosol generating device 120. The at least one image of the user 110 or at least one anonymized pixel map based on the at least one image of the user 110 may be transmitted to the server 140. The server 140 may be configured to estimate the age of the user based on the at least one image of the user 110 or the anonymized pixel map, determine whether the estimated age of the user is above or equal to a threshold, and instruct the aerosol generating device 120 to unlock the aerosol generating device 120 when the estimated age is above the threshold.

[0103] In an example, at least one of the aerosol generating device 120, the computing device 130, and the server 140 may include a built-in neural network-based processor configured to communicate with a device including an image acquisition sensor for basic interactions associated with the image acquisition sensor. The neural network may include electronic data, such as a software program, a code of a software program, a library, an application, a script, or other logic or instructions for execution by a processing device, such as at least one of the aerosol generating device 120, the computing device 130, and the server 140. The neural network may include code and routines configured to enable a computing device such as at least one of the aerosol generating device 120, the computing device 130, and the server 140 to perform one or more operations for classifying one or more inputs. In addition, the neural network may also be implemented using hardware, including a processor, a microprocessor (e.g., to perform one or more operations or control their execution), a field programmable gate array (FPGA), or an application specific integrated circuit (ASIC). Alternatively, in some aspects, a combination of hardware and software may be used to implement the neural network.

[0104] In another example, the aerosol generating device 120 is configured to interact with a smartphone for advanced interactions associated with an image acquisition sensor. For example, the image acquisition sensor may be included in a smartphone or other handheld computing device, and the smartphone may be configured to process images obtained from the image acquisition sensor. The smartphone may be configured to determine at least one of the age and identity of the user 110 based on at least one image of the user. At least one of the age and identity of the user 110 may be transmitted to the aerosol generating device 120 for further processing. Alternatively, the smartphone may be configured to receive additional information, such as information about the user's voice or speech, for further processing. The results of such further processing may be transmitted to the aerosol generating device 120 for unlocking the aerosol generating device 120. In one aspect, the smartphone obtains at least one image of the user and transmits at least one image of the user to the aerosol generating device 130 for further processing.

[0105] An acoustic sensor such as a microphone may be configured to capture an audio signal of the user. The acoustic sensor may also be configured to convert the captured audio signal into an electrical signal to determine the age of the user. For example, the age of the user may be determined by analyzing an audio signal including information about the user's voice.

[0106] The captured audio signal may include a plurality of speech parameters, such as loudness parameters, intonation parameters, harmonic intensity, speech modulation parameters, pitch parameters, tone parameters, speech rate parameters, speech quality parameters, voice parameters, pronunciation parameters, prosody parameters, timbre parameters, and one or more psychoacoustic parameters, which may be converted into electrical signals to determine the age of the user. Examples of acoustic sensors may include recorders, electric microphones, dynamic microphones, carbon microphones, piezoelectric microphones, fiber optic microphones, (micro-electromechanical systems) MEMS microphones, or other microphones known in the art.

[0107] In operation, the aerosol generating device may compare information associated with one or more captured images (e.g., estimated age) with information set by the manufacturer of the aerosol generating device 120 (e.g., the legal age or first age for using the aerosol generating device 120). The information set by the manufacturer may be stored integrally in the aerosol generating device 120, or remotely retrieved from a server 140 (e.g., a cloud server) or a smartphone via a suitable communication network (e.g., via a wireless fidelity (Wi-Fi) network).

[0108] In an example, the image acquisition sensor may capture one or more images of the first user 110. The aerosol generating system 100 may estimate the age of the first user based on the captured images. Based on the estimated age, if the first user 110 (e.g., a child) is not an authorized user, the aerosol generating device 120 may be maintained in a locked state, locked, and / or turned off to prevent use by unauthorized users. The aerosol generating system 100 may also generate an alarm. For example, the alarm may be provided to a second user or a device or service associated with the aerosol generating device 120, such as a service of a manufacturer of the aerosol generating device 120. The alarm may include information about an unauthorized user of the aerosol generating device. The alarm may include information associated with an unauthorized user attempting to use the aerosol generating device. The alarm may include at least one of an audible alarm, a visual alarm, an audiovisual alarm, or a vibration alarm.

[0109] In response to determining that the user is not authenticated or authorized to use the aerosol generating device 120, the user 110 may be prompted to verify the age of the user 110 with the aid of an ID card. The image acquisition sensor may be configured to capture at least one image of the ID card. The identity of the user corresponding to the identity of the ID card may be verified based on the image of the user or an anonymized pixel map of the image of the user and the image of the ID card or an anonymized pixel map of the image of the ID card.

[0110] In another example, based on the determined features, if the captured image indicates that the authorized user is tired, drunk, stressed, or emotionally unstable, such that the user is in a sad, crying, or scared state, the aerosol generating device can automatically shut down the aerosol generating device 100 based on the user's condition. Therefore, the user's age can also be verified by the second method using the user's 110 ID card.

[0111] If the second user is an authorized user, such as an adult owner of the device, the aerosol generating device may be unlocked after verifying that the user is old enough to use the aerosol generating device. In an example, if the second user does not reach the required age to use the aerosol generating device 120 estimated from the microphone measurements, for example, if the age of the user estimated from the user's voice is lower than the age of the user estimated from the captured images, the aerosol generating device may remain in a locked state and / or shut down to prevent use by the second user, who may then be considered an unauthorized user.

[0112] This sequence of operations of the image acquisition sensor and the acoustic sensor is provided merely as an example. The sequence of operations may be modified, reversed, or removed to achieve the same goal. For example, the acoustic sensor may detect the user's voice before the image acquisition sensor captures the user's image, or the acoustic sensor may detect the user's voice while the user is detecting an image from the image acquisition sensor.

[0113] Figure 2 is a flow chart illustrating a method 200 of unlocking an aerosol generating device. Each of the aerosol generating device 120, the computing device 130 and the server 140 may include at least one processor such that the aerosol generating system 100 includes at least one processor to perform at least one step of the method 200.

[0114] For example, the method 200 may be performed by an electronic device or an electronic system. Figures 1A to 1C The aerosol generating system 100 described herein may perform the method 200. In an example, the method 200 is performed by the system, wherein Figures 1A to 1C Any features of the described aerosol generating system may be part of the system on which method 200 is performed.

[0115] The method 200 includes, in step 210, obtaining, by at least one of an aerosol generating device, a computing device, and a server, at least one captured image of a user. For example, the at least one captured image of a user may be obtained from a computing device, such as a mobile computing device, that includes an image acquisition sensor. The image acquisition sensor may be used to capture at least one image of a user. A user may request to use the aerosol generating device. For example, a user may provide input to the aerosol generating device or the computing device that instructs the image acquisition sensor to capture at least one image of the user. The image acquisition sensor may be part of the aerosol generating device or remote from the aerosol generating device.

[0116] In step 220, voice data of the user is obtained by at least one of the aerosol generating device, the computing device, and the server. The voice data may be obtained by measuring or capturing the sound of the user, such as the user's voice. For example, the computing device may measure the sound generated by the user's voice to obtain the voice data. The computing device may then transmit the voice data to the server for further processing. The voice data may be anonymized voice data.

[0117] In step 230, at least one image of the user is converted into at least one corresponding anonymized pixel map. This may be performed by a computing device that captured the at least one image of the user. A neural network may be used to anonymize the at least one image of the user.

[0118] In step 240, the anonymized pixel map is sent to a server for estimating the user's age. The server may process the anonymized pixel map.

[0119] In step 242, verifying that at least one image of the user is authentic, for example, that the at least one image of the user depicts a living person. For example, verifying that the at least one image of the user is authentic may include determining whether the at least one image of the user has been tampered with by analyzing the at least one image of the user using a neural network for identifying representations of an attack. Additionally or alternatively, verifying that the at least one image of the user is authentic may include determining that a detected sound of the user corresponds to the at least one image of the user. Additionally or alternatively, verifying that the at least one image of the user is authentic may include determining muscle movements of the user in at least two captured images of the user. The verification may be performed by at least one of the aerosol generating device, the computing device, and the server.

[0120] In step 250, the age of the user is estimated based on at least one image of the user. Estimating the age of the user based on the at least one image of the user may include estimating the age of the user based on the anonymized pixel map at the server. The age of the user may be estimated by at least one of the aerosol generating device, the computing device, and the server. The age of the user may be estimated based on the at least one image of the user and the obtained voice data of the user. In an example, the age of the user estimated based on the at least one image of the user is verified using the obtained voice data of the user.

[0121] Step 260 comprises determining whether the estimated age of the user is above a threshold.Determining whether the estimated age of the user is above a threshold may be performed at the aerosol generating device, the computing device or the server.

[0122] In step 270, when it is determined that the estimated age is above the threshold, the aerosol generating device is unlocked for generating aerosol from the aerosol-forming substrate. Unlocking the aerosol generating device may include instructing the aerosol generating device, by the computing device, to switch from a locked state to an unlocked state.

[0123] When it is determined that the estimated age is below the threshold, the aerosol generating device remains locked in step 280. In the locked state, the aerosol generating device is unable to generate an aerosol from the aerosol-forming substrate.

[0124] In step 290 , at least one of the at least one image of the user and the anonymized pixel map is deleted after determining the estimated age of the user and / or unlocking the aerosol generating device.

[0125] For the purpose of this specification and the appended claims, unless otherwise indicated, all numbers representing amounts, quantities, percentages, etc. should be understood to be modified by the term "about" in all cases. Moreover, all ranges include the disclosed maximum and minimum points, and include any intermediate ranges therein that may be specifically listed or may not be listed in this article. In this case, the number A can be regarded as including a numerical value within the general standard error for the measurement of the attribute modified by the number A. In some cases used in the appended claims, the number A may deviate from the percentage listed above, provided that the amount of A deviation will not substantially affect the basic characteristics and novel features of the claimed invention. Moreover, all ranges include the disclosed maximum and minimum points, and include any intermediate ranges therein that may be specifically listed or may not be listed in this article.

Claims

1. An aerosol generating system comprising: an aerosol generating device configured to generate an aerosol from an aerosol-forming substrate in an unlocked state; an image acquisition sensor configured to capture at least one image of a user of the aerosol generating device; as well as at least one processor configured to: estimating an age of the user based on at least one image of the user; determining whether the estimated age of the user is above a threshold or equal to the threshold; as well as The aerosol generating device is unlocked when the estimated age is above the threshold or equal to the threshold.

2. An aerosol generating system according to claim 1, comprising a microphone configured to record the user's voice, wherein the at least one processor is configured to estimate the age of the user based on at least one image of the user and the recorded voice of the user.

3. An aerosol generating system according to one of claims 1 and 2, comprising a mobile computing device of the user, wherein the mobile computing device comprises the image acquisition sensor.

4. An aerosol generating system according to claim 3, wherein the at least one processor is configured to: converting, at the mobile computing device, at least one image of the user into at least one corresponding anonymized pixel map; and sending the anonymized pixel map from the mobile computing device to a server, The age of the user is estimated at the server based on the anonymized pixel map.

5. An aerosol generating system according to claim 4, wherein the at least one processor is configured to delete at least one of the at least one image of the user and the anonymized pixel map after determining the estimated age of the user and / or unlocking the aerosol generating device.

6. An aerosol generating system according to one of claims 1 to 5, wherein the age of the user is estimated by using a machine learning model, such as a neural network, preferably a deep neural network.

7. An aerosol generating system according to one of claims 1 to 6, wherein the at least one processor is configured to verify that the at least one image of the user is authentic by at least one of: determining whether at least one image of the user has been tampered with by analyzing at least one image of the user using a neural network for identifying indicative of an attack; determining that the detected sound of the user corresponds to at least one image of the user; as well as Muscle movement of the user in at least two of the at least one image of the user is determined.

8. An aerosol generating system according to one of claims 1 to 7, wherein the threshold value is predefined, preferably predefined by a manufacturer of the aerosol generating device.

9. An aerosol generating system according to one of claims 1 to 8, wherein the threshold is at least N years higher than a first age set for authorising use of the aerosol generating device, preferably wherein N = 1 or more, 2 or more, 3 or more, 4 or more or 5 or more.

10. An aerosol generating system according to one of claims 1 to 9, wherein the at least one processor is configured to determine a user profile of the user based on at least one image of the user, and optionally wherein the aerosol generating device is configured according to the user profile.

11. An aerosol generating system according to one of claims 1 to 10, wherein the at least one processor is configured to verify the identity of the user based on at least one image of the user.

12. A computer-implemented method of unlocking an aerosol generating device, the method comprising: obtaining at least one image of a user of the aerosol generating device; estimating an age of the user based on at least one image of the user; determining whether the estimated age of the user is above a threshold; as well as When it is determined that the estimated age is above the threshold, the aerosol generating device is unlocked for generating an aerosol from an aerosol-forming substrate.

13. The computer-implemented method of claim 12, further comprising obtaining voice data of the user, wherein the age of the user is estimated based on at least one image of the user and the obtained voice data of the user.

14. The computer-implemented method according to one of claims 12 and 13, further comprising: converting at least one image of the user into at least one corresponding anonymized pixel map; as well as sending the anonymized pixel map to a server for estimating the age of the user, The age of the user is estimated at the server based on the anonymized pixel map.

15. The computer-implemented method of one of claims 12 to 14, further comprising: Verifying that at least one image of the user is authentic by at least one of the following: determining whether at least one image of the user has been tampered with by analyzing at least one image of the user using a neural network for identifying indicative of an attack; determining that the detected sound of the user corresponds to at least one image of the user; as well as Muscle movement of the user in at least two of the at least one image of the user is determined.

Images