Virtual image generation method and device applied to intelligent door lock and intelligent door lock

Abstract

The invention relates to a virtual image generation method and device applied to an intelligent door lock and the intelligent door lock. The method comprises the steps that an image containing a target object is obtained; generating an initial virtual image of the target object according to the image; obtaining multi-dimensional information features related to the target object and / or the intelligent door lock environment; and according to the multi-dimensional information features, adjusting character attributes in the initial virtual image to generate a target virtual image associated with the multi-dimensional information features. By adopting the method, the problem that the display image of the intelligent door lock is difficult to meet the personalized requirement of a user can be solved.

Description

Technical Field

[0001] This application relates to the field of smart door locks, and in particular to a method, apparatus and smart door lock for generating virtual images for use in smart door locks. Background Technology

[0002] Currently, many smart locks are equipped with front panel displays that can show emojis to enhance the emotional interaction experience. However, these emojis are usually pre-designed, selected, and fixed by the manufacturer, and users can only choose from a limited set of preset emojis. Therefore, the image content displayed by smart locks is difficult to meet users' needs for personalization and also lacks effective interaction with users.

[0003] There is currently no effective solution to the problems of insufficient personalization and weak interactivity in the display images of existing smart door locks. Summary of the Invention

[0004] Based on this, this solution provides a method for generating virtual avatars, a corresponding device, and a smart lock, aiming to enhance the personalization of the content displayed on the smart lock and improve the user's interactive experience.

[0005] Firstly, this embodiment provides a method for generating a virtual image for smart door locks, including:

[0006] Get the image containing the target object;

[0007] Based on the image, an initial virtual image of the target object is generated;

[0008] Acquire multi-dimensional information features related to the target object and / or the smart lock environment;

[0009] Based on the multidimensional information features, the character attributes in the initial virtual image are adjusted to generate a target virtual image associated with the multidimensional information features.

[0010] In some embodiments, after obtaining the target virtual image of the target object, the method further includes:

[0011] Update the target virtual avatar to the initial virtual avatar.

[0012] In some embodiments, acquiring an image containing the target object includes:

[0013] Acquire images stored by the smart lock based on historically entered information; and / or,

[0014] The smart lock acquires images containing the target object, either historically or in real-time.

[0015] In some embodiments, the multidimensional information features include at least one of the following:

[0016] Image features extracted from the image of the target object;

[0017] Weather characteristics generated based on meteorological data at the current moment;

[0018] Calendar features generated based on the current date;

[0019] Behavioral characteristics generated based on the door lock logs of the smart door lock.

[0020] In some embodiments, after adjusting the character attributes in the initial virtual avatar according to the multidimensional information features to generate a target virtual avatar associated with the multidimensional information features, the method further includes:

[0021] Based on at least one of the multidimensional information features, determine a preset action that matches the feature;

[0022] Control the target virtual image to perform the preset action.

[0023] In some embodiments, after obtaining the target virtual image of the target object, the method further includes:

[0024] In response to an unlocking operation initiated by the target object, the unlocking feature corresponding to the unlocking state of the smart door lock is obtained;

[0025] Based on the unlocking characteristics, the dynamic attributes of the target virtual avatar are adjusted to control the target virtual avatar to perform actions that match the unlocking state.

[0026] In some embodiments, after obtaining the target virtual image of the target object, the method further includes:

[0027] When other objects besides the target object are detected to exist continuously within a preset time period, a preset prompt feature is obtained, and the target virtual image or preset virtual image corresponding to the other object is invoked.

[0028] Based on the aforementioned prompting features, the dynamic attributes of the invoked target virtual image or preset virtual image are adjusted to control the target virtual image to perform a preset prompting action.

[0029] In some embodiments, the method further includes: displaying a specified target virtual image and its dynamic actions on the display interface of the smart lock in response to a user instruction.

[0030] Secondly, this embodiment provides a virtual avatar generation device for smart locks, the device being used to execute the virtual avatar generation method for smart locks described in the first aspect.

[0031] Thirdly, this embodiment provides a smart door lock, which includes a processing device and a display device;

[0032] The processing device is configured to execute the virtual image generation method for smart door locks as described in the first aspect;

[0033] A display device is used to display the target virtual image and its dynamic actions generated by the processing device.

[0034] The aforementioned virtual image generation method, apparatus, and smart lock applied to smart locks, after generating an initial virtual image based on an image containing the target object, can adjust the initial virtual image of the target object based on multi-dimensional information features related to the target object and / or the smart lock environment. This allows for the generation of personalized virtual images of the target object based on different target objects and / or lock environments, thus solving the problem that the displayed images of smart locks cannot meet the personalized needs of users. Attached Figure Description

[0035] Figure 1 This is an application environment diagram of a virtual avatar generation method for smart door locks in one embodiment;

[0036] Figure 2 This is a flowchart illustrating a virtual avatar generation method applied to a smart door lock in one embodiment;

[0037] Figure 3 This is a flowchart illustrating a method for generating a cartoon character for a smart door lock, as described in one embodiment.

[0038] Figure 4 This is a flowchart illustrating a virtual avatar motion control method applied to a smart door lock in one embodiment;

[0039] Figure 5 This is a structural block diagram of a virtual avatar generation device applied to a smart door lock in one embodiment;

[0040] Figure 6 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation

[0041] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0042] Based on this, this embodiment provides a virtual avatar generation method for smart door locks. Specifically, the virtual avatar generation method for smart door locks provided in this application embodiment can be applied to, for example... Figure 1 In the application environment shown, the smart lock 102 communicates with the server 104 via a network. A personalized target virtual avatar can be generated based on the smart lock 102, or through the interaction between the smart lock 102 and the server 104. The data storage system can store the data that the server 104 needs to process. The data storage system can be integrated onto the server 104, or it can be located in the cloud or on other network servers. The server 104 can be implemented using a standalone server or a server cluster consisting of multiple servers.

[0043] In one embodiment, such as Figure 2 As shown, a method for generating virtual avatars for smart door locks is provided. Figure 1 Taking the smart door lock 102 as an example, the explanation includes the following steps:

[0044] Step S202: Obtain an image containing the target object.

[0045] The target object is a pre-defined object within the smart lock. The target object is not limited to a specific type and can include humans, animals (pets), etc. Optionally, images can be obtained from historical data stored in the smart lock, or images containing the target object can be captured by the smart lock itself.

[0046] Step S204: Generate an initial virtual image of the target object based on the image.

[0047] Optionally, the face and body regions of the target object in the image are identified. The face image in the face region is converted into a virtual face image, and the body image in the body region is converted into a virtual body image. Based on the size matching parameters between the virtual face and body images, the virtual face and / or virtual body images are scaled and located. Based on the location results, the scaled virtual face and virtual body images are stitched together to obtain an initial virtual avatar. Furthermore, image enhancement and optimization algorithms can be used to enhance and optimize the initial virtual avatar, thereby improving its quality.

[0048] Step S206: Obtain multi-dimensional information features related to the target object and / or the smart lock environment.

[0049] The smart lock environment includes, but is not limited to, the spatial environment and temporal environment of the smart lock; the spatial environment can be the surrounding environment of the smart lock installation location, the weather environment, etc., and the temporal environment can be the date and time when the smart lock is used, as well as anniversaries recorded in the lock log, etc.

[0050] Multidimensional information features include the visual characteristics of the target object, and may also include contextual features related to the smart lock environment and the target object. Visual characteristics include, but are not limited to, the target object's physiological characteristics, clothing, and accessories. Physiological characteristics include the target object's gender, age, skin color, facial features, and body features. Clothing characteristics include the target object's clothing color and style. Accessory features include the target object's glasses, watch, necklace, etc. Contextual features are background elements used to generate the virtual avatar, including but not limited to features such as region, weather, calendar, and behavior.

[0051] Optionally, multidimensional information features of the target object can be extracted from an image containing the target object. Alternatively, pre-configured multidimensional information features can be obtained based on the smart lock environment. When the multidimensional information features of the target object conflict with the multidimensional information features related to the smart lock environment, one of the conflicting features can be retained based on preset priorities or rules.

[0052] Step S208: Adjust the character attributes in the initial virtual image based on the multidimensional information features to generate a target virtual image associated with the multidimensional information features.

[0053] The character attributes are the parameters in the initial virtual avatar that correspond to various multi-dimensional information features. Optionally, the character attributes in the initial virtual avatar can be adjusted to the parameters corresponding to the multi-dimensional information features, so that the virtual avatar matches the target object.

[0054] In this embodiment, after generating an initial virtual image based on the image of the target object, the character attributes of the initial virtual image are adjusted based on the multi-dimensional information features related to the target object and / or the smart lock environment. This makes the adjusted target virtual image match the target object and / or the current smart lock usage environment, allowing different users to obtain a personalized target virtual image and solving the problem that the display image of the smart lock is difficult to meet the personalized needs of users.

[0055] In one embodiment, after obtaining the target virtual image of the target object, the method further includes updating the target virtual image to the initial virtual image. Optionally, each time a new target virtual image is generated, the initial virtual image is replaced based on the new target virtual image. This allows the next generation of target virtual images to use the previously generated target virtual image as a basis for modification, thereby improving the continuity and consistency of the generated target virtual images.

[0056] In one embodiment, acquiring an image containing a target object includes: acquiring an image stored by the smart lock based on historically entered information; and / or acquiring an image containing a target object that the smart lock acquires at a historical moment or in real time.

[0057] The historical data entered includes at least one of the following: 1. Image frames containing the target object that the user actively uploads to the smart lock; 2. Image or video frames containing the target object that the smart lock collects when the user registers the smart lock's facial recognition ID. This type of historical data entered by the user when registering the smart lock's facial recognition ID is used not only for identity verification during facial unlocking but also as the basis for generating a virtual avatar.

[0058] Images containing the target object captured by the smart lock at historical moments or in real time include: images and / or image frames from videos captured by the camera module in the smart lock during the user's use of or approach to the smart lock.

[0059] In this embodiment, the smart door lock acquires images containing the target object through historical data entry and / or data collection. Without requiring manual configuration by the user, it can automatically generate an initial virtual image of the target object, thereby improving the efficiency of generating the initial virtual image of the target object.

[0060] In one embodiment, the multidimensional information features include at least one of the following: image features extracted from an image of the target object; weather features generated based on meteorological data at the current moment; calendar features generated based on the current date; and behavioral features generated based on the door lock logs of the smart door lock.

[0061] Among them, image features are used to generate an appearance for the virtual avatar that matches the target object. Optionally, based on an image containing the target object, physiological features of the target object, including facial features and body features, as well as clothing and accessory features of the target object, are extracted.

[0062] Optionally, when multiple images of the target object are obtained, the image with the shortest time interval between the shooting time and the current time can be obtained, and the image features can be extracted based on the image.

[0063] Alternatively, meteorological data of the current location of the smart lock can be obtained, and meteorological data corresponding to multiple images can be acquired. The image matching the current meteorological data can be selected as the target image, and image features can be extracted based on this target image. Obtaining meteorological data corresponding to multiple images includes: acquiring meteorological data at the time of each image data acquisition, and / or obtaining meteorological data through image recognition. Selecting an image based on meteorological data allows the target virtual image to match the current weather conditions, improving the quality of the target virtual image.

[0064] Alternatively, the image features extracted from each image can be fused using methods such as simple averaging or weighted fusion.

[0065] Weather features are used to generate the appearance, background, and preset actions of the virtual avatar that match real-time weather data. Optionally, weather data for the current location of the smart lock is obtained via a network connection. This weather data includes, but is not limited to, temperature and humidity, sunshine level, wind speed, suitable clothing type, and season. Optionally, a weather model is pre-configured to indicate the mapping relationship between weather data and weather features, and weather features corresponding to the weather data are obtained based on the weather model. Weather features can be, for example, clothing in the virtual avatar that matches the current weather data, or the background of the virtual avatar that matches the current weather data.

[0066] Furthermore, a matching style template can be obtained based on meteorological data, and the style template can be adjusted according to weather characteristics; the character attributes of the initial virtual image can be adjusted to obtain a target virtual image that matches the adjusted style template.

[0067] Calendar features are used to generate appearances, scenes, and preset actions for virtual avatars that match specific dates such as holidays and anniversaries. Optionally, anniversaries set by the target user can be obtained through door lock logs or smart devices connected to the door lock. Anniversaries can be the user's birthday, a significant date for the user, etc. A pre-configured calendar model is obtained to indicate the mapping relationship between specific dates and calendar features. Based on the current time, it is determined whether the current date belongs to the specific date; if so, the calendar features corresponding to the specific date are obtained based on the calendar model.

[0068] Behavioral features are used to generate appearances, scenes, and preset actions for virtual avatars that match the operating habits of the target object. Optionally, the system can analyze the smart lock's door lock logs to summarize the user's habitual operations when interacting with or approaching the door lock, thereby extracting corresponding behavioral features. Specifically, behavioral features can be extracted based on data such as video capture data, unlocking methods, and interaction times contained in the smart lock's door lock logs.

[0069] For example, when extracting corresponding behavioral features from video capture data, the behavioral features can be generated based on the target object's actions and postures during interaction with or approach to the door lock in each video capture data. If the frequency and / or number of the same action and posture is greater than a specified value, behavioral features can be generated based on that action and posture. For instance, if the target object repeatedly touches its hair during its interaction with the door lock upon returning home, behavioral features can be generated based on this "touching hair" action, allowing the target virtual avatar to perform actions corresponding to "touching hair" based on these behavioral features.

[0070] When extracting behavioral features based on unlocking methods, behavioral features can be generated based on the specified unlocking method if the number or frequency of times a user unlocks the door using that method exceeds a specified value. For example, if a target frequently unlocks a door by entering a password, behavioral features can be generated based on the action of "entering a password," allowing the target virtual avatar to perform actions corresponding to "entering a password" based on these behavioral features.

[0071] In this embodiment, by acquiring multidimensional information features of the target object from multiple dimensions, a personalized virtual image of the target object can be constructed.

[0072] Furthermore, after adjusting the character attributes in the initial virtual image based on the multidimensional information features to generate a target virtual image associated with the multidimensional information features, the method further includes: determining a preset action matching the features based on at least one of the multidimensional information features; and controlling the target virtual image to perform the dynamic action corresponding to the preset action.

[0073] Optionally, based on image characteristics and / or behavioral characteristics in the door lock logs, the body posture or movement posture of the target object when interacting with the smart door lock is extracted, and preset actions are obtained based on the body posture or movement posture. Based on the extracted weather characteristics, action commands matching the current weather are configured for the virtual image, resulting in preset actions. Based on the extracted calendar characteristics, action commands matching the current date are configured for the virtual image, resulting in preset actions.

[0074] Optionally, based on the extracted multidimensional information features, preset actions that match the multidimensional information features are selected from a pre-defined action library, and the dynamic data of the target virtual image is adjusted based on the preset actions to control the target object to perform the preset actions.

[0075] In this embodiment, after adjusting the character attributes in the initial virtual image based on multidimensional information features to generate a static target virtual image, the target virtual image is driven to perform preset actions that match the multidimensional information features to obtain a dynamic target virtual object, thereby improving the personalization of the target virtual image and enhancing the interactivity between the target virtual image and the user.

[0076] In one embodiment, after obtaining the target virtual image of the target object, the method further includes: in response to an unlocking operation initiated by the target object, obtaining an unlocking feature corresponding to the unlocking state of the smart lock; and adjusting the dynamic attributes of the target virtual image according to the unlocking feature to control the target virtual image to perform actions that match the unlocking state.

[0077] The unlock status includes states such as the smart lock being unlocked, the smart lock successfully unlocking, and unlocking failing. Unlock features are used to generate actions for the virtual avatar in different unlock states. The dynamic attributes of the target virtual avatar are adjustable parameters used to control the actions of the target virtual avatar.

[0078] In this embodiment, by adjusting the parameters corresponding to the dynamic attributes based on the unlocking features, the virtual image can be driven to perform dynamic actions that match various unlocking states, thereby improving the interaction and personalization between the virtual image and the target object.

[0079] In one embodiment, after obtaining the target virtual image of the target object, the method further includes: when other objects besides the target object are detected to exist continuously within a preset time period, obtaining preset prompt features, and calling the target virtual image or preset virtual image corresponding to the other object; and adjusting the dynamic attributes of the called target virtual image or preset virtual image according to the prompt features, so as to control the target virtual image to perform a preset prompt action.

[0080] Different prompting features correspond to different prompting actions. These prompting actions are performed by the virtual avatar when the smart lock detects a non-target object lingering. Optionally, the prompting action varies depending on the detected object. If the detected object is a user-specified object, the prompting action might be a welcoming or greeting gesture; if the detected object is an unfamiliar object not specified by the user, the prompting action might be a warning or unwelcoming gesture. It should be understood that prompting actions can be configured and modified according to requirements.

[0081] Optionally, the smart lock's radar identifies whether other objects besides the target object continuously exist within a specified range of the smart lock for a preset time period. The target virtual image corresponding to the other objects can be a target virtual image generated based on an image containing the other objects. The preset virtual image can be a user-specified virtual image; optionally, based on user instructions, one virtual image from multiple target virtual images can be designated as the preset virtual image; for example, the user can use a target virtual image generated based on a pet as the preset virtual image. Alternatively, a virtual image uploaded by the user to the smart lock can also be used as the preset virtual image.

[0082] Optionally, when other objects are pre-specified objects by the user, the target virtual avatar corresponding to the other objects can be invoked; these other objects can be humans or animals, without limitation. Specifically, when a single object other than the target object is detected to exist continuously within a preset time period, the target virtual avatar of that single object can be generated and invoked. When multiple other objects other than the target object are detected to exist continuously within a preset time period, a specific object can be determined from among the multiple objects, thereby generating and invoking the target virtual avatar of that specific object; alternatively, an object can be randomly determined from among the multiple objects, and the target virtual avatar of that random object can be generated and invoked; or, the target virtual avatars of multiple other objects can be displayed simultaneously. When the target object and other objects are detected simultaneously, only the target object's target virtual avatar can be generated and displayed, or the virtual avatars of the target object and other objects can be displayed simultaneously. The method for generating the target virtual avatar of other objects is the same as the method for generating the target virtual avatar of the target object, and will not be described in detail here.

[0083] When other detected objects are unfamiliar objects not specified by the user, a preset virtual avatar can be invoked. When an unfamiliar object not specified by the user is detected, and a target object and / or an object not specified by the user are also detected, a target virtual avatar corresponding to the detected target object and / or other objects can be invoked, or a preset virtual avatar can be invoked.

[0084] In this embodiment, by calling any or a specific virtual avatar to perform preset prompting actions, the virtual avatar generation needs in different scenarios can be met, thereby improving the interactivity of the smart door lock.

[0085] In one embodiment, in response to a user instruction, a specified target virtual image and its dynamic actions are displayed on the smart lock's display interface.

[0086] User commands include, but are not limited to, commands such as opening and closing the door, unlocking, and viewing a virtual avatar. User commands can be generated during user interaction with the smart lock, including but not limited to actions such as opening and closing the door and triggering the lock's display screen. User commands can also be commands input by the user through an input device associated with the smart lock, such as a terminal connected to the smart lock, an external button, or a touchpad.

[0087] The display interface is used to create a visually visible image. It can be a built-in display screen on the door lock, or a display screen, projection device, or virtual reality imaging device associated with the door lock. The display screen can be an LCD screen or an e-ink screen.

[0088] Optionally, multiple target virtual images can be generated for the smart lock, each corresponding to a different object. In response to user commands, one or more specified target virtual images and their dynamic actions are displayed on the smart lock's display interface.

[0089] In this embodiment, a target virtual image is displayed in response to user commands, thereby improving the user experience.

[0090] In one embodiment, Figure 3 This paper presents a method for generating cartoon characters for smart door locks, using human figures as the target object to generate cartoon-style virtual characters; it can be understood that, based on... Figure 3 This method can also generate virtual images of other styles, and there are no limitations on it here. Specifically, such as Figure 3 As shown, the methods for generating cartoon characters include:

[0091] Step S310: The smart lock acquires image data of people. Users can upload images or videos of themselves or others through an app associated with the smart lock to obtain image data; the image data can also be images captured by the smart lock.

[0092] Taking the example of a user uploading their own or others' images or videos to obtain character image data in the APP according to their preferences, step S310 may optionally include:

[0093] Step S311: Obtain the image data of the person uploaded by the user. The image data includes: a face image and a body image;

[0094] Step S312: Preprocess the face image. Preprocessing includes image normalization, facial feature point localization, and facial key point detection; wherein, the facial feature points and key points can be configured according to requirements.

[0095] Step S313: Preprocess the body image. Preprocessing includes cropping the body image, extracting body feature lines, and detecting key body parts. The body feature lines and key body parts can be configured as needed.

[0096] In step S320, the smart door lock uploads the image data of the person to the cloud. The cloud analyzes the image data of the person based on AI algorithms and extracts facial features and body features.

[0097] Optionally, step S320 includes:

[0098] Step S321: Execute the face detection algorithm. Specifically, the face detection algorithm is used to locate the face region and obtain face features;

[0099] Step S322: Execute the face recognition algorithm. Specifically, using the face recognition algorithm, facial expression, eye position, and mouth shape features are obtained based on facial feature analysis;

[0100] Step S323: Execute the body detection algorithm. Specifically, the body detection algorithm is used to locate key body parts and extract body features;

[0101] Step S324: Execute the pose estimation algorithm. Specifically, the pose estimation algorithm is used to obtain the body pose based on body feature analysis.

[0102] In step S330, the cloud generates a cartoon template that matches the meteorological data based on the location of the smart door lock; the meteorological data includes weather and seasonal data; the cloud generates the cartoon template using an AI algorithm.

[0103] Optionally, step S330 includes:

[0104] Step S331: Obtain meteorological data. Meteorological data includes current weather and seasonal data; weather data includes parameters such as temperature and humidity, sunshine level, wind speed, and suitable clothing type.

[0105] Step S332: Based on the meteorological data, call the corresponding style template.

[0106] Step S333: Adjust the style template based on meteorological data to generate a cartoon template that matches the weather and season. Optionally, obtain weather characteristics based on weather data and current seasonal data, and adjust the style template based on these weather characteristics to obtain the cartoon template.

[0107] In step S340, the cloud uses a face conversion model and a body conversion model to convert the image into an initial cartoon image that matches the cartoon template.

[0108] Optionally, step S340 includes:

[0109] Step S341: Based on the extracted facial features, the face conversion model converts the face image into a cartoon face image that matches the cartoon template.

[0110] Step S342: Based on the extracted body features, the body conversion model converts the body image into a cartoon body image that matches the cartoon template.

[0111] Step S343: Perform facial feature correction and detail enhancement on the cartoon face image;

[0112] Step S344: Perform body feature correction and detail enhancement on the cartoon body image.

[0113] In step S350, the cloud stitches together the cartoon face image and the cartoon body image to generate the initial cartoon character.

[0114] Optionally, step S350 includes:

[0115] Step S351: Calculate the matching parameters between the cartoon face image and the cartoon body image;

[0116] Step S352: Scaling and positioning the cartoon face image according to the matching parameters;

[0117] Step S353: The cartoon face image and the cartoon body image are stitched together to generate an initial cartoon image;

[0118] Step S354: Optimize the initial cartoon image using an image enhancement algorithm to improve image quality.

[0119] In step S360, the cloud platform adjusts the character attributes of the initial cartoon character and / or controls the initial cartoon character to perform preset actions based on the user image collected by the smart door lock.

[0120] The user image can be a daily image of the user captured by the smart lock on the same day or recently. The cloud uses intelligent analysis algorithms to extract and process various features of the user's image on the same day, including but not limited to glasses, accessories, etc., which effectively avoids the limitations of feature extraction in traditional methods and improves the quality and realism of the generated image.

[0121] Optionally, an AI intelligent analysis algorithm is used to extract the image features of the current person's image, such as glasses, accessories, and hat, based on the user's daily images captured by the smart door lock on the same day or recently. Based on the image features, the corresponding personalized elements are added to the generated initial cartoon image to obtain the target cartoon image.

[0122] Furthermore, if a user uploads a video of a person with motion to the smart lock, and / or the smart lock captures the dynamic video of the person; the cloud AI can extract the person's behavioral characteristics based on the video, obtain preset actions that match the behavioral characteristics, and combine them with the generated target cartoon image to generate a dynamic target cartoon image that performs the preset actions.

[0123] Optionally, meteorological data can be obtained based on the current door lock position, and the AI ​​algorithm can select human image data that matches the current meteorological data, thereby automatically generating a cartoon character that conforms to the local climate style based on the human image data that matches the current meteorological data.

[0124] In step S370, when the cloud identifies a specific date related to the user, it adjusts the character attributes of the initial cartoon character and / or controls the initial cartoon character to perform preset actions. Specifically, by analyzing the relationship between seasons and traditional holidays, the cartoon character is adjusted so that the appearance, scene, and actions of the adjusted target cartoon character match the characteristic date, enabling personalized customization of the cartoon character for holidays and special anniversaries.

[0125] Optionally, when encountering traditional holidays or special anniversaries, the cloud-based AI analyzes the relationship between these dates and users, calls upon the calendar features corresponding to the dates, and automatically generates cartoon images for special dates such as holidays and special anniversaries based on the calendar features. For example, during the Spring Festival, the cloud-based AI generates a festive scene of users setting off fireworks and firecrackers based on the user's daily generated cartoon image; on a user's birthday, it generates a heartwarming scene of users blowing out the candles on their birthday cake.

[0126] Furthermore, once a virtual avatar is generated based on the smart lock, it can be controlled to perform corresponding actions based on the video data and unlock status collected by the smart lock. Figure 4 A flowchart illustrating a virtual avatar motion control method for smart door locks is provided, including:

[0127] Step S401: Obtain the virtual avatar generated based on the smart lock. The virtual avatar can be a cartoon character or an avatar of other styles. Optionally, it can be based on... Figure 3 The method shown produces a cartoon character.

[0128] Step S402: During the unlocking process of the smart door lock, the cartoon character is controlled to perform corresponding actions according to the unlocking status.

[0129] Optionally, a virtual avatar is displayed during the user's interaction with the smart lock, and the unlocking features are obtained according to different scenarios such as successful unlocking, failed unlocking, and unlocking in progress. Based on the unlocking features, the virtual avatar is controlled to perform corresponding actions, thereby generating a virtual avatar that conforms to the corresponding scenario.

[0130] For example, the virtual avatar can display corresponding actions based on the unlock status, including a happy expression when the smart lock unlocks successfully and a frustrated or crying expression when it fails to unlock, thus intuitively reflecting the user's interaction with the lock. Understandably, the avatar can be controlled to perform other actions based on the unlock status, and this is not limited here.

[0131] Step S403: When an object lingers within the detection range of the smart door lock, the corresponding virtual image is invoked and controlled to perform the corresponding action.

[0132] Optionally, if an object continuously exists within a preset time range of the smart lock's detection range, it is determined that an object is lingering within the smart lock's detection range.

[0133] For example, within the detection range of the smart lock, if a user-specified object is detected lingering, the lock invokes the virtual object corresponding to the specified object and controls the virtual avatar to perform prompting actions such as waving or welcoming. The virtual object corresponding to the specified object can be an image generated based on the specified object's image; for example, the user can pre-specify family members or pets as specified objects and generate corresponding virtual avatars based on them. Alternatively, the virtual object corresponding to the specified object can be a pre-configured or uploaded image of a person or animal.

[0134] Within the detection range of the smart lock, if an unfamiliar object not specified by the user is detected, a preset virtual avatar is invoked. The preset virtual avatar can be a pre-set human or animal image, etc., and can be controlled to perform actions to indicate warnings, prohibit loitering, etc. For example, a human-style virtual avatar based on a pet dog can be controlled to take a picture, thereby alerting the user to an unfamiliar object.

[0135] Furthermore, the actions performed by the virtual avatar can be adjusted based on the detection range of the smart lock and the dwell time of the object. For example, if an object is continuously detected within a first time period, the virtual avatar is controlled to perform a welcoming action; if the object is continuously detected within a second time period, the virtual avatar is controlled to perform an action to indicate confusion, where the second time period is longer than the first time period.

[0136] Unlike existing cartoon character generation technologies that rely on manual design and adjustments, which suffer from low generation efficiency, low personalization, and inconsistent product quality, this embodiment achieves seamless acquisition of human image data based on smart door locks. Using this image data as a benchmark, it combines AI algorithms to achieve automated and intelligent image processing. This generates virtual characters that closely resemble the characters while avoiding disruption to user behavior, thus improving the realism and personalization of virtual characters generated based on smart door locks. Furthermore, by using the human image data collected each time, each generated virtual character is different from the previous one, increasing the playability and emotional value of the smart lock.

[0137] Furthermore, this embodiment employs AI algorithms to extract and process various features of the user's image, combining multi-dimensional information features to generate a cartoon avatar. This achieves intelligent matching of elements such as hairstyle and clothing, effectively overcoming the limitations of traditional manual design and software generation. It significantly improves the accuracy and stability of cartoon avatar generation, enhancing the personalization, quality, and realism of the generated images. Building upon the static virtual avatar, dynamic actions can be added based on data such as date, weather, user video, and door lock unlock status, simulating dynamic effects. While ensuring accurate real-time dynamic generation of the virtual avatar, it also improves its personalization and flexibility, enabling effective interaction between the smart lock and the user.

[0138] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages in other steps. For example, steps S330, S360, and S370 can be executed synchronously or asynchronously after step S350 is executed. Alternatively, step S330 can be omitted, and after step S350 is executed, the character attributes in the initial cartoon character can be adjusted based on the weather characteristics generated from the meteorological data at the current time to generate a target cartoon character associated with the weather characteristics.

[0139] Based on the same inventive concept, this application also provides a virtual avatar generation device for smart locks, which implements the aforementioned virtual avatar generation method for smart locks. The solution provided by this device is similar to the implementation described in the above method. Therefore, the specific limitations of one or more embodiments of the virtual avatar generation device for smart locks provided below can be found in the limitations of the virtual avatar generation method for smart locks described above, and will not be repeated here.

[0140] In one embodiment, such as Figure 5 As shown, a virtual avatar generation device 500 for smart door locks is provided, comprising:

[0141] Image acquisition module 501 is used to acquire an image containing the target object;

[0142] The initial image generation module 502 is used to generate an initial virtual image of the target object based on the image.

[0143] Feature acquisition module 503 is used to acquire multi-dimensional information features related to the target object and / or the smart lock environment;

[0144] The target image generation module 504 is used to adjust the character attributes in the initial virtual image according to the multi-dimensional information features, so as to generate a target virtual image associated with the multi-dimensional information features.

[0145] In one embodiment, the initial image generation module 502 is further configured to update the target virtual image to the initial virtual image after obtaining the target virtual image of the target object.

[0146] In one embodiment, the image acquisition module 501 acquires an image containing the target object, including: acquiring an image stored by the smart lock based on historically entered information; and / or, acquiring an image containing the target object collected by the smart lock at a historical moment or in real time.

[0147] In one embodiment, the multidimensional information features include at least one of the following: image features extracted from an image of the target object; weather features generated based on meteorological data at the current moment; calendar features generated based on the current date; and behavioral features generated based on the door lock logs of the smart door lock.

[0148] Optionally, the virtual avatar generation device applied to the smart door lock further includes an action adjustment module 505, which is used to adjust the character attributes in the initial virtual avatar according to the multi-dimensional information features to generate a target virtual avatar associated with the multi-dimensional information features, and then determine a preset action matching the features according to at least one of the multi-dimensional information features; and control the target virtual avatar to perform the preset action.

[0149] In one embodiment, after obtaining the target virtual image of the target object, the action adjustment module 505 is further configured to respond to the unlocking operation initiated by the target object, obtain the unlocking features corresponding to the unlocking state of the smart door lock; and adjust the dynamic attributes of the target virtual image according to the unlocking features to control the target virtual image to perform actions that match the unlocking state.

[0150] In one embodiment, after obtaining the target virtual image of the target object, the action adjustment module 505 is further configured to obtain preset prompt features when an object other than the target object is detected to exist continuously within a preset time period, and call any or a specific target virtual image; adjust the dynamic attributes of the target virtual image according to the prompt features, so as to control the target virtual image to perform preset prompt actions.

[0151] In one embodiment, the virtual avatar generation device for smart locks further includes a display module 506, wherein the display module is used to display a specified target virtual avatar and its dynamic actions on the display interface of the smart lock in response to user instructions.

[0152] The modules in the aforementioned virtual avatar generation device for smart door locks can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the corresponding operations of each module.

[0153] In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as follows: Figure 6 As shown, the computer device includes a processor, memory, input / output (I / O) interfaces, and a communication interface. The processor, memory, and I / O interfaces are connected via a system bus, and the communication interface is also connected to the system bus via the I / O interfaces. The processor provides computational and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system, computer programs, and a database. The internal memory provides the environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The database stores virtual avatars. The I / O interfaces are used for exchanging information between the processor and external devices. The communication interface is used for communication with external terminals via a network connection. When the computer program is executed by the processor, it implements a method for generating virtual avatars for use in smart door locks.

[0154] Those skilled in the art will understand that Figure 6 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0155] In one embodiment, a smart lock is also provided, comprising a processing device and a display device; wherein the processing device is configured to execute the steps in the above method embodiments; and the display device is used to display a target virtual image and its dynamic actions generated by the processing device. The display device is used to form a visually visible image, and may be a display screen integrated into the lock, or a display screen, projection device, or virtual reality imaging device associated with the lock. The display screen may be a liquid crystal display screen or an e-ink display screen.

[0156] In one embodiment, a computer device is also provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above method embodiments.

[0157] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements the steps in the above method embodiments.

[0158] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps in the above method embodiments.

[0159] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0160] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments described above. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.

[0161] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0162] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A method for generating a virtual image for use in smart door locks, characterized in that, include: Get the image containing the target object; Based on the image, an initial virtual image of the target object is generated; Acquire multi-dimensional information features related to the target object and / or the smart lock environment; Based on the multidimensional information features, the character attributes in the initial virtual image are adjusted to generate a target virtual image associated with the multidimensional information features.

2. The method according to claim 1, characterized in that, After obtaining the target virtual image of the target object, the method further includes: Update the target virtual avatar to the initial virtual avatar.

3. The method according to claim 1, characterized in that, The step of acquiring an image containing the target object includes: Acquire images stored by the smart lock based on historically entered information; and / or, The smart lock acquires images containing the target object, either historically or in real-time.

4. The method according to claim 1, characterized in that, The multidimensional information features include at least one of the following: Image features extracted from the image of the target object; Weather characteristics generated based on meteorological data at the current moment; Calendar features generated based on the current date; Behavioral characteristics generated based on the door lock logs of the smart door lock.

5. The method according to claim 1 or 4, characterized in that, After adjusting the character attributes in the initial virtual image based on the multidimensional information features to generate a target virtual image associated with the multidimensional information features, the method further includes: Based on at least one of the multidimensional information features, determine a preset action that matches the feature; Control the target virtual image to perform the preset action.

6. The method according to claim 1, characterized in that, After obtaining the target virtual image of the target object, the method further includes: In response to an unlocking operation initiated by the target object, the unlocking feature corresponding to the unlocking state of the smart door lock is obtained; Based on the unlocking characteristics, the dynamic attributes of the target virtual avatar are adjusted to control the target virtual avatar to perform actions that match the unlocking state.

7. The method according to claim 1, characterized in that, After obtaining the target virtual image of the target object, the method further includes: When other objects besides the target object are detected to exist continuously within a preset time period, a preset prompt feature is obtained, and the target virtual image or preset virtual image corresponding to the other object is invoked. Based on the aforementioned prompting features, the dynamic attributes of the invoked target virtual image or preset virtual image are adjusted to control the target virtual image to perform a preset prompting action.

8. The method according to claim 1, characterized in that, The method further includes: In response to user commands, the smart lock displays a virtual image of a specified target and its dynamic actions on its display interface.

9. A virtual avatar generation device for smart door locks, characterized in that, The device is used to perform the virtual image generation method for smart door locks as described in any one of claims 1 to 8.

10. A smart door lock, characterized in that, The smart door lock includes a processing device and a display device; wherein... The processing device is configured to perform the virtual image generation method for smart door locks as described in any one of claims 1 to 8; A display device is used to display the target virtual image and its dynamic actions generated by the processing device.

Images