Prompting method and device of electronic equipment, computer equipment and storage medium

Abstract

The invention relates to the technical field of electronic equipment, and discloses a prompting method and device for electronic equipment, computer equipment and a storage medium, and the method comprises the steps: detecting a target person in a preset range of a front panel in the electronic equipment; when the target person is of the preset type, a visual prompt device in the electronic equipment is controlled to execute projection operation of the placement area; identifying a target object in the placement area, and judging whether the current position of the target object meets a preset condition or not to obtain a judgment result; and controlling the electronic equipment to execute corresponding control operation according to the judgment result. The problem that the express receiving convenience and safety are reduced due to the fact that an irradiation area is small and a device for intelligently prompting a courier to place an area is lacked when a camera under an existing electronic device is used for nursing a take-out express is solved.

Description

Technical Field

[0001] The present invention relates to the technical field of electronic devices, and particularly to a prompting method, device, computer device and storage medium for an electronic device. Background Art

[0002] With the development of technology, electronic devices are increasingly widely used in daily life, and their functions are also becoming increasingly rich. In the field of electronic devices, many products already have the function of using the lower camera to monitor takeaways and express deliveries, providing a certain degree of convenience for users, enabling users to understand the placement situation of takeaways and express deliveries at the door through the smart lock.

[0003] However, the existing method of using the lower camera to monitor takeaways and express deliveries has obvious deficiencies. The irradiation area range of the lower camera is relatively small, and the courier is very likely to place the item in an area that the camera cannot irradiate, resulting in the inability to effectively monitor the item. The main reason is that there is a lack of a device that can intelligently prompt the courier of the placement area, which greatly reduces the convenience and security of receiving express deliveries and cannot meet the user's demand for more perfect functions of the smart lock. Summary of the Invention

[0004] In view of this, embodiments of the present invention provide a prompting method, device, computer device and storage medium for an electronic device to solve the problem that the convenience and security of receiving express deliveries are reduced due to the small irradiation area and the lack of a device that can intelligently prompt the courier of the placement area when using the lower camera of the existing electronic device to monitor takeaways and express deliveries.

[0005] In a first aspect, an embodiment of the present invention provides a prompting method for an electronic device, the method comprising:

[0006] Detecting a target person within a preset range of the front panel of the electronic device;

[0007] When the target person is of a preset type, controlling a visualization prompting device in the electronic device to perform a projection operation of a placement area;

[0008] Identifying a target object within the placement area and determining whether the current position of the target object meets a preset condition to obtain a determination result;

[0009] Controlling the electronic device to perform a corresponding control operation according to the determination result.

[0010] Further, the controlling the electronic device to perform a corresponding control operation according to the determination result includes:

[0011] When the determination result is that the current position meets the preset condition, controlling the electronic device to turn off the visualization prompting device and perform a corresponding prompting operation.

[0012] Further, before controlling the visualization prompting device in the electronic device to perform the projection operation of the placement area, the method further includes:

[0013] When a target person is detected, triggering the image acquisition device of the electronic device to acquire a person image within a preset range;

[0014] Extracting visual features from the person image;

[0015] Comparing the visual features with preset identification features, and if the visual features match the preset identification features, determining that the target person is of a preset type.

[0016] Further, the controlling the visualization prompting device in the electronic device to perform the projection operation of the placement area includes:

[0017] Obtaining the object features in the visual features;

[0018] Determining the morphological data of the target object according to the object features;

[0019] Based on the morphological data, adjusting the original projection parameters stored in the visualization prompting device to obtain target projection parameters;

[0020] Controlling the visualization prompting device to project the placement area to a specified position according to the target projection parameters.

[0021] Further, the determining whether the current position of the target object meets a preset condition includes:

[0022] Obtaining a regional image of the placement area through the image acquisition device of the electronic device;

[0023] Identifying the edge contour of the target object in the regional image;

[0024] Analyzing the positional relationship between the edge contour and the placement area to obtain an analysis result;

[0025] Determining whether the current position of the target object meets the preset condition according to the analysis result.

[0026] Further, the analyzing the positional relationship between the edge contour and the placement area to obtain an analysis result includes:

[0027] Identifying the light spot shape of the placement area;

[0028] Dividing the placement area into an outer circle area and an inner circle area based on the light spot shape;

[0029] Analyze the positional relationship between the edge contour and the outer ring area and the inner ring area respectively to obtain an analysis result.

[0030] Further, the analyzing the positional relationship between the edge contour and the outer ring area and the inner ring area respectively to obtain an analysis result includes:

[0031] Judge the coverage state of the edge contour within the placement area;

[0032] When the coverage state is a complete state, determine that the analysis result is that the current position of the target object meets the preset conditions;

[0033] When the coverage state is a missing state, detect whether there is a partial contour of the edge contour located in the inner ring area. If there is a partial contour located in the inner ring area, determine that the analysis result is that the current position of the target object meets the preset conditions; or, if there is no partial contour located in the inner ring area, determine that the analysis result is that the current position of the target object does not meet the preset conditions.

[0034] Further, the method further includes:

[0035] When the judgment result is that the current position does not meet the preset conditions, obtain the positional relationship between the target object and the placement area;

[0036] Control the electronic device to perform corresponding reminder operations according to the positional relationship;

[0037] Receive the feedback signal of the user, and trigger the remote interaction function based on the feedback signal to control the electronic device to establish a corresponding interaction channel with the associated device.

[0038] In a second aspect, an embodiment of the present invention provides a prompting device for an electronic device, and the device includes:

[0039] A detection module, configured to detect a target person within a preset range on the front panel of the electronic device;

[0040] A projection module, configured to control the visualization prompting device in the electronic device to perform a projection operation on the placement area when the target person is of a preset type;

[0041] An identification module, configured to identify a target object within the placement area and judge whether the current position of the target object meets the preset conditions to obtain a judgment result;

[0042] A control module, configured to control the electronic device to perform corresponding control operations according to the judgment result.

[0043] In a third aspect, an embodiment of the present invention provides a computer device, including: a memory and a processor, which are communicatively connected to each other. The memory stores computer instructions, and the processor executes the computer instructions to execute the method according to the first aspect or any corresponding embodiment thereof.

[0044] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which computer instructions are stored, and the computer instructions are used to cause a computer to execute the method according to the first aspect or any corresponding embodiment thereof.

[0045] The method provided by the embodiments of the present application has the following beneficial effects:

[0046] The method provided by the embodiments of the present application realizes real-time perception of the dynamics of the people in front of the door by detecting the target people within the preset range of the front panel of the electronic device, providing a trigger basis for subsequent intelligent operations. By controlling the visualization prompt device in the electronic device to perform the projection operation of the placement area when the target people are of a preset type, it realizes clearly indicating the item placement position for the courier, improving the convenience and security of receiving the courier. By identifying the target object within the placement area and judging whether the current position of the target object meets the preset conditions, it realizes intelligent determination of the courier placement result, providing an accurate basis for subsequent operations. By corresponding different judgment results to different control operations, such as closing the visualization prompt device and controlling the electronic device to perform the corresponding prompt operation when the current position meets the preset conditions, it realizes reasonable management and control of the prompt device, timely informing the user of the courier placement status, and improving the user experience. Description of the Drawings

[0047] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings required for use in the description of the specific embodiments or the prior art. Obviously, the drawings in the following description are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0048] Figure 1 is a flowchart of the prompt method of the electronic device according to the embodiment of the present invention;

[0049] Figure 2 is a schematic diagram of the visualization prompt device projecting the placement area according to the embodiment of the present invention;

[0050] Figure 3 is a schematic diagram of the positional relationship between the object and the placement area according to the embodiment of the present invention;

[0051] Figure 4Schematic flowchart of a prompting method for another electronic device according to an embodiment of the present invention;

[0052] Figure 5 Block diagram of a prompting device for an electronic device according to an embodiment of the present invention;

[0053] Figure 6 Schematic diagram of the hardware structure of a computer device according to an embodiment of the present invention. Detailed implementation manners

[0054] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Apparently, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0055] According to an embodiment of the present invention, there is provided a prompting method, device, computer device, and storage medium for an electronic device. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than here.

[0056] In this embodiment, a prompting method for an electronic device is provided. Figure 1 It is a flowchart of a prompting method for an electronic device according to an embodiment of the present invention. As Figure 1 shown, the process includes the following steps:

[0057] Step S11, detecting a target person within a preset range on the front panel of the electronic device.

[0058] In an embodiment of the present application, in the application scenario of an intelligent lock, accurately detecting the person in front of the door is the basis for implementing a series of subsequent intelligent functions. Specifically, a specific detection device (such as a combination of multiple sensing technologies such as infrared sensing) can be set on the front panel of the electronic device to monitor the person within the preset range in real time. The setting of the preset range should ensure that it can cover the area where the person in front of the door normally stays and operates, and should not be too broad to cause excessive invalid detections and waste system resources (the preset range can be dynamically changed). After the detection device senses that the target person enters the preset range, it quickly transmits a signal to the control system of the intelligent lock to trigger a series of subsequent operation processes for different types of persons.

[0059] Step S12, when the target person is of a preset type, controlling the visual prompting device in the electronic device to perform a projection operation on the placement area.

[0060] In the embodiment of the present application, after accurately identifying the identity of the target person and determining that the person belongs to a preset type (such as a courier), the visual prompt device, as the core component for realizing this operation, its working principle and performance are to accurately guide the courier to place the item.

[0061] It should be noted that the main core component of the visual prompt device is a laser beam lamp. The laser beam lamp can have the following key parameters: output power, which can ensure clear display of the projected pattern under different ambient lights and also meet safety standards to avoid harm to the human body; beam divergence angle, which can ensure that the projected pattern has sufficient size and clarity within a suitable distance range; the nanometer range of the wavelength, and the light of this wavelength has good recognition in common environments, especially matching the working frequency bands of the image acquisition device and photosensitive sensor equipped with the smart lock, facilitating image recognition and light adjustment.

[0062] The laser beam lamp is connected to the main control chip of the smart lock through a high-speed data transmission line. The main control chip is responsible for receiving data from various sensors (such as an infrared sensing device for detecting the presence of a living body at the door, a camera for collecting images of people, etc.) and processing them using preset algorithms and logics. When the main control chip determines that the target person is a courier through image recognition technology and deep learning algorithms, combined with a database storing the clothing characteristics of different express companies, it will send a control command to the laser beam lamp.

[0063] At the same time, the laser beam lamp works closely in coordination with the ambient light sensor. The ambient light sensor monitors the ambient light intensity in real time and feeds the data back to the main control chip. The main control chip dynamically adjusts the brightness and display color of the laser beam lamp according to the ambient light intensity information. For example, in a strong light environment, the main control chip will instruct the laser beam lamp to increase the brightness and switch to a more eye-catching color (such as red) to enhance the recognition of the light spot; in a weak light environment, it will reduce the brightness to avoid the light being too dazzling, and may also adjust to a softer color (such as green).

[0064] In addition, there is also a coordination relationship between the laser beam lamp and the pressure sensing pad and the laser ranging sensor. When the laser beam lamp projects the placement area (the placement area such as Figure 2After the above (as shown), the pressure - sensing pad detects whether there is an item placed below the placement area and whether the pressure value is within a reasonable range corresponding to the weight of the express package. The laser rangefinder measures the distance from the laser lamp to the surface of the placed item to determine whether the item is within the preset reasonable placement height range. The data of these sensors will also be fed back to the main control chip. The main control chip comprehensively analyzes this data and the image information collected by the camera to determine whether the item is placed in place and decides whether to turn off the voice prompt and the light, or issue further prompt instructions, so as to realize the intelligent and automated collaborative work of the entire intelligent lock system during the express delivery placement process.

[0065] In the embodiment of the present application, before controlling the visualization prompt device in the electronic device to perform the projection operation of the placement area, the method further includes the following steps A1 - A3:

[0066] Step A1, when a target person is detected, trigger the image acquisition device of the electronic device to acquire a person image within a preset range.

[0067] Specifically, the electronic device can use a variety of induction technologies within a preset range on its front panel to work together and monitor in real - time whether there are people staying at the door. When a target person enters this preset range, trigger the image acquisition device equipped with the electronic device. Among them, for the night vision function of the image acquisition device, infrared fill - light technology can be used. In the night or low - light environment, it can automatically turn on the infrared fill - light so that the collected image is still clearly distinguishable. After the camera is started, it acquires images of people within the preset range. The preset range can be a dynamic condition (for example, by statistically analyzing the spatial dimensions of the door openings of different house types and combining the standing and walking habits of people, determine the best range that can completely capture the full view of people without collecting too much irrelevant information due to too large a range. For example, a rectangular area with X meters in front, Y meters on the left and right centered on the intelligent lock), aiming to ensure that the collected person image contains enough key information for identity recognition.

[0068] Step A2, extract the visual features in the person image.

[0069] Specifically, after the person image is acquired, the image processing system of the intelligent lock will use advanced image recognition algorithms (such as the convolutional neural network algorithm based on deep learning. This algorithm is trained on a large amount of image data to learn visual feature patterns such as the facial features and clothing textures of different people, and gradually extracts key feature information in the image through operations such as convolutional layers and pooling layers) to process the image and extract visual features from it.

[0070] Visual features include, but are not limited to, the facial contour of a person, hairstyle, clothing color, pattern, and the iconic clothing features of an express delivery company, etc. For example, for a courier, the color of the work uniform with the express delivery company logo and the shape of the logo belong to important visual features. By extracting these features, it provides a rich and accurate information basis for subsequent comparison with preset identification features.

[0071] Step A3, compare the visual features with the preset identification features. If the visual features match the preset identification features, determine that the target person is of the preset type.

[0072] Specifically, in the storage system of the smart lock, various preset identification features are pre-stored, and these features correspond to preset type of personnel, such as couriers, food deliverymen, etc.

[0073] Source of the preset identification features: First, collect sample images. Obtain the standard work uniform design drawings released on various platforms, and at the same time, take photos of couriers wearing work uniforms manually. The shooting range covers the front, side, and back views, and collect work uniform styles for different seasons, such as long-sleeved, short-sleeved, winter coats, etc. Subsequently, in terms of the application of professional image analysis tools, select the computer vision library, and use its color analysis function to extract the main color and distinguishable color matching information of the work uniform. For example, for the work uniform of an express delivery company with a blue main color, determine its specific numerical range in the RGB color space; for patterns, use edge detection and shape recognition algorithms to convert the features such as the shape and lines of the company logo into mathematical descriptions such as contour point sets or geometric graphic parameters; for text, use optical character recognition technology to identify information such as the company name and slogan on the work uniform, and extract features such as its font, font size, and color. Finally, organize the extracted color, pattern, text and other feature information based on the express delivery type as the classification basis to construct a preset identification feature database. The feature data records of each express delivery type cover various feature descriptions of the work uniform.

[0074] For example: {"Express Delivery Type A": {"Color Feature": [RGB value range 1, RGB value range 2,...], "Pattern Feature": [Contour point set 1, Geometric graphic parameter 2,...], "Text Feature": ["Font 1", "Font size 1", "Color 1", "Name 1", "Slogan 1"]}}.

[0075] Regular update mechanism for preset identification features: Taking a courier as an example, the update cycle is set to be quarterly. In each update cycle, information on work uniform changes and the latest design plans are collected through specific channels. If it is found that the work uniform has changed, a new work uniform sample image is immediately obtained, and the processes of sample image collection and feature extraction are repeated. For example, if the courier replaces the logo pattern, a new photo of the work uniform is taken again, and an image analysis tool is used to extract the features of the new pattern and update them to the preset identification feature database. After the update, a verification test is carried out on the intelligent lock recognition system using a group of known-identity courier images that include both new and old work uniform sample images to ensure that couriers in work uniforms of different periods and styles can be accurately identified without misjudgment. If the recognition accuracy rate decreases or misjudgment occurs, the updated feature data is adjusted and optimized in a timely manner.

[0076] The method provided in the embodiment of the present application triggers the image acquisition device to obtain a person's image, extracts visual features and compares them with the preset identification features, thereby achieving accurate identification of the target person's identity. This process avoids unnecessary operations on non-preset types of people, making the prompt function of the intelligent lock more targeted, reducing resource waste, and ensuring that subsequent operations such as projection of the placement area are only initiated when specific people such as couriers are detected, greatly improving the efficiency and effectiveness of the system operation.

[0077] In the embodiment of the present application, controlling the visualization prompt device in the electronic device to perform the projection operation of the placement area includes the following steps B1 - B4:

[0078] Step B1, obtaining the object features in the visual features.

[0079] Specifically, after determining that the target person is of the preset type, the visual features of the target person have been extracted at this time. These visual features include object features. Through a preset image analysis algorithm (such as a deep learning-based object detection algorithm), the location of the express package is located in the person's image, and the object features related to the package are extracted, and the object features directly related to the express package are screened out from the visual features.

[0080] The object features include but are not limited to the approximate shape of the package (such as cuboid, cylinder, irregular shape, etc.), size (estimating the length, width, and height of the package through the proportional relationship in the image and the known camera parameters), color, surface texture, etc. Obtaining these object features provides basic information for subsequent determination of the form data of the package and adjustment of the projection parameters.

[0081] Step B2, determining the form data of the target object according to the object features.

[0082] Specifically, for the shape feature, if the package presents a cuboid shape, by analyzing the proportional relationship of each side of the package in the image and comparing it with known size reference objects (such as the height and arm length of the courier, and this information can be estimated through camera parameters and human body structure models), the length, width, and height dimension values of the package are calculated (for example, using the principle of similar triangles to calculate the object size. Assume the known courier height is H, the number of pixels occupied by the courier's height in the image is h1, and the number of pixels occupied by the package length is h2. According to the proportional relationship of similar triangles, L=(h2 / h1)*H, and the package length L can be estimated. Similarly, the width and height can be calculated).

[0083] For packages with irregular shapes, the contour fitting algorithm is adopted to fit the edge contour of the package into a combination of a series of geometric figures, thereby determining its approximate size range and shape feature parameters. For example, the contour of an irregularly shaped package is fitted into multiple triangles and quadrilaterals, and by calculating the side lengths, angles, and other parameters of these geometric figures, the form of the package is described.

[0084] Step B3: Based on the morphological data, adjust the original projection parameters stored in the visual prompt device to obtain the target projection parameters.

[0085] Specifically, the visual prompt device (such as a laser ray lamp) stores original projection parameters, which are set based on common express package sizes and placement scenarios. However, in order to project the personalized placement area for each express package, the original projection parameters need to be adjusted according to the target object morphological data.

[0086] The original projection parameters include but are not limited to the emission angle, spot size, shape, color, etc. of the laser ray lamp. According to the morphological data of the target object, using a specific parameter adjustment algorithm (such as according to the length L and width W of the package, adjusting the spot size according to certain ratios k1 and k2, the new spot length S1'=k1*L, the new spot width S2'=k2*W; according to the shape of the package, if it is a cuboid, adjust the emission angle of the laser ray lamp so that the projected placement area is a rectangle and similar to the package shape. For color adjustment, if the package is a fragile item, adjust the spot color to a more eye-catching red according to the preset rules, etc.), the original projection parameters are dynamically adjusted. After adjustment, a set of target projection parameters specifically for the current express package are obtained, and these parameters can ensure that the placement area projected by the visual prompt device is highly adapted to the express package in terms of shape, size, position, etc., providing accurate placement guidance for the courier.

[0087] Step B4: Control the visual prompt device to project the placement area to the specified position according to the target projection parameters.

[0088] Specifically, after obtaining the target projection parameters, these parameters are used to control the visualization prompt device to project the placement area to a specified position, usually on the ground in front of the smart lock. The visualization prompt device is connected to the control system of the smart lock through a high-speed data transmission line. According to the target projection parameters, the control system of the smart lock sends a series of control instructions to the visualization prompt device, including instructions for turning on the laser beam projector, adjusting the emission angle, controlling the spot size and shape, and switching colors. After receiving these instructions, the laser beam projector operates according to the target projection parameters and projects the adjusted spot onto the ground to form a placement area specifically designed for the current express package.

[0089] The placement area can present a contour similar to the shape of the package. For example, for a cuboid package, a rectangular area is projected; for a cylindrical package, a circular or elliptical area may be projected. At the same time, according to the characteristics of the package (such as fragile items), the placement range in the height direction can also be displayed through the light and shadow effect, such as projecting a three-dimensional placement frame with height limits.

[0090] The method provided by the embodiments of the present application determines the morphological data by obtaining the object characteristics, and then adjusts the projection parameters, realizing the intelligence and personalization of the placement area projection. This operation can provide the most suitable placement area guidance for the courier according to the actual characteristics such as the size and shape of different express packages. This not only improves the convenience of express placement but also ensures that the express package can be placed in a suitable area, further improving the safety and accuracy of the express receiving process and making the prompt function of the smart lock more in line with the actual use scenario.

[0091] Step S13: Identify the target object in the placement area and determine whether the current position of the target object meets the preset conditions to obtain a judgment result.

[0092] In the embodiments of the present application, determining whether the current position of the target object meets the preset conditions includes the following steps C1 - C4:

[0093] Step C1: Obtain the area image of the placement area through the image acquisition device of the electronic device.

[0094] Specifically, after the visualization prompt device projects the placement area to the specified position according to the target projection parameters, the image acquisition device will quickly capture the image information of this area. To ensure the accuracy and consistency of the image, the shooting parameters of the image acquisition device will be automatically adjusted according to the ambient light (for example, by detecting the ambient light intensity through a built-in photosensitive sensor. When the light is strong, the exposure time and gain are reduced; when the light is weak, the exposure time and gain are increased to ensure that the captured image of the placement area is clear and bright for subsequent analysis). The obtained area image contains key information such as the spot shape of the placement area and the relative position between the target object and the spot, providing basic data for subsequent judgment on whether the target object is placed in place.

[0095] Step C2: Identify the edge contour of the target object in the area image.

[0096] Specifically, after obtaining the area image of the placement area, it is necessary to identify the edge contour of the target object (i.e., the express package) therein. An edge detection algorithm (the algorithm parameters can be fine-tuned according to the characteristics of the express package image) is used to extract the edge information of the target object from the complex image background and separate the target object from the background. The identified edge contour is presented in the form of a set of a series of pixel points, and these points outline the shape of the target object, providing a basis for subsequent analysis of its positional relationship with the placement area.

[0097] Step C3: Analyze the positional relationship between the edge contour and the placement area to obtain an analysis result.

[0098] The method provided by the embodiment of the present application realizes the accurate judgment of the express placement position by obtaining the area image and analyzing the positional relationship between the edge contour of the target object and the placement area. This judgment mechanism provides a reliable basis for subsequent determination of whether to turn off the prompt device and perform corresponding prompt operations. It can accurately identify whether the express is correctly placed in the specified area, ensuring the standardization of the express receiving process, avoiding potential safety hazards caused by improper express placement, and further improving the practicability and reliability of the intelligent lock in the express care scenario.

[0099] In the embodiment of the present application, step C3 includes: identifying the spot shape of the placement area; dividing the placement area into an outer ring area and an inner ring area based on the spot shape; analyzing the positional relationship between the edge contour and the outer ring area and the inner ring area respectively to obtain an analysis result.

[0100] Specifically, after obtaining an image containing the target object and the placement area, a shape recognition algorithm in image recognition technology is used to determine the shape of the light spot. A method based on template matching or feature extraction is adopted (such as using a shape recognition algorithm based on Hu moments. Hu moments are based on the gray distribution of the image and have rotational, translational, and scale invariance. Calculate the Hu moments of the light spot area and compare them with the Hu moment templates of standard light spot shapes such as circles, rectangles, and ellipses to find the most matching shape. At the same time, preprocess the image by graying and denoising, etc.). The shape features of the light spot are extracted from the image. In addition, a deformation model of the light spot shape under different environmental conditions can be established to correct the collected light spot image to make it closer to the standard shape.

[0101] According to the recognized light spot shape, the placement area is divided according to preset rules. For a circular light spot, with the center of the light spot as the center, a certain radius ratio is set to divide the outer circle and inner circle areas (for example, the outer circle radius is 70% of the light spot radius, and the inner circle radius is 30% of the light spot radius. This ratio can ensure the accuracy of judging the placement of express parcels of different sizes while having good versatility). For a rectangular light spot, it is divided according to the side length ratio. For example, the length and width of the rectangle are divided into two inner and outer rectangular areas according to a certain ratio (such as in the length and width directions, the ratio of the outer circle to the inner circle is 6:4). Finally, the positional relationship between the edge contour of the target object and the divided outer circle area and inner circle area is analyzed in detail to determine the analysis result.

[0102] As an example, the positional relationship between the edge contour of the target object relative to the outer circle area and the inner circle area is as Figure 3 shown. The placement area contains two concentric circles, namely the inner circle area and the outer circle area, and each placement area contains an edge contour of a target object, representing three positional relationships respectively. For example: The target object is a rectangle, and the entire contour is located in the outer circle area and does not intersect with the inner circle area. The target object is a parallelogram, and the contour intersects with both the outer circle area and the inner circle area. The target object is a rectangle, and a part of it is located inside the outer circle area and intersects with the inner circle area.

[0103] Step C4, determine whether the current position of the target object meets the preset conditions according to the analysis result.

[0104] The method provided by the embodiments of this application analyzes the positional relationship of the edge contour by identifying the spot shape and dividing the area, realizing the refinement of the judgment criteria for the placement position of the express delivery. This detailed division method makes the judgment process more scientific and reasonable, and can more accurately distinguish whether the express delivery placement meets the requirements. Compared with a single judgment criterion, this multi-region analysis method effectively reduces the occurrence of misjudgments, ensuring that the express delivery placement is considered correct only when specific positional relationship conditions are met, thereby improving the accuracy and stability of the entire express delivery receiving judgment system.

[0105] In the embodiments of this application, the positional relationships of the edge contour relative to the outer ring area and the inner ring area are analyzed to obtain the analysis results, including the following steps D1 - D3:

[0106] Step D1, judge the coverage status of the edge contour within the placement area.

[0107] Specifically, using the pixel traversal algorithm, starting from the upper left corner of the image, traverse the pixel points of the edge contour of the target object row by row and column by column, judge whether each pixel point is within the placement area, count the number of edge contour pixel points within the placement area, and compare it with the total number of pixel points of the edge contour. According to the preset coverage ratio threshold (such as 70%), when the ratio of the number of edge contour pixel points within the placement area to the total number of pixel points reaches or exceeds this threshold, the coverage status is determined to be the complete state; otherwise, it is determined to be the missing state. This quantitative judgment method provides a clear basis for subsequent determination of whether the express delivery placement meets the preset conditions.

[0108] Step D2, when the coverage status is the complete state, determine that the analysis result is that the current position of the target object meets the preset conditions.

[0109] Specifically, when it is determined that the coverage status of the edge contour within the placement area is the complete state, it indicates that the coverage degree of the target object within the placement area has reached the preset standard, which means that overall, the express delivery package is within the preset placement area, meeting the basic requirements for express delivery placement. Therefore, based on this judgment, it is determined that the analysis result is that the current position of the target object meets the preset conditions, providing a clear basis for subsequent intelligent locks to perform corresponding operations (such as turning off the visual prompt device, notifying the user that the express delivery has been placed in place, etc.).

[0110] Step D3, when the coverage status is the missing state, detect whether there is a partial contour of the edge contour within the inner ring area. If there is a partial contour within the inner ring area, determine that the analysis result is that the current position of the target object meets the preset conditions; or, if there is no partial contour within the inner ring area, determine that the analysis result is that the current position of the target object does not meet the preset conditions.

[0111] Specifically, if it is determined that the coverage status is a missing status, further refinement of the judgment is required at this time. Through a specific algorithm (such as an algorithm for edge contour tracking and region judgment), along the pixel point order of the edge contour, each point is sequentially judged whether it is located within the inner circle area. There can also be a quantization standard for some contours (such as setting that the number of edge contour pixels located within the inner circle area accounts for more than 10% of the total number of edge contour pixels, which is regarded as having some contours located within the inner circle area).

[0112] If there are some contours located within the inner circle area, although the overall coverage status is missing, considering the special significance of the inner circle area in the placement judgment, it can still be determined that the analysis result is that the current position of the target object meets the preset conditions. On the contrary, if there are no contours located within the inner circle area, it means that the express package not only has insufficient overall coverage but also does not cover the key inner circle area. In this case, it is determined that the analysis result is that the current position of the target object does not meet the preset conditions. This step further improves the judgment logic, making the judgment of the express placement position by the smart lock more accurate and comprehensive, effectively reducing the possibility of misjudgment, and improving the reliability of the entire express receiving judgment system.

[0113] The method provided by the embodiment of the present application realizes the clarification and standardization of the judgment of the express placement result by defining the judgment logic of the coverage status of the edge contour within the placement area. This rigorous judgment logic can distinguish different situations of express placement and can accurately judge whether it is completely covered or partially located within a specific area. It provides a clear quantitative basis for whether the express placement meets the preset conditions, improves the accuracy and reliability of the judgment result, and further ensures the standardization and security of the express receiving process.

[0114] Step S14, control the electronic device to perform corresponding control operations according to the judgment result.

[0115] In the embodiment of the present application, step S14 includes: when the judgment result is that the current position meets the preset conditions, turn off the visual prompt device and control the electronic device to perform corresponding prompt operations.

[0116] In the embodiment of the present application, the flowchart of the electronic device performing prompt operations based on the current position of the object is as Figure 4As shown, it includes: First, obtain the regional image of the placement area through the image acquisition device of the electronic device. Then, determine whether the current position of the target object meets the preset conditions based on the obtained regional image. If the judgment result is yes, that is, the position of the target object meets the preset conditions, then control the electronic device to perform the closing operation of the visualization prompt device; if the judgment result is no, that is, the position of the target object does not meet the preset conditions, then control the electronic device to perform the prompt operation, and the prompt operation and the closing process will be executed in a loop for a preset number of times. This flowchart clearly shows the decision-making and operation process of the electronic device when processing the position of the target object in the placement area, reflecting its intelligent working mechanism, ensuring that the prompt is turned off when the target object is placed correctly, and reminding the user in time when the placement is incorrect, so as to achieve a good user experience and functional accuracy.

[0117] In the embodiment of the present application, step S14 further includes: when the judgment result is that the current position does not meet the preset conditions, obtain the position relationship between the target object and the placement area; control the electronic device to perform the corresponding reminder operation according to the position relationship; receive the feedback signal of the user, and trigger the remote interaction function based on the feedback signal, and control the electronic device to establish a corresponding interaction channel with the associated device.

[0118] First, by calculating parameters such as the relative position of the edge contour of the target object and the boundaries of the placement area (including the outer and inner circle area boundaries), as well as the protruding direction and degree of the edge contour outside the placement area (for example, determine the protruding direction by analyzing the coordinate change trend of specific points on the edge contour, and quantify the protruding degree by calculating the length or area of the protruding part), comprehensively obtain the position relationship between the target object and the placement area.

[0119] Secondly, based on the position relationship between the target object and the placement area, the intelligent lock control system executes the corresponding reminder operation using the preset rules to guide the courier to place the item correctly. The preset rules are carefully formulated according to the actual application scenario and user needs.

[0120] For example, if the edge contour of the target object mainly protrudes to the left of the placement area, the voice prompt system of the intelligent lock will issue a voice reminder such as "Please move the package to the right and place it within the area illuminated by the light". In addition to the voice reminder, the intelligent lock can also further indicate the correct placement direction through the visualization prompt device, for example, adjust the projection pattern of the laser spotlight to display a more obvious guiding mark in the direction where the target object needs to move (such as by changing the emission angle, spot shape or color of the laser spotlight, etc.). This collaborative working mechanism of the visualization prompt and the voice prompt improves the effectiveness of the reminder.

[0121] Finally, after performing the reminder operation, the smart lock enters a state of waiting for the user to send a feedback signal. The user can send a feedback signal to the smart lock in various ways, such as by using the physical button set on the smart lock. After receiving the user's feedback signal, the smart lock triggers the remote interaction function based on this signal. This function allows the smart lock to establish a corresponding interaction channel with the associated device.

[0122] For example, if the user feedbacks that it is difficult to place an item at the lock end, the smart lock can send a notification to a designated person through the interaction channel with the security system to request assistance. Alternatively, the smart lock can send the real-time image of the placement area and the position information of the target object to the interaction interface for the user to remotely view and further adjust.

[0123] In this embodiment, a prompting device for an electronic device is also provided. This device is used to implement the above embodiments and preferred implementation manners, and those that have been described will not be repeated. As used hereinafter, the term "module" can be a combination of software and / or hardware that can achieve a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware is also possible and contemplated.

[0124] This embodiment provides a prompting device for an electronic device, as Figure 5 shown, including:

[0125] A detection module 51, configured to detect a target person within a preset range on the front panel of the electronic device;

[0126] A projection module 52, configured to control the visualization prompting device in the electronic device to perform a projection operation of the placement area when the target person is of a preset type;

[0127] An identification module 53, configured to identify a target object in the placement area and determine whether the current position of the target object meets a preset condition;

[0128] A control module 54, configured to control the electronic device to perform a corresponding control operation according to the judgment result.

[0129] In an optional implementation manner of the present application, the control module 54 is configured to control the electronic device to turn off the visualization prompting device and perform a corresponding prompting operation when the judgment result is that the current position meets the preset condition.

[0130] In an optional implementation manner of the present application, the device further includes: a triggering module, configured to trigger the image acquisition device of the electronic device to acquire a personnel image within a preset range when a target person is detected; extract visual features from the personnel image; compare the visual features with preset identification features, and if the visual features match the preset identification features, determine that the target person is of a preset type.

[0131] In an alternative embodiment of the present application, the projection module 52 is configured to obtain the object features in the visual features; determine the morphological data of the target object according to the object features; adjust the original projection parameters stored in the visualization prompting device based on the morphological data to obtain the target projection parameters; and control the visualization prompting device to project the placement area to a specified position according to the target projection parameters.

[0132] In an alternative embodiment of the present application, the recognition module 53 is configured to obtain the area image of the placement area through the image acquisition device of the electronic device; recognize the edge contour of the target object in the area image; analyze the positional relationship between the edge contour and the placement area to obtain an analysis result; and determine whether the current position of the target object meets the preset conditions according to the analysis result.

[0133] In an alternative embodiment of the present application, the recognition module 53 is configured to recognize the spot shape of the placement area; divide the placement area into an outer circle area and an inner circle area based on the spot shape; and analyze the positional relationships between the edge contour and the outer circle area and the inner circle area respectively to obtain an analysis result.

[0134] In an alternative embodiment of the present application, the recognition module 53 is configured to judge the coverage state of the edge contour within the placement area; when the coverage state is a complete state, determine that the analysis result is that the current position of the target object meets the preset conditions; when the coverage state is a missing state, detect whether there is a partial contour of the edge contour within the inner circle area. If there is a partial contour within the inner circle area, determine that the analysis result is that the current position of the target object meets the preset conditions, or, if there is no partial contour within the inner circle area, determine that the analysis result is that the current position of the target object does not meet the preset conditions.

[0135] In an alternative embodiment of the present application, the device further includes: a feedback module, configured to obtain the positional relationship between the target object and the placement area when the judgment result is that the current position does not meet the preset conditions; control the electronic device to perform a corresponding reminder operation according to the positional relationship; receive the feedback signal of the user, and trigger the remote interaction function based on the feedback signal to control the electronic device to establish a corresponding interaction channel with the associated device.

[0136] Please refer to Figure 6 , Figure 6 which is a schematic structural diagram of a computer device provided by an alternative embodiment of the present invention, as Figure 6As shown, the computer device includes: one or more processors 10, a memory 20, and interfaces for connecting the components, including a high-speed interface and a low-speed interface. Each component communicates with each other using different buses and can be installed on a common motherboard or installed in other ways as needed. The processor can process instructions executed within the computer device, including instructions stored in the memory or on the memory to display graphical information of the GUI on an external input / output device (such as a display device coupled to the interface). In some alternative embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple computer devices can be connected, and each device provides some necessary operations (for example, as a server array, a set of blade servers, or a multi-processor system).

[0137] The processor 10 can be a central processing unit, a network processor, or a combination thereof. Among them, the processor 10 can further include a hardware chip. The above hardware chip can be an application-specific integrated circuit, a programmable logic device, or a combination thereof. The above programmable logic device can be a complex programmable logic device, a field-programmable gate array, a generic array logic, or any combination thereof.

[0138] Among them, the memory 20 stores instructions executable by at least one processor 10, so that the at least one processor 10 executes the method shown in the above embodiments.

[0139] The memory 20 can include a program storage area and a data storage area. Among them, the program storage area can store an operating system and application programs required for at least one function; the data storage area can store data created according to the use of the computer device presented by a kind of mini-program landing page, etc. In addition, the memory 20 can include a high-speed random access memory, and can also include a non-transitory memory, such as at least one disk storage device, a flash memory device, or other non-transitory solid-state storage devices. In some alternative embodiments, the memory 20 can optionally include a memory remotely set relative to the processor 10, and these remote memories can be connected to the computer device through a network. Examples of the above network include but are not limited to the Internet, an enterprise intranet, a local area network, a mobile communication network, and combinations thereof.

[0140] The memory 20 can include a volatile memory, such as a random access memory; the memory can also include a non-volatile memory, such as a flash memory, a hard disk, or a solid-state drive; the memory 20 can also include a combination of the above types of memories.

[0141] The computer device further includes a communication interface 30 for the computer device to communicate with other devices or a communication network.

[0142] Embodiments of the present invention also provide a computer-readable storage medium. The method according to the embodiments of the present invention can be implemented in hardware, firmware, or be implemented as computer code that can be recorded on a storage medium, or be implemented by downloading via a network and originally stored in a remote storage medium or a non-transitory machine-readable storage medium and to be stored in a local storage medium, so that the method described herein can be stored as such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only memory, a random access memory, a flash memory, a hard disk, or a solid-state drive, etc.; further, the storage medium can also include a combination of the above-mentioned types of memories. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code, and when the software or computer code is accessed and executed by the computer, the processor, or the hardware, the method shown in the above embodiments is implemented.

[0143] Although embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations all fall within the scope defined by the appended claims.

Claims

1. A prompting method for an electronic device, characterized in that: The method comprises: Detect whether a target person appears within the preset field of view of the electronic device; When the target person is of a preset type, controlling the visual prompt device of the electronic device to perform a projection operation of the placement area; Identify the target object in the placement area, and determine whether the current position of the target object meets a preset condition to obtain a determination result; The electronic device is controlled to perform a corresponding control operation according to the judgment result.

2. The method according to claim 1, characterized in that The controlling the electronic device to perform a corresponding control operation according to the judgment result includes: When the judgment result is that the current position meets the preset condition, the electronic device is controlled to turn off the visual prompt device and perform a corresponding prompt operation.

3. The method according to claim 1, characterized in that Before controlling the visual prompt device in the electronic device to perform the projection operation of the placement area, the method further includes: When a target person is detected, the image acquisition device of the electronic device is triggered to acquire an image of the person within a preset range; extracting visual features from the person image; The visual feature is compared with a preset identification feature, and if the visual feature hits the preset identification feature, it is determined that the target person is of the preset type.

4. The method according to claim 3, characterized in that The step of controlling the visual prompt device in the electronic device to perform a projection operation of the placement area includes: Acquire object features from the visual features; Determining morphological data of the target object according to the object features; Adjusting original projection parameters pre-stored in the visual prompting device based on the morphological data to obtain target projection parameters; The visual prompting device is controlled to project the placement area to a designated position according to the target projection parameters.

5. The method according to claim 1, characterized in that: The determining whether the current position of the target object meets a preset condition includes: Acquire a regional image of the placement area by an image acquisition device of the electronic device; Identifying the edge contour of the target object in the regional image; Analyzing the positional relationship between the edge contour and the placement area to obtain an analysis result; Determine whether the current position of the target object meets a preset condition according to the analysis result.

6. The method according to claim 5, characterized in that The analyzing the positional relationship between the edge contour and the placement area to obtain an analysis result includes: Identifying the light spot shape of the placement area; Dividing the placement area into an outer circle area and an inner circle area based on the light spot shape; The positional relationship of the edge contour relative to the outer circle area and the inner circle area is analyzed to obtain an analysis result.

7. The method according to claim 6, characterized in that The analyzing the positional relationship of the edge contour relative to the outer circle area and the inner circle area to obtain the analysis result includes: Determining a coverage state of the edge contour in the placement area; When the coverage state is a complete state, determining that the analysis result is that the current position of the target object meets a preset condition; When the coverage state is a missing state, detect whether there is a partial contour of the edge contour located in the inner circle area. If there is a partial contour located in the inner circle area, determine that the analysis result is that the current position of the target object meets the preset conditions, or, if there is no partial contour located in the inner circle area, determine that the analysis result is that the current position of the target object does not meet the preset conditions.

8. The method according to claim 1, characterized in that: The method further comprises: When the judgment result is that the current position does not meet the preset condition, obtaining the position relationship between the target object and the placement area; Controlling the electronic device to perform a corresponding reminder operation according to the position relationship; A feedback signal from a user is received, and a remote interaction function is triggered based on the feedback signal, so as to control the electronic device to establish a corresponding interaction channel with an associated device.

9. A prompting device for an electronic device, characterized in that: The device comprises: A detection module, used to detect a target person within a preset range of a front panel of an electronic device; A projection module, used to control the visual prompt device in the electronic device to perform a projection operation of the placement area when the target person is of a preset type; An identification module is used to identify the target object in the placement area, and determine whether the current position of the target object meets the preset conditions to obtain a determination result; The control module is used to control the electronic device to perform a corresponding control operation according to the judgment result.

10. A computer device, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the method according to any one of claims 1 to 8 by executing the computer instructions.

Images