Unlocking processing method, device, smart device and storage medium for terminal application

Abstract

The present application proposes a method, apparatus, smart device and storage medium for unlocking terminal applications. The unlocking method includes: if an unlock trigger operation for a target application object in a smart device is detected, calling a shooting device to capture an environmental image of the environment in which the smart device is located; performing data analysis during the process of capturing the environmental image; and if the analysis result of the data analysis meets the unlocking condition, performing unlocking processing on the target application object. The analysis result includes: determining whether Q environmental images include static image objects that match the reference image object features based on the analysis of N environmental images, and determining whether P environmental images do not include any one or a combination of two dynamic image objects in the target image area based on the analysis of M environmental images. Through the present application, environmental analysis can be performed intelligently to achieve flexible management of terminal application objects.

Description

Technical Field

[0001] The present application relates to the field of computer application technology, and in particular to a method, apparatus, smart device, and storage medium for unlocking terminal applications. Background Art

[0002] With the advancement and development of technology, a wide variety of terminal applications, such as games, search engines, and calculators, have emerged. While these applications provide entertainment in people's daily lives, they can also have negative impacts in some business scenarios. For example, students use mobile phone search engines and other tools to cheat during exams and test-taking. Another example is the use of recording and screen recording software during training sessions where confidentiality is paramount, leading to the leakage of confidential documents.

[0003] In the special business scenarios mentioned above, the use of some terminal applications needs to be avoided. The current main solution is to directly require users to place smart devices such as mobile phones in designated locations, or to forcibly turn off their mobile phones. These solutions do not utilize users' emergency use of smart terminals such as mobile phones, or are not conducive to users being unable to use their mobile phones during periods when they can use them. For example, during a break in a training session, users cannot use their mobile phones to handle other matters. There are also some solutions that use third-party personnel to lock the corresponding terminal applications. If unlocking is required, the third party needs to unlock the terminal application through biometric verification or remote verification permission. This unlocking method requires the intervention of a third party (guardian, parent, teacher, etc.) to perform unlocking verification, and the unlocking efficiency of such a solution is low. Summary of the Invention

[0004] The embodiments of the present application provide a method, apparatus, smart device, and storage medium for unlocking terminal applications, which can intelligently perform environmental analysis to achieve flexible management of terminal application objects.

[0005] On the one hand, an embodiment of the present application provides a method for unlocking a terminal application, the method comprising:

[0006] If an unlock trigger operation for a target application object in the smart device is detected, calling a camera to capture an environmental image of the environment in which the smart device is located;

[0007] Perform data analysis during the process of collecting environmental images;

[0008] If the data analysis result meets the unlocking condition, the target application object is unlocked;

[0009] The analysis results include: determining, based on the analysis of the N environmental images, whether any of the Q environmental images include a static image object that matches the reference image object feature; and determining, based on the analysis of the M environmental images, whether any of the P environmental images do not include a dynamic image object in the target image area. A combination of the two;

[0010] N and Q are integers greater than or equal to 1, and Q is less than or equal to N. M and P are integers greater than 1, and P is less than or equal to M.

[0011] On the one hand, an embodiment of the present application provides a method for unlocking a terminal application, the method comprising:

[0012] Display the application unlock interface;

[0013] When an unlock trigger event is detected in the application unlock interface, an unlock prompt interface is displayed, the unlock prompt interface displays the collected environment image, and displays unlock condition prompt information according to the first display rule;

[0014] If the analysis result after data analysis of the collected environmental image meets the unlocking condition, the unlocking condition prompt information is displayed on the unlocking prompt interface according to the second display rule. The display method of the unlocking condition prompt information is different under the first display rule and the second display rule.

[0015] In one aspect, an embodiment of the present application provides an apparatus for unlocking a terminal application, the apparatus comprising:

[0016] a processing unit configured to, upon detecting an unlock trigger operation for a target application object in the smart device, call a camera to capture an image of the environment in which the smart device is located;

[0017] An analysis unit, used for performing data analysis in the process of collecting environmental images;

[0018] An unlocking unit, configured to unlock the target application object if the analysis result of the data analysis meets the unlocking condition;

[0019] The analysis results include: determining, based on the analysis of the N environmental images, whether any of the Q environmental images include a static image object that matches the reference image object feature; and determining, based on the analysis of the M environmental images, whether any of the P environmental images do not include a dynamic image object in the target image area. A combination of the two;

[0020] N and Q are integers greater than or equal to 1, and Q is less than or equal to N. M and P are integers greater than 1, and P is less than or equal to M.

[0021] In one aspect, an embodiment of the present application provides an apparatus for unlocking a terminal application, the apparatus comprising:

[0022] A display unit, used to display an application unlocking interface;

[0023] The display unit is further configured to display an unlock prompt interface when an unlock trigger event is detected in the application unlock interface, wherein the unlock prompt interface displays the captured environment image and displays unlock condition prompt information according to the first display rule;

[0024] The display unit is further used to display unlock condition prompt information on the unlock prompt interface according to the second display rule if the analysis result after data analysis of the collected environmental image meets the unlock condition. The display method of the unlock condition prompt information is different under the first display rule and the second display rule.

[0025] On the one hand, an embodiment of the present application provides a smart device, which includes a memory and a processor. The memory stores a computer program. When the computer program is executed by the processor, the processor executes the above-mentioned unlocking processing method for the terminal application.

[0026] On the one hand, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is read and executed by a processor of a smart device, the smart device executes the above-mentioned unlocking processing method for the terminal application.

[0027] In one aspect, embodiments of the present application provide a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a smart device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the smart device to perform the aforementioned method for unlocking a terminal application.

[0028] In an embodiment of the present application, a target application object such as an application in a smart device or part of a function of an application can be set as a locked object. If an unlock trigger operation is detected for the target application object in the smart device, the camera device can be called to collect an environmental image of the environment in which the smart device is located. Then, data analysis is performed on the collected environmental image to obtain an analysis result. If the analysis result meets the unlocking condition set in advance for the target application object, then the target application object can be unlocked, so that the target application object can be successfully unlocked and used. It can be seen that in the present application, whether to unlock the target application object can be determined by analyzing the collected environmental image without the intervention of a third party. Therefore, the unlocking method is more efficient, and it can also meet the user's emergency use and rest time use of the terminal application, and the management of the terminal application object is more flexible. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following is a brief introduction to the drawings required for the description of the embodiments. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0030] Figure 1 This is a flowchart of an unlocking processing system provided by an embodiment of the present application;

[0031] Figure 2 This is a flowchart of a method for unlocking a terminal application provided by an embodiment of the present application;

[0032] Figure 3a This is a schematic diagram of an unlock prompt interface provided in an embodiment of the present application;

[0033] Figure 3b This is a schematic diagram of another unlock prompt interface provided in an embodiment of the present application;

[0034] Figure 3c This is a schematic diagram of another unlock prompt interface provided in an embodiment of the present application;

[0035] Figure 3d This is a schematic diagram of another unlock prompt interface provided in an embodiment of the present application;

[0036] Figure 4 This is a flowchart of another method for unlocking a terminal application provided by an embodiment of the present application;

[0037] Figure 5a This is a schematic diagram of an unlocking function initialization interface provided by an embodiment of the present application;

[0038] Figure 5b This is a schematic diagram of a lock function configuration interface provided in an embodiment of the present application;

[0039] Figure 5c This is a schematic diagram of an application unlocking interface provided by an embodiment of the application;

[0040] Figure 6 This is a flow chart of a data analysis process provided by an embodiment of the present application;

[0041] Figure 7a This is a schematic diagram of a process for obtaining a shooting distance provided in an embodiment of the present application;

[0042] Figure 7bThis is another flowchart of obtaining the shooting distance provided by an embodiment of the present application;

[0043] Figure 8 This is a flowchart of another method for unlocking a terminal application provided by an embodiment of the present application;

[0044] Figure 9 This is a schematic diagram of the structure of an unlocking processing device for a terminal application provided in an embodiment of the present application;

[0045] Figure 10 This is a schematic diagram of the structure of another unlocking processing device for terminal applications provided in an embodiment of the present application;

[0046] Figure 11 This is a schematic diagram of the structure of a smart device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0047] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0048] Through the unlocking processing method of the terminal application of the present application, the terminal application can be flexibly managed in scenarios such as schools, training classes, and even some special work. When a user intends to open some terminal application objects that are set as locked objects, the unlocking processing method of the terminal application of the present application can be executed. For example, during the period when students are studying in class, through the embodiments of the present application, on the one hand, certain application objects (such as electronic calculators, browsers) can be locked to prevent students from using calculators or search engines to assist in answering questions during class. On the other hand, during breaks such as after class or during training breaks, it can be determined through environmental data analysis that the current rest scene is in progress. These applications can be intelligently unlocked to facilitate students to use electronic calculators, search engines, etc., consolidate the knowledge learned during class, or facilitate trained users to handle some work affairs in a more timely manner. The content of this application is described below.

[0049] In order to better understand the embodiments of the present application, the following professional terms involved in the embodiments of the present application are introduced:

[0050] Artificial Intelligence (AI) refers to the theories, methods, techniques, and application systems that use digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, to perceive the environment, acquire knowledge, and use that knowledge to achieve optimal results. In other words, AI is a comprehensive technology within computer science that seeks to understand the essence of intelligence and produce new intelligent machines that can respond in a manner similar to human intelligence. AI also studies the design principles and implementation methods of various intelligent machines, enabling them to possess the capabilities of perception, reasoning, and decision-making.

[0051] Artificial intelligence (AI) technology is a comprehensive discipline encompassing a wide range of fields, encompassing both hardware and software technologies. Foundational AI technologies generally include sensors, specialized AI chips, cloud computing, distributed storage, large-scale functional testing, operating / interaction systems, and mechatronics. AI software technologies primarily encompass computer vision, speech processing, natural language processing, and machine learning / deep learning.

[0052] Artificial intelligence cloud services, also commonly referred to as AIaaS (AI as a Service), are a mainstream AI platform service model. Specifically, AIaaS platforms break down several common AI services and provide them as standalone or packaged services in the cloud. This service model is similar to an AI-themed marketplace: all developers can access one or more AI services provided by the platform through APIs. Experienced developers can also use the platform's AI framework and infrastructure to deploy and maintain their own cloud AI services.

[0053] The application unlocking method involved in this application can be encapsulated as an artificial intelligence service, with only one interface exposed. When the version function test of the product or application software involved in this application is required in a certain business scenario, by calling this interface, a camera can be called to capture environmental images of the environment in which the smart device is located. If the analysis result of the environmental image set including multiple environmental images meets the unlocking conditions, the target application object in the smart device is unlocked.

[0054] An embodiment of the present application provides an unlocking processing solution for terminal applications, and the unlocking processing solution proposes that: when a user triggers an unlocking operation on a target application object such as an application in a smart device, or a part of a function in a certain application, the shooting device of the smart device (such as a mobile phone camera) can be called to collect an environmental image of the environment in which the smart device is located. After performing data analysis on the environmental image set including multiple environmental images, an analysis result is obtained. If it is determined that the analysis result meets the unlocking condition of the target application object, the target application object is unlocked. That is, the state of the target application object in the locked state is switched to the unlocked state. Subsequently, the user can perform related business operations based on the unlocked target application object, such as performing search operations based on the unlocked search engine application, and performing calculation operations based on the unlocked electronic calculator.

[0055] The aforementioned analysis results may include: determining, based on an analysis of N environmental images, whether Q environmental images include static image objects that match reference image object features; and determining, based on an analysis of M environmental images, whether P environmental images among the M environmental images do not include dynamic image objects in their target image regions, either one or a combination of the two; N and Q are integers greater than or equal to 1, with Q less than or equal to N; and M and P are integers greater than 1, with P less than or equal to M. Reference image object features may be pre-set, for example, and include image features of teaching equipment commonly found in classrooms and training rooms, such as blackboards, whiteboards, and projection screens. For example, the image features of a blackboard include features such as a regular, approximately rectangular image region within a certain image area, including a large black center area and a border of other colors. By comparing the image features of the environmental image with one or more reference image object features, it is possible to determine whether the environmental image includes a static image object that matches the reference image object features.

[0056] The embodiments of the present application can be applied to the following scenarios: first, an anti-addiction locking function can be set for an application (Application, APP) or some functions in the application in a smart device, so that it is set as a locked object. A series of unlocking conditions must be met for the locked object before it can be unlocked. When, in the target business scenario, it is necessary to unlock the target application object (i.e., the locked object) for which the anti-addiction locking function is set, the unlocking operation of the target application object can be completed according to the action indicated by the unlocking condition corresponding to the anti-addiction locking function set for the target application object.

[0057] For example, the target business scenario is a classroom with a teacher lecturing at a podium with a fixed blackboard or whiteboard as the background. Using the phone's rear camera and built-in infrared proximity sensor to verify the teacher's presence, students are restricted from unlocking their phones during class, thereby preventing them from becoming addicted to certain apps and neglecting their studies. For example, if a student performs an action during class that meets the requirements for app unlocking, such as holding up their phone to take a long photo of the podium, the teacher and classmates will notice, blocking their initial path to unlocking the app. This prevents students from playing games during class, thereby improving teaching quality.

[0058] Through the embodiments of the present application, for scenarios such as students attending classes, training classes, or even some special work, when a user intends to open some objects that are set to be locked, the unlocking processing method for terminal applications of the present application can be executed. For example, during the period when students are studying in class, through the embodiments of the present application, on the one hand, certain application objects (such as electronic calculators, search engines, etc.) can be locked to prevent students from using electronic calculators or search engines to assist in answering questions during class. However, during breaks such as after class, these application objects can be intelligently unlocked through data analysis of the surrounding environment, making it convenient for students to use electronic calculators, search engines, etc., thereby consolidating the knowledge learned during class. For another example, during adult training classes, especially for some training scenarios with high confidentiality requirements, through the embodiments of the present application, some application objects (such as recording applications, video applications, etc.) can also be locked to prevent users from using recording applications or video applications to record or record during training, etc., which can avoid the leakage of some confidential files, images, or videos, etc.

[0059] Please refer to Figure 1 , Figure 1 1 is a schematic diagram of the architecture of an unlocking processing system provided in an embodiment of the present application. The unlocking processing system architecture includes a server 140 and a terminal device cluster, wherein the terminal device cluster may include terminal device 110, terminal device 120, terminal device 130, and so on. The terminal device cluster and server 140 may be connected directly or indirectly via wired or wireless communication, which is not limited in this application.

[0060] Figure 1The server 140 shown can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), as well as big data and artificial intelligence platforms.

[0061] Figure 1 The terminal devices 110, 120, and 130 shown may be mobile phones, tablet computers, laptop computers, PDAs, mobile internet devices (MIDs), vehicles, vehicle-mounted devices, roadside devices, aircraft, wearable devices such as smart watches, smart bracelets, pedometers, and other smart devices with unlocking functions.

[0062] In one possible implementation, taking the terminal device 110 as an example, first, an unlock trigger operation is detected for the target application object (such as an application, or part of the function in an application) in the terminal device 110. If the unlock trigger operation is detected, the shooting device is called to capture the environmental image of the environment in which the terminal device 110 is located.

[0063] In addition, during the process of collecting environmental images, the terminal device 110 can send the collected environmental images to the server 140 in real time. The server 140 can perform data analysis based on the environmental images sent back by the terminal device 110. If the analysis result of the data analysis of the collected environmental images by the server 140 meets the unlocking conditions, the server 140 can send a notification message to the terminal device 110, which is used to instruct the terminal device 110 to unlock the target application object. It can be seen that in this application, whether to unlock the target application object can be determined by analyzing the collected environmental images without the intervention of a third party. Therefore, the unlocking method is more efficient, and it can also meet the user's emergency use and rest time use of terminal applications, and the management of terminal application objects is more flexible.

[0064] The analysis results include: server 140 determining, based on analysis of N environmental images, whether Q environmental images contain static image objects that match the reference image object features; server 140 determining, based on analysis of M environmental images, whether P environmental images among the M environmental images do not contain dynamic image objects in the target image area, or any combination thereof. Of course, users can also customize unlocking conditions based on scenario requirements or user needs.

[0065] Of course, the operation of performing data analysis on the collected environmental image is not necessarily performed by the server 140, but can also be performed by the terminal device 110. The embodiment of the present application does not make specific limitations on this.

[0066] It can be understood that the system architecture diagram described in the embodiment of the present application is intended to more clearly illustrate the technical solution of the embodiment of the present application, and does not constitute a limitation on the technical solution provided by the embodiment of the present application. Ordinary technicians in this field can know that with the evolution of the system architecture and the emergence of new business scenarios, the technical solution provided by the embodiment of the present application is also applicable to similar technical problems.

[0067] The following is a detailed description of the unlocking solution for terminal applications proposed in the embodiment of the present application, with reference to the accompanying drawings. Figure 2 , Figure 2 This is a flowchart of a method for unlocking a terminal application provided by an embodiment of the present application. The unlocking method can be executed by a smart device, which can be a terminal device, a vehicle-mounted device, a roadside device, an aircraft, a wearable device, etc. The unlocking method can also be executed by a smart device and a server together. For ease of explanation, the embodiment of the present application takes the example of a smart device executing the unlocking method. Figure 2 As shown, the unlocking processing method for the terminal application may include steps S201 to S203, wherein:

[0068] S201: If an unlock triggering operation for a target application object in a smart device is detected, a photographing device is called to capture an environmental image of the environment in which the smart device is located.

[0069] In an embodiment of the present application, the target application object may be an APP running in a smart device, such as a game APP; the target application object may also be part of the functions in an APP, such as a game function in a game APP, etc. The embodiment of the present application does not make specific limitations on this.

[0070] In one possible implementation, in the target business scenario, the user can set an anti-addiction lock function for the target application object in advance. For example, the target business scenario is a class scenario, and the target application object can be a game application. In order to prevent students from becoming addicted to games during class, the student's parents or teachers can set an anti-addiction lock function for certain game applications before class. When a student's unlock trigger operation (such as a click operation) for a game application in a smart device (such as a mobile phone, tablet, etc.) is detected, the shooting device of the smart device (such as a mobile phone camera) can be called to collect the environmental image of the environment in which the smart device is located. In the class scenario, the collected environmental image can be an image of the surroundings of the classroom, such as a blackboard, whiteboard, projection screen, etc.

[0071] In another possible implementation, for adult training scenarios, especially those with high confidentiality requirements, in order to prevent confidential documents, images, or videos from being leaked, it is necessary to prohibit users from using some application objects such as recording applications and video applications during the training period, so that they are set as locked objects. During the training period, if a user triggers an unlock operation for a recording application in a smart device, the unlocking conditions set for the recording application in this application must be met before the recording application can be unlocked. This way, the leakage of confidential documents can be prevented as much as possible during the training period, while the normal use of application objects by users is not affected during non-training periods.

[0072] When the user calls the camera to capture real-time images of the environment in which the smart device is located, the user can shoot in either horizontal or vertical mode, which is not specifically limited in this embodiment of the application. It should be noted that in a classroom scenario, horizontal shooting can be prioritized to make it easier to capture images of the blackboard or whiteboard around the podium, thereby facilitating more accurate data analysis of the environmental images.

[0073] In one possible implementation, after detecting an unlock trigger operation for a target application object in a smart device, the trigger time of the unlock trigger operation can also be obtained. If the trigger time is within a preset time period, the target application object is kept in a locked state. If the trigger time is not within the preset time period, an operation is triggered to call a camera to capture an environmental image of the environment in which the smart device is located.

[0074] For example, in a classroom scenario, the trigger time for unlocking a game application can be determined first. If the time is within the class time period, the user is directly prohibited from unlocking the game. If the trigger time is not within the class time period, such as during recess, the user can unlock the game according to the unlocking conditions in the embodiments of this application. In this way, before calling the camera to capture an image of the environment in which the smart device is located, it is possible to determine whether the user has the authority to unlock the target object based on the trigger time.

[0075] In one possible implementation, the trigger time and a business schedule for the unlock trigger operation can also be obtained. The business schedule includes multiple business time periods and business identifiers corresponding to each business time period. Each business identifier indicates a business scenario. Then, based on the business schedule, the target business time period within which the trigger time falls is determined, and the target business scenario is determined based on the target business identifier corresponding to the target business time period. Finally, business management is performed on the target user identifier based on the target business scenario. The user corresponding to the target user identifier can be the triggerer of the trigger operation.

[0076] For example, in a class scenario, after determining the trigger time for the operation to unlock the game application, the course schedule (business schedule) can also be obtained. Then, based on the trigger time, it is determined whether it is a Chinese class, a math class, an English class, etc. Assuming it is determined to be a math class, the math teacher can be reminded to manage the math class, which may include increasing classroom control or improving the quality of classroom explanations, etc. Furthermore, the number of triggers can be obtained, and based on the number of triggers, targeted improvements and increased control measures can be made to the class quality, thereby improving the teaching quality in a targeted manner. For example, if there is only one student in the math class who needs to unlock the game, the math teacher can increase the course management measures in the math class later; if there are only 10 students in the math class who need to unlock the game, it can be considered that the course quality needs to be rectified, and the math teacher can improve the class quality in the math class later. In this way, the classroom quality and teaching quality can be improved in a targeted manner, thereby improving the teaching level.

[0077] In one possible implementation, the unlock trigger operation is generated based on the target user identifier, and the business schedule is searched and retrieved based on the unit information (e.g., school, grade, class, etc.) configured for the target user identifier on the unlock function initialization interface. The target user identifier can be the target user's nickname, name, ID number, etc., such as a student's student ID number or name, as long as it uniquely identifies the target user. The present embodiment of the application does not specifically limit the representation of the target user identifier. In a class scenario, the business schedule can be, for example, a class schedule, which can include multiple time periods and corresponding courses for each time period. For example, the time period of 8:00-9:00 is Chinese class; the time period of 9:00-10:00 is Math class; the time period of 10:00-11:00 is English class, and so on. Of course, the class schedules of different schools, grades, and classes can be different. Therefore, the corresponding business schedule can be obtained based on the unit information of the target user identifier.

[0078] S202: Perform data analysis during the process of collecting environmental images.

[0079] In the process of calling the camera of the smart device to collect environmental images in real time, an environmental image set consisting of multiple environmental images can be obtained. Then, the smart device can perform data analysis on the environmental images in the environmental image set.

[0080] In one possible implementation, data analysis of an environmental image set may include: first, extracting key frames from a camera to capture environmental images of the environment surrounding the smart device to form an environmental image set. Then, performing image feature segmentation on each of the N environmental images in the environmental image set to obtain segmented image features for each of the N environmental images. Finally, performing hierarchical matching analysis between the segmented image features of each environmental image and reference image object features to determine whether any static image objects match the reference image object features.

[0081] The N environmental images in the environmental image set may be all or part of the environmental images in the set, and this is not specifically limited in the present embodiment. For example, in a classroom scene, the reference image object features may be features such as the dark green background of a blackboard or the metal frame of a whiteboard, and the static image object may be an image of a blackboard, whiteboard, or podium, such as a projection screen.

[0082] In another possible implementation, performing data analysis on the environmental image set may further include: first, extracting key frames during the process of calling a camera to capture environmental images of the environment in which the smart device is located to form the environmental image set. Then, performing image region segmentation processing on each of the M environmental images in the environmental image set to obtain a segmented image region for each of the M environmental images. Finally, performing living object analysis on a target image region within each segmented image region to determine whether the target image region includes a dynamic image object.

[0083] Among them, the M environmental images in the environmental image set can be all the environmental images in the set, or the M environmental images can be part of the environmental images in the set. This embodiment of the present application does not specifically limit this. For example, taking the classroom scene as an example, the living object analysis includes but is not limited to: face recognition, motion object recognition, etc. The dynamic image object can be a teacher, a classmate, etc. For example, in the embodiment of the present application, it is necessary to determine whether the teacher is teaching in the classroom scene, that is, it is necessary to perform liveness detection on the teacher. Therefore, after obtaining the environmental image set, the living image can be analyzed using liveness detection technology to determine whether the target image area includes a dynamic image object (such as a teacher). Among them, liveness detection technology can include but is not limited to: face liveness detection, the principle of which is mainly to verify liveness by texture recognition of the facial expression of the living object; of course, when the teacher is teaching from the back (such as writing with his back to the blackboard), the motion information can be combined to determine whether the target image area includes a dynamic image object, such as using variable focus analysis to check the change in pixel values ​​between two consecutive frames (environmental images) to determine the person performing the back action, etc.

[0084] S203: If the analysis result of the data analysis meets the unlocking condition, the target application object is unlocked.

[0085] In the embodiment of the present application, the analysis result of the data analysis includes: determining, based on the analysis of N environmental images, whether Q environmental images include a static image object that matches the reference image object feature; determining, based on the analysis of M environmental images, whether P environmental images do not include a dynamic image object in the target image area; or a combination of the two;

[0086] The first unlocking condition is determined to be satisfied when, based on an analysis of N environmental images, Q environmental images contain a static image object that matches the reference image object feature. N and Q are integers greater than or equal to 1, and Q is less than or equal to N.

[0087] When it is determined based on the analysis of M environmental images that the target image area of ​​P environmental images does not include a dynamic image object, the second condition of the unlocking condition is determined to be satisfied, where M and P are integers greater than 1, and P is less than or equal to M.

[0088] In one possible implementation, a shooting distance between the smart device and an environmental object in the environment in which the smart device is located may also be obtained. The analysis result may further include: whether the shooting distance is greater than or equal to a preset distance threshold; wherein the analysis result satisfying the unlocking condition may further include: if the shooting distance is greater than or equal to the preset distance threshold, determining that the third condition of the unlocking condition is satisfied.

[0089] In one possible implementation, the duration of the capture time of the environmental image set acquired by the capture device may also be obtained. The analysis result may further include determining whether the capture time is greater than or equal to a preset time threshold. The analysis result satisfying the unlocking condition may further include determining that the fourth unlocking condition is satisfied if the capture time is greater than or equal to the preset time threshold.

[0090] It should be noted that, for the first, second, third, and fourth conditions mentioned above, the smart device can be unlocked only when all four are met, or the smart device can be unlocked only when one or more of the conditions are met. These conditions can be set as needed, so that the degree of conditional restrictions for unlocking the smart device can be further adjusted.

[0091] The embodiment of the present application takes the business scenario of a class scenario as an example and the target application object as an example of a game application, and describes in detail the process of performing data analysis on the collected environmental images in the embodiment of the present application.

[0092] If a user needs to unlock a game, the following four conditions must be met for successful unlocking:

[0093] 1. Use a camera (such as a mobile phone camera) to shoot horizontally, and the captured content is successfully identified as a blackboard or whiteboard background. Of course, in addition to horizontal shooting, vertical shooting is also possible. In the embodiment of the present application, horizontal shooting can be given priority because it is easier to capture a complete image of the environment, thereby more accurately identifying the podium image such as a blackboard, whiteboard, projection screen, etc.

[0094] 2. The distance between the photographer and the podium must be greater than or equal to the preset distance threshold (such as 2 meters), and the camera focus and zoom function must be disabled to prevent students from unlocking the blackboard by taking static videos.

[0095] 3. Living people (such as teachers) cannot be detected during the shooting process.

[0096] 4. When all three conditions are met, a timer starts. The timer must be longer than or equal to a preset threshold (e.g., 5 seconds), and no live person is detected during the timer, for the unlock to complete. The timer duration can be flexibly set to prevent students from briefly holding up their phones to pretend to take photos of courseware.

[0097] In one possible implementation, after the smart device uses a camera to capture an image of the environment in which the smart device is located, an unlock prompt interface may be displayed. The unlock prompt interface displays the captured image and unlock condition prompt information according to a first display rule. If the result of data analysis of the environmental image set meets the unlock condition, the unlock condition prompt information is displayed on the unlock prompt interface according to a second display rule. The unlock condition prompt information is displayed differently under the first and second display rules.

[0098] Displaying the unlock condition prompt information in accordance with the first display rule in the unlock prompt interface may include: displaying the unlock condition prompt information in accordance with the first color and the first condition mark indicated by the first display rule. Displaying the unlock condition prompt information in accordance with the second display rule in the unlock prompt interface may include: displaying the unlock condition prompt information in accordance with the second color and the second condition mark indicated by the second display rule. The first color and the second color may be different, such as the first color is gray and the second color is green; the first condition mark and the second condition mark may be different, such as the first condition mark is an "×" symbol and the second condition mark is a "√" symbol. In addition, the unlock condition prompt information includes: timing prompt information; the timing prompt information includes timing text information and a timing progress icon indicating the elapsed shooting time.

[0099] See Figure 3a , Figure 3aThis is a schematic diagram of an unlock prompt interface provided by an embodiment of the present application. Figure 3a As shown, Figure 3a The unlock prompt interface in the present embodiment displays an environment image S310 captured in real time by a camera, and unlock condition prompt information S3101 corresponding to the process of capturing the environment image S310 by the camera. The unlock condition prompt information S3101 is displayed according to a first display rule. The unlock condition prompt information S3101 may be displayed using a first color and a first condition mark indicated by the first display rule. Furthermore, there may be one or more first condition marks, each of which may correspond to a display text, and the two may be used together to indicate whether an unlock condition is satisfied (e.g., one first condition mark and corresponding display text may indicate whether the first condition of the unlock condition is satisfied; another first condition mark and corresponding display text may indicate whether the second condition of the unlock condition is satisfied; and so on. The unlock condition prompt interface may include as many first condition marks as there are unlock conditions). For example, the first condition mark may be a symbol, such as "×", and the displayed text may be: "The blackboard / whiteboard on the podium is not recognized"; when the first condition is marked as "×", the displayed text may be: "The obstacle in front is less than 2 meters"; when the first condition is marked as "×", the displayed text may be: "A living person is recognized"; when the first condition is marked as "×", the displayed text may be: "The timing is not turned on". Among them, when the first condition is marked with the symbol "×", it can be used to indicate that the unlocking condition is not met, and when the first condition is marked with the symbol "√", it can be used to indicate that the unlocking condition is met. In addition, the unlocking condition prompt information may also include: timing prompt information; the timing prompt information includes timing text information and a timing progress icon about the shooting time. Such as Figure 3a Finally, in the embodiment of the present application, if the unlock prompt interface includes the symbol "×", it can be considered that the unlock condition is not met, and the unlock prompt interface will display the icon "Unmet unlock condition" (3103).

[0100] Furthermore, if the analysis results after data analysis meet the unlocking conditions, the unlocking condition prompt information is displayed on the unlocking prompt interface according to the second display rule, and the display method of the unlocking condition prompt information is different under the first display rule and the second display rule. The different display methods under the first display rule and the second display rule may include, but are not limited to, one or more of the following situations: the first condition mark and the second condition mark are different, and the display text is different. Furthermore, the difference between the first condition mark and the second condition mark may include one or both of the symbol and color of the first condition mark being different from the symbol and color of the second condition mark being different, and the difference in display text may also include one or both of the content and color of the display text displayed under the first display rule and the second display rule being different.

[0101] See Figure 3b , Figure 3b This is a schematic diagram of another unlock prompt interface provided by an embodiment of the present application. Figure 3b As shown, Figure 3b The unlock prompt interface in the displays the environment image S311 captured by the camera in real time, and the unlock condition prompt information S3111 corresponding to the process of the camera capturing the environment image S311. The unlock condition prompt information S3111 may include information displayed in a first color and a first condition mark according to the first display rule, and information displayed in a second color and a second condition mark according to the second display rule. Specifically, the first condition mark under the first display rule may be the symbol "×", and the second condition mark under the second display rule may be the symbol "√", as shown in FIG. Figure 3b It can be seen that when the second condition is marked as "√", the displayed text may be: "Blackboard / whiteboard on the podium is recognized"; when the second condition is marked as "√", the displayed text may be: "Obstacles ahead are greater than 2 meters"; when the second condition is marked as "√", the displayed text may be: "No living person is recognized"; when the first condition is marked as "×", the displayed text may be: "The timing reaches 5s". In addition, the unlocking condition prompt information may also include: timing prompt information; the timing prompt information includes timing text information and a timing progress icon about the shooting time. Figure 3b As can be seen from the above, since all unlocking conditions are not met, the icon (3113) of "Unmet Unlocking Conditions" may be displayed in the unlocking prompt interface.

[0102] See Figure 3c , Figure 3c This is a schematic diagram of another unlock prompt interface provided by an embodiment of the present application. Figure 3c As shown, Figure 3cThe unlock prompt interface in the is displayed with the environment image S312 acquired in real time by the shooting device, and the unlock condition prompt information S3121 corresponding to the process of the shooting device acquiring the environment image S312, wherein the unlock condition prompt information S3121 may be displayed in the second color and the second condition mark indicated by the second display rule. Specifically, when the second condition mark is "√", the displayed text may be: "Blackboard / whiteboard on the podium is recognized"; when the second condition mark is "√", the displayed text may be: "Obstacles ahead are greater than 2 meters"; when the second condition mark is "√", the displayed text may be: "No living person is recognized"; when the second condition mark is "√", the displayed text may be: "The timing reaches 5s". In addition, the unlock condition prompt information may also include: timing prompt information; the timing prompt information includes timing text information and a timing progress icon about the shooting time. As Figure 3c The "5S" and the timer progress icon (3122) are shown in the figure. As can be seen from the above, since all unlocking conditions have been met, the "Successfully Unlocked" icon (3123) can be displayed in the unlock prompt interface. It should be noted that the display methods of the icons corresponding to successful unlocking and unsuccessful unlocking can also be different. For example, if the unlocking is unsuccessful, the icon can be displayed in gray; if the unlocking is successful, the icon can be displayed in green, etc.

[0103] In one possible implementation, when the captured time is less than a preset time threshold, it is determined whether the data analysis result meets the re-timing condition. If so, the corresponding captured time during the capture of the new environmental image by the camera is re-counted starting from the current moment. Whether the data analysis result meets the re-timing condition includes any one or a combination of the following factors:

[0104] When it is determined based on the analysis of the collected environment image that no static image object matching the reference image object feature is included, it is determined that the retiming condition is met.

[0105] When it is determined based on the analysis of the collected environment image that a dynamic image object is included, it is determined that the re-timing condition is satisfied.

[0106] When the acquired shooting distance between the smart device and the environmental object in the environment where the smart device is located is less than a preset distance threshold, it is determined that the re-timing condition is met.

[0107] As can be seen from the above, when all four unlocking conditions are met, the user can unlock the target application object. For example, when the class is over and there is no teacher on the podium, students can unlock the target function or game on their own. In addition, if the above unlocking conditions cannot be met at the same time, or if one of the unlocking conditions is not met during the timer, the timer will restart, the user will not be able to complete the unlocking, and a failure prompt will be displayed. Please refer to Figure 3d , Figure 3d is a schematic diagram of another unlock prompt interface provided by an embodiment of the present application. Similarly, the unlock prompt interface displays an environmental image S313 captured in real time by a camera, as well as unlock condition prompt information S3131 corresponding to the process of the camera capturing the environmental image S313. It can be seen that the unlock condition prompt information includes that if a living person is detected (3132) during the timing period, the timer will be restarted and the display state of the unlock condition prompt information will be switched, including a timing progress icon (3133) indicating the duration of the recording. For example, when the second condition is marked as "√", the displayed text may be: "Blackboard / whiteboard on the podium is recognized"; when the second condition is marked as "√", the displayed text may be: "Obstacle ahead is greater than 2 meters"; when the first condition is marked as "×", the displayed text may be: "Living person is recognized"; when the first condition is marked as "×", the displayed text may be: "Timer reaches 5 seconds". As can be seen from the above, since all unlock conditions are not met, the "Unlock conditions not met" icon (3133) may be displayed in the unlock prompt interface.

[0108] It should be noted that the above examples are based on the requirement to meet all the conditions in the unlocking conditions (including the first condition, the second condition, the third condition and the fourth condition) at the same time. Of course, in different business scenarios, it is also possible to meet one or more of the unlocking conditions. For example, it is only necessary to meet the first and second conditions in the unlocking conditions at the same time; for example, it is only necessary to meet the first, second and third conditions in the unlocking conditions at the same time, and so on. In addition, the unlocking conditions can be customized according to user needs or scenario requirements. For example, the user can add a condition as the fifth condition in the unlocking conditions, and these five unlocking conditions need to be met at the same time to unlock the target application object, etc. Among them, the fifth condition can also be adaptively set according to different business scenarios, and the embodiments of the present application do not make specific limitations on this.

[0109] In an embodiment of the present application, a target application object, such as an application or a portion of an application's functions, in a smart device can be set as a locked object. If an unlock trigger operation is detected for the target application object in the smart device, a camera can be called to capture an environmental image of the smart device's environment. The captured environmental image is then analyzed to obtain an analysis result. If the analysis result meets the unlock conditions set for the target application object, the target application object can be unlocked, allowing the target application object to be successfully unlocked and used. For example, in a special scenario during class, where a teacher is lecturing at a podium with a fixed blackboard or whiteboard background, the mobile phone's rear camera and built-in infrared distance sensor can be used to verify the teacher's presence, thereby restricting students from unlocking their phones. As can be seen, in this application, whether to unlock the target application object can be determined by analyzing the captured environmental image, without the need for third-party intervention. This makes the unlocking method more efficient, and the captured environmental image can be automatically analyzed, allowing intelligent environmental analysis to complete the unlocking process. Furthermore, the present embodiment can also meet users' needs for emergency and rest time use of terminal applications, providing more flexible management of terminal application objects.

[0110] The embodiment of the present application can be applied to functions or application startup interfaces (such as game startup interfaces) that require anti-addiction locking. Next, the unlocking processing method for terminal applications provided by the embodiment of the present application is described in detail using the game application in the classroom scenario as an example. Figure 4 , Figure 4 This is a flowchart of another unlocking processing method for terminal applications provided by an embodiment of the present application. The unlocking processing method can be executed by a smart device, which can be a terminal device, a vehicle-mounted device, a roadside device, an aircraft, a wearable device, etc. The unlocking processing method can also be executed by a smart device and a server together. For ease of explanation, the embodiment of the present application takes the unlocking processing method executed by a smart device as an example. Figure 4 As shown, the unlocking processing method for the terminal application may include steps S401 to S403, wherein:

[0111] S401: Displaying the application unlocking interface.

[0112] In one possible implementation, first, in response to the lock configuration operation of the lock function interface for the target user identifier, the unlock function initialization interface is displayed, and the unlock function initialization interface includes at least one or more of the following options: gender, age, school, height, target application object, and any option is used to indicate the entry of the user basic information corresponding to any of the options. Then, the user basic information entered in the unlock function initialization interface is obtained, and the user basic information includes the target application object identifier. Finally, after obtaining one or more user basic information, the target application object corresponding to the target application object identifier is determined as the locked object, so that when the unlock trigger operation for the target application object in the smart device is detected, the application unlock interface is displayed.

[0113] It should be noted that in the embodiment of the present application, the locked object can be a user-defined setting in advance in the unlock function initialization interface, for example, the user can select some applications as locked objects in the unlock function initialization interface. In addition, the locked object can also be automatically matched by the system according to the target user identifier. Specifically, the application objects installed in the smart terminal can be screened and matched according to the user type corresponding to the target user identifier, and the locked objects that are allowed to be locked under the user type corresponding to the target user identifier are determined from the application objects installed in the smart terminal. For example, after detecting the unlock trigger operation for the target application object in the smart device, the target user identifier of the trigger of the unlock trigger operation is obtained. If the target user identifier indicates that the trigger is a student, the locked object can be an application object such as a game application, an electronic calculator, or a search engine to prevent students from using these application objects during class, thereby interfering with the course learning. For another example, if the target user identifier obtained indicates that the trigger is a social worker (such as in an adult training scenario), the locked object can be an application object such as a recording APP or a screen recording APP to prevent users from using these application objects to leak important files, images, etc. during training.

[0114] For example, see Figure 5a , Figure 5a This is a schematic diagram of an unlocking function initialization interface provided by an embodiment of the present application. After starting the game application, the user can log in to the user interface (S10) of the application, in which various application functions of the application can be displayed, including the "Home" function (101), the "Game" function (102), the "Message" function (103), the "Benefit" function (104) and the "My" function (105). If the user clicks the "My" function (105), the user interface S10 can be switched to the "Personal Center" user interface S20. Figure 5aAs shown in the user interface S20 in the figure, the user interface S20 may include a lock function during class, which can be applied to business scenarios such as class scenes, meeting scenes, and lecture scenes that need to be used to prevent users from being addicted to games. The lock function during class can include an opening control (201). Taking the class scene as an example, if the user clicks (which may include single-click, double-click, or long-press operations) the opening control 201, the lock function during class is turned on. Furthermore, if the user uses the "lock function during class" for the first time, the user interface is switched from S20 to interface S30. Interface S30 refers to the interface for initializing the lock function during class. In this interface, an initialization menu bar may be included. The initialization menu bar may include multiple options: such as "gender" option (301), "age" option (302), "school" option (303), "height" option (304), "frequently played applications" option (305), etc. The above options are used to instruct the user to fill in personal basic information into the corresponding options, so that the background can record and save the personal basic information entered by the user.

[0115] Further, see Figure 5b , Figure 5b This is a schematic diagram of a lock function configuration interface provided by an embodiment of the present application. Figure 5b As shown, the user enters the corresponding personal basic information in the corresponding option bar, such as "male" in the gender option, "12" in the age option, "Shenzhen Experimental Middle School, Grade 7" in the "school" option, "164cm" in the height option, and "Game A and Game B" in the frequently played games option (which means that Game A and Game B also have the lock function turned on during class). After all options have been entered with the relevant personal basic information, a prompt pop-up window (306) may pop up. The prompt pop-up window 306 is used to prompt the user whether to save the entered personal basic information. That is, the prompt pop-up window 306 may include a confirmation control 3061 and a return control 3062. If the user clicks the confirmation control 3061, the background records and saves the user's settings, and the user's personal basic information is associated with the user and saved.

[0116] Next, after completing the settings, the user enters any target application object (including a game application and some functions of a game application, etc.) that has completed the account (such as the target user ID) binding. Figure 5c , Figure 5c This is a schematic diagram of an application unlocking interface provided by an embodiment of the application. Figure 5cAs shown, first, the user can enter the user interface (S501) of the target application object (such as Game A). The user interface S501 includes an opening control (5011). As mentioned above, Game A has already enabled the lock function during class. Therefore, when the user clicks the opening control 5011 in the user interface S501, the interface S501 can be switched to the interface S502. Among them, the interface S302 displays a prompt pop-up window (5022), which is used to prompt Game A that the lock function during class has been enabled. The prompt pop-up window 5022 can also include unlocking operation prompt information, which is used to prompt the user to complete the unlocking of Game A according to the operation indicated in the prompt pop-up window 5022. For example, the unlocking operation prompt information may include: 1. Please enable the shooting permission in the system; 2. Rotate to landscape mode and take a picture of the podium; 3. Please follow the instructions on the screen.

[0117] S402: When an unlock trigger event is detected in the application unlock interface, an unlock prompt interface is displayed, where the captured environment image is displayed, and unlock condition prompt information is displayed according to a first display rule.

[0118] In a possible implementation, the application unlocking interface includes an unlocking control (such as Figure 5a The control 5023 shown in the figure) and the unlock operation prompt information (including: 1. Please turn on the shooting permission in the system; 2. Rotate to landscape mode and take a picture of the podium; 3. Please follow the instructions on the screen). When the unlock control 5023 is triggered, it is determined that the unlock trigger event is detected.

[0119] For example, the unlock prompt interface may include but is not limited to the following: Figure 3a-3d The interface schematic diagram of the unlock prompt interface shown is not repeated here for the schematic diagram of each unlock prompt interface.

[0120] S403: If the analysis result after data analysis of the collected environmental image meets the unlocking condition, the unlocking condition prompt information is displayed on the unlocking prompt interface according to the second display rule. The display method of the unlocking condition prompt information is different under the first display rule and the second display rule.

[0121] In one possible implementation, when an unlock trigger event is detected in the application unlock interface, a camera is activated to capture an image of the smart device's surroundings. Data analysis is then performed during the image capture process. Finally, if the analysis results meet the unlock conditions, the target application object is unlocked.

[0122] Displaying the unlock condition prompt information according to the first display rule includes displaying the unlock condition prompt information according to the first color and the first condition mark indicated by the first display rule. Displaying the unlock condition prompt information according to the second display rule includes displaying the unlock condition prompt information according to the second color and the second condition mark indicated by the second display rule. The first color and the second color are different, and the first condition mark and the second condition mark are different. The unlock condition prompt information includes timing prompt information, which includes timing text information and a timing progress icon indicating the elapsed shooting time.

[0123] For example, the difference in display mode under the first display rule and the second display rule may include, but is not limited to, one or more of the following: the first conditional marker and the second conditional marker are different, and the displayed text is different. Furthermore, the difference between the first conditional marker and the second conditional marker may include one or both of the symbol and color of the first conditional marker being different from the symbol and color of the second conditional marker being different. The difference in displayed text may also include one or both of the content and color of the displayed text being different under the first display rule and the second display rule being different.

[0124] In an embodiment of the present application, a locking function can be set in advance for a target application object, including a certain application or some functions in a certain application. Therefore, in the target business scenario, if a user wants to use the target application object, he or she needs to unlock it according to the unlock prompt information before unlocking the target application object. At the same time, it can also meet the user's emergency use and rest time use of terminal applications, and the management of terminal application objects is more flexible. In the teaching scenario, the situation of students being addicted to games during class can be controlled according to local conditions, and the bad habit of students playing games in class can be avoided to a large extent, thereby improving the quality of class and teaching.

[0125] Based on the above analysis, the following is a detailed description of the technical implementation of data analysis in the process of collecting environmental images by smart devices. For the sake of convenience, this application embodiment uses classroom scene image recognition as an example. Figure 6 , Figure 6 This is a flow chart of a data analysis process provided by an embodiment of the present application, wherein: Figure 6 An embodiment may be Figure 2 A specific embodiment of step S202. Figure 6 As shown, Figure 6 It can be executed by a smart device, wherein the smart device includes a shooting device and a background. Figure 6 As shown, the data analysis method may include steps S601 to S607, wherein:

[0126] S601: Real-time shooting of the podium image.

[0127] In this application, if a user triggers an unlock operation on a target application object in a smart device, a camera is called to capture an image of the environment in which the smart device is located. In a classroom scenario, the smart device can be a student's mobile phone, the camera can be the phone's camera, the phone's environment can be a classroom, and the captured image can be a screen of the podium. The screen of the podium can include a blackboard, whiteboard, projector, etc.

[0128] S602: Return the corresponding video.

[0129] In specific implementation, the shooting device can send the video collected after real-time shooting to the mobile phone background.

[0130] S603: Extract video key frames and perform image preprocessing.

[0131] In one possible implementation, after receiving the video from the camera, the backend can extract key frames from the video to form an environmental image set consisting of multiple environmental images. The environmental images in the environmental image set are then preprocessed. This preprocessing can include enhancement, noise reduction, normalization, and other processes, such as increasing useful information in the environmental images, reducing noise, and normalizing the data.

[0132] S604: Image feature segmentation.

[0133] In a specific implementation, color image feature segmentation processing is performed on N environmental images in the environmental image set, and image features of each environmental image in the N environmental images after segmentation can be obtained.

[0134] S605: Feature extraction and selection.

[0135] In specific implementation, the image features after segmentation processing (including extracting the dark green background of the blackboard, the metal frame of the whiteboard, etc.) can be subjected to hierarchical matching analysis to obtain the image features after feature extraction.

[0136] S606: Classification decision.

[0137] In specific implementations, the extracted image features can be subjected to classification and decision-making processing. Furthermore, machine training can be used to enhance the recognition accuracy of specific scenes and features. The classification and decision-making process can include performing hierarchical matching analysis between the segmented image features of each environmental image and the reference image object features to determine whether there are static image objects that match the reference image object features.

[0138] It should be noted that in the embodiments of the present application, the reference image features may include features such as the dark green background of a blackboard or the metal frame of a whiteboard. Matching with the reference image object features requires that the environmental image includes all of the reference image object features, thereby determining that the reference image object features match the reference image object features and confirming that a static image object matching the reference image object features exists in the environmental image. If only a portion of the reference image features are included, the reference image object features are considered not to match.

[0139] S607: Identification result.

[0140] Based on the above analysis, by performing a hierarchical matching analysis between the segmented image features of each environmental image and the object features of the reference image, the recognition result of each of the N environmental images can be determined. The recognition result includes whether there is a static image object that matches the object features of the reference image. The N environmental images can be all or a portion of the environmental images in the set of environmental images captured by the camera, and this is not specifically limited in this embodiment of the application.

[0141] Furthermore, if scene recognition is successful, that is, if, based on the analysis of N environmental images, Q environmental images are determined to include static image objects that match the reference image object features, then the first unlocking condition is determined to be satisfied. For example, in a classroom, if, after analyzing 10 captured environmental images, it is determined that all 10 images include a complete blackboard, whiteboard, projection screen, or other objects unique to a classroom environment, then the first unlocking condition is determined to be satisfied. If the first unlocking condition is not satisfied, verification continues until the first unlocking condition is satisfied or the user exits the process. Where Q is less than or equal to N.

[0142] Similarly, image region segmentation can be performed on each of the M environmental images in the environmental image set to obtain a segmented image region for each of the M environmental images. Then, live object analysis is performed on the target image region within each segmented image region to determine whether the target image region contains a dynamic image object. If, based on the analysis of the M environmental images, it is determined that the target image region of P environmental images does not contain a dynamic image object, the second condition of the unlocking condition is determined to be satisfied. A dynamic image object is an active detection object, such as a teacher. Liveness detection is used to determine whether the target image region, where a blackboard, whiteboard, or projection screen is located, contains a living object, such as a teacher. If the teacher is not included, the second condition is satisfied. If the teacher is included, the teacher may still be lecturing or taking an exam, making it unsuitable to unlock the locked object. If the second condition of the unlocking condition is not satisfied, verification continues until the second condition of the unlocking condition is satisfied or the user exits the process. The M environmental images can be all or a portion of the environmental images in the environmental image set captured by the camera. P is less than or equal to M, and M and N can be equal or unequal.

[0143] Next, how to obtain the shooting distance between the smart device and the environmental objects in the environment where the smart device is located is described in detail. In one possible implementation, obtaining the shooting distance between the smart device and the environmental objects in the environment where the smart device is located may include:

[0144] The shooting distance between the smart device and the surrounding objects in the smart device's environment is obtained through a distance sensor. For example, if the smart device has a built-in distance sensor, the shooting distance can be directly obtained by calling the distance sensor. Distance sensors may include, but are not limited to, infrared distance sensors (P-sensors), pulsed laser rangefinders, and ultrasonic sensors.

[0145] Among them, the principles of infrared distance sensors, pulsed laser rangefinders, and ultrasonic sensors are similar, all of which calculate distance by the time difference between the emitted light or sound waves and the return trip. Figure 7a , Figure 7a This is a schematic diagram of a process for obtaining shooting distance provided by an embodiment of the present application. This embodiment of the present application uses an infrared distance sensor as an example to illustrate obtaining shooting distance: After the user starts the process, the infrared distance sensor emits infrared light at a blackboard to measure the distance, dynamically transmitting distance data D back to the main judgment logic. After distance data D is applied to the main logic, real-time distance data is quickly acquired.

[0146] In another possible implementation, obtaining the shooting distance between the smart device and an environmental object in the smart device's environment may include: first, when, based on an analysis of N environmental images, it is determined that Q environmental images include a static image object that matches features of a reference image object, obtaining the original width of the environmental object in the smart device's environment and obtaining a focal length from shooting parameters of a camera. Then, obtaining the pixel width of the static image object from the captured environmental image. Finally, determining the shooting distance based on the original width, pixel width, and focal length.

[0147] It should be noted that in a classroom scenario, the environmental objects in the environment of the smart device may include a blackboard, classmates in the front row, etc. In the embodiment of the present application, if the environmental image captured by the shooting device includes both dynamic image objects and static image objects, for example Figure 3a As shown, if the environment image includes students in the front row and the blackboard, the unlock condition can be directly determined to be unsatisfied. In other words, only when the entire blackboard, whiteboard, and projector are captured can the first unlock condition be considered met. The shooting distance is then calculated based on the distance between the phone and the blackboard.

[0148] In specific implementation, if some smart devices (such as low-end mobile phones) do not have a distance sensor installed or the distance sensor permission is not enabled, the smart device may not be able to obtain the shooting distance through the distance sensor. Therefore, the shooting distance between the photographer and the blackboard can be roughly estimated based on the actual width of the blackboard. Figure 7b , Figure 7b This is another flow chart of obtaining the shooting distance provided by the embodiment of the present application. Figure 7b As shown in the figure, according to the pinhole imaging principle, D = (W × F) / P, where W is the width of the blackboard, F is the focal length of the mobile phone lens, and P is the imaging width of the blackboard in the environment image. Moreover, W, F, and P are all available data.

[0149] Blackboard width W: Based on conventional teaching blackboard designs, the width of a single blackboard unit is approximately 100cm to 120cm. Phone lens focal length F: This can be obtained from the device's camera parameters. Blackboard pixel width P: This can be obtained by framing the imaged blackboard width through image recognition. As can be seen from the above, the shooting distance D between the smart device and the surrounding objects in its environment = (blackboard width W × lens focal length F) / blackboard pixel width P.

[0150] Through the above analysis, regardless of the model or device type of the smart device, the shooting distance between the smart device and the environmental objects in the environment where the smart device is located can be obtained through the corresponding method. Therefore, the method in the embodiment of the present application can be compatible with more models of smart devices and has a higher universality.

[0151] Based on the above analysis, the principle of the unlocking processing solution for terminal applications provided by the embodiment of this application will be further explained below. Figure 8 , Figure 8 This is a flow chart of another method for unlocking terminal applications provided by an embodiment of the present application. This method for unlocking terminal applications can be executed by a smart device. Figure 8 As shown, the unlocking processing method for the terminal application may include steps S601 to S807, wherein:

[0152] S801: The user clicks to start unlocking and activates the camera.

[0153] In a possible implementation, if an unlock trigger operation for a target application object in a smart device is detected, a camera is called to capture an image of the environment in which the smart device is located. Figure 5c As shown, after the user clicks the "Start Unlocking" control, the smart device activates the camera to start capturing the environmental image of the environment where the smart device is located in real time, and the zoom and focus functions are disabled during the shooting process.

[0154] S802: The camera transmits the video in real time and turns on the distance sensor.

[0155] S803: Determine whether the three unlocking conditions are met simultaneously.

[0156] In an embodiment of the present application, the three unlocking conditions correspond to three devices respectively. These three devices include a classroom scene recognition device, a human liveness detection device, and a distance recognition device. Each device is used to judge an unlocking condition. Specifically, the classroom scene recognition device is used to judge whether the first condition in the unlocking condition is met. When it is determined based on the analysis of N environmental images that Q environmental images include static image objects that match the reference image object features, the classroom scene recognition device determines that the first condition in the unlocking condition is met. The human liveness detection device is used to judge whether the second condition in the unlocking condition is met. When it is determined based on the analysis of M environmental images that the target image area of ​​P environmental images does not include dynamic image objects, the human liveness detection device determines that the second condition in the unlocking condition is met. The distance recognition device is used to judge whether the third condition in the unlocking condition is met. If the shooting distance between the smart device and the environmental object in the environment where the smart device is located is greater than or equal to the preset distance threshold, the distance recognition device determines that the third condition in the unlocking condition is met.

[0157] In one possible implementation, the number and specific rules of unlocking conditions can be customized based on user needs. For example, in certain business scenarios, only some of the unlocking conditions may be met to unlock the target application object, such as only the first and second conditions need to be met. Alternatively, a certain number of unlocking conditions can be added based on scenario requirements, such as adding a fifth unlocking condition to the present embodiment, requiring all five unlocking conditions to be met simultaneously in order to unlock the target application object. This is not specifically limited in the present embodiment.

[0158] S804: The timer determines the unlocking time.

[0159] In specific implementation, when the shooting content meets the following three scenarios at the same time: 1. the shooting scene is identified as a teacher's podium, 2. there is no teacher on the podium, 3. the distance between the student and the blackboard D ≥ 2m, the timer can be started.

[0160] S805: Successfully unlocked, returning to the front desk successfully unlocked status.

[0161] In specific implementations, the target application object is successfully unlocked when the timer reaches the preset duration threshold. The preset duration threshold can be customized based on user needs or scenario requirements, for example, setting the preset duration threshold to 5 seconds. If all three unlock conditions are met simultaneously, when the timer reaches 5 seconds, it indicates that all unlock conditions have been met, and a successful unlock result is returned to the foreground.

[0162] S806: Continue identification until the unlocking condition is met or the user exits the process.

[0163] In specific implementation, if any of the three unlocking conditions is not met, that is, if the three unlocking conditions are not met at the same time, the smart device needs to call three devices (classroom scene recognition device, human liveness detection device, and distance recognition device) to continuously identify the three unlocking conditions respectively until all the unlocking conditions are met at the same time, or the user exits the process.

[0164] S807: Stop the timer and restart, and pop up a prompt.

[0165] In specific implementation, if the three unlocking conditions are met at the same time, within five seconds after the timer is started, if one of the unlocking conditions cannot be met, a prompt can be popped up, the timer will be terminated, and the timer will be restarted.

[0166] The technical solution of this application can be used to restrict students from unlocking their phones based on special scenarios during class, such as when a teacher is lecturing at the podium with a fixed blackboard or whiteboard background. This can be done by using the phone's rear camera and built-in infrared distance sensor to verify the teacher's presence. If a student performs an action that meets the unlocking conditions during class, such as raising the phone to take a long photo of the podium, the teacher and classmates will notice. This greatly limits the possibility of students playing with their phones during breaks, without the need for manual intervention by parents or teachers, and without the need for online identity verification. This prevents students from playing online or offline games according to local conditions, deepening anti-addiction measures at the device and interaction levels.

[0167] In an embodiment of the present application, if an unlock trigger operation is detected for a target application object such as an application or part of a function of an application in a smart device, the camera device can be called to collect an environmental image of the environment in which the smart device is located. If the analysis result after data analysis of the collected environmental image meets the unlocking condition, the target application object can be unlocked. Among them, the analysis result meeting the unlocking condition can be customized according to the scene requirements or user requirements. It can be seen that in this application, whether to unlock the target application object can be determined by analyzing the collected environmental image without the intervention of a third party, so the unlocking method is more efficient. At the same time, the embodiment of the present application can also meet the user's needs for some emergency use and rest time of terminal applications, and the management of terminal application objects is more flexible.

[0168] See Figure 9 , Figure 9 This is a schematic diagram of the structure of an unlocking processing device for terminal applications provided by an embodiment of the present application. The unlocking processing device 900 can be applied to Figure 2 、 Figure 4 and Figure 8 The corresponding smart device in the method embodiment. The unlocking processing device 900 can be a computer program (including program code) running in a lightweight node, for example, the unlocking processing device 900 is an application software; the device can be used to execute the corresponding steps of the method provided in the embodiment of the present application. The unlocking processing device 900 may include:

[0169] The processing unit 901 is configured to, upon detecting an unlock trigger operation for a target application object in the smart device, call a camera to capture an image of the environment in which the smart device is located;

[0170] An analysis unit 902 is used to perform data analysis during the process of collecting environmental images;

[0171] Unlocking unit 903, configured to unlock the target application object if the analysis result of the data analysis meets the unlocking condition;

[0172] The analysis result includes: determining, based on an analysis of N environmental images, whether Q environmental images include static image objects that match reference image object features; determining, based on an analysis of M environmental images, whether P environmental images do not include dynamic image objects in their target image regions; or a combination of the two;

[0173] N and Q are integers greater than or equal to 1, and Q is less than or equal to N. M and P are integers greater than 1, and P is less than or equal to M.

[0174] In a possible implementation, the unlocking processing device 900 further includes: a display unit 904 .

[0175] The display unit 904 is used to display an unlock prompt interface, which displays the collected environment image and unlock condition prompt information according to the first display rule;

[0176] If the analysis result after the data analysis meets the unlocking condition, the display unit 904 displays the unlocking condition prompt information on the unlocking prompt interface according to the second display rule. The display manner of the unlocking condition prompt information is different under the first display rule and the second display rule.

[0177] In a possible implementation, the processing unit 901 is further configured to perform the following operations:

[0178] Obtaining the shooting distance between the smart device and the environmental objects in the environment where the smart device is located;

[0179] The analysis result also includes: whether the shooting distance is greater than or equal to a preset distance threshold.

[0180] In a possible implementation, the processing unit 901 is further configured to perform the following operations:

[0181] Obtaining the shooting time of the shooting device in acquiring the environmental image;

[0182] The analysis result also includes whether the shooting time is greater than or equal to a preset time threshold.

[0183] In a possible implementation, the processing unit 901 is further configured to perform the following operations:

[0184] Get the trigger time of the unlock trigger operation. If the trigger time is within the preset time period, keep the target application object in the locked state;

[0185] If the trigger time is not within the preset time period, the operation of calling the shooting device to capture the environmental image of the environment where the smart device is located is triggered.

[0186] In a possible implementation, the processing unit 901 is further configured to perform the following operations:

[0187] Obtain the trigger time and business schedule of the unlock trigger operation, where the business schedule includes multiple business time periods and business identifiers corresponding to each business time period. A business identifier is used to indicate a business scenario;

[0188] Determine the target business time period of the trigger time according to the business schedule, and determine the target business scenario according to the target business identifier corresponding to the target business time period;

[0189] Perform business management on target user IDs based on target business scenarios.

[0190] In a possible implementation, the unlock trigger operation is generated based on the target user ID, and the business schedule is obtained based on the unit information configured for the target user ID on the unlock function initialization interface.

[0191] In a possible implementation, the processing unit 901 obtains the shooting distance between the smart device and an environmental object in the environment where the smart device is located, including:

[0192] When it is determined based on the analysis of the N environmental images that the Q environmental images include a static image object that matches the reference image object feature, obtaining the original width of the environmental object in the environment where the smart device is located, and obtaining the focal length from the shooting parameters of the shooting device;

[0193] Get the pixel width of the static image object from the collected environment image;

[0194] Determine the shooting distance based on the original width, pixel width and focal length.

[0195] In a possible implementation, the processing unit 901 is further configured to perform the following operations:

[0196] When the shooting time is less than the preset time threshold, determining whether the analysis result of the data analysis meets the re-timing condition;

[0197] If yes, then re-count the shooting time corresponding to the process of the shooting device acquiring the new environment image from the current moment;

[0198] Whether the data analysis results meet the re-timing conditions includes any one or a combination of the following factors:

[0199] When it is determined based on the analysis of the already collected environment image that no static image object matching the reference image object feature is included, determining that the retiming condition is satisfied;

[0200] When it is determined based on the analysis of the collected environment image that a dynamic image object is included, determining that a retiming condition is satisfied;

[0201] When the acquired shooting distance between the smart device and the environmental object in the environment where the smart device is located is less than a preset distance threshold, it is determined that the re-timing condition is met.

[0202] In one possible implementation, the analysis unit 902 performs data analysis during the process of collecting the environment image, including:

[0203] In the process of calling the shooting device to capture the environmental image of the environment where the smart device is located, key frames are extracted to form an environmental image set;

[0204] Performing image feature segmentation processing on each of the N environmental images in the environmental image set to obtain the image features of each of the N environmental images after segmentation;

[0205] A hierarchical matching analysis is performed between the image features after segmentation of each environmental image and the object features of the reference image to determine whether there is a static image object that matches the object features of the reference image.

[0206] In a possible implementation, the analyzing unit 902 performs data analysis during the process of collecting the environment image, further comprising:

[0207] In the process of calling the shooting device to capture the environmental image of the environment where the smart device is located, extracting key frames to form an environmental image set;

[0208] Performing image region segmentation processing on each of the M environmental images in the environmental image set to obtain the segmented image region of each of the M environmental images;

[0209] A living object analysis is performed on the target image region in the image region after segmentation of each environmental image to determine whether the target image region includes a dynamic image object.

[0210] In an embodiment of the present application, a target application object such as an application in a smart device or part of a function of an application can be set as a locked object. If an unlock trigger operation is detected for the target application object in the smart device, the camera device can be called to collect an environmental image of the environment in which the smart device is located. Then, data analysis is performed on the collected environmental image to obtain an analysis result. If the analysis result meets the unlocking condition set in advance for the target application object, then the target application object can be unlocked, so that the target application object can be successfully unlocked and used. It can be seen that in the present application, whether to unlock the target application object can be determined by analyzing the collected environmental image without the intervention of a third party. Therefore, the unlocking method is more efficient, and it can also meet the user's emergency use and rest time use of the terminal application, and the management of the terminal application object is more flexible.

[0211] See Figure 10 , Figure 10 This is a schematic diagram of the structure of another unlocking processing device for terminal application provided by the embodiment of the present application. The unlocking processing device 1000 can be applied to Figure 2 、 Figure 4 and Figure 8 The unlocking processing device 1000 may be a computer program (including program code) running in a lightweight node, for example, the unlocking processing device 1000 is an application software; the device may be used to execute the corresponding steps of the method provided in the embodiment of the present application. The unlocking processing device 1000 may include:

[0212] Display unit 1001, used to display the application unlocking interface;

[0213] The display unit 1001 is further configured to display an unlock prompt interface when an unlock trigger event is detected in the application unlock interface, wherein the unlock prompt interface displays the captured environment image and displays unlock condition prompt information according to the first display rule;

[0214] The display unit 1001 is also used to display the unlocking condition prompt information on the unlocking prompt interface according to the second display rule if the analysis result after data analysis of the collected environmental image meets the unlocking condition. The display method of the unlocking condition prompt information is different under the first display rule and the second display rule.

[0215] In a possible implementation, the unlocking processing device 1000 further includes: a processing unit 1002 .

[0216] The display unit 1001 responds to the lock configuration operation of the lock function interface for the target user identification and displays the unlock function initialization interface, which is used to enter the user's basic information;

[0217] The processing unit 1002 obtains the basic user information entered in the unlock function initialization interface, where the basic user information includes a target application object identifier and any one or more of the entered gender, age, school, and height;

[0218] After acquiring one or more user basic information, the processing unit 1002 determines the target application object corresponding to the target application object identifier as a locked object, so as to display an application unlocking interface when an unlock trigger operation for the target application object in the smart device is detected.

[0219] In a possible implementation, the application unlocking interface includes an unlocking control and unlocking operation prompt information. When the unlocking control is triggered, it is determined that an unlocking triggering event is detected.

[0220] In a possible implementation, the processing unit 1002 is further configured to perform the following operations:

[0221] When an unlock trigger event is detected in the application unlock interface, the camera is called to capture an environmental image of the environment in which the smart device is located;

[0222] Perform data analysis during the process of collecting environmental images;

[0223] If the data analysis result meets the unlocking condition, the target application object is unlocked;

[0224] The analysis result includes: determining, based on an analysis of N environmental images, whether Q environmental images include static image objects that match reference image object features; determining, based on an analysis of M environmental images, whether P environmental images do not include dynamic image objects in their target image regions; or a combination of the two;

[0225] N and Q are integers greater than or equal to 1, and Q is less than or equal to N. M and P are integers greater than 1, and P is less than or equal to M.

[0226] In a possible implementation, displaying the unlocking condition prompt information according to the first display rule includes: displaying the unlocking condition prompt information according to the first color and the first condition mark indicated by the first display rule;

[0227] The display unit 1001 displays the unlock condition prompt information on the unlock prompt interface according to the second display rule, including: displaying the unlock condition prompt information according to the second color and the second condition mark indicated by the second display rule;

[0228] wherein the first color and the second color are different, and the first condition mark and the second condition mark are different;

[0229] The unlock condition prompt information includes: timing prompt information; the timing prompt information includes timing text information and a timing progress icon about the shooting time.

[0230] See Figure 11 , Figure 11 This is a schematic diagram of the structure of a smart device provided in an embodiment of the present application. The smart device 1100 is used to execute Figure 2 、 Figure 4 and Figure 8 The steps performed by the smart device in the corresponding method embodiment are as follows: the smart device 1100 includes: one or more processors 1110; one or more input devices 1120; one or more output devices 1130; and a memory 1140. The processors 1110, input devices 1120, output devices 1130, and memory 1140 are connected via a bus 1150. The memory 1140 is used to store a computer program, which includes program instructions. The processor 1110 is used to call the program instructions stored in the memory 1140 to perform the following operations:

[0231] If an unlock trigger operation for a target application object in the smart device is detected, calling a camera to capture an environmental image of the environment in which the smart device is located;

[0232] Perform data analysis during the process of collecting environmental images;

[0233] If the data analysis result meets the unlocking condition, the target application object is unlocked;

[0234] The analysis result includes: determining, based on an analysis of N environmental images, whether Q environmental images include static image objects that match reference image object features; determining, based on an analysis of M environmental images, whether P environmental images do not include dynamic image objects in their target image regions; or a combination of the two;

[0235] N and Q are integers greater than or equal to 1, and Q is less than or equal to N. M and P are integers greater than 1, and P is less than or equal to M.

[0236] In one possible implementation, the output device 1130 is configured to call program instructions stored in the memory 1140 to perform the following operations:

[0237] Displaying an unlock prompt interface, where the unlock prompt interface displays the collected environment image and displays unlock condition prompt information according to the first display rule;

[0238] If the analysis result after the data analysis meets the unlocking condition, the unlocking condition prompt information is displayed on the unlocking prompt interface according to the second display rule. The display method of the unlocking condition prompt information is different under the first display rule and the second display rule.

[0239] In a possible implementation, the processor 1110 is further configured to perform the following operations:

[0240] Obtaining the shooting distance between the smart device and the environmental objects in the environment where the smart device is located;

[0241] The analysis result also includes: whether the shooting distance is greater than or equal to a preset distance threshold.

[0242] In a possible implementation, the processor 1110 is further configured to perform the following operations:

[0243] Obtaining the shooting time of the shooting device in acquiring the environmental image;

[0244] The analysis result also includes whether the shooting time is greater than or equal to a preset time threshold.

[0245] In a possible implementation, the processor 1110 is further configured to perform the following operations:

[0246] Get the trigger time of the unlock trigger operation. If the trigger time is within the preset time period, keep the target application object in the locked state;

[0247] If the trigger time is not within the preset time period, the operation of calling the shooting device to capture the environmental image of the environment where the smart device is located is triggered.

[0248] In a possible implementation, the processor 1110 is further configured to perform the following operations:

[0249] Obtain the trigger time and business schedule of the unlock trigger operation, where the business schedule includes multiple business time periods and business identifiers corresponding to each business time period. A business identifier is used to indicate a business scenario;

[0250] Determine the target business time period of the trigger time according to the business schedule, and determine the target business scenario according to the target business identifier corresponding to the target business time period;

[0251] Perform business management on target user IDs based on target business scenarios.

[0252] In a possible implementation, the unlock trigger operation is generated based on the target user ID, and the business schedule is obtained based on the unit information configured for the target user ID on the unlock function initialization interface.

[0253] In one possible implementation, the processor 1110 obtains the shooting distance between the smart device and an environmental object in the environment where the smart device is located, including:

[0254] When it is determined based on the analysis of the N environmental images that the Q environmental images include a static image object that matches the reference image object feature, obtaining the original width of the environmental object in the environment where the smart device is located, and obtaining the focal length from the shooting parameters of the shooting device;

[0255] Get the pixel width of the static image object from the collected environment image;

[0256] Determine the shooting distance based on the original width, pixel width and focal length.

[0257] In a possible implementation, the processor 1110 is further configured to perform the following operations:

[0258] When the shooting time is less than the preset time threshold, determining whether the analysis result of the data analysis meets the re-timing condition;

[0259] If yes, then re-count the shooting time corresponding to the process of the shooting device acquiring the new environment image from the current moment;

[0260] Whether the data analysis results meet the re-timing conditions includes any one or a combination of the following factors:

[0261] When it is determined based on the analysis of the already collected environment image that no static image object matching the reference image object feature is included, determining that the retiming condition is satisfied;

[0262] When it is determined based on the analysis of the collected environment image that a dynamic image object is included, determining that a retiming condition is satisfied;

[0263] When the acquired shooting distance between the smart device and the environmental object in the environment where the smart device is located is less than a preset distance threshold, it is determined that the re-timing condition is met.

[0264] In one possible implementation, the processor 1110 performs data analysis during the process of collecting environmental images, including:

[0265] In the process of calling the shooting device to capture the environmental image of the environment where the smart device is located, key frames are extracted to form an environmental image set;

[0266] Performing image feature segmentation processing on each of the N environmental images in the environmental image set to obtain the image features of each of the N environmental images after segmentation;

[0267] A hierarchical matching analysis is performed between the image features after segmentation of each environmental image and the object features of the reference image to determine whether there is a static image object that matches the object features of the reference image.

[0268] In one possible implementation, the processor 1110 performs data analysis during the process of collecting the environment image, further comprising:

[0269] In the process of calling the shooting device to capture the environmental image of the environment where the smart device is located, extracting key frames to form an environmental image set;

[0270] Performing image region segmentation processing on each of the M environmental images in the environmental image set to obtain the segmented image region of each of the M environmental images;

[0271] A living object analysis is performed on the target image region in the image region after segmentation of each environmental image to determine whether the target image region includes a dynamic image object.

[0272] In the embodiment of the present application, the output device 1130 is used to call the program instructions stored in the memory 1140, and is also used to perform the following operations:

[0273] Display the application unlock interface;

[0274] When an unlock trigger event is detected in the application unlock interface, an unlock prompt interface is displayed, the unlock prompt interface displays the collected environment image, and displays unlock condition prompt information according to the first display rule;

[0275] If the analysis result after data analysis of the collected environmental image meets the unlocking condition, the unlocking condition prompt information is displayed on the unlocking prompt interface according to the second display rule. The display method of the unlocking condition prompt information is different under the first display rule and the second display rule.

[0276] In one possible implementation, the output device 1130 displays an unlock function initialization interface in response to a lock configuration operation on the lock function interface identified by the target user, where the unlock function initialization interface is used to enter basic user information.

[0277] The input device 1120 obtains the basic user information entered in the unlock function initialization interface, the basic user information including the target application object identifier and any one or more of the entered gender, age, school, and height;

[0278] After the input device 1120 obtains one or more user basic information, the processor 1110 determines the target application object corresponding to the target application object identifier as a locked object, so as to display the application unlocking interface when an unlock trigger operation for the target application object in the smart device is detected.

[0279] In a possible implementation, the application unlocking interface includes an unlocking control and unlocking operation prompt information. When the unlocking control is triggered, it is determined that an unlocking triggering event is detected.

[0280] In a possible implementation, the processor 1110 is further configured to perform the following operations:

[0281] When an unlock trigger event is detected in the application unlock interface, the camera is called to capture an environmental image of the environment in which the smart device is located;

[0282] Perform data analysis during the process of collecting environmental images;

[0283] If the data analysis result meets the unlocking condition, the target application object is unlocked;

[0284] The analysis result includes: determining, based on an analysis of N environmental images, whether Q environmental images include static image objects that match reference image object features; determining, based on an analysis of M environmental images, whether P environmental images do not include dynamic image objects in their target image regions; or a combination of the two;

[0285] N and Q are integers greater than or equal to 1, and Q is less than or equal to N. M and P are integers greater than 1, and P is less than or equal to M.

[0286] In a possible implementation, displaying the unlocking condition prompt information according to the first display rule includes: displaying the unlocking condition prompt information according to the first color and the first condition mark indicated by the first display rule;

[0287] The output device 1130 displays the unlock condition prompt information on the unlock prompt interface according to the second display rule, including: displaying the unlock condition prompt information according to the second color and the second condition mark indicated by the second display rule;

[0288] wherein the first color and the second color are different, and the first condition mark and the second condition mark are different;

[0289] The unlock condition prompt information includes: timing prompt information; the timing prompt information includes timing text information and a timing progress icon about the shooting time.

[0290] It should be understood that the smart device described in the embodiments of the present application can execute the above Figure 2、 Figure 4 and Figure 8 The description of the unlocking processing method in the corresponding embodiment can also be performed as described above. Figure 9 The unlocking processing device 900 and Figure 10 The description of the unlocking processing device 1000 in the corresponding embodiment will not be repeated here. In addition, the description of the beneficial effects of adopting the same method will not be repeated here either.

[0291] In addition, it should be pointed out here that: the embodiment of the present application also provides a computer storage medium, and the computer storage medium stores the computer program executed by the unlocking processing device 900 and the unlocking processing device 1000 mentioned above, and the computer program includes program instructions. When the processor executes the above program instructions, it can execute the above Figure 2 、 Figure 4 and Figure 8 The method in the corresponding embodiment will therefore not be described in detail here. For technical details not disclosed in the computer storage medium embodiment involved in this application, please refer to the description of the method embodiment of this application. As an example, the program instructions can be deployed on a smart device, or executed on multiple smart devices located in one location, or executed on multiple smart devices distributed in multiple locations and interconnected by a communication network. Multiple smart devices distributed in multiple locations and interconnected by a communication network can constitute a blockchain system.

[0292] According to one aspect of the present application, a computer program product or computer program is provided, the computer program product or computer program including computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a smart device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the smart device can perform the above-mentioned Figure 2 、 Figure 4 and Figure 8 The method in the corresponding embodiment will therefore not be described in detail here.

[0293] Those skilled in the art will appreciate that all or part of the processes in the above-described method embodiments can be implemented by instructing related hardware through a computer program. The program can be stored in a computer-readable storage medium, and when executed, the program can include the processes in the above-described method embodiments. The storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0294] The above disclosure is only a preferred embodiment of the present application, and certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. A method for unlocking a terminal application, characterized in that: The method comprises: If an unlock trigger operation for a target application object in the smart device is detected, calling a camera to capture an environmental image of the environment in which the smart device is located; Perform data analysis during the process of collecting environmental images; If the analysis result of the data analysis meets the unlocking condition, unlocking the target application object; The analysis result includes: determining, based on an analysis of N environmental images, whether Q environmental images include static image objects that match reference image object features; determining, based on an analysis of M environmental images, whether P environmental images do not include dynamic image objects in their target image regions; or a combination of the two; N and Q are integers greater than or equal to 1, and Q is less than or equal to N. M and P are integers greater than 1, and P is less than or equal to M.

2. The method according to claim 1, wherein The method further comprises: Displaying an unlock prompt interface, wherein the unlock prompt interface displays the collected environment image and displays unlock condition prompt information according to the first display rule; If the analysis result after the data analysis meets the unlocking condition, the unlocking condition prompt information is displayed on the unlocking prompt interface according to the second display rule, and the display manner of the unlocking condition prompt information is different under the first display rule and the second display rule.

3. The method according to claim 1 or 2, wherein: The method further comprises: Obtaining a shooting distance between the smart device and an environmental object in an environment where the smart device is located; The analysis result also includes: whether the shooting distance is greater than or equal to a preset distance threshold.

4. The method according to claim 1 or 2, wherein: The method further comprises: Obtaining the shooting time of the shooting device in acquiring the environment image; The analysis result further includes: whether the shooting time is greater than or equal to a preset time threshold.

5. The method according to claim 1, wherein The method further comprises: Obtaining a trigger time of the unlock trigger operation, and if the trigger time is within a preset time period, keeping the target application object in a locked state; If the trigger time is not within the preset time period, the operation of calling a shooting device to capture an environmental image of the environment where the smart device is located is triggered.

6. The method according to claim 1, wherein The method further comprises: Obtaining a trigger time and a business schedule for the unlock trigger operation, wherein the business schedule includes multiple business time periods and a business identifier corresponding to each business time period, where one business identifier indicates one business scenario; Determine the target business time period in which the trigger time falls according to the business schedule, and determine the target business scenario according to the target business identifier corresponding to the target business time period; Perform business management on the target user identifier according to the target business scenario.

7. The method according to claim 6, wherein The unlock trigger operation is generated based on the target user ID, and the service schedule is obtained based on the unit information configured for the target user ID on the unlock function initialization interface.

8. The method according to claim 3, wherein The obtaining of the shooting distance between the smart device and an environmental object in the environment where the smart device is located includes: When it is determined based on the analysis of the N environmental images that the Q environmental images include a static image object that matches the reference image object feature, obtaining the original width of the environmental object in the environment where the smart device is located, and obtaining the focal length from the shooting parameters of the shooting device; Obtaining the pixel width of the static image object from the collected environment image; The shooting distance is determined according to the original width, the pixel width, and the focal length.

9. The method according to claim 4, wherein The method further comprises: When the shooting time is less than the preset time threshold, determining whether the analysis result of the data analysis meets the retiming condition; If so, re-count the shooting time corresponding to the process of the shooting device acquiring the new environment image from the current moment; Whether the analysis result of the data analysis satisfies the re-timing condition includes any one or a combination of the following factors: When it is determined based on the analysis of the already collected environment image that no static image object matching the reference image object feature is included, determining that the retiming condition is satisfied; When it is determined based on the analysis of the collected environment image that a dynamic image object is included, determining that a retiming condition is satisfied; When the acquired shooting distance between the smart device and an environmental object in the environment where the smart device is located is less than a preset distance threshold, it is determined that a re-timing condition is met.

10. The method according to claim 1, wherein The data analysis during the process of collecting environmental images includes: In the process of calling the shooting device to capture the environmental image of the environment where the smart device is located, extracting key frames to form an environmental image set; Performing image feature segmentation processing on each of the N environmental images in the environmental image set to obtain segmented image features of each of the N environmental images; A hierarchical matching analysis process is performed between the segmented image features of each environmental image and the reference image object features to determine whether there is a static image object that matches the reference image object features.

11. The method according to claim 1, wherein The data analysis during the process of collecting the environmental image further includes: In the process of calling the shooting device to capture the environmental image of the environment where the smart device is located, extracting key frames to form an environmental image set; Performing image region segmentation processing on each of the M environmental images in the environmental image set to obtain a segmented image region of each of the M environmental images; A living object analysis is performed on the target image area in the image area segmented from each environmental image to determine whether the target image area includes a dynamic image object.

12. An unlocking processing device for terminal applications, characterized in that: The device comprises: a processing unit configured to, upon detecting an unlock triggering operation for a target application object in the smart device, call a photographing device to capture an environmental image of an environment in which the smart device is located; An analysis unit, used for performing data analysis in the process of collecting environmental images; an unlocking unit, configured to unlock the target application object if the analysis result of the data analysis meets an unlocking condition; The analysis results include: determining, based on an analysis of N environmental images, whether Q environmental images include static image objects that match reference image object features; and determining, based on an analysis of M environmental images, whether P environmental images do not include dynamic image objects in their target image regions, or a combination of both; N and Q are integers greater than or equal to 1, and Q is less than or equal to N. M and P are integers greater than 1, and P is less than or equal to M.

13. A smart device, characterized in that: include: a processor adapted to execute a computer program; A computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by the processor, the unlocking processing method for the terminal application according to any one of claims 1 to 11 is implemented.

14. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, wherein the computer program includes program instructions. When the program instructions are executed by a processor, the processor executes the unlocking processing method for a terminal application according to any one of claims 1 to 11.

15. A computer program product, characterized in that The computer program product includes computer instructions, which are stored in a computer-readable storage medium; the processor of the smart device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the smart device executes the unlocking processing method for the terminal application as described in any one of claims 1-11.

Images