Method and device for running application program and vehicle

Abstract

The invention discloses a method and device for running an application program and a vehicle, and belongs to the field of application program running. The method comprises the following steps: switching a database used by the application program from a first database to a second database in response to switching of a current user using the application program from a first user to a second user; wherein the first user and the second user are different users, the first database is a database applied to the first user, and the second database is a database applied to the second user. In addition, in the process of determining the current user using the application program, the current user using the application program can be comprehensively determined in combination with the hand movement direction and the eye orientation of the user. In addition, the current user using the application program is non-perceptual to the switching process of the whole database.

Description

Technical Field

[0001] This application belongs to the field of application operation, and specifically relates to a method, apparatus and vehicle for running an application. Background Technology

[0002] Currently, in some multi-user scenarios, the same application on the same electronic device may be used by multiple users successively. For example, in the scenario of in-vehicle smart cockpit, both the driver and passengers can operate the central control screen and run the applications displayed on the screen.

[0003] However, in these scenarios, users are usually required to manually log out of the application after logging in and using it. If they do not log out in time, their personal privacy data on the application may be viewed by other users, which poses a privacy problem. Summary of the Invention

[0004] This application provides a method, apparatus, and vehicle for running an application, which can solve the problem of poor privacy in related technologies.

[0005] In a first aspect, embodiments of this application provide a method for running an application, including: When the application is logged in by the first user, in response to a target operation, the current user using the application is detected; the target operation is an operation used to trigger the running of the application. In response to the current user of the application switching from the first user to the second user, the database used by the application is switched from the first database to the second database; Wherein, the first user and the second user are different users, the first database is a database applied to the first user, and the second database is a database applied to the second user.

[0006] Optionally, after detecting the current user using the application, the method further includes: if the current user is detected, obtaining the identity information of the current user; if the current user is a second user, verifying the identity information of the second user based on a pre-set authentication information database; if the verification of the second user's identity information fails, determining that the second database is a public database; if the verification of the second user's identity information succeeds, determining that the second database is the second user's personal database. In this way, the database used by the application will only be switched to the second user's personal database if the second user's identity information is successfully verified, thus further improving the security of using the personal database and further preventing the leakage of personal privacy.

[0007] Optionally, detecting the current user using the application in response to a target operation includes: obtaining the operation time point of the target operation in response to the target operation; obtaining image information prior to the operation time point, the image information including images of at least one user; and identifying the current user using the application from among the at least one user based on the image information. In this way, the current user using the application can be identified through image information prior to the operation time point of the target operation, thereby allowing the database used by the application to be switched when the current user switches, thus protecting user privacy.

[0008] Optionally, the image information includes multiple image frames prior to the operation time point; the process of identifying the current user using the application from the at least one user based on the image information includes: determining the hand movement trajectory of each of the at least one user based on the multiple image frames; determining the hand movement direction of each of the at least one user based on the hand movement trajectory of each of the at least one user; and identifying the current user using the application from the at least one user based on the hand movement direction of each of the at least one user. In this way, the hand movement trajectory of the user while using the application is taken into account during the process of determining the current user using the application, which can improve the accuracy of identifying the current user using the application, thereby ensuring better database switching performance.

[0009] Optionally, identifying the current user of the application from the at least one users based on the hand movement direction of each of the at least one users includes: determining a target user whose hand movement direction is facing a target display screen, based on the hand movement direction of each of the at least one users; the target display screen is a display screen that displays the application; if there is only one target user among the at least one users, the target user is determined as the current user of the application. In this way, the determination of the current user of the application takes into account whether the user's hand movement direction is facing the target display screen, which can further improve the accuracy of the current user identification.

[0010] Optionally, determining the target user whose hand movement direction is towards the target display screen based on the hand movement direction of each of the at least one users includes: determining the target hand movement direction towards the target display screen based on the hand movement direction of each of the at least one users; obtaining the hand movement starting point corresponding to the target hand movement direction; determining the target position based on the hand movement starting point corresponding to the target hand movement direction; and identifying the user located at the target position among the at least one users as the target user. In this way, the target user triggering the target operation can be further located through the hand movement starting point, which can improve the accuracy of target user determination. Optionally, the at least one user can be multiple users; the step of identifying the current user using the application from the at least one user based on the hand movement direction of each of the at least one user further includes: if there is no target user among the at least one user, or if there are multiple target users among the at least one user, determining a designated user whose eyes are facing the target display screen from the at least one user based on the multiple image frames, and identifying the designated user as the current user using the application. This provides a multimodal fusion decision-making method for identifying the current user using the application, comprehensively judging the current user using the application based on user gesture recognition and viewing angle recognition, thus improving the accuracy of identifying the current user using the application.

[0011] Optionally, the image information includes multiple image frames prior to the operation time point; identifying the current user using the application from the at least one user based on the image information includes: determining a designated user whose eyes are facing a target display screen, which is the display screen showing the application, from the at least one user based on the multiple image frames; and identifying the designated user as the current user using the application. In this way, the current user using the application can be determined by identifying whether the user's eyes are facing the target display screen. This method takes into account the user's eye orientation during application use, improving the accuracy of identifying the current user using the application.

[0012] Secondly, embodiments of this application provide an apparatus for running an application, comprising: The determination module is used to detect the current user using the application in response to a target operation when the application is in the state of first user login; the target operation is an operation used to trigger the running of the application. A switching module is configured to switch the database used by the application from the first database to the second database in response to a change in the current user of the application from the first user to the second user. Wherein, the first user and the second user are different users, the first database is a database applied to the first user, and the second database is a database applied to the second user.

[0013] Thirdly, embodiments of this application provide a vehicle including the apparatus for running the application described in the second aspect.

[0014] Fourthly, embodiments of this application provide an electronic device, including a processor and a memory, wherein the memory stores a program or instructions, which, when executed by the processor, implement the method described in the first aspect.

[0015] Fifthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the method described in the first aspect.

[0016] In this embodiment, when the application is logged in by a first user, if the current user of the application is switched from the first user to the second user, the database used by the application can be switched from the first database to the second database. The first database is the database applied to the first user, and the second database is the database applied to the second user. The first database applied to the first user is no longer used. In this way, the second user will not be able to see the personal data of the first user when using the application, thus improving privacy and solving the problem of poor privacy in related technologies. Attached Figure Description

[0017] Figure 1 This is a flowchart illustrating a method for running an application provided in an embodiment of this application; Figure 2 This is an example diagram illustrating the establishment of an identity verification information database provided in an embodiment of this application; Figure 3 This is a flowchart of another method for running an application provided in an embodiment of this application; Figure 4 This is an example diagram illustrating how to determine the current user of the application, as provided in an embodiment of this application. Figure 5 This is a flowchart illustrating a method for running an application provided in an embodiment of this application; Figure 6 This is a structural block diagram of an apparatus for running an application provided in an embodiment of this application; Figure 7 This is a structural block diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0018] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0019] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0020] The method for running an application provided in this application embodiment can be applied to the process of running an application. When the current user of the application is switched from a first user to a second user, the database used by the application can be switched from a first database to a second database. The second user no longer uses the first database applied to the first user while using the application, thus improving privacy.

[0021] The method for running an application provided in this application embodiment can be executed by a target device, which can be a single electronic device or multiple electronic devices. When the method for running an application provided in this application embodiment is executed by a single electronic device, this electronic device can be a cockpit domain controller in a vehicle, a terminal device such as a desktop computer, laptop, mobile phone, or tablet, or a server, such as a dedicated physical server. When the method for running an application provided in this application embodiment is executed by multiple electronic devices, these multiple electronic devices can form a service cluster, cooperating with each other to complete the various steps.

[0022] The method for running an application provided in this application will be described in detail below with reference to the accompanying drawings, through specific embodiments and application scenarios.

[0023] Please see Figure 1 , Figure 1 This is a flowchart of a method for running an application provided in an embodiment of this application.

[0024] Step 110: When the application is logged in by the first user, in response to a target operation, detect the current user using the application; the target operation is an operation used to trigger the running of the application.

[0025] In this embodiment, the application can be an application on a target device, which can be used sequentially by multiple users. For example, the target device can be a public electronic device, such as a public terminal device or a smart cockpit device. A first user can log in and use the application, at which point the application is in a state where the first user is logged in. To determine whether the current user using the application has switched, the current user of the application can be detected. For the detection time point, in response to a target operation, the current user using the application can be detected, where the target operation can be an operation to trigger the running of the application. The target operation can be a touch operation performed by the user using the application, such as clicking to start the application, or clicking, swiping, or other operations during application use.

[0026] In one embodiment of this application, the application may be an application related to user privacy, such as a social application.

[0027] In a specific scenario, when user A logs into and uses application A, and user A's touch operation is detected, the current user of the application can be checked. If user A is still using application A, the database for application A does not need to be switched. After a period of time, user A stops using application A, and user B starts using application A. In response to user B's operation of running application A, the current user of application A can be checked, and the current user of application A can be detected to have changed from user A to user B.

[0028] In one embodiment of this application, after detecting the current user using the application, if the current user using the application is detected, the identity information of the current user is obtained; if the current user is a second user, the identity information of the second user is verified based on a pre-set identity verification information database; if the verification of the second user's identity information fails, the second database is determined to be a public database; if the verification of the second user's identity information succeeds, the second database is determined to be the second user's personal database.

[0029] In this embodiment, when a current user using the application is detected, the identity information of the current user can be obtained. Based on the detected current user, it can be determined whether the current user using the application has switched. If the current user is a first user, it is determined that the current user using the application has not switched, and the database used by the application can remain the first database. If the current user is a second user, it can be determined that the current user using the application has switched from the first user to the second user.

[0030] In this embodiment, when the current user is a second user, the identity information of the second user can be verified based on a pre-set identity verification information database. The identity verification information database stores the identity information of users who have enabled the personal database function; users who have enabled the personal database function can be users who own a personal database. Before verifying the identity information of the second user based on the pre-set identity verification information database, the database can be established as follows: when the second user has enabled the personal database function, the target identity information of the second user can be obtained, the second user's personal database can be established, the second user's personal database can be associated with the second user's target identity information, and the target identity information can be stored in the identity verification information database.

[0031] The identity information may include user facial information or user fingerprint information, etc. (See reference...) Figure 2 , Figure 2 This is an example diagram illustrating the establishment of an identity verification information database provided in an embodiment of this application. Figure 2 As shown, user A enables the personal database function for application A. User A can choose to associate their facial information and store it in the identity verification information database. Furthermore, a personal database for user A can be created based on the existing database for application A. The facial information shown is just an example; user fingerprint information can also be associated.

[0032] The identity information of the second user can be verified based on the aforementioned identity verification information database. In an in-vehicle scenario, this process can be implemented through the facial recognition module of the Driver Monitor System (DMS). Specifically, the facial information of the second user can be matched with the facial information stored in the identity verification information database. If a match is found in the database, the second user's identity verification is confirmed, and the second database is identified as the second user's personal database. This personal database stores the second user's personal data related to their use of the application. In this case, if the current user of the application switches from the first user to the second user, and the second user's identity verification is successful, it can be confirmed that the second user has enabled the personal database function, and the database used by the application can be switched to the second user's personal database.

[0033] If no facial information matches the second user's facial information in the authentication information database, it can be determined that the second user's authentication has failed, and the second database can be identified as a public database, which is available to unknown users or users who have not enabled the personal database function. In this case, if the current user of the application switches from the first user to the second user, and the second user's authentication fails (i.e., the second user may not have enabled the personal database function), the database used by the application can be switched to the public database.

[0034] In this embodiment, multiple users can enable the personal database function for the same application. For example, user A creates a personal database for user A, and user B creates a personal database for user B. Simultaneously, the application retains its original public database, ensuring other users can use the application normally. However, when multiple users are using the application, only one application entry is displayed on the page, and users are unaware of database switching, making it no different from normal application use. Furthermore, users can automatically switch to either the personal or public database while using the application, without being aware of this process.

[0035] Meanwhile, for users who have enabled the personal database function, taking user A as an example, while user A is using the application, they can automatically switch to their personal database without needing to enter a password to log in. Other users will not be aware that user A has encrypted the application, reducing the burden on user A when using the application. For the same application within the same system, it is possible to achieve isolation of personal privacy data for different users. Different users can have their own exclusive applications, and other users will be completely unaware of this and will not notice that the user has encrypted the application.

[0036] In this embodiment of the application, the database used by the application will only be switched to the second user's personal database if the second user's identity information is successfully verified. This can further improve the security of using the personal database and further prevent the leakage of personal privacy.

[0037] Step 120: In response to the current user using the application switching from the first user to the second user, the database used by the application is switched from the first database to the second database; wherein the first user and the second user are different users, the first database is the database applied to the first user, and the second database is the database applied to the second user.

[0038] The first database can be a database used by the application during the first user's use of the application; specifically, the first database can be a public database or the first user's personal database. The second database can be a database used by the application during the second user's use of the application; specifically, the second database can be a public database or the second user's personal database.

[0039] In this embodiment, after detecting the current user of the application, if no current user is detected, it can be determined that the current user has been switched from the first user to the second user, where the second user can be used to refer to an unknown user. In this case, the second database is a public database. Since it cannot be determined whether the current user of the application is still the first user, to avoid leakage of the first user's personal privacy data, the database used by the application can be switched from the first database to a public database.

[0040] If the current user of the application is detected, and the current user of the application is switched from the first user to the second user (where the second user refers to a user different from the first user), then the database used by the application can be switched to the second user's personal database. During this process, the second user can switch to the second user's personal database without entering a password.

[0041] In this embodiment, when the application is logged in by a first user, in response to a target operation, the current user using the application is detected; the target operation is an operation to trigger the running of the application; in response to the current user switching from the first user to a second user, the database used by the application is switched from a first database to a second database; wherein the first user and the second user are different users, the first database is the database applied to the first user, and the second database is the database applied to the second user. Thus, when the application is logged in by the first user, if the current user switches from the first user to the second user, the database used by the application can be switched from the first database to the second database, and the first database applied to the first user is no longer used. Therefore, the second user will not be able to see the personal data of the first user while using the application, resulting in better privacy and solving the problem of poor privacy in related technologies.

[0042] Please see Figure 3 , Figure 3 This is a flowchart of another method for running an application provided in an embodiment of this application. For example... Figure 3 As shown, the method includes the following steps: Step 310: When the application is logged in by the first user, in response to the target operation, obtain the operation time point of the target operation; the target operation is the operation used to trigger the running of the application.

[0043] For example, if a second user clicks on the application after the first user stops running the application, causing the application to start running, then the operation time point is the time point when the application starts running.

[0044] Step 320: Obtain image information prior to the operation time point, the image information including images of at least one user.

[0045] In this embodiment, the at least one user may be a user who might use the application at the operation time. Image information of the at least one user prior to the operation time can be obtained. Using this image information, further filtering can be performed among the at least one user to identify the current user using the application. Specifically, the image information can be obtained by capturing images of the at least one user using a camera. For example, in a vehicle interior scenario, the at least one user may include occupants, and image information of occupants can be obtained by capturing images of them using a DMS camera or an Occupant Monitoring System (OMS) camera inside the vehicle.

[0046] Step 330: Based on the image information, identify the current user using the application from among the at least one user.

[0047] In this embodiment of the application, the user most conveniently able to use the application among the at least one user can be determined as the current user based on the image information. Here, the user most conveniently able to use the application can be understood as a user who is idle or the user closest to the electronic device where the application is located, as these users are most likely to use the application.

[0048] Furthermore, when users use an application, they mostly do so through hand touch operations. Therefore, the current user using the application can also be identified based on the user's hand movement trajectory. Specifically, in one embodiment of this application, the image information includes multiple image frames prior to the operation time point; identifying the current user using the application from the at least one user based on the image information includes: determining the hand movement trajectory of each of the at least one user based on the multiple image frames; determining the hand movement direction of each of the at least one user based on the hand movement trajectory of each of the at least one user; and identifying the current user using the application from the at least one user based on the hand movement direction of each of the at least one user.

[0049] In this embodiment, to obtain the user's hand movement trajectory, multiple image frames prior to the operation time point can be acquired, such as 5 image frames within 5 seconds or 10 image frames within 10 seconds prior to the operation time point. Through these multiple image frames, the hand movement trajectory of each of the at least one user can be analyzed. The hand movement trajectory can be the movement trajectory of the user's hand key points, which may include parts such as the wrist or finger joints. During the hand movement trajectory analysis, a key point detection model can be used to detect hand key points frame by frame in the multiple image frames. The key point detection model can be, for example, a lightweight hand tracking model (MediaPipeHand). Then, Kalman filtering can be used to track the hand key points of the same user in the multiple image frames to reduce noise and smooth the hand movement trajectory, thus obtaining the hand movement trajectory of each of the at least one user.

[0050] The lightweight hand tracking model (MediaPipe Hand) is a real-time hand detection and tracking technology, part of the MediaPipe framework. Its core principle combines deep learning models and lightweight computer vision algorithms. The overall architecture of the lightweight hand tracking model (MediaPipe Hand) employs a two-stage detection-tracking pipeline. The first stage is the detection stage: a lightweight convolutional neural network model (such as the BlazePalm model) is used to quickly locate the hand position. The second stage is the tracking stage, which uses keypoint regression models and motion prediction to achieve continuous tracking of hand keypoints.

[0051] Because hand keypoints are susceptible to occlusion, rapid movement, or noise interference, leading to detection modulation, Kalman filtering can be used to reduce noise and smooth hand movement trajectories. In hand keypoint tracking, Kalman filtering fuses dynamic prediction and observation data. In the prediction phase, it estimates the position of hand keypoints in the next frame based on a motion model (prior). In the update phase, it combines the detection results of the current frame (observation) to weightedly correct the predicted values, resulting in a smoother, more continuous trajectory, reduced jitter, and significantly improved tracking smoothness and robustness.

[0052] Then, the hand movement direction of each of the at least one users can be analyzed by examining the hand movement trajectory of each user. Typically, during a click-type touch operation, the user's hand moves towards a fixed area, and the direction of hand movement is usually fixed in one direction, without constantly changing (sometimes left, sometimes right). Therefore, for any one of the at least one users, the user whose hand movement direction is fixed in one direction can be selected and identified as the current user of the application.

[0053] In this embodiment of the application, the hand movement trajectory of the user when using the application is taken into account during the process of determining the current user of the application, which can improve the recognition accuracy of the current user of the application and thus ensure better database switching effect.

[0054] In one embodiment of this application, identifying the current user of the application from the at least one users based on the hand movement direction of each of the at least one users includes: determining a target user whose hand movement direction is towards a target display screen based on the hand movement direction of each of the at least one users; the target display screen is a display screen that displays the application; if there is only one target user among the at least one users, the target user is determined as the current user of the application.

[0055] In this embodiment, the application displayed on the target display screen is available for use by users within a target area. The at least one user can be a user within the target area, and the image information can be image information of the target area. When a user uses the application by performing a touch operation on the target display screen, the user's hand is typically facing and moving towards the target display screen. Therefore, the target user whose hand is moving towards the target display screen can be determined from among the at least one user. If there are multiple target users among the at least one user, the current user using the application cannot be determined; that is, the current user using the application is not detected. If there is only one target user among the at least one user, that target user can be directly identified as the current user using the application.

[0056] To analyze the direction of a user's hand movement, a coordinate axis can be established with the target display screen as the origin. Taking an in-vehicle scenario as an example, the target display screen can be the vehicle's central control screen, and the at least one user includes occupants, specifically the driver and front passenger. The central control screen can be used as the origin, with the X-axis (left-right direction) pointing right as positive (to the right of the driver, i.e., the front passenger's direction) and left as negative (to the left of the front passenger, i.e., the driver's direction); the Y-axis (up-down direction) pointing vertically upwards as positive (i.e., the direction the central control screen faces towards the roof) and vertically downwards as negative (i.e., the direction the central control screen points towards the chassis); and the Z-axis (front-back / depth direction) pointing forward (towards the back of the screen) as positive (i.e., the direction of the screen's normal) and pointing backwards (i.e., towards the driver's direction) as negative.

[0057] In this embodiment, for each of the at least one users, it can be determined whether the hand movement direction is towards the target display screen. If the user's hand movement direction is towards the target display screen, it indicates that the user's hand has a tendency to operate the target display screen, and the target operation is likely triggered by the user. Specifically, taking the above-mentioned in-vehicle scenario as an example, if a person in the vehicle wants to perform a touch operation on the target display screen, the movement direction of the person's hand on the Z-axis is usually positive, that is, the person's hand points towards the central control screen. The movement direction of the person in the vehicle on the X-axis may be different for people in different positions. For example, when the driver points to the central control screen, the movement direction on the X-axis is usually positive, and when the passenger points to the central control screen, the movement direction on the X-axis is usually negative.

[0058] In other words, for each of the at least one users, a first displacement in a first direction and a second displacement in a second direction can be determined by the user's hand movement trajectory. Based on the first and second displacements, it can be determined whether the user's hand movement direction is towards the target display screen, and users whose hand movement direction is towards the target display screen are identified as target users. The first direction can be the left-right direction of the left and right halves of the target display screen, and the second direction can be the screen normal direction of the target display screen. The first displacement is positive along the direction from the left half to the right half of the screen, and the second displacement is positive along the opposite direction of the screen's facing direction. If only one target user exists among the at least one users, the target user is identified as the current user using the application. If multiple target users exist among the at least one users, it can be determined that no current user using the application has been detected, or the current user using the application can be further identified from among the target users.

[0059] In this embodiment of the application, the process of determining the current user of the application takes into account whether the user's hand movement direction is towards the target display screen, which can further improve the accuracy of the current user judgment.

[0060] To further improve the accuracy of identifying the current user, the user's hand movement direction can be analyzed frame by frame. It is necessary to ensure that the target user's movement direction is always towards the target display screen in multiple consecutive image frames, filtering out users whose movement direction changes. Specifically, the multiple image frames include M pairs of adjacent image frames, where M is an integer greater than 1. Based on the hand movement direction of each of the at least one user, the target user whose hand movement is towards the target display screen is determined. This includes: for any one of the at least one users, determining M hand movement directions of that user in the M pairs of adjacent image frames. These M hand movement directions correspond one-to-one with the M pairs of adjacent image frames. If the number of consecutive hand movement directions towards the target display screen in the M hand movement directions is greater than a preset value, then that user is identified as the target user. The preset value can be adjusted according to actual conditions; for example, the preset value can be 3. In other words, the target user is one whose hand movement direction is always towards the target display screen in multiple consecutive adjacent image frames.

[0061] In one embodiment of this application, determining the target user whose hand movement direction is toward the target display screen based on the hand movement direction of each of the at least one users includes: determining the target hand movement direction toward the target display screen based on the hand movement direction of each of the at least one users; obtaining the hand movement starting point corresponding to the target hand movement direction; determining the target position based on the hand movement starting point corresponding to the target hand movement direction; and identifying the user located at the target position among the at least one users as the target user.

[0062] In this embodiment of the application, the starting point of hand movement is different in different positions. In order to further determine the target user from the at least one user, after determining the target hand movement direction towards the target display screen from the hand movement direction of each user in the at least one user, the user from which the target hand movement direction comes can be locked based on the starting point of hand movement corresponding to the target hand movement direction, that is, the target position can be determined. Then, the user in the at least one user located at the target position can be determined as the target user.

[0063] Taking an in-vehicle scenario as an example, the at least one user includes the driver and the front passenger, from which the target user can be identified. Specifically, if the user's hand movement trajectory has a first displacement greater than 0 in the first direction (Δx>0) and a second displacement greater than 0 in the second direction (Δz>0), the user's hand movement direction can be determined as the target hand movement direction. The starting point of the hand movement corresponding to the target hand movement direction must satisfy the following condition: Then, the target position can be determined as the driver's position, and the driver in the driver's position can be identified as the target user. In the above process, the first displacement and second displacement within multiple pairs of adjacent image frames can be continuously judged. For example, the user's hand movement direction can only be determined as the target hand movement direction if the first displacement is greater than 0 and the second displacement is greater than 0 in three consecutive pairs of adjacent image frames.

[0064] If the user's hand movement trajectory has a first displacement less than 0 in the first direction (Δx < 0) and a second displacement greater than 0 in the second direction (Δz > 0), the user's hand direction can be determined as the target hand movement direction. If the starting point of the hand movement corresponding to the target hand movement direction satisfies the following condition: Then, the target location can be determined as the passenger seat, and the passenger in the passenger seat can be identified as the target user. In the above process, the first and second displacements within multiple pairs of adjacent image frames can be continuously determined. For example, the user's hand movement direction can only be determined as the target hand movement direction if the first displacement is less than 0 and the second displacement is greater than 0 in three consecutive pairs of adjacent image frames.

[0065] in, The position of the starting point of the hand movement. Let W be the position of the target display screen, and W be the screen width of the target display screen.

[0066] In this embodiment, the target position can be determined based on the starting point of the hand movement corresponding to the direction of the target hand movement, and the user located at the target position among the at least one users can be identified as the target user. In other words, the starting point of the hand movement can further locate the target user who triggered the target operation, thereby improving the accuracy of target user identification.

[0067] Since a user's gesture trajectory may not necessarily pinpoint the user who triggered the target operation from among the at least one users, the target user can be further determined by the direction of their gaze. In one embodiment of this application, the at least one user may be multiple users; the step of identifying the current user using the application from among the at least one users based on the hand movement direction of each of the at least one users further includes: if there is no target user among the at least one users, or if there are multiple target users among the at least one users, determining a designated user whose eyes are facing the target display screen from among the at least one users based on the multiple image frames, and identifying the designated user as the current user using the application.

[0068] In this embodiment, if there is no target user among the at least one users (i.e., the target user cannot be determined through user gesture trajectories), or if there are multiple target users among the at least one users (i.e., it is impossible to accurately locate a user using the application), the target user can be determined from the at least one users by tracking the user's eye direction. Specifically, an eye-tracking algorithm and the multiple image frames can be used to identify the user's eye movement direction. By determining whether the user's eyes are facing the target display screen, it can be determined whether the user has a tendency to use the application.

[0069] Specifically, for any one of the at least one users, based on the multiple image frames, it can be determined whether the user's eyes are facing the target display screen. If the user's eyes are facing the target display screen, then the user can be identified as a designated user. If only one designated user exists among the at least one users, then the designated user can be identified as the current user using the application. If multiple designated users exist among the at least one users, it can be determined that no current user using the application has been detected, or a target designated user can be selected from the multiple designated users through other means, and that target designated user can be identified as the current user using the application.

[0070] For specific examples, please refer to Figure 4, Figure 4 This is an example diagram illustrating how to determine the current user of the application, as provided in an embodiment of this application. Figure 4 As shown, in an in-vehicle scenario, once the vehicle is powered on (i.e., after the user gets in), the usage status of applications on the in-vehicle central control screen can be monitored in real time. For example, the running status of application A can be detected. If application A is not detected to be running, no action can be taken. If application A is detected to be running, the user's position that triggered the start of application A can be determined by recognizing the user's gesture trajectory (i.e., hand movement trajectory).

[0071] If the user's location, triggering the start of application A, is determined by recognizing the user's gesture trajectory, then the user's facial information at that location is acquired via camera and matched against facial information stored in the authentication database. If the authentication database contains user A's facial information that matches the user's facial information at that location, the user at that location is identified as user A, and the database used by application A is switched to user A's personal database. If no matching facial information is found in the authentication database, it is determined that the user at that location has not enabled the personal database function, and the database used by application A is switched to a public database.

[0072] If the user's location that triggered the launch of application A cannot be determined by recognizing the user's gesture trajectory, it can be determined by viewing angle recognition. If the user's location is determined by viewing angle recognition, the camera can be used to acquire the user's facial information at that location, and this facial information can be matched against the facial information stored in the authentication database. If the user's location that triggered the launch of application A also cannot be determined by viewing angle recognition, it can be determined that the user using application A cannot be identified, and the database used by application A can be switched to a public database.

[0073] In this application embodiment, a multimodal fusion decision-making method is provided to identify the current user of the application. The method comprehensively judges the current user of the application based on user gesture recognition and viewing orientation recognition, thereby improving the accuracy of identifying the current user of the application.

[0074] In addition to the methods described above, the current user of the application can also be determined directly by eye orientation recognition. Specifically, in one embodiment of this application, the image information includes multiple image frames prior to the operation time point; the step of identifying the current user of the application from the at least one user based on the image information includes: determining a designated user whose eyes are facing the target display screen from the at least one user based on the multiple image frames; and identifying the designated user as the current user of the application.

[0075] In this embodiment, an eye-tracking algorithm and the multiple image frames can be used to identify the user's eye movement direction. By determining whether the user's eyes are facing the target display screen, it can be determined whether the user has a tendency to use the application. Specifically, for any one of the at least one users, based on the multiple image frames, it can be determined whether the user's eyes are facing the target display screen. If the user's eyes are facing the target display screen, then the user can be identified as a designated user. If only one designated user exists among the at least one users, then the designated user can be identified as the current user of the application. If multiple designated users exist among the at least one users, it can be determined that no current user of the application has been detected, or the current user of the application can be identified by other means (e.g., by recognizing the user's hand movement trajectory).

[0076] In this embodiment of the application, the current user of the application can be determined by identifying whether the user's eyes are facing the target display screen. This method takes into account the user's eye orientation during application use, thereby improving the accuracy of determining the current user of the application.

[0077] Step 340: In response to the current user using the application switching from the first user to the second user, the database used by the application is switched from the first database to the second database; wherein the first user and the second user are different users, the first database is the database applied to the first user, and the second database is the database applied to the second user.

[0078] In this embodiment, image information of at least one user can be acquired in real time to determine if a second user is still using the application. If the second user is detected no longer using the application, the application can be stopped to prevent other users from viewing the second user's personal privacy data related to the application. For example, in a vehicle scenario, if the front passenger is using application A displayed on the vehicle's central control screen, the in-vehicle OMS camera can acquire real-time image information of the occupants. Once the front passenger is detected getting out of the vehicle, the application can be stopped.

[0079] In this embodiment of the application, the current user of the application can be identified by the image information prior to the operation time of the target operation. This allows the database used by the application to be switched when the current user switches, thereby protecting user privacy.

[0080] Please see Figure 5 , Figure 5 This is a flowchart illustrating a method for running an application provided in an embodiment of this application. Figure 5 As shown, the method includes the following steps: Step 510: When the application is logged in by the first user, in response to the target operation, obtain the operation time point of the target operation; the target operation is the operation used to trigger the running of the application.

[0081] Step 520: Obtain image information prior to the operation time point, the image information including images of at least one user.

[0082] Step 530: Based on the image information, identify the current user using the application from among the at least one user.

[0083] The current user of the application can be identified by the user's hand movement trajectory. Specifically, in one embodiment of this application, the image information includes multiple image frames prior to the operation time point. Identifying the current user of the application from the at least one user based on the image information includes: determining the hand movement trajectory of each of the at least one user based on the multiple image frames; determining the hand movement direction of each of the at least one user based on the hand movement trajectory of each of the at least one user; and identifying the current user of the application from the at least one user based on the hand movement direction of each of the at least one user.

[0084] In one embodiment of this application, identifying the current user of the application from the at least one users based on the hand movement direction of each of the at least one users includes: determining a target user whose hand movement direction is towards a target display screen based on the hand movement direction of each of the at least one users; the target display screen is a display screen that displays the application; if there is only one target user among the at least one users, the target user is determined as the current user of the application.

[0085] In one embodiment of this application, determining the target user whose hand movement direction is toward the target display screen based on the hand movement direction of each of the at least one users includes: determining the target hand movement direction toward the target display screen based on the hand movement direction of each of the at least one users; obtaining the hand movement starting point corresponding to the target hand movement direction; determining the target position based on the hand movement starting point corresponding to the target hand movement direction; and identifying the user located at the target position among the at least one users as the target user.

[0086] In one embodiment of this application, when the current user of the application cannot be determined based on the user's hand movement trajectory, the current user of the application can be determined by the user's eye orientation. The at least one user can be multiple users. The step of identifying the current user of the application from the at least one users based on the hand movement direction of each of the at least one users further includes: if there is no target user among the at least one users, or if there are multiple target users among the at least one users, determining a designated user whose eyes are facing the target display screen from the at least one users based on the multiple image frames, and identifying the designated user as the current user of the application.

[0087] In this embodiment, the current user of the application can also be determined directly by identifying the user's eye orientation. Specifically, in one embodiment, the image information includes multiple image frames prior to the operation time point. Identifying the current user of the application from the at least one user based on the image information includes: determining a designated user whose eyes are facing a target display screen, which is a display screen showing the application, from the at least one user based on the multiple image frames; and identifying the designated user as the current user of the application.

[0088] Step 540: If a current user using the application is detected, obtain the identity information of the current user.

[0089] Step 550: If the current user is the second user, verify the identity information of the second user based on the pre-set authentication information database.

[0090] Step 560: Determine whether the identity verification of the second user was successful.

[0091] In step 560, if it is determined that the identity information of the second user is successfully verified, then step 570 is executed; if it is determined that the identity information of the second user fails to be verified, then step 580 is executed.

[0092] Step 570: Determine that the second database is the second user's personal database.

[0093] Step 580: Determine that the second database is a public database.

[0094] Step 590: In response to the current user using the application switching from the first user to the second user, switch the database used by the application from the first database to the second database.

[0095] In this embodiment, when the application is logged in by a first user, in response to a target operation, the current user using the application is detected; the target operation is an operation to trigger the running of the application; in response to the current user switching from the first user to a second user, the database used by the application is switched from a first database to a second database; wherein the first user and the second user are different users, the first database is the database applied to the first user, and the second database is the database applied to the second user. Thus, when the application is logged in by the first user, if the current user switches from the first user to the second user, the database used by the application can be switched from the first database to the second database, and the first database applied to the first user is no longer used. Therefore, the second user will not be able to see the personal data of the first user while using the application, resulting in better privacy and solving the problem of poor privacy in related technologies.

[0096] Please see Figure 6 , Figure 6 This is a structural block diagram of a device for running an application provided in an embodiment of this application. Figure 6 As shown, this application embodiment provides an apparatus 600 for running an application, the apparatus 600 for running an application includes: a determining module 610 and a switching module 620.

[0097] The determining module 610 is used to detect the current user using the application in response to a target operation when the application is in a state where the application is logged in by a first user; the target operation is an operation used to trigger the running of the application. The switching module 620 is configured to switch the database used by the application from the first database to the second database in response to the current user of the application switching from the first user to the second user. Wherein, the first user and the second user are different users, the first database is a database applied to the first user, and the second database is a database applied to the second user.

[0098] In this embodiment, when the application is logged in by a first user, in response to a target operation, the current user using the application is detected; the target operation is an operation to trigger the running of the application; in response to the current user switching from the first user to a second user, the database used by the application is switched from a first database to a second database; wherein the first user and the second user are different users, the first database is the database applied to the first user, and the second database is the database applied to the second user. Thus, when the application is logged in by the first user, if the current user switches from the first user to the second user, the database used by the application can be switched from the first database to the second database, and the first database applied to the first user is no longer used. Therefore, the second user will not be able to see the personal data of the first user while using the application, resulting in better privacy and solving the problem of poor privacy in related technologies.

[0099] In one embodiment of this application, the apparatus for running the application may further include an authentication module. After detecting the current user using the application, the authentication module is configured to: obtain the identity information of the current user if the current user is detected; verify the identity information of the second user based on a pre-set authentication information database if the current user is a second user; determine that the second database is a public database if the verification of the second user's identity information fails; and determine that the second database is the second user's personal database if the verification of the second user's identity information is successful.

[0100] In one embodiment of this application, during the process of detecting the current user using the application in response to a target operation, the determining module 610 is specifically configured to, in response to the target operation, obtain the operation time point of the target operation; obtain image information prior to the operation time point, the image information including images of at least one user; and, based on the image information, identify the current user using the application from the at least one user.

[0101] In one embodiment of this application, the image information includes multiple image frames prior to the operation time point. In the process of identifying the current user using the application from the at least one user based on the image information, the determining module 610 is specifically configured to: determine the hand movement trajectory of each of the at least one user based on the multiple image frames; determine the hand movement direction of each of the at least one user based on the hand movement trajectory of each of the at least one user; and identify the current user using the application from the at least one user based on the hand movement direction of each of the at least one user.

[0102] In one embodiment of this application, in the process of identifying the current user of the application from the at least one users based on the hand movement direction of each of the at least one users, the determining module 610 is specifically used to determine the target user whose hand movement direction is towards the target display screen based on the hand movement direction of each of the at least one users; the target display screen is the display screen that displays the application; if there is only one target user among the at least one users, the target user is determined as the current user of the application.

[0103] In one embodiment of this application, in the process of determining a target user whose hand movement direction is toward the target display screen based on the hand movement direction of each of the at least one users, the determining module 610 is specifically used to determine the target hand movement direction toward the target display screen based on the hand movement direction of each of the at least one users; obtain the hand movement starting point corresponding to the target hand movement direction; determine the target position based on the hand movement starting point corresponding to the target hand movement direction; and determine the user located at the target position among the at least one users as the target user.

[0104] In one embodiment of this application, the at least one user may be multiple users. During the process of identifying the current user using the application from the at least one users based on the hand movement direction of each of the at least one users, the determining module 610 is further configured to, if there is no target user among the at least one users, or if there are multiple target users among the at least one users, determine a designated user whose eyes are facing the target display screen from the at least one users based on the multiple image frames, and identify the designated user as the current user using the application.

[0105] In one embodiment of this application, the image information includes multiple image frames prior to the operation time point. In the process of identifying the current user using the application from the at least one user based on the image information, the determining module 610 is specifically configured to, based on the multiple image frames, determine a designated user whose eyes are facing a target display screen, the target display screen being a display screen showing the application; and determine the designated user as the current user using the application.

[0106] This application also provides a vehicle including the apparatus for running the application described in the above embodiments. This vehicle can be used to implement the steps of the various embodiments of the method for running the application described above, and can achieve the same technical effects; therefore, to avoid repetition, further details are omitted here.

[0107] See also Figure 7 , Figure 7 This is a structural block diagram of an electronic device provided in an embodiment of this application. For example... Figure 7 As shown in the illustration, this application also provides an electronic device 700. The electronic device 700 includes a processor 710 and a memory 720. The memory 720 stores programs or instructions, which, when executed by the processor 710, implement the steps of any of the methods described above. For example, when the program is executed by the processor 710, it implements the following process: when an application is logged in by a first user, in response to a target operation, the current user using the application is detected; the target operation is an operation to trigger the running of the application; in response to the current user using the application switching from the first user to a second user, the database used by the application is switched from a first database to a second database; wherein the first user and the second user are different users, the first database is a database applied to the first user, and the second database is a database applied to the second user. In this way, when the application is logged in by the first user, if the current user of the application is switched from the first user to the second user, the database used by the application can be switched from the first database to the second database, and the first database used by the first user will no longer be used. In this way, the second user will not be able to see the personal data of the first user when using the application, thus improving privacy and solving the problem of poor privacy in related technologies.

[0108] This application also provides a readable storage medium storing a program or instructions that, when executed by a processor, implement the steps of various embodiments of the method for running an application and achieve the same technical effect. To avoid repetition, these steps will not be repeated here.

[0109] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0110] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above method embodiments and achieve the same technical effect. To avoid repetition, it will not be described again here.

[0111] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the above method embodiments and achieve the same technical effects. To avoid repetition, it will not be described again here.

[0112] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0113] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0114] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A method for running an application, characterized in that, include: When the application is logged in by the first user, in response to the target operation, the current user using the application is detected; The target operation is an operation used to trigger the running of the application; In response to the current user of the application switching from the first user to the second user, the database used by the application is switched from the first database to the second database; Wherein, the first user and the second user are different users, the first database is a database applied to the first user, and the second database is a database applied to the second user.

2. The method according to claim 1, characterized in that, After detecting the current user using the application, the method further includes: If a current user is detected using the application, the identity information of the current user is obtained; If the current user is the second user, the identity information of the second user is verified based on a pre-set authentication information database; If the verification of the second user's identity information fails, the second database is determined to be a public database; If the identity information of the second user is successfully verified, the second database is determined to be the personal database of the second user.

3. The method according to claim 1 or 2, characterized in that, The step of detecting the current user using the application in response to a target operation includes: In response to a target operation, the operation time point of the target operation is obtained; Acquire image information prior to the operation time point, the image information including images of at least one user; Based on the image information, identify the current user using the application from among the at least one user.

4. The method according to claim 3, characterized in that, The image information includes multiple image frames prior to the operation time point; the step of identifying the current user using the application from the at least one user based on the image information includes: Based on the multiple image frames, determine the hand movement trajectory of each of the at least one users; Based on the hand movement trajectory of each of the at least one users, determine the hand movement direction of each of the at least one users; Based on the hand movement direction of each of the at least one users, identify the current user using the application from the at least one users.

5. The method according to claim 4, characterized in that, The step of identifying the current user using the application from the at least one users based on the hand movement direction of each of the at least one users includes: Based on the hand movement direction of each of the at least one users, a target user whose hand movement direction is towards the target display screen is determined; the target display screen is a display screen that displays the application. If there is only one target user among the at least one users, the target user is identified as the current user using the application.

6. The method according to claim 5, characterized in that, The step of determining the target user whose hand movement direction is toward the target display screen based on the hand movement direction of each of the at least one user includes: Based on the hand movement direction of each of the at least one users, determine the target hand movement direction toward the target display screen; Obtain the starting point of hand movement corresponding to the target hand movement direction; The target position is determined based on the starting point of the hand movement corresponding to the direction of the target hand movement; The user located at the target location among the at least one users is identified as the target user.

7. The method according to claim 5, characterized in that, The at least one user may be multiple users; the step of identifying the current user using the application from the at least one user based on the hand movement direction of each user further includes: If there is no target user among the at least one users, or if there are multiple target users among the at least one users, based on the multiple image frames, a designated user whose eyes are facing the target display screen is determined from the at least one user, and the designated user is determined as the current user using the application.

8. The method according to claim 3, characterized in that, The image information includes multiple image frames prior to the operation time point; the step of identifying the current user using the application from the at least one user based on the image information includes: Based on the plurality of image frames, a designated user whose eyes are oriented toward a target display screen is determined from the at least one user, the target display screen being a display screen that displays the application; The specified user is identified as the current user using the application.

9. An apparatus for running an application, characterized in that, include: A determination module is used to detect the current user using the application in response to a target operation when the application is in a state where the application is logged in by a first user. The target operation is an operation used to trigger the running of the application; A switching module is configured to switch the database used by the application from the first database to the second database in response to a change in the current user of the application from the first user to the second user. Wherein, the first user and the second user are different users, the first database is a database applied to the first user, and the second database is a database applied to the second user.

10. A vehicle, characterized in that, Includes the apparatus for running the application as described in claim 9.

Images