Intelligent movement control method and system for sliding screen

Abstract

A sliding screen intelligent movement control method and system belong to the field of sliding screen control, and comprise the steps of collecting facial information of a user, performing identity recognition on the user according to the facial information, and distributing a control authority of a sliding screen of a corresponding level to the user according to an identity recognition result; collecting head posture information and eyeball information of a user, wherein the eyeball information comprises a sight gazing direction and sight gazing time; when it is judged that the duration of continuously watching the preset device by the user exceeds a preset threshold value according to the eyeball information, a following mode of a sliding screen is started; and in the following mode, according to the head posture information and the eyeball information of the user, in combination with the control authority of the user, processing to obtain a control strategy, and controlling the sliding screen to correspondingly move according to the control strategy. The user identity can be accurately recognized, irrelevant personnel are prevented from operating the sliding screen, the sliding screen can be adjusted according to the posture and state of the user, the use requirement of the user is met, and the driving experience feeling is improved.

Description

Technical Field

[0001] The present application relates to the field of sliding screen control, and in particular to a sliding screen intelligent movement control method and system. Background Art

[0002] The existing sliding screen movement mainly relies on single facial angle recognition, which has problems such as false start, insufficient safety and single function. For example, it is impossible to accurately distinguish the user's true intention, and anyone can control the sliding screen through face recognition. Moreover, the movement of the sliding screen is limited to translation, which cannot adapt to different driving needs.

[0003] The prior art discloses a control method, device and equipment for a sliding screen, the method comprising: in response to a vehicle entering a preset mode, determining a facial key point from a facial image of a target passenger; obtaining a first angle between a line connecting the facial key point and the origin of a three-dimensional coordinate system corresponding to the sliding screen and the X-axis of the three-dimensional coordinate system, and a second angle between the line connecting and the Y-axis of the three-dimensional coordinate system; when the first angle is not within a first preset range, controlling the sliding screen to move in the direction of the X-axis according to the first angle and a first distance between the facial key point and the X-axis; when the second angle is not within a second preset range, controlling the sliding screen to move in the direction of the Y-axis according to the second angle and a second distance between the facial key point and the Y-axis. The above scheme adjusts the position of the sliding screen according to the relative angle between the passenger's face and the sliding screen, so that the sliding screen reaches the most suitable position for passengers to watch movies, effectively improving the passengers' viewing experience.

[0004] The defects of the prior art include:

[0005] 1. When using face recognition (such as eye-related features) to control the movement of the sliding screen, it is impossible to clearly distinguish whether the driver / co-driver really wants to change the position of the sliding screen or accidentally sees the feature collection device, which leads to the wrong activation of the sliding screen and affects the user experience;

[0006] 2. Anyone can slide the sliding screen through face recognition. Due to the inherent permissions and assisted driving functions of the sliding screen in the prior art (assuming that the default gesture starts the vehicle, etc.), there is a risk that outsiders other than the owner or those related to the owner may enter the vehicle through the sliding screen or cause other losses, which lacks security.

[0007] 3. The prior art can only translate the sliding screen, but cannot adjust the angle / up, down, left, and right movement of the sliding screen. Therefore, it may not be possible to use the screen for reflection, sunlight blocking, etc., and cannot adapt to different driving needs (such as driving without sunlight blocking, driving with sunlight blocking, and the viewing mode when the driver / co-driver wants to take a rest) according to the different head postures and facial features of the driver / co-driver, and lacks practicality. Summary of the invention

[0008] The present application provides a sliding screen intelligent movement control method and system, which can solve the technical problems existing in the prior art that the sliding screen control mode is single and the safety cannot be guaranteed.

[0009] In a first aspect, an embodiment of the present application provides a sliding screen intelligent movement control method, the sliding screen intelligent movement control method comprising:

[0010] Collect the user's facial information, identify the user based on the facial information, and assign the user a corresponding level of sliding screen control authority based on the result of the identification;

[0011] Collecting the user's head posture information and eye information, wherein the eye information includes the gaze direction and the gaze duration;

[0012] When it is determined based on the eye information that the time for which the user continues to gaze at the preset device exceeds a preset threshold, the following mode of the sliding screen is enabled; in the following mode, a control strategy is obtained based on the user's head posture information and eye information, combined with the user's control authority, and the sliding screen is controlled to move accordingly according to the control strategy.

[0013] In combination with the first aspect, in one implementation, the method further includes:

[0014] After the user is identified based on the facial information, if the user's head posture information and eyeball information are not collected within a preset time period, or if the user's operation instructions for the sliding screen are not received within a preset time period, the user's control authority is locked and the number of abnormalities is accumulated;

[0015] When the number of abnormalities exceeds a preset number, the user is prohibited from controlling the sliding screen and an alarm message is output.

[0016] In combination with the first aspect, in one implementation, the method further includes:

[0017] When the user's control authority is locked and the number of exceptions does not exceed the preset number, if the user's facial information is collected again, the user is identified based on the facial information, and the user is assigned control authority for the sliding screen based on the identification result.

[0018] In combination with the first aspect, in one implementation, the method further includes:

[0019] In the follow mode, if an operation instruction for the sliding screen is received from the user, the operation of the sliding screen is controlled according to the operation instruction, and relevant data is recorded, and machine learning is performed in combination with the relevant data to update the control strategy in the control strategy database.

[0020] In combination with the first aspect, in one implementation, the method further includes:

[0021] A custom setting function is provided, and the user uses the custom setting function to set the facial information, head posture information, and / or eye information corresponding to the control strategy.

[0022] In combination with the first aspect, in one implementation, the head posture information includes a head tilt angle and a head rotation direction.

[0023] In combination with the first aspect, in one embodiment, the control strategy includes determining that the user is in a normal driving state and not adjusting the position of the sliding screen when the user's head is facing the front of the vehicle without turning and the time the user's line of sight is looking straight ahead exceeds a preset threshold.

[0024] In combination with the first aspect, in one embodiment, the control strategy includes judging that the user is in an abnormal driving state if the direction of the user's head rotation within a preset time period is greater than a preset threshold and the duration of the user's multiple gazes is less than a preset duration, and then adjusting the position of the sliding screen.

[0025] In combination with the first aspect, in one embodiment, when it is determined that the user is in an abnormal driving state, the display status of the in-car display screen is collected to determine whether the in-car display screen is in a playing state. If so, the display screen is moved to the optimal playing position. If not, the light direction outside the car is collected and the display screen is moved to the optimal blocking position to block the sunlight from interfering with the user's line of sight.

[0026] In a second aspect, an embodiment of the present application provides a sliding screen intelligent movement control system, and the sliding screen intelligent movement control system includes:

[0027] A data collection module is used to collect the user's facial information, identify the user based on the facial information, and assign the user a corresponding level of control authority for the sliding screen based on the result of the identification; it is also used to collect the user's head posture information and eyeball information, the eyeball information including the gaze direction and gaze duration;

[0028] The data processing module is used to enable the following mode of the sliding screen when it is determined based on the eye information that the user continues to gaze at the preset device for a period of time exceeding a preset threshold; in the following mode, the control strategy is obtained based on the user's head posture information and eye information, combined with the user's control authority, and the sliding screen is controlled to move accordingly according to the control strategy.

[0029] The beneficial effects brought by the technical solution provided by the embodiments of the present application include:

[0030] Improve user experience: Accurately identify user intentions to avoid accidental activation, and automatically adjust the position and angle of the sliding screen according to user needs to improve comfort and convenience during driving.

[0031] Enhanced security: Introducing multimodal biometric recognition and permission management to effectively prevent outsiders from controlling the sliding screen and ensure the security of vehicle and user information.

[0032] Improve practicality: Realize multi-dimensional movement of the sliding screen to adapt to different driving scenarios and user needs, and improve the practicality and intelligence level of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 This is a flow chart of an embodiment of a sliding screen intelligent movement control method of the present application;

[0034] Figure 2 This is a schematic diagram of the functional modules of an embodiment of the sliding screen intelligent mobile control system of the present application. DETAILED DESCRIPTION

[0035] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0036] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0037] In a first aspect, an embodiment of the present application provides a method for intelligent movement control of a sliding screen.

[0038] In one embodiment, referring to Figure 1 , Figure 1 This is a flow chart of the first embodiment of the sliding screen intelligent movement control method of the present application. Figure 1 As shown, the sliding screen intelligent movement control method includes:

[0039] Step S1, collecting the user's facial information, identifying the user based on the facial information, and assigning the user a corresponding level of sliding screen control authority based on the result of the identification.

[0040] Step S2: collecting the user's head posture information and eye information, where the eye information includes the gaze direction and gaze duration.

[0041] Step S3: When it is determined based on the eye information that the user continues to gaze at the preset device for a period exceeding a preset threshold, the following mode of the sliding screen is enabled. In the following mode, a control strategy is obtained based on the user's head posture information and eye information, combined with the user's control authority, and the sliding screen is controlled to move accordingly according to the control strategy.

[0042] Step S1 and step S2 can be performed simultaneously.

[0043] In this embodiment, by collecting the user's facial information, the user's facial features can be extracted based on the facial information, the user's identity can be accurately identified based on the extracted facial features, and appropriate control permissions can be assigned to different users based on their identities, thereby ensuring that different users can only perform specified operations on the sliding screen, improving security, and avoiding safety hazards caused by unrelated users operating the sliding screen.

[0044] By collecting the user's head posture information and eye information, the user's head posture features and eye features can be extracted. The user's current control needs can be accurately identified based on the head posture features and eye features, and the sliding screen can be appropriately moved according to different needs, thereby improving the intelligence of the sliding screen control, avoiding misjudgment, and improving the user experience.

[0045] The eye information includes the gaze direction and gaze duration. Only when the user continues to gaze at the preset device for a period of time exceeding a preset threshold (the preset threshold here is customized according to the actual situation, and its specific value can also be automatically adjusted in combination with relevant parameters), it is determined that the user does have the intention to control the sliding screen, so as to avoid the movement control of the sliding screen being mistakenly triggered due to the user's unintentional actions when the user has no intention to control the sliding screen.

[0046] The facial feature database, eye feature database, and control strategy database can be configured in advance. The control model can be pre-trained by combining the training data in the facial feature database, eye feature database, and control strategy database. After the model is trained, the model is used to process the newly collected facial features and eye features to obtain the corresponding control strategy, and the control model and control strategy are optimized in combination with the user's feedback after each control. Among them, after controlling the movement of the sliding screen according to the control strategy, the user's facial information, head posture information, and eye information can continue to be collected. If the user is identified as having an emotion based on the facial information, or the user is identified as not adapting to the new position of the sliding screen based on the head posture information and eye information, etc., the control model can be adjusted based on the recognition result feedback to optimize the subsequent output control strategy.

[0047] In a specific embodiment, the present invention adopts advanced multimodal biometric recognition technology, which integrates multiple technical means such as facial feature recognition, head posture recognition, and eye tracking to achieve accurate judgment of user intentions.

[0048] Facial feature recognition: Using deep learning algorithms, the system can accurately identify and verify the user's facial features, ensuring that only users logged into the system can perform operations.

[0049] Head posture recognition: Through head posture recognition technology, the system can capture the user's head posture information in real time, including the tilt angle and rotation direction of the head. This information combined with eye tracking and facial feature recognition results can further improve the accuracy of judging the user's intentions.

[0050] Eye tracking: Through high-precision eye tracking technology, the system can capture and analyze the user's eye movement trajectory in real time, including key information such as gaze direction and gaze time. When the user stares at the feature acquisition device for a long time and steadily, the system will regard the user as intending to adjust the position of the sliding screen.

[0051] Combined with user behavior pattern learning, the system can continuously learn and optimize the recognition algorithm for user intentions to improve the accuracy and stability of recognition. When the user intends to adjust the position of the sliding screen, the system will automatically calculate and move the sliding screen to the nearest target position based on the user's position and line of sight to meet the user's actual needs.

[0052] In summary, the present invention can accurately identify the identity of the user, prevent irrelevant personnel from operating the sliding screen, and can adjust the sliding screen according to the user's posture and state to meet the user's usage needs and improve the driving experience.

[0053] Furthermore, in one embodiment, the above method further includes:

[0054] After the user is identified based on facial information, if the user's head posture information and eye information are not collected within a preset time period, or if the user's operation instructions for the sliding screen are not received within a preset time period, the user's control authority will be locked and the number of abnormalities will be accumulated.

[0055] When the number of abnormalities exceeds a preset number, the user is prohibited from controlling the sliding screen and an alarm message is output.

[0056] In this embodiment, in order to ensure the security and reliability of the sliding screen control, the present invention introduces a strict authority management and security authentication mechanism.

[0057] In the vehicle, the system will first ask the user to enter facial information, which will serve as an important basis for the system to identify the user's identity and authority. The input process must ensure the accuracy and completeness of the user's facial features so that the system can perform subsequent identification and verification.

[0058] The system will set the corresponding permission level for the user according to their role and needs. The permission level may include but is not limited to: system access rights, sliding screen operation rights, specific function use rights, etc. Every time a user attempts to use the system, the system will authenticate the user through facial feature recognition technology. If the verification is successful, the user will obtain the corresponding system access and operation rights.

[0059] If a user is temporarily deprived of permissions by the system for some reason (such as not using the system for a threshold period of time), they can restore permissions by reauthenticating. If the system detects abnormal behavior of the user, the system will immediately take security measures (such as locking the account) and notify the administrator to handle it.

[0060] Furthermore, in one embodiment, the above method further includes:

[0061] When the user's control authority is locked and the number of exceptions does not exceed the preset number, if the user's facial information is collected again, the user is identified based on the facial information, and the user is assigned control authority for the sliding screen based on the identification result.

[0062] In this embodiment, the system sets a threshold time to determine whether the user has used the system within the preset time. If the user does not use the system within the threshold time, his / her facial feature information will be automatically transferred to the candidate list and the number of abnormalities will be recorded. Users on the candidate list need to re-authenticate before their use rights can be restored. This mechanism helps prevent unauthorized users from entering the system through illegal means.

[0063] Furthermore, in one embodiment, the above method further includes:

[0064] In the follow mode, if an operation instruction for the sliding screen is received from the user, the operation of the sliding screen is controlled according to the operation instruction, and relevant data is recorded, and machine learning is performed in combination with the relevant data to update the control strategy in the control strategy database.

[0065] In this embodiment, the priority of the operation instruction and the priority of the control strategy can be pre-configured. If the priority of the control strategy is high, during the execution of the control strategy, even if an operation instruction is received, the sliding screen is still controlled according to the control strategy. If the priority of the operation instruction is high, during the execution of the control strategy, if an operation instruction is received, the sliding screen is mainly controlled based on the operation instruction.

[0066] Furthermore, in one embodiment, the above method further includes:

[0067] The above method further includes:

[0068] A custom setting function is provided, and the user uses the custom setting function to set the facial information, head posture information, and / or eye information corresponding to the control strategy.

[0069] In this embodiment, the user database supports manual update operations so that users can update their facial feature information at any time. This helps ensure that the user information stored in the system is always up to date. Users can manually delete or modify their facial feature information. This provides users with greater flexibility and security. The system will regularly back up the user database to prevent data loss. At the same time, the system will also encrypt the user database to ensure data confidentiality and security.

[0070] Furthermore, in one embodiment, the head posture information includes a head tilt angle and a head rotation direction.

[0071] The above control strategy includes determining that the user is in a normal driving state and not adjusting the position of the sliding screen when it is determined that the user's head is facing the front of the vehicle without turning and the time the user's line of sight is looking straight ahead exceeds a preset threshold.

[0072] In this embodiment, the system can accurately determine the driving state that the user may be in based on the relationship between the user's eye gaze sensor and the head posture. For example, when the user's eyes are looking forward and the head posture is stable, the system determines that it is a normal driving state.

[0073] Furthermore, in one embodiment, the head posture information includes a head tilt angle and a head rotation direction.

[0074] The above control strategy includes determining that the user is in an abnormal driving state and adjusting the position of the sliding screen if the direction of the user's head rotation within a preset time period is greater than a preset threshold and the duration of the user's multiple gazes is less than a preset duration.

[0075] When it is determined that the user is in an abnormal driving state, the display status of the in-car display screen is collected to determine whether the in-car display screen is in a playing state. If so, the display screen is moved to the optimal playing position. If not, the light direction outside the car is collected and the display screen is moved to the optimal blocking position to block the interference of sunlight on the user's vision.

[0076] In this embodiment, when the user's eyeballs frequently turn to one side and the head posture changes significantly, the system may determine that it is a special case such as sunlight blocking or the need to adjust the direction of sight. Based on the judgment of the user's driving status, the system will automatically adjust the position and angle of the sliding screen. For example, in the case of sunlight blocking, the system will automatically move the sliding screen to a suitable position and adjust the angle to reduce the interference of sunlight on the user's sight. In the movie viewing mode, the system will automatically adjust the horizontal and vertical angles of the sliding screen according to the user's head posture and line of sight to provide the best viewing experience.

[0077] In addition, the system also supports users to customize the movement trajectory and angle adjustment range of the sliding screen to meet the personalized needs of different users. At the same time, the system will also monitor user feedback and behavior habits in real time, and continuously optimize and adjust algorithm parameters to improve the system's intelligence level and user experience.

[0078] In a second aspect, an embodiment of the present application also provides a sliding screen intelligent movement control system.

[0079] In one embodiment, referring to Figure 2 , Figure 2 This is a functional module diagram of an embodiment of the sliding screen intelligent mobile control system of the present application. Figure 2 As shown, the sliding screen intelligent mobile control system includes:

[0080] The data collection module 1 is used to collect the user's facial information, identify the user based on the facial information, and assign the user a corresponding level of sliding screen control authority based on the result of the identification. It is also used to collect the user's head posture information and eyeball information, and the above eyeball information includes the gaze direction and gaze time.

[0081] The data processing module 2 is used to enable the following mode of the sliding screen when it is determined based on the eye information that the user continues to gaze at the preset device for a period of time exceeding a preset threshold. In the following mode, the control strategy is obtained based on the user's head posture information and eye information, combined with the user's control authority, and the sliding screen is controlled to move accordingly according to the control strategy.

[0082] In this embodiment, by collecting the user's facial information, the user's facial features can be extracted based on the facial information, the user's identity can be accurately identified based on the extracted facial features, and appropriate control permissions can be assigned to different users based on their identities, thereby ensuring that different users can only perform specified operations on the sliding screen, improving security, and avoiding safety hazards caused by unrelated users operating the sliding screen.

[0083] By collecting the user's head posture information and eye information, the user's head posture features and eye features can be extracted. The user's current control needs can be accurately identified based on the head posture features and eye features, and the sliding screen can be appropriately moved according to different needs, thereby improving the intelligence of the sliding screen control, avoiding misjudgment, and improving the user experience.

[0084] The eye information includes the gaze direction and gaze duration. Only when the user continues to gaze at the preset device for a period of time exceeding a preset threshold (the preset threshold here is customized according to the actual situation, and its specific value can also be automatically adjusted in combination with relevant parameters), it is determined that the user does have the intention to control the sliding screen, so as to avoid the movement control of the sliding screen being mistakenly triggered due to the user's unintentional actions when the user has no intention to control the sliding screen.

[0085] The facial feature database, eye feature database, and control strategy database can be configured in advance. The control model can be pre-trained by combining the training data in the facial feature database, eye feature database, and control strategy database. After the model is trained, the model is used to process the newly collected facial features and eye features to obtain the corresponding control strategy, and the control model and control strategy are optimized in combination with the user's feedback after each control. Among them, after controlling the movement of the sliding screen according to the control strategy, the user's facial information, head posture information, and eye information can continue to be collected. If the user is identified as having an emotion based on the facial information, or the user is identified as not adapting to the new position of the sliding screen based on the head posture information and eye information, etc., the control model can be adjusted based on the recognition result feedback to optimize the subsequent output control strategy.

[0086] In summary, the present invention can accurately identify the identity of the user, prevent irrelevant personnel from operating the sliding screen, and can adjust the sliding screen according to the user's posture and state to meet the user's usage needs and improve the driving experience.

[0087] In a specific embodiment, the data acquisition module 1 includes an eye tracking device, which captures the user's eye images in real time through a built-in camera or sensor. These images are usually collected at a high frame rate (such as 120Hz) to ensure that the subtle movements of the eye can be captured.

[0088] The data processing module 2 processes the captured eyeball image and extracts key features of the eyeball, such as pupil position, corneal reflection, etc. These features will be used for subsequent analysis of the user's gaze direction and gaze time.

[0089] The data processing module 2 calculates the user's gaze direction through an algorithm based on the extracted eye feature information. This usually involves geometric transformation and coordinate conversion of the eye image to determine the user's line of sight direction. The data processing module 2 records the time the user continuously gazes at the feature acquisition device. When this time reaches a preset threshold, the system believes that the user may intend to perform a certain operation.

[0090] When the user's gaze time reaches a preset threshold and the gaze direction stably points to the feature acquisition device, the data processing module 2 system determines that the user intends to adjust the position of the sliding screen. Once the system determines the user's intention, it will immediately trigger the corresponding response operation. This may include calculating the optimal moving position of the sliding screen, sending control instructions to the sliding screen driver, etc. The sliding screen will move to a new position according to the system's instructions. At this time, the system may provide visual or auditory feedback to inform the user that the operation has been successfully completed. At the same time, the system will continue to monitor the user's eye movements so that further adjustments can be made if necessary.

[0091] The system monitors the user's eye movement trajectory in real time to detect any possible abnormal behavior (such as rapid eye blinking, sudden changes in gaze direction, etc.). These abnormal behaviors may indicate that the user is experiencing discomfort or distraction. If the system detects abnormal behavior, it may take a series of safety measures, such as pausing the movement of the sliding screen, issuing a warning sound, etc. These measures are designed to ensure that users operate the system in a safe environment.

[0092] The system may also allow the user to provide feedback through specific means (such as buttons, voice commands, etc.) to enable manual adjustments or resets when necessary.

[0093] Among them, the functional implementation of each module in the above-mentioned sliding screen intelligent movement control system corresponds to the various steps in the above-mentioned sliding screen intelligent movement control method embodiment, and its functions and implementation processes will not be repeated here one by one.

[0094] It should be noted that the serial numbers of the above-mentioned embodiments of the present application are only for description and do not represent the advantages or disadvantages of the embodiments.

[0095] The terms "including" and "having" and any variations thereof in the specification and claims of this application and the above-mentioned drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices. The terms "first", "second" and "third" are used to distinguish different objects, etc., and do not represent a sequence, nor do they limit "first", "second" and "third" to different types.

[0096] In the description of the embodiments of the present application, "exemplary", "for example" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary", "for example" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary", "for example" or "for example" is intended to present related concepts in a specific way.

[0097] In the description of the embodiments of the present application, unless otherwise specified, “ / ” means or, for example, A / B can mean A or B; the “and / or” in the text is merely a description of the association relationship of associated objects, indicating that three relationships may exist, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, “multiple” refers to two or more than two.

[0098] In some processes described in the embodiments of the present application, multiple operations or steps that appear in a specific order are included, but it should be understood that these operations or steps may not be executed in the order in which they appear in the embodiments of the present application or in parallel, and the sequence number of the operation is only used to distinguish the different operations, and the sequence number itself does not represent any execution order. In addition, these processes may include more or fewer operations, and these operations or steps may be executed in sequence or in parallel, and these operations or steps may be combined.

[0099] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, disk, CD) as described above, and includes a number of instructions for a terminal device to execute the methods described in each embodiment of the present application.

[0100] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A sliding screen intelligent movement control method, characterized in that: The sliding screen intelligent movement control method comprises: Collect the user's facial information, identify the user based on the facial information, and assign the user a corresponding level of sliding screen control authority based on the result of the identification; Collecting the user's head posture information and eye information, wherein the eye information includes the gaze direction and the gaze duration; When it is determined based on the eye information that the time for which the user continues to gaze at the preset device exceeds a preset threshold, the following mode of the sliding screen is enabled; in the following mode, a control strategy is obtained based on the user's head posture information and eye information, combined with the user's control authority, and the sliding screen is controlled to move accordingly according to the control strategy.

2. The sliding screen intelligent movement control method according to claim 1, characterized in that: The method further comprises: After the user is identified based on the facial information, if the user's head posture information and eyeball information are not collected within a preset time period, or if the user's operation instructions for the sliding screen are not received within a preset time period, the user's control authority is locked and the number of abnormalities is accumulated; When the number of abnormalities exceeds a preset number, the user is prohibited from controlling the sliding screen and an alarm message is output.

3. The sliding screen intelligent movement control method according to claim 2, characterized in that: The method further comprises: When the user's control authority is locked and the number of exceptions does not exceed the preset number, if the user's facial information is collected again, the user is identified based on the facial information, and the user is assigned control authority for the sliding screen based on the identification result.

4. The sliding screen intelligent movement control method according to claim 1, characterized in that: The method further comprises: In the follow mode, if an operation instruction for the sliding screen is received from the user, the operation of the sliding screen is controlled according to the operation instruction, and relevant data is recorded, and machine learning is performed in combination with the relevant data to update the control strategy in the control strategy database.

5. The sliding screen intelligent movement control method according to claim 1, characterized in that: The method further comprises: A custom setting function is provided, and the user uses the custom setting function to set the facial information, head posture information, and / or eye information corresponding to the control strategy.

6. The sliding screen intelligent movement control method according to claim 1, characterized in that: The head posture information includes a head tilt angle and a head rotation direction.

7. The sliding screen intelligent movement control method according to claim 6, characterized in that: The control strategy includes determining that the user is in a normal driving state and not adjusting the position of the sliding screen when it is determined that the user's head is facing the front of the vehicle without turning and the time for which the user's line of sight is looking straight ahead exceeds a preset threshold.

8. The sliding screen intelligent movement control method according to claim 6, characterized in that: The control strategy includes determining that the user is in an abnormal driving state and adjusting the position of the sliding screen if the direction of the user's head rotation within a preset time period is greater than a preset threshold and the duration of the user's multiple gazes is less than a preset duration.

9. The sliding screen intelligent movement control method according to claim 8, characterized in that: When it is determined that the user is in an abnormal driving state, the display status of the in-car display screen is collected to determine whether the in-car display screen is in a playing state. If so, the display screen is moved to the optimal playing position. If not, the light direction outside the car is collected and the display screen is moved to the optimal blocking position to block the interference of sunlight on the user's vision.

10. A sliding screen intelligent mobile control system, characterized in that: The sliding screen intelligent mobile control system includes: A data collection module is used to collect the user's facial information, identify the user based on the facial information, and assign the user a corresponding level of control authority for the sliding screen based on the result of the identification; it is also used to collect the user's head posture information and eyeball information, the eyeball information including the gaze direction and gaze duration; The data processing module is used to enable the following mode of the sliding screen when it is determined based on the eye information that the user continues to gaze at the preset device for a period of time exceeding a preset threshold; in the following mode, the control strategy is obtained based on the user's head posture information and eye information, combined with the user's control authority, and the sliding screen is controlled to move accordingly according to the control strategy.

Images