Head-mounted device control method, apparatus, device, and storage medium

Abstract

This invention provides a head-mounted device control method, apparatus, device, and storage medium, belonging to the field of device control technology. The method includes: acquiring head posture data and motion data of a user wearing the head-mounted device; determining the user's behavior pattern based on the head posture data and motion data; and if the behavior pattern is a privacy risk mode, controlling the camera component of the head-mounted device to prohibit shooting operations. This avoids errors in determining privacy risk modes caused by positioning errors when relying on geographical location or specific scenarios, and also avoids privacy leaks caused by images captured by the camera component to identify the user's environment or scene. Furthermore, by prohibiting the head-mounted device from executing shooting commands based on the camera component when the user's behavior pattern indicates a privacy risk mode, this invention reduces the probability of head-mounted devices infringing on user privacy.

Description

Technical Field

[0001] This invention relates to the field of equipment control technology, and in particular to a head-mounted device control method, apparatus, equipment, and storage medium. Background Technology

[0002] Current head-mounted devices, such as AR glasses and AI glasses, typically integrate cameras to achieve functions such as environmental perception and image recognition. These devices are now widely used in consumer, industrial, medical, and security fields. As the applications of head-mounted devices expand, their privacy and security issues are receiving increasing attention. Head-mounted devices can collect images of the surrounding environment and facial information without the user's awareness, thus constituting a privacy violation.

[0003] Therefore, reducing the probability of head-mounted devices infringing on user privacy is an urgent technical problem to be solved. Summary of the Invention

[0004] This invention provides a head-mounted device control method, apparatus, device, and storage medium, aiming to reduce the probability of head-mounted devices infringing on user privacy.

[0005] In a first aspect, embodiments of the present invention provide a head-mounted device control method, comprising: Acquire head posture and motion data of the user wearing the head-mounted device; The user's behavior pattern is determined based on the head posture data and the motion data; If the behavior mode is a privacy risk mode, then the camera component controlling the head-mounted device is prohibited from performing shooting operations.

[0006] In a second aspect, embodiments of the present invention also provide a head-mounted device control device, comprising: The data acquisition module is used to acquire head posture data and motion data of the user wearing the head-mounted device; A behavior pattern determination module is used to determine the behavior pattern of the wearer based on the head posture data and the motion data; An operation control module is used to control the camera component of the head-mounted device to prohibit shooting operations if the behavior mode is a privacy risk mode.

[0007] Thirdly, embodiments of the present invention also provide a head-mounted device, the head-mounted device including a processor, a memory, a computer program stored in the memory and executable by the processor, and a data bus for implementing communication between the processor and the memory, wherein when the computer program is executed by the processor, it implements the head-mounted device control method as described in the first aspect.

[0008] Fourthly, embodiments of the present invention also provide a storage medium for computer-readable storage, the storage medium storing one or more programs, the one or more programs being executable by one or more processors to implement the head-mounted device control method as described in the first aspect.

[0009] This invention provides a method, apparatus, device, and storage medium for controlling a head-mounted device. By acquiring head posture and motion data of a user wearing the head-mounted device, this invention determines the user's behavior pattern based on the head posture and motion data. If the behavior pattern is a privacy risk mode, the camera component of the head-mounted device is prohibited from performing shooting operations. This proposes a privacy risk mode determination method based on the user's behavior pattern. This method eliminates the need to identify the user's environment or scene through images captured by the camera component, and also avoids determining whether the user is in a privacy risk mode based on geographical location or a specific scene. It determines the privacy risk mode based on the user's own behavior pattern, avoiding errors caused by positioning errors when determining privacy risk modes based on geographical location or a specific scene. It also avoids privacy leaks caused by images captured by the camera component when identifying the user's environment or scene. Furthermore, this invention reduces the probability of head-mounted devices infringing on user privacy when the user is determined to be in a privacy risk mode based on their behavior pattern, thus prohibiting the head-mounted device from executing shooting commands based on the camera component. Attached Figure Description

[0010] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the following description of the embodiments will be briefly introduced. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0011] Figure 1 This is a flowchart illustrating a head-mounted device control method provided in an embodiment of the present invention; Figure 2 This is a flowchart illustrating another head-mounted device control method provided in an embodiment of the present invention; Figure 3 This is a schematic block diagram of the structure of a head-mounted device control device provided in an embodiment of the present invention; Figure 4 This is a schematic block diagram of a head-mounted device provided in an embodiment of the present invention. Detailed Implementation

[0012] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0013] The flowchart shown in the attached diagram is for illustrative purposes only and does not necessarily include all content and operations / steps, nor does it necessarily have to be performed in the order described. For example, some operations / steps can be broken down, combined, or partially merged, so the actual execution order may change depending on the actual situation.

[0014] It should be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the invention. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0015] Current head-mounted devices, such as AR glasses and AI glasses, typically integrate cameras to achieve functions like environmental perception and image recognition. These devices are now widely used in consumer, industrial, medical, and security fields. As the application areas of head-mounted devices expand, their privacy and security issues are receiving increasing attention. Head-mounted devices can collect images of the surrounding environment and facial information without the user's awareness, thus potentially violating privacy. Therefore, reducing the probability of head-mounted devices infringing on user privacy is a pressing technical problem that needs to be solved.

[0016] To address the aforementioned problems, this invention provides a head-mounted device control method, apparatus, device, and storage medium. This invention acquires head posture and motion data of a user wearing the head-mounted device, determines the user's behavior pattern based on this data, and if the behavior pattern is a privacy risk mode, the camera component of the head-mounted device is prohibited from performing shooting operations. This proposes a privacy risk mode determination method based on the user's behavior pattern. This method eliminates the need to identify the user's environment or scene through images captured by the camera component, and also avoids determining privacy risk modes based on geographical location or specific scenes. It determines privacy risk modes based on the user's behavior pattern, avoiding errors caused by positioning mistakes when determining privacy risk modes based on geographical location or specific scenes. It also avoids privacy leaks caused by images captured by the camera component when identifying the user's environment or scene. When the user's behavior pattern is determined to be a privacy risk mode, the head-mounted device is prohibited from executing shooting commands based on the camera component, reducing the probability of the head-mounted device infringing on user privacy.

[0017] The head-mounted device control method provided in this invention can be applied to head-mounted devices or control devices that are communicatively connected to them; this invention does not specifically limit the application. The head-mounted device may include augmented reality (AR) glasses, smart glasses without a display, AR helmets, mixed reality (MR) glasses, and MR helmets. The control device may include smartphones, tablets, laptops, desktop computers, personal digital assistants, and wearable devices, etc.

[0018] The following detailed description, in conjunction with the accompanying drawings, outlines some embodiments of the present invention. Unless otherwise specified, the following embodiments and features can be combined with each other. For ease of description, the following embodiments are illustrated using the application of a head-mounted device control method to a head-mounted device as an example.

[0019] Please see Figure 1 , Figure 1 This is a flowchart illustrating a head-mounted device control method provided in an embodiment of the present invention.

[0020] like Figure 1 As shown, the head-mounted device control method includes steps S101 to S103.

[0021] Step S101: Obtain head posture data and motion data of the user wearing the head-mounted device.

[0022] In this embodiment, the head-mounted device may or may not have a display function. The head-mounted device integrates an IMU (Inertial Measurement Unit), which collects head posture and motion data from the user wearing the device. The IMU's data acquisition frequency can be set between 50Hz and 100Hz. The head posture data includes pitch, yaw, and roll angles, while the motion data includes acceleration and angular velocity along three axes: the X, Y, and Z axes in a spatial coordinate system.

[0023] The head-mounted device can periodically acquire the head posture and motion data of the user through the IMU, such as acquiring the user's head posture and motion data at regular intervals, which may be equal to the first preset duration and / or the second preset duration in subsequent embodiments.

[0024] In one embodiment, in order to reduce the power consumption of the head-mounted device, the head posture and motion data of the wearer can be acquired by an IMU when the head-mounted device is in a crowded place or indoors.

[0025] When a head-mounted device acquires head posture and motion data from a user, the data collected by the IMU can be analyzed within a fixed time window to obtain the user's head posture and motion data. The duration of this fixed time window can be set as needed, such as 3 seconds, 5 seconds, or 6 seconds. A fixed time window includes multiple sets of data, such as 250, 300, or 500 sets. By analyzing these multiple sets of data within the fixed time window, the user's head posture and motion data for that specific time window are obtained. In determining the user's behavior pattern, the head-mounted device uses data from at least one fixed time window to identify the user's behavioral pattern.

[0026] Step S102: Determine the user's behavior pattern based on the head posture data and the motion data.

[0027] In this embodiment of the invention, the user's behavior pattern is divided into a privacy risk mode and a privacy security mode. The privacy risk mode indicates that if the head-mounted device performs a shooting operation through the camera component in this behavior mode, it is easy to infringe on the user's privacy and there is a privacy security problem. The privacy security mode indicates that if the head-mounted device performs a shooting operation normally through the camera component in this behavior mode, it will not infringe on the user's privacy.

[0028] This embodiment uses the IMU in the head-mounted device to acquire the wearer's head posture and motion data. Based on the wearer's head posture and motion data, it determines the wearer's behavior pattern, thereby determining whether the wearer's behavior pattern belongs to a privacy risk mode. This achieves the goal of determining the privacy risk mode without relying on images captured by the camera component to identify the wearer's environment or scene, or relying on geographical location or specific scenes to determine whether it is in a privacy risk mode. It can determine the privacy risk mode based on the wearer's own behavior pattern, avoiding the situation where the privacy risk mode is incorrectly determined due to positioning errors in the process of determining whether it is in a privacy risk mode based on geographical location or specific scenes. It also avoids the situation where privacy is leaked due to images captured by the camera component to identify the wearer's environment or scene and then identify the privacy risk mode.

[0029] Step S103: If the behavior mode is a privacy risk mode, then the camera component of the head-mounted device is prohibited from performing shooting operations.

[0030] The head-mounted device pre-stores behavioral characteristics corresponding to privacy risk modes. Therefore, when the head-mounted device acquires the user's behavioral pattern, it compares these characteristics with those corresponding to the privacy risk mode. If the behavioral characteristics match, the user's behavior is determined to be in a privacy risk mode; otherwise, it is determined to be in a privacy security mode. When the head-mounted device determines the user's behavior is in a privacy risk mode, a privacy risk indicator is generated. When this indicator is present, the head-mounted device controls its camera to prevent recording. For example, if the user's behavior is in a privacy risk mode, the camera is turned off. If the user's behavior is in a privacy security mode, the camera maintains its current operating mode. This embodiment does not limit the form of the privacy risk indicator.

[0031] This embodiment acquires head posture and motion data of the user wearing the head-mounted device, determines the user's behavior pattern based on this data, and if the behavior pattern is a privacy risk mode, the camera component of the head-mounted device is prevented from performing any shooting operations. This proposes a privacy risk mode determination method based on the user's behavior pattern. This method eliminates the need to identify the user's environment or scene through images captured by the camera component, and also avoids determining privacy risk modes based on geographical location or specific scenarios. It determines privacy risk modes based on the user's behavior pattern, avoiding errors caused by positioning mistakes when determining privacy risk modes based on geographical location or specific scenarios. It also avoids privacy leaks caused by images captured by the camera component to identify the user's environment or scene. When the user's behavior pattern is determined to be a privacy risk mode, the head-mounted device is prohibited from executing shooting commands based on the camera component, reducing the probability of the head-mounted device infringing on user privacy.

[0032] In some embodiments, step S102 includes: Step a: If, based on the head posture data, it is determined that the user exhibits head-down behavior characteristics and micro-movement behavior characteristics within a first preset time period, and based on the motion data, it is determined that the user exhibits stationary behavior characteristics within the first preset time period, then the user's behavior pattern is determined to be a privacy risk pattern.

[0033] In one embodiment, during the process of determining the user's behavior pattern based on head posture data and motion data, the head-mounted device determines the user's behavioral characteristics using both head posture data and motion data. Specifically, head posture data and motion data are used to determine different behavioral characteristics. The first preset duration can be set according to specific needs; this embodiment does not impose a specific limitation on the size of the first preset duration. In this embodiment, the behavioral characteristics of the privacy risk mode are that the user exhibits head-down behavior, micro-movement behavior, and stationary behavior characteristics within the first preset duration. Head-down behavior and micro-movement behavior are behavioral characteristics of the user's head, while stationary behavior characteristics are behavioral characteristics of the user's entire body and micro-movement behavior. Therefore, if the head-mounted device determines that the user exhibits head-down behavior and micro-movement behavior characteristics within the first preset duration based on head posture data, and determines that the user exhibits stationary behavior characteristics within the first preset duration based on motion data, the head-mounted device determines that the user's behavior pattern is a privacy risk mode.

[0034] In some embodiments, the method further includes: if the pitch angle value in the head posture data is within a first preset range within the first preset time period, and the change range of the pitch angle is less than a first threshold, then it is determined that the user wearing the device has a head-down behavior characteristic. In one embodiment, the presence of a user exhibiting head-down behavior is determined by the pitch angle in the head posture data. It is understood that the head-mounted device acquires more than one pitch angle value within a first preset time period. To improve the accuracy of determining the user's head-down behavior, the pitch angle value can be the average or variance of the multiple pitch angles acquired within the first preset time period. The range of pitch angle variation can be calculated by subtracting the minimum pitch angle from the maximum pitch angle within the first preset time period. If, in this embodiment, the pitch angle corresponding to the user's eye level is defined as 0 degrees, then the first preset range is negative, such as [-25 degrees, -60 degrees], [-20 degrees, -50 degrees], [-28 degrees, -62 degrees], etc. The first threshold can be set to 8 degrees, 10 degrees, or 13 degrees, etc. When the head-mounted device determines that the pitch angle value in the head posture data within a first preset time period is within a first preset range, and the change in pitch angle is less than a first threshold, the head-mounted device determines that the user has a head-down behavior characteristic; when the head-mounted device determines that the pitch angle value in the head posture data within a first preset time period is not within the first preset range, and / or the change in pitch angle is greater than or equal to the first threshold, the head-mounted device determines that the user does not have a head-down behavior characteristic.

[0035] and / or If, based on the head posture data, it is determined that the frequency of head posture changes of the wearer within a first preset time period is greater than a preset frequency, and the amplitude of each head posture change is less than a second threshold, then it is determined that the wearer has micro-movement behavior characteristics. In one embodiment, the posture change refers to the change in the wearer's head posture. Since this embodiment aims to determine whether the wearer exhibits micro-motion behavior characteristics, the second threshold should be relatively small, such as 3 degrees or 4 degrees. Within a first preset duration, if the amplitude of a single pitch angle change by the wearer is less than the second threshold, it can be determined that the wearer has undergone one head posture change. The preset frequency can be set according to specific needs, such as 1.5 times / second or 2 times / second. When the head-mounted device determines, based on head posture data, that the frequency of head posture changes by the wearer within the first preset duration is greater than the preset frequency, and the amplitude of each head posture change is less than the second threshold, the head-mounted device determines that the wearer exhibits micro-motion behavior characteristics. When the head-mounted device determines, based on head posture data, that the rate of head posture change by the wearer within the first preset duration is less than or equal to the preset frequency, and / or the amplitude of each head posture change is greater than or equal to the second threshold, the head-mounted device determines that the wearer does not exhibit micro-motion behavior characteristics.

[0036] and / or If, based on the motion data, it is determined that the displacement of the user within a first preset time period is less than a first preset distance, then it is determined that the user exhibits static behavior characteristics.

[0037] In one embodiment, the specific process of determining the wearer's displacement within a first preset time period based on motion data collected by the IMU can be found in related technologies, and will not be described in detail here. In this embodiment, the goal is to determine if the wearer exhibits stationary behavior characteristics; therefore, the first preset distance should be set relatively small, otherwise the accuracy of identifying stationary behavior characteristics will be low. For example, the first preset distance can be set to 0.3 meters or 0.25 meters. It is understood that the stationary behavior in this embodiment is relative stationary behavior, not absolute stillness. When the head-mounted device determines, based on motion data, that the wearer's displacement within the first preset time period is less than the first preset distance, the head-mounted device determines that the wearer exhibits stationary behavior characteristics; when the head-mounted device determines, based on motion data, that the wearer's displacement within the first preset time period is greater than or equal to the first preset distance, the head-mounted device determines that the wearer does not exhibit stationary behavior characteristics, i.e., exhibits active behavior characteristics.

[0038] In one embodiment, to improve the accuracy of privacy risk pattern recognition, this embodiment imposes sequential restrictions on the various behavioral characteristics within a privacy risk pattern. When the head-mounted device determines that the user first exhibits a head-down behavior characteristic, then a slight movement behavior characteristic, and finally a stationary behavior characteristic within a first preset time period, the head-mounted device determines the user's behavioral pattern as a privacy risk pattern. It is understood that if the user is in a restroom, stairwell, or similar location and exhibits the aforementioned behavioral characteristics, activating the camera component to perform a recording operation would infringe on the privacy of other users; therefore, it is necessary to define the user's behavioral pattern at this time as a privacy risk pattern.

[0039] This embodiment determines the user's behavior pattern as a privacy risk pattern by identifying head-down and micro-movement behaviors within a first preset time period based on head posture data, and stationary behaviors within the same time period based on motion data. When determining whether the user's behavior pattern is a privacy risk pattern, the embodiment considers both head behavior characteristics (head-down and micro-movement behaviors) and body behavior characteristics (stationary behaviors) to improve the accuracy of privacy risk pattern identification.

[0040] In some embodiments, step S102 further includes: if it is determined based on the head posture data that the user has a head-turning behavior characteristic during a second preset time period, and based on the motion data it is determined that the user has a stationary activity behavior characteristic during the second preset time period, then the user's behavior pattern is determined to be a privacy risk pattern.

[0041] In this embodiment, the second preset duration may be equal to or different from the first preset duration in the above embodiment. In this embodiment, the behavioral characteristics of the privacy risk mode are the head-turning behavior and the stationary movement behavior of the user during the second preset duration. Therefore, if the head-mounted device determines that the user has a head-turning behavior during the second preset duration based on head posture data, and determines that the user has a stationary movement behavior during the second preset duration based on motion data, then the user's behavioral mode is determined to be a privacy risk mode.

[0042] In some embodiments, the method further includes: if the change in posture along any axis of the head posture data is greater than a third threshold within the second preset time period, and the change in posture along multiple axes is greater than a fourth threshold, then it is determined that the user wearing the device has a head-turning behavior characteristic. and / or If, based on the motion data, it is determined that the displacement of the wearer within a second preset time period is less than a second preset distance, then it is determined that the wearer exhibits behavioral characteristics of stationary activity.

[0043] In this embodiment, the head rotation behavior of the wearer is characterized by a relatively large head rotation. Therefore, the head rotation behavior of the wearer is determined only when the amplitude of any axial attitude change in the head posture data within the second preset time period is greater than the third threshold, and the amplitude of attitude change in multiple axes is greater than the fourth threshold. The third threshold is greater than the fourth threshold; for example, the third threshold can be set to 25 degrees and the fourth threshold to 15 degrees; or the third threshold can be set to 20 degrees and the fourth threshold to 12 degrees, etc. The amplitude of any axial attitude change is the attitude change amplitude corresponding to one of the pitch angle, yaw angle, and roll angle axes. It is understood that in this embodiment, the amplitude of attitude change in multiple axes being greater than the fourth threshold can be two axes or three axes.

[0044] It is understandable that, in determining whether a user exhibits stationary behavior, the head-mounted device can determine the user's displacement based on acceleration and a second preset duration in the motion data, thereby determining whether the user exhibits stationary behavior. Since this embodiment aims to determine whether a user exhibits stationary behavior, the second preset distance cannot be set too large; for example, it can be set to 0.4 meters, 0.5 meters, or 0.7 meters.

[0045] In one embodiment, to improve the accuracy of privacy risk pattern recognition, this embodiment imposes sequential restrictions on the various behavioral features within a privacy risk pattern. When the head-mounted device determines that the user first exhibits head-turning behavior followed by stationary movement within a first preset time period, the head-mounted device determines the user's behavioral pattern as a privacy risk pattern. It is understood that when the user exhibits the aforementioned behavioral features, it can be assumed that the user is in a changing room, bathroom, bathhouse, or similar location. If the head-mounted device were to activate its camera component to perform a recording operation at this time, it would infringe on the privacy of other users. Therefore, it is necessary to define the user's behavioral pattern at this time as a privacy risk pattern.

[0046] This embodiment provides another method for identifying whether a user's behavior pattern constitutes a privacy risk pattern, thereby improving the accuracy of privacy risk pattern identification from the perspective of behavioral pattern diversity.

[0047] In one embodiment, to improve the accuracy of privacy risk pattern recognition, after determining that the user exhibits head-turning and stationary behavior characteristics within a second preset time period, the head-mounted device can use infrared or radar technology to identify the number of people in the location and / or the distance from the wall. It is understood that in places like bathhouses, there are many people, while in changing rooms and bathrooms, due to the smaller space, the user is closer to the wall. Therefore, when the head-mounted device identifies that the number of people in the location is greater than or equal to a preset number, and / or the distance from the wall is less than or equal to a preset distance, the head-mounted device determines that the user's behavior pattern is a privacy risk pattern. The preset number of people and preset distance can be set according to specific needs; in this embodiment, the preset number of people and preset distance are not specifically limited.

[0048] In some embodiments, step a includes: if it is determined based on the head posture data that the user has a head-turning behavior characteristic during a second preset time period, and based on the motion data it is determined that the user has a stationary activity behavior characteristic during the second preset time period, then the sensor data collected by the user during the head-turning process is acquired; if it is determined based on the sensor data that the user's spatial range is smaller than a preset spatial range, then the user's behavior pattern is determined to be a privacy risk mode.

[0049] In one embodiment, a privacy mode recognition function switch can be set in the head-mounted device. When the privacy mode recognition function switch is turned on, the head-mounted device can identify whether the user's behavior pattern is a privacy risk mode. When the privacy mode recognition function switch is turned on, when the head-mounted device determines that the user has head rotation behavior characteristics within a second preset time period based on head posture data, it acquires sensor data collected during the user's head rotation. This sensor data can be infrared data and / or radar data, and the spatial range of the user is determined through this sensor data. It is understood that the determined spatial range of the user is based on the acquired sensor data and may differ from the actual spatial range of the user's location. The process of determining the spatial range of the user's location based on sensor data can be found in relevant documents, and will not be described in detail in this embodiment. The size of the spatial range can be represented by area. This embodiment does not limit the size of the preset spatial range, but it can be set as needed in specific implementation. When the head-mounted device determines that the user exhibits head-turning and stationary behavior characteristics within a second preset time period, and determines, based on the acquired sensor data, that the user's spatial range is smaller than a preset spatial range, the user's behavior pattern is identified as a privacy risk pattern. In considering whether a user's behavior pattern is a privacy risk pattern, the spatial range of the user is taken into account. For example, if the user is outdoors and exhibits head-turning and stationary behavior characteristics, the user's behavior pattern should not be considered a privacy risk pattern, thereby improving the accuracy of privacy risk pattern identification.

[0050] In some embodiments, refer to Figure 2 The method further includes: Step S104: If a shooting instruction is received, control the camera component to execute the shooting instruction.

[0051] When the head-mounted device controls the camera component to prohibit shooting operations based on the privacy risk mode, the camera component is in a turned-off state. If the head-mounted device receives a shooting command while the camera component is in a turned-off state, the head-mounted device controls the camera component to execute the shooting command. In one embodiment, after receiving the shooting command, the head-mounted device will output a prompt message to remind the user that it is currently in privacy risk mode and asks whether to confirm the execution of the shooting command. If the head-mounted device receives a confirmation command to execute the shooting command within a certain period of time, the head-mounted device will execute the shooting command; if the head-mounted device does not receive the confirmation command within a certain period of time, or receives a negative command not to execute the shooting command, the head-mounted device will not execute the shooting command.

[0052] In this embodiment, if a shooting command is received when the head-mounted device is in privacy risk mode, the shooting command can be executed, thereby avoiding the situation where the head-mounted device cannot start when the camera component actually needs to be activated.

[0053] In one embodiment, to better protect the privacy of user personal information, the head-mounted device performs identity recognition based on the shooting command after receiving it. For example, if the shooting command is triggered by voice, the voiceprint information of the shooting command is extracted and compared with the voiceprint information of the user stored in the head-mounted device. The head-mounted device will only control the camera component to execute the shooting command if the similarity between the extracted voiceprint information and the stored voiceprint information is greater than a preset voiceprint similarity. The head-mounted device will not execute the shooting command if the similarity between the extracted voiceprint information and the stored voiceprint information is equal to or less than the preset voiceprint similarity. When the shooting command is triggered via the touch panel of the head-mounted device, the device can obtain the fingerprint information of the user who triggered the command. The extracted fingerprint information is compared with the user's pre-stored fingerprint information. The head-mounted device will only control the camera component to execute the shooting command if the similarity between the extracted fingerprint information and the pre-stored fingerprint information is greater than a preset fingerprint similarity threshold. If the similarity is equal to or less than the preset fingerprint similarity threshold, the head-mounted device will not execute the shooting command. The preset voiceprint similarity and preset fingerprint similarity can be set to 80%, 85%, or 92%, etc.

[0054] This embodiment identifies whether the user who triggers the shooting command is the wearer himself. The head-mounted device will only execute the shooting command when the user who triggers the shooting command is the wearer himself. This ensures that if the wearer obtains other users' privacy information using the head-mounted device, the source can be traced, thereby improving the wearer's awareness of the risks of using the head-mounted device.

[0055] Please see Figure 3 , Figure 3 This is a schematic block diagram of the structure of a head-mounted device control device provided in an embodiment of the present invention, such as... Figure 3 As shown, the head-mounted device control unit 300 includes: Data acquisition module 310 is used to acquire head posture data and motion data of the user wearing the head-mounted device; The behavior pattern determination module 320 is used to determine the behavior pattern of the wearer based on the head posture data and the motion data. The operation control module 330 is used to control the camera component of the head-mounted device to prohibit shooting operations if the behavior mode is a privacy risk mode.

[0056] In some embodiments, the behavior pattern determination module 320 is further configured to: if it is determined based on the head posture data that the user exhibits head-down behavior characteristics and micro-movement behavior characteristics within a first preset time period, and based on the motion data it is determined that the user exhibits stationary behavior characteristics within the first preset time period, then the user's behavior pattern is determined to be a privacy risk pattern.

[0057] In some embodiments, the head-mounted device control device 300 further includes: The first feature recognition module is configured to determine that the user exhibits head-down behavior if the pitch angle value in the head posture data is within a first preset range within the first preset time period, and the change amplitude of the pitch angle is less than a first threshold; determine that the user exhibits micro-motion behavior if the frequency of head posture changes within the first preset time period is greater than a preset frequency, and the amplitude of each head posture change is less than a second threshold, based on the head posture data; and determine that the user exhibits stationary behavior if the displacement of the user within the first preset time period is less than a first preset distance, based on the motion data.

[0058] In some embodiments, the behavior pattern determination module 320 is further configured to: if the head posture data determines that the user has a head-turning behavior characteristic during a second preset time period, and the motion data determines that the user has a stationary activity behavior characteristic during the second preset time period, then determine that the user's behavior pattern is a privacy risk pattern.

[0059] In some embodiments, the head-mounted device control device 300 further includes: The first feature recognition module is used to determine that the user has a head rotation behavior if the change in posture along any axis of the head posture data within the second preset time period is greater than a third threshold, and the change in posture along multiple axes is greater than a fourth threshold; and if the user's displacement within the second preset time period is less than a second preset distance based on the motion data, then the user has a stationary movement behavior.

[0060] In some embodiments, the behavior pattern determination module 320 is further configured to: if it is determined based on the head posture data that the wearer has a head rotation behavior characteristic during a second preset time period, and based on the motion data it is determined that the wearer has a stationary activity behavior characteristic during a second preset time period, then acquire sensor data collected by the wearer during the head rotation process. If the sensor data determines that the user's location is within a preset spatial range, then the user's behavior pattern is determined to be a privacy risk pattern.

[0061] In some embodiments, the operation control module 330 is further configured to: if a shooting instruction is received, control the camera component to execute the shooting instruction.

[0062] It should be noted that those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the head-mounted device control device described above can be referred to the corresponding process in the aforementioned head-mounted device control method embodiments, and will not be repeated here.

[0063] Please see Figure 4 , Figure 4 This is a schematic block diagram of the structure of a head-mounted device provided in an embodiment of the present invention.

[0064] like Figure 4 As shown, the head-mounted device 400 includes a processor 401 and a memory 402, which are connected via a bus 403, such as an I2C (Inter-integrated Circuit) bus. The head-mounted device includes at least two display units (not shown in the figure).

[0065] Specifically, processor 401 provides computing and control capabilities to support the operation of the entire head-mounted device. Processor 401 can be a Central Processing Unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0066] Specifically, the memory 402 can be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a portable hard drive, etc.

[0067] Those skilled in the art will understand that Figure 4 The structures shown are merely block diagrams of some structures related to the embodiments of the present invention, and do not constitute a limitation on the head-mounted devices to which the embodiments of the present invention are applied. Specific head-mounted devices may include more or fewer components than those shown in the figures, or combine certain components, or have different component arrangements.

[0068] The processor 401 is used to run a computer program stored in the memory 402, and implements any of the head-mounted device control methods provided in the embodiments of the present invention when executing the computer program.

[0069] In one embodiment, the processor 401 is configured to run a computer program stored in a memory, and to perform the following steps when executing the computer program: Acquire head posture and motion data of the user wearing the head-mounted device; The user's behavior pattern is determined based on the head posture data and the motion data; If the behavior mode is a privacy risk mode, then the camera component controlling the head-mounted device is prohibited from performing shooting operations.

[0070] In some embodiments, when the processor 401 determines the user's behavior pattern based on the head posture data and the motion data, it is configured to: If, based on the head posture data, it is determined that the user exhibits head-down behavior and micro-movement behavior characteristics within a first preset time period, and based on the motion data, it is determined that the user exhibits stationary behavior characteristics within the first preset time period, then the user's behavior pattern is determined to be a privacy risk pattern.

[0071] In some embodiments, the processor 401 is further configured to implement: If the pitch angle value in the head posture data is within the first preset range within the first preset time period, and the change range of the pitch angle is less than the first threshold, then it is determined that the user wearing the device has a head-down behavior characteristic. and / or If, based on the head posture data, it is determined that the frequency of head posture changes of the wearer within a first preset time period is greater than a preset frequency, and the amplitude of each head posture change is less than a second threshold, then it is determined that the wearer has micro-movement behavior characteristics. and / or If, based on the motion data, it is determined that the displacement of the user within a first preset time period is less than a first preset distance, then it is determined that the user exhibits static behavior characteristics. In some embodiments, when the processor 401 determines the user's behavior pattern based on the head posture data and the motion data, it is configured to: If, based on the head posture data, it is determined that the user exhibits head-turning behavior within a second preset time period, and based on the motion data, it is determined that the user exhibits stationary behavior within the second preset time period, then the user's behavior pattern is determined to be a privacy risk pattern.

[0072] In some embodiments, the processor 401 is further configured to implement: If the change in posture along any axis of the head posture data is greater than the third threshold within the second preset time period, and the change in posture along multiple axes is greater than the fourth threshold, then it is determined that the user wearing the device exhibits head rotation behavior. and / or If, based on the motion data, it is determined that the displacement of the wearer within a second preset time period is less than a second preset distance, then it is determined that the wearer exhibits behavioral characteristics of stationary activity.

[0073] In some embodiments, when the processor 401 determines that the user's behavior pattern is a privacy risk pattern if it determines, based on the head posture data, that the user exhibits head-turning behavior characteristics during a second preset time period, and based on the motion data, it determines that the user exhibits stationary behavior characteristics during the second preset time period, the processor 401 is configured to: If, based on the head posture data, it is determined that the user has a head-turning behavior characteristic within a second preset time period, and based on the motion data, it is determined that the user has a stationary activity behavior characteristic within a second preset time period, then the sensor data collected by the user during the head-turning process is acquired. If the sensor data determines that the user's location is within a preset spatial range, then the user's behavior pattern is determined to be a privacy risk pattern.

[0074] In some embodiments, after the step of controlling the camera component of the head-mounted device to prohibit shooting operations if the behavior mode is a privacy risk mode, the processor 401 is configured to implement: If a shooting instruction is received, the camera component is controlled to execute the shooting instruction.

[0075] It should be noted that those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the head-mounted device described above can be referred to the corresponding process in the aforementioned head-mounted device control method embodiments, and will not be repeated here.

[0076] This invention also provides a storage medium for computer-readable storage, wherein the storage medium stores one or more programs that can be executed by one or more processors to implement any of the head-mounted device control methods provided in the specification of this invention.

[0077] The storage medium can be volatile or non-volatile. It can be an internal storage unit of the head-mounted device described in the foregoing embodiments, such as the hard drive or memory of the head-mounted device. Alternatively, it can be an external storage device of the head-mounted device, such as a plug-in hard drive, Smart Media Card (SMC), Secure Digital (SD) card, or FlashCard.

[0078] Those skilled in the art will understand that all or some of the steps, systems, or apparatuses disclosed above, and their functional modules / units, can be implemented as software, firmware, hardware, or suitable combinations thereof. In hardware embodiments, the division between functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed collaboratively by several physical components. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include computer storage media (or non-transitory media) and communication media (or transient media). As is known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and can be accessed by a computer. Furthermore, it is well known to those skilled in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.

[0079] It should be understood that the term "and / or" as used in this specification and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes such combinations. It should be noted that, herein, the terms "comprising," "including," or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0080] The sequence numbers of the above embodiments of the present invention are merely for descriptive purposes and do not represent the superiority or inferiority of the embodiments. The above descriptions are only specific embodiments of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in the present invention, and these modifications or substitutions should all be covered within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A method for controlling a head-mounted device, characterized in that, The method includes: Acquire head posture and motion data of the user wearing the head-mounted device; The user's behavior pattern is determined based on the head posture data and the motion data; If the behavior mode is a privacy risk mode, then the camera component controlling the head-mounted device is prohibited from performing shooting operations.

2. The head-mounted device control method according to claim 1, characterized in that, Determining the user's behavior pattern based on the head posture data and the motion data includes: If, based on the head posture data, it is determined that the user exhibits head-down behavior and micro-movement behavior characteristics within a first preset time period, and based on the motion data, it is determined that the user exhibits stationary behavior characteristics within the first preset time period, then the user's behavior pattern is determined to be a privacy risk pattern.

3. The head-mounted device control method according to claim 2, characterized in that, The method includes: If the pitch angle value in the head posture data is within the first preset range within the first preset time period, and the change range of the pitch angle is less than the first threshold, then it is determined that the user wearing the device has a head-down behavior characteristic. and / or If, based on the head posture data, it is determined that the frequency of head posture changes of the wearer within a first preset time period is greater than a preset frequency, and the amplitude of each head posture change is less than a second threshold, then it is determined that the wearer has micro-movement behavior characteristics. and / or If, based on the motion data, it is determined that the displacement of the user within a first preset time period is less than a first preset distance, then it is determined that the user exhibits static behavior characteristics.

4. The head-mounted device control method according to claim 1, characterized in that, Determining the user's behavior pattern based on the head posture data and the motion data includes: If, based on the head posture data, it is determined that the user exhibits head-turning behavior within a second preset time period, and based on the motion data, it is determined that the user exhibits stationary behavior within the second preset time period, then the user's behavior pattern is determined to be a privacy risk pattern.

5. The head-mounted device control method according to claim 4, characterized in that, The method further includes: If the change in posture along any axis of the head posture data is greater than the third threshold within the second preset time period, and the change in posture along multiple axes is greater than the fourth threshold, then it is determined that the user wearing the device exhibits head rotation behavior. and / or If, based on the motion data, it is determined that the displacement of the wearer within a second preset time period is less than a second preset distance, then it is determined that the wearer exhibits behavioral characteristics of stationary activity.

6. The head-mounted device control method according to claim 4, characterized in that, If, based on the head posture data, it is determined that the user exhibits head-turning behavior within a second preset time period, and based on the motion data, it is determined that the user exhibits stationary movement behavior within the second preset time period, then the user's behavior pattern is determined to be a privacy risk pattern, including: If, based on the head posture data, it is determined that the user has a head-turning behavior characteristic within a second preset time period, and based on the motion data, it is determined that the user has a stationary activity behavior characteristic within a second preset time period, then the sensor data collected by the user during the head-turning process is acquired. If the sensor data determines that the user's location is within a preset spatial range, then the user's behavior pattern is determined to be a privacy risk pattern.

7. The head-mounted device control method according to any one of claims 1-6, characterized in that, Following the step of controlling the camera component of the head-mounted device to prohibit shooting operations if the behavior mode is a privacy risk mode, the method further includes: If a shooting instruction is received, the camera component is controlled to execute the shooting instruction.

8. A head-mounted device control device, characterized in that, The device includes: The data acquisition module is used to acquire head posture data and motion data of the user wearing the head-mounted device; A behavior pattern determination module is used to determine the behavior pattern of the wearer based on the head posture data and the motion data; An operation control module is used to control the camera component of the head-mounted device to prohibit shooting operations if the behavior mode is a privacy risk mode.

9. A head-mounted device, characterized in that, The head-mounted device includes a processor, a memory, a computer program stored in the memory and executable by the processor, and a data bus for enabling communication between the processor and the memory, wherein when the computer program is executed by the processor, it implements the steps of the head-mounted device control method as described in any one of claims 1 to 7.

10. A storage medium for computer-readable storage, characterized in that, The storage medium stores one or more programs, which can be executed by one or more processors to implement the steps of the head-mounted device control method according to any one of claims 1 to 7.

Images