Head-mounted device, head-mounted device deformation state recognition method and device

Abstract

This application discloses a head-mounted device, a method and apparatus for recognizing the deformation state of the head-mounted device, relating to the field of head-mounted device technology. The head-mounted device includes: an inertial sensor for collecting inertial data of the posture of the head-mounted device; a first distance sensor for collecting a first distance between the posture of the head-mounted device and the wearer's face in a first direction; a second distance sensor for collecting a second distance between the posture of the head-mounted device and the wearer's face in a second direction different from the first posture direction; and a processing unit for acquiring the first posture distance, the second posture distance, and posture inertial data at each acquisition moment within an adjustment time period, and determining a first deformation state of the head-mounted device based on the first posture distance, the second posture distance, and the posture inertial data, wherein the first posture deformation state is deformed or not deformed. This head-mounted device can recognize the deformation state of the head-mounted device.

Description

Technical Field

[0001] This application relates to the field of head-mounted device technology, and more specifically, to a head-mounted device, a method and apparatus for recognizing the deformation state of a head-mounted device. Background Technology

[0002] AR glasses, as a near-eye display device that overlays device-generated images with the real world, are being used more and more widely.

[0003] With prolonged use, AR glasses may deform compared to their original factory design, such as the temples expanding outwards or the nose pads deforming. This causes the glasses to shift out of position when the wearer performs actions like turning, bending, or tilting their head. The wearer then needs to frequently adjust the temples, frame, and nose pads to reposition the glasses, significantly reducing the wearing experience.

[0004] Therefore, how to identify whether AR glasses have deformed has become a technical problem that urgently needs to be solved. Summary of the Invention

[0005] One objective of this application is to provide a new technical solution for head-mounted devices.

[0006] According to a first aspect of this application, a head-mounted device is provided, comprising:

[0007] An inertial sensor is used to collect inertial data from the head-mounted device;

[0008] A first distance sensor is used to acquire a first distance between the head-mounted device and the wearer's face in a first direction;

[0009] A second distance sensor is used to collect a second distance between the head-mounted device and the wearer's face in a second direction different from the first direction;

[0010] The processing unit is configured to acquire the first distance, the second distance, and the inertial data at each acquisition moment within the adjustment time period, and determine the first deformation state of the head-mounted device based on the first distance, the second distance, and the inertial data, wherein the first deformation state is deformed or undeformed.

[0011] Optionally, the head-mounted device further includes:

[0012] A reminder unit is used to output calibration reminder information under the instruction of the processing unit;

[0013] The processing unit is further configured to instruct the reminder unit to output calibration reminder information when it is determined that the head-mounted device is deformed.

[0014] According to a second aspect of this application, a method for recognizing the deformation state of a head-mounted device is provided, applied to a head-mounted device as described in any one of the first aspects, comprising:

[0015] Acquire the first distance collected by the first distance sensor, the second distance collected by the second distance sensor, and the inertial data collected by the inertial sensor at each acquisition moment within the adjustment time period;

[0016] Based on the first distance, the second distance, and the inertial data, a first deformation state of the head-mounted device is determined, wherein the first deformation state is either deformed or undeformed.

[0017] Optionally, the inertial data is the adjustment angle along a direction perpendicular to the wearer's face, and determining the first deformation state of the head-mounted device based on the first distance, the second distance, and the inertial data includes:

[0018] Based on the first distance, the second distance, the adjustment angle, and the first mapping data acquired at each acquisition moment, the amount of movement of the head-mounted device along the direction of the adjustment angle change at each acquisition moment is determined;

[0019] The first deformation state of the head-mounted device is determined based on the adjustment angle and the amount of movement at each acquisition moment;

[0020] The first mapping data is data reflecting the correspondence between the first distance, the second distance, and the amount of movement along the direction of the adjustment angle change.

[0021] Optionally, determining the first deformation state of the head-mounted device based on the adjustment angle and the amount of movement at each acquisition moment includes:

[0022] Based on the second mapping data, the adjustment angle and the amount of movement at each acquisition time, the first deformation state of the head-mounted device is determined;

[0023] The second mapping data is data reflecting the correspondence between the amount of movement of the head-mounted device of the standard structure along the direction of adjustment angle change and the adjustment angle.

[0024] Optionally, acquiring the first distance collected by the first distance sensor, the second distance collected by the second distance sensor, and the inertial data collected by the inertial sensor at each acquisition moment within the adjustment time period includes:

[0025] Acquire the inertial data collected by the inertial sensor;

[0026] Based on the inertial data, determine the current posture of the wearer of the head-mounted device;

[0027] Acquire the first distance collected by the first distance sensor, the second distance collected by the second distance sensor, and the inertial data collected by the inertial sensor at each acquisition moment within each adjustment period of the current attitude duration;

[0028] The method further includes:

[0029] The number of times the first deformation state is determined to be deformed within the duration of the current posture is counted;

[0030] When the number of adjustments reaches the adjustment threshold, the second deformation state of the head-mounted device is determined to be a deformation. The adjustment threshold corresponds to the posture and the duration of the posture.

[0031] Optionally, before acquiring the first distance collected by the first distance sensor, the second distance collected by the second distance sensor, and the inertial data collected by the inertial sensor at each acquisition moment within the adjustment time period, the method further includes:

[0032] If at least one of the first distance and the second distance changes, determine the time when the change occurs and the time when the change ends;

[0033] The duration from the time the change occurs to the time the change ends is recorded as the adjustment duration.

[0034] Optionally, the method further includes:

[0035] In the event of deformation of the head-mounted device, a calibration reminder message is output.

[0036] According to a third aspect of this application, a deformation state recognition device for a head-mounted device is provided, applied to a head-mounted device as described in any one of the first aspects, comprising:

[0037] The acquisition module is used to acquire the first distance collected by the first distance sensor, the second distance collected by the second distance sensor, and the inertial data collected by the inertial sensor at each acquisition moment within the adjustment time period;

[0038] The determination module is used to determine the first deformation state of the head-mounted device based on the first distance, the second distance, and the inertial data, wherein the first deformation state is deformed or undeformed.

[0039] According to a fourth aspect of this application, a head-mounted device is provided, the head-mounted device comprising the means as described in the third aspect;

[0040] Alternatively, the head-mounted device includes a memory and a processor, the memory for storing computer instructions and the processor for retrieving the computer instructions from the memory to perform the method as described in any one of the second aspects.

[0041] According to a fifth aspect of this application, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the method according to any one of the second aspects.

[0042] In this embodiment, a head-mounted device is provided, comprising: an inertial sensor for collecting inertial data of the head-mounted device; a first distance sensor for collecting a first distance between the head-mounted device and the wearer's face in a first direction; a second distance sensor for collecting a second distance between the head-mounted device and the wearer's face in a second direction different from the first direction; and a processing unit for acquiring the first distance, the second distance, and inertial data at each acquisition moment within an adjustment time period, and determining a first deformation state of the head-mounted device based on the first distance, the second distance, and the inertial data, wherein the first deformation state is deformed or not deformed. This head-mounted device can identify the deformation state of the head-mounted device.

[0043] Other features and advantages of this application will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0044] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments of the present application and, together with their description, serve to explain the principles of the present application.

[0045] Figure 1 This is a schematic diagram of the hardware structure of a head-mounted device provided in an embodiment of this application. Figure 1 ;

[0046] Figure 2 This is a schematic diagram of a head-mounted device wearing scenario provided in an embodiment of this application;

[0047] Figure 3 This is a schematic flowchart of a deformation state recognition method for a head-mounted device provided in an embodiment of this application;

[0048] Figure 4 This is a schematic diagram of the deformation state recognition device for a head-mounted device provided in an embodiment of this application;

[0049] Figure 5 This is a schematic diagram of the hardware structure of a head-mounted device provided in an embodiment of this application. Figure 2 . Detailed Implementation

[0050] Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of the present application.

[0051] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit the scope of this application and its application or use.

[0052] Techniques, methods, and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques, methods, and equipment should be considered part of the specification.

[0053] In all the examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.

[0054] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.

[0055] <Example 1 of Head-Mounted Device>

[0056] This application provides a head-mounted device 100, which can be an AR, VR, MR, or XR type head-mounted device. The head-mounted device 100 can be glasses or a helmet. The following embodiment is illustrated using glasses as an example.

[0057] like Figure 1 As shown, the head-mounted device 100 provided in this application includes:

[0058] Inertial sensor 101 is used to collect inertial data from head-mounted device 100;

[0059] The first distance sensor 102 is used to collect the first distance S1 between the head-mounted device 100 and the wearer's face in a first direction;

[0060] The second distance sensor 103 is used to collect a second distance S2 between the head-mounted device 100 and the wearer's face in a second direction different from the first direction, wherein the first direction is perpendicular to the second direction.

[0061] The processing unit is used to acquire a first distance S1, a second distance S2 and inertial data at each acquisition time within the adjustment time period, and to determine a first deformation state of the head-mounted device 100 based on the first distance S1, the second distance S2 and the inertial data. The first deformation state includes deformed and undeformed states.

[0062] It should be noted that, as Figure 1 As shown, the head-mounted device 100 may also include a frame 104, temples 105, and nose pads 106.

[0063] In this embodiment, the inertial sensor 101 is also referred to as an IMU. Correspondingly, the inertial data is also referred to as IMU data. In one embodiment, the inertial sensor 101 can be placed at any location on the head-mounted device 100. Figure 1 The example shown is an inertial sensor 101 positioned slightly above the center of the inner side of the frame 104.

[0064] In this embodiment, the first distance sensor 101 and the second distance sensor 102 can be exemplarily ultrasonic distance sensors, but other sensors capable of measuring distances can also be used, and this application does not limit them.

[0065] In one embodiment, the first direction is specifically the direction from the frame 104 to the wearer's face of the head-mounted device 100. Correspondingly, the second direction is specifically the direction from the lower sidewall of the frame 104 to the wearer's face. Or, conversely, as... Figure 2 As shown, the first direction D1 is specifically the direction from the lower sidewall of the frame 104 to the wearer's face, and the second direction D2 is the direction from the frame 104 to the wearer's face of the head-mounted device 100. The following embodiment will illustrate the latter. For the latter, the first distance sensor 102 can be positioned at the middle of the lower sidewall of the frame 104, and the second distance sensor 103 can be positioned inside the frame 104.

[0066] In this embodiment, the processing unit can be, for example, a data processing device such as an MCU. The processing unit can be housed in the frame 104, or it can be located in other components of the head-mounted device 100. Figure 1 The processing unit is not shown in the document.

[0067] The processing unit is electrically connected to the inertial sensor, the first distance sensor, and the second distance sensor to acquire inertial data from the inertial sensor, acquire a first distance from the first distance sensor, and acquire a second distance from the second distance sensor. Further, the processing unit is specifically used to perform the following steps S11 and S12.

[0068] Step S11: Obtain the first distance, second distance, and inertial data for each acquisition time within the adjustment duration.

[0069] Step S12: Determine the first deformation state of the head-mounted device based on the first distance, the second distance, and inertial data. The first deformation state includes deformed and undeformed states.

[0070] In this embodiment, the adjustment time refers to the duration during which the wearer adjusts the head-mounted device after wearing it. This adjustment includes manually adjusting the temples, frames, nose pads, etc., to change the overall height of the head-mounted device. Furthermore, first distance, second distance, and inertial data can be acquired periodically within the adjustment time to obtain the first distance, second distance, and inertial data at each acquisition moment within the adjustment time.

[0071] When the head-mounted device leaves the factory, its structure is a standard one. Based on this, during the process of the wearer adjusting the head-mounted device, the changes in the aforementioned first distance, second distance, and inertial data follow certain patterns.

[0072] During wear, the head-mounted device may deform. For example, if the wearer has a wide face, the distance between the two temples of the head-mounted device increases, and the temples may widen after prolonged wear. Based on this deformation, the head-mounted device deviates from its optimal wearing position, prompting the wearer to adjust it. During this adjustment process, the changes in the aforementioned first distance, second distance, and inertia data may deviate from the previously described patterns.

[0073] In this embodiment, based on the above, the processing unit determines the first deformation state of the head-mounted device according to whether the changes in the first distance, the second distance, and the inertial data deviate from the aforementioned pattern. Specifically, if the deviation is greater than a certain value, the first deformation state is determined to be deformed. Conversely, if the deviation is less than or equal to a certain value, the first deformation state is determined to be undeformed. This means that the head-mounted device provided in this embodiment can identify the deformation state of the head-mounted device.

[0074] In this embodiment, a head-mounted device is provided, comprising: an inertial sensor for collecting inertial data of the head-mounted device; a first distance sensor for collecting a first distance between the head-mounted device and the wearer's face in a first direction; a second distance sensor for collecting a second distance between the head-mounted device and the wearer's face in a second direction different from the first direction; and a processing unit for acquiring the first distance, the second distance, and inertial data at each acquisition moment within an adjustment time period, and determining a first deformation state of the head-mounted device based on the first distance, the second distance, and the inertial data, wherein the first deformation state is deformed or not deformed. This head-mounted device can identify the deformation state of the head-mounted device.

[0075] In one embodiment of this application, the head-mounted device 100 further includes:

[0076] The reminder unit is used to output calibration reminder information under the instruction of the processing unit;

[0077] The processing unit is also used to instruct the reminder unit to output calibration reminder information when the deformation of the head-mounted device is determined.

[0078] In this embodiment, the processing unit and the reminder unit are electrically connected. The processing unit determines the head-mounted device...

[0079] In the event of deformation of the equipment, the instruction reminder unit outputs calibration prompt information. Based on this, the reminder unit outputs calibration prompt information. The calibration prompt information may, for example, be an audio-visual, text, or visual prompt, and this application does not limit this to any particular type.

[0080] The wearer can determine the deformation of the head-mounted device based on the calibration reminder information output by the reminder unit. Furthermore, the wearer can send the head-mounted device to an after-sales service center or return it to the factory for professional calibration.

[0081] <Example of a Deformation State Recognition Method for Head-Mounted Devices>

[0082] This application provides a method for recognizing the deformation state of a head-mounted device, which can be applied to any of the head-mounted devices described in the above embodiments. Figure 3 As shown, the method includes the following steps S310 and S320.

[0083] Step S310: Obtain the first distance collected by the first distance sensor, the second distance collected by the second distance sensor, and the inertial data collected by the inertial sensor at each acquisition time within the adjustment time period.

[0084] Step S320: Based on the first distance, the second distance, and the inertial data, determine the first deformation state of the head-mounted device, which is either deformed or undeformed.

[0085] In this embodiment, the description of step S310 is the same as that of step S11 in the first embodiment of the head-mounted device, and the description of step S320 is the same as that of step S12 in the first embodiment of the head-mounted device, so they will not be repeated here.

[0086] In this embodiment of the application, a method for identifying the deformation state of a head-mounted device is provided. This method is applied to any of the head-mounted devices provided in Embodiment 1 above, and includes: acquiring a first distance collected by a first distance sensor, a second distance collected by a second distance sensor, and inertial data collected by an inertial sensor at each acquisition moment within an adjustment time period; determining a first deformation state of the head-mounted device based on the first distance, the second distance, and the inertial data, wherein the first deformation state is deformed or not deformed. This method can identify the deformation state of the head-mounted device.

[0087] In one embodiment of this application, the inertial data is the adjustment angle along a direction perpendicular to the wearer's face. Based on this, the above-mentioned step S320 is specifically implemented through the following steps S321 and...

[0088] Step S321: Based on the first distance, second distance, adjustment angle, and first mapping data acquired at each acquisition moment, determine the amount of movement of the head-mounted device along the direction of adjustment angle change at each acquisition moment.

[0089] The first preset mapping data is data that reflects the correspondence between the first distance, the second distance, and the amount of movement along the direction of the adjustment angle change.

[0090] In one embodiment, such as Figure 2 As shown, the adjustment angle specifically refers to the rotation angle of the head-mounted device within the yz plane.

[0091] In this embodiment, for a first distance, a second distance, and an adjustment angle corresponding to an acquisition time, the amount of movement of a head-mounted device along the adjustment angle direction is obtained based on the first mapping data.

[0092] exist Figure 2 Based on this, during a single adjustment of the head-mounted device by the wearer, the first distance S1 undergoes a gradual process of increasing and then decreasing, resembling a loop curve. Therefore, based on simulation experiments and experience, the following formula reflects the relationship between the first distance S1, the second distance S2, and the movement d of the head-mounted device along the direction of the adjustment angle change:

[0093]

[0094] Where θ is the adjustment angle; S 11 is the horizontal distance from the frame to the wearer's face; b is a constant that can be set based on experience.

[0095] Based on the above, by substituting the first distance, the second distance, and the adjustment angle obtained at each acquisition moment into the above formula, the amount of movement of the head-mounted device along the direction of adjustment angle change at each acquisition moment can be determined.

[0096] Step S322: Determine the first deformation state of the head-mounted device based on the adjustment angle and movement amount at each acquisition moment.

[0097] In this embodiment, the first deformation state specifically refers to the deformation state of the head-mounted device during an adjustment process.

[0098] In one embodiment of this application, step S322 can be specifically implemented as step S3221 below.

[0099] Step S3221: Determine the first deformation state of the head-mounted device based on the second mapping data, the adjustment angle and movement amount at each acquisition time.

[0100] The second mapping data is data reflecting the correspondence between the amount of movement of the head-mounted device with the standard structure along the direction of adjustment angle change and the adjustment angle.

[0101] In one embodiment, the specific implementation of step S3221 above can be as follows: based on the adjustment angle and movement amount at each acquisition moment, fit the correspondence between the adjustment angle and movement amount of the head-mounted device during the current adjustment process to obtain a first fitting relationship; fit the correspondence between the adjustment angle and movement amount in the second mapping data to obtain a second fitting relationship; calculate the deviation between the first fitting relationship and the second fitting relationship; if the deviation is greater than a preset threshold, determine the first deformation state of the head-mounted device as deformation; otherwise, determine the first deformation state of the head-mounted device as no deformation, wherein the preset threshold is the maximum allowable deviation between the first fitting relationship and the second fitting relationship when the head-mounted device has not deformed, and the specific value can be determined based on experience or simulation experiments.

[0102] In one embodiment of this application, in order to more accurately determine the deformation state of the head-mounted device, the above step S310 can be specifically implemented through the following steps S311 to S313.

[0103] Step S311: Acquire inertial data collected by the inertial sensor.

[0104] Step S312: Determine the current posture of the wearer of the head-mounted device based on the inertial data.

[0105] In this embodiment, step S312 can be implemented using the traditional method of determining the wearer's current posture based on inertial data. This embodiment does not specifically limit the method of determining the wearer's current posture based on inertial data.

[0106] Step S313: Obtain the first distance collected by the first distance sensor, the second distance collected by the second distance sensor, and the inertial data collected by the inertial sensor at each acquisition moment within each adjustment duration of the current attitude duration.

[0107] In this embodiment, when the head-mounted device deforms, the wearer adjusts the head-mounted device at least once in a given posture. Based on this, for any adjustment process within the current posture, the first distance collected by the first distance sensor, the second distance collected by the second distance sensor, and the inertial data collected by the inertial sensor are acquired at each acquisition moment within the corresponding adjustment time.

[0108] During the above steps S311 to S313, the method for identifying the deformation state of the head-mounted device provided in this application embodiment further includes the following steps S330 and S340.

[0109] Step S330: Count the number of times the first deformation state is determined to be deformed within the duration of the current posture.

[0110] Step S340: When the number of adjustments reaches the adjustment threshold, the second deformation state of the head-mounted device is determined to be deformation. The adjustment threshold corresponds to the posture and the duration of the posture.

[0111] In this embodiment, after step S313, step S320 is executed to determine the first deformation state corresponding to each adjustment process within the duration of the current posture. The number of times the first deformation state is determined to be deformed within the duration of the current posture is also counted. If this number reaches an adjustment count threshold, it indicates that the wearer is frequently adjusting the head-mounted device in the current posture. In this case, a second deformation state is determined, i.e., the deformation state determined after multiple adjustments is a deformed state. Otherwise, the deformation state of the head-mounted device is determined to be undeformed.

[0112] The threshold for the number of adjustments corresponds to the posture and the duration of the posture. The threshold is smaller when the posture is low, such as when the head is tilted down, and also when the posture duration is short. Therefore, the threshold for the number of adjustments can be determined empirically.

[0113] In one embodiment of this application, the state recognition method for a head-mounted device provided in this application further includes a step of determining the adjustment duration before step S310 described above. This step is specifically implemented through the following steps S314 and S315.

[0114] Step S314: If at least one of the first distance and the second distance changes, determine the time when the change occurs and the time when the change ends.

[0115] Step S315: Record the duration from the time the change occurs to the time the change ends as the adjustment duration.

[0116] In this embodiment, if at least one of the first distance and the second distance changes, it indicates that the wearer is adjusting the head-mounted device. Therefore, the time of the change is the adjustment start time, and the time of the change ending is the adjustment end time. The duration between the adjustment start time and the adjustment end time is the adjustment duration.

[0117] Based on the above steps S314 and S315, a method for determining the adjustment duration is provided.

[0118] In one embodiment of this application, based on any of the above method embodiments, the method for identifying the deformation state of a head-mounted device provided in this application embodiment further includes the following step S350.

[0119] Step S350: In the event of deformation of the head-mounted device, output a calibration reminder message.

[0120] In this embodiment, step S350 may specifically include one of the following two implementation methods.

[0121] In the first embodiment of this application, when the method for identifying the deformation state of the head-mounted device is a method for obtaining a first deformation state, a calibration reminder information indication is output when the first deformation state is deformation.

[0122] In the second embodiment, when the method for identifying the deformation state of the head-mounted device provided in this application is a method for obtaining a second deformation state, a calibration reminder information indication is output when the second deformation state is deformation.

[0123] Through the above step S350, the wearer can intuitively understand that the head-mounted device has deformed.

[0124] As can be seen from any of the above embodiments, the head-mounted device deformation state recognition method provided in any of the above method embodiments of this application is based on the premise that the head-mounted device is being worn and adjusted. Therefore, before executing the head-mounted device deformation state recognition method provided in any of the above method embodiments, it can first be detected whether the head-mounted device is in a wearing state. If so, the head-mounted device deformation state recognition method provided in any of the above method embodiments is then executed. Otherwise, it is not executed. In this way, meaningless deformation state recognition can be avoided, effectively reducing the computational overhead of the head-mounted device.

[0125] <Example of a Deformation State Recognition Device for Head-Mounted Devices>

[0126] This application provides a deformation state recognition device 400 for a head-mounted device, applicable to any of the head-mounted devices described in Embodiment 1 above, such as... Figure 4 As shown, it includes:

[0127] The acquisition module 410 is used to acquire the first distance collected by the first distance sensor, the second distance collected by the second distance sensor, and the inertial data collected by the inertial sensor at each acquisition moment within the adjustment time period;

[0128] The determination module 420 is used to determine the first deformation state of the head-mounted device based on the first distance, the second distance and the inertial data, wherein the first deformation state is deformed or undeformed.

[0129] This device can identify the deformation state of head-mounted devices.

[0130] In one embodiment of this application, the inertial data is an adjustment angle along a direction perpendicular to the wearer's face, and the determining module 420 is specifically used for:

[0131] Based on the first distance, the second distance, the adjustment angle, and the first mapping data acquired at each acquisition moment, the amount of movement of the head-mounted device along the direction of the adjustment angle change at each acquisition moment is determined;

[0132] The first deformation state of the head-mounted device is determined based on the adjustment angle and the amount of movement at each acquisition moment;

[0133] The first mapping data is data reflecting the correspondence between the first distance, the second distance, and the amount of movement along the direction of the adjustment angle change.

[0134] In one embodiment of this application, the determining module 420 is specifically used for:

[0135] Based on the second mapping data, the adjustment angle and the amount of movement at each acquisition time, the first deformation state of the head-mounted device is determined;

[0136] The second mapping data is data reflecting the correspondence between the amount of movement of the head-mounted device of the standard structure along the direction of adjustment angle change and the adjustment angle.

[0137] In one embodiment of this application, the acquisition module 410 is specifically used for:

[0138] Acquire the inertial data collected by the inertial sensor;

[0139] Based on the inertial data, determine the current posture of the wearer of the head-mounted device;

[0140] Acquire the first distance collected by the first distance sensor, the second distance collected by the second distance sensor, and the inertial data collected by the inertial sensor at each acquisition moment within each adjustment period of the current attitude duration;

[0141] Furthermore, in this embodiment, the deformation state recognition device 400 for the head-mounted device provided in this application further includes:

[0142] The statistics module is used to count the number of times the first deformation state is determined to be deformed within the duration of the current posture;

[0143] Module 420 is also used for:

[0144] When the number of adjustments reaches the adjustment threshold, the second deformation state of the head-mounted device is determined to be a deformation. The adjustment threshold corresponds to the posture and the duration of the posture.

[0145] In one embodiment of this application, the determining module 420 is further configured to:

[0146] If at least one of the first distance and the second distance changes, determine the time when the change occurs and the time when the change ends;

[0147] The duration from the time the change occurs to the time the change ends is recorded as the adjustment duration.

[0148] In one embodiment of this application, the deformation state recognition device 400 for a head-mounted device provided in this application further includes:

[0149] The output module is used to output a calibration reminder message when the head-mounted device is deformed.

[0150] <Example 2 of Head-Mounted Device>

[0151] This application embodiment also provides a head-mounted device, which includes the features described above. Figure 4 The head-mounted device shown is a deformation state recognition device 400.

[0152] Or, such as Figure 5 As shown, the head-mounted device 500 includes a memory 510 and a processor 520. The memory 510 is used to store computer instructions, and the processor 520 is used to retrieve the computer instructions from the memory 510 to execute any of the methods provided in the above-described method embodiments.

[0153] <Media Example>

[0154] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the method according to any one of the above method embodiments.

[0155] This application may be a system, method, and / or computer program product. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of this application.

[0156] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination thereof. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0157] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0158] The computer program instructions used to perform the operations of this application may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuits, such as programmable logic circuits, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), are personalized by utilizing state information from the computer-readable program instructions. These electronic circuits can execute the computer-readable program instructions to implement various aspects of this application.

[0159] Various aspects of this application are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0160] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0161] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0162] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions. It will be well known to those skilled in the art that implementation in hardware, implementation in software, and implementation using a combination of software and hardware are equivalent.

[0163] The various embodiments of this application have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical applications, or technical improvements to the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein. The scope of this application is defined by the appended claims.

Claims

1. A head-mounted device, characterized in that, include: An inertial sensor is used to collect inertial data from the head-mounted device; A first distance sensor is used to acquire a first distance between the head-mounted device and the wearer's face in a first direction; The second distance sensor is used to collect the second distance between the head-mounted device and the wearer's face in a second direction different from the first direction, wherein the first direction is from the frame of the head-mounted device to the wearer's face, and the second direction is from the lower sidewall of the frame to the wearer's face. The processing unit is configured to acquire the first distance, the second distance, and the inertial data at each acquisition moment within the adjustment time period, and determine the first deformation state of the head-mounted device based on the first distance, the second distance, and the inertial data, wherein the first deformation state is deformed or undeformed.

2. The head-mounted device according to claim 1, characterized in that, The head-mounted device also includes: A reminder unit is used to output calibration reminder information under the instruction of the processing unit; The processing unit is further configured to instruct the reminder unit to output calibration reminder information when it is determined that the head-mounted device is deformed.

3. A method for recognizing the deformation state of a head-mounted device, characterized in that, Applied to the head-mounted device as described in claim 1 or 2, comprising: Acquire the first distance collected by the first distance sensor, the second distance collected by the second distance sensor, and the inertial data collected by the inertial sensor at each acquisition moment within the adjustment time period; Based on the first distance, the second distance, and the inertial data, a first deformation state of the head-mounted device is determined, wherein the first deformation state is either deformed or undeformed.

4. The method according to claim 3, characterized in that, The inertial data is the adjustment angle along a direction perpendicular to the wearer's face. Determining the first deformation state of the head-mounted device based on the first distance, the second distance, and the inertial data includes: Based on the first distance, the second distance, the adjustment angle, and the first mapping data acquired at each acquisition moment, the amount of movement of the head-mounted device along the direction of the adjustment angle change at each acquisition moment is determined; The first deformation state of the head-mounted device is determined based on the adjustment angle and the amount of movement at each acquisition moment; The first mapping data is data reflecting the correspondence between the first distance, the second distance, and the amount of movement along the direction of the adjustment angle change.

5. The method according to claim 4, characterized in that, Determining the first deformation state of the head-mounted device based on the adjustment angle and the amount of movement at each acquisition moment includes: Based on the second mapping data, the adjustment angle and the amount of movement at each acquisition time, the first deformation state of the head-mounted device is determined; The second mapping data is data reflecting the correspondence between the amount of movement of the head-mounted device of the standard structure along the direction of adjustment angle change and the adjustment angle.

6. The method according to claim 3, characterized in that, The acquisition of the first distance collected by the first distance sensor, the second distance collected by the second distance sensor, and the inertial data collected by the inertial sensor at each acquisition moment within the adjustment time period includes: Acquire the inertial data collected by the inertial sensor; Based on the inertial data, determine the current posture of the wearer of the head-mounted device; Acquire the first distance collected by the first distance sensor, the second distance collected by the second distance sensor, and the inertial data collected by the inertial sensor at each acquisition moment within each adjustment period of the current attitude duration; The method further includes: The number of times the first deformation state is determined to be deformed within the duration of the current posture is counted; When the number of adjustments reaches the adjustment threshold, the second deformation state of the head-mounted device is determined to be a deformation. The adjustment threshold corresponds to the posture and the duration of the posture.

7. The method according to claim 3, characterized in that, Before acquiring the first distance data collected by the first distance sensor, the second distance data collected by the second distance sensor, and the inertial data collected by the inertial sensor at each acquisition time within the adjustment time period, the method further includes: If at least one of the first distance and the second distance changes, determine the time when the change occurs and the time when the change ends; The duration from the time the change occurs to the time the change ends is recorded as the adjustment duration.

8. The method according to any one of claims 3-7, characterized in that, The method further includes: In the event of deformation of the head-mounted device, a calibration reminder message is output.

9. A deformation state recognition device for a head-mounted device, characterized in that, Applied to the head-mounted device as described in claim 1 or 2, comprising: The acquisition module is used to acquire the first distance collected by the first distance sensor, the second distance collected by the second distance sensor, and the inertial data collected by the inertial sensor at each acquisition moment within the adjustment time period; The determination module is used to determine the first deformation state of the head-mounted device based on the first distance, the second distance, and the inertial data, wherein the first deformation state is deformed or undeformed.

10. A head-mounted device, characterized in that, The head-mounted device includes the apparatus as described in claim 9; Alternatively, the head-mounted device includes a memory and a processor, the memory for storing computer instructions and the processor for retrieving the computer instructions from the memory to perform the method as described in any one of claims 3-8.

Images