Method for controlling a head-mounted display, device and head-mounted display
The method for controlling data glasses using sensor signals from units like acceleration and rotation rate sensors addresses energy management and measurement challenges, enabling efficient and accurate distance and height measurements without additional equipment, thus enhancing user experience.
Patent Information
- Application Number
- PCT/EP2024/060929
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-04
- Filing Date
- 2024-04-22
- Publication Date
- 2024-11-07
AI Technical Summary
Current data glasses technologies face challenges in efficiently managing energy consumption and accurately measuring distances and heights without additional equipment, while also providing user-friendly control mechanisms.
A method for controlling data glasses that utilizes sensor signals from units like acceleration and rotation rate sensors to determine position and orientation, enabling energy-saving modes and precise measurement functions, such as triangulation, without requiring additional devices.
This approach reduces energy consumption, allows users to measure distances and heights accurately and efficiently, and enhances user experience by eliminating the need for extra equipment, while providing precise control over data glasses functions.
Smart Images

Figure EP2024060929_07112024_PF_FP_ABST
Abstract
Description
[0001] Description
[0002] title
[0003] Method for controlling data glasses, device and data glasses
[0004] State of the art
[0005] The invention relates to a method for controlling smart glasses, a device, and smart glasses according to the preamble of the independent claims. The present invention also relates to a computer program.
[0006] Data glasses or so-called smart glasses can include various components, such as a screen, a processing unit, sensors, a display / projector, cameras, speakers, microphones or more.
[0007] Current glasses, for example, can offer the ability to play music or control a connected smartphone through inputs on the glasses. There are also virtual reality glasses or augmented reality glasses, which can determine the position and orientation of the object in order to adjust the display in the user's field of vision accordingly.
[0008] Disclosure of the invention
[0009] Against this background, the approach presented here presents a method for controlling smart glasses, a device using this method, smart glasses, and finally a corresponding computer program according to the main claims. The measures listed in the dependent claims enable advantageous refinements and improvements of the device specified in the independent claim. The method presented here can advantageously control functions of the smart glasses, reducing their energy consumption and thus supporting a user in everyday activities in a particularly advantageous manner.
[0010] A method for controlling smart glasses is presented. The method comprises a step of reading a sensor signal from a sensor unit arranged on the smart glasses, wherein the sensor signal represents a change in the position of the smart glasses with respect to a defined reference point and additionally or alternatively a movement of the smart glasses. Furthermore, the method comprises a step of executing a functional rule for controlling a function of the smart glasses using the sensor signal. In the executing step, the functional rule is executed to control a measurement function for measuring an object.
[0011] Data glasses, which can also be referred to as glasses for short, can be so-called smart glasses, for example. The data glasses can be designed, for example, to show various information on a display, for example in one or both lenses. Additionally or alternatively, the data glasses can be designed as so-called virtual reality glasses or augmented reality glasses and, for example, interactions with other devices networked with the data glasses, such as a smartphone, can be possible. The data glasses can have at least one or more sensor units or different types of sensors to determine the position and orientation of the glasses in space. The types of sensors can be, for example, acceleration sensors, gyroscopes and magnetic field sensors.The sensors can either be installed in separate sensors or in a single sensor, such as an inertial measurement unit (IMU). The sensors record signals in one, two, or three different dimensions. If a user wears the glasses on their nose, this can be used as a reference point or starting point, for example. If the glasses are taken off or put on the head, the position and orientation of the glasses in relation to the reference point can change. The change in position can be recorded using different sensors or combinations of sensors. For example, acceleration sensors and gyroscopes can be used to record the movement of the glasses. The sensors can be attached in or on the housing of the glasses, for example on one or both sides of the glasses or on the nose bridge.In addition, proximity sensors or pressure sensors in the temples, nose pieces or nose pads can be used to detect whether the glasses are being taken off. The sensors can generate analog signals which can be converted into digital signals. Using these sensor signals, a change in position or a movement of the data glasses can be detected in the method presented here. For example, such a movement can be a movement of the head of a person wearing the data glasses. Thus, the sensor signal can be used to determine, for example, whether the head and thus also the data glasses are being tilted or rotated and, additionally or alternatively, whether the person is moving through the room, for example. Additionally or alternatively, a change in the position of the data glasses relative to the person can be detected.For example, the bridge of the nose of a user of the data glasses can be set as a reference point, i.e., if the user is wearing the glasses on their nose, this can be considered a starting point, for example. When the glasses are taken off or put on the head, the position and orientation of the glasses change in relation to the starting point. Using the sensor signal or in response to a detected movement or change in position of the data glasses, a functional specification is executed in the method presented here. This advantageously makes it possible to control functions of the data glasses that are tailored to a specific movement and, in addition or alternatively, the position of the data glasses, for example to put the glasses into energy-saving mode or to start and control a specific application. The position and orientation of the glasses can advantageously be determined without the aid of cameras.
[0012] Specifically, the glasses presented here allow users to measure distances and heights without the need for any additional devices. Distances and heights can be determined, for example, using information about the position and orientation of the glasses through triangulation, advantageously allowing users to measure their surroundings without the need for additional devices.
[0013] According to a further embodiment, in the execution step, an orientation angle of the data glasses with respect to the object to be measured can be determined using the sensor signal, wherein the object can be measured using the orientation angle. The glasses can be used, for example, to measure objects. For example, the height of objects, such as a house, can be measured using the glasses. Alternatively, this method can also be used to determine how many meters certain objects are above or below the user. To measure the height, for example, the user can focus on the point whose height difference they want to know, such as a gable of a house. The orientation angle can be determined from the focusing.The accuracy of angle determination can be increased, for example, by displaying a target cross or a point in the user's field of vision, which can be used to focus on the gable of a house, for example. If the distance and the height of the glasses above the ground are known, the height of the house can now be determined. This assumes that the object and the user are on the same level. For greater heights, the height of the glasses above the ground can be approximately neglected. This type of measurement offers the advantage that no additional equipment is required, allowing objects to be measured quickly and efficiently.
[0014] A favorable embodiment of the approach presented here is one in which, in the execution step, the orientation angle of the data glasses is determined using an acceleration signal from an acceleration sensor arranged on the data glasses, wherein the acceleration signal represents a spatial orientation of the data glasses in the Earth's gravitational field. An acceleration sensor can be understood, for example, as a sensor that detects an acceleration, advantageously in three dimensions, and outputs a corresponding acceleration signal that represents, for example, a temporal profile of the detected acceleration or a current acceleration vector. The acceleration sensor can, for example, be attached to the temple of the data glasses. Such an embodiment of the approach presented here enables a relatively accurate determination of the orientation orthe orientation angle of the data glasses in the room.
[0015] The orientation angle of the smart glasses can be determined particularly precisely if, in the execution step, the orientation angle of the smart glasses is determined when the smart glasses are detected as being in a rest position. Such a rest position can be detected, for example, if the acceleration signal indicates that the detected acceleration does not change significantly within a tolerance range. In this way, interference caused by the superposition of an acceleration caused by the movement of the smart glasses in addition to the acceleration caused by the Earth's gravitational field can be minimized.
[0016] Another conceivable embodiment of the approach proposed here is one in which, in the execution step, the orientation angle is determined as the mean value of a plurality of orientation angles determined consecutively in time, and / or wherein the orientation angle is determined when a plurality of orientation angles determined consecutively in time deviate from one another by no more than a tolerance value. Such an embodiment also offers the advantage of a more robust determination of the orientation angle of the data glasses, since, for example, vibration or movement of the data glasses during the measurement process of the orientation angle or of data for determining the orientation angle can be compensated for as effectively as possible.
[0017] Furthermore, according to another embodiment of the approach proposed here, the orientation angle can be determined in the step of executing using an integration of a sensor signal supplied and read by a yaw rate sensor arranged on the data glasses. Such an embodiment of the approach proposed here offers the advantage of a further, reliable provision of data for determining the orientation angle in order to be able to determine the height and / or distance of the object as precisely as possible.
[0018] The method can also include a step of re-reading the sensor signal. In this execution step, using the re-read sensor signal, a further orientation angle of the data glasses with respect to the object to be measured and / or a distance the data glasses have moved and / or a relative position change of the data glasses with respect to the object can be determined. Using the orientation angle and the further orientation angle, the relative position change and / or the distance, the object can be measured. However, the sensor signal does not only need to be read in at the target point to capture the orientation angle. Rather, the sensor signal can be read in regularly.For example, the sensor signal is read in to record the orientation angle at the starting point. Then the sensor signal is read in to measure the distance traveled and also to detect that the glasses are moving little again, allowing a second orientation angle to be recorded. For example, in this measurement variant, a user can first focus on a gable of a house whose height is to be determined, for example. An initial position of the user, i.e. the starting point of the glasses, as well as the orientation angle can be recorded. In the next step, the user can move towards the object whose height is to be determined. After the user has covered a certain distance and reached a second position, the gable of the house can be focused on again.The further orientation angle as well as the distance or its corresponding direction vector between the first and second points can be recorded. The height of the house can then be determined from the recorded values. This measurement option offers the advantage that no additional devices or distance measuring devices are required besides the data glasses.
[0019] According to a further embodiment, in the execution step, the distance the data glasses have moved and / or the relative position change of the data glasses can be determined using an integration of an acceleration profile that represents a temporal profile of an acceleration of the data glasses during a period of time that lies between the read-in sensor signal and the re-read-in sensor signal. In this way, an additional function, namely the determination of the distance or the determination of the relative position change, can be realized in such an embodiment by utilizing already available sensor signals.
[0020] According to a further embodiment, in the execution step, a height of the data glasses above a floor and / or a height of the data glasses relative to the object can be determined in order to measure the object. For example, the height of the data glasses above a floor and / or the height of the data glasses relative to the object can also be determined by integrating an acceleration curve, now in the vertical direction. Such an embodiment of the approach proposed here offers the possibility of measuring the object very precisely, since not only the orientation angle(s) of the data glasses are taken into account, but also the relative height position from which the corresponding orientation angle was detected. This allows a more precise measurement of parameters, so that triangulation based on these parameters enables a more precise measurement of the object.
[0021] In addition, the reading and / or executing step can be started in response to a start signal input on the smart glasses and / or a start signal provided by a mobile device that is or can be coupled to the smart glasses. For example, such a start signal can be triggered by touching an element of the smart glasses and / or a voice signal. Alternatively or additionally, the reading and / or executing step can also be started by a mobile device, such as a mobile phone of the user of the smart glasses. Such an embodiment of the approach proposed here offers the advantage of actively starting a measurement of the object, so that permanent or continuous measurement of various objects during operation of the smart glasses can be avoided.In this way, user comfort can be increased by avoiding irritation when the user of the data glasses does not currently want to measure an object.
[0022] This method can be implemented, for example, in software or hardware or in a mixed form of software and hardware, for example in a control unit.
[0023] The approach presented here further provides a device designed to perform, control, or implement the steps of a variant of a method presented here in corresponding devices. This embodiment of the invention in the form of a device also allows the problem underlying the invention to be solved quickly and efficiently.
[0024] For this purpose, the device can have at least one computing unit for processing signals or data, at least one memory unit for storing signals or data, at least one interface to a sensor or an actuator for reading sensor signals from the sensor or for outputting data or control signals to the actuator, and / or at least one communication interface for reading or outputting data embedded in a communication protocol. The computing unit can be, for example, a signal processor, a microcontroller, or the like, wherein the memory unit can be a flash memory or a magnetic storage unit.The communication interface can be designed to read in or output data wirelessly and / or wired, wherein a communication interface that can read in or output wired data can read this data, for example, electrically or optically from a corresponding data transmission line or output it to a corresponding data transmission line.
[0025] In this case, a device can be understood as an electrical device that processes sensor signals and outputs control and / or data signals depending on them. The device can have an interface, which can be implemented in hardware and / or software. In a hardware implementation, the interfaces can, for example, be part of a so-called system ASIC, which contains a wide variety of functions of the device. However, it is also possible for the interfaces to be separate integrated circuits or to consist at least partially of discrete components. In a software implementation, the interfaces can be software modules that are present, for example, on a microcontroller alongside other software modules.
[0026] Furthermore, a pair of smart glasses is presented, comprising a variant of the previously presented device and at least one sensor unit for detecting a change in the position of the smart glasses relative to a defined reference point and, in addition or alternatively, a movement of the smart glasses. This combination allows for optimal implementation of all the advantages of the previously presented method.
[0027] Also advantageous is a computer program product or computer program with program code that can be stored on a machine-readable carrier or storage medium such as a semiconductor memory, a hard disk memory or an optical memory and is used to carry out, implement and / or control the steps of the method according to one of the embodiments described above, in particular when the program product or program is executed on a computer or a device.
[0028] Examples of the approach presented here are shown in the drawings and explained in more detail in the following description. It shows:
[0029] Fig. 1 A is a schematic representation of data glasses according to an embodiment;
[0030] Fig. 1B shows a representation of a coordinate system representing an orientation of the glasses and an angle to be determined relative to a direction of the Earth's gravitational field; Fig. 2 shows a flowchart of a method for controlling data glasses according to an embodiment;
[0031] Fig. 3 is a schematic representation of a measurement function controllable by means of data glasses according to an embodiment;
[0032] Fig. 4 is a diagram of a sensor signal according to an embodiment;
[0033] Fig. 5 is a diagram of a sensor signal according to an embodiment;
[0034] Fig. 6 is a schematic representation of a measurement function controllable by means of data glasses according to an embodiment;
[0035] Fig. 7 is a schematic representation of a measurement function controllable by means of data glasses according to another embodiment; and
[0036] Fig. 8 is a schematic representation of the choice of a freely selected path x between the first measuring point and the second measuring point for implementing the measurement of the object.
[0037] In the following description of advantageous embodiments of the present invention, the same or similar reference numerals are used for the elements shown in the various figures and having a similar effect, whereby a repeated description of these elements is omitted.
[0038] Fig. 1A shows a schematic representation of data glasses 100 according to one exemplary embodiment. In this exemplary embodiment, the data glasses 100 comprise two sensor units 105a, 105b, which are arranged purely by way of example on the temples 110a, 110b of the data glasses 100. In one exemplary embodiment, the sensor units 105a, 105b, which can also be referred to simply as sensors, are designed as acceleration sensors to detect a movement or a change in position of the data glasses 100. To determine the position or orientation of the glasses in space, the glasses can, in exemplary embodiments, additionally or alternatively have various other sensors and sensor types. Either some or all of the sensor types can be used. The sensor types can be, for example, acceleration sensors, yaw rate sensors, pressure sensors, and magnetic field sensors.The sensors can be mounted in or on the housing of the glasses. In the exemplary embodiment shown here, the sensor units 105a, 105b are mounted, merely by way of example, on both sides of the glasses or temples 110a, 110b of the glasses 100. In other exemplary embodiments, it is also conceivable for the sensors to be mounted on only one of the two sides. Optionally, the sensors can also be mounted in or on the nosepiece.
[0039] The sensor units 105a, 105b are designed to provide analog signals, which are converted into digital signals, i.e., into sensor signals 115a, 115b. The sensor signals 105a, 105b represent a change in position of the data glasses 100 with respect to a defined reference point and, for example, a movement of the data glasses. The digital sensor signals 115a, 115b can be read by a device 120. In one embodiment, the device 120 is a central processing unit installed together with the sensor. Alternatively, the processing unit can be arranged in a sensor housing or on an external server, for example, as a so-called cloud. However, it is also conceivable for only one of the sensors 105a, 105b to be present and provide a corresponding sensor signal 115a or 115b, without impairing the functionality of the glasses.
[0040] The device 120 is designed to read in the sensor signals 115a, 115b, evaluate them, and use the signals to execute a functional specification for controlling a function of the data glasses. In one exemplary embodiment, the device is designed, by way of example, to enable the measurement of an object. The data glasses 100 shown here accordingly enable the use of various sensor types to determine the position and / or orientation of the glasses in relation to a starting point for the implementation of various applications, here specifically the measurement of an object, as will be explained in more detail below. Fig. 1B shows a representation of a coordinate system 150, which represents an orientation of the glasses 100 and an angle β to be determined in relation to a direction of the Earth's gravitational field 155.
[0041] Fig. 2 shows a flowchart of a method 200 for controlling smart glasses according to one embodiment. The method 200 comprises a step 205 of reading in a sensor signal from a sensor unit arranged on the smart glasses, wherein the sensor signal represents a change in position of the smart glasses with respect to a defined reference point and additionally or alternatively a movement of the smart glasses. Furthermore, the method 200 comprises a step 210 of executing a functional specification for controlling a function of the smart glasses using the sensor signal.
[0042] In this step 210 of the execution, a special function rule is executed in order to control a measuring function for measuring an object.
[0043] If, in one embodiment, the functional specification is executed in the execution step to control a measuring function, then, purely by way of example, an orientation angle of the data glasses with respect to the object to be measured is determined using the sensor signal. For this purpose, in one embodiment, in a re-reading step 220, the sensor signal is read in again, and in step 210 of execution, a further orientation angle of the data glasses with respect to the object to be measured is determined using the re-read sensor signal. In one embodiment, the object is measured using the orientation angle and the further orientation angle. Furthermore, the sensor signal between the positions can also be read out to determine the distance traveled. With knowledge of the distance traveled, the object can be measured very precisely. Fig.Figure 3 shows a schematic representation of a measurement function controllable by means of data glasses 100 according to an exemplary embodiment. In this application example, the data glasses 100 can be used to measure objects. The measurement of the object 300 shown here can be controllable, for example, in an execution step as described in the previous Figure 2.
[0044] The figure shown here illustrates how the height of an object 300, which is, for example, a house, can be measured using the glasses. Alternatively, this method can also be used to determine how many meters certain objects are above or below the user 305. Two different approaches can be used to measure height.
[0045] In the first variant, the user 305 focuses on the point whose height difference they want to know. In the illustration shown here, the user 305 focuses on the gable 311 of the house in a first position Pi, as an example. The orientation angle Qi results from the focusing. The accuracy of the determination of the angle Qi can be increased by, for example, displaying a target cross or a point in the field of vision of the user 305, with the help of which, for example, the gable 311 of the house must be focused. The height of the house can now be determined using two different variants. If the distance d and the height of the glasses above the ground are known, the height of the house can be determined. This of course assumes that the house and the user 305 are on the same level. For greater heights, the height of the glasses above the ground can be approximately neglected.
[0046] A distance meter is required to determine the distance d. This may be impractical, which is why a further
[0047] A variant for determining the height is presented. In the second variant, the user 305 first focuses on the gable 311 of the house. The first position Pi of the user or the starting point of the data glasses 100, as well as the orientation angle Qi are recorded. In the next step, the user 305 moves in the direction of the object 300 whose height is to be determined, for example in the direction of the house. After the user 305 has covered a distance x and reached a second position P2, the user 305 focuses on the gable 311 of the house again. The further orientation angle θ2 resulting from the renewed focusing as well as the distance x or its associated direction vector between the first and the second point are recorded. The height of the house can now be determined from the recorded values.
[0048] Fig. 4 shows a diagram 400 of a sensor signal 115 according to an exemplary embodiment. The sensor signal 115 shown here is merely an example of an acceleration g plotted over time s of a signal from an acceleration sensor of data glasses, as described in the previous Figures 1 and 3, while a user of the data glasses determines the height of an object. The sensor signal 115 is depicted three times, for example, in order to represent the signal both as sensor signal 115x along an x-axis of the diagram 400, as sensor signal 115y along a y-axis, and as sensor signal 115z along a z-axis of the diagram 400.
[0049] In the diagram 400 shown here, two areas numbered 1 and 2 are highlighted. The two areas correspond to the two positions of the stick figure in the previous Figure 3, with area 1 corresponding to a time interval of approximately 6.5 to 11 seconds and area 2 to a time interval of approximately 17 to 23 seconds. In the area between the highlighted areas, the user has approached the object, resulting in larger deflections in the image of the sensor signal 115. In areas 1 and 2, however, the object to be measured is targeted, and the signal remains relatively constant compared to the movements before and after the highlighted areas. As can be seen in this illustration, the values of the acceleration signal 115 differ in areas 1 and 2.For example, the sensor signal 115y has an exemplary acceleration of 0.2 along the y-axis in region 1 and an exemplary acceleration of 0.3 in region 2. Different angles can thus be determined from the values of the acceleration signal. Figure 5 shows a diagram 400 of a sensor signal 115 according to an exemplary embodiment. The sensor signal 115 shown here is merely an example of a magnetic flux density pT plotted over time s of a signal from a magnetic field sensor of data glasses, as described in the previous Figures 1 and 3, while a user of the data glasses determines the height of an object. The sensor signal 115 is shown three times, for example, in order to represent the signal both as sensor signal 115x along an x-axis of the diagram 500, as well as as sensor signal 115y along a y-axis and as sensor signal 115z along a z-axis of the diagram 500.
[0050] In addition to acceleration signals, as described in the previous Figure 4, signals from a magnetic field sensor can also be used. In the illustration shown here, the signals from a magnetic field sensor are plotted over time while the user measures the height of an object. Two phases, numbered 1 and 2, are highlighted, with phase 1 corresponding to a time interval of approximately 3 to 6 seconds and phase 2 to a time interval of approximately 10.5 to 14.5 seconds. The two phases correspond to the two positions of the stick figure in the previous Figure 3. In both phases, the signals from the magnetic field sensor are recorded while the user focuses on the object whose height is to be determined. To improve the measurement, the signals can, for example, be averaged over the duration of the phases.From the determined values of the magnetic flux density, the orientation of the head can be deduced and thus the orientation angle can be determined.
[0051] Fig. 6 shows a schematic representation of a measuring function controllable by means of data glasses according to an exemplary embodiment. The measurement of the object 300 shown here can, for example, be controllable in an execution step as described in the previous Figure 2. The object 300 in this exemplary embodiment is a wall. In addition to the height of an object 300, a horizontal distance on a wall, for example between two drill holes 600a, 600b, can also be determined. The drill holes 600a, 600b are each marked with a cross in the figure shown here. The method shown in this figure can be used to measure any distances, which can have other orientations besides a horizontal one. The figure shown here shows a top view showing two positions Pi, P2 of a user 305. The user 305 is shown as a circle.Initially, the user 305 stands at the first position P1 and focuses once on the left cross, i.e., the first drill hole 600a, and the right cross, i.e., the second drill hole 600b. The user 305 then moves to the second position P2. At the second position P2, the user 305 again focuses on the left and right crosses. Using the angles c1i, 02, 03, cu and the vector x, the vector d, or the horizontal distance d, between the drill holes 600a, 600b can be determined.
[0052] In addition to the above, it can be noted here that the approach presented here enables improved measurement of an object, in which the user or user of the data glasses 100 does not need to walk directly toward the object to be measured, but can instead choose any path. A measurement function for measuring an object can be implemented, for example, as follows. First, the user starts the measurement function by entering an input. This can be done, for example, by tapping the glasses. Alternatively, the measurement function can also be triggered, for example, by a mobile phone or smartphone that is connected to the glasses or can be connected.
[0053] For the measurement function to measure an object, two angles and the distance between the measurement points should be determined. The angles can be determined, for example, as described for Fig. 3, using the coordinate system shown in Fig. 1B. In Fig. 1B, the reference coordinate system 150 is shown next to the glasses. The y-axis is defined, for example, along the temples of the glasses 100. The angle to be determined is preferably the angle between the y-axis and the gravitational vector. The gravitational vector 155 is the vector that points toward the Earth's center and thus represents the Earth's gravitational field. The gravitational vector is shown in Fig. 1B as a dashed arrow. If the user is at rest and not moving, the sum of the accelerations measured in the direction of the three axes x, y, and z results in the value 1 g or 9.81 m / s. 2This circumstance can be used, for example, to detect whether the user is not moving and a measurement can be carried out. a measurement of the angle can be carried out, where
[0054] The expression |iT| corresponds to the L2 norm or Euclidean norm. The parameter E determines the tolerance limit up to which a measurement of the angle a x or a2. The angle a to be determined x or a2 corresponds to the included angle between a vector oriented along the y-axis and the gravitational vector. The included angle between the two vectors o' and b~* can generally be calculated using the scalar product To determine the angle ß in Fig. 1 B, the following expression can be used. a n = 90 — ß 1tf n G {1,2}. (5)
[0055] To ensure the accuracy of the measurement of the angle a xor a2, the measurement of the angle a x or a2 are carried out several times and the measured angle a x or a2 are averaged over the measurements. It is also conceivable to continue the measurement until the further measurements of the angle a x or a2 only lead to deviations below a certain limit or below a tolerance range. The angle a x or a2 can optionally also be determined via a yaw rate sensor. When using a yaw rate sensor, for example, integration is then carried out via the yaw rate. It is also conceivable to combine signals from an acceleration sensor and a yaw rate sensor, preferably in the form of an IMU, for measuring the angle a. x or a2. Furthermore, a magnetic field sensor can be used to improve the measurement results.
[0056] Between the measurements of the angles a xThe distance between the measurement points should be determined using a2 or a2. Preferably, the two measurement points are at the same height, as shown in Fig. 3.
[0057] Fig. 7 shows a schematic representation of a measurement function controllable by means of data glasses according to another exemplary embodiment, in which the two measuring points Pi and P2 (or the corresponding positions Pi and P2) of the data glasses 100 are at different heights. The height of the glasses 100 above the ground and / or relative to the position of the object 300 can be determined in this case, for example, with the aid of a pressure sensor 700. From the detection of the path x, the height difference between the two measuring points Pi and P2 can also be deduced. This can be done, for example, using a method in which, among other things, a double integration is performed using the signal from the acceleration sensor on the data glasses 100 in order to determine the distance "x" traveled between the two measuring points Pi and P2.
[0058] The second measuring point Pi or P2 should be selected by the user such that the second measuring point P2 lies on a line between the first measuring point Pi and the object 300 to be measured. Alternatively, if the entire orientation of the glasses 100 is also recorded to determine the direction in which the user is looking, the user can approach or move away from the object 300 to be measured along a freely selected path x. The distance x required for the measurement can be determined from the overall orientation of the glasses 100 at the first measuring point Pi and the second measuring point P2.
[0059] Fig. 8 shows a schematic representation of the selection of a freely chosen path between the first measuring point Pi and the second measuring point P2 for implementing the measurement of the object 300. Fig. 8 shows a method with which the distance x required for measuring an object 300 can be determined according to Fig. 7 (or also according to Fig. 3). By determining the orientation of the glasses 100 at the two measuring points Pi and P2 shown in Fig. 8, the intersection point of the two dashed lines in Fig. 8 can be determined. The intersection point of the two dashed lines is located at the location 311 at which the relevant point to be measured on the object 300 to be measured is located. From the intersection point, as well as the orientation of the glasses 100 at the two measuring points Pi and P2, as well as either knowledge of the path shown in Fig. 8 or the positions of the measuring points P1 and P2, the distances shown in Fig.The circles 800 drawn in the figure 8, as well as their radii n and r2, are determined. The difference between the radii. ri or r2 corresponds to the desired distance x from Fig. 3 or Fig. 8. If the height of the measuring points Pi or P2 above the ground is also recorded, x is not a scalar, but the vector x~
[0060] If an embodiment comprises an “and / or” link between a first feature and a second feature, this is to be read as meaning that the embodiment according to one embodiment has both the first feature and the second feature and according to another embodiment has either only the first feature or only the second feature.
Claims
Claims 1 . Method (200) for controlling data glasses (100), the method (200) comprising the following steps (205, 210): Reading (205) a sensor signal (115) of a sensor unit (105) arranged on the data glasses (100), wherein the sensor signal (115) represents a change in position of the data glasses (100) with respect to a defined reference point (800) and / or a movement of the data glasses (100); and Executing (210) a functional rule for controlling a function of the data glasses (100) using the sensor signal (115), wherein in step (210) of execution the functional rule is executed to control a measuring function for measuring an object (300).
2. Method (200) according to claim 1, wherein in the step (210) of executing using the sensor signal (115) an orientation angle (cii) of the data glasses (100) with respect to the object (300) to be measured is determined, wherein the object (300) is measured using the orientation angle (cii).
3. The method (200) according to claim 2, wherein in step (210) of carrying out the method, the orientation angle (cii) of the data glasses (100) is determined using an acceleration signal of an acceleration sensor arranged on the data glasses (100), wherein the acceleration signal represents a spatial orientation of the data glasses (100) in the Earth's gravitational field.
4. Method (200) according to claim 2 or 3, wherein in step (210) of executing the orientation angle (cii) of the data glasses (100) then is determined when the data glasses (100) are detected as being in a rest position.
5. The method (200) according to any one of claims 2 to 4, wherein in the step (210) of executing, the orientation angle (cii) is determined as the mean value of a plurality of orientation angles (cii) determined successively in time, and / or wherein the orientation angle (cii) is determined when a plurality of orientation angles (cii) determined successively in time do not deviate from one another by more than a tolerance value.
6. The method (200) according to any one of claims 2 to 5, wherein in the step (210) of executing the orientation angle (cii) is determined using an integration of a sensor signal (115) supplied and read in by a rotation rate sensor arranged on the data glasses (100).
7. The method (200) according to any one of claims 2 to 6, comprising a step (220) of re-reading the sensor signal (115), wherein in the step (210) of executing using the re-read sensor signal (115) a further orientation angle (c^) of the data glasses (100) with respect to the object (300) to be measured and / or a distance that the data glasses (100) have moved and / or a relative change in position of the data glasses (100) with respect to the object (300) is determined, wherein the object (300) is measured using the orientation angle (cii) and the further orientation angle (ch), the relative change in position and / or the distance.
8. The method (200) according to claim 7, wherein in the step (210) of executing, the distance that the data glasses (100) have moved and / or the relative position change of the data glasses (100) in relation to the object (300) is determined using an integration of an acceleration profile, which is a temporal profile of an acceleration of the data glasses (100) during a period of time represents the distance between the read-in sensor signal (115) and the re-read sensor signal (115).
9. The method (200) according to any one of the preceding claims, wherein in the step (210) of executing, a height of the data glasses (100) above a floor and / or a height of the data glasses (100) relative to the object (300) is determined in order to measure the object (300).
10. The method (200) according to any one of the preceding claims, wherein the step (205) of reading in and / or the step (210) of executing is started in response to a start signal input to the data glasses and / or a start signal provided by a mobile device that is or can be coupled to the data glasses.
11. Device (120) which is configured to carry out and / or control the steps (205, 210) of the method (200) according to one of the preceding claims in corresponding units.
12. Data glasses (100) with a device (120) according to claim 11 and with at least one sensor unit (105) for detecting a change in position of the data glasses (100) with respect to a defined reference point (800) and / or a movement of the data glasses (100).
13. Computer program configured to execute and / or control the steps (205, 210) of the method (200) according to one of the preceding claims 1 to 8.
14. A machine-readable storage medium on which the computer program according to claim 13 is stored.
Citation Information
Patent Citations
Object height measuring method based on intelligent terminal and intelligent terminal
CN105486279A
Selective hand occlusion over virtual projections onto physical surfaces using skeletal tracking
US20120249590A1
