Passive accessory
The method and system use magnetometers and orientation sensors to accurately track user-carried devices by adjusting for rotations, addressing inaccuracies in current position determination methods.
Patent Information
- Application Number
- CN202380084455.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-12-22
- Filing Date
- 2023-12-14
- Publication Date
- 2025-07-15
AI Technical Summary
The prior art lacks accuracy and reliability in determining and tracking the location of a user's carrying device, especially when the interactive surface rotates or orientation changes, especially for electrical and electronic passive devices.
Using multiple magnetometers and orientation sensors, by measuring the magnetic field and orientation data, the orientation and positioning of magnetic objects relative to the interactive reference coordinate system is determined, so as to track the position of the user's carrying equipment, and can track accurately even when the magnetometer rotates relative to the interactive reference coordinate system.
Improves the accuracy and reliability of the determination and tracking of the user's carrying device position, and can maintain high-precision position tracking when the interactive surface rotates or orientation changes.
Smart Images

Figure CN120322650A_ABST
Abstract
Description
[0001] This application claims the benefit of European Patent Application EP 22 307 015.2, filed on Dec. 22, 2022, the content of which is incorporated herein by reference. Technical Field
[0002] The present disclosure relates to the technical field of determining and / or tracking the position of passive accessories, and more particularly, to a computer-implemented method for determining the position of at least one user-carried device, an electronic device for determining the position of at least one user-carried device, and a system for determining the position of at least one user-carried device. Background Art
[0003] In the technical field of determining and / or tracking the position of a device held or worn by a user (i.e., a user-carried device), providing multiple magnetometers allows measuring a magnetic field associated with a magnetic object arranged in or coupled to the user-carried device. The user-carried device using this technology can be electronically passive and / or electrically passive. More specifically, electrically passive means that the user-carried device may not include a power source (e.g., a battery) for powering the electronic features of the user-carried device and / or means for receiving electrical power (e.g., wireless power transfer via an induction coil). Electronically passive means that no computing or processing occurs (or takes place) on the user-carried device. The magnetometer measurement results enable determining and / or tracking the position of the magnetic object within the sensing volume created by the multiple magnetometers. In some applications, the magnetic object may be arranged within a writing device (e.g., a stylus), which can be operated by the user on a writing support during user operation. Based on the magnetic field measurement results associated with the magnetic object, the position of the writing device on the writing support can be determined.
[0004] User operations of a user-carried device within a sensing volume created by a plurality of magnetometers can be presented to the user on an output device (e.g., a screen). More specifically, the movement of the user-carried device within the sensing volume can be reproduced as the movement of a virtual object on the output device. Determining and / or tracking the position of the user-carried device by means of magnetic objects may require the definition of an interaction surface, i.e., the surface on which the user-carried device operates. The magnetic objects are typically remote from the interaction surface. In current applications, a plurality of magnetometers may be arranged in an electronic device (e.g., a tablet computer). To determine the position of the user-carried device relative to the interaction surface, in known applications it is assumed that the interaction surface is exactly parallel to and directly above the plane of the magnetometers (e.g., the plane defined by the plurality of magnetometers). However, assuming that the interaction surface will be exactly parallel can limit the applications for determining and / or tracking the position of the user-carried device. When the plurality of magnetometers are moved (e.g., rotated) relative to the interaction surface, current applications do not allow the determination and / or tracking of the position of the user-carried device (and the representation as a virtual object), or at least the accuracy is insufficient.
[0005] Accordingly, an object of the present disclosure is to provide a computer-implemented method, an electronic device, and a system that enable the position of at least one user-carried device to be determined and / or tracked with increased accuracy and reliability. Summary of the Invention
[0006] The present disclosure relates to a computer-implemented method for determining the position of at least one user-carried device according to claim 1, an electronic device for determining the position of at least one user-carried device according to claim 14, and a system for determining the position of at least one user-carried device according to claim 15. The dependent claims depict embodiments of the present disclosure.
[0007] According to a first aspect of the present disclosure, a computer-implemented method for determining the location of at least one user-carried device includes obtaining magnetic field measurements associated with at least one magnetic object using a plurality of magnetometers, wherein at least one magnetic object is coupled to at least one user-carried device, and wherein at least one user-carried device is associated with an interaction reference coordinate system. Additionally, the computer-implemented method includes obtaining orientation data from at least one orientation sensor, wherein at least one orientation sensor is arranged in an electronic device, and wherein the plurality of magnetometers are arranged in the electronic device. Further, the computer-implemented method includes determining the orientation and positioning of the plurality of magnetometers relative to the interaction reference coordinate system based on the obtained orientation data. The computer-implemented method also includes determining the location of the user-carried device relative to the interaction reference coordinate system based on the obtained magnetic field measurements and the determined orientation and positioning. The plurality of magnetometers arranged in the electronic device may be movable relative to the interaction reference coordinate system, more specifically rotatable. Based on the computer-implemented method as described above, although the plurality of magnetometers may be moved (e.g., rotated) to different positions and / or orientations relative to the interaction reference coordinate system (more specifically, relative to the interaction surface), the determination and / or tracking of the location of at least one user-carried device relative to the interaction reference coordinate system can be achieved. The determined orientation and positioning may include the tilt, orthogonal orientation, parallel orientation, rotation, and / or positioning of the plurality of magnetometers relative to the interaction reference coordinate system. The plurality of magnetometers may be arranged in a movable part of the electronic device. Additionally, even when the plurality of magnetometers are rotated relative to the interaction reference coordinate system (more specifically, relative to the interaction surface), the determination of the location of the user-carried device relative to the interaction reference coordinate system can be automatically adapted. Thus, the location of at least one user-carried device can be determined and / or tracked with increased accuracy and / or reliability. The at least one user-carried device can be provided as a representation of a virtual object on at least one output device with increased accuracy and reliability.
[0008] According to a second aspect of the present disclosure, an electronic device for determining the location of at least one user-carried device includes a plurality of magnetometers and at least one orientation sensor. The electronic device is configured to perform the computer-implemented method according to the first aspect of the present disclosure. The electronic device can at least provide the advantages outlined for the first aspect of the present disclosure.
[0009] According to a third aspect of the present disclosure, a system for determining the location of at least one user-carried device includes at least one user-carried device associated with an interaction reference coordinate system, wherein the at least one user-carried device includes at least one magnetic object. Additionally, the system includes the electronic device according to the second aspect of the present disclosure. The system can at least provide the advantages outlined for the first aspect or the second aspect of the present disclosure. Description of the Drawings
[0010] Other features will be apparent from the drawings that form a part of the present disclosure. The drawings are intended to further explain the present disclosure and enable a person skilled in the art to practice the present disclosure. However, the drawings are intended as non-limiting examples. Common reference numerals in different figures indicate similar or like features.
[0011] Figure 1 and Figure 2 is a schematic perspective view of a system for determining the location of at least one user-carrying device according to an aspect of the present disclosure;
[0012] Figures 3A to 3E is a schematic diagram of an electronic device having different embodiments of an orientation sensor according to aspects of the present disclosure;
[0013] Figure 4 is a schematic diagram of an electronic device and a user-carrying device operating together with the electronic device according to an aspect of the present disclosure;
[0014] Figure 5A and Figure 5B is a schematic diagram of an embodiment of an electronic device according to aspects of the present disclosure;
[0015] Figure 6A and Figure 6B is a schematic diagram of a user-carrying device including at least one magnetic object;
[0016] Figure 7A and Figure 7B is a schematic diagram of a user-carrying device including at least one magnetic object, wherein the magnetic object is rotatable about a second user-carrying device axis;
[0017] Figure 8A and Figure 8B is a schematic diagram of a user-carrying device including at least one magnetic object, wherein the magnetic object is rotatable about a first user-carrying device axis;
[0018] Figure 9 is a schematic diagram of a plurality of magnetometers arranged in rows and columns with respect to an electronic device (more specifically, a second device portion of the electronic device);
[0019] Figure 10 is a schematic diagram of a user-carrying device moving on an interactive support;
[0020] Figure 11 Schematically illustrates steps of a computer-implemented method for determining the location of at least one user-carrying device according to aspects of the present disclosure.
[0021] Figure 12Steps of a computer-implemented method for determining the location of at least one user-carrying device according to aspects of the present disclosure are illustrated schematically in more detail. Detailed Description of the Invention
[0022] Embodiments of a computer-implemented method, an electronic device, and a system for determining the location of at least one user-carrying device according to the present disclosure will be described with reference to the following drawings.
[0023] Figure 1 and Figure 2 A system 10 for determining the location of at least one user-carrying device 100 according to aspects of the present disclosure is illustrated schematically. Referring to Figure 1 , the system for determining the location of at least one user-carrying device 100 includes at least one user-carrying device 100 associated with an interactive reference coordinate system Xs, Ys, Zs. The at least one user-carrying device 100 includes at least one magnetic object 110. In addition, the system 10 includes an electronic device 500 for determining the location of the at least one user-carrying device 100. More specifically, the system 10 and / or the electronic device 500 may be adapted to determine the location of at least one electrically passive and / or electronically passive user-carrying device 100. In other words, the system 10 and / or the electronic device 500 may be adapted to determine and / or track the location of the at least one user-carrying device 100 within a sensing volume M. Embodiments of the electronic device 500 will be described below with reference to Figures 3A to 5B The electronic device 500 includes a plurality of magnetometers 300 and at least one orientation sensor 520 ( Figure 1 and Figure 2 not shown in Figures 3A to 5B ). The at least one orientation sensor 520 may be configured to detect the rotation of the plurality of magnetometers 300 relative to the interactive reference coordinate system Xs, Ys, Zs and / or measure the orientation of the plurality of magnetometers relative to the interactive reference coordinate system. Embodiments of the at least one orientation sensor 520 will be explained below with reference to Figures 3A to 5B The electronic device 500 is configured to perform a computer-implemented method 600 for determining the location of at least one user-carrying device 100, as described below.
[0024] In an embodiment, the electronic device 500 may include (or may be) a notebook, a laptop computer, a smart phone, a cellular phone, a screen, a virtual reality (VR) kit, a board, a tablet computer, a foldable smart phone, a foldable tablet computer, and / or an electronic device case. The board may be, for example, a whiteboard, a blackboard, a digital board (on which a stylus can operate), a drawing and / or writing board, or a display board. In an embodiment, the at least one user-carrying device 100 may be a computer mouse, a keyboard, a doorbell, a toy, a stylus, a dial, or a pointer.
[0025] Referring to Figure 1and Figure 2 The electronic device 500 may include at least one output device 510. In some embodiments, the system 10 may include at least one additional output device. The at least one additional output device may be configured to represent at least one user-carrying device 100, and more specifically, reproduce the at least one user-carrying device 100 as a virtual object. The at least one additional output device may be separate from the electronic device 500. In an embodiment, the at least one output device 510 and / or the at least one additional output device may be a display or a screen.
[0026] In addition, as shown, for example, Figure 1 the electronic device 500 may include a first device part 531 and at least one second device part 532. The at least one second device part 532 may be coupled to the first device part 531. The at least one second device part 532 may be movable relative to the first device part 531, and more specifically, rotatable. A plurality of magnetometers 300 may be arranged in the at least one second device part 532. The at least one output device 510 may be arranged in the at least one second device part 532 and / or the at least one first device part 531.
[0027] The plurality of magnetometers 300 may be fixedly arranged in the at least one second device part 532, thereby defining a fixed positioning and / or orientation of the plurality of magnetometers 300 relative to each other. In some embodiments, the plurality of magnetometers 300 may define a magnetometer plane 310, which may be defined by a plane extending through most of the plurality of magnetometers 300. More specifically, the magnetometer plane 310 may extend through the center (more specifically, the geometric center) of most of the plurality of magnetometers 300. In other words, most of the plurality of magnetometers 300 may be arranged in a common plane (i.e., the magnetometer plane 310). However, one or more of the plurality of magnetometers 300 may be away from and / or tilted relative to the common plane, for example, due to manufacturing problems and / or tolerances. The magnetometer plane 310 may additionally or alternatively be defined by a plane in which the magnetometers among the plurality of magnetometers 300 are mainly arranged.
[0028] A measurement reference coordinate system Xm, Ym, Zm may be defined relative to the plurality of magnetometers 300 (see, for example, Figures 1 to 4)。The measurement reference coordinate system Xm, Ym, Zm can be associated with the position (i.e., orientation and / or location) of at least one of the plurality of magnetometers 300. The measurement reference coordinate system Xm, Ym, Zm can include a first measurement reference axis Xm, a second measurement reference axis Ym, and a vertical measurement reference axis Zm. The first measurement reference axis Xm and the second measurement reference axis Ym can be orthogonal to each other. The vertical measurement reference axis Zm can be orthogonal to the first measurement reference axis Xm and the second measurement reference axis Ym. In some embodiments, the measurement reference coordinate system Xm, Ym, Zm can extend through the center of the plurality of magnetometers 300. Optionally, the first measurement reference axis Xm and the second measurement reference axis Ym can be defined on the magnetometer plane 310. The vertical measurement reference axis Zm can be orthogonal to the magnetometer plane 310.
[0029] The plurality of magnetometers 300 can be configured to measure a magnetic field associated with at least one magnetic object 110. At least one magnetic object 100 can be disposed in or coupled to at least one user-carrying device 100. As outlined above, each of the plurality of magnetometers 300 can be configured to measure a magnetic field associated with at least one magnetic object 110 in the direction of the first measurement reference axis Xm, the second reference axis Ym, and / or the vertical reference axis Zm. In other words, each of the plurality of magnetometers 300 can be configured to perform magnetic field measurements in the direction of one axis (i.e., one dimension), two axes (i.e., two dimensions), or three axes (i.e., three dimensions). The number of magnetometers provided can depend on the desired size of the sensing volume M in which the at least one user-carrying device 100 operates. The plurality of magnetometers 300 can be configured to collect magnetic field measurement results associated with at least one magnetic object 110 within the sensing volume M up to a maximum measurement distance. In an embodiment, the maximum measurement distance can be 30 cm, more specifically 15 cm. In an embodiment, the maximum measurement distance can be defined between the farthest point within the interactive reference coordinate system Xs, Ys, Zs or the sensing volume M and the nearest magnetometer among the plurality of magnetometers 300.
[0030] Reference Figure 9 , shows the arrangement of the plurality of magnetometers relative to at least one second device part 532. In Figure 9 the embodiment shown, the plurality of magnetometers 300 can be arranged in rows and columns. However, it is also possible that the plurality of magnetometers 300 can be arranged in a disordered manner within at least one second device part 532. A calibration process can be used to determine the exact position and measurement axis of each magnetometer within at least one second device part 532 relative to the measurement coordinate system Xm, Ym, Zm. The plurality of magnetometers 300 in Figure 9is shown as being arranged in the magnetometer plane 310 (i.e., in the same plane with respect to the vertical measurement reference axis Zm). However, as outlined above, one or more of the magnetometers may be remote from the magnetometer plane 310, and more specifically, remote in the direction of the vertical measurement reference axis Zm. In some embodiments, at least one second device portion 532 may include at least one output device 510 (see, for example Figure 1 ). At least one output device 510 may include a display or screen. A plurality of magnetometers 300 may be arranged laterally and / or behind the display or screen.
[0031] In Figure 9 the arrangement, a plurality of magnetometers 300 may be arranged in rows k and columns 1 in at least one second device portion 532. Each magnetometer S k,1 may include a vertical magnetometer axis (e.g., Zm), which may be arranged at the intersection of row k and column 1. Adjacent magnetometers S k,1 , S k,l+1 , S k,l-1 may be spaced along row k by distances d l,l+1 and d l,l-1 . Adjacent magnetometers S k,l , S k+1,l , S k-1,l may be spaced along column 1 by distances d k,k+1 and d k,k-1 . As outlined above, the distances d k,1 between corresponding magnetometers S k , d1 may be equal or may be different. As shown, for example Figure 1 , a plurality of magnetometers 300 may be arranged laterally with respect to at least one output device 510. In Figure 1 the embodiment, a plurality of magnetometers 300 may be arranged adjacent to the left edge, right edge, and / or bottom edge of at least one second device portion 532.
[0032] The electronic device 500 may include or may be connected to a processing unit 400, which is configured to perform a computer-implemented method 600 as described below. The electronic device 500 may include a user interface configured to interact with a user U. In some embodiments, the user interface may be provided by at least one output device 510, by a keyboard arranged in the first device portion 531 and / or at least one second device portion 532, and / or by a touchpad arranged in the first device portion 531 and / or at least one second device portion 532.
[0033] In an embodiment of the electronic device 500, at least one second device portion 532 may be rotatably coupled to a first device portion 531. The at least one second device portion 532 may be rotatably coupled to the first device portion 531 via at least one hinge 533 that defines at least one rotation axis R. The at least one second device portion 532 may be fixedly or releasably coupled to the first device portion 531 via at least one hinge. In some embodiments (not shown in the figures), a first hinge may be provided and at least on a second hinge. The first hinge may define a first rotation axis. The at least one second hinge may define at least one second rotation axis. In an embodiment, the first rotation axis may be parallel to the at least one second rotation axis. In some embodiments, the first rotation axis may be inclined and / or orthogonal to the at least one second rotation axis. In one embodiment, the electronic device 500 may further include at least one output device 510. The at least one output device 510 may include a display or a screen. A plurality of magnetometers 300 may be arranged laterally and / or behind the display or the screen, as described above. In these embodiments, the electronic device 500 may be, for example, a laptop computer or a notebook (see, for example Figure 1 ).
[0034] In an embodiment of the electronic device 500, the at least one second device portion 532 may include an output device portion 536 and at least one auxiliary device portion 537 (see, for example Figure 1 ). As Figure 1 's example shows, the at least one auxiliary device portion 537 may be a measuring rod including a plurality of magnetometers 300. The output device portion 536 may be rotatably coupled to the first device portion 531 via at least one hinge 533 that defines at least one rotation axis R. The at least one hinge 533 and the at least one rotation axis R may include the features defined above. The at least one auxiliary device portion 537 may be releasably coupled to the first device portion 531 at least via a data and / or power transmission port 535 (see, for example Figure 1 , Figure 5A and Figure 5B ). The output device portion 536 may include at least one output device 510. As described above, the at least one output device 510 may include a display or a screen. A plurality of magnetometers 300 may be arranged laterally and / or behind the display or the screen. In these embodiments, the electronic device 500 may include, for example, a laptop computer or a notebook, and, for example, at least one measuring rod coupled to the laptop computer or the notebook (see, for example Figure 1 ). As Figure 1 , Figure 5A and Figure 5BAs shown, at least one auxiliary device portion 537 may be coupled to the right edge of the first device portion 531. However, in an embodiment, at least one auxiliary device portion 537 may be coupled to the left edge, the rear edge (which faces away from the user during use), the front edge (which faces the user during use), the top surface 534, and / or the bottom surface of the first device portion 531.
[0035] In an embodiment of the electronic device 500, at least one second device portion 532 may be releasably coupled to the first device portion 531 via at least a data and / or power transfer port 535. The first device portion 531 may include at least one output device 510. In these embodiments, the first device portion 531 may be, for example, a tablet computer, and at least one second device portion 532 may be, for example, a measuring rod coupled to the tablet computer (and / or, for example, a display or screen coupled to the tablet computer). More specifically, a plurality of magnetometers 300 may be arranged in the measuring rod. In an embodiment, the electronic device 500 may include a third device portion 536. The third device portion 536 may be rotatably coupled to the first device portion 531, more specifically via at least one hinge 533 as described above. The third device portion 536 may include at least one output device 510. A plurality of magnetometers 300 may not be arranged in the third device portion 536.
[0036] Figures 3A to 3E is a schematic diagram of an electronic device 500 according to some embodiments. As outlined above, the electronic device 500 includes at least one orientation sensor 520. As Figure 3A and Figure 3B shown in the embodiment of, at least one orientation sensor 520 may include an angle sensor arranged between at least one second device portion 532 and the first device portion 531. The angle sensor may be configured to generate angle sensor measurement data between the first device portion 531 and at least one second device portion 532. The angle sensor may be arranged on or in at least one hinge 533. The angle sensor measurement data may indicate the rotation and / or orientation of at least one second device portion 532 relative to the first device portion 531.
[0037] Refer to Figure 3CIn the illustrated embodiment, at least one orientation sensor 520 may include at least one magnetic object 521 disposed in a first device portion 531 and one or more magnetometers 300 disposed in at least one second device portion 532. In this embodiment, the at least one orientation sensor 520 may be configured to generate magnetic field measurement data associated with the at least one magnetic object 521. The magnetic field measurement data associated with the at least one magnetic object 521 may indicate the rotation and / or orientation of the at least one second device portion 532 relative to the first device portion 531.
[0038] Reference Figure 3D In the embodiment shown in [reference], at least one orientation sensor 520 may include at least one accelerometer disposed in at least one second device portion 532 and / or the first device portion 531. More specifically, the at least one orientation sensor 520 may be configured to generate accelerometer measurement data. The accelerometer may be configured to measure the physical acceleration experienced by the at least one second device portion 532 due to rotation and / or orientation relative to the first device portion 531. In an embodiment, one accelerometer may be disposed in the at least one second device portion 532 and another accelerometer may be disposed in the first device portion 531. The measurement data of the respective accelerometers may be compared with each other. The compared accelerometer measurement data may indicate the rotation and / or orientation of the at least one second device portion 532 relative to the first device portion 531.
[0039] As Figure 3E In the embodiment shown in [reference], the plurality of magnetometers 300 may be a first plurality of magnetometers 300a. The resulting magnetic field measurements (measured with the plurality of magnetometers 300) may be first magnetic field measurements. The electronic device 500 may include a second plurality of magnetometers 300b. The second plurality of magnetometers 300 may be disposed in the first device portion 531. The at least one orientation sensor 520 may include the first plurality of magnetometers 300a and the second plurality of magnetometers 300b. The at least one orientation sensor 520 may be configured to generate first magnetic field measurement data associated with the at least one magnetic object 110 using the first plurality of magnetometers 300a and second magnetic field measurement data associated with the at least one magnetic object 110 using the second plurality of magnetometers 300b. The first magnetic field measurement data and the second magnetic field measurement data may be evaluated and / or compared relative to each other. The compared magnetic field measurement data may indicate the rotation and / or orientation of the at least one second device portion 532 relative to the first device portion 531.
[0040] As Figure 4As shown in the embodiments, at least one orientation sensor 520 may include a plurality of magnetometers 310. The at least one orientation sensor 520 may be configured to generate magnetic field measurement data associated with at least one magnetic object 110. More specifically, the magnetic field measurement data associated with at least one magnetic object 110 may indicate the interaction surface normal N3, particularly in the initial state where at least one user is carrying the device 100. Based on the magnetic field measurement data indicating the interaction surface normal N3, the orientation and / or rotation of at least one second device part 532 relative to at least one first device part 531 may be determined.
[0041] Figure 11 Steps of a computer-implemented method 600 for determining the position of a user-carrying device in accordance with aspects of the present disclosure are schematically illustrated. Figure 12More particularly, the steps of the computer-implemented method 600 are schematically illustrated. The computer-implemented method 600 includes obtaining magnetic field measurements 610 associated with at least one magnetic object 110 using a plurality of magnetometers 300. At least one magnetic object 110 is coupled to at least one user-carried device 100. At least one user-carried device 100 is associated with an interaction reference coordinate system Xs, Ys, Zs. The computer-implemented method 600 includes obtaining orientation data 620 from at least one orientation sensor 520, wherein at least one orientation sensor 520 is arranged in an electronic device 500. The plurality of magnetometers 300 are arranged in the electronic device 500. Further, the computer-implemented method 600 includes determining the orientation and positioning of the plurality of magnetometers 300 relative to the interaction reference coordinate system Xs, Ys, Zs based on the obtained orientation data 630. Additionally, the computer-implemented method 600 includes determining the user-carried device position relative to the interaction reference coordinate system Xs, Ys, Zs (more specifically, the user-carried device position of at least one user-carried device 100) based on the obtained magnetic field measurements and the determined orientation and positioning 640. The plurality of magnetometers 300 arranged in the electronic device 500 may be movable, more specifically rotatable, relative to the interaction reference coordinate system Xs, Ys, Zs, in particular relative to the interaction surface 210. Based on the computer-implemented method 600 described above, although the plurality of magnetometers may be moved (e.g., rotated) to different positions and / or orientations relative to the interaction reference coordinate system Xs, Ys, Zs (more specifically, relative to the interaction surface 210), it is possible to determine and / or track the position of at least one user-carried device 100 relative to the interaction reference coordinate system Xs, Ys, Zs. The determined orientation and positioning may include the tilt, orthogonal orientation, parallel orientation, rotation, and / or positioning of the plurality of magnetometers 300 relative to the interaction reference coordinate system Xs, Ys, Zs. The plurality of magnetometers 300 may be arranged in a movable part of the electronic device 500 (i.e., at least one second device part 532). Further, even when the plurality of magnetometers 300 are rotated relative to the interaction reference coordinate system Xs, Ys, Zs (more specifically, relative to the interaction surface 210), the determination of the user-carried device position relative to the interaction reference coordinate system Xs, Ys, Zs can be automatically adapted. Thus, it is possible to determine and / or track the position of at least one user-carried device 100 with increased accuracy and / or reliability. The representation of at least one user-carried device 100 as a virtual object on at least one output device 510 can be provided with increased accuracy and reliability. This also applies to the electronic device 500 configured to execute the computer-implemented method 600 and the system 10 including the electronic device 500. The order of obtaining the data or measurements described above may vary.
[0042] Such as, for example Figure 1 andFigure 2 As shown, at least one user-carrying device 100 can be operable on the interaction surface 210. More specifically, the vertical interaction reference axis Zs of the interaction reference coordinate system Xs, Ys, Zs can be orthogonal to the interaction surface 210. In an embodiment, the first interaction reference axis Xs and the second interaction reference axis Ys can be defined on the interaction surface 210. The first device portion 531 can include a top surface 534. In some embodiments, the interaction reference coordinate system Xs, Ys, Zs can be defined on the top surface 534. In some embodiments, the vertical interaction reference axis Zs can be orthogonal to the first device portion 531, and more specifically orthogonal to the top surface 534.
[0043] A plurality of magnetometers 300 can be configured to create a sensing volume M (as indicated in FIG. 5, for example). The interaction reference coordinate system Xs, Ys, Zs and / or the interaction surface 210 can be defined within the sensing volume M. The sensing volume M can have an ellipsoidal form. In some embodiments, the plurality of magnetometers 300 can be associated with the magnetometer plane 310, as described above. The method 600 can include defining a measurement reference coordinate system Xm, Ym, Zm with respect to the plurality of magnetometers 300 (see, for example Figures 1 to 4 ). The measurement reference coordinate system Xm, Ym, Zm can be associated with the position of at least one of the plurality of magnetometers 300 as described above.
[0044] At least one user-carrying device 100 can be electrically passive and / or electronically passive. More specifically, electrically passive means that at least one user-carrying device 100 can not include a power source (e.g., a battery) for powering the features (e.g., electronic features) of at least one user-carrying device 100 and / or means for receiving electrical power (e.g., wireless power transfer via an induction coil). Electronically passive means that no computing or processing occurs (or takes place) on at least one user-carrying device 100.
[0045] The term "at least one magnetic object" can refer to an object that can include a component made of a magnetic material (i.e., a material having magnetic properties that can be measured by the plurality of magnetometers 300). At least one user-carrying device 100 and / or at least one magnetic object 210 can be mobile, i.e., freely movable relative to the measurement reference coordinate system Xm, Ym, Zm. In other words, during user operation (i.e., an operation in which at least one user-carrying device 100 and / or at least one magnetic object 110 is operated by the user), the position of at least one user-carrying device 100 within the sensing volume M and / or relative to the interaction reference coordinate system Xs, Ys, Zs (more specifically, the interaction surface 210) can be manipulated by the user within the sensing volume M.
[0046] At least one magnetic object 110 can be a permanent magnet. In an embodiment, at least one magnetic object 110 can be configured to generate a non-zero magnetic field. It may include paramagnetic or diamagnetic materials. In an embodiment, at least one magnetic object 110 can include ferromagnetic or ferrimagnetic materials.
[0047] Method 600 may further include defining a user-carried device coordinate system (see, for example, Figures 6A to 8B ). The device coordinate system may include a first device axis x d , a second device axis y d orthogonal to the first device axis x d , and a vertical device axis z d . The vertical device axis z d can be orthogonal to the device contact surface or point 130 and / or orthogonal to the plane defined by the first device axis x d and the second device axis y d . The device contact surface or point 130 can be a part of at least one user-carried device 100 that can contact the interaction surface 210 during user operation. In the example shown in, for example, Figure 1 , at least one user-carried device 100 can include a contact surface 130 that contacts the interaction surface 210. In other examples, at least one user-carried device 100 can include a contact point 130 (e.g., a stylus or other writing device including a writing tip that contacts the interaction surface 210 during a writing operation). In some embodiments, at least one user-carried device 100 can operate within the sensing volume M but not on the interaction surface 210. In such a case, at least one user-carried device 100 can be used as, for example, a pointer. The pointer can be operable relative to the interaction surface 210 (e.g., to point to a part of the interaction surface 210), but at a distance from the interaction surface 210 (i.e., not in contact with the interaction surface 210). In some embodiments, the device coordinate system can be defined within the geometric center of at least one user-carried device 100.
[0048] The determined orientation may include rotations and / or tilts of the plurality of magnetometers 300 relative to the interaction reference coordinate system Xs, Ys, Zs. More specifically, the determined orientation and positioning may include tilts, orthogonal orientations, parallel orientations, rotations, and / or positionings of the plurality of magnetometers 300 relative to the interaction reference coordinate system Xs, Ys, Zs. More specifically, in the case where the interaction reference coordinate system Xs, Ys, Zs is defined on the interaction surface 210, the determined orientation and positioning may include rotations and / or tilts of the plurality of magnetometers 300 relative to the interaction surface 210. The rotation may be defined by at least one rotation axis R defined relative to the plurality of magnetometers 300 (more specifically, the measurement reference coordinate system Xm, Ym, Zm) and defined relative to the interaction reference coordinate system Xs, Ys, Zs. Determining the orientation and positioning 630 may include determining the orientation and positioning of the measurement reference coordinate system Xm, Ym, Zm relative to the interaction reference coordinate system Xs, Ys, Zs based on the obtained orientation data. More specifically, determining the orientation and positioning 630 may include determining the orientation and positioning of the second device portion 532 relative to the first device portion 531.
[0049] Reference Figures 3A to 5B , determining the orientation and positioning 630 may include detecting a rotation 631 of the plurality of magnetometers 300 (more specifically, the measurement reference coordinate system Xm, Ym, Zm) relative to the interaction reference coordinate system Xs, Ys, Zs (specifically relative to the first device portion 532) based on the obtained orientation data. Additionally or alternatively, determining the orientation and positioning 630 may include determining 632 an orientation angle β between the plurality of magnetometers 300, more specifically between the measurement reference coordinate system Xm, Ym, Zm and the interaction reference coordinate system Xs, Ys, Zs, particularly the first device portion 531, based on the obtained orientation data. More details, a rotation of the measurement reference coordinate system Xm, Ym, Zm relative to the interaction reference coordinate system Xs, Ys, Zs may be detected. An orientation angle β between the measurement reference coordinate system Xm, Ym, Zm and the interaction reference coordinate system Xs, Ys, Zs may be determined. Since the plurality of magnetometers 300 are provided in at least one second device portion 532, a rotation of the at least one second device portion relative to the first device portion 531 may be detected. Since the plurality of magnetometers 300 are provided in at least one second device portion 532, an orientation angle β between the at least one second device portion 532 and the first device portion 531 may be determined. In Figures 3A to 4 the illustrated embodiment (e.g., where the at least one second device portion 532 is coupled to the first device portion 531 via at least one hinge 533), the detected orientation angle β may be between 0° and 360°. In Figure 5BIn the illustrated embodiments (e.g., where at least one second device portion 532, more specifically the measurement rod, is coupled to the first device portion 531), the detected orientation angle β can be 0°, 90°, 180°, or 270°. In this case, the orientation angle β can depend on the positioning of the data and / or power transfer port 535 between the first device portion 531 and the at least one second device portion 532).
[0050] As Figures 3A to 4 and Figure 5B shown, determining the orientation and positioning 630 can include determining 633 a first normal vector N1 orthogonal to the interaction surface 210 based on the determined orientation angle β. More specifically, the first normal vector N1 can be parallel to the vertical interaction reference axis Zs. In some embodiments, the first device portion 531 can include a top surface 534, and the first normal vector N1 can be defined on the top surface 534. Determining 633 the first normal vector N1 orthogonal to the interaction surface 210 can include defining a second normal vector N2 associated with the at least one second device portion 532. The second normal vector N2 can be substantially parallel to the vertical measurement reference axis Zm of the measurement reference coordinate system Xm, Ym, Zm and / or the side surface of the at least one second device portion 532. Determining 633 the first normal vector N1 orthogonal to the interaction surface 210 can include obtaining positioning data of the rotation axis R between the measurement reference coordinate system Xm, Ym, Zm (more specifically, the at least one second device portion 532) and the interaction reference coordinate system Xs, Ys, Zs (more specifically, the first device portion 531). Determining 633 the first normal vector N1 orthogonal to the interaction surface 210 can include calculating the first normal vector N1 based on the obtained positioning data and the determined orientation angle β. The first normal vector N1 can be calculated by applying Rodrigues' rotation formula. Calculating the first normal vector N1 can be based on the defined second normal vector N2, the determined orientation angle β, and the obtained rotation axis R positioning data. As Figure 3A shown, the second normal vector N2 can extend from a second positioning point P2 defined on the at least one second device portion 532, which can be at a second distance l2 from at least one rotation axis R. The second distance l2 and / or the second positioning point P2 can be obtained from a database. The first normal vector N1 can extend from a first positioning point P1 (e.g., on the top surface 534 of the first device portion 531), which can be at a first distance l1 from at least one rotation axis R. The first distance l1, the first positioning point P1, and the first normal vector N1 can be determined based on applying Rodrigues' rotation formula.
[0051] Referring to Figure 3AIn the embodiment shown and as outlined above, at least one orientation sensor 520 may include an angle sensor disposed between at least one second device part 532 and a first device part 531. In this case, the obtained orientation data may include angle sensor measurement data. The angle sensor measurement data may indicate the rotation and / or orientation of at least one second device part 532 relative to the first device part 531. Based on the angle sensor measurement data, rotation may be detected and / or the orientation angle β may be determined.
[0052] Reference Figure 3B In the embodiment shown and as outlined above, at least one orientation sensor 520 may include at least one magnetic object 521 disposed in a first device part 531 and one or more magnetometers 300 disposed in at least one second device part 532. More specifically, at least one magnetic object 110 coupled to at least one user-carrying device 100 may be at least one first magnetic object 110. At least one magnetic object 521 disposed in (and / or coupled to) the first device part 531 may be at least one second magnetic object 521. It should be understood that the determination of the absolute magnetic object position 641 as described below for at least one magnetic object 521 coupled to at least one user-carrying device 100 may be similarly applied to determine the absolute magnetic object position of at least one magnetic object 110 disposed in (and / or coupled to) the first device part 531. The absolute magnetic object position of at least one magnetic object 521 may indicate the absolute magnetic object positioning and / or absolute magnetic object orientation of at least one magnetic object 521 relative to the measurement reference coordinate system Xm, Ym, Zm. More specifically, the obtained orientation data may include magnetic field measurement data associated with at least one magnetic object 521 disposed in the first device part 531 and measured using one or more of the plurality of magnetometers 300. Based on the rotation of at least one second device part 532 relative to the first device part 531, the magnetic field of at least one magnetic object 521 may be measured, and the magnetic field measurement data may be used to determine orientation and positioning. The magnetic field measurement data associated with at least one magnetic object 521 may indicate the rotation and / or orientation of at least one second device part 532 relative to the first device part 531. Based on the magnetic field measurement data associated with at least one magnetic object 521, rotation may be detected and / or the orientation angle β may be determined.
[0053] Reference Figure 3DAs shown in the embodiments and as outlined above, at least one orientation sensor 520 may include at least one accelerometer disposed in at least one second device part 532 and / or the first device part 531. The obtained orientation data may include the accelerometer measurement data as described above. The accelerometer measurement data may indicate the rotation and / or orientation of at least one second device part 532 relative to the first device part 531. In an embodiment, an accelerometer may be disposed in at least one second device part 532, and another accelerometer may be disposed in the first device part 531. The accelerometer measurement data of the respective accelerometers may be compared with each other. The (compared) accelerometer measurement data may indicate the rotation and / or orientation of at least one second device part 532 relative to the first device part 531. Based on the accelerometer measurement data, rotation may be detected and / or the orientation angle β may be determined.
[0054] Reference Figure 3EIn the embodiments shown and as outlined above, the plurality of magnetometers 300 may be a first plurality of magnetometers 300a. The obtained magnetic field measurements (measured with the plurality of magnetometers 300) may be first magnetic field measurements. The electronic device 500 may include a second plurality of magnetometers 300b. The second plurality of magnetometers 300 may be arranged in the first device part 531. The computer-implemented method 600 may further include obtaining second magnetic field measurements associated with at least one magnetic object 110 using the second plurality of magnetometers 300b. The at least one orientation sensor 520 may include the first plurality of magnetometers 300a and the second plurality of magnetometers 300b. The obtained orientation data may include first magnetic field measurement data associated with at least one magnetic object 110 from the first plurality of magnetometers 300a and second magnetic field measurement data associated with at least one magnetic object 110 from the second plurality of magnetometers 300b. More specifically, the first magnetic field measurement data and the second magnetic field measurement data may be evaluated and / or compared with each other. The first magnetic field measurement data and / or the second magnetic field measurement data (evaluated and / or compared) associated with at least one magnetic object 100 may indicate the rotation and / or orientation of at least one second device part 532 relative to the first device part 531. Based on the first magnetic field measurement data and / or the second magnetic field measurement data associated with at least one magnetic object 100, rotation may be detected and / or the orientation angle β may be determined. In some embodiments, detecting rotation 631 and / or determining 632 the orientation angle β, more specifically evaluating and / or comparing the first magnetic field measurement data and the second magnetic field measurement data, may include determining an absolute magnetic object position indicating the absolute magnetic object positioning and / or absolute magnetic object orientation of at least one magnetic object 110 relative to the measurement reference coordinate system Xm, Ym, Zm based on the obtained orientation data. A first absolute magnetic object position of at least one magnetic object 110 may be determined relative to the first plurality of magnetometers 300b, and a second magnetic object position of at least one magnetic object 110 may be determined relative to the second plurality of magnetometers 300b. Determining the orientation and positioning 630 may be based on the first magnetic object position and the second magnetic object position. In this embodiment, the electronic device 500 may include (or may be) a board, a foldable smartphone, or a foldable tablet computer. The board may be, for example, a whiteboard, a blackboard, a digital board (on which a stylus can operate), a drawing and / or writing board, or a display board. In an embodiment, the first device part 531 may be connected to a wall or a bracket, and at least one second device part 532 may be rotatably coupled to the first device part 531.
[0055] As Figure 4In the embodiments indicated and as outlined above, at least one orientation sensor 520 may include a plurality of magnetometers 310. The acquired orientation data may include magnetic field measurement data associated with at least one magnetic object 110. The magnetic field measurement data associated with at least one magnetic object 110 may indicate the interaction surface normal N3, more specifically in the initial state of at least one user-carried device 100 (the initial state will be described in detail below). In the initial state, at least one magnetic object 110 may be parallel to the vertical device axis z d arranged in at least one user-carried device 100. In the initial state of at least one user-carried device 100, the magnetic object torque vector 120 may be arranged to be orthogonal to the interaction surface 210 and / or parallel to the vertical device axis z d . This may be the case when at least one user-carried device 100 is operated on the interaction surface 210 and includes a contact surface 130 relative to the interaction surface 210. Detecting the rotation 631 and / or determining 632 the orientation angle β, more specifically evaluating the magnetic field measurement data, may include determining an absolute magnetic object position indicating the absolute magnetic object positioning and / or absolute magnetic object orientation of at least one magnetic object 110 relative to a plurality of magnetometers 300, more specifically relative to the measurement reference coordinate system Xm, Ym, Zm, based on the acquired orientation data. The absolute magnetic object position may include the magnetic object torque vector 120 and / or the magnetic object positioning vector associated with at least one magnetic object 110. Based on the magnetic field measurement data associated with at least one magnetic object 110, more specifically the magnetic object torque vector 120 and / or the magnetic object positioning vector associated with at least one magnetic object 110, the rotation may be detected and / or the orientation angle β may be determined.
[0056] In an embodiment, the computer-implemented method 600 may further include determining at least one rotation trigger event 634 in response to detecting a rotation 633. The electronic device 500 may include a sleep mode and an active mode. Determining the at least one rotation trigger event 634 may include determining a sleep mode event in response to detecting a rotation 633 in a first direction (e.g., a clockwise rotation about the rotation axis R). The sleep mode event may cause the electronic device 500 to transition from the active mode to the sleep mode. Additionally or alternatively, determining the at least one rotation trigger event 634 may include determining an active mode event in response to detecting a rotation 633 in a second direction (e.g., a counterclockwise rotation about the rotation axis R). The active mode event may cause the electronic device 500 to transition from the sleep mode to the active mode. The electronic device 500 may include a specific threshold orientation angle associated with the orientation of at least one second device portion 532 relative to the first device portion 531 at which the corresponding mode may be activated. The sleep mode may be a power-saving mode of the electronic device 500. In such a case, the electronic device 500 may include (or may be) a notebook, a laptop computer, a foldable smartphone, a foldable tablet computer, and / or an electronic device case.
[0057] In an embodiment, determining the orientation and positioning 630 may include determining an interaction surface position 650. The interaction surface position may indicate the interaction surface positioning, the interaction surface orientation, and / or the interaction surface distance c relative to the electronic device 500, and more specifically relative to the first device portion 531. As Figures 3A to 3E and Figure 5BAs indicated, an interaction surface distance c can be measured between the interaction surface 210 and the top surface 534. The interaction surface position 650 can be defined based on a first set of geometric parameters associated with the interaction surface 210, and more specifically, where the first set of geometric parameters can indicate the geometry of the interaction surface 210. The first set of geometric parameters can include predefined geometric parameters associated with the interaction surface 210. The first set of parameters can be obtained from a database. Determining the interaction surface position 650 can include deriving a first interaction surface configuration 210a that indicates the position of the interaction surface 210 that is substantially parallel to and on the electronic device 500 (more specifically, on the top surface 534 of the first device portion 531). In some embodiments, determining the interaction surface position 650 can include deriving a second interaction surface configuration 210b that indicates the position of the interaction surface 210 that is substantially parallel to and at a distance from the electronic device 500 (more specifically, at a distance from the top surface 534 of the first device portion 531). The distance can be the interaction surface distance c as described above. Since the position of the interaction surface 210 relative to the first device portion 531 can be known, and the orientation of the first device portion 531 relative to at least one second device portion 532 (where a plurality of magnetometers 300 are arranged) can be determined, the positioning and orientation of the plurality of magnetometers 300 relative to the interaction reference coordinate system Xs, Ys, Zs (more specifically, relative to the interaction surface 210) can be determined.
[0058] As Figure 12 indicated, determining the user-carried device position 640 can include determining an absolute magnetic object position 641. The absolute magnetic object position can indicate the absolute magnetic object positioning and / or absolute magnetic object orientation of at least one magnetic object 110 relative to the plurality of magnetometers 300 (more specifically, relative to the measurement reference coordinate system Xm, Ym, Zm). More specifically, the absolute magnetic object position can be determined based on the obtained magnetic field measurement results. The obtained magnetic field measurement results can indicate the magnetic field associated with at least one magnetic object 110. In an embodiment, determining the absolute magnetic object position 641 can include generating magnetic field measurement data 642 based on the obtained magnetic field measurement results. The magnetic field measurement data can indicate the magnetic field positioning, magnetic field orientation, and / or magnetic field strength relative to the measurement reference coordinate system Xm, Ym, Zm. Determining the absolute magnetic object position 641 can also include processing the magnetic field measurement data 643 to correlate the magnetic field measurement data with the absolute magnetic object position (i.e., the absolute magnetic object position as described above).
[0059] The absolute magnetic object position can include a magnetic object torque vector 120 and / or a magnetic object positioning vector associated with at least one magnetic object 110. The magnetic moment vector 120 can indicate the magnetic object orientation and / or magnetic field strength of at least one magnetic object 110 relative to a measurement reference coordinate system Xm, Ym, Zm. The magnetic object positioning vector can indicate the magnetic object positioning relative to the measurement reference coordinate system Xm, Ym, Zm. The absolute magnetic object orientation can be defined by a first set of magnetic object tilt angles δ1, δ2, δ3 measured between the measurement reference coordinate system Xm, Ym, Zm (and / or in some embodiments, the magnetometer plane 310) and the projection of the magnetic moment vector 120 onto (or relative to) the measurement reference coordinate system Xm, Ym, Zm (and / or in some embodiments, the magnetometer plane 310). In some embodiments, the absolute magnetic object orientation can be defined by a first set of Cartesian coordinates defined within the measurement reference coordinate system Xm, Ym, Zm. The first set of magnetic object orientation angles δ1, δ2, δ3 can be measured relative to the measurement reference coordinate axes Xm, Ym, Zm, and more specifically, between the projection of the magnetic object torque vector 120 and the respective axes Xm, Ym, Zm of the measurement reference coordinate system Xm, Ym, Zm. For example, as Figure 2 shown, the first magnetic object orientation angle δ1 can be defined between the first measurement reference axis Xm and the projection of the magnetic object torque vector 120, more specifically, in the Xm-Zm plane. The magnetic object torque vector 120 and / or the magnetic object positioning vector can be determined based on the acquired magnetic field measurements. The magnetic object torque vector 120 and / or the magnetic object positioning vector can be determined based on the implementation of a mathematical model that associates each measurement of the magnetometers in the plurality of magnetometers 300 with the position of at least one magnetic object 110 in the measurement reference coordinate system Xm, Ym, Zm. The model can typically be constructed from the physical equations of electromagnetics, and more specifically, from the equations of magnetostatics. To establish the model, at least one magnetic object 110 can be approximated by a magnetic dipole. Each magnetometer in the plurality of magnetometers 300 can be a vector magnetometer and can be configured to measure the magnetic field in one, two, or three dimensions, as described above.
[0060] Referring Figure 12 to, determining the user-carried device positioning 640 can include determining a relative magnetic object position 644 that indicates the relative magnetic object positioning and / or relative magnetic object orientation of at least one magnetic object 110 relative to at least one user-carried device 110, and more specifically, relative to the device coordinate system. The relative magnetic object orientation can be defined based on a second set of magnetic object tilt angles γ1, γ2, γ3. More specifically, the second set of tilt angles γ1, γ2, γ3 can be measured between the magnetic object torque vector 120 and the respective axes of the device coordinate system (see, for example, Figure 6A andFigure 7A and Figure 7B )。The determination of the relative magnetic object position 644 can be based on the absolute magnetic object position and the second set of geometric parameters as described above. The second set of geometric parameters can include predefined geometric parameters that indicate the geometric positioning and / or geometric orientation of at least one magnetic object 100 relative to at least one user-carrying device 100 (more specifically, in the initial state of at least one user-carrying device 100, which will be described in more detail below). The second set of geometric parameters can be obtained from a database. In other words, based on the determined absolute position of at least one magnetic object 110 and the knowledge of the arrangement of at least one magnetic object 110 in at least one user-carrying device 100 (more specifically, relative to the device coordinate system), the user-carrying device position can be known.
[0061] In an embodiment, the determination of the relative magnetic object position 644 can include detecting a positioning deviation and / or an orientation deviation 645 of the relative magnetic object positioning and / or the relative magnetic object orientation caused by the translation and / or rotation of at least one magnetic object 110 relative to at least one user-carrying device 100, more specifically where at least one user-carrying device 100 can be in an actuated state. As mentioned above, the device coordinate system can be defined within the geometric center of the user-carrying device 100. In the initial state, at least one magnetic object 110 can be in an initial position, for example, tilted and / or away from the device coordinate system and / or the geometric center of at least one user-carrying device 100. When at least one magnetic object 110 is in an actuated position relative to the initial position (and / or relative to at least one user-carrying device 100 and / or relative to the housing 150), at least one user-carrying device 100 can be in an actuated state. In other words, when at least one magnetic object 110 rotates and / or translates relative to at least one user-carrying device 100, more specifically rotates and / or translates from the initial position, at least one user-carrying device 100 can be in an actuated state. In the actuated state, compared with the initial state, the magnetic object orientation and / or the magnetic object positioning of at least one magnetic object 110 relative to the device coordinate system can be different. As Figure 12 indicated, the method 600 can include determining at least one interaction trigger event 646 associated with the positioning deviation and / or the orientation deviation in response to detecting the positioning deviation and / or the orientation deviation. Based on the detected specific translation and / or rotation, the method 600 can include transforming the detected positioning deviation and / or orientation deviation into an interaction trigger event associated with the corresponding translation and / or rotation. In one example, the method 600 can obtain data from a database. The database can include data associating at least one interaction trigger event with a specific translation and / or rotation of at least one magnetic object 110 from the initial position to the actuated position. Examples of at least one interaction trigger event will be described in detail below.
[0062] The determined position of the user-carried device may include at least one of the user-carried device positioning and / or the user-carried device orientation of the user-carried device 100 relative to the interaction reference coordinate system Xs, Ys, Zs (more specifically relative to the interaction surface 210). In some embodiments, determining the absolute magnetic object position 641 may include determining whether at least one magnetic object 110 is located on the side of the measurement reference coordinate system Xm, Ym, Zm that faces the user U during the operation of at least one user-carried device 100 and / or the electronic device 500, or on the side of the measurement reference coordinate system Xm, Ym, Zm that faces away from the user U during the operation of at least one user-carried device 100 and / or the electronic device 500, based on the magnetic object torque vector 120 and / or the magnetic object positioning vector (see, for example, Figure 4 ). More specifically, this may be defined relative to the magnetometer plane 310 and / or the second device part 532. Determining the absolute magnetic object position 641 may include determining whether at least one magnetic object 110 is located on the side of the magnetometer plane 310 that faces the user U during the operation of at least one user-carried device 100 and / or the electronic device 500, or on the side of the magnetometer plane 310 that faces away from the user U during the operation of at least one user-carried device 100 and / or the electronic device 500. In other words, based on these features, it can be determined whether at least one user-carried device 100 is operating in front of or behind the second device part 532, and more specifically in front of or behind the magnetometer plane 310.
[0063] In an embodiment, determining the user-carried device position 640 may include deriving the magnetic object torque vector 120 and / or the magnetic object positioning vector from the absolute magnetic object position. Determining the user-carried device position 640 may also include deriving the determined interaction surface position relative to the electronic device 500. Determining the user-carried device position 640 may also include determining a first virtual intersection point of the projection of the magnetic object torque vector 120 with the interaction surface 210.
[0064] In some embodiments, determining the user-carried device position 640 may include assuming a user-carried device contact 646 between at least one user-carried device 100 and the interaction surface 210. More specifically, assuming the user-carried device contact 646 may include determining the vertical device axis z dA second virtual intersection point with the interaction surface 210. It is assumed that the user-carried device contact 646 between at least one user-carried device 100 and the interaction surface 210 can be based on the determined interaction surface position and the determined relative magnetic object position. Additionally, it is assumed that the user-carried device contact 646 between at least one user-carried device 100 and the interaction surface 210 can be based on the determined absolute magnetic object position and / or the determined positioning and orientation.
[0065] As Figure 11 and Figure 12 indicated, the computer-implemented method may further include representing the at least one user-carried device 100 as a virtual object on at least one output device 510 (and / or at least one additional output device) based on the determined user-carried device position. More specifically, the movement of the virtual object on the at least one output device 510 may be based on a virtual reproduction of the position of the at least one user-carried device 100 relative to the interaction reference coordinate system Xs, Ys, Zs (more specifically relative to the interaction surface 210). The manipulation of the user-carried device position during user operation may be represented as a virtual object on the at least one output device 510 (and / or at least one additional output device). In an embodiment, the at least one user-carried device 100 may be visually reproduced as a virtual object. In an embodiment, the at least one output device 510 (and / or at least one additional output device) may be configured to visually reproduce the virtual object. Representing the at least one user-carried device 100 may include reproducing the movement of the at least one user-carried device 100 within the sensing volume M as a movement of a virtual object on the at least one output device 510. The movement of the at least one user-carried device 100 within the sensing volume M may be caused by the manipulation of the user-carried device 100 during user operation (i.e., by the user manipulating the position of the at least one user-carried device 100). In other words, the movement of the user-carried device position may be determined and reproduced as the movement of a virtual object on the at least one output device 510 (and / or at least one additional output device). The visual reproduction may be the movement of a cursor on the at least one output device 510 (and / or at least one additional output device). In an embodiment, the visual reproduction may be different from the design of the at least one user-carried device 100, but may be any icon (e.g., an arrow, a picture). In an embodiment, the visual reproduction may be a drawing or a letter. In other embodiments, the visual reproduction may be a color change and / or a brightness change of the at least one output device 510 (e.g., the at least one output device 510 may become brighter or darker). In an embodiment, the at least one output device 510 (and / or at least one additional output device) may be a visual screen or a display. In some embodiments, the at least one output device 510 (and / or at least one additional output device) may be a light indicator device or an audio device.
[0066] The computer-implemented method 600 may also include initializing the plurality of magnetometers 300 and at least one user-carried device 100, more specifically, when the user starts a user operation. In an embodiment, the at least one user-carried device 100 may be tracked over a time period that includes a plurality of time samples. At each time sample, the computer-implemented method 600 may include determining the user-carried device location 640 and may store the determined location (or interaction) for each time sample.
[0067] In an embodiment, the computer-implemented method 600 may also include applying a filter for filtering the determined user-carried device location. Magnetic noise and electronic noise as well as environmental variations may cause the location determination to not be smooth over time. Based on the filtering, a smooth position trajectory of the at least one user-carried device 100 with respect to the measurement reference coordinate system Xm, Ym, Zm and / or the interaction reference coordinate system Xs, Ys, Zs may be achieved. The filter may be a low-pass filter or a Kalman filter, more specifically an extended Kalman filter or an unscented Kalman filter. The filter may use the magnetic field measurements of the plurality of magnetometers 300 as inputs and may implement the mathematical model as described above to approximate at least one magnetic object 110 by a magnetic dipole.
[0068] The computer-implemented method 600 described above may be performed by a computer or computer network or capable of being performed via a computer or computer network, which includes at least one processing unit (processor) and at least one data storage device (i.e., memory). The described process logic may be stored in the at least one data storage device in the form of executable code and executed by the at least one processing unit. Systems and subsystems may send data to the at least one processing unit and, in an example, they may also receive instructions from the at least one processing unit. The processing unit may thereby direct user-initiated and / or automatically generated queries to the system 10 and / or the electronic device 500. The system 10 and / or the electronic device 500 are not limited to a particular hardware environment. Thus, distributed devices coupled via a network may perform the techniques described herein. The present disclosure also encompasses electrical signals and computer-readable media that define instructions that, when executed by a processing unit, implement the techniques described herein. As described above, the system 10 and / or the electronic device 500 may include at least one database. Alternatively or in addition, the system 10 and / or the electronic device 500 may access a database in the cloud (via a communication interface). The system 10 and / or the electronic device 500 may include (at least one) communication interface to couple to a plurality of magnetometers, processing units, and / or databases. The communication interface may include one or more of a network, the Internet, a local area network, a wireless local area network, a broadband cellular network, and / or a wired network. In an example, the system 10 and / or the electronic device 500 may be coupled to one or more features via a server hosted in the cloud.
[0069] In accordance with one aspect of the present disclosure, a computer system may be configured to perform the computer-implemented method 600 described above. In accordance with another aspect of the present disclosure, a computer program may be configured to perform the computer-implemented method 600 described above. Additionally, a computer-readable medium or signal storing the computer program may be provided.
[0070] System 10 and / or the electronic device may be configured to track the movement of at least one magnetic object 110 and / or at least one user-carrying device 100 in at least five degrees of freedom. The at least five degrees of freedom may include the translation of at least one magnetic object 110 along a first measurement reference axis Xm, a second measurement reference axis Ym, and a vertical measurement reference axis Zm, a first rotation about a first rotation axis, and a second rotation about a second rotation axis. In the case where at least one user-carrying device 100 operates on the interaction surface 210, system 10 and / or the electronic device 500 may be configured to assume contact between the user-carrying device 100 and the interaction surface 210. This may be done based on the determined position of the user-carrying device as described above. During user operation, system 10 and / or the electronic device 500 may be configured to track the movement of at least one user-carrying device 100 within the sensing volume M and / or relative to the interaction surface 210 over a period of time. More specifically, system 10 may be configured to determine the trajectory of the user-carrying device 100 within the sensing volume M and / or relative to the interaction reference coordinate system Xs, Ys, Zs (more specifically, the interaction surface 210). As described above, the user-carrying device 100 may be tracked over a period of time including a plurality of time samples. At each time sample, the position of at least one user-carrying device 100 within the sensing volume M and / or relative to the interaction reference coordinate system Xs, Ys, Zs may be determined.
[0071] Reference Figure 10 , indicating the movement of at least one user-carrying device 100 on the interaction surface 210. In this embodiment, at least one user-carrying device 100 may be a computer mouse. During user operation, at least one user-carrying device 100 may move on the interaction surface 210 from the position xd, yd to the position dx d , dy d . System 10 and / or the electronic device 500 may be configured to track this movement based on the determined position of the user-carrying device. As outlined above, the electronic device 500 may include a user interface configured to interact with the user U and / or receive user input. A plurality of magnetometers 300 may be configured to receive data from the processing unit 400 and / or an external processing unit and / or transmit data to the processing unit 400 and / or an external processing unit. System 10 and / or the electronic device 500 may include a data storage device connected to the processing unit 400. The data storage device may include a main data storage device (e.g., RAM) and a secondary data storage device. The data storage device may be integrated in the electronic device 500 and / or connected to the electronic device.
[0072] As Figure 1 , Figure 2 and Figure 10As indicated, system 10 may include an interactive support member 200 having an interactive support surface 230. The interactive surface 210 may be at least part of the surface of the interactive support surface 230. The interactive support member 200 may not include ferromagnetic properties, such as ferromagnetic particles. In an embodiment, the interactive support member 200 may be furniture (e.g., a table), an electronic device 500 as described above (e.g., a notebook, laptop, or tablet computer), a screen, a wall, or a mouse pad. The interactive surface 210 may be defined based on a first set of geometric parameters associated with the interactive support member 200. More specifically, the type of the interactive support member 200 may be known, such as a notebook or a mouse pad. Such an interactive support member 200 may be defined by the first set of geometric parameters as described above. A partial surface of the interactive support surface 230 may be used as the interactive surface 210. A plurality of magnetometers 300 may be electrically (e.g., via wires or a data bus) or wirelessly connected to the processing unit 400, an external processing unit, and / or the electronic device 500.
[0073] Reference Figures 6A to 8B , at least one user-carrying device 100 may include a housing 150. At least one magnetic object 110 may be disposed in the housing 150. In other embodiments, at least one magnetic object 110 may be coupled to the housing 150. In an initial state of the at least one user-carrying device 100, the relative magnetic object orientation with respect to the at least one user-carrying device 100 may be defined based on the second set of tilt angles γ1, γ2, γ3 as described above. More specifically, the second set of tilt angles γ1, γ2, γ3 may be measured between the magnetic moment vector 120 and the respective axes of the device coordinate system. In the example as Figure 6A and Figure 7A shown, γ1 may be measured between the vertical device axis z d and the magnetic moment vector 120. In an initial state of the at least one user-carrying device 100, the magnetic moment vector 120 may be tilted with respect to the vertical device axis z d .
[0074] However, in other embodiments, for example, as Figure 6B indicated, in an initial state of the at least one user-carrying device 100, the magnetic moment vector 120 may extend substantially parallel to the vertical device axis z d . In one embodiment, in an initial state of the at least one user-carrying device 100, at least one magnetic object 110 may be disposed in the housing 150 such that the vertical device axis z d extends through the magnetic moment vector 120. However, in other embodiments, in an initial state of the at least one user-carrying device 100, at least one magnetic object 110 may be disposed in the housing 150 such that the magnetic moment vector 120 is parallel to the vertical device axis z dbut away from the vertical device axis (see for example Figure 6B ).
[0075] At least one magnetic object 110 may be movable relative to at least one user-carrying device 100, and more specifically, wherein at least one magnetic object 110 may be rotatable and / or translatable relative to at least one user-carrying device 100 (and / or housing 150). When at least one magnetic object 110 is in an initial position relative to at least one user-carrying device 100 (more specifically, relative to housing 150), at least one user-carrying device 100 may be in an initial state. In other words, when at least one magnetic object 110 is not rotated and / or translated relative to user-carrying device 100, at least one user-carrying device 100 may be in an initial state. As mentioned above, a device coordinate system may be defined within the geometric center of at least one user-carrying device 100. In the initial state, at least one magnetic object 110 may be tilted and / or away from the device coordinate system and / or the geometric center of at least one user-carrying device 100. When at least one magnetic object 110 is in an actuated position relative to the initial position (and / or relative to at least one user-carrying device 100 and / or relative to housing 150), user-carrying device 100 may be in an actuated state. In other words, when at least one magnetic object 110 is rotated and / or translated relative to at least one user-carrying device 100, more specifically when rotated and / or translated from the initial position, at least one user-carrying device 100 may be in an actuated state. In the actuated state, the magnetic object orientation and / or magnetic object positioning of at least one magnetic object 110 may be different compared to the initial state with respect to the device coordinate system.
[0076] As Figure 6B shown, at least one user-carrying device 100 may include at least two magnetic objects 110a, 110b having different relative orientations with respect to each other. System 10 and / or electronic device 500 may be configured to determine the relative magnetic object orientation of each of at least two magnetic objects 110a, 110b. More specifically, system 10 and / or electronic device 500 may be configured to determine the magnetic moment vectors 120a, 120b of each of at least two magnetic objects 110a, 110b. Additionally, system 10 and / or electronic device 500 may be configured to determine the magnetic object positioning, magnetic object orientation, and / or magnetic object distance of each of at least two magnetic objects 110a, 110b with respect to a reference coordinate system XYZ (more specifically, with respect to the magnetometer plane 310) and / or with respect to the interaction surface 210. As Figure 6BAs shown, the first magnetic object 110a may include a first magnetic moment vector 120a. The second magnetic object 110b may include a second magnetic moment vector 120b. The first magnetic moment vector 120a may be inclined relative to the second magnetic moment vector 120b. In Figure 6B the example shown, the first magnetic moment vector 120a may be substantially orthogonal to the second magnetic moment vector 120b. The first magnetic object 110a may be fixedly coupled to at least one user-carrying device 100. This means that the first magnetic object 110a may not be rotatable and / or translatable relative to at least one user-carrying device 100. The second magnetic object 110b may be disposed in the housing 150. The second magnetic object 110b may be rotatable and / or translatable relative to at least one user-carrying device 100 and / or the first magnetic object 110a. The system 10 and / or the electronic device 500 may be configured to track the movement of at least two magnetic objects 110a, 110b in at least six degrees of freedom. In addition to at least five degrees of freedom defined above, at least one user-carrying device 100 including at least two magnetic objects 110a, 110b allows determination of the relative positioning deviation and / or relative orientation deviation of the at least two magnetic objects 110a, 110b relative to each other.
[0077] Figure 6B An example illustrates a translation 160 of at least one magnetic object from an initial position to an actuated position relative to a device coordinate system. In Figure 6B the example, the second magnetic object 110b may be disposed in the housing 150, which is translated from an initial position to an actuated position. The second magnetic object 110b is translated in the direction of the first device axis x d and in the direction of the vertical device axis z d such translations 160 from the initial position to the actuated position may be described by dx m and dz m as indicated in Figure 6B Although described only for the second magnetic object 110b, the above features may be similarly applied to at least one magnetic object 110. In some embodiments, at least one magnetic object 110 may be fixedly disposed in the housing 150. In this case, at least one magnetic object 110 may not be translatable 160 and / or rotatable relative to at least one user-carrying device 100 (and / or the housing 150).
[0078] Referring to Figures 7A to 8B illustrates a rotation of at least one magnetic object 110 relative to at least one user-carrying device 100 and / or the housing 150. In Figure 7A and Figure 7B at least one magnetic object 110 may be rotated about a second device axis y by a first rotation 170 dRotate from the initial position to the actuated position. It should be noted that in Figure 7A In the embodiment of, in the initial state, at least one magnetic object 110 is inclined by an angle γ1 measured between the magnetic moment vector 120 and the vertical device axis z d In other words, in its initial position, at least one magnetic object 110 can be arranged to be inclined with respect to the vertical device axis z d As Figure 7A And Figure 7B As shown, the first rotation 170 can be defined by a first rotation angle α1 measured between the initial position (i.e., the initial positioning and / or orientation of the magnetic moment vector in the initial state) and the magnetic moment vector 120. In Figure 7A , the first rotation angle α1 can include a positive value. In Figure 7B , the first rotation angle α1 can include a negative value.
[0079] In Figure 8A And Figure 8B In the embodiment shown, in its initial position and / or state, at least one magnetic object 110 can include a magnetic moment vector 120 parallel to the vertical device axis z d . In other words, the tilt angle γ2 about the first device axis x d Can be zero. At least one magnetic object 110 can be rotated from the initial position to the actuated position about the first device axis x d By a second rotation 180. This second rotation 180 can be defined by a second rotation angle α2 measured between the vertical device axis z d And the magnetic moment vector 120. In Figure 8A , the second rotation angle α2 can include a positive value, and in Figure 8B , the second rotation angle α2 can include a negative value. Although not explicitly shown in the figure, it should be understood that combinations of the rotations 170, 180 and / or translations 160 as described above are also possible. The translation 160 of at least one magnetic object 110 from the initial position to the actuated position is only shown in the example of Figure 6B In the directions of the first device axis x d And the vertical device axis z d . However, any combination of translations with respect to the device axes x d , yd, z d (more specifically along the first device axis x d , the second device axis y d And / or the vertical device axis z d ) is possible. The system 10 and / or the electronic device 500 can be configured to detect the translation 160 and / or the rotations 170, 180 of at least one magnetic object 110 relative to at least one user-carrying device 100.
[0080] As Figure 2 and Figures 6A to 8B indicated, at least one user-carrying device 100 may include at least one manipulation feature 140, more specifically coupled to the housing 150. At least one manipulation feature 140 may be translatable and / or rotatable relative to at least one user-carrying device 100, more specifically relative to the housing 150. At least one magnetic object 110 may be coupled to at least one manipulation feature 140. More specifically, at least one magnetic object 110 may be operably (e.g., mechanically) coupled to at least one manipulation feature 140. Translation and / or rotation of at least one manipulation feature 140 relative to the housing 150 may cause translation and / or rotation of at least one magnetic object 110 relative to the housing 150. At least one manipulation feature 140 may be actuated by a user. In an initial state of at least one user-carrying device 100, at least one manipulation feature 140 and / or at least one magnetic object 110 may be in an initial position. In an actuated state of at least one user-carrying device 100, at least one manipulation feature 140 and / or at least one magnetic object 110 may be in an actuated position. In other words, in the case where at least one manipulation feature 140 is not actuated by a user, the user-carrying device may be in an initial state. More specifically, in the initial state, at least one manipulation feature 140 and / or at least one magnetic object 110 may be in an initial position. In the case where at least one manipulation feature 140 is actuated by a user, at least one user-carrying device 100 may be in an actuated state. More specifically, in the actuated state, at least one manipulation feature 140 and / or at least one magnetic object 110 may be in an actuated position. Referring Figure 7A and Figure 7B to the example shown in, actuation of at least one manipulation feature 140 may result in a first rotation 170 about a second device axis y d as described above. Depending on the actuation direction of at least one manipulation feature 140, the first rotation angle α1 may have a positive or negative value. Additionally or alternatively, referring Figure 8A and Figure 8B , actuation of at least one manipulation feature 140 may result in a second rotation 180 about a first device axis x d as described above. Depending on the actuation direction of at least one manipulation feature 140, the second rotation angle α2 may have a positive or negative value. Referring Figure 6B , actuation of at least one manipulation feature 140 may cause at least one magnetic object 110 to move along a first device axis x d , a second device axis y d and / or a vertical device axis z dTranslation 160. As defined above, method 600 includes detecting a positioning deviation and / or an orientation deviation 635. In an embodiment, the detected orientation deviation may be the first rotation angle α1 and / or the second rotation angle α2.
[0081] At least one user-carrying device 100 may include a biasing element (not shown) configured to push at least one manipulation feature 140 and / or at least one magnetic object 110 from an actuated position to an initial position, more specifically when at least one manipulation feature 140 is not actuated. More specifically, when a user actuates (e.g., applies a force thereto) at least one manipulation feature 140, at least one manipulation feature 140 and at least one magnetic object 110 may be moved from the initial position to the actuated position. In this case, the biasing element may be biased. When the user releases the force on at least one manipulation feature 140, the at least one manipulation feature 140 and at least one magnetic object 140 may be pushed from the actuated position to the initial position.
[0082] At least one manipulation feature 140 may be associated with at least one interaction trigger event. System 10 and / or electronic device 500 may be configured to determine a corresponding interaction trigger event based on the translation 160 and / or rotation 170, 180 of at least one magnetic object 110 relative to at least one user-carrying device 100 as described above, more specifically caused by the translation of at least one manipulation feature 140 operatively coupled to at least one magnetic object 110. Specifically, electronic device 500 and / or system 10 may be configured to determine a positioning and / or rotation deviation between the initial position and the actuated position. In other words, a specific translation and / or rotation of at least one magnetic object 110 relative to at least one user-carrying device 100 may be detected by system 10 (more specifically by electronic device 500). Based on the detected specific translation and / or rotation, system 10 and / or electronic device 500 may be configured to transform the movement into a trigger event associated with the translation and / or rotation. In one example, system 10 and / or electronic device 500 may be coupled to (and / or include) a database. The database may include data associating at least one trigger event with a specific translation and / or rotation of at least one magnetic object 110 from the initial position to the actuated position. System 10 and / or electronic device 500 may be configured to transmit data to the database and / or receive data from the database. In Figure 7A and Figure 7B the illustrated embodiment, the first rotation 170 may be associated with a first trigger event. In Figure 8A and Figure 8BIn the illustrated embodiment, the second rotation 180 may be associated with a second trigger event. The corresponding trigger event may be, for example, a click event, a scroll event, and / or a selection event. In the case where multiple magnetic objects are provided, additional trigger events may be determined based on the rotation and / or translation of the magnetic objects relative to each other and may be detected by the system 10 and / or the electronic device 500. At least one interaction trigger event may be initiated by sensing the user manipulation of at least one user-carrying device 100 (more specifically, at least one electrically passive user-carrying device and / or electronically passive user-carrying device 100) within the sensing volume M. At least one interaction trigger event may cause an action based on user input and / or may be used to control an action in a digital environment (i.e., an environment controlled by a computer or a computer network) (e.g., a virtual environment). More specifically, at least one interaction trigger event may implement the user input on at least one user-carrying device 100 as an action in the digital environment. For example, at least one user-carrying device 100 may be used with an electronic device 500, which may be or may include, for example, a tablet computer, a cellular phone, a smart phone, a laptop computer, a computer, a virtual reality (VR) kit, a notebook, a foldable smart phone, a foldable tablet computer, an electronic device case, and / or a television. At least one interaction trigger event may cause an action on the electronic device 500 and / or may be used to control an action on the electronic device 500 based on the user input on at least one user-carrying device 100.
[0083] As mentioned above, at least one interaction trigger event can be a scroll event and / or a click event. The scroll event and / or the click event can be applied to various different application fields. The scroll event can trigger a scrolling action in a digital environment (more specifically, a virtual environment) based on user input (e.g., "scroll up" and "scroll down" on a display). The scroll event can cause or provide control over the rotation and / or translational movement of virtual objects in a digital environment (more specifically, the virtual environment associated with the user input). For example, the scroll event can trigger a scrolling action, including scrolling of files or data, rotation or translational movement of virtual objects associated with the selection of an option from multiple options. The scrolling action can also include rotating a body in the virtual environment and / or changing the perspective in the virtual environment. In addition, the scrolling action can include one or more of the following: moving the cursor in two opposite directions (e.g., horizontally or vertically on an output device), moving a displayed element (e.g., a page, a cursor) that can be controlled by at least one user-carrying device 100, stepping in a direction, flipping through a menu, flipping through a selection list, or adjusting (e.g., increasing or decreasing) a parameter (e.g., setting or configuring). The click event can trigger a click action (more specifically, a click action on a virtual object) in a digital environment (more specifically, a virtual environment) based on user input. The click event can include, for example, the selection of an object (such as a button, a file, an icon, or another object), the selection of an item, the selection of a list, the selection of an item on a list. The click event can trigger the following actions. The click event can trigger an action to provide additional information and / or attributes of the selected object, item, or text (e.g., letters, words, phrases). The click event can trigger a single-click action, a double-click action, a triple-click action, a right-click action, and / or a click-and-drag action within the digital environment (more specifically, the virtual environment). The single-click action can refer to the selection of an object within the virtual environment. The double-click action can open a file or execute a program in the virtual environment. The click-and-drag action can include clicking, holding, and moving an object, for example, which can be used to highlight or drag-select text or an object. The triple-click action can be used to select a paragraph of text. The right-click action can execute a special action, for example, opening a list with additional information and / or attributes of the selected object as mentioned above. The actions triggered by the click event depend on the user input on at least one user-carrying device 100. For example, when the user provides two quick and consecutive inputs on at least one user-carrying device 100, the click event can cause a double-click action. The above features enable various new application fields for at least one user-carrying device 100, such as a computer mouse, a keyboard, a dial, a mouse scroll element (e.g., a scroll wheel), a joystick, controls for an electronic device (e.g., audio controls or visual controls), controls for software settings or visualization (e.g., graphics software or design software), or controls for a computer game.
[0084] In an example such as Figure 2 and Figures 6A to 8B shown, a first manipulation feature 140a can be provided and a second manipulation feature 140b can be provided. Each of the first manipulation feature 140a and the second manipulation feature 140b can be operatively coupled to at least one magnetic object 110. In this example, the at least one user-carrying device 100 can be, for example, a computer mouse. The first manipulation feature 140a can be a click manipulation feature and the second manipulation feature 140b can be a scroll manipulation feature. Actuating the first manipulation feature 140a may cause a first rotation 170 of the at least one magnetic object 110. Depending on the actuation direction, the first rotation angle α1 can include a positive or negative value. The system 10 and / or the electronic device 500 can be configured to detect the first rotation angle α1 and can convert this rotation into a click event including a first click event or a second click event according to the first rotation angle value. The first click event can trigger a left-click action as described above, more specifically a single-click action, a double-click action, a triple-click action, and / or a click-and-drag action. The second click event can trigger a right-click action as described above. Actuating the second manipulation feature 140b may cause a second rotation 180 of the at least one magnetic object 110. Depending on the actuation, the second rotation angle α2 can include a positive or negative value. The system 10 and / or the electronic device 500 can be configured to detect the second rotation angle α2 and can convert this rotation into a scroll event. The scroll event can include a first scroll event or a second scroll event. The corresponding scroll event can depend on the second rotation angle value. More specifically, the first rotation 170 can be associated with a click event. In the case where the first rotation angle α1 has a positive value, this can be associated with the first click event. In the case where the first rotation angle α1 has a negative value, this can be associated with the second click event. The second rotation 180 can be associated with a scroll event. In the case where the second rotation angle α2 has a positive value, this can be associated with a first scroll event (e.g., "scroll up"). In the case where the second rotation angle α2 has a negative value, this can be associated with a second scroll event (e.g., "scroll down").
[0085] The above features have been described with respect to at least one user-carried device 100. In some embodiments, more than one user-carried device 100 may be provided and operated (e.g., manipulated by user U) within a sensing volume M created by a plurality of magnetometers 300. The computer-implemented method 600, electronic device 500, and system 10 according to the present disclosure have been described with respect to at least one user-carried device 100. The features described above may also apply to each additional user-carried device or other user-carried device 100 operating within the sensing volume M. Additionally, more than one electronic device 500 may be provided and operate together with at least one user-carried device 100 and any additional user-carried device 100 as described above. In the case where more than one electronic device 500 is provided, the features described above according to aspects of the present disclosure may also apply to each additional electronic device or other electronic device 500.
[0086] Although the present disclosure has been described above and defined in the appended claims, it should be understood that the present disclosure may be defined in accordance with the following embodiments:
[0087] 1. A computer-implemented method (600) for determining the position of at least one user-carried device (100), comprising:
[0088] - Obtaining magnetic field measurements (610) associated with at least one magnetic object (110) using a plurality of magnetometers (300), wherein the at least one magnetic object (110) is coupled to at least one user-carried device (100), and wherein the at least one user-carried device (100) is associated with an interactive reference coordinate system (Xs, Ys, Zs);
[0089] - Obtaining orientation data (620) from at least one orientation sensor (520), wherein the at least one orientation sensor (520) is arranged in an electronic device (500), and wherein the plurality of magnetometers (300) are arranged in the electronic device (500);
[0090] - Determining the orientation and positioning of the plurality of magnetometers (300) relative to the interactive reference coordinate system (Xs, Ys, Zs) based on the obtained orientation data (630), and
[0091] - Determining the user-carried device position relative to the interactive reference coordinate system (Xs, Ys, Zs) based on the obtained magnetic field measurements and the determined orientation and positioning (640).
[0092] 2. The computer-implemented method (600) according to embodiment 1, wherein the at least one user-carrying device (100) is capable of operating on the interaction surface (210), and more specifically wherein the vertical interaction reference axis (Zs) of the interaction reference coordinate system (Xs, Ys, Zs) is orthogonal to the interaction surface (210).
[0093] 3. The computer-implemented method (600) according to embodiment 2, wherein the plurality of magnetometers (300) are configured to create a sensing volume (M), and wherein the interaction surface (210) is defined within the sensing volume (M).
[0094] 4. The computer-implemented method (600) according to any one of the foregoing embodiments, comprising:
[0095] defining a measurement reference coordinate system (Xm, Ym, Zm) relative to the plurality of magnetometers (300), and more specifically wherein the measurement reference coordinate system (Xm, Ym, Zm) is associated with the position of at least one of the plurality of magnetometers (300).
[0096] 5. The computer-implemented method (600) according to any one of the foregoing embodiments, wherein the determined orientation comprises rotation and / or tilt of the plurality of magnetometers (300) relative to the interaction reference coordinate system (Xs, Ys, Zs).
[0097] 6. The computer-implemented method (600) according to embodiment 5, wherein the rotation is defined by at least one rotation axis (R) defined relative to the plurality of magnetometers (300), and more specifically the measurement reference coordinate system (Xm, Ym, Zm) and the interaction reference coordinate system (Xs, Ys, Zs).
[0098] 7. The computer-implemented method (600) according to any one of embodiments 4 to 6, wherein determining the orientation and positioning (630) comprises determining the orientation and positioning of the measurement reference coordinate system (Xm, Ym, Zm) relative to the interaction reference coordinate system (Xs, Ys, Zs) based on the obtained orientation data.
[0099] 8. The computer-implemented method (600) according to any one of the foregoing embodiments, wherein the electronic device (500) comprises a first device part (531) and at least one second device part (532) coupled to the first device part (531), and more specifically wherein the plurality of magnetometers (300) are provided in the at least one second device part (532).
[0100] 9. The computer-implemented method (600) according to embodiment 8, wherein determining the orientation and position (630) includes determining the orientation and position of the second device part (532) relative to the first device part (531).
[0101] 10. The computer-implemented method (600) according to embodiment 8 or embodiment 9, when dependent on embodiment 4, wherein determining the orientation and position (630) includes:
[0102] detecting a rotation (631) of the plurality of magnetometers (300), more specifically the measurement reference coordinate system (Xm, Ym, Zm), relative to the interaction reference coordinate system (Xs, Ys, Zs), in particular relative to the first device part (532), based on the obtained orientation data, and / or
[0103] determining (632) an orientation angle (β) between the plurality of magnetometers (300), more specifically between the measurement reference coordinate system (Xm, Ym, Zm) and the interaction reference coordinate system (Xs, Ys, Zs), in particular the first device part (531), based on the obtained orientation data.
[0104] 11. The computer-implemented method (600) according to embodiment 10, wherein the detected orientation angle (β) is between 0° and 360°.
[0105] 12. The computer-implemented method (600) according to embodiment 10, wherein the detected orientation angle (β) is 0°, 90°, 180° or 270°.
[0106] 13. The computer-implemented method (600) according to any one of embodiments 10 to 12, when dependent on embodiment 2, wherein determining the orientation and position (630) includes:
[0107] determining (633) a first normal vector (N1) orthogonal to the interaction surface (210) based on the determined orientation angle (β), more specifically wherein the first normal vector (N1) is parallel to the vertical interaction reference axis (Zs).
[0108] 14. The computer-implemented method (600) according to embodiment 13, when dependent on embodiments 2 and 10, wherein determining (633) the first normal vector (N1) orthogonal to the interaction surface (210) includes:
[0109] Define a second normal vector (N2) associated with the at least one second device part (532), wherein the second normal vector (N2) is substantially parallel to the vertical measurement reference axis (Zm) of the measurement reference coordinate system (Xm, Ym, Zm) and / or the side surface of the at least one second device part (532);
[0110] Obtain positioning data of the rotation axis (R) between the measurement reference coordinate system (Xm, Ym, Zm), more specifically the first device part (531), and the interaction reference coordinate system (Xs, Ys, Zs), more specifically the at least one second device part (532); and
[0111] Calculate the first normal vector (N1) based on the obtained positioning data and the determined orientation angle (β).
[0112] 15. The computer-implemented method (600) according to embodiment 13 or embodiment 14, wherein the first device part (531) includes a top surface (534), more specifically wherein the first normal vector (N1) is defined on the top surface (534).
[0113] 16. The computer-implemented method (600) according to any one of embodiments 8 to 15, wherein determining orientation and positioning (630) includes:
[0114] Determine an interaction surface position (650), wherein the interaction surface position indicates the interaction surface positioning, interaction surface orientation, and / or interaction surface distance (c) relative to the electronic device (500), more specifically relative to the first device part (531).
[0115] 17. The computer-implemented method (600) according to embodiment 16, when dependent on embodiment 2, wherein the interaction surface position (650) is defined based on a first set of geometric parameters associated with the interaction surface (210), more specifically wherein the first set of geometric parameters indicates the geometric shape of the interaction surface (210).
[0116] 18. The computer-implemented method (600) according to embodiment 17, wherein the first set of geometric parameters includes predefined geometric parameters associated with the interaction surface (210).
[0117] 19. The computer-implemented method (600) according to any one of embodiments 16 to 18, when dependent on embodiment 15, wherein determining the interaction surface position (650) includes:
[0118] Derive a first interaction surface configuration (210a) that indicates the position of the interaction surface (210) that is substantially parallel to the electronic device (500) and on the electronic device, more specifically on the top surface (534) of the first device portion (531).
[0119] 20. The computer-implemented method (600) according to any one of embodiments 16 to 18, when dependent on embodiment 15, wherein determining the interaction surface position (650) includes:
[0120] Derive a second interaction surface configuration (210b) that indicates the position of the interaction surface (210) that is substantially parallel to the electronic device (500) and at a distance from the electronic device, more specifically at a distance from the top surface (534) of the first device portion (531).
[0121] 21. The computer-implemented method (600) according to any one of embodiments 8 to 20, wherein the at least one orientation sensor (520) includes an angle sensor disposed between the at least one second device portion (532) and the first device portion (531), more specifically wherein the obtained orientation data includes angle sensor measurement data.
[0122] 22. The computer-implemented method (600) according to any one of embodiments 8 to 21, wherein the at least one orientation sensor (520) includes at least one magnetic object (521) disposed in the first device portion (531) and one or more magnetometers of the plurality of magnetometers (300) disposed in the at least one second device portion (532), more specifically wherein the obtained orientation data includes magnetic field measurement data associated with the at least one magnetic object (521) measured using the one or more magnetometers of the plurality of magnetometers (300).
[0123] 23. The computer-implemented method (600) according to any one of embodiments 8 to 22, wherein the at least one orientation sensor (520) includes at least one accelerometer disposed in the at least one second device portion (532) and / or the first device portion (531), more specifically wherein the obtained orientation data includes accelerometer measurement data.
[0124] 24. The computer-implemented method (600) according to any one of embodiments 8 to 23, wherein the at least one orientation sensor (520) includes the plurality of magnetometers (310), wherein the obtained orientation data includes magnetic field measurement data associated with the at least one magnetic object (110), and more particularly wherein the magnetic field measurement data associated with the at least one magnetic object (110) indicates the interaction surface normal (N3), especially in the initial state of the at least one user carrying the device (100).
[0125] 25. The computer-implemented method (600) according to any one of embodiments 8 to 24, wherein the plurality of magnetometers (300) is a first plurality of magnetometers (300a), and wherein the obtained magnetic field measurement result is a first magnetic field measurement result, wherein the electronic device (500) includes a second plurality of magnetometers (300b), and more particularly wherein the second plurality of magnetometers is arranged in the first device part (531).
[0126] 26. The computer-implemented method (600) according to embodiment 25, the computer-implemented method comprising:
[0127] Obtaining a second magnetic field measurement result (610) associated with the at least one magnetic object (110) using the second plurality of magnetometers (300b).
[0128] 27. The computer-implemented method (600) according to embodiment 26, wherein the at least one orientation sensor (520) includes the first plurality of magnetometers (300a) and the second plurality of magnetometers (300b), and wherein the obtained orientation data includes first magnetic field measurement data associated with the at least one magnetic object (110) from the first plurality of magnetometers (300a)
[0129] and second magnetic field measurement data associated with the at least one magnetic object (110) from the second plurality of magnetometers (300b).
[0130] 28. The computer-implemented method (600) according to any one of embodiments 10 to 27, further comprising:
[0131] Determining at least one rotation trigger event (634) associated with the detected rotation in response to detecting a rotation (633).
[0132] 29. The computer-implemented method (600) according to embodiment 28, wherein the electronic device (500) includes a sleep mode and an active mode, and wherein determining at least one rotation trigger event (634) includes:
[0133] Determining a sleep mode event in response to detecting a rotation in a first direction (633), wherein the sleep mode event causes the electronic device (500) to transition from an active mode to the sleep mode, and / or
[0134] Determining an active mode event in response to detecting a rotation in a second direction (633), wherein the active mode event causes the electronic device (500) to transition from the sleep mode to the active mode.
[0135] 30. The computer-implemented method (600) according to any one of the preceding embodiments, wherein the electronic device (500) comprises a notebook, a screen, a laptop computer, a smartphone, a board or a tablet computer.
[0136] 31. The computer-implemented method (600) according to any one of embodiments 8 to 30, wherein the at least one second device part (532) is rotatably coupled to the first device part (531), more specifically wherein the at least one second device part (532) is rotatably coupled to the first device part (531) via at least one hinge (533) defining at least one axis of rotation (R).
[0137] 32. The computer-implemented method (600) according to embodiment 31, wherein the at least one second device part (532) comprises at least one output device (510), more specifically wherein the at least one output device (510) comprises a display or a screen, and
[0138] wherein the plurality of magnetometers (300) are arranged laterally and / or arranged behind the display or the screen.
[0139] 33. The computer-implemented method (600) according to any one of embodiments 8 to 32, wherein the at least one second device part (532) comprises an output device part (536) and at least one auxiliary device part (537).
[0140] 34. The computer-implemented method (600) according to embodiment 33, wherein the output device part (536) is rotatably coupled to the first device part (531) via at least one hinge (533) defining at least one axis of rotation (R), and wherein the at least one auxiliary device part (537) is releasably coupled to the first device part (531) at least via a data and / or power transmission port (535).
[0141] 35. The computer-implemented method (600) according to embodiment 33 or embodiment 33, wherein the output device portion (536) includes at least one output device (510), more specifically wherein the at least one output device (510) includes a display or a screen, and wherein the plurality of magnetometers (300) are arranged laterally and / or arranged behind the display or the screen.
[0142] 36. The computer-implemented method (600) according to any one of embodiments 8 to 32, wherein the at least one second device portion (532) is releasably coupled to the first device portion (531) at least via a data and / or power transmission port (535), more specifically wherein the first device portion (531) includes at least one output device (510).
[0143] 37. The computer-implemented method (600) according to embodiment 36, wherein the electronic device (500) includes a third device portion (536), wherein the third device portion (536) is rotatably coupled to the first device portion (531) more specifically via at least one hinge (533), particularly wherein the third device portion (536) includes at least one output device (510).
[0144] 38. The computer-implemented method (600) according to any one of the foregoing embodiments, wherein the obtained magnetic field measurement results indicate a magnetic field associated with the at least one magnetic object (110).
[0145] 39. The computer-implemented method (600) according to any one of the foregoing embodiments, wherein determining the user-carrying device position (640) includes:
[0146] Determining an absolute magnetic object position (641) indicating the absolute magnetic object positioning and / or absolute magnetic object orientation of the at least one magnetic object (110) relative to the measurement reference coordinate system (Xm, Ym, Zm), more specifically wherein the absolute magnetic object position is determined based on the obtained magnetic field measurement results.
[0147] 40. The computer-implemented method (600) according to embodiment 39, wherein determining the absolute magnetic object position (641) includes:
[0148] Generating magnetic field measurement data (642) based on the obtained magnetic field measurement results, wherein the magnetic field measurement data indicates magnetic field positioning, magnetic field orientation, and / or magnetic field intensity relative to the measurement reference coordinate system (Xm, Ym, Zm).
[0149] 41. The computer-implemented method (600) according to embodiment 40, wherein determining the absolute magnetic object position (641) comprises:
[0150] Processing magnetic field measurement data (643) to correlate the magnetic field measurement data with the absolute magnetic object position.
[0151] 42. The computer-implemented method (600) according to any one of embodiments 39 to 41, wherein the absolute magnetic object position comprises a magnetic object torque vector (120) and / or a magnetic object positioning vector associated with the at least one magnetic object (110), wherein the magnetic moment vector (120) indicates the magnetic object orientation and magnetic field strength of the at least one magnetic object (110), and / or wherein the magnetic object positioning vector indicates the magnetic object positioning relative to the measurement reference coordinate system (Xm, Ym, Zm).
[0152] 43. The computer-implemented method (600) according to embodiment 42, wherein the absolute magnetic object orientation is defined by a first set of magnetic object tilt angles (δ1, δ2, δ3) measured between the measurement reference coordinate system (Xm, Ym, Zm) and the projection of the magnetic object torque vector (120) onto the measurement reference coordinate system (Xm, Ym, Zm).
[0153] 44. The computer-implemented method (600) according to any one of the foregoing embodiments, comprising:
[0154] Defining a user-carried device coordinate system, more specifically wherein the device coordinate system comprises a first device axis (x d ), a second device axis (yd) orthogonal to the first device axis (x d ), and a vertical device axis (z d ), more specifically wherein the vertical device axis (z d ) is orthogonal to the device contact surface or point (130) and / or orthogonal to the plane defined by the first device axis (x d ) and the second device axis (yd).
[0155] 45. The computer-implemented method (600) according to embodiment 44, wherein determining the user-carried device position (640) comprises:
[0156] Determining a relative magnetic object position (644) indicative of the relative magnetic object positioning and / or relative magnetic object orientation of the at least one magnetic object (110) relative to the at least one user-carried device (110), more specifically relative to the device coordinate system.
[0157] 46. The computer-implemented method (600) according to embodiment 45, when dependent on embodiment 39, wherein determining the relative magnetic object position (644) is based on the absolute magnetic object position and a second set of geometric parameters.
[0158] 47. The computer-implemented method (600) according to embodiment 46, wherein the second set of geometric parameters includes predefined geometric parameters that indicate the geometric positioning and / or geometric orientation of the at least one magnetic object (110) relative to the at least one user-carrying device (100), more specifically in an initial state of the at least one user-carrying device (100).
[0159] 48. The computer-implemented method (600) according to any one of embodiments 45 to 47, wherein determining the relative magnetic object position (644) comprises:
[0160] detecting a positioning deviation and / or an orientation deviation (645) of the relative magnetic object positioning and / or relative magnetic object orientation caused by translation and / or rotation of the at least one magnetic object (110) relative to the at least one user-carrying device (100), more specifically wherein the at least one user-carrying device (100) is in an actuated state, and
[0161] responsive to detecting the positioning deviation and / or the orientation deviation, determining at least one interaction trigger event (646) associated with the positioning deviation and / or the orientation deviation.
[0162] 49. The computer-implemented method (600) according to any one of embodiments 2 to 48, wherein the determined user-carrying device position includes the device positioning and / or device orientation of the at least one user-carrying device (100) relative to the interaction reference coordinate system (Xs, Ys, Zs), more specifically relative to the interaction surface (210).
[0163] 50. The computer-implemented method (600) according to any one of embodiments 42 to 49, when dependent on embodiment 4, wherein determining the absolute magnetic object position
[0164] (641) comprises:
[0165] Determine whether the at least one magnetic object (110) is located on the side of the measurement reference coordinate system (Xm, Ym, Zm) that faces the user (U) during operation of the at least one user-carrying device (100) and / or the electronic device (500), or on the side of the measurement reference coordinate system (Xm, Ym, Zm) that faces away from the user (U) during operation of the at least one user-carrying device (100) and / or the electronic device (500), based on the magnetic object torque vector (120) and / or the magnetic object positioning vector of the magnetic object.
[0166] 51. The computer-implemented method (600) according to any one of embodiments 42 to 50, when dependent on embodiments 2 and 16, wherein determining the user-carrying device position (640) comprises:
[0167] Derive the magnetic object torque vector (120) and / or the magnetic object positioning vector from the absolute magnetic object position;
[0168] Derive the determined interaction surface position relative to the electronic device (500); and
[0169] Determine a first virtual intersection point of the magnetic moment vector (120) and the interaction surface (210).
[0170] 52. The computer-implemented method (600) according to any one of embodiments 44 to 51, when dependent on embodiment 2, wherein determining the user-carrying device position (640) comprises:
[0171] Assume a user-carrying device contact (646) between the at least one user-carrying device (100) and the interaction surface (210), more specifically wherein assuming the user-carrying device contact (646) comprises determining a second virtual intersection point between the vertical device axis (z d ) and the interaction surface (210).
[0172] 53. The computer-implemented method (600) according to embodiment 52, when dependent on embodiments 2, 16 and 45, wherein assuming the user-carrying device contact (646) between the at least one user-carrying device (100) and the interaction surface (210) is based on the determined interaction surface position and the determined relative magnetic object position.
[0173] 54. The computer-implemented method (600) according to any one of embodiments 2 to 53, further comprising:
[0174] Representing (660) the at least one user-carrying device (100) as a virtual object on at least one output device (510) based on the determined location of the user-carrying device, more specifically where the movement of the virtual object on the at least one output device (510) is based on a virtual reproduction of the location of the at least one user-carrying device (100) relative to the interaction reference coordinate system (Xs, Ys, Zs), more specifically relative to the interaction surface (210).
[0175] 55. The computer-implemented method (600) according to any one of the preceding embodiments, wherein the at least one user-carrying device (100) is electrically passive and / or electronically passive.
[0176] 56. The computer-implemented method (600) according to any one of the preceding embodiments, wherein the at least one magnetic object (110) is a permanent magnet.
[0177] 57. The computer-implemented method (600) according to any one of embodiments 54 to 56, wherein the one or more output devices (510) are a display or a screen.
[0178] 58. The computer-implemented method (600) according to any one of the preceding embodiments, wherein the at least one user-carrying device (100) is a computer mouse, keyboard, toy, stylus, dial, or pointer.
[0179] 59. A computer system configured to execute the computer-implemented method (600) according to any one of the preceding embodiments.
[0180] 60. A computer program configured to execute the computer-implemented method (600) according to any one of embodiments 1 to 58.
[0181] 61. A computer-readable medium or signal storing the computer program according to embodiment 60.
[0182] 62. An electronic device (500) for determining the location of at least one user-carrying device (100), comprising:
[0183] A plurality of magnetometers (300), and
[0184] At least one orientation sensor (520),
[0185] wherein the electronic device (500) is configured to execute the computer-implemented method (600) according to any one of embodiments 1 to 58.
[0186] 63. The electronic device (500) according to embodiment 62, wherein the electronic device (500) includes or is connectable to a processing unit (400) configured to execute the computer-implemented method (600), and more particularly wherein the electronic device (500) includes a user interface configured to interact with a user (U).
[0187] 64. The electronic device (500) according to embodiment 62 or embodiment 63, wherein the at least one orientation sensor (520) is configured to detect a rotation of the plurality of magnetometers (300) relative to the interaction reference coordinate system (Xs, Ys, Zs) and / or measure an orientation of the plurality of magnetometers relative to the interaction reference coordinate system.
[0188] 65. The electronic device (500) according to any one of embodiments 62 to 64, wherein the electronic device (500) includes a first device part (531) and at least one second device part (532) coupled to the first device part (531), and more particularly wherein the plurality of magnetometers (300) are provided in the at least one second device part (532).
[0189] 66. The electronic device (500) according to embodiment 65, wherein the at least one orientation sensor (520) includes an angle sensor arranged between the at least one second device part (532) and the first device part (531), and more particularly wherein the angle sensor is configured to generate angle sensor measurement data between the first device part (531) and the second device part (532).
[0190] 67. The electronic device (500) according to embodiment 65 or embodiment 66, wherein the at least one orientation sensor (520) includes at least one magnetic object (521) arranged in the first device part (531) and one or more magnetometers of the plurality of magnetometers (300) arranged in the at least one second device part (532), and more particularly wherein the at least one orientation sensor (520) is configured to generate magnetic field measurement data associated with the at least one magnetic object (521).
[0191] 68. The electronic device (500) according to any one of embodiments 65 to 67, wherein the at least one orientation sensor (520) includes at least one accelerometer arranged in the at least one second device part (532) and / or the first device part (531), and more particularly wherein the at least one orientation sensor (520) is configured to generate accelerometer measurement data.
[0192] 69. The electronic device (500) according to any one of embodiments 65 to 68, wherein the at least one orientation sensor (520) includes the plurality of magnetometers (310), and wherein the at least one orientation sensor (520) is configured to generate magnetic field measurement data associated with the at least one magnetic object (110), and more specifically wherein the magnetic field measurement data associated with the at least one magnetic object (110) indicates the interaction surface normal (N3), particularly in the initial state when the at least one user carries the device (100).
[0193] 70. The electronic device (500) according to any one of embodiments 65 to 69, wherein the plurality of magnetometers (300) are a first plurality of magnetometers (300a), and wherein the obtained magnetic field measurement result is a first magnetic field measurement result, and wherein the electronic device (500) includes a second plurality of magnetometers (300b), and more specifically wherein the second plurality of magnetometers are arranged in the first device part (531).
[0194] 71. The electronic device (500) according to embodiment 70, wherein the at least one orientation sensor (520) includes the first plurality of magnetometers (300a) and the second plurality of magnetometers (300b), and wherein the at least one orientation sensor (520) is configured to generate first magnetic field measurement data associated with the at least one magnetic object (110) using the first plurality of magnetometers (300a), and generate second magnetic field measurement data associated with the at least one magnetic object (110) using the second plurality of magnetometers (300b).
[0195] 72. The electronic device (500) according to any one of embodiments 62 to 71, wherein the electronic device (500) includes a notebook, a laptop, a smartphone, a screen, a board, or a tablet computer.
[0196] 73. The electronic device (500) according to any one of embodiments 62 to 72, wherein the at least one second device part (532) is rotatably coupled to the first device part (531), and more specifically wherein the at least one second device part (532) is rotatably coupled to the first device part (531) via at least one hinge (533) defining at least one axis of rotation (R).
[0197] 74. The electronic device (500) according to embodiment 73, wherein the at least one second device part (532) comprises at least one output device (510), more specifically wherein the at least one output device (510) comprises a display or a screen, and wherein the plurality of magnetometers (300) are arranged laterally and / or arranged behind the display or the screen.
[0198] 75. The electronic device (500) according to any one of embodiments 62 to 72, wherein the at least one second device part (532) comprises an output device part (536) and at least one auxiliary device part (537).
[0199] 76. The electronic device (500) according to embodiment 75, wherein the output device part (536) is rotatably coupled to the first device part (531) via at least one hinge (533) defining at least one axis of rotation (R), and wherein the at least one auxiliary device part (537) is releasably coupled to the first device part (531) at least via a data and / or power transmission port (535).
[0200] 77. The electronic device (500) according to embodiment 75 or embodiment 76, wherein the output device part (536) comprises at least one output device (510), more specifically wherein the at least one output device (510) comprises a display or a screen, and wherein the plurality of magnetometers (300) are arranged laterally and / or arranged behind the display or the screen.
[0201] 78. The electronic device (500) according to any one of embodiments 62 to 72, wherein the at least one second device part (532) is releasably coupled to the first device part (531) at least via a data and / or power transmission port (535), more specifically wherein the first device part (531) comprises at least one output device (510).
[0202] 79. The electronic device (500) according to embodiment 78, wherein the electronic device (500) comprises a third device part (536), wherein the third device part (531) is more specifically rotatably coupled to the first device part (531) via at least one hinge (533), particularly wherein the third device part (536) comprises at least one output device (510).
[0203] 80. A system (10) for determining the position of at least one user-carrying device (100), comprising:
[0204] At least one user-carrying device (100) associated with an interactive reference coordinate system (Xs, Ys, Zs), wherein the at least one user-carrying device (110) includes at least one magnetic object (110), and
[0205] An electronic device (500) according to any one of embodiments 62 to 79.
[0206] 81. The system (10) according to embodiment 80, wherein the system (10) is configured to track the movement of the at least one magnetic object (110) in at least five degrees of freedom.
[0207] 82. The system (10) according to embodiment 80 or 81, wherein the at least one user-carrying device (100) includes at least two magnetic objects (110a, 110b) having different relative orientations with respect to each other, and wherein the system (10) is configured to determine the user-carrying device position based on the at least two magnetic objects (110a, 110b).
[0208] 83. The system (10) according to embodiment 82, wherein the system (10) is configured to track the movement of the at least two magnetic objects (110a, 110b) in at least six degrees of freedom.
[0209] 84. The system (10) according to embodiment 82 or embodiment 83, wherein the at least one user-carrying device (100) includes a first magnetic object (110a) fixedly coupled to the at least one user-carrying device (100), and wherein the at least one user-carrying device (100) includes a second magnetic object (110b) that is rotatable and / or translatable with respect to the at least one user-carrying device (100) and / or with respect to the first magnetic object (110a).
[0210] 85. The system (10) according to any one of embodiments 80 to 84, wherein the at least one user-carrying device (100) includes at least one manipulation feature (140), wherein the at least one manipulation feature (140) is translatable and / or rotatable with respect to the at least one user-carrying device (100).
[0211] 86. The system (10) according to embodiment 85, wherein the at least one magnetic object (110) is coupled to the at least one manipulation feature (140).
[0212] 87. The system (10) according to embodiment 86, wherein the at least one manipulation feature (140) is associated with at least one interaction trigger event, and wherein the system (10) is configured to determine a corresponding interaction trigger event based on translation and / or rotation of the at least one magnetic object (110) relative to the at least one user-carrying device (100).
[0213] 88. The system (10) according to any one of embodiments 80 to 87, wherein during user operation, the system (10) is configured to track movement of the at least one user-carrying device (100) relative to the interaction surface (210) over a period of time.
[0214] 89. The system (10) according to any one of embodiments 80 to 88, wherein the system (10) includes an interaction support (200) having an interaction support surface (230), and wherein the at least one user-carrying device is operable on the interaction surface (210), wherein the interaction surface (210) is at least a partial surface of the interaction support surface (230).
[0215] 90. The system (10) according to embodiment 89, wherein the interaction support (200) is furniture, the electronic device 500, a screen, a wall, a keyboard, or a mouse pad.
[0216] 91. The system (10) according to any one of embodiments 80 to 90, wherein the system (10) includes at least one additional output device, wherein the at least one additional output device is configured to represent the at least one user-carrying device (100), more specifically to reproduce the at least one user-carrying device (100) as a virtual object, in particular wherein the at least one additional output device is separate from the electronic device (500).
[0217] Reference Numerals of the Drawings
[0218] Xm First measurement reference axis 400 Processing unit
[0219] Ym Second measurement reference axis 500 Electronic device
[0220] Zm Vertical measurement reference axis 510 At least one output device
[0221] Xs First interaction reference axis 520 At least one orientation sensor
[0222] Ys Second interaction reference axis 521 Magnetic sensor object
[0223] Zs Vertical interaction reference axis 530 Device body
[0224] x d First device axis 531 First device part
[0225] y d Second device axis 532 Second device body
[0226] z d Vertical device axis 533 Hinge
[0227] 10 System 534 Top surface
[0228] 100 User-carrying device 535 Data and / or power transmission port
[0229] 110 At least one magnetic object 536 Output device part
[0230] 120 Magnetic moment vector 537 Auxiliary device part
[0231] 130 Contact surface or contact point 538 Third device part
[0232] 140 At least one interaction feature U User
[0233] 150 Housing M Sensing volume
[0234] 160 Translation of magnetic object N1 First normal vector
[0235] 170 First rotation N2 Second normal vector
[0236] 180 Second rotation N3 Third normal vector
[0237] 200 Interaction support α1 First rotation angle
[0238] 210 Interaction surface α2 Second rotation angle
[0239] 210a First interaction surface configuration S k , 1 Magnetometer
[0240] 210b Second interaction surface configuration δ1, δ2, δ3 First set of tilt angles
[0241] 230 Interaction support surface
[0242] 300 Multiple magnetometers γ1, γ2, γ3 Second set of tilt angles
[0243] 310 Magnetometer plane β Orientation angle
[0244] 320 Magnetometer body
Claims
1. A computer-implemented method (600) for determining the location of at least one user-carried device (100), comprising: - obtaining magnetic field measurements (610) associated with at least one magnetic object (110) using a plurality of magnetometers (300), wherein the at least one magnetic object (110) is coupled to at least one user-carried device (100), and wherein the at least one user-carried device (100) is associated with an interaction reference coordinate system (Xs, Ys, Zs); - obtaining orientation data (620) from at least one orientation sensor (520), wherein the at least one orientation sensor (520) is arranged in an electronic device (500), and wherein the plurality of magnetometers (300) are arranged in the electronic device (500); - determining the orientation and positioning of the plurality of magnetometers (300) relative to the interaction reference coordinate system (Xs, Ys, Zs) based on the obtained orientation data, and - determining the user-carried device location relative to the interaction reference coordinate system (Xs, Ys, Zs) based on the obtained magnetic field measurements and the determined orientation and positioning.
2. The computer-implemented method (600) according to claim 1, wherein the at least one user-carried device (100) is operable on an interaction surface (210), and more particularly wherein the vertical interaction reference axis (Zs) of the interaction reference coordinate system (Xs, Ys, Zs) is orthogonal to the interaction surface (210).
3. The computer-implemented method (600) according to claim 1 or claim 2, comprising: defining a measurement reference coordinate system (Xm, Ym, Zm) relative to the plurality of magnetometers (300), and more particularly wherein the measurement reference coordinate system (Xm, Ym, Zm) is associated with the position of at least one of the plurality of magnetometers (300).
4. The computer-implemented method (600) according to any one of the preceding claims, wherein the determined orientation includes the rotation and / or tilt of the plurality of magnetometers (300) relative to the interaction reference coordinate system (Xs, Ys, Zs).
5. The computer-implemented method (600) according to any one of the preceding claims, wherein the electronic device (500) includes a first device part (531) and at least one second device part (532) coupled to the first device part (531), and more particularly wherein the plurality of magnetometers (300) are provided in the at least one second device part (532), and in particular wherein determining the orientation and positioning (630) includes determining the orientation and positioning of the second device part (532) relative to the first device part (531).
6. The computer-implemented method (600) according to claim 5, wherein determining the orientation and positioning (630) includes: Detecting the rotation (631) of the plurality of magnetometers (300), more specifically of the measurement reference coordinate system (Xm, Ym, Zm) relative to the interaction reference coordinate system (Xs, Ys, Zs), in particular relative to the first device part (532), based on the obtained orientation data, and / or Determining (632) the orientation angle (β) between the plurality of magnetometers (300), more specifically between the measurement reference coordinate system (Xm, Ym, Zm) and the interaction reference coordinate system (Xs, Ys, Zs), in particular the first device part (531), based on the obtained orientation data.
7. The computer-implemented method (600) according to claim 5 or claim 6, wherein determining the orientation and positioning (630) comprises: Determining an interaction surface position (650), wherein the interaction surface position indicates an interaction surface positioning, interaction surface orientation and / or interaction surface distance (c) relative to the electronic device (500), more specifically relative to the first device part (531).
8. The computer-implemented method (600) according to any one of claims 5 to 7, wherein the at least one second device part (532) is rotatably coupled to the first device part (531), more specifically wherein the at least one second device part (532) is rotatably coupled to the first device part (531) via at least one hinge (533) defining at least one axis of rotation (R), in particular wherein the at least one second device part (532) comprises at least one output device (510).
9. The computer-implemented method (600) according to any one of claims 5 to 7, wherein the at least one second device part (532) comprises an output device part (536) and at least one auxiliary device part (537), more specifically wherein the output device part (536) is rotatably coupled to the first device part (531) via at least one hinge (533) defining at least one axis of rotation (R), and wherein the at least one auxiliary device part (537) is releasably coupled to the first device part (531) at least via a data and / or power transmission port (535).
10. The computer-implemented method (600) according to any one of claims 5 to 7, wherein the at least one second device part (532) is releasably coupled to the first device part (531) at least via a data and / or power transmission port (535), more specifically wherein the first device part (531) comprises at least one output device (510).
11. The computer-implemented method (600) according to any one of the preceding claims, wherein determining the user-carried device position (640) comprises: Determine an absolute magnetic object position (641) indicating the absolute magnetic object positioning and / or absolute magnetic object orientation of the at least one magnetic object (110) relative to a measurement reference coordinate system (Xm, Ym, Zm), more specifically wherein the absolute magnetic object position is determined based on the obtained magnetic field measurements.
12. The computer-implemented method (600) according to any one of the preceding claims, wherein determining the user-carried device position (640) comprises: Determine a relative magnetic object position (644) indicating the relative magnetic object positioning and / or relative magnetic object orientation of the at least one magnetic object (110) relative to the at least one user-carried device (110), more specifically relative to the device coordinate system.
13. The computer-implemented method (600) according to any one of the preceding claims, wherein the at least one user-carried device (100) is electrically passive and / or electronically passive.
14. An electronic device (500) for determining the position of at least one user-carried device (100), comprising: A plurality of magnetometers (300), and At least one orientation sensor (520), Wherein the electronic device (500) is configured to perform the computer-implemented method (600) according to any one of the preceding claims.
15. A system (10) for determining the position of at least one user-carried device (100), comprising: At least one user-carried device (100) associated with an interaction reference coordinate system (Xs, Ys, Zs), wherein the at least one user-carried device (110) comprises at least one magnetic object (110), and The electronic device (500) according to claim 14.