Automatic recognition of passive accessories
The method and system use magnetometers to determine and track passive user-mounted devices' configurations and modes, addressing the challenge of controlling their representation on output devices, ensuring accurate and efficient operation without power or processing, and supporting multiple devices simultaneously.
Patent Information
- Application Number
- JP2025528254
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-11-24
- Filing Date
- 2023-11-13
- Publication Date
- 2025-11-07
AI Technical Summary
Existing technologies struggle to accurately and efficiently control the representation of passive user-mounted devices on output devices, such as determining and tracking their placement and capabilities, particularly when these devices lack a power source or means for electronic processing.
A computer-implemented method and system that utilizes multiple magnetometers to measure magnetic fields from magnetic objects on user-mounted devices, allowing for the determination of device configurations and modes, and automatically recognizing the device type and function based on predetermined operating ranges.
Enables reliable and accurate control of user-mounted device representations on output devices, supporting various types and functions without requiring a power source or electronic processing, and allowing for simultaneous tracking and operation of multiple devices.
Smart Images

Figure 2025536642000001_ABST
Abstract
Description
[Technical Field]
[0001] This application claims the benefit of European Patent Application No. EP22306735.6, filed November 24, 2022, the contents of which are incorporated herein by reference.
[0002] FIELD OF THE INVENTION The present disclosure relates to the technical field of determining and / or tracking the placement of passive accessories, and more particularly to a computer-implemented method for controlling the representation of a user-mounted device according to one of one or more user-mounted device modes on an output device, and a system for controlling the representation of a user-mounted device according to one of one or more user-mounted device modes. [Background technology]
[0003] In the technical field of determining and / or tracking the location of a device held or worn by a user (i.e., a user-mounted device), providing multiple magnetometers makes it possible to measure magnetic fields associated with magnetic objects disposed within or coupled to the user-mounted device. User-mounted devices using this technology may be electronically and / or electrically passive. More specifically, electrically passive means that the user-mounted device may not include a power source (e.g., a battery) and / or a means for receiving power (e.g., wireless power transmission via an induction coil) to power the electronic functions of the user-mounted device. Electronically passive means that no calculations or processing are performed (or occur) on the user-mounted device. The magnetometer measurements enable determining and / or tracking the location of a magnetic object within a sensing volume created by the multiple magnetometers. In some applications, the magnetic object may be disposed within a writing device (e.g., a stylus) that can be manipulated by a user on a writing substrate during user operation. The location of the writing device on the writing substrate can be determined based on the magnetic field measurements associated with the magnetic object.
[0004] User manipulation of a user-mounted device within the sensing volume generated by the multiple magnetometers can be represented to the user on an output device (e.g., a screen). Specifically, manipulation of the user-mounted device within the sensing volume can be reproduced as manipulation of a virtual object on the output device. Current applications may include different types of user-mounted devices and / or different capabilities of the user-mounted devices.
[0005] It is an object of the present disclosure to provide a computer-implemented method and system that allows improved control of the representation of different types and capabilities of user-mounted devices on an output device. Summary of the Invention
[0006] The present disclosure relates to a computer-implemented method for controlling the representation of a user-mounted device on an output device according to one of one or more user-mounted device modes, as defined in claim 1, and to a system for controlling the representation of a user-mounted device on an output device according to one of one or more user-mounted device modes, as defined in claim 15. The dependent claims set forth embodiments of the present disclosure.
[0007] According to a first aspect of the present disclosure, a computer-implemented method for controlling a representation of a user-mounted device on an output device according to one of one or more user-mounted device modes is provided. The method includes acquiring magnetic field measurements associated with at least one magnetic object and measured by a plurality of magnetometers. The at least one magnetic object is coupled to the user-mounted device. The method further includes acquiring user-mounted device mode data indicating predetermined operating ranges of the one or more user-mounted device modes. In addition, the method includes determining a user-mounted device configuration based on the collected magnetic field measurements. Further, the method includes determining a user-mounted device mode based on the user-mounted device configuration and the user-mounted device mode data. The implementation method may provide automatic recognition of a desired user-mounted device mode, e.g., a currently used user-mounted device type and / or user-mounted device function, based on the predetermined operating range and the determined user-mounted device configuration.
[0008] According to a second aspect of the present disclosure, there is provided a system for controlling a representation of a user-mounted device on an output device according to one of one or more user-mounted device modes. The system includes a user-mounted device, the user-mounted device including at least one magnetic object. The system further includes a plurality of magnetometers configured to perform magnetic field measurements associated with the at least one magnetic object. In addition, the system includes an output device. The system is configured to execute a computer-implemented method according to the first aspect of the present disclosure. The system may provide automatic recognition of a desired user-mounted device mode, e.g., a currently used user-mounted device type and / or user-mounted device function, based on a predetermined operating range and a determined user-mounted device configuration. [Brief explanation of the drawings]
[0009] Other features will be apparent from the accompanying drawings, which form a part of this disclosure. The drawings are intended to further explain the disclosure and to enable those skilled in the art to practice it. However, these drawings are intended as non-limiting examples. Common reference symbols in different figures indicate similar or similar features. [Figure 1] 1A and 1B illustrate generally a process flow diagram of a computer-implemented method for controlling the representation of a user-mounted device on an output device according to one of one or more user-mounted device modes, according to a first aspect of the present disclosure. [Figure 2] 1 illustrates generally in more detail a computer-implemented method according to a first aspect of the present disclosure. [Figure 3] 1 is a schematic diagram of a system for controlling the representation of a user-mounted device on an output device according to one of one or more user-mounted device modes, according to a second aspect of the present disclosure; [Figure 4] 1 is a schematic diagram of a first exemplary system according to a second aspect of the present disclosure, in which a user-equipped device is controlled according to a first user-equipped device mode. [Figure 5] FIG. 10 is a schematic diagram of a second exemplary system according to a second aspect of the present disclosure, in which a user-equipped device is controlled according to a second user-equipped device mode. [Figure 6] FIG. 10 is a schematic diagram of a third exemplary system according to a second aspect of the present disclosure, in which a user-equipped device is controlled according to a third user-equipped device mode. [Figure 7] FIG. 10 is a schematic diagram of a third exemplary system according to a second aspect of the present disclosure, in which a user-equipped device is controlled according to a fourth user-equipped device mode. DETAILED DESCRIPTION OF THE INVENTION
[0010] DETAILED DESCRIPTION OF THE INVENTION Embodiments of a computer-implemented method and system for controlling the presentation of a user-installed device according to one of one or more user-installed device modes on an output device are described as follows with reference to the drawings.
[0011] 1 schematically illustrates a computer-implemented method 600 for controlling a representation of a user-mounted device according to one of one or more user-mounted device modes on an output device according to a first aspect of the present disclosure. The method 600 includes acquiring (610) magnetic field measurements associated with at least one magnetic object 110. The magnetic field measurements are measured by a plurality of magnetometers 300. The at least one magnetic object 110 is coupled to a user-mounted device 100. The method 600 further includes determining (630) a user-mounted device configuration based on the collected magnetic field measurements. The collected magnetic field measurements may indicate a magnetic field associated with the at least one magnetic object 110. The method 600 further includes acquiring (630) user-mounted device mode data indicative of a predetermined operating range of one or more user-mounted device modes. Additionally, the method 600 includes determining (640) a user-mounted device mode based on the user-mounted device configuration and the user-mounted device mode data. The computer-implemented method may be suitable for representing, or more specifically reproducing, the user-mounted device 100 as a virtual object according to one of one or more user-mounted device modes on the output device 500. Manipulation of the user-mounted device configuration during user operation may be represented as a virtual object according to one of one or more user-mounted device modes on the output device 500. The order in which such data or measurements are obtained may vary.
[0012] The above-described computer-implemented method 600 may provide automatic recognition of a desired user-mounted device mode, e.g., a currently used user-mounted device type and / or user-mounted device capabilities, based on a predetermined operating range and a determined user-mounted device configuration. Furthermore, the method 600 may enable reliable and accurate control of the representation of the user-mounted device 100 on the output device 500 according to one of one or more user-mounted device modes.
[0013] 3-7 schematically illustrate a system 10 for controlling a representation of a user-mounted device 100 according to one of one or more user-mounted device modes on an output device 500 according to a second aspect of the present disclosure. The system 10 comprises a user-mounted device 100 comprising at least one magnetic object 110. The system 10 further comprises a plurality of magnetometers 300 configured to perform magnetic field measurements associated with the at least one magnetic object 110, and the output device 500. The system 10 is configured to perform a computer-implemented method 600 according to a first aspect described herein.
[0014] In embodiments, the user-mounted device mode may indicate a specific user-mounted device type. In embodiments, the user-mounted device mode may indicate a specific user-mounted device function. In some embodiments, the user-mounted device mode may indicate a specific user-mounted device type and a specific user-mounted device function. In embodiments, the specific user-mounted device type may indicate one of a computer mouse, a keyboard, a toy, a stylus, or a dial, a brush, or a finger ring. In embodiments, the specific user-mounted device function may indicate a default function or one or more adapted functions. The default function may be a function of the intended use. For example, the default function of the stylus may be writing. The adapted function of the stylus may be erasing, which may be determined by another predetermined operating range.
[0015] The multiple magnetometers 300 may be configured to generate a sensing volume M (e.g., as shown in FIG. 3 ). The multiple magnetometers 300 may be associated with a magnetometer plane 310. More specifically, the magnetometer plane 310 may be defined by a plane that may extend through a majority of the multiple magnetometers 300. In an embodiment, the multiple magnetometers 300 may be integrated into a wall, furniture, a notebook, an electronic device, a screen or display, a keyboard, and / or a mouse pad.
[0016] The method 600 may include defining a reference coordinate system XYZ for the plurality of magnetometers 300 (see, for example, FIGS. 3-7 ). The reference coordinate system XYZ may include a first reference axis X, a second reference axis Y, and a vertical reference axis Z. The first reference axis X and the second reference axis Y may be orthogonal to one another. The vertical reference axis Z may be orthogonal to the first reference axis X and the second reference axis Y. The vertical reference axis Z may extend through a center of the plurality of magnetometers 300. In an embodiment, the first reference axis X and the second reference axis Y may be defined on the magnetometer plane 310. In this case, the vertical reference axis Z may be orthogonal to the magnetometer plane 310.
[0017] In an embodiment, the user-mounted device 100 may be operable within a sensing volume M. Specifically, the user-mounted device 100 may be operable on or above an interaction surface 210. More specifically, the interaction surface 210 may be defined within the sensing volume M. The interaction surface 210 may be understood as a physical constraint associated with the plurality of magnetometers 300. For example, the interaction surface 210 may be defined by a first set of geometric parameters relative to the plurality of magnetometers 300 and / or a reference coordinate system XYZ. More specifically, the first set of geometric parameters may indicate the geometric shape of the interaction surface 210. The first set of geometric parameters may include a point and a normal vector on the interaction surface 210 (thereby defining an infinite surface), at least three coplanar points defining a finite surface, a center point, a radius and a normal vector in the case of a disk-shaped surface, and / or two axes defined on the surface (e.g., two dimensions may define a rectangular surface). The above-described interaction surface configuration may be based on a first set of geometric parameters. The interaction surface 210 may include a set of subsurfaces having different orientations and / or positions. The computer-implemented method 600 may determine the interaction surface 210 based on the first set of geometric parameters. This allows for determining the user-mounted device placement on any surface, even complex surfaces (e.g., due to the polygonal shape of the surface, curved surfaces). The first set of geometric parameters may include predefined geometric parameters associated with the interaction surface 210.
[0018] In an embodiment, the system 10 may include an interaction support 200 having an interaction support surface (see FIGS. 3-7). The interaction surface 210 may be at least a partial surface of the interaction support surface. The interaction support 200 may not include ferromagnetic properties, e.g., ferromagnetic particles. In an embodiment, the interaction support 200 may be a piece of furniture (e.g., a table), a notebook, an electronic device, a screen or display, a plate, a wall, or a mouse pad. The interaction surface 210 may be defined based on a first set of geometric parameters associated with the interaction support 200. More specifically, the type of the interaction support 200 may be a known one, e.g., a notebook or a mouse pad. Such an interaction support 200 may be defined by a set of predefined geometric parameters. A partial surface of the interaction support surface may be used as the interaction surface 210. Thus, the set of predefined parameters may include data, more specifically, geometric data, associated with the interaction surface configuration of the interaction surface 210. As an example, these parameters may indicate the position and / or orientation of the interaction surface 210 relative to a reference coordinate system XYZ. In an embodiment, the first set of geometric parameters may be determined by interactive surface recognition, as described below. In an embodiment, the user-mounted device 100 may be a computer mouse, a keyboard, a toy, a stylus, or a dial. In an embodiment, the user-mounted device 100 may be an accessory tool, such as a ruler. In an embodiment, the plurality of magnetometers 300 may be configured within or attached to the interactive support 200.
[0019] As outlined above, the interaction support 200 may comprise an interaction support surface. The interaction surface 210 may be at least a partial surface of the interaction support surface. Defining the interaction surface 210 may include receiving input data, more specifically from a database, regarding the particular type of interaction support 200 for which the interaction surface 210 is defined. The particular type of interaction support 200 may include predefined geometric parameters associated with the interaction support 200. The particular predefined geometric parameters may be stored in a database that associates the type of interaction support 200 with the geometric parameters. In embodiments, receiving the input data may include prompting the user to select an interaction support 200 to be used with the user-mounted device 100. In other embodiments, receiving the input data may include deriving a set of geometric parameters associated with the interaction surface 210 from a database.
[0020] In an embodiment, the first set of geometric parameters may be determined based on interaction surface recognition. The interaction surface recognition may be a calibration procedure or an automatic recognition procedure. As an example, for calibration, the computer-implemented method 600 may instruct the user via a user interface to place the user-mounted device 100 at at least three different points on the interaction surface 210, where the at least three points may not be aligned (in particular, the three points may form an equilateral triangle). Based on these points, the computer-implemented method 600 may calculate a normal to the interaction surface 210. More specifically, the interaction surface position and / or interaction surface orientation may be determined by calculating an average of the at least three points. The automatic recognition procedure may be based on an automatic calculation of the first set of geometric parameters based on a normal vector or a set of normal vectors.
[0021] The method 600 defines an interaction surface coordinate system x s y s z s(See, for example, FIGS. 3 to 7.) s y s z s is the first interaction surface axis x s and the second interaction surface axis y s and the vertical interaction surface axis z s The first interaction surface axis x s and the second interaction surface axis y s may be perpendicular to each other and define the interaction surface 210. The vertical interaction surface axis z s is the first interaction surface axis x s and the second interaction surface axis y s In other words, the perpendicular interaction surface axis z s may be perpendicular to the interaction surface 210.
[0022] The user-mounted device 100 may be electrically passive and / or electronically passive. More specifically, electrically passive means that the user-mounted device 100 may not include a power source (e.g., a battery) and / or a means for receiving power (e.g., wireless power transmission via an induction coil) to power the functions (e.g., electronic functions) of the user-mounted device 100. Electronically passive means that no computation or processing is performed (or occurs) on the user-mounted device 100.
[0023] The term "magnetic object" may refer to an object that may have components made of a magnetic material, i.e., a material having magnetic properties that can be measured by the magnetometers 300. The user-mounted device 100 and / or the at least one magnetic object 110 may be movable, i.e., freely movable within the reference coordinate system XYZ. In other words, during a user operation (i.e., an operation in which the user-mounted device 100 and / or the at least one magnetic object 110 are manipulated by a user), the placement of the user-mounted device 100 within the sensing volume M and / or relative to the interaction surface 210 may be manipulated by a user within the sensing volume M.
[0024] At least one magnetic object 110 may be a permanent magnet. In embodiments, at least one magnetic object 110 may be configured to generate a non-zero magnetic field. The magnetic object may comprise a paramagnetic or diamagnetic material. In embodiments, at least one magnetic object 110 may comprise a ferromagnetic or ferrimagnetic material.
[0025] In some embodiments, the at least one magnetic object 110 may include one or more coils, particularly electromagnetic coils, and in such cases, the user-mounted device 100 may be electrically and / or electronically active.
[0026] In some embodiments, the user-mounted device 100 may include an RFID tag, e.g., an RFID transponder (RFID: radio-frequency identification). Correspondingly, the system 10 may include an RFID reader, e.g., an RFID transceiver unit, configured to detect the RFID tag. The combination of the RFID tag and the RFID reader may be referred to as an RFID system.
[0027] The method 600 may further include defining a user-mounted device coordinate system (see, e.g., FIGS. 3-7). The device coordinate system is defined by a first device axis x d and the first device axis x d A second device axis, y, perpendicular to d and the vertical device axis z d and a vertical device axis z d may be perpendicular to the device contact surface or point 130 and / or perpendicular to the first device axis x d and the second device axis y dThe device contact surface or point 130 may be orthogonal to the plane defined by (a) and (b). The device contact surface or point 130 may be a portion of the user-mounted device 100 that may contact the interaction surface 210 during user operation. For example, in the examples shown in FIG. 3 or FIG. 4, the user-mounted device 100 may include a contact surface 130 that contacts the interaction surface 210. In other examples, the user-mounted device 100 may include a contact point 130 (e.g., a stylus or other writing device with a writing tip that contacts the interaction surface 210 during a writing operation, as shown in FIG. 6). In some embodiments, the device coordinate system may be defined within the geometric center of the user-mounted device 100 (see, for example, FIG. 3). Alternatively, relative to the Cartesian device coordinate system, the device coordinate system may be described as a cylindrical coordinate system or a spherical coordinate system.
[0028] 2 illustrates the computer-implemented method 600 in more detail. Determining the user-mounted device location (620) may include determining a magnetic object location (621, 624) of at least one magnetic object 110 that indicates the user-mounted device location. Specifically, determining the user-mounted device location (620) may include determining a position vector (621, 624) that indicates the magnetic object position and / or determining a magnetic moment vector 120 that indicates the magnetic object orientation of at least one magnetic object 110 (621, 624). Because the magnetic object 110 is coupled to the user-mounted device 100, the location of the magnetic object 110 can indicate the location of the user-mounted device 100.
[0029] The user-mounted device configuration may indicate an absolute user-mounted device configuration with respect to the magnetometer plane 310, in particular the reference coordinate system XYZ, and / or a user-mounted device configuration relative to the interaction surface 210. Determining (620) a user-mounted device configuration indicating an absolute user-mounted device configuration may include determining (621) an absolute magnetic object configuration. The absolute magnetic object configuration may indicate an absolute magnetic object position and / or absolute magnetic object orientation of at least one magnetic object 110 with respect to the reference coordinate system XYZ. Specifically, the absolute magnetic object configuration may be determined based on the acquired magnetic field measurements. This allows determining an absolute position and / or absolute orientation of at least one magnetic object 110 in the reference coordinate system XYZ.
[0030] In an embodiment, determining 621 the absolute magnetic object location may include generating 622 magnetic field measurement data based on the acquired magnetic field measurements (see FIG. 2 ). The magnetic field measurement data may indicate the magnetic field position, magnetic field orientation, and / or magnetic field strength of the magnetic object 110 relative to a reference coordinate system XYZ. Determining 621 the absolute magnetic object location may further include processing 623 the magnetic field measurement data to relate the magnetic field measurement data to the absolute magnetic object location. For example, a filter and / or an estimation algorithm may be used to evaluate the absolute magnetic object location associated with the magnetic field measurement data.
[0031] The absolute magnetic object configuration may include a magnetic moment vector 120 and / or an absolute position vector associated with at least one magnetic object 110. The magnetic moment vector 120 may indicate the orientation of the magnetic object. The absolute position vector may indicate the magnetic object position relative to a reference coordinate system XYZ. In an embodiment, the absolute magnetic object orientation may be defined by a first set of magnetic object tilt angles δ1, δ2, δ3 measured between the magnetometer plane 310 and the magnetic moment vector 120. The first set of magnetic object orientation angles δ1, δ2, δ3 may be measured relative to the reference coordinate axes X, Y, Z, more specifically, between the magnetic moment vector 120 and each of the axes X, Y, Z of the reference coordinate system XYZ. For example, as shown in FIGS. 4-7, a first magnetic object orientation angle δ1 may be defined between the first reference axis X and the magnetic moment vector 120, more specifically, in the XZ plane. In embodiments, two angles relative to the magnetometer plane 310 may be sufficient to define the absolute magnetic object orientation of the magnetic object 110. Specifically, when a magnetic dipole model is used, two angles relative to the magnetometer plane 310 may be sufficient to define the absolute magnetic object orientation of the magnetic object 110. More specifically, when the magnetic object 110 is symmetric along its magnetization axis, i.e., is magnetized with rotational symmetry, two angles relative to the magnetometer plane 310 may be sufficient to define the absolute magnetic object orientation of the magnetic object 110. In some embodiments, the absolute position vector may be defined by a first set of Cartesian coordinates defined in a reference coordinate system XYZ. The magnetic moment vector 120 and / or the absolute position vector may be determined based on implementation of a mathematical model that relates each measurement of one magnetometer of the plurality of magnetometers 300 to the location of at least one magnetic object 110 in the reference coordinate system XYZ. The model may be constructed from physical equations, typically of electromagnetics, and more specifically, of magnetostatics. To establish this model, at least one magnetic object 110 may be approximated by a magnetic dipole. Each magnetometer of the plurality of magnetometers 300 may be a vector magnetometer and may be configured to measure magnetic fields in one, two, or three dimensions.
[0032] 2, determining 620 a user-mounted device configuration indicative of a relative user-mounted device configuration may include determining 624 a relative magnetic object configuration. The relative magnetic object configuration may indicate a relative magnetic object position and / or a relative magnetic object orientation. The relative magnetic object position is relative to the interaction surface 210, more specifically, in the interaction surface coordinate system x s , y s , z s The relative magnetic object orientation may be the position of at least one magnetic object 110 relative to the interaction surface 210, more specifically in the interaction surface coordinate system x s y s z s The relative magnetic object configuration may be the orientation of at least one magnetic object 110 with respect to the magnetic moment vector 120 and / or the relative position vector Δx associated with the at least one magnetic object 110. s , Δy s , Δz s The magnetic moment vector 120 can indicate the relative magnetic object orientation and / or the relative position vector Δx s , Δy s , Δz s is the interaction surface coordinate system x s , y s , z s In an embodiment, the relative position vector is expressed in terms of the surface coordinate system x s y s z s can be understood as a vector from the origin of the magnetic moment vector 120 to the center of mass or dipole center of the magnetic object 110. In an embodiment, the relative magnetic object orientation can be defined by a second set of magnetic object tilt angles γ1, γ2, γ3 determined between the interaction surface 210 and the magnetic moment vector 120. In other words, the relative magnetic object orientation can be defined by a second set of magnetic object tilt angles γ1, γ2, γ3 determined between the interaction surface coordinate axis x s , y s , z s Specifically, the first magnetic object tilt angle γ1 can be defined by a set of magnetic object tilt angles γ1, γ2, and γ3 relative to the first interaction surface axis x sand the magnetic moment vector 120. The second magnetic object tilt angle γ2 can be determined between the second interaction surface axis y s and the magnetic moment vector 120. The perpendicular magnetic object tilt angle γ3 can be determined between the perpendicular interaction surface axis z s and the magnetic moment vector 120. For example, as shown in FIGS. 4 to 7, the vertical magnetic object tilt angle γ3 can be determined by the vertical interaction surface axis z s and magnetic moment vector 120. In particular, the perpendicular magnetic object tilt angle γ3 can be defined between magnetic moment vector 120 and the perpendicular interaction surface axis z s or an axis parallel thereto, such that the perpendicular magnetic object tilt angle γ3 may only range from 0° to 90° (see, e.g., FIGS. 4-7). In embodiments, two angles relative to the magnetometer plane 310 may be sufficient to define the absolute magnetic object orientation of the magnetic object 110.
[0033] In an embodiment, determining 624 the relative magnetic object orientation may be based on the absolute magnetic object orientation and a first set of geometric parameters. Specifically, the relative magnetic object orientation may be determined based on the determined absolute orientation of the at least one magnetic object 110 and knowledge of the configuration of the interaction surface 210 relative to the reference coordinate system XYZ. In an embodiment, the first set of geometric parameters may be based on the interaction surface coordinate system x s y s z s In other words, as outlined above, the first set of geometric parameters includes predefined transformation parameters that describe the transformation of the reference coordinate system XYZ into the interaction surface coordinate system x s y s z s Furthermore, in the described embodiment, the first set of geometric parameters can convert absolute magnetic object positions into relative magnetic object positions. Specifically, absolute magnetic object positions and / or absolute magnetic object orientations can be converted into relative magnetic object positions and / or relative magnetic object orientations.
[0034] As outlined above, method 600 includes obtaining (630) user-installed device mode data indicating predetermined operating ranges for one or more user-installed device modes. Specifically, the user-installed device mode data may include multiple predetermined operating ranges for one or more user-installed device modes. In embodiments, the user-installed device mode data may be obtained from a database and / or user input. Each predetermined operating range may be associated with one of the one or more user-installed device modes. Specifically, each of the multiple predetermined operating ranges may be associated with only one or one specific mode of the one or more user-installed device modes.
[0035] In embodiments, the predetermined operating range may define a predetermined range of user-mounted device configurations associated with one of the one or more user-mounted device modes. In particular embodiments, the predetermined operating range may define one or more specific predetermined user-mounted device configurations associated with one of the one or more user-mounted device modes. For example, the predetermined operating range may define one typical user-mounted device configuration associated with one of the one or more user-mounted device modes.
[0036] In embodiments, the predetermined range of user-mounted device positions may include a predetermined range of absolute user-mounted device positions and / or a predetermined range of relative user-mounted device positions. In embodiments, the predetermined operating range may include a predetermined orientation interval indicating a magnetic object orientation and / or a predetermined position interval indicating a magnetic object position. In some embodiments, the shape of the user-mounted device 100 may influence the definition of the predetermined operating range.
[0037] In an embodiment, the predetermined orientation interval may include an interval of at least one magnetic object tilt angle in a first set of magnetic object tilt angles δ1, δ2, δ3. In an embodiment, the predetermined orientation interval may include an interval of at least one magnetic object tilt angle in a second set of magnetic object tilt angles γ1, γ2, γ3.
[0038] In an embodiment, the predetermined position interval may include an interval of an operating distance Δz defined by the z-component of a position vector. In an embodiment, the predetermined position interval may include an interval of an operating area ΔxΔy defined by the x-component and / or the y-component of a position vector. Specifically, the operating distance Δz may be defined by the z-component of an absolute position vector and / or the z-component of a relative position vector. In an embodiment, the predetermined position interval may include one or more of the operating area and / or the operating distance. The operating area is defined in the interaction surface coordinate system x s , y s , z s and / or in the xy domain relative to a reference coordinate system XYZ. In an embodiment, the predetermined position interval may comprise the interval of one or more components of a position vector, more specifically an absolute position vector or a relative position vector.
[0039] In some embodiments, the predetermined operating range may include RFID data associated with a user-installed device mode.
[0040] In an embodiment, the predetermined operating ranges may be mutually exclusive.
[0041] The following describes some examples of predetermined operating ranges and user-mounted device modes. In an embodiment, the user-mounted device mode data may include a first predetermined operating range associated with a first user-mounted device mode (see FIG. 4). The user-mounted device mode data may include a second predetermined operating range associated with a second user-mounted device mode (see FIG. 5). The user-mounted device mode data may include a third predetermined operating range associated with a third user-mounted device mode (see FIG. 6). Additionally, the user-mounted device mode data may include a fourth predetermined operating range associated with a fourth user-mounted device mode (see FIG. 7).
[0042] The first predetermined operating range may include a predetermined orientation interval that is restricted to magnetic object orientations such that magnetic moment vector 120 is directed away from interaction surface 210. Furthermore, magnetic moment vector 120 is within a first angular interval γ of perpendicular magnetic object tilt angle γ. 3,1,min ~γ 3,1,max As outlined above, the perpendicular magnetic object tilt angle γ3 can be oriented within the perpendicular interaction surface axis z s As further outlined above, the vertical magnetic object tilt angle γ3 is defined to be in the range of 0° to 90°. In an embodiment, the first angular interval is defined relative to the vertical interaction surface axis z s For γ 3,1,max In an embodiment, the first angular interval may be limited to γ≦75°. 3,1,max In an embodiment, the first angular interval may be limited to γ≦60°. 3,1,max In an embodiment, γ 3,1,min may be 0°. Illustratively, this first user-installed device mode may be associated with a user-installed device type of computer mouse (see FIG. 4).
[0043] The second predetermined operating range includes a predetermined interval of orientations that are limited to magnetic object orientations, and the magnetic moment vector 120 is aligned within a second angular interval γ of the perpendicular magnetic object tilt angle γ 3 . 3,2,min ~γ 3,2,max As outlined above, the perpendicular magnetic object tilt angle γ3 is oriented in the direction perpendicular to the perpendicular interaction surface axis z s As further outlined above, the vertical magnetic object tilt angle γ3 is defined to be in the range of 0° to 90°. In an embodiment, the lower end of the second angular interval is defined to be γ 3,2,min >γ 3,1,max In an embodiment, the second angular interval is a distance from the normal to the interaction surface axis z s For γ 3,2,minIn embodiments of a second predetermined operating range of predetermined orientation intervals, magnetic moment vector 120 may be oriented away from or towards interaction surface 210. Illustratively, this second user-mounted device mode may be associated with a user-mounted device type of dial (see FIG. 5).
[0044] The third predetermined operating range includes a predetermined orientation interval that is restricted to magnetic object orientations, where magnetic moment vector 120 is directed toward interaction surface 210. Furthermore, magnetic moment vector 120 is within a third angular interval γ of perpendicular magnetic object tilt angle γ. 3,3,min ~γ 3,3,max As outlined above, the perpendicular magnetic object tilt angle γ3 is oriented within the perpendicular interaction surface axis z s As further outlined above, the vertical magnetic object tilt angle γ3 is defined to be in the range of 0° to 90°. In an embodiment, the upper end of the third angular interval is γ 3,3,max <γ 3,2,min In an embodiment, the third angular interval is a distance from the normal to the interaction surface axis z s For γ 3,3,max It may be limited to ≦75°. Illustratively, this third user-installed device mode may be associated with a user-installed device type of stylus (see FIG. 6).
[0045] In embodiments, one or more of the first, second, and third predetermined operating ranges may include one or more predetermined position intervals in addition to or instead of one or more of the above-mentioned predetermined orientation interval requirements. For example, the first and / or second predetermined operating ranges may include a predetermined position interval restricted to magnetic object positions, with an operating distance Δz of ≦2 cm (see, e.g., FIGS. 3 and 4). For example, the third predetermined operating range may include a predetermined position interval restricted to magnetic object positions, with an operating distance Δz of ≧3 cm. In some embodiments, a fourth predetermined operating range may be defined. The fourth predetermined operating range may have the same predetermined angular interval as the first predetermined operating range. In addition, the fourth predetermined operating range may include a predetermined position interval restricted to magnetic object positions, with an operating distance Δz of ≧3 cm. Illustratively, this fourth user-mounted device mode may be associated with the user-mounted device type of the stylus (see FIG. 7). Additionally, third and fourth user-mounted device modes can be distinguished by distinguishing the general direction of magnetic moment vector 120, e.g., toward or away from interaction surface 210. For example, the third user-mounted device mode may further include the first user-mounted device function, e.g., write. For example, the fourth user-mounted device mode may further include the second user-mounted device function, e.g., erase.
[0046] In some embodiments, one or more of the above-mentioned predetermined operating ranges may additionally or alternatively include a predetermined position interval that includes an interval of the operating area ΔxΔy defined by the x-component and / or the y-component of the position vector.
[0047] To illustrate with the above exemplary configuration, the computer-implemented method 600 and associated system 10 disclosed in this specification can automatically recognize a user-mounted device type and / or a user-mounted device function according to one or more of a predetermined angular interval, a predetermined position interval, specifically a predetermined interval of an operating area ΔxΔy defined by the x component and / or the y component of a position vector, specifically a predetermined interval of an operating distance Δz defined by the z component of a position vector, or a combination thereof.
[0048] Referring again to FIG. 2 , determining (640) the user-mounted device mode may include comparing (641) the acquired user-mounted device mode data with the determined user-mounted device configuration. Specifically, comparing (641) the acquired user-mounted device mode data with the determined user-mounted device configuration may include comparing the determined user-mounted device configuration with a plurality of predetermined operating ranges. In embodiments, determining (640) the user-mounted device mode may further include selecting (642) the user-mounted device mode based on the comparison. In embodiments, selecting (642) the user-mounted device mode may include excluding the compared user-mounted device mode when the determined user-mounted device configuration does not satisfy the predetermined operating range of the compared user-mounted device mode. In embodiments, selecting (642) the user-mounted device mode may include selecting the compared user-mounted device mode when the determined user-mounted device configuration satisfies the predetermined operating range of the compared user-mounted device mode. In an embodiment, selecting a user-mounted device mode (642) may include selecting the user-mounted device mode to be compared when the predetermined operating range of the user-mounted device mode to be compared is closest to the determined user-mounted device position. For example, instead of a distance, a typical value may be included in the predetermined operating range. The distance between the magnetic object position and the typical value may be calculated. The user-mounted device mode is then selected by selecting the smallest distance, e.g., difference, specifically, orientation difference and / or position difference, to the associated predetermined operating range.
[0049] In an embodiment, determining 620 the user-mounted device location based on the collected magnetic field measurements is performed over a period of time. Specifically, acquiring 610 the magnetic field measurements may be performed over a period of time. The period of time may include multiple time samples during which magnetic field measurements are acquired and respective user-mounted device locations, more specifically respective magnetic object locations, are determined. This allows tracking of the movement of the user-mounted device 100, more specifically the movement of at least one magnetic object 110. In an embodiment, the period of time may begin when the user-mounted device 100, specifically its associated magnetic object 110, is detected within the sensing volume M. In an embodiment including an RFID system, the period of time may begin when the user-mounted device 100, including the magnetic object 110, is detected near an RFID reader. The term "proximity" may be understood as the distance from the RFID reader at which the RFID reader can detect the RFID tag. Using an RFID system in combination with a magnetic object 110 can result in reduced power consumption. In an embodiment, the RFID system, and in particular the RFID reader, may be active only when the user-mounted device 100 is in proximity to the RFID reader. In an embodiment, the time period may end when the user-mounted device 100, and in particular the magnetic object 110 associated therewith, is no longer detected within the sensing volume M.
[0050] In an embodiment, determining the user-mounted device mode (640) may be performed within a time period. Specifically, determining the user-mounted device mode (640) may include storing the determined user-mounted device mode in a memory (e.g., see FIG. 2 ) (643). The time period may include a mode recognition time phase. In an embodiment, the user-mounted device mode may be determined and stored during the mode recognition time phase. Specifically, the user-mounted device mode may be determined and stored only during the mode recognition time phase. In an embodiment, the mode recognition time phase may start at the same moment as the time period. In an embodiment, the mode recognition time phase may start upon determining a predetermined start-trigger user-mounted device configuration. The start-trigger user-mounted device configuration may be understood as a user-mounted device configuration that triggers the start of the mode recognition time phase. For example, the start-trigger user-mounted device configuration may be a predetermined distance from the interaction surface 210, specifically, along the vertical surface axis z s In an embodiment, the mode recognition time phase may begin when a predetermined time interval has elapsed since the start of the period.
[0051] In embodiments, the end of the mode recognition time phase may be triggered by one or more of the following: the expiration of a predetermined time interval, the determination of a user-installed device mode, storing the determined user-installed device mode in memory, the determination that a distance, specifically one or more components of a position vector, exceeds a predetermined threshold, and / or the expiration of a time period. In embodiments, determining the user-installed device mode (640) is stopped when the mode recognition time phase ends. The mode recognition time phase allows for clear distinction between different user-installed device modes while simultaneously allowing for a greater operating range of the user-installed device once different user-installed device modes have been determined.
[0052] 1 and 2 , the computer-implemented method 600 may further include representing (650) the user-mounted device 100 on the output device 500. The method 600 may further include controlling (660) the representation of the user-mounted device 100 according to the determined user-mounted device mode. In embodiments, the output device 500 may include one or more of a display, a screen, a light, a domotic peripheral, a laptop, a smartphone, a tablet, or a control panel. For example, a control panel may be provided from which different peripherals, such as a gate, a light, a heat system, and / or shutters, may be controlled depending on the determined user-mounted device mode.
[0053] It should be noted that the computer-implemented method 600 and associated system 10 may be configured to determine user-mounted device configurations and / or track the operation of two or more user-mounted devices 100 simultaneously. The computer-implemented method 600 and associated system 10 may also be configured to determine a user-mounted device mode for each of the two or more user-mounted devices 100.
[0054] In an embodiment, system 10 may include a processing unit 400 or may be connectable to an external processing unit. Processing unit 400 may be configured to execute computer-implemented method 600 described herein. In an embodiment, system 10 may include an electronic device. In an embodiment, processing unit 400 may be integrated into the electronic device. In an embodiment, output device 500 may be integrated into the electronic device. In an embodiment, the electronic device may be a tablet, a mobile phone, a laptop, a computer, a virtual reality (VR) set, or a television.
[0055] In an embodiment, the electronic device may be a VR set, more specifically an XR headset, which may be a device configured to be worn on a user's head and allow the user to experience a virtual environment (virtual reality environment, or VR environment) in real life. In an embodiment, the user-mounted device 100 may be reproduced as a virtual object in the virtual environment. In one embodiment, the user-mounted device 100 may be displayed or reproduced as a virtual object in the VR environment, allowing the user U to recognize where the user-mounted device is located. Multiple magnetometers 300 may be provided to create a sensing volume in which the user-mounted device 100 is manipulated. The user-mounted device configuration may indicate the orientation and / or position of the user-mounted device 100 relative to a reference coordinate system XYZ, more specifically relative to the multiple magnetometers 300. The reference coordinate system XYZ may be fixed in the VR environment. The position and / or orientation of the user-mounted device 100 may be calculated relative to the VR set, more specifically relative to the XR headset, and may be calculated and particularly displayed for the user via the XR headset. In embodiments, the reference coordinate system XYZ may be dynamically evaluated from tracking of the environment by the XR headset. Specifically, the interaction surface 210 and / or the interaction surface coordinate system may be dynamically evaluated from tracking of the environment by the XR headset. In embodiments, it may also be possible to provide an additional tracking system fixed to the magnetometers 300, such as IR tracking, electromagnetic tracking, or camera-based tracking. Scrolling events and / or clicking events may generally be indicated as trigger events, and the triggered actions may also be represented in the VR environment, more specifically, displayed to the user U via a display configured in the XR headset. The representation in the VR environment may be achieved by changing rendering parameters of the user-mounted device 100, such as color or light, and / or adding specific sounds.In some embodiments, the interaction surface 210 may be modeled in a VR environment, displayed to a user via an XR headset, and / or used as input to represent an interaction between the user-mounted device 100 and the interaction surface 210 in the VR environment (e.g., representing the user-mounted device 100 being manipulated on the interaction surface 210 in the VR environment). Specifically, control of the user-mounted device 100 may be calculated and / or displayed to the user via the XR headset according to the determined user-mounted device mode. In some embodiments, one or more output devices 500 may be represented as a virtual display or screen in the VR environment. In embodiments, the XR headset may be configured to evaluate the shape of the user-mounted device 100 by merging data regarding the user-mounted device placement with camera input tracked by a camera to dynamically create the shape of the user-mounted device 100. Based on a comparison of the created shape of the user-mounted device 100 with a predefined shape, the user-mounted device type and mode may be recognized or identified.
[0056] Referring to FIG. 3 , an arrangement of multiple magnetometers relative to an interaction surface 210 defined on an interaction support 200 is shown. In the embodiment shown in FIG. 3 , the multiple magnetometers 300 may be arranged in rows and columns. However, the multiple magnetometers may also be arranged randomly within the magnetometer body. A calibration procedure can be used to determine the exact location and measurement axis of each magnetometer within the magnetometer body relative to the reference coordinate system XYZ. The multiple magnetometers 300 are shown in FIG. 3 as arranged in a magnetometer plane 310 (i.e., in the same plane with respect to the vertical reference axis Z). However, as outlined above, one or more of the magnetometers may be spaced apart from the magnetometer plane 310, and more specifically, spaced apart in the direction of the vertical reference axis Z.
[0057] The plurality of magnetometers 300 may be electrically (e.g., via a wire or data bus) or wirelessly connected to the processing unit 400, an external processing unit, and / or an electronic device. In embodiments, the plurality of magnetometers 300 may be integrated into a wall, furniture, a notebook, an electronic device, a screen, a keyboard, and / or a mouse pad. When the plurality of magnetometers 300 are configured on a wall, the interaction surface 210 may be a screen or display positioned in front of the plurality of magnetometers 300. In embodiments, the interaction surface 210 may be defined on one or more output devices 500.
[0058] According to one aspect of the present disclosure, a computer system may be configured to perform the computer-implemented method 600 described herein. According to another aspect of the present disclosure, a computer program may be configured to perform the computer-implemented method 600 described herein. Furthermore, a computer-readable medium or signal having the computer program stored thereon may be provided.
[0059] In an embodiment (not shown), the user-mounted device 100 may include at least one manipulation feature, more specifically coupled to the housing of the user-mounted device. The at least one manipulation feature may be translatable and / or rotatable relative to the user-mounted device 100, more specifically relative to the housing. At least one magnetic object 110 may be coupled to the at least one manipulation feature. More specifically, the at least one magnetic object 110 may be operatively, e.g., mechanically, coupled to the at least one manipulation feature 140. Translation and / or rotation of the at least one manipulation feature relative to the housing may cause translation and / or rotation of the at least one magnetic object 110 relative to the housing. The at least one manipulation feature may be actuated by a user. In an initial state of the user-mounted device 100, the at least one manipulation feature and / or the at least one magnetic object 110 may be in an initial position. In an actuated state of the user-mounted device 100, the at least one manipulation feature and / or the at least one magnetic object 110 may be in an actuated position. In other words, when at least one control feature is not activated by the user, the user-mounted device may be in an initial state. More specifically, in the initial state, at least one control feature and / or at least one magnetic object 110 may be in an initial position. When at least one control feature is activated by the user, the user-mounted device 100 may be in an activated state. More specifically, in the activated state, at least one control feature and / or at least one magnetic object 110 may be in an activated position. In an embodiment, the user-mounted device 100 may include a biasing element (not shown) configured to bias at least one control feature and / or at least one magnetic object 110 from the activated position to the initial position, more specifically when at least one control feature is not activated. More specifically, when the user activates at least one control feature (e.g., applies a force to at least one control feature), at least one control feature and at least one magnetic object 110 may be moved from the initial position to the activated position. In this case, the biasing element may be biased.When the user releases the force on the at least one control feature, the at least one control feature and the at least one magnetic object may be biased from the activated configuration to the initial configuration.
[0060] In an embodiment, at least one manipulation feature may be associated with at least one trigger event. The system 10 may be configured to determine a respective trigger event based on a translation and / or rotation of the at least one magnetic object 110 relative to the user-mounted device 100, more specifically, caused by a translation and / or rotation of at least one manipulation feature operably coupled to the at least one magnetic object 110. More specifically, the system 10 may be configured to determine a positional and / or rotational deviation between an initial configuration and an actuated configuration. In other words, a specific translation and / or rotation of the at least one magnetic object 110 relative to the user-mounted device 100 may be detectable by the system 10. Based on the detected specific translation and / or rotation, the system 10 may be configured to convert this movement into a trigger event associated with the translation and / or rotation. In one example, the system 10 may be coupled to a database. The database may include data associating at least one trigger event with a specific translation and / or rotation of the at least one magnetic object 110 from the initial configuration to the actuated configuration. The system 10 may be configured to transmit data to and / or receive data from a database. A particular translational and / or rotational movement of the at least one magnetic object 110 may be associated with a particular trigger event. Each trigger event may be, for example, a click event, a scroll event, and / or a selection event. If multiple magnetic objects are provided, additional trigger events may be determined based on the rotational and / or translational movements of the magnetic objects relative to one another and may be detectable by the system 10. The at least one trigger event may be initiated by user manipulation of the user-mounted device 100 within the sensing volume M. The at least one trigger event may cause and / or be used to control an action in a digital environment (i.e., an environment controlled by a computer or a network of computers), for example, a virtual environment, based on user input.More specifically, the at least one trigger event may implement user input on the user-equipped device as an action in the digital environment. For example, the at least one user-equipped device 100 may be used with an electronic device, such as a tablet, a mobile phone, a laptop, a computer, a virtual reality (VR) set, or a television. The at least one trigger event may cause an action on the electronic device and / or may be used to control an action on the electronic device 700 based on the user input on the user-equipped device 100.
[0061] As described above, the at least one trigger event may be a scroll event and / or a click event. The scroll event and / or the click event may be applied to a variety of different application fields. The scroll event may trigger a scroll action in a digital environment, more specifically, a virtual environment, based on a user input, e.g., "scroll up" and "scroll down" on a display. The scroll event may cause or provide control of rotational and / or translational movement of a virtual object in the digital environment, more specifically, a virtual environment, associated with the user input. For example, the scroll event may trigger a scroll action including scrolling through files or data, or rotational or translational movement of a virtual object associated with selecting an option from multiple options. The scroll action may also include rotating a body in the virtual environment and / or changing a viewpoint in the virtual environment. Furthermore, a scrolling action may include one or more of: moving a cursor in two opposite directions (e.g., horizontally or vertically on an output device), moving a display element (e.g., a page, a cursor) that can be controlled by the user-mounted device 100, a directional step, flipping through a menu, flipping through a selection list, or adjusting (e.g., increasing or decreasing) a parameter (e.g., a setting or configuration). A click event can trigger a click action (more specifically, of a virtual object) in a digital environment, more specifically, a virtual environment, based on user input. A click event can include, for example, selecting an object (such as a button, a file, an icon, or another object), selecting an item, selecting a list, or selecting an item on a list. A click event can trigger the following actions: A click event can trigger an action that provides additional information and / or properties of the selected object, item, or text (e.g., a character, word, phrase).A click event can trigger a single-click action, a double-click action, a triple-click action, a right-click action, and / or a click-and-drag action within a digital environment, more specifically a virtual environment. A single-click action can refer to selecting an object within the virtual environment. A double-click action can open a file or run a program within the virtual environment. A click-and-drag action can include clicking, holding, and moving an object and can be used, for example, to highlight or drag-select text or an object. A triple-click action can be used to select a paragraph of text. A right-click action can perform a special action, such as opening a list with additional information and / or properties about the selected object, as described above. The action triggered by a click event depends on the user's input on the user-mounted device 100. For example, a click event can cause a double-click action when the user provides two rapid successive inputs on the user-mounted device 100. The above-described features enable a variety of new application areas for the user-mounted device 100, such as, for example, a computer mouse, a keyboard, a dial, a mouse scroll element (e.g., a wheel), a joystick, a control for an electronic device (e.g., an audio control or a visual control), a control of software settings or visualization (e.g., graphics software or design software), or a control of a computer game. [Example]
[0062] While the inventive concept has been described above and defined in the appended claims, it should be understood that the concept may be defined according to the following embodiments. 1. A computer-implemented method (600) for controlling the presentation of a user-installed device (100) on an output device (500) according to one of one or more user-installed device modes, comprising: - acquiring (610) magnetic field measurements associated with at least one magnetic object (110) and measured by a plurality of magnetometers (300), wherein the at least one magnetic object (110) is coupled to a user-mounted device (100); - determining (620) a user-mounted device placement based on the collected magnetic field measurements; - obtaining (630) user-installed device mode data indicative of predetermined operating ranges of one or more user-installed device modes; - determining a user-installed device mode based on the user-installed device configuration and the user-installed device mode data (640). 2. A computer-implemented method (600) as described in embodiment 1, wherein the plurality of magnetometers (300) are configured to generate a sensing volume (M), and specifically, the user-mounted device (100) is operable within the sensing volume (M). 3. The user-mounted device (100) is operable on an interaction surface (210), and the method comprises: The interaction surface coordinate system (x s y s z s ) and defining an interaction surface coordinate system (x s y s z s ) is the first interaction surface axis (x s ), the second interaction surface axis (y s ), and the normal interaction surface axis (z s ), and the first interaction surface axis (x s ) and the second interaction surface axis (y s ) are orthogonal to each other and define an interaction surface (210), and the vertical interaction surface axis (z s ) is the first interaction surface axis (x s ) and the second interaction surface axis (y s 3. The computer-implemented method (600) of any one of embodiments 1 to 2, comprising: defining a vertex that is orthogonal to the vertex. 4. A computer-implemented method (600) described in any one of embodiments 1 to 3, wherein the multiple magnetometers (300) are associated with a magnetometer plane (310), and more specifically, the magnetometer plane (310) is defined by a plane extending through a majority of the multiple magnetometers (300). 5. 5. A computer-implemented method (600) as recited in embodiment 4, comprising defining a reference coordinate system (XYZ) for the plurality of magnetometers (300), the reference coordinate system (XYZ) including a first reference axis (X), a second reference axis (Y), and a vertical reference axis (Z), the first reference axis (X) and the second reference axis (Y) being orthogonal to each other, the vertical reference axis (Z) being orthogonal to the first reference axis (X) and the second reference axis (Y) and extending through a center of the plurality of magnetometers (300), and optionally the first reference axis (X) and the second reference axis (Y) being defined on a magnetometer plane (310), and the vertical reference axis (Z) being orthogonal to the magnetometer plane (310). 6. The user-mounted device (100) includes a device coordinate system, and more specifically, the device coordinate system is defined by a first device axis (x d ) and the first device axis (x d The second device axis (y d ) and the vertical device axis (z d ), and more specifically, the vertical device axis (z d ) is perpendicular to the device contact surface or point (130) and / or perpendicular to the first device axis (x d ) and the second device axis (y d 6. The computer-implemented method (600) according to any one of embodiments 1 to 5, wherein the plane is perpendicular to the plane defined by the plane. 7. The computer-implemented method (600) of any one of embodiments 1 to 6, wherein the collected magnetic field measurements are indicative of a magnetic field associated with at least one magnetic object (110). 8. Determining user-equipped device placement (620) includes: A computer-implemented method (600) according to any one of embodiments 1 to 7, comprising determining (621, 624) a magnetic object configuration of at least one magnetic object (110) indicative of a user-mounted device configuration, in particular determining (621, 624) a position vector indicative of the magnetic object position, and / or determining (621, 624) a magnetic moment vector (120) indicative of the magnetic object orientation of at least one magnetic object (110). 9. A computer-implemented method (600) according to any one of embodiments 1 to 8, wherein the user-mounted device position indicates the absolute user-mounted device position with respect to the magnetometer plane (310) and / or the user-mounted device position relative to the interaction surface (210). 10. Determining (620) a user-mounted device location indicating an absolute user-mounted device location includes: A computer-implemented method (600) as described in embodiment 9, comprising determining (621) an absolute magnetic object configuration indicating the absolute magnetic object position and / or absolute magnetic object orientation of at least one magnetic object (110) relative to a reference coordinate system (XYZ), more specifically, the absolute magnetic object configuration is determined based on acquired magnetic field measurements. 11. Determining absolute magnetic object configuration (621) A computer-implemented method (600) as described in embodiment 10, comprising generating (622) magnetic field measurement data based on the acquired magnetic field measurements, the magnetic field measurement data indicating magnetic field position, magnetic field orientation and / or magnetic field strength relative to a reference coordinate system (XYZ). 12. Determining absolute magnetic object configuration (621) 12. The computer-implemented method (600) of embodiment 11, comprising processing (623) the magnetic field measurement data to relate the magnetic field measurement data to absolute magnetic object configurations. 13. A computer-implemented method (600) described in any one of embodiments 10 to 12, wherein the absolute magnetic object configuration includes a magnetic moment vector (120) and / or an absolute position vector associated with at least one magnetic object (110), wherein the magnetic moment vector (120) indicates the magnetic object orientation and / or the absolute position vector indicates the magnetic object position relative to a reference coordinate system (XYZ). 14. The computer-implemented method (600) of embodiment 13, wherein the absolute magnetic object orientation is defined by a first set of magnetic object tilt angles (δ1, δ2, δ3) measured between the magnetometer plane (310) and the magnetic moment vector (120). 15. Determining (620) a user-mounted device location indicating a relative user-mounted device location includes: A relative magnetic object configuration indicating the magnetic object position relative to the interaction surface (210) and / or a coordinate system relative to the interaction surface (210), more specifically the interaction surface coordinate system (x s y s z s 15. The computer-implemented method (600) of any one of embodiments 9 to 14, comprising determining (624) a relative magnetic object orientation of at least one magnetic object (110) with respect to the magnetic object. 16. The relative magnetic object configuration includes a magnetic moment vector (120) and / or a relative position vector associated with at least one magnetic object (110), the magnetic moment vector (120) indicating a relative magnetic object orientation and / or the relative position vector (Δx s , Δy s , Δz s ) is the interaction surface coordinate system (x s y s z s 16. The computer-implemented method (600) of embodiment 15, further comprising: indicating a magnetic object position relative to the target object. 17. The relative magnetic object orientation is determined by the magnetic object tilt angle (γγ) determined between the interaction surface (210) and the magnetic moment vector (120). 2. 17. The computer-implemented method (600) of embodiment 15 or 16, wherein: 18. A computer-implemented method (600) according to any one of embodiments 15 to 17, wherein determining (624) the relative magnetic object configuration is based on the absolute magnetic object configuration and a first set of geometric parameters. 19. The first set of geometric parameters is the translation from the reference coordinate system (XYZ) to the interaction surface coordinate system (x s y s z s 19. The computer-implemented method (600) of embodiment 18, comprising predefined transformation parameters indicating a transformation into 20. The computer-implemented method (600) of any one of embodiments 1-19, wherein the user-installed device mode data includes a plurality of predetermined operating ranges for one or more user-installed device modes. 21. The computer-implemented method (600) of embodiment 20, wherein each predetermined operating range is associated with one of one or more user-installed device modes. 22. The computer-implemented method (600) of embodiment 20 or 21, wherein the predetermined operating range defines a predetermined range of user-mounted device configurations associated with one of the one or more user-mounted device modes. 23. The computer-implemented method (600) of embodiment 22, wherein the predetermined range of user-mounted device placements includes a predetermined range of absolute user-mounted device placements and / or a predetermined range of relative user-mounted device placements. 24. A computer-implemented method (600) according to any one of embodiments 20 to 23, wherein the predetermined operating range includes a predetermined orientation interval indicating a magnetic object orientation and / or a predetermined position interval indicating a magnetic object position. 25. A computer-implemented method (600) according to embodiment 24, when at least dependent on embodiment 8, wherein the predetermined orientation interval includes an interval of at least one magnetic object tilt angle of a first set of magnetic object tilt angles (δ1, δ2, δ3) and / or a second set of magnetic object tilt angles (γ1, γ2, γ3). 26. When dependent on at least embodiment 8, the computer-implemented method (600) described in embodiment 24 or 25, wherein the predetermined position interval includes an interval of an operating distance (Δz) defined by the z component of the position vector, and / or an interval of an operating area (ΔxΔy) defined by the x component and / or the y component of the position vector. 27. The computer-implemented method (600) of any one of embodiments 20-26, wherein the predetermined operating ranges are mutually exclusive. 28. A computer-implemented method (600) described in any one of embodiments 20 to 27, wherein the user-mounted device mode data includes a first predetermined operating range associated with a first user-mounted device mode, a second predetermined operating range associated with a second user-mounted device mode, and a third predetermined operating range associated with a third user-mounted device mode. 29. According to at least embodiment 3, the first predetermined operating range includes a predetermined orientation interval limited to the magnetic object orientation; The magnetic moment vector (120) is directed away from the interaction surface (210), The magnetic moment vector (120) is perpendicular to the interaction surface (210) along the normal interaction surface axis (z s ) to the first angle interval (γ 3,1,min ~γ 3,1,max 29. The computer-implemented method (600) of embodiment 28, wherein the vertices are oriented in a direction perpendicular to the axis of the arrow. 30. The first angular interval is perpendicular to the interaction surface axis (z s ) for γ 3,1,max 30. The computer-implemented method (600) of embodiment 29, wherein the angle is limited to ≦75°. 31. According to at least embodiment 3, the second predetermined operating range includes a predetermined orientation interval limited to the magnetic object orientation; The magnetic moment vector (120) is perpendicular to the interaction surface (210) along the normal interaction surface axis (z s ) the second angular interval (γ 3,2,min ~γ 3,2,max31. The computer-implemented method (600) according to any one of embodiments 28 to 30, wherein the 32. When subject to at least embodiment 29 or 30, γ 3,2,min >γ 3,1,max 32. The computer-implemented method (600) of embodiment 31, wherein: 33. The second angular interval is perpendicular to the interaction surface axis (z s ) for γ 3,2,min 33. The computer-implemented method (600) of embodiment 31 or 32, wherein the angle is limited to >80°. 34. According to at least embodiment 3, the third predetermined operating range includes a predetermined orientation interval limited to the magnetic object orientation; The magnetic moment vector (120) is oriented toward the interaction surface (210), The magnetic moment vector (120) is perpendicular to the interaction surface (210) along the normal interaction surface axis (z s ) to the third angle interval (γ 3,3,min ~γ 3,3,max 34. The computer-implemented method (600) according to any one of embodiments 28 to 33, wherein the . 35. When subject to at least embodiment 31 or 33, γ 3,2,min >γ 3,3,max 35. The computer-implemented method (600) of embodiment 34, wherein: 36. The third angular interval is perpendicular to the interaction surface (210) along the vertical interaction surface axis (z s ) for γ 3,3,max 36. The computer-implemented method (600) of embodiment 34 or 35, wherein the angle is limited to ≦75°. 37. The computer-implemented method (600) of any one of embodiments 1 to 36, wherein the user-installed device mode indicates a particular user-installed device type and / or a particular user-installed device function. 38. The computer-implemented method (600) of embodiment 37, wherein the particular user-mounted device type indicates one of a computer mouse, a keyboard, a toy, a stylus, or a dial, a brush, or a ring. 39. The computer-implemented method (600) of embodiment 37 or 38, wherein the specific user-installed device capabilities indicate default capabilities or one or more adapted capabilities. 40. Determining the user-installed device mode (640) includes: comparing (641) the acquired user-installed device mode data with the determined user-installed device configuration; and selecting a user-installed device mode based on the comparison (642). 41. When relying on at least embodiment 20, comparing the acquired user-mounted device mode data with the determined user-mounted device configuration (641) 41. The computer-implemented method (600) of embodiment 40, comprising comparing the determined user-mounted device configuration with a plurality of predetermined operating ranges. 42. According to at least embodiment 20, selecting a user-installed device mode based on the comparison (642) includes: Excluding a compared user-equipped device mode when the determined user-equipped device configuration does not satisfy a predetermined operating range for the compared user-equipped device mode; and / or A computer-implemented method (600) as described in embodiment 40 or 41, comprising selecting a user-mounted device mode to be compared when the determined user-mounted device configuration satisfies a predetermined operating range of the user-mounted device mode to be compared. 43. The computer-implemented method (600) of any one of embodiments 1 to 42, wherein determining (620) the user-equipped device placement based on the collected magnetic field measurements is performed over a period of time. 44. The determining of the user-installed device mode (640) is performed within a period of time, and the determining of the user-installed device mode (640) includes: 44. The computer-implemented method (600) of embodiment 43, comprising storing (643) the determined user-installed device mode in memory. 45. The computer-implemented method (600) of embodiment 44, wherein the period includes a mode recognition time phase during which the user-installed device mode is determined and stored. 46. A computer-implemented method (600) as described in embodiment 45, wherein the mode recognition time phase starts at the same moment as the period, or the mode recognition time phase starts upon determining a predetermined start trigger user-mounted device configuration. 47. The end of the mode recognition time phase is After a predetermined time interval, When determining the user's device mode, When the determined user-installed device mode is stored in the memory, When the distance, specifically one or more components of the position vector, exceeds a predetermined threshold, and / or 47. The computer-implemented method (600) of embodiment 45 or 46, triggered by any one or more of the lapse of a period of time. 48. The computer-implemented method (600) of any one of embodiments 45 to 47, wherein determining the user-installed device mode (640) is stopped when the mode recognition time phase ends. 49. - rendering (650) the user-installed device (100) on the output device (500); The computer-implemented method (600) according to any one of embodiments 1 to 48, further comprising: - controlling (660) the presentation of the user-mounted device (100) according to the determined user-mounted device mode. 50. The computer-implemented method (600) of any one of embodiments 1 to 49, wherein the user-mounted device (100) is electrically passive and / or electronically passive. 51. The computer-implemented method (600) of any one of embodiments 1 to 50, wherein at least one magnetic object (110) is a permanent magnet. 52. The computer-implemented method (600) of any one of embodiments 1 to 51, wherein the output device (500) includes one or more of a display, a screen, a light, a domotic peripheral, a laptop, a smartphone, and a tablet. 53. A computer system configured to execute the computer-implemented method (600) described in any one of embodiments 1 to 52. 54. A computer program configured to execute the computer-implemented method (600) according to any one of embodiments 1 to 52. 55. A computer-readable medium or signal storing the computer program of embodiment 54. 56. A system (10) for controlling the presentation of a user-installed device (100) on an output device (500) according to one of one or more user-installed device modes, comprising: a user-mounted device (100) comprising at least one magnetic object (110); a plurality of magnetometers (300) configured to perform magnetic field measurements associated with at least one magnetic object (110); an output device (500); The system (10) is configured to execute the computer-implemented method (600) described in any one of embodiments 1 to 52. 57. The system (10) comprises a processing unit (400) configured to execute a computer-implemented method (600); or 57. The system (10) of embodiment 56, wherein the system (10) is connectable to an external processing unit configured to execute the computer-implemented method (600). 58. The system (10) of embodiment 56 or 57, wherein the system (10) comprises an electronic device. 59. The system (10) of embodiments 57 and 58, wherein the processing unit (400) is integrated into an electronic device. 60. The system (10) of embodiment 58 or 59, wherein the output device (500) is integrated within an electronic device. 61. A system (10) described in any one of embodiments 56 to 60, wherein the plurality of magnetometers (300) are integrated into a wall, furniture, a notebook, an electronic device, a screen or display, a keyboard, and / or a mouse pad. 62. A system (10) according to any one of embodiments 56 to 61, wherein the user-mounted device (100) is electrically and / or electronically passive. 63. A system (10) according to any one of embodiments 56 to 62, wherein the system (10) comprises an interaction support (200) having an interaction support surface, and the interaction surface (210) is at least a partial surface of the interaction support surface. 64. The system (10) according to embodiment 63, wherein the interactive support (200) is a wall, a piece of furniture, a notebook, an electronic device, a screen or display, a keyboard and / or a mouse pad. 65. A system (10) according to embodiment 63 or 64, wherein the interaction surface (210) is defined based on a first set of geometric parameters associated with the interaction support (200).
Claims
1. 1. A computer-implemented method for controlling a presentation of a user-installed device on an output device according to one of one or more user-installed device modes, comprising: - acquiring (610) magnetic field measurements associated with at least one magnetic object (110) and measured by a plurality of magnetometers (300), said at least one magnetic object (110) being coupled to said user-mounted device (100); - determining (620) a user-mounted device placement based on the collected magnetic field measurements; - obtaining (630) user-installed device mode data indicative of predetermined operating ranges of said one or more user-installed device modes; - determining a user device mode based on said user device configuration and said user device mode data (640); - Representing (650) the user-mounted device (100) on the output device (500); - controlling (660) the presentation of the user-mounted device (100) according to the determined user-mounted device mode.
2. The user-mounted device (100) is operable on an interaction surface (210), and the method comprises: The interaction surface coordinate system (x) is used to determine the interaction surface (210). s y s z s ), wherein the interaction surface coordinate system (x s y s z s ) is the first interaction surface axis (x s ), the second interaction surface axis (y s ), and the normal interaction surface axis (z s ), and the first interaction surface axis (x s ) and the second interaction surface axis (y s ) are orthogonal to each other and define said interaction surface (210), and said perpendicular interaction surface axis (z s ) is the first interaction surface axis (x s ) and the second interaction surface axis (y s 2. The computer-implemented method of claim 1, comprising: defining a first dimension that is orthogonal to the first dimension.
3. defining a reference coordinate system (XYZ) for the plurality of magnetometers (300), the reference coordinate system (XYZ) including a first reference axis (X), a second reference axis (Y), and a vertical reference axis (Z), the first reference axis (X) and the second reference axis (Y) being orthogonal to each other, the vertical reference axis (Z) being orthogonal to the first reference axis (X) and the second reference axis (Y) and extending through a center of the plurality of magnetometers (300); Optionally, the first reference axis (X) and the second reference axis (Y) are defined on a magnetometer plane (310) associated with the plurality of magnetometers (300), the magnetometer plane (310) being defined by a plane extending through a majority of the plurality of magnetometers (300), and the vertical reference axis (Z) being orthogonal to the magnetometer plane (310).
4. Determining 620 the user-mounted device placement includes: The computer-implemented method (600) of any one of claims 1 to 3, comprising determining a magnetic object configuration (621, 624) of the at least one magnetic object (110) indicative of the user-mounted device configuration, in particular determining a position vector (621, 624) indicative of a magnetic object position, and / or determining a magnetic moment vector (120) indicative of a magnetic object orientation of the at least one magnetic object (110).
5. The computer-implemented method (600) of any one of claims 1 to 4, wherein the user-mounted device position indicates an absolute user-mounted device position with respect to the magnetometer plane (310) and / or a relative user-mounted device position with respect to the interaction surface (210).
6. Determining 620 a user-mounted device location indicating a relative user-mounted device location includes: a relative magnetic object configuration indicating the magnetic object position relative to the interaction surface (210) and / or a coordinate system (x, y, z) relative to the interaction surface (210), more specifically the interaction surface coordinate system (x, y, z) s y s z s 6. The computer-implemented method of claim 5, further comprising determining a relative magnetic object orientation of the at least one magnetic object relative to the at least one magnetic object.
7. The computer-implemented method (600) of any one of claims 1 to 6, wherein the user-installed device mode data comprises a plurality of predetermined operating ranges of the one or more user-installed device modes.
8. The computer-implemented method (600) of claim 7, wherein the predetermined operating range defines a predetermined range of user-mounted device positioning associated with one of the one or more user-mounted device modes, and specifically, the predetermined range of user-mounted device positioning includes a predetermined range of user-mounted device positioning absolute with respect to the magnetometer plane and / or a predetermined range of user-mounted device positioning relative to an interaction surface.
9. The computer-implemented method (600) of claim 7 or 8, wherein the predetermined operating range comprises a predetermined orientation interval indicative of a magnetic object orientation and / or a predetermined position interval indicative of a magnetic object position.
10. 10. The computer-implemented method (600) of claim 9, wherein, at least when dependent on claim 4, the predetermined position interval comprises an interval of operating distance (Δz) defined by a z-component of the position vector and / or an interval of operating area (ΔxΔy) defined by an x-component and / or a y-component of the position vector.
11. Determining 640 the user-installed device mode includes: comparing the acquired user device mode data with the determined user device configuration (641); and selecting a user-installed device mode based on the comparison.
12. When dependent at least on claim 7, selecting a user-installed device mode based on the comparison (642) may further comprise: excluding a compared user-equipped device mode when the determined user-equipped device configuration does not satisfy the predetermined operating range of the compared user-equipped device mode; and / or 12. The computer-implemented method (600) of claim 11, further comprising: selecting a compared user-mounted device mode when the determined user-mounted device configuration satisfies the predetermined operating range of the compared user-mounted device mode.
13. The determining 620 of the user-mounted device configuration based on the collected magnetic field measurements is performed over a period of time, and specifically, the determining 640 of the user-mounted device mode is performed within the period of time, and the determining 640 of the user-mounted device mode includes: The computer-implemented method (600) of any one of claims 1 to 12, comprising storing (643) the determined user-installed device mode in a memory.
14. 14. The computer-implemented method (600) of claim 13, wherein the period includes a mode recognition time phase during which the user-installed device mode is determined and stored, and optionally, determining the user-installed device mode (640) is stopped when the mode recognition time phase ends.
15. 1. A system (10) for controlling the presentation of a user-installed device (100) on an output device (500) according to one of one or more user-installed device modes, comprising: said user-mounted device (100) comprising at least one magnetic object (110); a plurality of magnetometers (300) configured to perform magnetic field measurements associated with the at least one magnetic object (110); an output device (500); The system (10) is configured to perform a computer-implemented method (600) according to any one of claims 1 to 14.