Automatic identification of passive accessories

Abstract

The present disclosure relates to a computer-implemented method (600) for controlling a representation of a user-carried device according to one of one or more user-carried device modes on an output device. The method (600) includes obtaining a magnetic field measurement (610) associated with at least one magnetic object (110). The magnetic field measurements are measured with a plurality of magnetometers (300). At least one magnetic object (110) is coupled to the user-carried device (100). The method (600) also includes determining a user carried device location (630) based on the collected magnetic field measurements. The method 600 also includes obtaining (630) user carrying device mode data indicating a predetermined operating range of the one or more user carrying device modes. In addition, the method (600) includes determining (640) a user carrying device pattern based on the user carrying device location and the user carrying device pattern data.

Description

[0001] This application claims the benefit of European Patent Application EP 22 306 735.6, filed on November 24, 2022, the content of which is incorporated herein by reference. Technical Field

[0002] The present disclosure relates to the technical field of determining and / or tracking the position of passive accessories, and more particularly to a computer-implemented method for controlling the representation of a user-carrying device according to one of one or more user-carrying device modes on an output device, and a system for controlling the representation of a user-carrying device according to one of one or more user-carrying device modes. Background Art

[0003] In the technical field of determining and / or tracking the position of a device held or worn by a user (i.e., a user-carrying device), providing multiple magnetometers allows for measuring the magnetic field associated with a magnetic object disposed in or coupled to the user-carrying device. The user-carrying device using this technology can be electronically passive and / or electrically passive. More specifically, electrically passive means that the user-carrying device may not include a power source (e.g., a battery) for powering the electronic features of the user-carrying device and / or means for receiving electrical power (e.g., wireless power transfer via an induction coil). Electronically passive means that no computing or processing occurs (or takes place) on the user-carrying device. The magnetometer measurement results enable the determination and / or tracking of the position of the magnetic object within the sensing volume created by the multiple magnetometers. In some applications, the magnetic object may be disposed within a writing device (e.g., a stylus), which can be operated by the user on a writing support during user operation. Based on the magnetic field measurement results associated with the magnetic object, the position of the writing device on the writing support can be determined.

[0004] The user operation of the user-carrying device within the sensing volume created by the multiple magnetometers can be represented to the user on an output device (e.g., a screen). Specifically, the manipulation of the user-carrying device within the sensing volume can be reproduced as the manipulation of a virtual object on the output device. Current applications may include different types of user-carrying devices and / or different functions of the user-carrying device.

[0005] It is an object of the present invention to provide a computer-implemented method and system that enables improved control of the representation of different types and functions of a user-carrying device on an output device. Summary of the Invention

[0006] The present disclosure relates to a computer-implemented method for controlling the representation of a user-carryable device according to one of one or more user-carryable device modes on an output device, and a system for controlling the representation of a user-carryable device according to one of one or more user-carryable device modes on an output device as defined in claim 15. The dependent claims depict embodiments of the present disclosure.

[0007] According to a first aspect of the present disclosure, there is provided a computer-implemented method for controlling the representation of a user-carryable device according to one of one or more user-carryable device modes on an output device. The method includes obtaining magnetic field measurement results associated with at least one magnetic object and measured using a plurality of magnetometers. The at least one magnetic object is coupled to the user-carryable device. The method further includes obtaining user-carryable device mode data indicating a predetermined operating range of one or more user-carryable device modes. Additionally, the method includes determining the user-carryable device location based on the collected magnetic field measurement results. Furthermore, the method includes determining the user-carryable device mode based on the user-carryable device location and the user-carryable device mode data. The computer-implemented method can provide automatic recognition of a desired user-carryable device mode (such as the type of user-carryable device currently in use and / or the function of the user-carryable device) based on the predetermined operating range and the determined user-carryable device location.

[0008] According to a second aspect of the present disclosure, there is provided a system for controlling the representation of a user-carryable device according to one of one or more user-carryable device modes on an output device. The system includes a user-carryable device, wherein the user-carryable device includes at least one magnetic object. Additionally, the system includes a plurality of magnetometers configured to perform magnetic field measurement results associated with the at least one magnetic object. Additionally, the system includes an output device. The system is configured to perform the computer-implemented method according to the first aspect of the present disclosure. The system can provide automatic recognition of a desired user-carryable device mode (such as the type of user-carryable device currently in use and / or the function of the user-carryable device) based on the predetermined operating range and the determined user-carryable device location. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Other features will be apparent from the drawings which form a part of the present disclosure. The drawings are intended to further explain the present disclosure and enable a person skilled in the art to practice the present disclosure. However, the drawings are intended as non-limiting examples. Common reference numerals in different figures indicate similar or like features.

[0010] Figure 1A process flow diagram of a computer-implemented method for controlling a representation of a user-carrying device according to one of one or more user-carrying device modes on an output device is schematically shown, in accordance with a first aspect of the present disclosure;

[0011] Figure 2 The computer-implemented method according to the first aspect of the present disclosure is schematically shown in more detail;

[0012] Figure 3 A schematic diagram of a system for controlling a representation of a user-carrying device according to one of one or more user-carrying device modes on an output device is shown, in accordance with a second aspect of the present disclosure;

[0013] Figure 4 A schematic diagram of a first example system according to the second aspect of the present disclosure, wherein the user-carrying device is controlled according to a first user-carrying device mode;

[0014] Figure 5 A schematic diagram of a second example system according to the second aspect of the present disclosure, wherein the user-carrying device is controlled according to a second user-carrying device mode;

[0015] Figure 6 A schematic diagram of a third example system according to the second aspect of the present disclosure, wherein the user-carrying device is controlled according to a third user-carrying device mode;

[0016] Figure 7 A schematic diagram of a third example system according to the second aspect of the present disclosure, wherein the user-carrying device is controlled according to a fourth user-carrying device mode. Detailed implementation

[0017] Embodiments of a computer-implemented method and system for controlling a representation of a user-carrying device according to one of one or more user-carrying device modes on an output device of the present disclosure will be described below with reference to the accompanying drawings.

[0018] Figure 1Schematically illustrated is a computer-implemented method 600 for controlling a representation of a user-carrying device according to one of one or more user-carrying device modes on an output device. The method 600 includes obtaining a magnetic field measurement result 610 associated with at least one magnetic object 110. The magnetic field measurement result is measured using a plurality of magnetometers 300. At least one magnetic object 110 is coupled to the user-carrying device 100. The method 600 further includes determining a user-carrying device position 630 based on the collected magnetic field measurement results. The collected magnetic field measurement results may indicate a magnetic field associated with at least one magnetic object 110. The method 600 further includes obtaining 630 user-carrying device mode data indicating a predetermined operating range of one or more user-carrying device modes. Additionally, the method 600 includes determining 640 the user-carrying device mode based on the user-carrying device position and the user-carrying device mode data. The computer-implemented method may be adapted to represent, more specifically reproduce, the user-carrying device 100 as a virtual object according to one of one or more user-carrying device modes on the output device 500. Manipulation of the user-carrying device position during user operation may be represented as a virtual object according to one of one or more user-carrying device modes on the output device 500. The order of obtaining the data or measurement results as described above may vary.

[0019] The computer-implemented method 600 as described above may provide automatic identification of a desired user-carrying device mode (e.g., the type of user-carrying device currently in use and / or the functions of the user-carrying device) based on the predetermined operating range and the determined user-carrying device position. Additionally, the method 600 may provide reliable and accurate control of the representation of the user-carrying device 100 according to one of one or more user-carrying device modes on the output device 500.

[0020] Figures 3 to 7 Schematically illustrated is a system 10 for controlling a representation of a user-carrying device 100 according to one of one or more user-carrying device modes on an output device 500 according to a second aspect of the present disclosure. The system 10 includes a user-carrying device 100 that includes at least one magnetic object 110. The system 10 further includes a plurality of magnetometers 300 configured to perform magnetic field measurement results associated with at least one magnetic object 110, and an output device 500. The system 10 is configured to perform the computer-implemented method 600 according to the first aspect as described herein.

[0021] In an embodiment, the user-carried device mode may indicate a specific user-carried device type. In an embodiment, the user-carried device mode may indicate a specific user-carried device function. In some embodiments, the user-carried device mode may indicate a specific user-carried device type and a specific user-carried device function. In an embodiment, the specific user-carried device type may indicate one of a computer mouse, a keyboard, a toy, a stylus, or a dial, a brush, a finger ring. In an embodiment, the specific user-carried device function may indicate a default function or one or more adapted functions. The default function may be the function of the intended use. For example, the default function of a stylus may be writing. The adapted function of a stylus may be erasing, for example, which may be determined by another predetermined operation range.

[0022] A plurality of magnetometers 300 may be configured to create a sensing volume M (as indicated, for example, Figure 3 in). The plurality of magnetometers 300 may be associated with a magnetometer plane 310. More specifically, the magnetometer plane 310 may be defined by a plane that may extend through most of the plurality of magnetometers 300. In an embodiment, the plurality of magnetometers 300 may be integrated in a wall, furniture, a notebook, an electronic device, a screen or display, a keyboard, and / or a mouse pad.

[0023] Method 600 may include defining a reference coordinate system XYZ with respect to the plurality of magnetometers 300 (see, for example, Figures 3 to 7 ). The reference coordinate system XYZ may include a first reference axis X, a second reference axis Y, and a vertical reference axis Z. The first reference axis X and the second reference axis Y may be orthogonal to each other. The vertical reference axis Z may be orthogonal to the first reference axis X and the second reference axis Y. The vertical reference axis Z may extend through the center of the plurality of magnetometers 300. In an embodiment, the first reference axis X and the second reference axis Y may be defined on the magnetometer plane 310. In this case, the vertical reference axis Z may be orthogonal to the magnetometer plane 310.

[0024] In an embodiment, the user-carried device 100 may be operable within the sensing volume M. Specifically, the user-carried device 100 may be operable on or above the interaction surface 210. More specifically, the interaction surface 210 may be defined within the sensing volume M. The interaction surface 210 may be understood as a physical constraint related to the plurality of magnetometers 300. For example, the interaction surface 210 may be defined by a first set of geometric parameters relative to the plurality of magnetometers 300 and / or the reference coordinate system XYZ. More specifically, the first set of geometric parameters may indicate the geometry of the interaction surface 210. The first set of geometric parameters may include points and normal vectors on the interaction surface 210 (thus defining an infinite surface), at least three coplanar points defining a finite surface, a center point, a radius, and a normal vector in the case of a disk-shaped surface, and / or two axes defined on the surface (e.g., two dimensions may define a rectangular surface). The interaction surface configuration as described above may be based on the first set of geometric parameters. The interaction surface 210 may include a set of partial surfaces having different orientations and / or positions relative to each other. The computer-implemented method 600 may determine the interaction surface 210 based on the first set of geometric parameters. This allows the determination of the position of the user-carried device on any surface, even a complex surface (e.g., a polygonal shape of the surface, a curved surface). The first set of geometric parameters may include predefined geometric parameters associated with the interaction surface 210.

[0025] In an embodiment, the system 10 may include an interaction support 200 having an interaction support surface (see Figures 3 to 7 ). The interaction surface 210 may be at least a partial surface of the interaction support surface. The interaction support 200 may not include ferromagnetic properties, such as ferromagnetic particles. In an embodiment, the interaction support 200 may be a piece of furniture (e.g., a table), a notebook, an electronic device, a screen or display, a board, a wall, or a mouse pad. The interaction surface 210 may be defined based on a first set of geometric parameters associated with the interaction support 200. More specifically, the type of the interaction support 200 may be known, such as a notebook or a mouse pad. Such an interaction support 200 may be defined by a set of predefined geometric parameters. A partial surface of the interaction support surface may be used as the interaction surface 210. Thus, the set of predefined parameters may include data associated with the interaction surface configuration of the interaction surface 210, more specifically geometric data. As an example, these parameters may indicate the positioning and / or orientation of the interaction surface 210 relative to the reference coordinate system XYZ. In an embodiment, the first set of geometric parameters may be determined by interaction surface identification, which will be described below. In an embodiment, the user-carried device 100 may be a computer mouse, a keyboard, a toy, a stylus, or a dial. In an embodiment, the user-carried device 100 may be an accessory tool, such as a ruler. In an embodiment, the plurality of magnetometers 300 may be arranged within the interaction support 200 or may be attached to the interaction support 200.

[0026] As described above, the interaction support member 200 may include an interaction support surface. The interaction surface 210 may be at least a partial surface of the interaction support surface. Defining the interaction surface 210 may include receiving input data, more specifically, receiving a specific type of input data about the interaction support member 200 on which the interaction surface 210 is defined from a database. A specific type of interaction support member 200 may include predefined geometric parameters associated with the interaction support member 200. The specific predefined geometric parameters may be stored in a database that associates the type of the interaction support member 200 with the geometric parameters. In an embodiment, receiving the input data may include instructing a user to select an interaction support member 200 to be used with the user-carrying device 100. In other embodiments, receiving the input data may include deriving a set of geometric parameters associated with the interaction surface 210 from a database.

[0027] In an embodiment, a first set of geometric parameters may be determined based on interaction surface recognition. The interaction surface recognition may be a calibration process or an automatic recognition process. As an example, for calibration, the computer-implemented method 600 may instruct a user via a user interface to set the user-carrying device 100 at at least three different points on the interaction surface 210, where the at least three points may not be aligned (specifically, the three points may form an equilateral triangle). Based on these points, the computer-implemented method 600 may calculate the normal of the interaction surface 210. More specifically, the interaction surface positioning and / or the interaction surface orientation may be determined by calculating the average value of at least three points. The automatic recognition process may be based on an automatic calculation of a first set of geometric parameters based on a normal vector or a set of normal vectors.

[0028] The method 600 may include defining an interaction surface coordinate system x s y s z s (see, for example Figures 3 to 7 ). The interaction surface coordinate system x s y s z s may include a first interaction surface axis x s , a second interaction surface axis y s and a vertical interaction surface axis z s . The first interaction surface axis x s and the second interaction surface axis y s may be orthogonal to each other and may define the interaction surface 210. The vertical interaction surface axis z s may be orthogonal to the first interaction surface axis x s and the second interaction surface axis y s . In other words, the vertical interaction surface axis z scan be orthogonal to the interaction surface 210.

[0029] The user-carryable device 100 can be electrically passive and / or electronically passive. More specifically, being electrically passive means that the user-carryable device 100 may not include a power source (e.g., a battery) for powering the features (e.g., electronic features) of the user-carryable device 100 and / or means for receiving electric power (e.g., wireless power transfer via an induction coil). Being electronically passive means that no computing or processing occurs on the user-carryable device 100.

[0030] The term "magnetic object" can refer to an object that may include components made of a magnetic material (i.e., a material having magnetic properties measurable by a plurality of magnetometers 300). The user-carryable device 100 and / or at least one magnetic object 110 can be mobile, i.e., freely movable within a reference coordinate system XYZ. In other words, during user operation (i.e., an operation in which the user operates the user-carryable device 100 and / or at least one magnetic object 110), the position of the user-carryable device 100 within the sensing volume M and / or relative to the interaction surface 210 can be manipulated by the user within the sensing volume M.

[0031] At least one magnetic object 110 can be a permanent magnet. In an embodiment, at least one magnetic object 110 can be configured to generate a non-zero magnetic field. It can include paramagnetic or diamagnetic materials. In an embodiment, at least one magnetic object 110 can include ferromagnetic or ferrimagnetic materials.

[0032] In some embodiments, at least one magnetic object 110 can include one or more coils, specifically, electromagnetic coils. In this case, the user-carryable device 100 can be electrically active and / or electronically active.

[0033] In some embodiments, the user-carryable device 100 can include an RFID tag, such as an RFID transponder (RFID: Radio Frequency Identification). The system 10 can accordingly include an RFID reader, such as an RFID transmitter-receiver unit, which is configured to detect the RFID tag. The combination of the RFID tag and the RFID reader can be represented as an RFID system.

[0034] The method 600 can further include defining a user-carryable device coordinate system (see, for example Figures 3 to 7 ). The device coordinate system can include a first device axis x d , a second device axis y d that is orthogonal to the first device axis x d , and a vertical device axis z d . The vertical device axis z dIt can be orthogonal to the device contact surface or point 130 and / or orthogonal to the plane defined by the first device axis x d and the second device axis y d The device contact surface or point 130 can be a part of the user-carried device 100 that can contact the interaction surface 210 during user operation. In examples such as Figure 3 or Figure 4 In the example shown, the user-carried device 100 can include a contact surface 130 that contacts the interaction surface 210. In other examples, the user-carried device 100 can include a contact point 130 (e.g., a stylus or other writing device including a writing tip that contacts the interaction surface 210 during a writing operation as shown in Figure 6 ). In some embodiments, the device coordinate system can be defined within the geometric center of the user-carried device 100 (see, for example Figure 3 ). Alternatively, for a Cartesian device coordinate system, the device coordinate system can be described as a cylindrical coordinate system or a spherical coordinate system.

[0035] Figure 2 A computer-implemented method 600 is shown more schematically in detail. Determining 620 the user-carried device position can include determining 621, 624 the magnetic object positions of at least one magnetic object 110 indicating the user-carried device position. Specifically, determining 620 the user-carried device position can include determining 621, 624 the positioning vectors indicating the magnetic object positions and / or determining 621, 624 the magnetic moment vectors 120 indicating the magnetic object orientations of at least one magnetic object 110. Since the magnetic object 110 is coupled to the user-carried device 100, the position of the magnetic object 110 can indicate the position of the user-carried device 100.

[0036] The user-carried device position can indicate the absolute user-carried device position relative to the magnetometer plane 310 (especially the reference coordinate system XYZ), and / or the relative user-carried device position relative to the interaction surface 210. Determining 620 the user-carried device position indicating the absolute user-carried device position can include determining 621 the absolute magnetic object position. The absolute magnetic object position can indicate the absolute magnetic object positioning and / or absolute magnetic object orientation of at least one magnetic object 110 relative to the reference coordinate system XYZ. Specifically, the absolute magnetic object position can be determined based on the obtained magnetic field measurement results. Thus, the absolute positioning and / or absolute orientation of at least one magnetic object 110 in the reference coordinate system XYZ can be determined.

[0037] In an embodiment, determining 621 the absolute magnetic object position can include generating 622 magnetic field measurement result data based on the obtained magnetic field measurement results (see Figure 2)). The magnetic field measurement result data can indicate the magnetic field positioning, magnetic field orientation, and / or magnetic field strength of the magnetic object 110 relative to the reference coordinate system XYZ. Determining the absolute magnetic object position 621 can also include processing 623 the magnetic field measurement result data to correlate the magnetic field measurement result data with the absolute magnetic object position. For example, filters and / or estimation algorithms can be used to evaluate the absolute magnetic object position associated with the magnetic field measurement result data.

[0038] The absolute magnetic object position can include a magnetic moment vector 120 and / or an absolute positioning vector associated with at least one magnetic object 110. The magnetic moment vector 120 can indicate the magnetic object orientation. The absolute positioning vector can indicate the positioning of the magnetic object relative to the reference coordinate system XYZ. In an embodiment, the absolute magnetic object orientation can be defined by a first set of magnetic object tilt angles δ1, δ2, δ3 measured between the magnetometer plane 310 and the magnetic moment vector 120. The first set of magnetic object orientation angles δ1, δ2, δ3 can be measured relative to the reference coordinate axes X, Y, Z, more specifically between the magnetic moment vector 120 and the respective axes X, Y, Z of the reference coordinate system XYZ. For example, as Figures 4 to 7 shown, the first magnetic object orientation angle δ1 can be defined between the first reference axis X and the magnetic moment vector 120, more specifically in the XZ plane. In an embodiment, two angles relative to the magnetometer plane 310 can be sufficient to define the absolute magnetic object orientation of the magnetic object 110. Specifically, when using the magnetic dipole model, two angles relative to the magnetometer plane 310 can be sufficient to define the absolute magnetic object orientation of the magnetic object 110. More specifically, when the magnetic object 110 is symmetric along the magnetization axis (i.e., rotationally symmetric magnetization), two angles relative to the magnetometer plane 310 can be sufficient to define the absolute magnetic object orientation of the magnetic object 110. In some embodiments, the absolute positioning vector can be defined by a first set of Cartesian coordinates defined within the reference coordinate system XYZ. The magnetic moment vector 120 and / or the absolute positioning vector can be determined based on the implementation of a mathematical model that correlates each measurement of the magnetometers in the plurality of magnetometers 300 with the position of at least one magnetic object 110 in the reference coordinate system XYZ. The model can typically be constructed from the physical equations of electromagnetics, more specifically from the equations of magnetostatics. To establish the model, at least one magnetic object 110 can be approximated by a magnetic dipole. Each magnetometer in the plurality of magnetometers 300 can be a vector magnetometer and can be configured to measure the magnetic field in one, two, or three dimensions.

[0039] Referring again to Figure 2, determining the user-carrying device position indicating the position relative to the user-carrying device 620 may include determining the position relative to the magnetic object 624. The position relative to the magnetic object may indicate the positioning relative to the magnetic object and / or the orientation relative to the magnetic object. The positioning relative to the magnetic object may be the positioning of at least one magnetic object 110 relative to the interaction surface 210, more specifically relative to the interaction surface coordinate system x s , y s , z s . The orientation relative to the magnetic object may be the orientation of at least one magnetic object 110 relative to the interaction surface 210, more specifically relative to the interaction surface coordinate system x s y s z s . The position relative to the magnetic object may include the magnetic moment vector 120 associated with at least one magnetic object 110 and / or the relative positioning vectors Δx s , Δy s , Δz s . The magnetic moment vector 120 may indicate the orientation relative to the magnetic object and / or the relative positioning vectors Δx s , Δy s , Δz s indicate the relative positioning of the magnetic object relative to the interaction surface coordinate system x s , y s , z s . In an embodiment, the relative positioning vector may be understood as the vector from the origin of the surface coordinate system x s y s z s to the centroid or dipole center of the magnetic object 110. In an embodiment, the orientation relative to the magnetic object may be defined by a second set of magnetic object tilt angles γ1, γ2, γ3 determined between the interaction surface 210 and the magnetic moment vector 120. In other words, the orientation relative to the magnetic object may be defined by a set of magnetic object tilt angles γ1, γ2, γ3 relative to the interaction surface coordinate axes x s , y s , z s . Specifically, the first magnetic object tilt angle γ1 may be determined between the first interaction surface axis x s and the magnetic moment vector 120. The second magnetic object tilt angle γ2 may be determined between the second interaction surface axis y s and the magnetic moment vector 120. The vertical magnetic object tilt angle γ3 may be determined between the vertical interaction surface axis z s and the magnetic moment vector 120. For example, as shown in Figures 4 to 7 , the vertical magnetic object tilt angle γ3 may be defined between the vertical interaction surface axis z s and the magnetic moment vector 120. Specifically, the vertical magnetic object tilt angle γ3 may be defined between the magnetic moment vector 120 and the vertical interaction surface axis zs (or an axis parallel thereto), such that the vertical magnetic object tilt angle γ3 can be only in the range between 0° and 90° (see, for example, Figures 4 to 7 ). In an embodiment, two angles relative to the magnetometer plane 310 may be sufficient to define the absolute magnetic object orientation of the magnetic object 110.

[0040] In an embodiment, determining the relative magnetic object position 624 may be based on the absolute magnetic object position and a first set of geometric parameters. Specifically, based on the knowledge of the absolute position of at least one magnetic object 110 determined and the arrangement of the interaction surface 210 relative to the reference coordinate system XYZ, the relative magnetic object position can be determined. In an embodiment, the first set of geometric parameters includes predefined transformation parameters indicating the transformation from the reference coordinate system XYZ to the interaction surface coordinate system x s y s z s . In other words and as described above, the first set of geometric parameters includes the predefined geometric parameters for transforming the reference coordinate system XYZ to the interaction surface coordinate system x s y s z s . Additionally, in the described embodiments, the first set of geometric parameters may transform the absolute magnetic object position into the relative magnetic object position. Specifically, the absolute magnetic object positioning and / or the absolute magnetic object orientation may be transformed into the relative magnetic object positioning and / or the relative magnetic object orientation.

[0041] As described above, the method 600 includes obtaining 630 user carried device mode data indicating a predefined operating range of one or more user carried device modes. Specifically, the user carried device mode data may include a plurality of predefined operating ranges of one or more user carried device modes. In an embodiment, the user carried device mode data may be obtained from a database and / or from user input. Each predefined operating range may be associated with one user carried device mode among one or more user carried device modes. Specifically, each predefined operating range among the plurality of predefined operating ranges may be associated with only one user carried device mode or a specific user carried device mode among one or more user carried device modes.

[0042] In an embodiment, the predefined operating range may define a predefined range of the user carried device position associated with one user carried device mode among one or more user carried device modes. In a particular embodiment, the predefined operating range may define one or more specific predefined user carried device positions associated with one user carried device mode among one or more user carried device modes. For example, the predefined operating range may define a typical user carried device position associated with one user carried device mode among one or more user carried device modes.

[0043] In an embodiment, a predetermined range of the user-carried device position may include a predetermined range of the absolute user-carried device position and / or a predetermined range of the relative user-carried device position. In an embodiment, a predetermined operating range may include a predetermined orientation interval indicating the orientation of a magnetic object and / or a predetermined positioning interval indicating the positioning of a magnetic object. In some embodiments, the shape of the user-carried device 100 may drive the definition of the predetermined operating range.

[0044] In an embodiment, the predetermined orientation interval may include an interval of at least one magnetic object tilt angle among a first set of magnetic object tilt angles δ1, δ2, δ3. In an embodiment, the predetermined orientation interval may include an interval of at least one magnetic object tilt angle among a second set of magnetic object tilt angles γ1, γ2, γ3.

[0045] In an embodiment, the predetermined positioning interval may include an interval of an operating distance Δz defined by the z-component of a positioning vector. In an embodiment, the predetermined positioning interval may include an interval of an operating area ΔxΔy defined by the x-component and / or y-component of a positioning vector. Specifically, the operating distance Δz may be defined by the z-component of an absolute positioning vector and / or by the z-component of a relative positioning vector. In an embodiment, the predetermined positioning interval may include one or more of an operating area and / or an operating distance. The operating area may be relative to the x s , y s , z s coordinate system of an interaction surface and / or an x-y area relative to a reference coordinate system XYZ. In an embodiment, the predetermined positioning interval may include an interval of one or more components of a positioning vector (more specifically, an absolute positioning vector or a relative positioning vector).

[0046] In some embodiments, the predetermined operating range may include RFID data associated with a user-carried device mode.

[0047] In an embodiment, the predetermined operating ranges may be mutually exclusive.

[0048] Hereinafter, some examples of the predetermined operating range and the user-carried device mode are described. In an embodiment, the user-carried device mode data may include a first predetermined operating range associated with a first user-carried device mode (see Figure 4 ). The user-carried device mode data may include a second predetermined operating range associated with a second user-carried device mode (see Figure 5 ). The user-carried device mode data may include a third predetermined operating range associated with a third user-carried device mode (see Figure 6) Additionally, the user-carrying device mode data may include a fourth predetermined operating range associated with a fourth user-carrying device mode (see Figure 7 ).

[0049] The first predetermined operating range may include a predetermined orientation interval restricted to the orientation of a magnetic object, where the magnetic moment vector 120 is directed away from the interaction surface 210. Additionally, the magnetic moment vector 120 may be oriented within a first angular interval γ of the vertical magnetic object tilt angle γ3 3,1，min to γ 3,1，max . As described above, the vertical magnetic object tilt angle γ3 is defined relative to the vertical interaction surface axis z s orthogonal to the interaction surface 210. As further outlined above, the vertical magnetic object tilt angle γ3 is defined such that it can be in the range between 0° and 90°. In an embodiment, the first angular interval may be restricted to γ s ≤ 75° relative to the vertical interaction surface axis z 3,1，max . In an embodiment, the first angular interval may be restricted to γ 3,1，max ≤ 60°. In an embodiment, the first angular interval may be restricted to γ 3,1，max ≤ 45°. In an embodiment, γ 3,1，min may be 0°. Exemplarily, this first user-carrying device mode may be related to the user-carrying device type of a computer mouse (see Figure 4 ).

[0050] The second predetermined operating range includes a predetermined orientation interval restricted to the orientation of a magnetic object, where the magnetic moment vector 120 is oriented within a second angular interval γ of the vertical magnetic object tilt angle γ3 3,2，min to γ 3,2，max . As described above, the vertical magnetic object tilt angle γ3 is defined relative to the vertical interaction surface axis z s orthogonal to the interaction surface 210. As further outlined above, the vertical magnetic object tilt angle γ3 is defined such that it can be in the range between 0° and 90°. In an embodiment, the lower end of the second angular interval may be γ 3,2,min > γ 3,1,max . In an embodiment, the second angular interval may be restricted to γ s > 80° relative to the vertical interaction surface axis z 3,2,min . In an embodiment of the predetermined orientation interval of the second predetermined operating range, the magnetic moment vector 120 may be directed away from or towards the interaction surface 210. Exemplarily, this second user-carrying device mode may be related to the user-carrying device type of a dial (see Figure 5 ).

[0051] The third predefined operating range includes a predefined orientation interval that is restricted to the orientation of the magnetic object, in which the magnetic moment vector 120 is directed towards the interaction surface 210. Additionally, the magnetic moment vector 120 is oriented within a third angular interval γ of the vertical magnetic object tilt angle γ3. 3,3，min to γ 3,3，max within which it is oriented. As described above, the vertical magnetic object tilt angle γ3 is defined with respect to the vertical interaction surface axis z that is orthogonal to the interaction surface 210. s As further outlined above, the vertical magnetic object tilt angle γ3 is defined such that it can range between 0° and 90°. In an embodiment, the upper end of the third angular interval can be γ 3,3,max < γ 3,2,min . In an embodiment, the third angular interval can be restricted with respect to the vertical interaction surface axis z s to γ 3,3，max ≤ 75°. Exemplarily, this third user-carried device mode can be related to the type of user-carried device of the stylus (see Figure 6 ).

[0052] In an embodiment, in addition to or alternatively to one or more of the requirements of the predefined orientation interval described above, one or more of the first predefined operating range, the second predefined operating range, and the third predefined operating range can include one or more predefined position intervals. For example, the first predefined operating range and / or the second predefined operating range can include a predefined position interval that is restricted to the positioning of the magnetic object, in which the operating distance Δz ≤ 2 cm (see, for example, Figure 3 and Figure 4 ). For example, the third predefined operating range can include a predefined position interval that is restricted to the positioning of the magnetic object, in which the operating distance Δz ≥ 3 cm. In some embodiments, a fourth predefined operating range can be defined. The fourth predefined operating range can have the same predefined angular interval as the first predefined operating range. Additionally, the fourth predefined operating range can include a predefined position interval that is restricted to the positioning of the magnetic object, in which the operating distance Δz ≥ 3 cm. Exemplarily, this fourth user-carried device mode can be related to the type of user-carried device of the stylus (see Figure 7 ). Additionally, by differentiating the general direction of the magnetic moment vector 120, such as towards the interaction surface 210 or away from the interaction surface 210, the third user-carried device mode and the fourth user-carried device mode can be differentiated. For example, the third user-carried device mode can also include a first user-carried device function, such as writing. For example, the fourth user-carried device mode can also include a second user-carried device function, such as erasing.

[0053] In some embodiments, one or more of the above-described predetermined operating ranges may additionally or alternatively include a predetermined positioning interval that includes an interval of the operating area ΔxΔy defined by the x-component and / or y-component of the positioning vector.

[0054] Illustratively explained using the above example configuration, the computer-implemented method 600 and associated system 10 disclosed herein may automatically identify the type of user-carried device and / or the function of the user-carried device based on one or more of a predetermined angular interval, a predetermined positioning interval (specifically, a predetermined interval of the operating area ΔxΔy defined by the x-component and / or y-component of the positioning vector, specifically, a predetermined interval of the operating distance Δz defined by the z-component of the positioning vector), or a combination thereof.

[0055] Referring again to Figure 2 , determining 640 the user-carried device mode may include comparing 641 the obtained user-carried device mode data with the determined user-carried device location. Specifically, comparing 641 the obtained user-carried device mode data with the determined user-carried device location may include comparing the determined user-carried device location with a plurality of predetermined operating ranges. In an embodiment, determining 640 the user-carried device mode may further include selecting 642 the user-carried device mode based on the comparison. In an embodiment, selecting 642 the user-carried device mode may include excluding the compared user-carried device mode when the determined user-carried device location does not satisfy the predetermined operating range of the compared user-carried device mode. In an embodiment, selecting 642 the user-carried device mode may include selecting the compared user-carried device mode when the determined user-carried device location satisfies the predetermined operating range of the compared user-carried device mode. In an embodiment, selecting 642 the user-carried device mode may include: when the predetermined operating range of the compared user-carried device mode is closest to the determined user-carried device location, selecting the compared user-carried device mode. For example, a typical value (rather than an interval) may be included in the predetermined operating range. The distance between the magnetic object location and the one typical value may be calculated. Then, the selection of the user-carried device mode is made by selecting the lowest distance (e.g., difference, specifically, orientation difference and / or positioning difference) to the associated predetermined operating range.

[0056] In an embodiment, determining the user-carried device location 620 based on the collected magnetic field measurements is performed over a time period. Specifically, obtaining the magnetic field measurements 610 can be performed over the time period. The time period can include a plurality of time samples at which the magnetic field measurements are obtained and at which the corresponding user-carried device location, more specifically the corresponding magnetic object location, is determined. Thereby, the movement of the user-carried device 100, more specifically the movement of at least one magnetic object 110, can be tracked. In an embodiment, the time period can start when the user-carried device 100 (specifically the magnetic object 110 associated therewith) is detected within the sensing volume M. In an embodiment including an RFID system, the time period can start when the user-carried device 100 including the magnetic object 110 is detected in the vicinity of the RFID reader. The term "in the vicinity" can be understood as the distance from the RFID reader within which the RFID reader is able to detect the RFID tag. Using the RFID system in combination with the magnetic object 110 can result in a reduction in power consumption. In an embodiment, the RFID system, particularly the RFID reader, can be active only when the user-carried device 100 is in the vicinity of the RFID reader. In an embodiment, the time period can end when the user-carried device 100 (particularly the magnetic object 110 associated therewith) is no longer detected within the sensing volume M.

[0057] In an embodiment, determining the user-carried device mode 640 can be performed during the time period. Specifically, determining the user-carried device mode 640 can include storing 643 the determined user-carried device mode in a memory (see, for example Figure 2 ). The time period can include a pattern recognition time phase. In an embodiment, the user-carried device mode can be determined and stored during the pattern recognition time phase. Specifically, the user-carried device mode can be determined and stored only during the pattern recognition time phase. In an embodiment, the pattern recognition time phase can start at the same moment as the time period. In an embodiment, the pattern recognition time phase can start after a predetermined start trigger of the user-carried device location is determined. The start trigger of the user-carried device location can be understood as the user-carried device location that triggers the start of the pattern recognition time phase. For example, the start trigger of the user-carried device location can include a predetermined distance from the interaction surface 210, particularly the distance along the vertical surface axis z s . In an embodiment, the pattern recognition time phase can start after a predetermined time interval has elapsed after the start of the time period.

[0058] In an embodiment, the end of the pattern recognition time phase can be triggered by one or more of the following: after a predetermined time interval has elapsed, after determining the user-carried device mode, after storing the determined user-carried device mode in a memory, after determining that a distance (specifically, one or more components of a positioning vector) exceeds a predetermined threshold, and / or after the time period has elapsed. In an embodiment, when the pattern recognition time phase ends, determining the user-carried device mode of 640 stops. The pattern recognition time phase enables clear differentiation of different user-carried device modes and, once different user-carried device modes are determined, enables a greater range of operation of the user-carried device.

[0059] Referring again to Figure 1 and Figure 2 , the computer-implemented method 600 may further include representing 650 the user-carried device 100 on the output device 500. The method 600 may further include controlling 660 the representation of the user-carried device 100 according to the determined user-carried device mode. In an embodiment, the output device 500 may include one or more of a display, a screen, a light, a portable peripheral device, a laptop computer, a smart phone, a tablet computer, or a control panel. For example, a control panel may be provided where different peripheral devices, such as doors, lights, a heating system, and / or shutters, can be controlled depending on the determined user-carried device mode.

[0060] It should be noted that the computer-implemented method 600 and the associated system 10 can be configured to simultaneously determine the user-carried device location and / or track the manipulation of more than one user-carried device 100. The computer-implemented method 600 and the associated system 10 can also be configured to determine the user-carried device mode for each user-carried device of more than one user-carried device 100.

[0061] In an embodiment, the system 10 may include a processing unit 400 or may be capable of connecting to an external processing unit. The processing unit 400 may be configured to execute the computer-implemented method 600 as described herein. In an embodiment, the system 10 may include an electronic device. In an embodiment, the processing unit 400 may be integrated in the electronic device. In an embodiment, the output device 500 may be integrated in the electronic device. In an embodiment, the electronic device may be a tablet computer, a cellular phone, a laptop computer, a computer, a virtual reality (VR) kit, or a television.

[0062] In an embodiment, the electronic device can be a VR kit, more specifically an XR headset, which can be a device worn on a user's head and configured to allow the user to experience a virtual environment (virtual reality environment or VR environment) in real life. In an embodiment, the user-carrying device 100 can be reproduced as a virtual object in the virtual environment. In an embodiment, the user-carrying device 100 can be displayed or reproduced as a virtual object in the VR environment, thereby allowing the user U to identify where the user-carrying device is located. A plurality of magnetometers 300 can be provided to create a sensing volume in which the user-carrying device 100 operates. The user-carrying device position can indicate the orientation and / or positioning of the user-carrying device 100 relative to a reference coordinate system XYZ (more specifically, relative to the plurality of magnetometers 300). The reference coordinate system XYZ can be fixed in the VR environment. The positioning and / or orientation of the user-carrying device 100 can be calculated relative to the VR kit (more specifically relative to the XR headset) and can be calculated and, in particular, displayed to the user via the XR headset. In an embodiment, the reference coordinate system XYZ can be dynamically evaluated based on the tracking of the environment by the XR headset. Specifically, the interaction surface 210 and / or the interaction surface coordinate system can be dynamically evaluated based on the tracking of the environment by the XR headset. In an embodiment, an additional tracking system, such as IR tracking, electromagnetic tracking, or camera-based tracking, can also be provided that is fixed to the plurality of magnetometers 300. Scroll events and / or click events can generally be represented as trigger events, and the actions caused can also be represented in the VR environment and, more specifically, can be displayed to the user U via a display arranged in the XR headset. The representation in the VR environment can be accomplished by changing the rendering parameters (such as color or light) of the user-carrying device 100 and / or adding specific sounds. In some embodiments, the interaction surface 210 can be modeled in the VR environment, displayed to the user via the XR headset, and / or used as an input representing the interaction between the user-carrying device 100 and the interaction surface 210 within the VR environment (e.g., representing the user-carrying device 100 operating on the interaction surface 210 within the VR environment). Specifically, the control of the user-carrying device 100 can be calculated and / or displayed to the user via the XR headset based on the determined user-carrying device mode. In some embodiments, one or more output devices 500 can be represented as virtual displays or screens in the VR environment. In an embodiment, the XR headset can be configured to evaluate the shape of the user-carrying device 100 by combining data on the user-carrying device position and camera input tracked by the camera to dynamically create the shape of the user-carrying device 100. Based on a comparison of the created shape with a predefined shape of the user-carrying device 100, the user-carrying device type and mode can be identified or distinguished.

[0063] Refer to Figure 3, showing the arrangement of a plurality of magnetometers relative to an interaction surface 210 defined on an interaction support 200. In Figure 3 the embodiment shown, the plurality of magnetometers 300 may be arranged in rows and columns. However, it is also possible that the plurality of magnetometers may be arranged in a disorderly manner within the magnetometer body. A calibration process may be used to determine the exact position and measurement axes of each magnetometer within the magnetometer body relative to a reference coordinate system XYZ. The plurality of magnetometers 300 are shown in Figure 3 as being arranged in a magnetometer plane 310 (i.e., in the same plane relative to the vertical reference axis Z). However, as outlined above, one or more of the magnetometers may be away from the magnetometer plane 310, more specifically, away in the direction of the vertical reference axis Z.

[0064] The plurality of magnetometers 300 may be electrically (e.g., via wires or a data bus) or wirelessly connected to a processing unit 400, an external processing unit, and / or an electronic device. In an embodiment, the plurality of magnetometers 300 may be integrated in a wall, furniture, a notebook, an electronic device, a screen, a keyboard, and / or a mouse pad. In the case where the plurality of magnetometers 300 are arranged in a wall, the interaction surface 210 may be a screen or a display placed in front of the plurality of magnetometers 300. In an embodiment, the interaction surface 210 may be defined on one or more output devices 500.

[0065] According to one aspect of the present disclosure, a computer system may be configured to execute a computer-implemented method 600 as described herein. According to another aspect of the present disclosure, a computer program may be configured to execute a computer-implemented method 600 as described herein. Additionally, a computer-readable medium or a signal storing the computer program may be provided.

[0066] In an embodiment (not shown in the figures), the user-carryable device 100 may include at least one manipulation feature, and more specifically the at least one manipulation feature is coupled to the housing of the user-carryable device. The at least one manipulation feature may be translatable and / or rotatable relative to the user-carryable device 100, and more specifically relative to the housing. At least one magnetic object 110 may be coupled to the at least one manipulation feature. More specifically, the at least one magnetic object 110 may be operatively (e.g., mechanically) coupled to the at least one manipulation feature 140. Translation and / or rotation of the at least one manipulation feature relative to the housing may cause translation and / or rotation of the at least one magnetic object 110 relative to the housing. The at least one manipulation feature may be actuated by the user. In an initial state of the user-carryable device 100, the at least one manipulation feature and / or the at least one magnetic object 110 may be in an initial position. In an actuated state of the user-carryable device 100, the at least one manipulation feature and / or the at least one magnetic object 110 may be in an actuated position. In other words, in the case where the at least one manipulation feature is not actuated by the user, the user-carryable device may be in an initial state. More specifically, in the initial state, the at least one manipulation feature and / or the at least one magnetic object 110 may be in an initial position. In the case where the at least one manipulation feature is actuated by the user, the user-carryable device 100 may be in an actuated state. More specifically, in the actuated state, the at least one manipulation feature and / or the at least one magnetic object 110 may be in an actuated position. In an embodiment, the user-carryable device 100 may include a biasing element (not shown) configured to push the at least one manipulation feature and / or the at least one magnetic object 110 from the actuated position to the initial position, more specifically when the at least one manipulation feature is not actuated. More specifically, when the user actuates (e.g., applies a force to) the at least one manipulation feature, the at least one manipulation feature and the at least one magnetic object 110 may be moved from the initial position to the actuated position. In this case, the biasing element may be biased. When the user releases the force on the at least one manipulation feature, the at least one manipulation feature and the at least one magnetic object may be pushed from the actuated position to the initial position.

[0067] In an embodiment, the at least one manipulation feature may be associated with at least one trigger event. The system 10 may be configured to determine a corresponding trigger event based on the translation and / or rotation of at least one magnetic object 110 relative to the user-carried device 100. More specifically, it is caused by the translation and / or rotation of at least one manipulation feature operatively coupled to at least one magnetic object 110. More specifically, the system 10 may be configured to determine a positioning and / or rotation deviation between an initial position and an actuated position. In other words, a specific translation and / or rotation of at least one magnetic object 110 relative to the user-carried device 100 may be detected by the system 10. Based on the detected specific translation and / or rotation, the system 10 may be configured to transform the movement into a trigger event associated with the translation and / or rotation. In an example, the system 10 may be coupled to a database. The database may include data associating at least one trigger event with a specific translation and / or rotation of at least one magnetic object 110 from an initial position to an actuated position. The system 10 may be configured to transmit data to and / or receive data from the database. A specific translational movement and / or rotational movement of at least one magnetic object 110 may be associated with a specific trigger event. The corresponding trigger event may be, for example, a click event, a scroll event, and / or a selection event. In the case where multiple magnetic objects are provided, additional trigger events may be determined based on the rotation and / or translation of the magnetic objects relative to each other and may be detected by the system 10. The at least one trigger event may be initiated by a user manipulation of the user-carried device 100 within a sensing volume M. The at least one trigger event may cause an action in a digital environment (i.e., an environment controlled by a computer or a network of computers) (e.g., a virtual environment) based on a user input and / or may be used to control an action. More specifically, the at least one trigger event may implement a user input on the user-carried device as an action in the digital environment. For example, at least one user-carried device 100 may be used with an electronic device (e.g., a tablet, a cellular phone, a laptop computer, a computer, a virtual reality (VR) kit, or a television). The at least one trigger event may cause an action on the electronic device and / or may be used to control an action on the electronic device 700 based on a user input on the user-carried device 100.

[0068] As described above, at least one trigger event can be a scroll event and / or a click event. The scroll event and / or the click event can be applied to various different application fields. The scroll event can trigger a scrolling action in a digital environment (more specifically, a virtual environment) based on user input (e.g., "scroll up" and "scroll down" on a display). The scroll event can cause or provide control over the rotation and / or translational movement of virtual objects in a digital environment (more specifically, the virtual environment associated with the user input). For example, the scroll event can trigger a scrolling action, including scrolling of files or data, rotation or translational movement of virtual objects associated with the selection of an option from multiple options. The scrolling action can also include rotating a body in the virtual environment and / or changing the perspective in the virtual environment. Additionally, the scrolling action can include one or more of the following: moving the cursor in two opposite directions (e.g., horizontally or vertically on an output device), moving the displayed element (e.g., page, cursor) that can be controlled by the user-carrying device 100, stepping in a direction, flipping through a menu, flipping through a selection list, or adjusting (e.g., increasing or decreasing) a parameter (e.g., setting or configuring). The click event can trigger a click action (more specifically, a click action on a virtual object) in a digital environment (more specifically, a virtual environment) based on user input. The click event can include, for example, the selection of an object (such as a button, file, icon, or another object), the selection of an item, the selection of a list, the selection of an item on a list. The click event can trigger the following actions. The click event can trigger an action to provide additional information and / or attributes of the selected object, item, or text (e.g., letter, word, phrase). The click event can trigger a single-click action, a double-click action, a triple-click action, a right-click action, and / or a click-and-drag action within the digital environment (more specifically, the virtual environment). The single-click action can refer to the selection of an object within the virtual environment. The double-click action can open a file or execute a program in the virtual environment. The click-and-drag action can include clicking, holding, and moving an object. For example, it can be used to highlight or drag-select text or an object. The triple-click action can be used to select a paragraph of text. The right-click action can perform a special action, such as opening a list with additional information and / or attributes of the selected object as described above. The actions triggered by the click event depend on the user input on the user-carrying device 100. For example, when the user provides two quick and consecutive inputs on the user-carrying device 100, the click event can cause a double-click action. The above features enable various new application fields for the user-carrying device 100, such as computer mice, keyboards, dials, mouse scroll elements (e.g., scroll wheels), joysticks, controls for electronic devices (e.g., audio controls or visual controls), controls for software settings or visualizations (e.g., graphic software or design software), or controls for computer games.

[0069] Although the present concept has been described above and defined in the appended claims, it should be understood that the present concept may be defined in accordance with the following embodiments:

[0070] 1. A computer-implemented method (600) for controlling the representation of a user-carrying device (100) according to one of one or more user-carrying device modes on an output device (500), wherein the method comprises:

[0071] - Obtaining (610) magnetic field measurement results associated with at least one magnetic object (110) and measured using a plurality of magnetometers (300), wherein the at least one magnetic object (110) is coupled to the user-carrying device (100),

[0072] - Determining (620) the user-carrying device position based on the collected magnetic field measurement results,

[0073] - Obtaining (630) user-carrying device mode data indicating a predetermined operating range of the one or more user-carrying device modes,

[0074] - Determining (640) the user-carrying device mode based on the user-carrying device position and based on the user-carrying device mode data.

[0075] 2. The computer-implemented method (600) according to embodiment 1, wherein the plurality of magnetometers (300) are configured to create a sensing volume (M), specifically, wherein the user-carrying device (100) can operate within the sensing volume (M).

[0076] 3. The computer-implemented method (600) according to any one of the foregoing embodiments, wherein the user-carrying device (100) can operate on an interaction surface (210), and the method comprises:

[0077] Defining an interaction surface coordinate system (x s y s z s ) relative to the interaction surface (210), the interaction surface coordinate system (x s y s z s ) includes a first interaction surface axis (x s ), a second interaction surface axis (y s ), and a vertical interaction surface axis (z s ), wherein the first interaction surface axis (x s ) and the second interaction surface axis (y s)Orthogonal to each other and defining the interaction surface (210), and wherein the vertical interaction surface axis (z s ) is orthogonal to the first interaction surface axis (x s ) and the second interaction surface axis (y s ).

[0078] 4. The computer-implemented method (600) according to any one of the foregoing embodiments, wherein the plurality of magnetometers (300) are associated with a magnetometer plane (310), and more specifically, wherein the magnetometer plane (310) is defined by a plane extending through most of the plurality of magnetometers (300).

[0079] 5. The computer-implemented method (600) according to embodiment 4, the method comprising:

[0080] Defining a reference coordinate system (XYZ) relative to the plurality of magnetometers (300), the reference coordinate system (XYZ) including a first reference axis (X), a second reference axis (Y), and a vertical reference axis (Z), wherein the first reference axis (X) and the second reference axis (Y) are orthogonal to each other, and wherein the vertical reference axis (Z) is orthogonal to the first reference axis (X) and the second reference axis (Y) and extends through the center of the plurality of magnetometers (300), optionally, wherein the first reference axis (X) and the second reference axis (Y) are defined on the magnetometer plane (310), and wherein the vertical reference axis (Z) is orthogonal to the magnetometer plane (310).

[0081] 6. The computer-implemented method (600) according to any one of the foregoing embodiments, wherein the user-carrying device (100) includes a device coordinate system, and more specifically wherein the device coordinate system includes a first device axis (x d ), a second device axis (y d ) orthogonal to the first device axis (x d ), and a vertical device axis (z d ), and more specifically wherein the vertical device axis (z d ) is orthogonal to the device contact surface or point (130) and / or orthogonal to the plane defined by the first device axis (x d ) and the second device axis (y d ).

[0082] 7. The computer-implemented method (600) according to any one of the foregoing embodiments, wherein the collected magnetic field measurements indicate a magnetic field associated with the at least one magnetic object (110).

[0083] 8. The computer-implemented method (600) according to any one of the foregoing embodiments, wherein determining (620) the user-carried device position comprises:

[0084] Determining (621, 624) the magnetic object position of the at least one magnetic object (110), the magnetic object position indicating the user-carried device position, specifically, determining (621, 624) the positioning vector indicating the magnetic object positioning and / or determining (621, 624) the magnetic moment vector (120) indicating the magnetic object orientation of the at least one magnetic object (110).

[0085] 9. The computer-implemented method (600) according to any one of the foregoing embodiments, wherein the user-carried device position indicates an absolute user-carried device position relative to the magnetometer plane (310) and / or a relative user-carried device position relative to the interaction surface (210).

[0086] 10. The computer-implemented method (600) according to embodiment 9, wherein determining (620) the user-carried device position indicating the absolute user-carried device position comprises:

[0087] Determining (621) the absolute magnetic object position, the absolute object position indicating the absolute magnetic object positioning and / or absolute magnetic object orientation of the at least one magnetic object (110) relative to the reference coordinate system (XYZ), more specifically, wherein the absolute magnetic object position is determined based on the obtained magnetic field measurement results.

[0088] 11. The computer-implemented method (600) according to embodiment 10, wherein determining (621) the absolute magnetic object position comprises:

[0089] Generating (622) magnetic field measurement result data based on the obtained magnetic field measurement results, wherein the magnetic field measurement result data indicates the magnetic field positioning, magnetic field orientation, and / or magnetic field strength relative to the reference coordinate system (XYZ).

[0090] 12. The computer-implemented method (600) according to embodiment 11, wherein determining (621) the absolute magnetic object position comprises:

[0091] Processing (623) the magnetic field measurement result data to correlate the magnetic field measurement result data with the absolute magnetic object position.

[0092] 13. The computer-implemented method (600) according to any one of embodiments 10 to 12, wherein the absolute magnetic object position includes a magnetic moment vector (120) associated with the at least one magnetic object (110) and / or an absolute positioning vector, where

[0093] the magnetic moment vector (120) indicates the magnetic object orientation and / or where the absolute positioning vector indicates the magnetic object positioning relative to the reference coordinate system (XYZ).

[0094] 14. The computer-implemented method (600) according to embodiment 13, wherein the absolute magnetic object orientation is defined by a first set of magnetic object tilt angles (δ1, δ2, δ3) measured between the magnetometer plane (310) and the magnetic moment vector (120).

[0095] 15. The computer-implemented method (600) according to any one of embodiments 9 to 14, wherein determining (620) the user-carried device position indicating the relative user-carried device position includes:

[0096] determining (624) the relative magnetic object position, the relative magnetic object position indicating the relative magnetic object positioning relative to the interaction surface (210) and / or the relative magnetic object orientation of the at least one magnetic object (110) relative to the interaction surface (210), more specifically relative to the interaction surface coordinate system (x s y s z s ).

[0097] 16. The computer-implemented method (600) according to embodiment 15, wherein the relative magnetic object position includes a magnetic moment vector (120) associated with the at least one magnetic object (110) and / or a relative positioning vector, where the magnetic moment vector (120) indicates the relative magnetic object orientation and / or where the relative positioning vector (Δx s , Δy s , Δz s ) indicates the relative magnetic object positioning relative to the interaction surface coordinate system (x s y s z s ).

[0098] 17. The computer-implemented method (600) according to any one of embodiments 15 or 16, wherein the relative magnetic object orientation is defined by a second set of magnetic object tilt angles (γ1, γ2, γ3) determined between the interaction surface (210) and the magnetic moment vector (120).

[0099] 18. The computer-implemented method (600) according to any one of embodiments 15 to 17, wherein determining (624) the relative magnetic object position is based on the absolute magnetic object position and a first set of geometric parameters.

[0100] 19. The computer-implemented method (600) according to embodiment 18, wherein the first set of geometric parameters includes predefined transformation parameters indicating the transformation of the reference coordinate system (XYZ) to the interaction surface coordinate system (x s y s z s ).

[0101] 20. The computer-implemented method (600) according to any one of the foregoing embodiments, wherein the user-carried device mode data includes a plurality of predefined operating ranges of the one or more user-carried device modes.

[0102] 21. The computer-implemented method (600) according to embodiment 20, wherein each predefined operating range is associated with one of the user-carried device modes of the one or more user-carried device modes.

[0103] 22. The computer-implemented method (600) according to any one of embodiments 20 or 21, wherein the predefined operating range defines a predefined range of the user-carried device position associated with one of the user-carried device modes of the one or more user-carried device modes.

[0104] 23. The computer-implemented method (600) according to embodiment 22, wherein the predefined range of the user-carried device position includes a predefined range of the absolute user-carried device position and / or a predefined range of the relative user-carried device position.

[0105] 24. The computer-implemented method (600) according to any one of embodiments 20 to 23, wherein the predefined operating range includes a predefined orientation interval indicating the orientation of the magnetic object and / or a predefined positioning interval indicating the positioning of the magnetic object.

[0106] 25. The computer-implemented method (600) according to embodiment 24, if at least subordinate to embodiment 8, wherein the predefined orientation interval includes an interval of at least one magnetic object tilt angle of the first set of magnetic object tilt angles (δ1, δ2, δ3) and / or the second set of magnetic object tilt angles (γ1, γ2, γ3).

[0107] 26. The computer-implemented method (600) according to any one of embodiments 24 or 25, if at least subordinate to embodiment 8, wherein the predetermined positioning interval includes an interval of an operating distance (Δz) defined by the z-component of the positioning vector and / or an interval of an operating area (ΔxΔy) defined by the x-component and / or y-component of the positioning vector.

[0108] 27. The computer-implemented method (600) according to any one of embodiments 20 to 26, wherein the predetermined operating ranges are mutually exclusive.

[0109] 28. The computer-implemented method (600) according to any one of embodiments 20 to 27, wherein the user-carried device mode data includes a first predetermined operating range associated with a first user-carried device mode, a second predetermined operating range associated with a second user-carried device mode, and a third predetermined operating range associated with a third user-carried device mode.

[0110] 29. The computer-implemented method (600) according to embodiment 28, if at least subordinate to embodiment 3, wherein the first predetermined operating range includes a predetermined orientation interval restricted to the orientation of a magnetic object:

[0111] wherein the magnetic moment vector (120) is directed away from the interaction surface (210), and

[0112] wherein the magnetic moment vector (120) is relative to the vertical interaction axis (z

[0113] orthogonal to the interaction surface (210) s ) and is oriented within a first angular interval (γ 3,1，min to γ 3,1，max ) of the vertical magnetic object tilt angle γ3.

[0114] 30. The computer-implemented method (600) according to embodiment 29, wherein the first angular interval is restricted to γ s relative to the vertical interaction surface axis z 3,1,max ≤ 75°.

[0115] 31. The computer-implemented method (600) according to any one of embodiments 28 to 30, if at least subordinate to embodiment 3, wherein the second predetermined operating range includes a predetermined orientation interval restricted to the orientation of a magnetic object:

[0116] wherein the magnetic moment vector (120) is relative to the vertical interaction axis (z s), within a second angular interval (γ of the vertical magnetic object tilt angle γ3 3,2，min to γ 3,2，max ).

[0117] 32. The computer-implemented method (600) according to embodiment 31, if at least subordinate to any one of embodiments 29 or 30, wherein γ 3,2，min > γ 3,1，max .

[0118] 33. The computer-implemented method (600) according to any one of embodiments 31 or 32, wherein the second angular interval is limited to γ with respect to the vertical interaction surface axis (z s )> 80°. 3,2，min > 80°.

[0119] 34. The computer-implemented method (600) according to any one of embodiments 28 to 33, if at least subordinate to embodiment 3, wherein the third predetermined operating range includes a predetermined orientation interval restricted to the orientation of the magnetic object:

[0120] wherein the magnetic moment vector (120) is directed towards the interaction surface (210), and

[0121] wherein the magnetic moment vector (120) is relative to the interaction surface (210)

[0122] orthogonal vertical interaction axis (z s ), within a third angular interval (γ of the vertical magnetic object tilt angle γ3 3,3，min to γ 3,3，max ).

[0123] 35. The computer-implemented method (600) according to embodiment 34, if at least subordinate to any one of embodiments 31 or 33, wherein γ 3,2，min > γ 3,3，max .

[0124] 36. The computer-implemented method (600) according to any one of embodiments 34 or 35, wherein the third angular interval is limited to γ ≤ 75° with respect to the vertical interaction surface axis (z s ) orthogonal to the interaction surface (210). 3,3，max ≤ 75°.

[0125] 37. The computer-implemented method (600) according to any one of the foregoing embodiments, wherein the user-carrying device mode indicates a specific user-carrying device type and / or a specific user-carrying device function.

[0126] 38. The computer-implemented method (600) according to embodiment 37, wherein the specific user-carrying device type indicates one of a computer mouse, a keyboard, a toy, a stylus, or a dial, a brush, a finger ring.

[0127] 39. The computer-implemented method (600) according to any one of embodiments 37 or 38, wherein the specific user-carrying device function indicates a default function or one or more adapted functions.

[0128] 40. The computer-implemented method (600) according to any one of the foregoing embodiments, wherein determining (640) the user-carrying device mode includes:

[0129] comparing (641) the obtained user-carrying device mode data with the determined user-carrying device location, and

[0130] selecting (642) the user-carrying device mode based on the comparison.

[0131] 41. The computer-implemented method (600) according to embodiment 40, if at least subordinate to embodiment 20, wherein comparing (641) the obtained user-carrying device mode data with the determined user-carrying device location includes:

[0132] comparing the determined user-carrying device location with the plurality of predetermined operating ranges.

[0133] 42. The computer-implemented method (600) according to any one of embodiments 40 or 41, if at least subordinate to embodiment 20, wherein selecting (642) the user-carrying device mode based on the comparison includes:

[0134] when the determined user-carrying device location does not satisfy the predetermined operating range of the compared user-carrying device mode, excluding the compared user-carrying device mode, and / or

[0135] when the determined user-carrying device location satisfies the predetermined operating range of the compared user-carrying device mode, selecting the compared user-carrying device mode.

[0136] 43. The computer-implemented method (600) according to any one of the foregoing embodiments, wherein determining (620) the user-carrying device location based on the collected magnetic field measurement results is performed over a period of time.

[0137] 44. The computer-implemented method (600) according to embodiment 43, wherein determining (640) the user-carried device mode is performed during the time period, and wherein determining (640) the user-carried device mode includes:

[0138] Storing (643) the determined user-carried device mode on a memory.

[0139] 45. The computer-implemented method (600) according to embodiment 44, wherein the time period includes a pattern recognition time phase during which the user-carried device mode is determined and stored.

[0140] 46. The computer-implemented method (600) according to embodiment 45, wherein the pattern recognition time phase starts at the same moment as the time period, or wherein the pattern recognition time phase starts after determining a predetermined start to trigger the user-carried device location.

[0141] 47. The computer-implemented method (600) according to any one of embodiments 45 or 46, wherein the end of the pattern recognition time phase is triggered by one or more of the following:

[0142] After a predetermined time interval has elapsed,

[0143] After determining the user-carried device mode,

[0144] After storing the determined user-carried device mode on a memory,

[0145] After determining that one or more components of a distance, specifically a positioning vector, exceed a predetermined threshold, and / or

[0146] After the time period has elapsed.

[0147] 48. The computer-implemented method (600) according to any one of embodiments 45 to 47, wherein when the pattern recognition time phase ends, determining (640) the user-carried device mode is stopped.

[0148] 49. The computer-implemented method (600) according to any one of the foregoing embodiments, the method further comprising:

[0149] - Representing (650) the user-carried device (100) on an output device (500), and

[0150] - Controlling (660) the representation of the user-carried device (100) according to the determined user-carried device mode.

[0151] 50. The computer-implemented method (600) according to any one of the foregoing embodiments, wherein the user-carrying device (100) is electrically passive and / or electronically passive.

[0152] 51. The computer-implemented method (600) according to any one of the foregoing embodiments, wherein the at least one magnetic object (110) is a permanent magnet.

[0153] 52. The computer-implemented method (600) according to any one of the foregoing embodiments, wherein the output device (500) comprises one or more of a display, a screen, a light, a portable peripheral device, a laptop computer, a smart phone, a tablet computer.

[0154] 53. A computer system configured to execute the computer-implemented method (600) according to any one of the foregoing embodiments.

[0155] 54. A computer program configured to execute the computer-implemented method (600) according to any one of embodiments 1 to 52.

[0156] 55. A computer-readable medium or signal storing the computer program of embodiment 54.

[0157] 56. A system (10) for controlling the representation of a user-carrying device (100) according to one of one or more user-carrying device modes on an output device (500), the system comprising:

[0158] A user-carrying device (100) comprising at least one magnetic object (110),

[0159] A plurality of magnetometers (300) configured to perform magnetic field measurement results associated with the at least one magnetic object (110), and

[0160] An output device (500),

[0161] wherein the system (10) is configured to execute the computer-implemented method (600) according to any one of embodiments 1 to 52.

[0162] 57. The system (10) according to embodiment 56, wherein the system (10) comprises a processing unit (400) configured to execute the computer-implemented method (600), or

[0163] Wherein, the system (10) can be connected to an external processing unit configured to execute the computer-implemented method (600).

[0164] 58. The system (10) according to any one of embodiments 56 or 57, wherein the system (10) includes an electronic device.

[0165] 59. The system (10) according to embodiments 57 and 58, wherein the processing unit (400) is integrated in the electronic device.

[0166] 60. The system (10) according to any one of embodiments 58 or 59, wherein the output device (500) is integrated in the electronic device.

[0167] 61. The system (10) according to any one of embodiments 56 to 60, wherein the plurality of magnetometers (300) are integrated in a wall, furniture, a notebook, an electronic device, a screen or display, a keyboard, and / or a mouse pad.

[0168] 62. The system (10) according to any one of embodiments 56 to 61, wherein the user-carrying device (100) is electrically passive and / or electronically passive.

[0169] 63. The system (10) according to any one of embodiments 56 to 62, wherein the system (10) includes an interaction support (200) having an interaction support surface, wherein the interaction surface (210) is at least a partial surface of the interaction support surface.

[0170] 64. The system (10) according to embodiment 63, wherein the interaction support (200) is a wall, furniture, a notebook, an electronic device, a screen or display, a keyboard, and / or a mouse pad.

[0171] 65. The system (10) according to any one of embodiments 63 or 64, wherein the interaction surface (210) is defined based on a first set of geometric parameters associated with the interaction support (200).

Claims

1. A computer-implemented method (600) for controlling a representation of a user-carrying device (100) according to one of one or more user-carrying device modes on an output device (500), wherein, The method includes: - obtaining (610) magnetic field measurement results associated with at least one magnetic object (110) and measured using a plurality of magnetometers (300), wherein the at least one magnetic object (110) is coupled to the user-carrying device (100), - determining (620) the user-carrying device position based on the collected magnetic field measurement results, - obtaining (630) user-carrying device mode data indicating a predetermined operating range of the one or more user-carrying device modes, - determining (640) the user-carrying device mode based on the user-carrying device position and based on the user-carrying device mode data, - representing (650) the user-carrying device (100) on the output device (500), - controlling (660) the representation of the user-carrying device (100) according to the determined user-carrying device mode.

2. The computer-implemented method (600) according to claim 1, wherein, The user-carrying device (100) is operable on an interaction surface (210), and the method includes: Define an interaction surface coordinate system (x s y s z s ) relative to the interaction surface (210), wherein the interaction surface coordinate system (x s y s z s ) includes a first interaction surface axis (x s ), a second interaction surface axis (y s ), and a vertical interaction surface axis (z s ), wherein the first interaction surface axis (x s ) and the second interaction surface axis (y s ) are orthogonal to each other and define the interaction surface (210), and wherein the vertical interaction surface axis (z s ) is orthogonal to the first interaction surface axis (x s ) and the second interaction surface axis (y s ).

3. The computer-implemented method (600) according to any one of the preceding claims, the method including: defining a reference coordinate system (XYZ) with respect to the plurality of magnetometers (300), the reference coordinate system (XYZ) including a first reference axis (X), a second reference axis (Y), and a vertical reference axis (Z), wherein the first reference axis (X) and the second reference axis (Y) are orthogonal to each other, and wherein the vertical reference axis (Z) is orthogonal to the first reference axis (X) and the second reference axis (Y) and extends through the center of the plurality of magnetometers (300). Optionally, wherein the first reference axis (X) and the second reference axis (Y) are defined on a magnetometer plane (310) associated with the plurality of magnetometers (300), wherein the magnetometer plane (310) is defined by a plane extending through most of the plurality of magnetometers (300), and wherein the vertical reference axis (Z) is orthogonal to the magnetometer plane (310).

4. The computer-implemented method (600) according to any one of the preceding claims, wherein, Determining (620) the user-carrying device position includes: determining (621, 624) the magnetic object position of the at least one magnetic object (110), the magnetic object position indicating the user-carrying device position. Specifically, determining (621, 624) a positioning vector indicating the magnetic object positioning and / or determining (621, 624) a magnetic moment vector (120) indicating the magnetic object orientation of the at least one magnetic object (110).

5. The computer-implemented method (600) according to any one of the preceding claims, wherein, The user-carrying device position indicates an absolute user-carrying device position relative to the magnetometer plane (310) and / or a relative user-carrying device position relative to the interaction surface (210).

6. The computer-implemented method (600) according to claim 5, wherein, Determining (620) the user-carrying device position indicating the relative user-carrying device position includes: Determine (624) the relative magnetic object position, which indicates the relative magnetic object positioning with respect to the interaction surface (210) and / or the relative magnetic object orientation of the at least one magnetic object (110) with respect to the interaction surface (210), more specifically with respect to the interaction surface coordinate system (x s y s z s ).

7. The computer-implemented method (600) according to any one of the preceding claims, wherein, The user-carrying device mode data includes a plurality of predetermined operating ranges of the one or more user-carrying device modes.

8. The computer-implemented method (600) according to claim 7, wherein, The predefined operation range defines a predefined range of the user-carrying device position associated with one of the one or more user-carrying device modes. Specifically, the predefined range of the user-carrying device position includes a predefined range of the absolute user-carrying device position relative to the magnetometer plane and / or a predefined range of the relative user-carrying device position relative to the interaction surface.

9. The computer-implemented method (600) according to any one of claims 7 or 8, wherein, The predefined operation range includes a predefined orientation interval indicating the orientation of the magnetic object and / or a predefined positioning interval indicating the positioning of the magnetic object.

10. The computer-implemented method (600) according to claim 9, if at least dependent on claim 4, wherein, The predefined positioning interval includes an interval of the operating distance (Δz) defined by the z-component of the positioning vector and / or an interval of the operating area (ΔxΔy) defined by the x-component and / or y-component of the positioning vector.

11. The computer-implemented method (600) according to any one of the preceding claims, wherein, Determining (640) the user-carrying device mode includes: comparing (641) the obtained user-carrying device mode data with the determined user-carrying device position, and selecting (642) the user-carrying device mode based on the comparison.

12. The computer-implemented method (600) according to claim 11, if at least dependent on claim 7, wherein, Selecting (642) the user-carrying device mode based on the comparison includes: excluding the compared user-carrying device mode when the determined user-carrying device position does not satisfy the predefined operation range of the compared user-carrying device mode, and / or selecting the compared user-carrying device mode when the determined user-carrying device position satisfies the predefined operation range of the compared user-carrying device mode.

13. The computer-implemented method (600) according to any one of the preceding claims, wherein, Determining (620) the user-carrying device position based on the collected magnetic field measurement results is performed over a time period. Specifically, determining (640) the user-carrying device mode is performed within the time period, and determining (640) the user-carrying device mode includes: storing (643) the determined user-carrying device mode in a memory.

14. The computer-implemented method (600) according to claim 13, wherein, The time period includes a mode recognition time phase during which the user-carrying device mode is determined and stored. Optionally, when the mode recognition time phase ends, determining (640) the user-carrying device mode stops.

15. A system (10) for controlling the representation of a user-carrying device (100) according to one of one or more user-carrying device modes on an output device (500), the system comprising: the user-carrying device (100) including at least one magnetic object (110), a plurality of magnetometers (300) configured to perform magnetic field measurement results associated with the at least one magnetic object (110), and an output device (500), wherein the system (10) is configured to perform the computer-implemented method (600) according to any one of claims 1 to 14.

Images