Method and apparatus for object tracking, and device and storage medium

Abstract

Provided in the embodiments of the present disclosure are a method and apparatus for object tracking, and a device and a storage medium. The method comprises: determining an optical configuration associated with an operating mode of a first device, wherein the first device comprises a motion sensor and at least one light-emitting element, and the optical configuration is used for controlling light emission of the at least one light-emitting element; and at least on the basis of the optical configuration, configuring the first device, so as to execute object tracking by means of tracking light emitted by the at least one light-emitting element and / or on the basis of sensing data of the motion sensor. Thus, different configurations can be performed for different operating modes. In this way, different tracking requirements can be met, and a tracking device with good scalability can be implemented.

Description

Method, apparatus, device and storage medium for object tracking

[0001] This application claims priority to the Chinese invention patent application entitled “Methods, devices, equipment and storage media for object tracking” and application number 2023111205911, filed on August 31, 2023, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, apparatuses, devices, and computer-readable storage media for object tracking. Background Art

[0003] Extended Reality (XR) technologies include Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). With the development of XR technology, the experiences offered by XR devices are becoming increasingly rich. For example, all-in-one VR headsets supporting 6 degrees of freedom (DoF) are rapidly improving both gaming content and user experience.

[0004] Summary of the Invention

[0005] In a first aspect of the present disclosure, a method for object tracking is provided. The method includes: determining an optical configuration associated with an operating mode of a first device, the first device including a motion sensor and at least one light-emitting element, the optical configuration configured to control light emission from the at least one light-emitting element; and configuring the first device based at least on the optical configuration to perform object tracking by tracking light emitted by the at least one light-emitting element and / or based on sensor data from the motion sensor.

[0006] In a second aspect of the present disclosure, an apparatus for object tracking is provided. The apparatus includes: an optical configuration determination module configured to determine an optical configuration associated with an operating mode of a first device, the first device including a motion sensor and at least one light-emitting element, the optical configuration configured to control light emission from the at least one light-emitting element; and a device setting module configured to set the first device based on at least the optical configuration to perform object tracking by tracking light emitted by the at least one light-emitting element and / or based on sensor data from the motion sensor.

[0007] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the device to perform the method of the first aspect.

[0008] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.

[0009] It should be understood that the content described in this summary section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0011] FIG1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

[0012] 2A to 2C are schematic diagrams showing various exemplary structures of a first device according to some embodiments of the present disclosure;

[0013] FIG3A is a schematic diagram showing an example of an attachment method of a first device according to some embodiments of the present disclosure;

[0014] FIG3B is a schematic diagram showing an example of a wearing method of the first device according to some embodiments of the present disclosure;

[0015] FIG4 is a schematic diagram showing a light emission timing of a light emitting element according to some embodiments of the present disclosure;

[0016] FIG5 illustrates a flowchart of an example process for identifying a tracker according to some embodiments of the present disclosure;

[0017] FIG6 illustrates a flowchart of an example process for connecting multiple trackers according to some embodiments of the present disclosure;

[0018] FIG7 is a schematic diagram showing a communication sequence between multiple trackers and a headset according to some embodiments of the present disclosure;

[0019] FIG8 is a schematic diagram showing an example signaling diagram of a back-connection and frequency hopping configuration between a tracker and a headset according to some embodiments of the present disclosure;

[0020] FIG9 illustrates a flow chart of a process for object tracking according to some embodiments of the present disclosure;

[0021] FIG10 shows a block diagram of an apparatus for object tracking according to some embodiments of the present disclosure; and

[0022] FIG11 shows a block diagram of a device capable of implementing various embodiments of the present disclosure. DETAILED DESCRIPTION

[0023] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0024] For example, in response to a user's active request, a prompt message is sent to the user to clearly inform the user that the operation requested will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the electronic device, application, server, storage medium, or other software or hardware that performs the operations of the disclosed technical solution based on the prompt message.

[0025] As an optional but non-limiting implementation, in response to receiving a user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. Furthermore, the pop-up window may also contain a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0026] It is understandable that the above notification and user authorization process are merely illustrative and do not limit the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0027] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) must comply with the requirements of relevant laws, regulations and relevant provisions.

[0028] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0029] It should be noted that the titles of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and any type of embodiment may be included under any section / subsection. Furthermore, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or in different sections / subsections.

[0030] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.

[0031] As briefly mentioned above, with the development of XR technology, some gaming, sports, and medical rehabilitation applications are beginning to support XR devices. For example, some VR 6DoF games and applications rely primarily on the 6DoF capabilities of headsets and controllers. These headsets and controllers enable basic game and application interaction. However, some body movements remain unavailable, such as walking, running, sitting, squatting, dancing, playing soccer, and doing yoga. The inability to track these body movements significantly impacts the user experience.

[0032] Some tracking solutions include outside-in tracking technology, which can rely on external cameras and locators to capture and track body movements. For example, by arranging laser light towers externally, the position information of body parts can be located. Such position information is then transmitted to a PC or all-in-one machine via USB or wirelessly to achieve body movement tracking. However, this implementation method has some obvious disadvantages. First, the installation process is complicated, and multiple locators (at least two) are required to form 360° coverage to establish three-dimensional position information. Second, it is complicated to use, especially for all-in-one machines, and the positional relationship between the all-in-one machine and the locator needs to be corrected. Third, the position data transmission delay is large. Fourth, if the tracked object is away from the scanning range of the locator or is blocked by an object, the accurate position cannot be obtained.

[0033] Some tracking solutions utilize multiple trackers that incorporate both light-emitting elements and inertial measurement units (IMUs) on the body. Using a combination of optical and inertial tracking technologies, these trackers are used to identify their position and posture to infer body movements or perform other operations. However, different XR application scenarios require different inputs related to body posture and posture. For example, dance or fitness applications may prioritize capturing the user's lower limbs. Another example is ball games or shooting games, where capturing the user's arm posture or the position of a handheld object (such as a rod or handle) may be more important. The way trackers are worn or mounted, how they communicate with the head-mounted display, how the light-emitting elements are controlled, and the logic for processing image and IMU data vary significantly across scenarios. Consequently, a single system solution cannot be applied across multiple scenarios. However, designing both optical and IMU trackers for each scenario and application would result in high costs, poor scalability, and user inconvenience.

[0034] Embodiments of the present disclosure propose a scheme for object tracking. According to various embodiments of the present disclosure, an optical configuration associated with an operating mode of a first device is determined. The first device includes a motion sensor and at least one light-emitting element. The optical configuration is used to control the light emission of the at least one light-emitting element. The first device is set based at least on the determined optical configuration to perform object tracking by tracking the light emitted by the at least one light-emitting element and / or according to the sensing data of the motion sensor, such as tracking a person wearing the first device or tracking the first device itself. Thus, by controlling the light emission of the light-emitting element in association with the operating mode, different configurations can be made for different operating modes. In this way, different tracking requirements can be met to achieve a highly scalable tracking device.

[0035] Sample Environment

[0036] FIG1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. In environment 100, a subject 130 (also referred to as a user) wears a second device 120. The second device 120 can be a head-mounted or wearable display device, such as a head-mounted display, smart glasses, etc., supporting technologies such as VR, AR, and MR. The second device 120 can communicate with a remote device (not shown) to reconstruct a virtual scene for the subject 130 or merge virtual content with a real scene. In some embodiments, the second device 120 can be designed to be integrated with the remote device.

[0037] Environment 100 also includes a first device 110. In some embodiments, first device 110 can be worn by subject 130. For example, first device 110 can be worn by subject 130 on a wrist, arm, waist, knee, foot, or ankle. Environment 100 may include multiple first devices 110. For example, multiple first devices 110 can be worn by subject 140 on the left wrist, right wrist, left ankle, and right ankle, respectively. In this case, first device 110 can be in the form of a wristband, a handle, a belt, an anklet, or the like.

[0038] In some embodiments, the first device 110 can be attached to the object 130 in any suitable manner. For example, the first device 110 can be held by the object 130 or placed on a fixed or movable object near the object 130. In this case, the object 130 can be an object to which the first device 110 can be attached, such as a golf club, a handle, a robot dog, etc.

[0039] The first device 110 may establish communication with the second device 120 via a wired link or a wireless link. The second device 120 may track the object 130 based on sensor data collected by the second device 120 and / or data uploaded by the first device 120.

[0040] It should be understood that the structure and functionality of the environment 100 are described for exemplary purposes only and do not imply any limitation on the scope of the present disclosure. Furthermore, it should be understood that the above description of the first device 110 and the second device 120 is merely exemplary and non-limiting. The first device 110 and the second device 120 can be implemented as various forms, structures, or types of devices, and the embodiments of the present disclosure are not limited in this respect.

[0041] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

[0042] Example structure of the first device

[0043] In environment 100, first device 110 may include a motion sensor and at least one light-emitting element. The light-emitting element may include an active light-emitting element and / or a passive light-emitting element. Active light-emitting elements include, for example, visible light emitting diodes (LEDs), infrared light-emitting diodes (IRLEDs), and the like. Passive light-emitting elements include, for example, markers formed of reflective materials. Second device 120 may include an image sensor (e.g., a camera). Second device 120 may perform object tracking by tracking light emitted by the light-emitting elements on first device 110 and / or based on sensor data from the motion sensor. For example, first device 110 itself may be tracked and / or subject 130 wearing first device 110 may be further tracked. Exemplarily, second device 120 may determine the position of first device 110 relative to second device 120 based on the light emitted by the light-emitting elements on first device 110 and / or based on sensor data from the motion sensor. Further, second device 120 may determine the position of first device 110 in space based on its own position in space. Thus, first device 110 may be tracked. Furthermore, the object may be tracked based on a connection relationship between the first device 110 and the object wearing or attached with the first device 110. The tracked object may include, but is not limited to, a human body, a human body part, or an object (such as a racket, a handle, etc.).

[0044] In order to more clearly understand the object tracking solution according to an embodiment of the present disclosure, an example structure of the first device 110 will be described below with reference to FIG. 2A to FIG. 2C .

[0045] In the example of FIG. 2A , the first device 110 includes at least a main body 210 (also referred to as a body). In some embodiments, the first device 110 can be attached to a base 220 (also referred to as a stand), for example, by the main body 210. Alternatively, in some embodiments, the base 220 can be a part of the first device 110. The main body 210 includes at least one light-emitting element 212, a communication interface 214, and a wireless communication module (not shown). For ease of description, the light-emitting element on the main body is also referred to as a first light-emitting element. Such a first light-emitting element is disposed on a side of the main body 210 facing the second device 120, so that the first device 120 can track the light emitted by the first light-emitting element. In some embodiments, the number of first light-emitting elements exceeds a predetermined number, for example, two. Multiple first light-emitting elements can be staggered to facilitate identification by the second device 120. The communication interface 214 is disposed on a side or bottom surface facing the base 220. The main body 210 can establish a wireless communication connection with the second device 120 via the wireless communication module to transmit various data, such as sensor data and configuration data.

[0046] In the example of Figure 2A, the main body 210 and the base 220 are detachable. Thus, the same main body can be adapted to different bases, and the same base can be adapted to different main bodies. In this way, the split design can flexibly adapt to the needs of different scenarios. The installation methods of the main body 210 and the base 220 include but are not limited to elastic snaps, magnetic suction, rotational buckle, press-lock and then press-pop-out, etc. The left figure in Figure 2A shows a schematic diagram of the main body 210 and the base 220 being separated, and the right figure shows a schematic diagram of the main body 210 being installed on the base 220. Based on different wearing positions, the base 220 may include a rigid material (such as PVC or metal), a flexible material (such as an elastic strap) or a combination thereof to improve wearing comfort.

[0047] In some embodiments, the base 220 may include at least one light-emitting element 222. For ease of subsequent description only, the light-emitting element on the base is also referred to as a second light-emitting element. At least one second light-emitting element is mounted on a side of the base 220 facing the second device 120 to facilitate tracking of light emitted by the second light-emitting element by the second device 120. In some embodiments, the number of second light-emitting elements exceeds a predetermined number, such as two. Multiple second light-emitting elements are disposed at both ends of the base 220 or staggered with the first light-emitting element to facilitate identification by the second device 120.

[0048] The base 220 may further include a communication interface 224 and a wireless communication module (not shown). When the main body 210 is mounted on the base 220, the communication interface 224 and the communication interface 214 may be connected to each other. The connection between the communication interface 224 and the communication interface 214 may be any suitable form of connection, including a wired connection (e.g., a hard-wired connection, a slot connection) and / or a wireless connection (e.g., near-field communication, radio frequency identification technology). Thus, the base 220 establishes a communication connection with the first device 110. The base 220 can send signals, transmit data, etc. to the first device 110 (e.g., the main body 210). In some embodiments, the base 220 may also establish a wireless communication connection with the second device 120 through the wireless communication module for transmitting sensing data, configuration data, etc.

[0049] The base 220 may also include a vibration motor 226. The vibration motor 226 is used to provide vibration feedback. For example, during a game, when the arm wearing the first device 110 performs a striking action, the vibration motor 226 can provide strong vibration feedback to enhance the immersiveness of the game. For another example, when attention is needed or an abnormal situation occurs, the vibration motor 226 can vibrate slightly to alert the user.

[0050] The first device 110 may further include a motion sensor (not shown) for collecting sensory data related to the movement of the first device 110. In some embodiments, the motion sensor may include a three-axis gyroscope for detecting rotation angles such as pitch, roll, and heading, so that the first device 110 supports 3DoF. Additionally or alternatively, the motion sensor may include a three-axis accelerometer so that the first device 110 supports 6DoF. Additionally or alternatively, the motion sensor may include a magnetometer for detecting directions such as east, west, south, and north relative to the earth's magnetic field. Additionally or alternatively, the motion sensor may include an IMU.

[0051] The base 220 may also include a battery 228. The battery 228 may be used to power the second light-emitting element, the vibration motor 226, and the wireless communication module. In some embodiments, the battery 228 may be used to power the main body 210 via the communication interface 224 and the communication interface 214 to drive the first light-emitting element to emit light, etc.

[0052] In the example of Figure 2B, the first device 110 generally includes a main body 230 and is attached to the base 240 through the main body 230. In some embodiments, the first device 110 may include a main body 230 and a base 240. The main body 230 includes at least one light-emitting element 232, a communication interface 234, and a wireless communication module (not shown). Alternatively, the base 240 may include at least one light-emitting element 242, a communication interface 244, a wireless communication module (not shown), and a motion sensor (not shown). The difference from the example of Figure 2A is the installation position of the vibration motor 236 and the battery 238. The main body 230 can establish a wireless communication connection with the second device 120 through the wireless communication module for transmitting various data, such as sensing data, configuration data, etc.

[0053] In some embodiments, referring to FIG2B , the main body 230 may further include a vibration motor 236 and a battery 238. The battery 238 may be used to power the light-emitting element 232 and may also be used to power the base 240 via the communication interface 234 and the communication interface 244. In other words, the first device 110 may provide power to the base 220. The power supplied by the first device 110 may be used to drive the light-emitting element 242 to emit light.

[0054] In the examples of Figures 2A and 2B, first device 110 can be worn by subject 130. In the example of Figure 2C, first device 110 can be placed on an object near subject 130. For example, first device 110 includes body 250 and is attached to base 260, or first device 110 can include base 260. Base 260 is generally annular and includes two light-emitting elements 262. Body 250 is generally cylindrical and includes one light-emitting element 252.

[0055] The structure of the first device 110 is described above with reference to the examples of Figures 2A to 2C . It should be understood that this is merely exemplary and does not constitute a limitation to the present disclosure.

[0056] Example working mode

[0057] The object tracking method according to the embodiments of the present disclosure can be executed by the first device 110, the second device 120, or both. Alternatively or additionally, the object tracking method according to the embodiments of the present disclosure can also be executed by a remote device. For purposes of example only and not intended to be limiting, the following description of various embodiments takes execution by the first device 110 as an example.

[0058] The optical configuration is used to control the light emission of at least one light-emitting element in the first device 110. In an embodiment of the present disclosure, the optical configuration is associated with an operating mode of the first device 110. In some embodiments, the operating mode may be related to the scene of object tracking. The scene may depend on the application or specific part of the application of the object tracking. For example, different applications may correspond to different scenes. For another example, different types of games, game scenes or game levels in the same application may correspond to different scenes. Exemplarily, the corresponding operating mode can be determined based on an indication of the scene from the application layer. For example, in the example of Figure 3A, the first device 110 can be used in a shooting game. For another example, in the example of Figure 3B, the first device 110 can be used in a running application.

[0059] Alternatively or additionally, in some embodiments, the operating mode may be related to the base to which the first device 110 is attached or included. In such embodiments, the attached or included base can be determined based on an identification signal from the base. After the main body of the first device 110 is paired and connected with the base, the signal from the base can be used as the basis for the operating mode. Such a signal can indicate information corresponding to the wearing position or attachment position of the base. Thus, the first device 110 can determine its operating mode.

[0060] When the second device 120 is present, the second device 120 is typically worn at a predetermined location on the object 130, also referred to as a wearing location, such as the head. In light of this, the operating mode may be related to the location of the base relative to the second device 120. In some embodiments, the operating mode corresponding to the first base located at a first preset location is a close-range mode, and the operating mode corresponding to the second base located at a second preset location is a long-range mode. The first preset location and the second preset location are associated with the object 130 on which the second device 120 is worn, and the second preset location is further away from the wearing location of the second device 120 on the object 130, such as the head, than the first preset location.

[0061] The first preset position is a position associated with the object 130. In some embodiments, the first preset position includes the wearing position of the base in the first device 110 or the base to which it is attached. For example, referring to FIG2A , the first device 110 is worn on the wrist of the object 130 via the base 220, and the first preset position may refer to the wrist. In some embodiments, the first preset position includes a position in the first device 110 corresponding to the attachment position of the base. For example, in the example of FIG3A , the first device 110 includes a main body 310 and a base 320. When such a first device 110 is held by the object 130, the first preset position may refer to the position of the main body 310.

[0062] The second preset location is a location associated with the subject 130. In some embodiments, the second preset location includes the location where the base of the first device 110 or the base to which it is attached is worn. For example, referring to FIG3B , the first device 110 includes a body 330 and a base 340. If the first device 110 is worn at the ankle of the subject 130 via the base 340, the second preset location may refer to the ankle.

[0063] When the first device 110 is located at the first preset position and / or the second preset position, the second device 120 can track the object 130 (e.g., a body part of the object 130 or a device associated therewith) by tracking the light emitted by the light-emitting element mounted on the first device 110 (e.g., by capturing a light spot image using an image sensor). This mode may also be referred to as an optical tracking mode.

[0064] Additionally, in some embodiments, a sensing configuration for a motion sensor (e.g., an IMU) associated with the operating mode may be determined, and the first device 110 may be configured based on the sensing configuration and the optical configuration. In such embodiments, the second device 120 may receive the sensing data of the motion sensor sent by the first device 110 and perform object tracking, such as tracking the object 130, based on the light emitted by the light-emitting element and the sensing data. In this manner, the combination of light tracking and motion sensing data may improve tracking accuracy.

[0065] In some embodiments, if the operating mode indicates that first device 110 is outside the optical tracking range for object tracking, for example, when first device 110 is located at a third preset position outside the optical tracking range, at least one light-emitting element in first device 110 may be disabled. In other words, in this case, first device 110 operates in a non-optical tracking mode. For example, first device 110 may be worn around the waist of subject 130, thus outside the field of view of the image sensor. In this case, second device 120 may receive motion sensor data transmitted by first device 110 and track subject 130 based solely on this data. In this manner, the operating scenario of first device 110 can be differentiated relative to the optical tracking range of second device 120. Furthermore, in this embodiment, since first device 110 is no longer within the optical tracking range of second device 120, continuing to enable the light-emitting element in first device 110 does not improve tracking accuracy and may instead increase power consumption of first device 110. Therefore, in this embodiment, controlling first device 110 to operate in non-optical tracking mode can reduce power consumption of first device 110.

[0066] In some embodiments, after the first device 110 and the base are paired and connected, the base to which the device is attached can be determined based on an identification signal from the base, thereby determining its operating mode. Such an identification signal can specifically indicate whether the base is a leg base, a waist base, or a hand base.

[0067] The operating modes of the first device 110 have been described above through various embodiments. The various operating modes are determined based on the scene relative to the object being tracked, the light tracking range relative to the second device 120, and the identification signal from the base. Furthermore, the first device 110 can determine an optical configuration associated with the operating mode. This optical configuration can control the light emission of multiple light-emitting elements installed on the first device 110, thereby achieving the effects of saving energy and improving battery life while ensuring stable tracking.

[0068] In the embodiments of the present disclosure, determining the optical configuration based on the base is a hardware-based implementation. In this case, the first device can be appropriately configured regardless of the base it is connected to, thereby achieving convenient configuration. In addition, the hardware-based implementation is fast and reliable. Determining the optical configuration based on the scene is a software-based implementation. This approach enables the first device to adapt to any application scenario, thereby increasing flexibility. Determining the optical configuration based on the base and scene can combine hardware and software implementations, further improving flexibility and scalability.

[0069] Example optical configuration

[0070] The second device 120 collects light (e.g., visible light) emitted by the light-emitting elements through an image sensor. The light emitted by each light-emitting element forms a light spot. The distance between the light spots determines the distance. If these light spots are too far from the predetermined position of the second device 120, the light spots may be too dense to be easily recognized. To adapt to different operating modes, for example, all or some light-emitting elements can be selectively enabled or disabled. Controlling the light emission of the light-emitting elements can be referred to as optical configuration.

[0071] The optical configuration may include corresponding activation states of a plurality of light emitting elements. In some embodiments, if the first device 110 is located at a first preset position, the first device 110 may disable some of the light emitting elements. In this way, the density of the light spot may be reduced.

[0072] In the example of FIG2A , the main body 210 includes a plurality of light-emitting elements 212. The base 220 includes a plurality of light-emitting elements 222. The arrangement of the plurality of light-emitting elements 212 is relatively dense relative to the arrangement of the plurality of light-emitting elements 222. If such a first device 110 is located at a first preset position, for example, worn on the ankle of the subject 130, the first device 110 can disable some or all of the plurality of light-emitting elements 212 on the main body 210 and enable the plurality of light-emitting elements 222 on the base 220. In this way, the distance between the light spots can be increased, thereby reducing the density of the light spots, which facilitates recognition by the second device 120.

[0073] [Corrected 02.11.2024 per Rule 91] In some embodiments, if first device 110 is in a second preset position, the second light-emitting element on the base can be disabled. Continuing with FIG. 2A , if first device 110 is in the second preset position, such as when worn on the wrist of subject 130, all light-emitting elements 222 can be disabled, and some or all light-emitting elements 212 can be enabled. In this way, battery life can be improved.

[0074] If the first device 110 has fewer light-emitting elements installed, a targeted optical configuration can also be set. In the example of Figure 2C, the main body 250 includes one light-emitting element 252. The base 260 includes two light-emitting elements 262. If such a first device 110 is in the second preset position, only light-emitting element 252 can be enabled, and light-emitting element 262 can be disabled. If such a first device 110 is in the first preset position, light-emitting element 262 can be enabled. In this way, the range of the light spot can be increased, which facilitates recognition by the second device 120.

[0075] Additionally or alternatively, the optical configuration may include the brightness of the light emitted by the enabled light-emitting element. Therefore, in addition to adjusting the density and range of the light spot, the brightness of the light emitted by the light-emitting element can also be adjusted to achieve the effect of improving battery life. In some embodiments, if the first device 110 is located at the first preset position, it can be determined that the enabled light-emitting element emits light at a higher brightness. If the first device 110 is located at the second preset position, it can be determined that the enabled light-emitting element emits light at a lower brightness. This is because when the distance to the predetermined position is closer, even if the brightness of the light spot is lower, it is easy to be recognized by the second device 120. Therefore, if the first device 110 is located at the second preset position, the brightness of the light emitted by the light-emitting element can be appropriately reduced, for example, the light-emitting element emits light at 60% brightness. If the first device 110 is located at the first preset position, the brightness of the light emitted by the light-emitting element can be appropriately increased, for example, the light-emitting element emits light at 90% brightness.

[0076] Additionally or alternatively, the first device 110 may determine the brightness of each enabled light-emitting element, thereby achieving an overall brightness reduction or brightness increase effect. For example, if the first device 110 is located at the second preset position, the brightness of half of the enabled light-emitting elements may be controlled at 50%, and the brightness of the other half of the enabled light-emitting elements may be controlled at 70%.

[0077] In the example of Figure 3A, the main body 310 is mounted on a handle bracket. If such a first device 110 is held by the subject 130, all the light-emitting elements on the main body 310 can be enabled to facilitate tracking by the second device 120 from various perspectives. However, if the main body is mounted on some special base (such as a wrap-around bracket), only some of the light-emitting elements can be enabled. In some embodiments, the first device 110 can determine whether there are light-emitting elements designated as not lit among the multiple light-emitting elements based on the identification signal of the base, thereby disabling these light-emitting elements designated as not lit in order to improve battery life. For example, when the main body is mounted on a wrap-around bracket, one or some light-emitting elements on the main body will be blocked by the bracket. The identification information of the base indicates the presence of blocked light-emitting elements. The first device 110 can disable the corresponding light-emitting elements based on such an identification signal.

[0078] The optical configuration of the first device 110 can also be determined based on whether the light-emitting elements are within the light tracking range of the second device 120. In some embodiments, if the operating mode indicates that the first device 110 is outside the light tracking range for object tracking, the first device 110 can disable all light-emitting elements. Because these light-emitting elements are outside the light tracking range, whether or not these light-emitting elements are illuminated does not affect the tracking of the second device 120 based on the sensor data from the motion sensor. In this way, the battery life of the first device 110 can be improved.

[0079] Additionally or alternatively, the optical configuration may further include the light emission timing of the enabled light-emitting elements. The light emission timing may include, but is not limited to, one or more of the light emission moment, light emission frequency, or light emission duration. When multiple first devices 110 operate simultaneously, there is a possibility of mutual occlusion or simultaneous appearance, thereby increasing the difficulty for the second device 120 to distinguish. In particular, for the case where the first device 110 has a small volume, or when the optical shape of the first device 110 is kept consistent considering later scalability and mass production cost, the light-emitting elements enabled on each first device 110 can be controlled to emit light at different timings.

[0080] In some embodiments, if multiple first devices 110 operate simultaneously, the optical configuration of one first device 110 is associated with the corresponding operating modes of these first devices 110. In other words, in this case, the optical configuration of a certain first device 110 is not only associated with its own operating mode but also with the operating modes of other first devices 110. As an example, when two first devices 110 operate simultaneously, for example, one first device 110 operates at a first preset position (such as the left ankle), and the other first device 110 operates at another first preset position (such as the right ankle), then the optical configuration of one first device 110 is not only related to its own operating mode but also to the operating mode of the other first device 110. Thus, such two first devices 110 can be distinguished by the optical configuration (such as different spot patterns and / or different light emission timings).

[0081] In some embodiments, the optical configuration of one first device 110 may be at least partially different from the optical configuration of another first device 110. For example, the optical configuration may include the spot patterns formed by the enabled light-emitting elements on each first device110. These spot patterns may not be completely the same or at least partially different to facilitate the second device 120 to distinguish the first devices 110 based on the patterns. In some embodiments, if two first devices 110 are respectively located at substantially symmetric first preset positions or substantially symmetric second preset positions, different spot patterns can be used to facilitate the second device 120 to distinguish. For example, the spot pattern of the first device 110 located on the left wrist of the object 130 is in the shape of "丄", and the spot pattern of the first device 110 located on the right wrist of the object 130 can be in the shape of "丅".

[0082] FIG4 illustrates a schematic diagram of a light emission timing sequence 400 of a light-emitting element according to some embodiments of the present disclosure. In the example of FIG4 , the first device 110 includes a tracker 1 (e.g., located on the user's left hand) and a tracker 2 (e.g., located on the user's right hand). The second device 120 includes a head-mounted display (hereinafter referred to as a head-mounted display, located on the user's head). The head-mounted display is provided with cameras 1, 2, 3, and 4. These cameras can capture image data at a preset frequency.

[0083] Referring to light emission timing 400, at time t1, the headset sends a synchronization signal. The cameras can begin exposure at their respective times and maintain exposure for a specific duration, ensuring that the center points of their exposure times align at time t2, thereby capturing tracking images of the headset's position within different fields of view. At time t3, the cameras capture tracking images of the tracker's position using the same exposure time and aligned exposure center points. At this time, Tracker 1 emits light. The center point of Tracker 1's light emission duration is aligned with the center point of the camera's exposure duration and is also greater than the exposure duration. At time t4, the headset sends a synchronization signal. At time t5, the camera captures tracking images of the headset's position. At time t6, Tracker 2 emits light. The center point of Tracker 2's light emission duration is aligned with the center point of the camera's exposure duration and is also greater than the exposure duration. This allows Tracker 1 and Tracker 2 to emit light at different timings, facilitating headset recognition.

[0084] In some embodiments, a first optical configuration can be determined based on a base to which the first device 110 is attached or included, and a second optical configuration different from the first optical configuration can be determined based on the scene of object tracking. For example, the first optical configuration and the second optical configuration can be different types of configurations. Exemplarily, the first optical configuration can be the enabled state of a light-emitting element, and the second optical configuration can be the light emission timing of the enabled light-emitting element. For example, in a dancing application scenario, two first devices 110 work simultaneously. One first device 110 works at a first preset position (e.g., at the left ankle), and the other first device 110 works at another first preset position (e.g., at the right ankle). The first optical configuration is determined based on the bases to which such two first devices 110 are attached (in this example, the bases at the left ankle and the right ankle), for example, one light-emitting element on each can be enabled. Further, the second optical configuration is determined based on the dancing application scenario. For example, for a dancing scene, it is necessary to track the movements of the left foot and the right foot separately, that is, it is necessary to distinguish between the left foot and the right foot. Accordingly, the light emission timings of the enabled light emitting elements may be configured such that the light emission timings of the two first devices 110 are staggered with each other.

[0085] In some embodiments, the first optical configuration and the second optical configuration may be determined by the first device 110. In some embodiments, the first optical configuration and the second optical configuration may be determined by the second device 120. In some embodiments, the first optical configuration may be determined by the first device 110, and the second optical configuration may be determined by the second device 120.

[0086] In some embodiments, the light-emitting elements on the base may also emit light. Accordingly, the combined light spot of the light emitted by the light-emitting elements on the first device 110 and the light emitted by the light-emitting elements on the base can be tracked. Thus, object tracking can be performed based on tracking the combined light spot, such as tracking a person wearing the first device 110 and / or the first device 110 itself.

[0087] The optical configuration of the first device 110 is described above. According to various embodiments of the present disclosure, the present disclosure can provide a system solution, including one or more first devices 110 used in conjunction with the second device 120. The first device 110 can be an integral structure or a split structure. The first device 110 can be set on the limbs of the object 130 or on a fixed or movable object in a real scene as required. Furthermore, for different scenarios, the first device 110 can be optically configured accordingly to meet the specific tracking requirements in the scenario. Such an optical configuration includes, for example, the optical configuration of enabling and disabling each light-emitting element on the main body and base of the first device 110, the brightness configuration of the emitted light, the light spot pattern configuration, and the light emission timing configuration. With reference to Figures 5 and 6 below, specific examples of mode control of multiple trackers in different scenarios are described.

[0088] Figure 5 shows a flowchart of an example process 500 for identifying a tracker, according to some embodiments of the present disclosure. Example process 500 involves a tracker and a headset. The tracker, for example, is a split-body (i.e., detachable) structure, comprising a main body and a base. When the main body is attached to the base, at block 510, determination of the tracker's relative position begins.

[0089] In box 512, if it is a leg tracker, that is, the base to which it is attached is installed on the leg, proceed to box 514. In box 514, the main body and the base are paired, and the main body or the base sends a connection identifier. In box 516, the tracker and the headset are connected, and it is determined whether to enter the leg tracking mode. If the leg tracking mode is entered, proceed to box 518. In box 518, the tracker or the headset can perform the optical configuration associated with the leg mode. For example, some light-emitting elements can be enabled with higher brightness and lower density. After the optical configuration, the enabled light-emitting elements on the tracker may not emit light immediately, but may be temporarily in standby mode. When a light-emitting instruction (such as a signal sent by the headset) is received, the enabled light-emitting elements are controlled to emit light, thereby entering the tracking mode.

[0090] At block 512, if it is determined that the device is not a leg tracker, process 500 proceeds to block 520. At block 520, if it is determined that the device is a waist tracker, meaning that the base to which it is attached is mounted at the waist, process 500 proceeds to block 522. At block 522, the main unit and base are paired, and the main unit or base sends a connection identifier. At block 524, the tracker and headset are connected, and a determination is made as to whether waist tracking mode is to be entered. If waist tracking mode is to be entered, process 500 proceeds to block 526. At block 526, the tracker or headset may configure the optical configuration associated with waist mode, for example, disabling all light-emitting elements.

[0091] If, at block 520, the tracker is not a waist tracker, process 500 proceeds to block 528. At block 528, the main unit and the base are paired, and the base sends a connection identifier. At block 530, the tracker is connected to the headset, and a determination is made as to whether a corresponding tracking mode, such as hand mode, has been entered. If so, process 500 proceeds to block 526. At block 526, the tracker or headset may be configured with the optical configuration associated with that tracking mode. For example, in hand mode, some of the light-emitting elements may be enabled at a lower brightness.

[0092] FIG6 shows a flowchart of an example process 600 for connecting multiple trackers according to some embodiments of the present disclosure. Example process 600 involves a scenario of tracker 1, tracker 2, and a headband. For example, example process 500 determines that tracker 1 is in leg mode (e.g., corresponding to the user's left ankle) and tracker 2 is in leg mode (e.g., corresponding to the user's right ankle). Further, based on tracker 1 and tracker 2 being located at the left ankle and right ankle, respectively, it is possible to determine which light-emitting elements of each of the two trackers are enabled and the corresponding light emission timings of the two trackers.

[0093] At block 610, tracker 1 connects to the headset. If it is determined that the device has entered tracking mode from standby mode, process 600 proceeds to block 612. At block 612, tracker 1 receives a synchronization signal from the headset and synchronizes with the headset. The headset sets the timing for tracker 1's light emission. At block 614, tracker 1 emits light at the corresponding timing based on the previously determined optical configuration and returns a light-up indicator and a timestamp.

[0094] At block 620, tracker 2 connects to the headset. If it is determined that the device has entered tracking mode from standby mode, process 600 proceeds to block 622. At block 622, tracker 2 receives a synchronization signal from the headset and synchronizes with the headset. The headset sets the timing for tracker 2's light emission. At block 624, tracker 2 emits light at the corresponding timing based on the previously determined optical configuration and returns a light-up indicator and a timestamp.

[0095] In block 630 , the head-mounted device captures images of tracker 1 and tracker 2 at corresponding time sequences, thereby performing tracking based on the corresponding images and IMU data.

[0096] Example Communication Sequence

[0097] The system solution of the present disclosure may also include configuring the communication transmission method between multiple first devices 110 and second devices 120, and may also include adjusting the corresponding tracking algorithm based on the configuration of the first device 110. The following describes a specific example of the communication configuration between the tracker and the headset with reference to Figures 7 and 8.

[0098] Figure 7 shows a schematic diagram of a communication sequence 700 between multiple trackers and a headset, according to some embodiments of the present disclosure. The communication sequence 700 involves tracker 1, tracker 2, and a headset. Tracker 1 and tracker 2 use their own communication lists.

[0099] During a specific time period, Tracker 1, Tracker 2, and the headset all operate on Tracker 1's Channel 1. Tracker 1 is in the receiving state, receiving a beacon signal at time t11 and transmitting data at time t12. Simultaneously, the headset switches to the receiving state. After a specific period, Tracker 1 and the headset all hop to Tracker 1's Channel 2 and operate. Tracker 2 operates similarly to Tracker 1.

[0100] By adjusting the transmission and reception timings based on pairing, Tracker 1 and Tracker 2 form a periodic transmission sequence, as shown in the figure with period T1. Period T1 determines the maximum data transmission frequency of the trackers. Period T1 and the number of trackers determine the system's communication transmission timing. The headset and trackers can use their respective timings to determine the data transmission channel and the time to send and receive data within a certain period of time. Adjusting period T2 can reduce interference of wireless communication on other frequency bands of the headset, such as WiFi, Bluetooth devices, etc.

[0101] [Corrected 02 / 11 / 2024 in accordance with Rule 91] Figure 8 illustrates an example signaling process 800 for configuring backlinks and frequency hopping between a tracker and a headset, according to some embodiments of the present disclosure. Example signaling process 800 involves a tracker and a headset. The headset and tracker have fixed backlink channels. The backlink channel can be a single channel or a fixed channel list. If it is a fixed channel list, the connection logic includes ensuring that the headset updates the channel periodically differently from the tracker if the headset and tracker are not connected successfully. After a successful connection, the headset and tracker use the same frequency hopping period to maintain consistent channel updates.

[0102] Specifically, at 802, the headset is powered on. At 804, the tracker is powered on. At 806, the headset scans channels to determine a data channel list. For example, the list of channels exceeding a predetermined noise floor includes channels 5 to 20. When the headset connects to the tracker, it includes the determined data channel list in the connection information. For example, a connection message is broadcast on the connection channel, and such message includes the data channel list. At 808, the headset transmits a broadcast signal. The broadcast signal includes the data channel list and a frequency hopping count. If no confirmation message is received from the tracker, it indicates that the headset and tracker have not yet successfully connected. Therefore, the headset continues to transmit the broadcast signal. For example, at 810, the headset continues to transmit the broadcast signal. Each time the broadcast signal is transmitted, the frequency hopping count is decremented by 1. When the frequency hopping count is not zero, for example, at 812, the headset transmits the broadcast signal. At 814, the tracker receives the data channel list and responds with a confirmation message. At 818, the headset determines when to use the data channel list. At 816, the tracker determines when to use the data channel list. When the hop count is 0, both the headset and the tracker use the confirmed data channel list.

[0103] However, during the actual transmission process, there may be new interference sources in the external environment. At 818, the headset scans the external environment interference in real time and generates a new data channel list. For example, the connection information is broadcast on the connection channel, and the connection information includes the new data channel list and the updated frequency hopping count. At 820, the headset sends a broadcast signal. The broadcast signal includes the data channel list and a frequency hopping count. Each time a broadcast signal is sent, the frequency hopping count is reduced by 1. When the frequency hopping count is not 0, for example, at 822, the headset sends a broadcast signal. At 824, the tracker updates the data channel list and replies with a confirmation message. At 826, the headset determines the time point to use the new data channel list. At 828, the tracker determines the time point to use the new data channel list. When the frequency hopping count is 0, the headset and the tracker use the new data channel list at the same time.

[0104] Therefore, as long as a frame of data is successfully updated during a channel update, both the headset and the tracker will use the new channel list at the specified time. This method can solve the problem of channel interference during transmission. Additionally or alternatively, the frequency hopping count can also use a reverse operation of adding 1.

[0105] Example Process

[0106] 9 shows a flowchart of a process 900 for object tracking according to some embodiments of the present disclosure. The process 900 may be implemented at the first device 110, the second device 120, or both, or performed by other devices capable of communicating with the first device 110 and the second device 120.

[0107] At block 910, an optical configuration associated with an operating mode of a first device is determined. The first device includes a motion sensor and at least one light emitting element, and the optical configuration is for controlling light emission of the at least one light emitting element.

[0108] At block 920 , the first device is configured based on at least the optical configuration to perform object tracking by tracking light emitted by at least one light emitting element and / or based on sensory data from a motion sensor.

[0109] In some embodiments, the operating mode is related to at least one of: a scenario in which the object is tracked, or a base to which the first device is attached or included.

[0110] In some embodiments, object tracking is performed by the second device, and the operating mode corresponding to the first base being located at a first preset position is a close-range mode, and the operating mode corresponding to the second base being located at a second preset position is a long-range mode. The first preset position and the second preset position are associated with a subject wearing the second device, and the second preset position is farther from a position of the second device on the subject than the first preset position.

[0111] In some embodiments, determining the optical configuration includes: disabling some of the at least one light emitting element if the operating mode is a long-distance mode; and disabling the light emitting elements on the first base if the operating mode is a short-distance mode.

[0112] In some embodiments, determining the optical configuration includes: if the working mode is a long-distance mode, determining that the enabled light-emitting element emits light at a first preset brightness; or if the working mode is a short-distance mode, determining that the enabled light-emitting element emits light at a second preset brightness, the first preset brightness being higher than the second preset brightness.

[0113] In some embodiments, process 900 further includes: receiving an identification signal from a base; and determining the base based on the identification signal.

[0114] In some embodiments, determining the optical configuration includes disabling at least one light emitting element if the operating mode indicates that the first device is out of a light tracking range for object tracking.

[0115] In some embodiments, configuring the first device based on at least the optical configuration includes determining a sensing configuration for the motion sensor associated with the operating mode; and configuring the first device based on the sensing configuration and the optical configuration.

[0116] In some embodiments, the first device is one of a plurality of first devices, and the optical configuration is associated with a respective operating mode of the plurality of first devices.

[0117] In some embodiments, the first device is one of a plurality of first devices, and an optical configuration of the first device is at least partially different from optical configurations of other devices in the plurality of first devices except the first device.

[0118] In some embodiments, the optical configuration includes at least one of the following: a corresponding enabled state of at least one light-emitting element, a light spot pattern formed by an enabled light-emitting element among at least one light-emitting element, a brightness of light emitted by the enabled light-emitting element, and a light emission timing of the enabled light-emitting element.

[0119] In some embodiments, determining an optical configuration associated with the operating mode of the first device includes: determining a first optical configuration based on the base; and determining a second optical configuration different from the first optical configuration based on the scene.

[0120] In some embodiments, process 900 further includes providing power to the base via the first device in response to the first device being attached to the base.

[0121] In some embodiments, process 900 further includes: tracking a combined light spot of light emitted by the at least one light emitting element and light emitted by the light emitting element on the base; and performing object tracking based on tracking the combined light spot.

[0122] In some embodiments, object tracking includes tracking at least one of: the first device, or a human body wearing the first device.

[0123] Example devices and equipment

[0124] FIG10 shows a schematic block diagram of an apparatus 1000 for object tracking according to certain embodiments of the present disclosure. Apparatus 1000 may be implemented as or included in first device 110 and / or second device 120. Each module / component in apparatus 1000 may be implemented by hardware, software, firmware, or any combination thereof.

[0125] As shown, apparatus 1000 includes an optical configuration determination module 1010 configured to determine an optical configuration associated with an operating mode of a first device, the first device including a motion sensor and at least one light-emitting element, the optical configuration being configured to control light emission from the at least one light-emitting element. Apparatus 1000 also includes a device settings module 1020 configured to configure the first device based at least on the optical configuration to perform object tracking by tracking light emitted by the at least one light-emitting element and / or based on sensory data from the motion sensor.

[0126] In some embodiments, the operating mode is related to at least one of: a scenario in which the object is tracked, or a base to which the first device is attached or included.

[0127] In some embodiments, object tracking is performed by the second device, and the operating mode corresponding to the first base being located at a first preset position is a close-range mode, and the operating mode corresponding to the second base being located at a second preset position is a long-range mode. The first preset position and the second preset position are associated with a subject wearing the second device, and the second preset position is farther from a position of the second device on the subject than the first preset position.

[0128] In some embodiments, the optical configuration determination module 1010 is further configured to: disable some of the at least one light-emitting element if the working mode is the long-distance mode; and disable the light-emitting elements on the first base if the working mode is the short-distance mode.

[0129] In some embodiments, the optical configuration determination module 1010 is further configured to: if the working mode is a long-distance mode, determine that the enabled light-emitting element emits light at a first preset brightness; or if the working mode is a short-distance mode, determine that the enabled light-emitting element emits light at a second preset brightness, and the first preset brightness is higher than the second preset brightness.

[0130] In some embodiments, the apparatus 1000 further includes: a signal receiving module configured to receive an identification signal from the base; and a base determining module configured to determine the base based on the identification signal.

[0131] In some embodiments, the optical configuration determination module 1010 is further configured to disable at least one light emitting element if the operating mode indicates that the first device is out of a light tracking range for object tracking.

[0132] In some embodiments, the device setting module 1020 is further configured to: determine a sensing configuration for the motion sensor associated with the operating mode; and set the first device based on the sensing configuration and the optical configuration.

[0133] In some embodiments, the first device is one of a plurality of first devices, and the optical configuration is associated with a respective operating mode of the plurality of first devices.

[0134] In some embodiments, the first device is one of a plurality of first devices, and an optical configuration of the first device is at least partially different from optical configurations of other devices in the plurality of first devices except the first device.

[0135] In some embodiments, the optical configuration includes at least one of the following: a corresponding enabled state of at least one light-emitting element, a light spot pattern formed by an enabled light-emitting element among at least one light-emitting element, a brightness of light emitted by the enabled light-emitting element, and a light emission timing of the enabled light-emitting element.

[0136] In some embodiments, the optical configuration determination module 1010 is further configured to: determine a first optical configuration based on the base; and determine a second optical configuration different from the first optical configuration based on the scene.

[0137] In some embodiments, the apparatus 1000 further includes: a power supply module configured to supply power to the base via the first device in response to the first device being attached to the base.

[0138] In some embodiments, the device 1000 further includes: a spot tracking module configured to track a combined spot of light emitted by at least one light-emitting element and light emitted by the light-emitting element on the base; and an object tracking module configured to perform object tracking based on tracking the combined spot.

[0139] In some embodiments, object tracking includes tracking at least one of: the first device, or a human body wearing the first device.

[0140] FIG11 is a block diagram illustrating an electronic device 1100 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the electronic device 1100 shown in FIG11 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. The electronic device 1100 shown in FIG11 may be used to implement the first device 110 and / or the second device 120 of FIG1 .

[0141] As shown in FIG11 , electronic device 1100 is a general-purpose electronic device. Components of electronic device 1100 may include, but are not limited to, one or more processors or processing units 1110, memory 1120, storage device 1130, one or more communication units 1140, one or more input devices 1150, and one or more output devices 1160. Processing unit 1110 may be a real or virtual processor and is capable of performing various processes according to programs stored in memory 1120. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to enhance the parallel processing capabilities of electronic device 1100.

[0142] The electronic device 1100 typically includes a plurality of computer storage media. Such media can be any accessible media that can be obtained by the electronic device 1100, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 1120 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 1130 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk, or any other medium that can be used to store information and / or data and can be accessed within the electronic device 1100.

[0143] The electronic device 1100 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 11 , a disk drive for reading from or writing to a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 1120 may include a computer program product 1125 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0144] The communication unit 1140 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device 1100 can be implemented as a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the electronic device 1100 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or other network nodes.

[0145] Input device 1150 may be one or more input devices, such as a mouse, keyboard, or trackball. Output device 1160 may be one or more output devices, such as a display, a speaker, or a printer. Electronic device 1100 may also communicate with one or more external devices (not shown) via communication unit 1140 as needed, such as storage devices, display devices, or the like, with one or more devices that allow a user to interact with electronic device 1100, or with any device that allows electronic device 1100 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0146] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0147] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0148] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0149] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0150] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0151] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, not exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. An object tracking method, comprising: determining an optical configuration associated with an operating mode of a first device, the first device comprising a motion sensor and at least one light emitting element, the optical configuration for controlling light emission of the at least one light emitting element; as well as The first device is arranged based at least on the optical configuration to perform object tracking by tracking light emitted by the at least one light emitting element and / or based on sensory data of the motion sensor.

2. The method according to claim 1, wherein the working mode is related to at least one of the following: the scene in which the object is tracked, or A base to which the first device is attached or included.

3. The method of claim 2, wherein the object tracking is performed by a second device, and The working mode corresponding to the first base located at the first preset position is the short-distance mode, and the working mode corresponding to the second base located at the second preset position is the long-distance mode, and The first preset position and the second preset position are associated with a subject wearing the second device, and wherein the second preset position is farther away from a wearing position of the second device on the subject than the first preset position.

4. The method of claim 3, wherein determining the optical configuration comprises: If the working mode is the long-distance mode, disabling some of the at least one light-emitting element; as well as If the working mode is the short-distance mode, the light-emitting element on the first base is disabled.

5. The method of claim 3, wherein determining the optical configuration comprises: If the working mode is the long-distance mode, determining that the enabled light-emitting element emits light at a first preset brightness; or If the working mode is the short-distance mode, determining the enabled light emitting element to The light is emitted at a second preset brightness, and the first preset brightness is higher than the second preset brightness.

6. The method according to claim 2, further comprising: receiving an identification signal from the base; as well as The base is determined based on the identification signal.

7. The method of claim 1 , wherein determining the optical configuration comprises: If the operating mode indicates that the first device is out of the light tracking range for object tracking, the at least one light emitting element is disabled.

8. The method of claim 1 , wherein configuring the first device based at least on the optical configuration comprises: determining a sensing configuration for the motion sensor associated with the operating mode; as well as The first device is set up based on the sensing configuration and the optical configuration.

9. The method of claim 1, wherein the first device is one of a plurality of first devices, and the optical configuration is associated with a respective operating mode of the plurality of first devices.

10. The method of claim 1, wherein the first device is one of a plurality of first devices, and the optical configuration of the first device is at least partially different from optical configurations of other devices of the plurality of first devices except the first device.

11. The method of claim 1 , wherein the optical configuration comprises at least one of: a respective activation state of the at least one light emitting element, A light spot pattern formed by an enabled light emitting element among the at least one light emitting element, the brightness of the light emitted by the enabled light-emitting element, The light emission timing of the enabled light emitting elements.

12. The method of claim 2, wherein determining the optical configuration associated with the operating mode of the first device comprises: determining a first optical configuration based on the base; as well as A second optical configuration different from the first optical configuration is determined based on the scene.

13. The method according to claim 1, further comprising: In response to the first device being attached to the base, power is supplied to the base through the first device.

14. The method according to claim 2, further comprising: Tracking a combined spot of light emitted by the at least one light emitting element and light emitted by the light emitting element on the base; as well as The object tracking is performed based on tracking the combined light spot.

15. The method of claim 1, wherein the object tracking comprises tracking at least one of: the first device, or A human body wearing the first device.

16. An apparatus for object tracking, comprising: an optical configuration determination module configured to determine an optical configuration associated with an operating mode of a first device, the first device comprising a motion sensor and at least one light emitting element, the optical configuration being used to control light emission of the at least one light emitting element; as well as A device setting module is configured to set the first device based at least on the optical configuration to perform object tracking by tracking the light emitted by the at least one light emitting element and / or based on the sensing data of the motion sensor.

17. An electronic device comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 15 when executed by the at least one processing unit.

18. The electronic device of claim 17, wherein the first device is a tracker, the second device is a head mounted display device, and the electronic device comprises at least one of the tracker or the head mounted display device.

19. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 15.

Images