Method and apparatus for device control, device, storage medium, and program product

Abstract

Embodiments of the present disclosure provide a method and apparatus for device control, a device, a storage medium, and a program product. The method comprises: controlling light sources at locators among a first set of locators to be turned on the basis of a first set of time sequences; controlling light sources at locators among a second set of locators to be turned on the basis of a second set of time sequences, wherein the first set of time sequences and the second set of time sequences are configured to synchronize the turn-on time of the light source at the at least one locator among the first set of locators with the turn-on time of the light sources at some locators among the second set of locators; and controlling an image collector to execute image collection at least on the basis of a third time sequence, wherein the third time sequence is configured to enable the image collector to execute image collection when the light source at the at least one locator among the first set of locators and the light sources at some locators among the second set of locators are synchronously turned on.

Description

Method, apparatus, device, storage medium and program product for device control

[0001] The present application claims priority to the Chinese patent application No. 202410454996.7, filed on April 15, 2024, entitled “Method, apparatus, device, storage medium and program product for device control”, the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] Example embodiments of the present disclosure generally relate to the field of computers, and in particular, to a method, apparatus, device, computer-readable storage medium and computer program product for device control. BACKGROUND

[0003] Extended Reality (XR) is widely researched and applied. XR combines hardware devices and various technical means to fuse virtual content and real scenes, providing users with a unique sensory experience. XR includes, for example, Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR).

[0004] Thus, a user can be provided with an immersive interactive experience in a virtual environment by wearing an XR device. SUMMARY

[0005] In a first aspect of the present disclosure, a method for device control is provided. The method comprises: controlling a light source at each positioner in a first group of positioners to perform lighting according to a first group of timing; controlling a light source at each positioner in a second group of positioners to perform lighting according to a second group of timing, the first group of timing and the second group of timing being configured to synchronize the lighting time of the light source at at least one positioner in the first group of positioners with the lighting time of the light source at a part of the positioners in the second group of positioners; and controlling an image collector to perform image collection according to at least a third timing, the third timing being configured to cause the image collector to perform image collection when at least one positioner in the first group of positioners and a part of the positioners in the second group of positioners are synchronously lit.

[0006] In a second aspect of the disclosure, an apparatus for device control is provided. The apparatus comprises: a first lighting control module configured to control light sources at individual positioners in a first group of positioners to perform lighting according to a first group of timing; a second lighting control module configured to control light sources at individual positioners in a second group of positioners to perform lighting according to a second group of timing, the first group of timing and the second group of timing being configured to synchronize lighting time of light sources at part of the positioners in the first group of positioners with lighting time of light sources at at least one positioner in the second group of positioners; and an image acquisition module configured to control an image acquirer to perform image acquisition according to at least a third timing, the third timing being configured to cause the image acquirer to perform image acquisition when at least one positioner in the first group of positioners and part of the positioners in the second group of positioners are synchronously lit.

[0007] In a third aspect of the disclosure, an electronic device is provided. The device comprises at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. The instructions, when executed by the at least one processing unit, cause the device to perform the method of the first aspect.

[0008] In a fourth aspect of the disclosure, a computer-readable storage medium is provided. The computer-readable storage medium has stored thereon a computer program, the computer program being executable by a processor to implement the method of the first aspect.

[0009] In a fifth aspect of the disclosure, a computer program product is provided. The computer program product is tangibly stored in a computer storage medium and comprises computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.

[0010] It is to be understood that the details set forth in this section are not intended to limit key or critical features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description. BRIEF DESCRIPTION OF DRAWINGS

[0011] The above and other features, aspects, and advantages of embodiments of the present disclosure will become more apparent from the following detailed description in conjunction with the accompanying drawings, in which like reference numerals denote like elements, and in which:

[0012] FIG. 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

[0013] FIG. 2 shows a flowchart of a process of device control according to some embodiments of the present disclosure;

[0014] FIG. 3 shows a schematic diagram of an example of a first set of timings of a first set of positioners, a second set of timings of a second set of positioners, and a third set of timings of an image collector, according to some embodiments of the present disclosure;

[0015] FIG. 4 shows a flowchart of a process of device control, according to some embodiments of the present disclosure;

[0016] FIG. 5 shows a schematic diagram of a set of images collected by an image collector, according to some embodiments of the present disclosure;

[0017] FIG. 6 shows a block diagram of an apparatus for device control, according to some embodiments of the present disclosure; and

[0018] FIG. 7 shows a block diagram of an electronic device capable of implementing one or more embodiments of the present disclosure. DETAILED DESCRIPTION

[0019] It can be understood that, before using the technical solutions disclosed in the embodiments of the present disclosure, the type of personal information involved in the present disclosure, the range of use, the scenario of use, etc. should be informed to the user and the authorization of the user should be obtained in a proper manner according to relevant laws and regulations.

[0020] For example, in response to receiving an active request of a user, a prompt information is sent to the user to explicitly prompt the user that the operation requested to be performed will require obtaining and using personal information of the user. Thus, the user can voluntarily choose whether to provide personal information to the electronic device, application program, server or storage medium, etc. software or hardware performing the operation of the technical solutions of the present disclosure according to the prompt information.

[0021] As an optional but non-limiting implementation manner, in response to receiving an active request of a user, the manner of sending a prompt information to the user may, for example, be a pop-up window manner, in which the prompt information can be presented in a text manner. In addition, the pop-up window can also carry a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0022] It can be understood that the above notification and obtaining of user authorization process is only illustrative and does not limit the implementation manner of the present disclosure, and other manners meeting relevant laws and regulations can also be applied to the implementation manner of the present disclosure.

[0023] It can be understood that the data involved in the present technical solutions (including but not limited to the data itself, the acquisition or use of the data) should comply with the requirements of relevant laws and regulations and relevant provisions.

[0024] Embodiments of the present disclosure will be described below in more detail with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be embodied in various forms and should not be interpreted as being limited to the embodiments set forth herein; rather, these embodiments are provided so as to more completely and thoroughly understand the present disclosure. It is understood that the drawings and embodiments of the present disclosure are for exemplary purposes only and are not intended to limit the scope of protection of the present disclosure.

[0025] It is noted that the headings provided herein are not limitations of the disclosure. Various embodiments are described throughout this document and any type of embodiment can be included under any heading. Moreover, embodiments described in any heading can be combined with any other embodiment described in the same heading and / or in a different heading in any manner.

[0026] In the description of embodiments of the present disclosure, the term "includes" and its derivatives are to be interpreted as including but not limited to. The term "based on" is to be interpreted as "based, at least in part, on". The term "one embodiment" or "an embodiment" is to be interpreted as "at least one embodiment". The term "some embodiments" is to be interpreted as "at least some embodiments". Other explicit and implicit definitions can also be included below. The terms "first", "second", etc. can refer to different or same objects. Other explicit and implicit definitions can also be included below.

[0027] FIG. 1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. The environment 100 can be a physical scene, i.e., the environment 100 can be an example of a real-world actual scene. In the environment 100, a user 110 can implement interactive operations by wearing at least one XR device. The at least one XR device can include a head-mounted XR device 120, an XR manipulator 122-1 and an XR manipulator 122-2 (which can be referred to individually or collectively as XR manipulators 122) held by the left and right hands respectively, and a plurality of locators 124-1 and 124-2 which can be worn on other parts of the body such as the lower limbs. The locators can also be referred to as trackers. In some embodiments, the XR manipulator 122-1 can include a locator 123-1, the XR manipulator 122-2 can include a locator 123-2, and the locators 123-1 and 123-2 can belong to a first group of locators (each of which is referred to as a first locator 123). Correspondingly, the locators 124-1 and 124-2 can belong to a second group of locators (each of which is referred to as a second locator 124). The hand-held XR manipulators 122 can be any suitable type of device controlled by the hands, such as a hand grip, etc. The second locators 124 can be any suitable type of trackers for being worn on various parts of the body, such as the waist, the arms, etc. In such examples, the head-mounted XR device 120 can communicate with the XR manipulators 122 and the second locators 124 to implement interactions with the user in a cooperative manner.

[0028] In some embodiments, the XR device can include an image collector, such as a camera, an infrared camera, etc., for collecting images to take images of the physical space. The image collector can be provided on one or more XR devices respectively. Exemplarily, the image collector can be provided on the head-mounted XR device 120 to collect images of a wider spatial range based on a higher spatial position. If an infrared camera is provided on the head-mounted XR device 120, correspondingly, at least one infrared light source can be provided on the XR manipulators 122 and the second locators 124 respectively, so that the infrared camera can take images of the infrared light sources on the XR manipulators 122 and the second locators 124, and thus identify and locate the XR manipulators 122 and the second locators 124 according to the obtained images.

[0029] In other scenarios, the image collector for image collection can be independent of the XR device (e.g., independent of the head-mounted XR device 120). Such an image collector can be independently deployed for image perception of the first locators 123, the second locators 124, and other devices and environments, etc. in the environment.

[0030] In some embodiments, the user 110 can utilize multiple XR devices to communicate with the electronic device 130 to utilize the electronic device 130 to process data acquired by the XR devices and to issue data to the XR devices. It should be appreciated that in some cases, the XR devices 120 can also not communicate with the electronic device 130 (or in other words, the environment 100 can also exemplarily not include the electronic device 130). In this case, the XR manipulator 122-1 (and the first positioner therein), the XR manipulator 122-2 (and the first positioner therein), the second positioner 124-1, the second positioner 124-2, and other XR devices can be interacted with through the head-mounted XR device 120. Specifically, the other XR devices can be interacted with through the XR control device 121 in the head-mounted XR device 120. It should be appreciated that the XR control device 121 can not be limited to being disposed in the head-mounted XR device 120, it can be disposed in other XR devices, or it can exist as a standalone control device.

[0031] In the environment 100, the user 110 can utilize the XR devices to acquire a virtual environment 140. The virtual environment 140 can exemplarily be a space. In some embodiments, a virtual object 150 of the user 110 can be generated in the virtual environment 140, so that the user 110 can have an immersive interactive experience in the virtual environment 140 through the virtual object 150, for example, the user 110 can adjust the actions of the virtual object 150, etc. In some embodiments, virtual tools and / or virtual objects of other users can be provided in the virtual environment 140, so that the user 110 can interact with the virtual tools in the virtual environment 140 through the virtual object 150, and can also interact with the virtual objects of other users through the virtual object 150.

[0032] The electronic device 130 can be a separate device capable of communicating with the XR devices and / or other image capture devices, such as a server, a computing node, etc. for image or data processing, or can be integrated with the XR devices and / or other image capture devices. In some embodiments, the electronic device 130 can be implemented as an XR device, that is, in this case, the XR device can implement all the functions of the electronic device 130. It should be appreciated that the above description of the electronic device 130 is merely exemplary and not limiting, and the electronic device 130 can be implemented as a device in multiple forms, structures, or categories, and embodiments of the present disclosure have no limitation in this regard.

[0033] It should be appreciated that the structure and function of the various elements in the environment 100 are described for illustrative purposes only, and do not imply any limitation on the scope of the present disclosure.

[0034] As briefly mentioned above, a user can achieve an immersive experience in a virtual environment by wearing an XR device. Therefore, when a user operates the XR device, positioning tracking needs to be implemented for some XR devices. Currently, in the field of XR, the positioning tracking of a tracker (i.e., a locator) or a handheld manipulator (such as a handle) is mainly achieved by deploying a locator with a specific light source (for example, an optical infrared lamp). Specifically, the infrared lamp of the handle or other tracker is photographed by a camera to track in combination with an IMU (Inertial Measurement Unit) attitude.

[0035] Generally, it is desirable to produce and use a unified somatosensory tracker, which not only facilitates production, but also facilitates use and expansion. However, if the appearance of the somatosensory tracker and the positions of the light sources, light spots and the like provided therein are all completely consistent, it will be difficult to distinguish different trackers. In addition, according to different scenes, the number of trackers used will also be indefinite, so that the distinction of the trackers can only rely on the relative position of the trackers or the IMU attitude for judgment, which will lead to great interference and difficulty for detecting and identifying the trackers. Therefore, when multiple trackers and handles are used at the same time, how to accurately distinguish different locators among them and avoid misjudgment and interference is an important task to be solved.

[0036] Embodiments of the present disclosure propose a scheme for device control. According to various embodiments of the present disclosure, the light sources at each locator in a first group of locators are controlled to perform lighting according to a first group of timing. Then, the light sources at each locator in a second group of locators are controlled to perform lighting according to a second group of timing, the first group of timing and the second group of timing are configured to synchronize the lighting time of the light source at at least one locator in the first group of locators with the lighting time of the light source at part of the locators in the second group of locators. Next, the image collector is controlled to perform image collection at least according to a third timing, the third timing is configured to make the image collector perform image collection when at least one locator in the first group of locators and part of the locators in the second group of locators are synchronously lit. Thus, this scheme can realize the time-sharing lighting of the locators in the second group of locators, and at the same time be compatible with the lighting of the first group of locators, realizing the distinction of different locators, avoiding the positioning confusion when detecting according to the photographed image, and further improving the efficiency and accuracy of positioning tracking.

[0037] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

[0038] FIG. 2 illustrates a flowchart of a process 200 of device control, according to some embodiments of the present disclosure. For ease of discussion, these embodiments will be described with reference to the environment 100 of FIG. 1. In some examples, these embodiments can be implemented in the XR control device 121 of FIG. 1. In other examples, these embodiments can also be implemented in a remote controller, which can be provided in the electronic device 130 of FIG. 1, for example. The following specific embodiments are by way of example only and are not intended to be limiting in any way.

[0039] It should also be appreciated that while the example embodiments are described with reference to the environment 100 of FIG. 1 involving XR devices, the device control scheme provided by embodiments of the present disclosure can equally be applied to non-XR environments, as long as there is a need to track and locate the locators deployed in such environments with the image collector.

[0040] As shown in FIG. 2, at block 210, the XR control device 121 can control the light sources at each of the first locators 123 in the first set of locators to perform lighting according to a first set of timing. In some embodiments, the light sources include, but are not limited to, infrared light sources. The image collector can recognize and capture the light sources, and the recognition and location of the first locators 123 and the locators 124 can be achieved based on the captured images. In some embodiments, each of the first locators 123 is deployed at the XR manipulators 122. In such embodiments, the XR manipulators 122 can be recognized and located through each of the first locators 123.

[0041] In some embodiments, the first set of locators includes a plurality of the first locators 123, and wherein the plurality of the first timing corresponding to the plurality of the first locators 123 is configured to cause the light sources at the plurality of the first locators 123 to be lit synchronously. At least one of the first locators 123 can be deployed at each of the XR manipulators 122. In such embodiments, the image collector can directly distinguish the corresponding XR manipulators 122 based on the captured images each time the light sources at the plurality of the first locators 123 are captured. Thus, the light sources at the plurality of the first locators 123 can be controlled to be lit synchronously. In some embodiments, the first set of locators can also include only a single first locator, and in some examples, the locator can be included in any of the XR manipulators 122.

[0042] With reference to FIG. 1, taking the first set of locators including the first locator 123-1 of the XR manipulator 122-1 held by the left hand of the user and the first locator 123-2 of the XR manipulator 122-2 held by the right hand of the user as an example, when the image collector simultaneously captures the light sources at the first locator 123-1 and the first locator 123-2, the light spots corresponding to the left-hand XR manipulator 122-1 and the right-hand XR manipulator 122-2 can be directly distinguished on the image, so as to identify the positions and postures of the left-hand XR manipulator 122-1 and the right-hand XR manipulator 122-2.

[0043] In some embodiments, the light source patterns of the plurality of first locators 123 are different. In such embodiments, when the image collector captures the light sources of the plurality of first locators 123, the corresponding light source patterns (e.g., light spots) on the image are different, so that the corresponding manipulators of the plurality of first locators 123 can be quickly distinguished. In some embodiments, the light source in the locator can include a single light source having a corresponding light spot. In some embodiments, the light source in the locator can include a plurality of sub-light sources, which can have a certain positional relationship, so that the corresponding light source light spot can be formed by controlling the sub-light sources.

[0044] In block 220, the XR control device 121 can control the light sources at each second locator 124 in the second set of locators to perform lighting according to a second set of timing, the first set of timing and the second set of timing being configured to synchronize the lighting time of the light source at at least one first locator 123 in the first set of locators with the lighting time of the light source at part of the second locators 124 in the second set of locators. In some embodiments, the light source pattern of the first set of locators is different from the light source pattern of the second set of locators, for example, the light source pattern of any one first locator 123 is different from the light source pattern of any one second locator 124.

[0045] In some scenarios, the image collector can simultaneously capture images of the first set of locators and the second set of locators, and in other scenarios, the image collector can be caused to simultaneously capture images of the first set of locators and the second set of locators in order to achieve better identification of the posture and action of the user 110. Based on this, the light source pattern of the first set of locators can be made different from the light source pattern of the second set of locators. In this way, when the image collector simultaneously captures images of the first locators 123 and part of the second locators 124, the two can be easily distinguished. Therefore, by making the light source pattern of the first set of locators different from the light source pattern of the second set of locators, and synchronizing the lighting time of the light source at at least one first locator 123 with the lighting time of the light source at part of the second locators 124 in the second set of locators, the positioning tracking effect can be improved.

[0046] In some embodiments, the second set of locators includes a plurality of second locators 124, and wherein the plurality of second timings corresponding to the plurality of second locators 124 are configured to cause the light sources at the plurality of second locators 124 to be sequentially lit up. In some embodiments, the light source patterns of the plurality of second locators 124 are the same.

[0047] Since the second locators 124 can be used by the user 110 simultaneously for tracking and locating, the external shapes and internal configurations of the plurality of second locators 124 can be the same. Accordingly, the light source patterns of the plurality of second locators 124 can be the same. It should be appreciated that the plurality of second locators 124 can be the same kind of locators. Thus, in such embodiments, by setting the plurality of second timings to cause the light sources at the corresponding plurality of second locators 124 to be sequentially lit up, the time-sharing lighting up of the plurality of second locators 124 can be achieved. This way, only one second locator 124 can be lit up when the image collector collects images, so as to avoid the abnormal situation of identification confusion caused by simultaneous lighting up of the plurality of second locators 124.

[0048] At block 230, the XR control device 121 can control the image collector to perform image collection according to at least a third timing, the third timing being configured to cause the image collector to perform image collection when at least one first locator 123 (or all of the first locators 123) in the first set of locators and part of the second locators 124 in the second set of locators are simultaneously lit up.

[0049] In such embodiments, by setting the third timing to cause the image collector to perform image collection when at least one first locator 123 (or all of the first locators 123) in the first set of locators and part of the second locators 124 in the second set of locators are simultaneously lit up, the simultaneous use of the XR manipulators 122 where the first locators 123 are located and the second locators 124 can be achieved, the tracking of at least one XR manipulator 122 can be achieved while the tracking and locating of the plurality of second locators 124 are also achieved, and the tracking and locating of the XR manipulators 122 and the second locators 124 can be achieved without interfering with each other.

[0050] FIG. 3 illustrates a schematic diagram of an example of the first set of timings of the first set of locators, the second set of timings of the second set of locators, and the third timing of the image collector, according to some embodiments of the present disclosure. The example 300 can be implemented in the environment 100 of FIG. 1. The example 300 can be applied in part of the process 200.

[0051] As shown in FIG. 3, the example 300 includes a third timing 310 of the image collector, and further includes a first timing 320-1 of the first positioner 123-1 of the XR manipulator 122-1 and a first timing 320-2 of the first positioner 123-2 of the XR manipulator 122-2 (which can be referred to individually or collectively as the first timing 320), a second timing 330-1 of the second positioner 124-1 and a second timing 330-2 of the second positioner 124-2 (which can be referred to individually or collectively as the second timing 330). The third timing 310 includes a plurality of pulled-up pulses 301, which can represent the exposure of the head-mounted XR device 120 and the XR manipulators 122. The first timing 320 and the second timing 330 each include a plurality of pulled-up pulses 302, each of which represents the lighting up of a corresponding light source.

[0052] Specifically, based on the first timing 320-1 and the first timing 320-2, the light sources at the XR manipulator 122-1 and the XR manipulator 122-2 are synchronously lit up. Based on the second timing 330-1, the second timing 330-2, and the first timing 320, the lighting up times of the light sources at the second positioner 124-1 and the second positioner 124-2 are different, and each of the second positioners is respectively synchronized with the lighting up times of the light sources at the respective XR manipulators 122. In this context, the “synchronous lighting up” and “synchronization of lighting up times” of different positioners can include controlling the positioners to light up at the same time, or to have a common lighting up state within a certain time period, or to be lit up such that the image collector collects the positioners during one exposure of image collection.

[0053] Further, based on the second timing 330-1 and the second timing 330-2, the light sources at the second positioner 124-1 and the second positioner 124-2 are sequentially lit up (i.e., lit up in time division). Based on the third timing 310, the image collector performs image collection when the XR manipulator 122-1 and the XR manipulator 122-2, and one of the second positioner 124-1 and the second positioner 124-2 are both lit up.

[0054] In some embodiments, the periods of the respective timings in the first group of timings are the same, and the periods of the respective timings in the second group of timings are the same. In some embodiments, the periods corresponding to the first group of timings are different from the periods corresponding to the second group of timings.

[0055] For example, referring to FIG. 3, the first group of time sequences includes the first time sequence 320-1 and the first time sequence 320-2, and the second group of time sequences includes the second time sequence 330-1 and the second time sequence 330-2. The period of the first time sequence 320-1 and the first time sequence 320-2 can be the same, and the period of the second time sequence 330-1 and the second time sequence 330-2 can also be the same. However, the period of the first time sequence 320 and the second time sequence 330 can be different. Because the light sources of the first positioner 123-1 and the first positioner 123-2 corresponding to the first time sequence 320-1 and the first time sequence 320-2, respectively, can be photographed at the same time by the image collector, the XR manipulator 122-1 and the XR manipulator 122-2 can be distinguished, and thus the period of the first time sequence 320-1 and the first time sequence 320-2 can be the same, and the first time sequence 320-1 and the first time sequence 320-2 can be the same. In addition, because the light sources at the plurality of second positioners 124 can be sequentially lighted, that is, the second time sequence 330-1 and the second time sequence 330-2 are staggered, the period of the second time sequence 330-1 and the second time sequence 330-2 can be the same, and the period of the first time sequence 320 and the second time sequence 330 can be different.

[0056] Thus, through the first time sequence 320 of the first positioner 123, the second time sequence 330 of the second positioner 124, and the third time sequence 310 of the image collector, the time-sharing lighting of the second positioner 124 is realized, and the tracking effect of the second positioner 124 can be improved. In addition, the time-sharing lighting can reduce the power consumption of each second positioner 124, thereby prolonging the use time of the product.

[0057] In some embodiments, if it is detected that the connection of the second group of positioners is completed, the XR control device 121 can determine the time sequence corresponding to each second positioner 124 in the second group of positioners based on the attribute information of the second group of positioners. The time sequence corresponding to each second positioner 124 in the second group of positioners is based on the order in which each second positioner 124 is lighted and / or the period in which the second group of positioners is sequentially polled and lighted. In some embodiments, the attribute information of the second group of positioners at least includes the number of the second positioners 124 in the second group of positioners. In some embodiments, the attribute information of at least one second positioner 124 can also include the unique identification number of each second positioner 124.

[0058] Specifically, after detecting the second set of locators connected, the XR control device 121 can determine the order in which each second locator 124 is lit according to the number of locators and the identification number of the second set of locators, and can determine the period in which each second locator 124 is sequentially polled and lit according to the number of locators of the second set of locators. Then, based on the period and the order in which each second locator 124 is lit, the timing of each second locator 124 can be determined. In this way, the time-sharing lighting of each second locator 124 is facilitated.

[0059] In some embodiments, the period corresponding to the second set of timings is an integer multiple of the period corresponding to the first set of timings, and wherein the integer multiple is determined based on the number of second locators 124 in the second set of locators. For example, if the number of second locators is 2, then the period of the second set of timings corresponding thereto is 2 times the period of the first set of timings. Referring to FIG. 3, the period of the second timing 330 can be 2 times the period of the first timing 320. In this way, the light sources of each second locator 124 in the second set of locators can be sequentially lit.

[0060] In some embodiments, in controlling the light sources at each second locator 124 in the second set of locators to perform lighting according to the second set of timings, for a first image acquisition period, the XR control device 121 can respectively configure each timing in the second set of timings to each second locator 124 in the second set of locators, and receive a reply from each second locator 124 in the second set of locators for the configuration of each timing in the second set of timings. The first image acquisition period can correspond to a complete period in which the second set of locators is performed a round of time-sharing lighting, and there are multiple acquisition points in this image acquisition period.

[0061] In some embodiments, in controlling the image acquirer to perform image acquisition according to at least the third timing, if a reply is received from each second locator 124 in the second set of locators for the configuration of each timing in the second set of timings within a predetermined time, the XR control device 121 can control the image acquirer to perform image acquisition for a first image acquisition period according to at least the third timing. And if a reply is not received from one or more second locators 124 in the second set of locators within the predetermined time, the XR control device 121 can determine that the configuration of the second set of timings fails in the first image acquisition period.

[0062] Illustratively, in configuring the second set of timings, if the light source of the current second locator 124 in the second set of locators completes time-sharing lighting according to the corresponding timing, a reply message about the timing configuration is sent. Then, based on the reply message, the XR control device 121 can configure the corresponding timing for the next second locator 124 of the current second locator, so that the light source of the next second locator 124 performs time-sharing lighting according to the corresponding timing.

[0063] In such embodiments, whether the second locators 124 are configured successfully can be determined according to the reply and reply time of the second locators 124 to the timing configuration. In the case that the second locators 124 are configured successfully, the current image acquisition cycle can perform image acquisition. If the configuration fails, it means that the timing synchronization of the current image acquisition cycle fails, and the second timing needs to be reconfigured in the next image acquisition cycle. In this way, the accuracy of the second locators 124 being illuminated at different time points can be ensured, and the tracking efficiency of the second locators 124 can be improved.

[0064] In some embodiments, the XR control device 121 can perform image analysis on the first image acquired by the image acquisition device to determine the position information and / or pose information of the second locators 124 that are illuminated in the second group of locators at the acquisition time of the first image. In some embodiments, based on the second group of timing, the XR control device 121 can determine the second locators 124 that are illuminated in the second group of locators at the acquisition time of the first image, and write the serial number of the determined second locators 124 in the frame information of the first image. And when determining the position information and / or pose information corresponding to the second locators, the XR control device 121 can determine that the position information and / or pose information corresponding to the second locators are included in the frame information of the first image.

[0065] For example, if the timing configuration corresponding to the next second locator 124 of the current second locator 124 is completed, based on the completed timing, the XR control device 121 can write the serial number of the next second locator 124 in the configuration information of the image acquisition device before controlling the image acquisition device to acquire the image of the next second locator 124. After the XR control device 121 writes the serial number of the next second locator 124 in the configuration information of the image acquisition device, the frame information of the image of the next second locator 124 acquired by the image acquisition device includes the corresponding serial number. Then, when the upper layer obtains the image, it will obtain that the current image is illuminated by the next second locator 124 through the image information, and the current image also includes the image of the light source of the first locator 123 of the XR manipulator 122, so as to perform image analysis. In this way, the specific second locators 124 that are illuminated can be easily identified through the frame information, which is conducive to realizing the positioning tracking and obtaining the pose information of the body part of the user 110.

[0066] In some embodiments, the XR control device 121 can receive the respective used timing from each second localizer 124 in the second set of localizers 124, and determine whether the received timing from each second localizer 124 in the second set of localizers 124 is the same as the second set of timing. If it is determined that at least one of the received timing from at least one second localizer 124 in the second set of localizers 124 is not the same as at least one of the second set of timing, each timing in the second set of timing is reconfigured to each second localizer 124 in the second set of localizers 124, respectively.

[0067] Exemplarily, after the light source of the current second localizer 124 is turned on, the next second localizer 124 that needs to be turned on can immediately report its serial number to the XR control device 121. The XR control device 121 can detect whether the configuration information of the serial number to be written corresponds to the reported serial number of the second localizer 124. If an abnormality occurs, it is considered that the timing of the next second localizer 124 that needs to be turned on is disordered. Then, the configuration of the timing of the second localizer 124 can be re-performed in the next image acquisition cycle to ensure the stability of the timing. Thus, through the timing detection mechanism, it can be detected in real time whether the timing of the second localizer 124 is abnormal, so as to ensure that the time-sharing turning on of each second localizer 124 can be normally performed.

[0068] In some embodiments, the XR control device 121 can detect the connection state of each second localizer 124 in the second set of localizers to determine whether the number of second localizers 124 in the second set of localizers changes. If it is determined that the number of second localizers in the second set of localizers changes, the second set of timing corresponding to the second set of localizers after the change is determined based on the changed number. In some embodiments, the XR control device 121 determines that the first set of localizers and the second set of localizers have been connected to the XR control device 121 before controlling the first set of localizers and the second set of localizers to perform turning on.

[0069] Specifically, if the number of second localizers 124 connected to the XR control device 121 decreases or increases, the timing of the corresponding second localizer 124 is determined based on the changed number. In some embodiments, the XR control device 121 is deployed at the head-mounted XR device 120. Exemplarily, the head-mounted XR device 120 can detect the connection state of each second localizer 124 to determine whether the number of second localizers 124 connected to the head-mounted XR device changes. If the change occurs, the timing of each second localizer 124 corresponding to the second localizer 124 is determined based on the changed number of second localizers 124. Thus, through the detection mechanism of the connection state of the second localizer 124, the flexibility and adaptability of tracking and positioning of multiple second localizers 124 can be improved.

[0070] Through the above disclosed embodiments, time-sharing lighting of the second group of locators can be realized, and meanwhile, lighting of the first group of locators is compatible, avoiding positioning confusion when subsequent detection is performed according to the photographed image, and thus the efficiency and accuracy of positioning tracking in the XR scene can be improved.

[0071] FIG. 4 shows a flowchart of a process of device control according to some embodiments of the present disclosure. The process 400 can be implemented in the environment 100 of FIG. 1. The process 400 can be shown as a specific embodiment of the steps of the process 200. The process 400 can be implemented according to the timing of the example 300 of FIG. 3.

[0072] As shown in FIG. 4, the process 400 involves the relevant procedures of the head-mounted XR device 120, the second locators 124 (including the second locators 124-1 and 124-2), and the XR manipulators 122 (including the XR manipulators 122-1 and 122-2). The operations performed by each second locator 124 are similar, and the operations performed by each XR manipulator 122 are similar. The process 400 can be described in detail taking the example that the XR control device 121 and the image collector are deployed at the head-mounted XR device 120.

[0073] The XR manipulators 122 need to be connected to the head-mounted XR device 120 (in particular, to the XR control device 121 therein), and the second locators 124 need to be connected to the head-mounted XR device 120 (in particular, to the XR control device 121 therein). The head-mounted XR device 120 can detect whether it is determined to be connected to the second locators 124. If it is determined to be connected to the second locators 124 (410), the head-mounted XR device 120 issues respective second timings to the respective second locators 124 (411).

[0074] After being connected to the head-mounted XR device 120 (430), the XR manipulators 122 light up the infrared light sources of their own first locators 123 according to the predetermined first timing (431). That is, the head-mounted device 120 does not need to issue the first timing to the XR manipulators 122 every time in each cycle. The first timing can be configured or defined at the XR manipulators 122. After being connected to the head-mounted device 120, the XR manipulators 122 can perform lighting according to the predetermined first timing. In addition, since the lighting time of the multiple XR manipulators 122 can be the same, the first timing configured at each XR manipulator 122 can also be the same.

[0075] After being connected to the head-mounted XR device 120 (420), each second locator 124 receives the second timing and is configured (421), and then replies to the head-mounted XR device 120 with a configuration completion (422). After receiving the reply (412), the head-mounted XR device 120 determines whether the second locator 124 completes the configuration within a preset time (413). If the second locator 124 does not complete the configuration within the predetermined time, the next cycle reissues the second timing to the second locator 124 (411). If the second locator 124 completes the configuration within the predetermined time, the configuration of the image collector is performed according to the corresponding second timing (414), which can specifically write the serial number of the second locator 124 into the image collector. The second locator 124 also lights up its own infrared light source according to the second timing, achieving time-sharing lighting of the infrared light sources (423). Then, the head-mounted XR device 120 can obtain the serial number of the locator that is lit up according to the frame information of the image captured by the image collector (415), and analyze the image.

[0076] Next, the head-mounted XR device 120 can determine in real time whether the number of second locators 124 changes (416). If it changes, the second timing is updated and issued (411). The second locator 124 can report the current second timing at regular intervals, and then the head-mounted XR device 120 can determine whether the reported second timing is correct when the number of second locators 124 does not change (417). If it is correct, the configuration of the image collector can continue according to the second timing (414). If it is not correct, it is considered that the second timing is chaotic, and the second timing is reissued in the next cycle (411) to ensure the stability of the second timing.

[0077] Taking FIG. 1 as an example, when the head-mounted XR device 120 captures the exposure moment of the XR manipulator 122 and the second locator 124, the first locators 123 in the two XR manipulators 122 are always lit up synchronously, so the first locators 123 in the two XR manipulators 122 are always captured each time of shooting, but the infrared light sources of the multiple second locators 124 are time-sharing lit up. At all frame image exposure moments of shooting the XR manipulator 122, the left-hand XR manipulator 122-1 and the right-hand XR manipulator 122-2 will synchronously light up the respective infrared light sources. Before the current frame exposure, the head-mounted XR device 120 writes the serial number of the second locator 124-1 in the configuration of the image collector. At the exposure moment, the infrared light source of the second locator 124-1 is lit up, and the infrared light source of the second locator 124-2 is turned off. When obtaining this frame image, the upper layer obtains that the current image is lit up by the second locator 124-1 through the image information, and obtains the images of the synchronously lit up second locator 124-1 and the locator 123 of the XR manipulator 122 for analysis.

[0078] Before the next frame exposure, the head-mounted XR device 120 writes the serial number of the second locator 124-2 in the configuration of the image collector. At the moment of exposure, the second locator 124-2 is lit, and the second locator 124-1 is turned off. When acquiring this frame of image, the upper layer acquires the current image through the image information that the second locator 124-2 is lit, and acquires the image of the synchronous light of the second locator 124-2 and the infrared light source of the left and right XR manipulators 122 for analysis. In this way, the tracking effect of the two XR manipulators 122 and the two second locators 124 can be achieved.

[0079] FIG. 5 shows a schematic diagram of an image set 500 collected by an image collector according to some embodiments of the present disclosure. The image set 500 can be implemented in the environment 100 of FIG. 1. The image set 500 can be shown as an example of the execution result of the process 200. The image set 500 can be shown as an example of the execution result of the method implemented by using the example 300 of FIG. 3. The image set 500 can be shown as an example of the execution result of the process 400.

[0080] As shown in FIG. 5, the image set 500 includes an image 510 and an image 520. The image 510 is an image collected by the image collector when the infrared light source of the second locator 124-1 is lit, and the serial number of the second locator 124-1 is recorded in the frame information of the image 510. The image 520 is an image collected by the image collector when the infrared light source of the second locator 124-2 is lit, and the serial number of the second locator 124-2 is recorded in the frame information of the image 520.

[0081] Since the two XR manipulators 122-1 and 122-2 are also lit at the same time when the infrared light source of the second locator 124-1 is lit. Accordingly, the three light spots in the image 510 respectively represent the exposure of the infrared light source of the second locator 124-1, the XR manipulator 122-1 of the left hand, and the XR manipulator 122-2 of the right hand. Since the two XR manipulators 122-1 and 122-2 are also lit at the same time when the infrared light source of the second locator 124-2 is lit. Accordingly, the three light spots in the image 520 respectively represent the exposure of the infrared light source of the second locator 124-2, the XR manipulator 122-1 of the left hand, and the XR manipulator 122-2 of the right hand. In addition, it can be seen that the light spots have a certain arrangement in space. Thus, the process for device control of the embodiments of the present disclosure realizes the time-sharing light control of the locators, and realizes the tracking and positioning of the locators.

[0082] FIG. 6 shows a schematic structural block diagram of an apparatus 600 for device control, according to certain embodiments of the present disclosure. The apparatus 600 can be implemented as or included in the XR control device 121. Various modules / components in the apparatus 600 can be implemented by hardware, software, firmware, or any combination thereof.

[0083] As shown, the apparatus 600 includes a first lighting control module 610 configured to control the light sources at the individual locators in the first group of locators to perform lighting according to a first group of timing; a second lighting control module 620 configured to control the light sources at the individual locators in the second group of locators to perform lighting according to a second group of timing, the first group of timing and the second group of timing being configured to synchronize the lighting time of the light sources at the at least one locator in the first group of locators with the lighting time of the light sources at the locators in the second group of locators; and an image acquisition module 630 configured to control the image acquirer to perform image acquisition according to at least a third timing, the third timing being configured to cause the image acquirer to perform image acquisition when the at least one locator in the first group of locators and the locators in the second group of locators are synchronously lit.

[0084] In some embodiments, the period corresponding to the first group of timing is different from the period corresponding to the second group of timing.

[0085] In some embodiments, the periods of the individual timing in the first group of timing are the same, and the periods of the individual timing in the second group of timing are the same.

[0086] In some embodiments, the light source pattern of the first group of locators is different from the light source pattern of the second group of locators.

[0087] In some embodiments, the second group of locators includes a plurality of second locators, and wherein the plurality of second timing corresponding to the plurality of second locators are configured to cause the light sources at the plurality of second locators to be lit sequentially.

[0088] In some embodiments, the light source patterns of the plurality of second locators are the same.

[0089] In some embodiments, the first group of locators includes a plurality of first locators, and wherein the plurality of first timing corresponding to the plurality of first locators are configured to cause the infrared light sources at the plurality of first locators to be synchronously lit.

[0090] In some embodiments, the light source patterns of the plurality of first locators are different.

[0091] In some embodiments, the apparatus 600 further comprises a timing determination module configured to, in response to detecting the connection completion of the second set of locators, determine the timing corresponding to each of the second set of locators based on the attribute information of the second set of locators, the timing corresponding to each of the second set of locators being based on the order in which each of the second set of locators is illuminated and / or the period in which the second set of locators are sequentially polled to be illuminated.

[0092] In some embodiments, the attribute information of the second set of locators comprises at least the number of locators in the second set of locators.

[0093] In some embodiments, the period corresponding to the second set of timings is an integer multiple of the period corresponding to the first set of timings, and wherein the integer multiple is determined based on the number of locators in the second set of locators.

[0094] In some embodiments, the second illumination control module 620 is further configured to, for the first image acquisition period, configure each of the second set of timings to each of the second set of locators respectively; and receive a reply from each of the second set of locators respectively for the configuration of each of the second set of timings.

[0095] In some embodiments, the image acquisition module 630 is further configured to, in response to receiving the reply from each of the second set of locators respectively for the configuration of each of the second set of timings within a predetermined time, control the image acquirer to perform the image acquisition of the first image acquisition period according to at least the third timing; and the apparatus 600 further comprises a configuration failure module configured to, in response to not receiving the reply from one or more of the second set of locators within the predetermined time, determine that the configuration of the second set of timings in the first image acquisition period fails.

[0096] In some embodiments, the apparatus 600 further comprises an image analysis module configured to perform image analysis on the first image acquired by the image acquirer to determine the position information and / or the pose information corresponding to the part of the second set of locators that are illuminated at the acquisition time of the first image.

[0097] In some embodiments, the apparatus 600 further comprises a sequence number writing module configured to, based on the second set of timings, determine the part of the second set of locators that are illuminated at the acquisition time of the first image; and write the sequence number of the determined part of locators in the frame information of the first image; the image analysis module comprises an information determination module configured to determine the position information and / or the pose information corresponding to the part of locators contained in the frame information of the first image.

[0098] In some embodiments, the apparatus 600 further includes a number determination module configured to detect connection states of the respective locators in the second group of locators to determine whether a number of the locators in the second group of locators changes; and in response to determining that the number of the locators in the second group of locators changes, determine a second group of timings corresponding to the second group of locators based on the changed number.

[0099] In some embodiments, the apparatus 600 further includes a timing reconfiguration module configured to receive respective used timings from the respective locators in the second group of locators; determine whether the timings received from the respective locators in the second group of locators are the same as the second group of timings; and in response to determining that at least one of the timings received from at least one of the locators in the second group of locators is not the same as at least one of the second group of timings, reconfigure the respective timings in the second group of timings to the respective locators in the second group of locators, respectively.

[0100] In some embodiments, the apparatus 600 can be implemented at an extended reality (XR) control device, and the apparatus 600 further includes a connection determination module configured to determine that the first group of locators and the second group of locators have been connected to the XR control device before controlling the first group of locators and the second group of locators to perform the lighting up.

[0101] In some embodiments, the XR control device includes a head-mounted XR device, and / or wherein the first group of locators are disposed at an XR manipulator.

[0102] The units and / or modules included in the apparatus 600 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units and / or modules can be implemented using software and / or firmware, e.g., machine executable instructions stored on a storage medium. In addition to or instead of machine executable instructions, some or all of the units and / or modules in the apparatus 500 can be implemented at least partially by one or more hardware logic components. As an example and not by way of limitation, example types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SOCs), complex programmable logic devices (CPLDs), etc.

[0103] FIG. 7 shows a block diagram of an electronic device 700 in which one or more embodiments of the disclosure can be implemented. It should be understood that the electronic device 700 illustrated in FIG. 7 is merely an example and should not be construed as limiting on the functionality and scope of the embodiments described herein. The electronic device 700 illustrated in FIG. 7 can be used to implement the XR control device 121 of FIG. 1.

[0104] As shown in FIG. 7, electronic device 700 is in the form of a general- purpose computer. Components of electronic device 700 can include, but are not limited to, one or more processors or processing units 710, memory 720, storage 730, one or more communication units 740, one or more input devices 750, and one or more output devices 760. Processing unit(s) 710 can be physical or virtual processors and capable of executing various processing units according to programs stored in memory 720. In a multi-processing system, multiple processing units execute computer-executable instructions in parallel to improve the processing power of electronic device 700.

[0105] Electronic device 700 typically includes a plurality of computer storage media. Such media can be volatile and / or nonvolatile storage media and removable and / or non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Memory 720 can be volatile (such as random access memory (RAM)), non-volatile (such as read-only memory (ROM), EEPROM, flash memory), or some combination of the two. Storage 730 can be removable or non-removable and can include machine-readable media such as flash drives, magnetic disks, or any other medium that can be used to store information and / or data and that can be accessed by electronic device 700.

[0106] Electronic device 700 can further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 7, a disk drive or other computer-readable media drive can be provided for reading from or writing to a removable, non-removable, volatile or non-volatile computer-readable medium. In these instances, each drive can be connected to the bus (not shown) by one or more data media interfaces. Memory 720 can include a computer program product 725 having one or more program modules configured to carry out the various methods or actions of the various embodiments of the present disclosure.

[0107] Communication unit(s) 740 enable communication with other computing devices. Additionally, the functionality of components of electronic device 700 can be implemented in a single computing cluster or a plurality of computer machines capable of communication with one another through a communication connection. Thus, electronic device 700 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network nodes.

[0108] Input device 750 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. Output device 760 can be one or more output devices, such as a display, a speaker, a printer, etc. Electronic device 700 can also communicate with one or more external devices (not shown) such as a storage device, a display device, etc. through communication unit 740, as desired, in order to obtain further input to electronic device 700, and / or to provide outputs from electronic device 700. Such communication can be effected via an input / output (I / O) interface (not shown).

[0109] According to an example implementation of the present disclosure, a computer readable storage medium is provided having computer executable instructions stored thereon, where the computer executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, a computer program product is also provided that is tangibly stored on a non-transitory computer readable medium and includes computer executable instructions, where the computer executable instructions are executed by a processor to implement the method described above.

[0110] Various aspects of the disclosure are now described with reference to the drawings. In general, the drawings described below are diagrammatic and schematic representations of actual or conceptual structures and processes, and as such, they are not drawn to scale. Certain aspects of the disclosure are described below with reference to flowchart and / or block diagram illustrations of methods, apparatuses, devices, and computer program products according to this disclosure. It will be understood that each block of the flowchart and / or block diagram illustrations, and combinations of blocks in the flowchart and / or block diagram illustrations, can be implemented by computer readable program instructions.

[0111] These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can include a non-transitory computer readable storage medium that can direct a computer, a programmable data processing apparatus, and / or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including instructions which implement aspects of the function / act specified in the flowchart and / or block diagram block or blocks.

[0112] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0113] The computer program product of the present disclosure can be a computer program product, which is a machine-readable medium (media) having instances of the software embodied thereon, such as computer software, firmware, wireless application protocol (WAP), middleware or microcode. For example, a computer program product can be a floppy disk, a CD-ROM, a DVD, a Blu-ray Disc™, a flash drive, a memory stick, a magnetic tape, or a hard disk drive. The machine-readable medium can be a single medium, or multiple media, of the same or different type. The computer program product can be one or more computer program components embodied in medium and / or transmission signals. The computer program product can have one or more computer readable and / or computer executable components embodied in medium and / or transmission signals. The computer program product can be one or more computer readable and / or computer executable components embodied in medium and / or transmission signals. The computer program product can also be at least one or combination of controller(s) with associated computer program component(s), the computer program component(s) being an example of computer program product.

[0114] The foregoing description of implementations has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the implementations to the precise form disclosed. Many modifications and variations are possible in light of the above teaching. It is intended that the scope of the implementations be limited not by this detailed description, but rather by the claims appended hereto.

Claims

1. A method for device control, comprising: controlling light sources at each of a first set of locators to perform lighting according to a first set of timings; controlling light sources at each of a second set of locators to perform lighting according to a second set of timings, the first set of timings and the second set of timings being configured to synchronize lighting time of light sources at at least one of the first set of locators with lighting time of light sources at a portion of the second set of locators; and controlling an image collector to perform image collection according to at least a third timing, the third timing being configured to cause the image collector to perform image collection when at least one of the first set of locators and a portion of the second set of locators are synchronously lit. 2.The method of claim 1, wherein a period corresponding to the first set of timings is different from a period corresponding to the second set of timings. 3.The method of claim 1, wherein a period of each timing in the first set of timings is the same, and a period of each timing in the second set of timings is the same. 4.The method of claim 1, wherein a light source pattern of the first set of locators is different from a light source pattern of the second set of locators. 5.The method of claim 1, wherein the second set of locators comprises a plurality of second locators, and wherein a plurality of second timings corresponding to the plurality of second locators are configured to cause light sources at the plurality of second locators to be lit sequentially. 6.The method of claim 5, wherein light source patterns of the plurality of second locators are the same. 7.The method of claim 1, wherein the first set of locators comprises a plurality of first locators, and wherein a plurality of first timings corresponding to the plurality of first locators are configured to cause light sources at the plurality of first locators to be lit synchronously. 8.The method of claim 7, wherein light source patterns of the plurality of first locators are different. 9.The method of claim 1, further comprising determining the second set of timings at least by: in response to detecting that connection of the second set of locators is completed, determining a timing corresponding to each of the second set of locators based on attribute information of the second set of locators, the timing corresponding to each of the second set of locators being based on an order in which each of the second set of locators is lit and / or a period in which the second set of locators are sequentially polled to be lit. 10.The method of claim 9, wherein the attribute information of the second set of locators comprises at least a number of locators in the second set of locators. 11.The method of claim 10, wherein a period corresponding to the second set of timings is an integer multiple of a period corresponding to the first set of timings, and wherein the integer multiple is determined based on the number of locators in the second set of locators. 12.The method of claim 1, wherein controlling light sources at each of the second set of locators to perform lighting according to a second set of timings comprises: for a first image capture period, configuring each timing in the second set of timings to each positioner in the second set of positioners, respectively; and receiving a reply for the configuration of each timing in the second set of timings from each positioner in the second set of positioners, respectively.

13. The method of claim 12, wherein controlling the image capturer to perform image capture according to at least the third timing comprises: in response to receiving the reply for the configuration of each timing in the second set of timings from each positioner in the second set of positioners, respectively, within a predetermined time, controlling the image capturer to perform image capture of the first image capture period according to at least the third timing; and wherein the method further comprises: in response to not receiving the reply from one or more positioners in the second set of positioners within the predetermined time, determining that the configuration of the second set of timings in the first image capture period fails.

14. The method of claim 1, further comprising: performing image analysis on a first image captured by the image capturer to determine position information and / or pose information corresponding to the portion of positioners in the second set of positioners that are lit at a time of capture of the first image.

15. The method of claim 14, further comprising: based on the second set of timings, determining the portion of positioners in the second set of positioners that are lit at the time of capture of the first image; and writing a sequence number of the determined portion of positioners in frame information of the first image; wherein the determining the position information and / or pose information corresponding to the portion of positioners comprises determining that the position information and / or pose information corresponding to the portion of positioners is included in the frame information of the first image.

16. The method of claim 1, further comprising: detecting a connection status of each positioner in the second set of positioners to determine whether a number of positioners in the second set of positioners changes; and in response to determining that the number of positioners in the second set of positioners changes, determining a changed second set of timings corresponding to the second set of positioners based on the changed number.

17. The method of claim 1, further comprising: receiving a timing used by each positioner in the second set of positioners from each positioner in the second set of positioners, respectively; determining whether the received timing from each positioner in the second set of positioners is the same as the second set of timings; and in response to determining that at least one of the received timings from at least one positioner in the second set of positioners is not the same as at least one of the second set of timings, reconfiguring each timing in the second set of timings to each positioner in the second set of positioners, respectively.

18. The method of claim 1, wherein the method is implemented at an extended reality (XR) control device, and the method further comprises: prior to controlling the first set of positioners and the second set of positioners to perform lighting, determining that the first set of positioners and the second set of positioners are connected to the XR control device. ​ ​ ​ 19. The method of claim 18, wherein the XR control device is deployed at a head-mounted XR device, and / or wherein the first set of positioners are deployed at an XR manipulator.

20. An apparatus for device control, comprising: a first illumination control module configured to control light sources at individual positioners in a first set of positioners to perform illumination according to a first set of timing; a second illumination control module configured to control light sources at individual positioners in a second set of positioners to perform illumination according to a second set of timing, the first set of timing and the second set of timing being configured to synchronize illumination timing of light sources at at least one positioner in the first set of positioners with illumination timing of light sources at a portion of positioners in the second set of positioners; and an image acquisition module configured to control an image acquirer to perform image acquisition at least according to a third timing, the third timing being configured to cause the image acquirer to perform image acquisition when at least one positioner in the first set of positioners and a portion of positioners in the second set of positioners are synchronously illuminated.

21. An electronic device, comprising: at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions when executed by the at least one processing unit cause the electronic device to perform the method of any of claims 1-19.

22. A computer-readable storage medium having stored thereon a computer program, the computer program executable by a processor to implement the method of any of claims 1-19.

23. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method of any of claims 1-19. ​

Images