Tracking system for implementing events in computing environment

Abstract

According to a first aspect of the present disclosure, there is provided a tracking system for implementing events in a computing environment, the system comprising: a sensor array comprising one or more trigger zones, each trigger zone configured to perform an allocation event in the computing environment when activated; the preparation area is configured as a pilot which needs to be activated to enable the one or more trigger areas to work; and at least one processor configured to: process the signal output from the sensor array to determine an order in which the preliminary zone and the one or more trigger zones are activated; and in response to the correct order, sending a command to execute an allocation event of the activated one or more trigger regions.

Description

Technical Field

[0001] The present disclosure relates to a tracking system that allows a user to execute events in a computing environment. Background Art

[0002] Virtual reality (VR) locomotion refers to technologies that enable movement from one location to another (locomotion) within a virtual reality environment. Users consider several factors when choosing an interface for controlling their avatar's locomotion. These factors include:

[0003] - The ability to traverse infinite virtual worlds even within limited physical space;

[0004] - Safe and intuitive to use

[0005] - Compact, not over-engineered

[0006] - Portable and easy to set up.

[0007] Current solutions include:

[0008] - Thumbstick control

[0009] - Devices involving arm waving

[0010] - Omnidirectional treadmill or sliding platform

[0011] - shoe

[0012] - Sensors that detect when a user is running in place.

[0013] One or more of these solutions suffer from one or more of the following drawbacks:

[0014] - Controls are unnatural and unintuitive

[0015] - Cause or aggravate VR motion sickness

[0016] - Unsafe

[0017] - Expensive due to over-engineering

[0018] - Bulky structure that takes up a lot of space

[0019] - Requires a lot of setup and maintenance.

[0020] The object of the present invention is to provide a solution to the above-mentioned drawbacks, without being limited to mobile applications. Summary of the Invention

[0021] According to a first aspect of the present invention, there is provided a tracking system for implementing events in a computing environment, the system comprising: a sensor array including one or more trigger zones, each trigger zone being configured to execute an allocation event in the computing environment when activated; a preparation zone being configured as a precursor that requires activation for the one or more trigger zones to operate; and at least one processor being configured to: process signal outputs from the sensor array to determine the order in which the preparation zone and the one or more trigger zones are activated; and in response to the order being correct, send a command to execute the allocation event for the one or more activated trigger zones.

[0022] According to a second aspect of the present invention, there is provided a method of implementing an event in a computing environment, the method comprising: defining physical boundaries of one or more virtual trigger zones, each virtual trigger zone being assigned an event to be executed in the computing environment when activated; defining separate physical boundaries of a virtual preparatory zone, the virtual preparatory zone acting as a precursor that needs to be activated in order for the one or more virtual trigger zones to function; processing a signal output including the order in which the virtual preparatory zone and the one or more virtual trigger zones are activated; and

[0023] In response to determining that the sequence is correct, a command is sent to execute the assigned event for the activated one or more virtual trigger zones. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Representative embodiments of the invention are herein described, by way of example only, with reference to the accompanying drawings, in which:

[0025] Figure 1 A top view of a pad integrating sensors used by a tracking system according to one implementation of the present invention is shown.

[0026] Figure 2 Shown Figure 1 Flowchart of the operation of one or more trigger areas and preparation areas of a pad when adapted for VR motion tracking.

[0027] Figure 3 Shown Figure 2 A flowchart in which the order of the two steps used in the flowchart is reversed.

[0028] Figure 4 Two possible examples of body-worn devices are shown: a head-mounted display (HMD) and a hip-worn inertial measurement unit, which can be used with Figure 1 The pad is used in conjunction with the control panel to control the movement of the virtual image.

[0029] Figure 5 and Figure 6 A flow chart showing possible movement scenarios.

[0030] Figure 7 Shows the implementation Figure 1 Flowchart of the virtual implementation of the pad. DETAILED DESCRIPTION

[0031] In the following description, various embodiments are described with reference to the drawings, wherein like reference numerals generally refer to the same parts throughout the different views.

[0032] A tracking system for implementing events in a computing environment, i.e., executing commands to cause an action, task, or process to be processed in a computer, is disclosed. In a preferred implementation, the tracking system is used in virtual reality, augmented reality, or other forms of visually immersive computer simulation applications. Virtual reality, or VR, refers to a computer-simulated environment that can be interacted with by a user using hardware that maps or simulates the user's movements into the computer-simulated environment. Augmented reality, or AR, refers to the superimposition of virtual images on or otherwise incorporation of real-world environments through the use of a head-mounted device (HMD) that still allows the user to see the real world. In another implementation, the tracking system provides a peripheral input device, similar to a mouse or keyboard, that allows cursor control and icon selection in a graphical user interface running in the computing environment. In yet another implementation, the tracking system is used as gaming hardware to facilitate gaming in the computing environment.

[0033] The tracking system of the present application includes a sensor array that can be integrated into a mat, for example. The mat can have any suitable shape, including triangular, square, rectangular, circular, oval, regular or irregular polygons, and can be rigid, elastic, rollable, or foldable. The mat can be formed from any suitable material or combination of materials, including foam, rubber, plastic, fabric, or carpet.

[0034] The sensor array may be one or more of capacitive sensors, resistive sensors, or electromagnetic sensors that are spatially distributed across the mat (uniformly or non-uniformly) to detect pressure or contact applied to the mat surface, thereby detecting pressure or contact through the sensors to notify the computing environment that the sensors have been activated. The sensor array includes one or more trigger zones and a standby zone, which can be implemented by programming or designating some of the mat sensors as one or more trigger zones and designating other mat sensors as standby zones.

[0035] A preparation zone refers to a sensor that, when activated, notifies the computing environment of a command to execute an event within the computing environment. Examples of executable events include, but are not limited to, selecting an object in the computing environment, inputting commands into a game running within the computing environment, and controlling the movement of an avatar within the computing environment. Typically, activation of a preparation zone does not result in the execution of any event, but is necessary to enable one or more trigger zones to operate and cause an event to execute. That is, the execution of an event is due to the activation of another zone. The command to execute an event comes from the activation of one or more trigger zones, and the event that occurs (i.e., the next action, task, or process in the computing environment) depends on which of the one or more trigger zones is activated. Therefore, the preparation zone is configured to serve as a precursor to the activation required for one or more trigger zones to operate. One or more trigger zones and the preparation zone are activated when pressure or contact is detected by their corresponding sensors.

[0036] When in use, each trigger zone or zones are pre-programmed to provide the input expected by the application in which they are used (e.g., if the tracking system is used for VR locomotion, each trigger zone or zones are used to set the direction of travel of the avatar; and if the tracking system is used for music, dance, and rhythm games, each trigger zone or zones are used to capture input responses to music and visual cues). Such pre-programming facilitates the assignment of events to these trigger zones. When the trigger zone or zones are activated, instructions are sent to the computing environment to execute their assigned events. One or more trigger zones can be assigned to the same event to accommodate the proximity of the sensors on the mat. For example, if the sensors are dispersed so that the probability of adjacent trigger zones being activated simultaneously in any case is low, each sensor in such adjacent trigger zones can be assigned a different event. On the other hand, if the sensors are densely arranged so that adjacent trigger zones are likely to be activated simultaneously in any case, multiple trigger zones can be assigned the same event.

[0037] The tracking system of the present application also includes at least one processor in communication with the sensor array. The term "processor" may refer to an application-specific integrated circuit (ASIC), a central processing unit (CPU), a graphics processing unit (GPU), a programmable logic device (PLD), a microcontroller, a field-programmable gate array (FPGA), a microprocessor, a digital signal processor (DSP), or other suitable component. The processor can be configured using machine-readable instructions stored in a memory. The processor can be centralized or distributed, such as integrated with the sensor array, or separately packaged, such as within a computing environment.

[0038] The processor is configured to process the signals output from the sensor array to determine the order in which the preparatory zone and one or more trigger zones are activated. The order refers to the sequence in which the preparatory zone and one or more trigger zones are activated. In response to determining that the order is correct, the processor issues a command to execute an event assigned to the activated one or more trigger zones. That is, if the order is determined to be correct, the processor issues a command to execute an event in the computing environment due to the activation of the one or more trigger zones. If the processor detects that more than one event is executed due to the activation of the one or more trigger zones, the processor may issue a command to combine these events for execution in the computing environment. For example, if a trigger zone that causes an avatar to move forward and a trigger zone that causes an avatar to move sideways are both activated, the processor may issue a command to cause the avatar to move diagonally in the computing environment.

[0039] Typically, whenever one or more trigger zones are activated while the preparatory zone is activated, a command is sent to execute the assigned events for these one or more trigger zones. Additionally, the correct sequence typically requires that the preparatory zone be activated before activating one or more trigger zones, and that the preparatory zone remain activated while the one or more trigger zones are activated. Figure 2 、 Figure 5 and Figure 6 The correct sequence is described in more detail below for various operation scenarios.

[0040] The processor is also configured to ignore activation of one or more trigger zones, the preparatory zones, or both if they are executed in an incorrect order. For example, if the processor detects that the preparatory zones are not activated (or deactivated), the processor will remain unresponsive when one or more trigger zones are detected to be activated. Similarly, if the processor detects that the preparatory zones are activated but one or more trigger zones are not activated (or deactivated), no action will be taken. If the processor detects that one or more trigger zones are activated first and then activates the preparatory zones while the preparatory zones remain activated, this will similarly not result in the execution of an event due to the activation of one or more trigger zones.

[0041] Operation of one or more of the trigger regions, the standby regions, or both in an incorrect order may result in the effect that any of these regions are considered dormant and result in commands not being sent to the computing environment and no response in the computing environment.

[0042] By imposing the requirement to activate the preparation zone and one or more trigger zones in the correct order for an event to execute in the computing environment, this ensures that commands executed by the tracking system are the result of conscious decisions by the user. The tracking system is also configured to ignore activation of its sensors when executed in an incorrect order, which further enforces adherence to the correct order by preventing the computing environment from reacting to its accidental activation. This is advantageous in gaming applications because it provides the user with the option of walking on the pad without causing their avatar's state to change.

[0043] The operation of the tracking system is combined below Figures 1 to 7 , which are described in more detail, are directed to virtual reality applications. However, as mentioned above, the tracking system can also be used as a peripheral input device in addition to or instead of a mouse and keyboard; and can also be used in other applications such as footwork tracking for music, dance, and rhythm games; aerobic fitness; force transfer and weight distribution analysis; and training for sports such as golf, baseball, and tennis. Therefore, reference is made below to Figures 1 to 7 The discussion represents only one possible application of the tracking system.

[0044] Figure 1 A top view and a perspective view of a mat 100 incorporating sensors used by the tracking system of the present invention are shown. As described above, the mat 100 can have any suitable shape, including triangular, square, rectangular, circular, oval, regular or irregular polygons, and can be rigid, elastic, rollable, or foldable. In one implementation, the mat 100 is a specialized floor mat specifically configured for use with a virtual reality system. The mat 100 can also include tactile feedback devices for physical interaction with the user.

[0045] The pad 100 has a sensor array having a preparatory area 102, one or more triggering areas 106, and a neutral area 104. The preparatory area 102, the triggering area 106, and the neutral area 104 are areas that can be activated independently. The sensor array can be one or more of capacitive sensors, resistive sensors, or electromagnetic sensors that can detect pressure or contact. The sensors are spatially distributed, with Figure 1 In one embodiment, a preparation zone 102 is located in the center and is surrounded by one or more trigger zones 106, with a neutral zone 104 located between the preparation zone 102 and the one or more trigger zones 106. The three distinct zones 102, 104, and 106 are separated by different materials, textures, patterns, and / or grooves (MTPGs) to provide tactile feedback, making each zone distinguishable by the foot. In one embodiment, the grooves are achieved by varying the heights of one or more of the trigger zone 106, the neutral zone 104, and the preparation zone 102.

[0046] A possible layout of the backing plate 100 is as follows:

[0047] Preparation Area 102

[0048] Located at the center of the backing plate 100, the portion of the backing plate 100 where the sensor resides, the preparation zone 102, is shaped like a circle with a diameter between 20 cm and 30 cm. This portion is a raised area approximately 12 mm in height with smooth, rounded edges. In one embodiment, the portion of the backing plate 100 used for the preparation zone 102 has a different MTPG than the trigger zone 106.

[0049] Trigger Zone 106

[0050] The trigger zone 106 is located in a deck area of ​​the backing plate 100 outside the preparatory zone 102 and the neutral zone 104. In one embodiment, the portion of the backing plate 100 having the sensor for the trigger zone 106 protrudes slightly above the portion of the backing plate 100 having the sensor for the neutral zone 104 and is lower in height than or equal to the portion of the backing plate 100 having the sensor for the preparatory zone 102. The deck has a different MTPG than the preparatory zone 102 and the neutral zone 104.

[0051] Neutral Zone 104:

[0052] Located between the preparatory zone 102 and the trigger zone 106, the portion of the backing plate 100 containing the sensor for the neutral zone 104 has a slightly concave annular area with a diameter between 40 cm and 70 cm. This portion of the backing plate 100 can have a height between 6 mm and 9 mm. In one embodiment, the portion of the backing plate 100 used for the neutral zone 104 has the same MTPG as the portion of the backing plate 100 used for the preparatory zone 102, but a different MTPG than the portion of the backing plate 100 containing the trigger zone 106.

[0053] To enable pad 100 to function in its intended application, each trigger zone 106 or multiple trigger zones 106 are configured (via preprogrammed instructions) to execute an action, task, or process specific to the intended application upon activation. The preprogrammed actions, tasks, or processes assign an event to each trigger zone 106 or multiple trigger zones therein, which, when activated, executes the event within the computing environment. However, trigger zones 106 are configured to operate in conjunction with preparatory zones 102, as preparatory zones 102 are precursors to trigger zones 106 that are configured to require activation before one or more trigger zones 106 can function. That is, preparatory zones 102 must be activated before one or more trigger zones 106 can function (i.e., trigger zones 106 can only function after preparatory zones 102 are activated). Sensors in neutral zones 104 are not assigned any events and serve as a resting area for initiating new events or switching between events.

[0054] Whether one or more trigger zones 106 and preparatory zones 102 are operating correctly is determined by one or more processors 110, with the sensor array communicating with the one or more processors (indicated by bidirectional arrow 130). At least one processor 110 is configured to process signals output from the sensor array to determine the order in which preparatory zones 102 and one or more trigger zones 106 are activated. Processor 110 then communicates with the computing environment and, in response to the order being correct, sends a command to the computing environment to execute the assigned event for the activated one or more trigger zones 106. Processor 110 is further configured to ignore the activation of one or more trigger zones, preparatory zones, or both if they are executed in an incorrect order, such that no command is sent to the computing environment and no response occurs in the computing environment. For example, processor 110 is configured to act on signals from one or more trigger zones 106 only after preparatory zones 102 are activated first and remain activated while one or more trigger zones 106 are activated.

[0055] refer to Figure 2 Flowchart 200 illustrates the operation of one or more trigger zones 106 and preparation zone 102 when adapted for VR motion tracking. VR motion refers to a technique that enables a user's avatar to move within a virtual world created in a computing environment using only a small amount of real-world space, where the tracking system of the present invention facilitates spatial scaling. For such applications, each trigger zone 106 is assigned an event related to controlling the avatar's movement within the computing environment, such as the direction of that movement.

[0056] The tracking system enables intuitive VR movement by triggering directional movement commands when the user follows a two-step sequence in which the preparatory zone 102 is first activated, followed by activation of one or more trigger zones 106. Any reference to a stepping motion for activating one or more trigger zones 106 and the preparatory zone 102 is in the context of a pad placed on the floor and used as a cushion. However, the pad can also be placed on a table, whereby the user's hands then activate one or more trigger zones 106 and the preparatory zone 102.

[0057] Flowchart 200 begins at 201, where processor 110 detects the state of the computing environment. The first step of the two-step sequence occurs at stage 202, where a user steps on preparatory zone 102 with one foot, as preparatory zone 102 acts as a precursor to the activation required for one or more trigger zones to operate. As depicted in stage 204, no movement occurs within the computing environment, preparing the computing environment to receive commands from one or more subsequently activated trigger zones 106 to execute events within the computing environment.

[0058] The second step in the two-step sequence occurs in stage 206 of flowchart 200. For the second step, the user maintains one foot on the preparation zone 102 and steps on one or more trigger zones 106 with their other foot. When the computing environment receives a movement command in stage 208, the event assigned to the activated one or more trigger zones 106 is executed, causing the avatar to perform the desired movement. This two-step sequence (stages 202 and 206) is applicable to translational movement, backward movement, and forward movement.

[0059] Therefore, the operations of stages 201, 202 and 206 illustrate that, in the absence of ongoing events related to movement of the virtual image in the computing environment from one or more previously activated trigger areas 106 (for which the processor 110 did not send commands to the computing environment in stage 201), the correct order for the processor 110 to send commands to execute the virtual image movement events assigned to the trigger areas 106 requires that the preparation area 102 be activated before the trigger area 106 is activated.

[0060] Stage 210 occurs when the user wishes to change or adjust their direction of movement. The user lifts their foot from one or more trigger zones 106 while maintaining their other foot in the preparation zone 102. Stage 212 then occurs, where the avatar in the computing environment continues the previous movement command after a time delay / decay (e.g., 0.5 to 2 seconds or any other preprogrammed interval), which is perceived as the avatar slowing down or gliding. If the user does not step on the trigger zone, stage 214 occurs, where the movement eventually stops.

[0061] After stage 210, in which the user maintains one foot on the preparatory zone 102, stage 216 occurs when the user places their other foot on another trigger zone 106. When the user places their foot on this other trigger zone 106 during the sliding window, the avatar adjusts to the new direction without losing speed or at most slightly slowing down in stage 218. Alternatively, if the other trigger zone 106 is activated after movement has stopped, the avatar will then move in the new direction in a manner similar to that described with respect to stage 208.

[0062] The operations of stages 210, 216, and 218 illustrate that processor 110 compares the assigned event (the movement direction set in stage 218) of the currently activated trigger zone 106 to determine whether it is a new event relative to ongoing events (the movement direction set in stage 206) from previously activated trigger zones 106 in the computing environment. The proper sequence for executing the newly assigned event requires that the preparation zone remain active during the activation of the current trigger zone 106. Stage 220 involves processor 110 being configured to terminate ongoing events (i.e., the movement direction set as described in stage 218) occurring in the computing environment from one or more previously activated trigger zones 106 in response to detecting the deactivation of the preparation zone 102. Therefore, to quickly deactivate their avatar, the user need only lift their foot from the preparation zone 102 at any point during the operation. The avatar then deactivates in stage 222.

[0063] After stage 222, placing their foot anywhere on the mat 100 will not trigger a movement command unless the user re-enters the two-step sequence of stage 202 followed by stage 206. That is, the processor 110 determines the order in which the preparatory zone 102 and one or more triggering zones 106 are activated, and in response to the order being correct, issues a command to execute the assigned event for the activated one or more triggering zones 106. Thus, if the user steps only on the preparatory zone 102 in stage 224 and does not subsequently step on a triggering zone 106, stage 226 occurs, in which no movement is executed in the computing environment.

[0064] Except for the two-step sequence of stage 202 followed by stage 206, the order or combination of steps will not trigger a move command. This is because the processor 110 is configured to ignore the activation of one or more triggering areas 106, preparation areas 102, or both if they are not executed in the correct order, such as Figure 3 As shown in .

[0065] Figure 3Flowchart 300 is shown, in which the two-step sequence is reversed. In stage 302, the user first steps on any one of the trigger zones 106. This results in no movement occurring in stage 304. In stage 306, the user then steps on the preparatory zone 102. This results in no movement occurring in stage 308. Therefore, when one or more trigger zones 106 and preparatory zones 102 are activated in an incorrect order, the processor 110 does not send commands to the computing environment. This means that the user can freely move on the mat 100 while playing games or using applications without triggering movement commands, yet can still easily execute movement commands by reversing the two-step sequence when needed. Configuring the processor 110 to not respond to activation of the preparatory zone 102 and trigger zones of the mat 100 in an incorrect order enables safe gaming because when the user wears the HMD and immerses themselves in VR, the mat 100 becomes a reference to the user's physical environment. The user perceives that as long as one or both feet are on the mat 110, they are safely outside the range of physical objects in their use space. The trigger zone 106 and the preparation zone 102 have one or more of the following physical characteristics: different heights; different surface textures; and different surface designs, which result in different MTPGs between the trigger zone 106 and the preparation zone 102, which allows the user to instinctively / intuitively sense their position on the pad 110 relative to the preparation zone 102, their approximate position on the pad 110, and the positions of the preparation zone 102 and the trigger zone 106 without having to see the pad.

[0066] therefore, Figure 2 and Figure 3 The operations described in indicate that for an event to occur, the preparation area 102 must be activated. Events in the computing environment are realized by the activation of the trigger area 106 (if the avatar is at rest) or by changes in the activation of the trigger area 106 (if the avatar is already in motion). Each trigger area 106 can also be programmed to take into account the pressure applied during their activation, which affects how their assigned event is executed. Figure 2 and Figure 3 In scenarios where the event involves controlling the movement of an avatar, the pressure applied can control the speed at which the movement occurs. Lighter pressure causes the avatar to walk, while heavier pressure causes it to run or sprint.

[0067] In addition to being able to assign events related to controlling the movement of the avatar, each trigger area 106 can also be assigned events corresponding to the application in which it is used. For example, assignable events include: selecting an object in the computing environment; and entering commands into a game running in the computing environment. Each trigger area 106 can also be assigned events related to other applications, including:

[0068] • Input alternatives for WASD keyboard, joystick and / or thumbstick configurations in FPS and third-person games

[0069] • Racing games

[0070] • Music, art, and general creative apps

[0071] • Step tracking for music, dance and rhythm games, and aerobic fitness apps

[0072] • Force transfer and weight distribution analysis and training for sports such as golf, baseball, and tennis

[0073] • Motion capture calibration with foot placement in room / absolute positioning

[0074] • Real-time indoor / absolute position tracking with foot placement and pose estimation

[0075] • Weight distribution and center of gravity estimation

[0076] • Telemedicine for physical therapy and rehabilitation

[0077] • General training and simulation across diverse industries

[0078] When the pad 100 is used as the only input device for controlling the virtual image in the computing environment, Figure 2 and Figure 3 An operation is described in which each trigger zone 106 controls the movement, orientation, or both movement and orientation of the avatar. For example, placing one foot on a trigger zone 106 on the left or right side of the preparation zone 102 while the other foot remains on the preparation zone 102 causes the avatar to turn left or right, respectively. Placing one foot on a trigger zone 106 in front of or behind the preparation zone 102 while the other foot remains on the preparation zone 102 causes the avatar to move forward or backward, respectively. Additional programming is also possible, such as double-clicking a trigger zone 106 on the left or right side of the preparation zone 102 causing the avatar to move sideways while still facing forward.

[0079] In another implementation, the processor 110 supports other peripheral devices, such as body-worn devices, in addition to the trigger zone 106 to control the avatar in the computing environment. The trigger zone 106 enables movement, while the body-worn device provides the direction of the movement.

[0080] Figure 4Two possible examples of body-worn devices are shown: a head-mounted display (HMD) 402 and a hip-worn inertial measurement unit (IMU) 404. The processor 110 receives input from the body-worn devices 402, 404 that provides the orientation of the avatar and includes the orientation of the avatar when sending a command that instructs the computing environment to perform an event that occurs as a result of activation of the trigger zone 106. The body-worn devices 402, 404 determine the orientation of the avatar by determining the orientation of the user (also interchangeably referred to as a "participant"), which will be referred to as Figure 5 and Figure 6 Describe in more detail.

[0081] Figure 5 and Figure 6 Flowcharts 500, 550, 570, and 600 illustrate possible movement scenarios in which body-worn devices 402, 404 operate in conjunction with a foot 406 placed on the preparation zone 102 and the trigger zone 106. These are exemplary movement scenarios and are therefore not comprehensive.

[0082] Flowchart 500 involves a series of steps that result in the avatar moving forward or backward. In step 502, processor 110 detects that preparatory zone 102 is first activated, and then, while preparatory zone 102 remains activated, one or more trigger zones 106 in front of preparatory zone 102 are activated. Processor 110 determines that one or more trigger zones 106 in front of preparatory zone 102 are activated based on the participant's facing direction. In step 504, processor 110 detects from body-worn devices 402, 404 that the participant is facing forward. Trigger zones 106 located within corner region 580 where the participant is facing directly forward (or forward), as determined by body-worn devices 402, 404, are considered aligned with the participant's facing direction. In response to verifying that one or more trigger zones 106 within corner region 580 are activated, processor 110 issues a command to move the avatar forward in step 506. In step 508, processor 110 detects that, while preparatory zone 102 remains activated, one or more trigger zones 106 in front of preparatory zone 102 are deactivated and replaced by activation of one or more trigger zones 106 behind preparatory zone 102. In step 510, processor 110 detects from body-worn devices 402, 404 that the participant remains facing forward. In response, processor 110 sends a command to move the avatar backward in step 512. Flowchart 550 involves a series of steps that result in the avatar translating to the left. The leftward translation motion refers to the avatar moving in an arc to the left. In step 552, processor 110 detects that preparatory zone 102 is first activated, followed by activation of one or more trigger zones 106 to the left of preparatory zone 102 while preparatory zone 102 remains activated. In step 554, processor 110 detects the participant's facing direction from body-worn devices 402, 404 and trigger zone 584 located within corner region 582 where the participant is facing forward. Processor 110 determines that activated trigger zone 106, to the left of preparatory zone 102, falls outside trigger zone 584 within forward angle region 582. Activated trigger zone 106 is deemed misaligned with the participant's facing direction to the extent that a translational movement is required. In response, processor 110 issues a command to translate the avatar to the left in step 556.

[0083] Flowchart 570 involves a series of steps that result in the avatar translating to the right. Rightward translational motion refers to the avatar moving in a rightward arc. In step 572, processor 110 detects that preparatory zone 102 is first activated, and then, while preparatory zone 102 remains activated, one or more trigger zones 106 to the right of preparatory zone 102 are activated. In step 574, processor 110 detects the participant's facing direction from body-worn devices 402, 404 and trigger zones 588 within forward-facing corner region 586. Processor 110 determines that the activated trigger zone 106 to the right of preparatory zone 102 falls outside of trigger zone 588 within forward-facing corner region 586. The activated trigger zone 106 is deemed misaligned with the participant's facing direction to the extent that a translational motion is performed. In response, processor 110 issues a command to translate the avatar to the right in step 576.

[0084] Figure 6 Describes the misalignment between the activated one or more trigger zones 106 and the trigger zone 682 located in the corner area 680 where the participant is facing forward, which causes the avatar to move diagonally. The degree of misalignment for diagonal movement is less than that for Figure 5 Describes the degree of misalignment of the translational movement.

[0085] When the processor 110 detects activation of the preparation zone 102 and activation of the trigger zone 106 that is arranged diagonally relative to the participant's facing direction, the avatar will move diagonally left or right (see step 605), as the participant's facing direction is obtained from the HMD 402 and / or IMU 404. The left diagonal movement or right diagonal movement is set as follows in steps 602 and 652, respectively, where the participant is facing north.

[0086] In step 602, preparatory zone 102 and trigger zone 106 on the left diagonal are activated. This activated trigger zone 106 is located outside corner region 680 where the participant is facing forward. Processor 110 senses a misalignment between the participant's orientation and the activated trigger zone 106, as the participant is facing forward and the trigger zone 106 on the left diagonal is activated. Consequently, the avatar moves along the left diagonal.

[0087] In step 652, preparatory zone 102 and trigger zone 106 on the right diagonal are activated. This activated trigger zone 106 is located outside corner region 680 where the participant is facing forward. Processor 110 senses a misalignment between the participant's orientation and the activated trigger zone 106 because the participant is facing forward and the trigger zone 106 on the right diagonal is activated. Consequently, the avatar moves along the right diagonal.

[0088] Steps 604 and 606 relate to the movement of the avatar when the user is facing and their feet are in the west direction, as shown in image 603. If preparatory zone 102 is activated, processor 110 detects that the activated trigger zone 106 is aligned with the user's facing direction, as obtained from HMD 402 and / or IMU 404. This causes the avatar to move forward. Similarly, steps 654 and 656 relate to the movement of the avatar when the user is facing and their feet are in the east direction, as shown in image 604. If preparatory zone 102 is activated, processor 110 detects that the activated trigger zone 106 is aligned with the user's facing direction, as obtained from HMD 402 and / or IMU 404. This causes the avatar to move forward.

[0089] The default angular spacing of angular regions 582, 584, 586, and 680 can be 30°, but the degree (i.e., how wide or narrow) can be user-specified. Processor 110 can also be programmed through user profile settings to prioritize the output of some trigger zones 106 over others, thereby addressing scenarios where trigger zones 106 assigned to different movements are activated simultaneously. For example, if diagonal movement is set as primary movement, the simultaneous activation of a trigger zone 106 assigned to diagonal movement and a trigger zone 106 assigned to translational movement will cause the avatar to move diagonally. If translational movement is set as primary movement, the simultaneous activation of a trigger zone 106 assigned to diagonal movement and a trigger zone 106 assigned to translational movement will cause the avatar to perform a translational motion.

[0090] Figures 1 to 6 The use of mat 100 to physically implement trigger zone 106 and preparatory zone 102 is described. However, the trigger zone and preparatory zone can also be implemented virtually. In one approach, mat 100 and its preparatory zone 102, neutral zone 104, and trigger zone 106 can be projected onto a surface (e.g., a mat or mat portion, or directly onto a floor or other surface) using a light source falling within the visible, infrared, near-infrared, or other suitable portion of the spectrum. During use, activation of these virtual zones 102, 104, and 106 is determined by sensors detecting which of these projected zones are occupied.

[0091] In another approach, the user maps each of the preparation zone 102, neutral zone 104, and trigger zone 106 by assigning an area in the computing environment based on the physical space in which the virtual pad is to be implemented. The mapping allows the virtual zones 102, 104, and 106 to be superimposed on their corresponding defined areas in the physical space. The user can access the virtual pad through their HMD (refer to Figure 4The user's HMD 402 (seeing the virtual zones 102, 104, and 106) is displayed on a virtual mat. The active virtual zones 102, 104, and 106 at any given moment are determined by the position of the user's feet, as detected by data from one or more IMUs placed on the user's lower limbs. Therefore, the user does not need a physical mat with a sensor array; instead, they simply mark the areas of the preparation zone 102, neutral zone 104, and trigger zone 106 in physical space and virtually overlay the mat within the HMD, which the user can see through their HMD. The overlay can be determined by selecting a default template, rather than drawing within the virtual space from the aforementioned mapping. The virtual map can be deactivated when the user wishes to perform tasks in the physical space, or if the player wishes to move to another physical space with sufficient area to accommodate the defined areas required for the virtual zones 102, 104, and 106. If the new physical space cannot accommodate them, the virtual zones 102, 104, and 106 will need to be remapped.

[0092] Figure 7 A flowchart 700 is shown for implementing the virtual implementation by a processor (eg, from a computing environment). Flowchart 700 is directed to steps of a method for implementing an event in a computing environment.

[0093] In step 702, the physical boundaries of one or more virtual trigger zones are defined. Each virtual trigger zone is assigned an event to be executed in the computing environment when activated. The virtual trigger zone has a physical boundary with respect to a reference trigger zone. Figure 1 and Figure 6 The functions corresponding to the trigger area 106 are described above and therefore will not be described in detail.

[0094] In step 704, a separate physical boundary of the virtual preparation area is defined. The virtual preparation area acts as a precursor that needs to be activated to enable one or more virtual trigger areas to operate. The virtual preparation area has a physical boundary with the reference area. Figure 1 and Figure 6 The functions corresponding to the preparation area 102 are described, so they are not described again.

[0095] In step 706, a signal output is processed containing the order in which the virtual preparatory area and the one or more virtual triggering areas are activated. In step 708, in response to determining that the order is correct, a command for executing the assigned event of the activated one or more virtual triggering areas is executed. The correct order corresponds to the order in which the triggering area 106 and the preparatory area 102 are referenced. Figure 1 and Figure 6 The activation of one or more virtual triggering zones and virtual preparation zones includes the detection of occupancy of a physical boundary and a separate physical boundary by a sensor, respectively.

[0096] The virtual implementation method is used in the same way as above Figures 1 to 6 The control logic is identical to the physical implementation described above. Therefore, if one or more virtual trigger zones, virtual standby zones, or both are activated in an incorrect order, no command will be sent to the computing environment. Whenever one or more virtual trigger zones are activated at the same time as a virtual standby zone, a command to execute an allocation event for one or more trigger zones will be sent. Similar to the physical implementation, the operation of this virtual implementation involves detecting the state of the computing environment.

[0097] In one operational scenario, detecting the state of the computing environment compares whether assigned events for one or more currently activated virtual trigger zones are new events relative to ongoing events occurring in the computing environment by one or more previously activated virtual trigger zones.

[0098] The correct sequence of executing the newly allocated events requires that the virtual preparatory zone remain active during the activation of the current one or more of the virtual trigger zones.

[0099] In another operational scenario, detecting the state of the computing environment verifies that there are no ongoing events in the computing environment that occurred due to one or more previously activated virtual trigger zones. The correct sequence of executing events assigned to the one or more virtual trigger zones requires activating the virtual preparation zone before activating those virtual trigger zones.

[0100] When there is an ongoing event in the computing environment that occurs due to one or more previously activated virtual triggering areas, the ongoing event will be terminated in response to detecting the deactivation of the virtual preparatory area.

[0101] Each virtual trigger zone can be configured to perform the same events as its corresponding physical trigger zone 106, including one or more of the following: selecting an object in the computing environment, inputting commands to a game running in the computing environment, and controlling the movement of an avatar in the computing environment. When used to control the movement of an avatar, the virtual implementation can also receive input from a body-worn device (such as an HMD or a hip-worn IMU) to provide the avatar's orientation.

[0102] about Figure 7 The details of the virtual implementation of [ ] have been described above. Since no physical pad is used, a virtual pad space needs to be defined. This involves setting the boundaries of each of the virtual preparation zone, virtual neutral zone, and virtual trigger zone within the virtual space. The virtual pad can then be overlaid on top of the virtual space.

[0103] With the virtual pad disabled, the avatar's range of movement in the computing environment is limited to the boundaries of the user's available physical space. To allow the avatar full range of movement without being limited by the user's available physical space, the user activates the virtual pad and moves to a fixed virtual preparation area. The user then activates the virtual preparation area and the virtual target area in a two-step sequence, which allows unrestricted movement in the computing environment. In addition to or as an alternative to using an HMD with a virtual pad as described above, a hip-worn inertial measurement unit (see Figure 4 The IMU 404 shown in FIG. 1 determines which virtual zones 102, 104, and 106 are active at any given moment, and also determines the player's facing or initial forward (north) direction. If the player decides to change their initial forward direction (e.g., from north to east), the player must unwind the current state, set their forward direction to east, and perform a re-centering sequence.

[0104] In this application, unless otherwise stated, the terms "comprising," "comprise," and grammatical variations thereof are intended to represent "open" or "inclusive" language such that it includes the recited elements but also allows for the inclusion of additional elements that are not explicitly recited.

[0105] Although the present invention has been described with reference to exemplary embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof without departing from the scope of the present invention. In addition, modifications may be made to adapt the teachings of the present invention to specific circumstances and materials without departing from the basic scope of the present invention. Therefore, the present invention is not limited to the specific examples disclosed in this specification, but encompasses all embodiments falling within the scope of the appended claims.

Claims

1. A tracking system for implementing events in a computing environment, the system comprising a sensor array integrated into a backplane, the sensor array providing: one or more trigger zones, each of the trigger zones configured to execute a distribution event in the computing environment when activated; as well as a preparation zone configured as a precursor that needs to be activated to enable the one or more trigger zones to operate; as well as At least one processor configured to: processing signals output from the sensor array to determine an order in which the preparatory zone and the one or more triggering zones are activated; as well as In response to the sequence being correct, a command is sent to execute the allocation event of the one or more activated trigger zones, wherein the command to execute the allocation event of the one or more trigger zones is sent only if the one or more trigger zones are activated when the preparatory zone is activated.

2. The tracking system according to claim 1, wherein: The at least one processor is further configured to: Activation of the one or more trigger regions, the preparation region, or both the one or more trigger regions and the preparation region if executed in an incorrect order is ignored such that commands are not sent to the computing environment.

3. A tracking system according to any one of the preceding claims, wherein: The processor is further configured to detect a status of the computing environment.

4. The tracking system according to claim 3, wherein: Detecting the state of the computing environment includes the processor being further configured to: comparing whether an assigned event for one or more currently activated ones of the trigger zones is a new event relative to ongoing events from one or more previously activated ones of the computing environment; and Wherein, executing the correct sequence of the new allocation events includes the preparation area remaining activated during the current activation of the one or more triggering areas.

5. The tracking system according to claim 3 or 4, wherein: Detecting the state of the computing environment includes the processor being further configured to: verifying that there are no ongoing events in the computing environment from one or more previously activated trigger zones; and The correct sequence includes activating the preparation zone before activating the one or more trigger zones.

6. A tracking system according to any one of the preceding claims, wherein: The processor is further configured to: In response to detecting deactivation of the preparation region, ongoing events in the computing environment from the one or more previously activated trigger regions are terminated.

7. A tracking system according to any one of the preceding claims, wherein: The event includes one or more of: selecting an object in the computing environment, entering a command into a game running in the computing environment, and controlling movement of an avatar in the computing environment.

8. The tracking system according to claim 7, wherein: The processor is further configured to: Input is received providing an orientation of the avatar, and the orientation of the avatar is included in the sent command.

9. The tracking system according to claim 8, wherein: The input is received from a body worn device.

10. A tracking system according to any one of the preceding claims, wherein: The one or more triggering regions and the preparation region have one or more of the following physical characteristics: different heights; different surface textures; and different surface designs.

11. A tracking system according to any one of the preceding claims, wherein: The one or more triggering areas surround the preparation area.

Images