A direction-aware 3D spatial tactile redirection method
By constructing a magnetic physical agent system and optimizing target mapping using magnetic adhesion relationships and tactile orientation fraction sets, the problems of physical structure collapse and tactile-visual inconsistency in existing methods are solved, thus improving the user interaction experience.
Patent Information
- Application Number
- CN202611379731.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-09-07
- Publication Date
- 2026-11-17
AI Technical Summary
Existing haptic redirection methods cannot distinguish the support relationship of agents in a 3D stacked structure, leading to the collapse of the physical structure, disrupting the directional consistency between haptics and vision, increasing the number of system resets and the distance the user's arm moves, and interrupting the immersive interactive experience.
A magnetic physical agent system containing a magnetic base and a magnetic cube is constructed. The set of unoccupied agents and the set of available placement locations are determined by magnetic attachment relationships. The interaction attribute group is determined by combining local exposure, global haptic orientation quality and availability. The target is mapped using a set of haptic orientation scores. The selection of reset points is optimized to reduce structural collapse and the number of resets.
It reduces the occurrence of physical structure collapse, improves the directional consistency between touch and vision, reduces the number of system resets and the distance the user's arm moves, and enhances the immersive interactive experience.
Smart Images

Figure CN123114261A_ABST
Abstract
Description
Technical Field
[0001] The embodiments disclosed herein relate to the field of computer technology, and more specifically to a three-dimensional spatial tactile redirection method based on orientation awareness. Background Technology
[0002] In immersive virtual reality applications, haptic feedback plays a crucial role in enhancing users' sense of presence and spatial distance perception. Passive haptic mechanisms utilize physical proxy objects in physical space to provide users with realistic tactile feedback signals, offering a low-latency, low-power, and cost-effective solution for tangible interaction. However, due to the typically limited physical workspace, it is impossible to assign a one-to-one physical proxy to every virtual object in a scene. To address this contradiction, researchers have proposed haptic redirection technology. Currently, the common approach to haptic redirection is to map virtual targets to the physical proxy closest to the user's hand, based on the principle of shortest spatial distance.
[0003] However, when using the above method to redirect haptic sensation in a physical interaction space, existing methods often encounter the following problems: Existing methods select physical agents solely based on spatial distance, failing to distinguish the support relationships of agents within a 3D stacked structure. This can lead to the collapse of the physical structure when a user picks up a key support block. Furthermore, existing methods neglect the alignment between the operable approach direction of the virtual target and the free surface direction of the physical agent, disrupting the directional consistency between tactile and visual senses. Additionally, the fixed-position reset strategy does not consider the spatial correlation between the reset point and subsequent available agents, resulting in frequent searches after a reset. This increases the number of system resets and the distance the user's arm moves, severely disrupting the user's immersive interactive experience.
[0004] The information disclosed in this background section is only intended to enhance the understanding of the background of the inventive concept, and therefore may contain information that does not constitute prior art known to those skilled in the art. Summary of the Invention
[0005] The summary portion of this disclosure is intended to provide a brief overview of the concepts, which will be described in detail in the detailed description portion. This summary portion is not intended to identify key or essential features of the claimed technical solutions, nor is it intended to limit the scope of the claimed technical solutions.
[0006] Some embodiments of this disclosure propose a direction-aware three-dimensional spatial tactile redirection method, apparatus, electronic device, and computer-readable medium to address one or more of the technical problems mentioned in the background section above.
[0007] In a first aspect, some embodiments of this disclosure provide a direction-aware three-dimensional spatial tactile redirection method, the method comprising: constructing a magnetic physical agent system comprising a magnetic base and various magnetic cubes, wherein each of the magnetic cubes is marked with a visual reference mark; determining an unoccupied agent set and an available placement location set based on the magnetic attachment relationship between the magnetic cubes in the magnetic physical agent system; determining an interaction attribute set for each unoccupied agent in the unoccupied agent set and each available placement location in the available placement location set, wherein the interaction attribute set includes local exposure, global tactile orientation quality, and availability; determining a tactile orientation score set corresponding to the unoccupied agent set and the available placement location set based on the obtained interaction attribute sets; determining a target tactile orientation score set based on the tactile orientation score set, the current real hand position, and virtual target information; and determining a target physical agent or target placement location corresponding to the virtual target information based on the target tactile orientation score set in response to determining that the target tactile orientation score set is not empty.
[0008] Secondly, some embodiments of this disclosure provide a direction-aware three-dimensional spatial tactile redirection device, including a construction unit configured to construct a magnetic physical agent system comprising a magnetic base and various magnetic cubes, wherein each of the magnetic cubes is equipped with a visual reference marker; a first determining unit configured to determine an unoccupied agent set and a set of available placement locations based on the magnetic attachment relationship between the magnetic cubes in the magnetic physical agent system; and a second determining unit configured to determine each unoccupied agent in the unoccupied agent set and the set of available placement locations based on the unoccupied agent set and the set of available placement locations. The system comprises: a set of interactive attributes for each available placement location, wherein the set of interactive attributes includes local exposure, global haptic orientation quality, and availability; a third determining unit configured to determine, based on the obtained set of interactive attributes, a set of haptic orientation scores corresponding to the set of unoccupied proxies and the set of available placement locations; a fourth determining unit configured to determine a set of target haptic orientation scores based on the set of haptic orientation scores, the current real hand position, and virtual target information; and a fifth determining unit configured to, in response to determining that the set of target haptic orientation scores is not empty, determine the target physical proxy or target placement location corresponding to the virtual target information based on the set of target haptic orientation scores.
[0009] Thirdly, some embodiments of this disclosure provide an electronic device, including: one or more processors; and a storage device having one or more programs stored thereon, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the method described in any implementation of the first aspect above.
[0010] Fourthly, some embodiments of this disclosure provide a computer-readable medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method described in any of the implementations of the first or second aspect.
[0011] The above-described embodiments of this disclosure have the following beneficial effects: A direction-aware 3D spatial tactile redirection method based on some embodiments of this disclosure can reduce the occurrence of physical structure collapse caused by users picking up key support blocks, improve the directional consistency between touch and vision, and reduce the number of system resets and the distance the user's arm moves, thus improving the user's immersive interactive experience. The reason why physical structure collapse caused by users picking up key support blocks disrupts the directional consistency between touch and vision, increases the number of system resets and the distance the user's arm moves, and severely disrupts the user's immersive interactive experience is that: existing methods only select physical agents based on spatial distance and cannot distinguish the support relationship of agents in a 3D stacked structure, leading to physical structure collapse caused by users picking up key support blocks; simultaneously, existing methods ignore the alignment relationship between the operable approach direction of the virtual target and the free surface direction of the physical agent, disrupting the directional consistency between touch and vision; furthermore, the fixed-position reset strategy does not consider the spatial correlation between the reset point and subsequent available agents, resulting in frequent searches after reset, increasing the number of system resets and the distance the user's arm moves, severely disrupting the user's immersive interactive experience. Based on this, some embodiments of the orientation-aware 3D spatial tactile redirection method disclosed herein first construct a magnetic physical agent system comprising a magnetic base and various magnetic cubes. This yields the magnetic physical agent system. Next, based on the magnetic attachment relationships between the magnetic cubes in the magnetic physical agent system, a set of unoccupied agents and a set of available placement positions are determined. This yields a set of occupied agents and a set of available placement positions. Then, based on the set of unoccupied agents and the set of available placement positions, an interaction attribute group is determined for each unoccupied agent in the set of unoccupied agents and each available placement position in the set of available placement positions. This yields an interaction attribute group corresponding to each unoccupied agent and an interaction attribute group corresponding to each available placement position. Next, based on the obtained interaction attribute groups, a set of tactile direction scores corresponding to the set of unoccupied agents and the set of available placement positions is determined. This yields a tactile direction score corresponding to each unoccupied agent and a tactile direction score corresponding to each available placement position. Finally, based on the set of tactile direction scores, the current real hand position, and virtual target information, a target tactile direction score set is determined. Therefore, a target tactile direction score set can be obtained. Finally, in response to determining that the above target tactile direction score set is not empty, the target physical agent or target placement position corresponding to the above virtual target information is determined based on the above target tactile direction score set. Therefore, the target physical agent or target placement position corresponding to the virtual target information can be obtained.Because it doesn't select physical agents solely based on spatial distance, but first constructs a magnetic physical agent system and clarifies the judgment logic for unoccupied agents (i.e., only agents whose removal will not cause other agents to collapse can be considered as candidates), it effectively distinguishes the support relationships of agents in the 3D stacked structure, reducing the possibility of structural collapse caused by users picking up key support blocks. Furthermore, because it doesn't only focus on the positional matching between virtual target information and physical agents, but introduces a tactile direction score mechanism, and combines the operable approach direction of virtual target information for spatial direction alignment filtering, it solves the problem of inconsistency between tactile and visual directions. Also, because it doesn't use a fixed position for forced backtracking, but proposes an optimal reset point selection method based on volume search, searching spherically layer by layer outward from the current hand position, and filtering to obtain target reset candidate points, it ensures that there are usable physical agents around the target reset candidate points, thereby reducing the number of system resets and the user's arm movement distance, and ensuring the continuity of the immersive interactive experience. This reduces the likelihood of physical structure collapse caused by users picking up key support blocks, improves the consistency between tactile and visual directions, reduces the number of system resets and the distance users need to move their arms, and enhances the user's immersive interactive experience. Attached Figure Description
[0012] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and elements are not necessarily drawn to scale.
[0013] Figure 1 This is a flowchart of some embodiments of the orientation-aware three-dimensional spatial tactile redirection method according to the present disclosure; Figure 2 This is a schematic diagram of the structure of some embodiments of the orientation-aware three-dimensional spatial tactile redirection device according to the present disclosure; Figure 3 This is a schematic diagram of the structure of an electronic device suitable for implementing some embodiments of the present disclosure. Detailed Implementation
[0014] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.
[0015] It should also be noted that, for ease of description, only the parts relevant to the invention are shown in the accompanying drawings. Unless otherwise specified, the embodiments and features described in this disclosure can be combined with each other.
[0016] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.
[0017] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".
[0018] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.
[0019] This disclosure will now be described in detail with reference to the accompanying drawings and embodiments.
[0020] Figure 1 A flow 100 of some embodiments of a direction-aware three-dimensional spatial tactile redirection method according to the present disclosure is shown. This direction-aware three-dimensional spatial tactile redirection method includes the following steps: Step 101: Construct a magnetic physical agent system that includes a magnetic base and various magnetic cubes.
[0021] In some embodiments, the execution entity (e.g., a computing device) of the orientation-aware 3D spatial haptic repositioning method can construct a magnetic physical agent system comprising a magnetic base and various magnetic cubes. Each of the magnetic cubes is marked with a visual reference marker. Each magnetic cube can represent a cube with magnetic properties. The visual reference marker can be a marker used to uniquely identify each magnetic cube and its spatial orientation. The visual reference marker can be a QR code-like pattern. The visual reference marker can be used by a system tracking device to uniquely identify each magnetic cube and track its position and orientation (six degrees of freedom pose) in the physical interaction space in real time. The physical interaction space can represent the three-dimensional physical area that a user's hand can reach and that is covered by the system tracking device during virtual reality haptic interaction. The system tracking device can be a color depth camera (RGB). (D camera). The aforementioned magnetic physical agent system can characterize a hardware device that provides a stackable, magnetic, and trackable physical tactile feedback carrier in a physical interaction space. In practice, the aforementioned execution entity can place a magnetic base in the physical interaction space and arrange multiple magnetic cubes on the magnetic base to form a magnetic physical agent system.
[0022] Step 102: Based on the magnetic attachment relationship between each magnetic cube in the magnetic physical agent system, determine the set of unoccupied agents and the set of available placement locations.
[0023] In some embodiments, the executing entity can determine the set of unoccupied agents and the set of available placement locations based on the magnetic attachment relationships between the various magnetic cubes in the magnetic physical proxy system. The magnetic attachment relationships can characterize a stable and detachable physical connection between two or more objects achieved through magnetic forces between magnetic materials. The unoccupied agents in the set of unoccupied agents can characterize magnetic cubes that, when removed from the magnetic physical proxy system, will not cause other magnetic cubes to collapse. The available placement locations in the set of available placement locations can characterize the spatial coordinates within the voxel grid corresponding to the physical interaction space, where a new magnetic cube can be placed and where the magnetic cube can magnetically attract the magnetic base or existing magnetic cubes to obtain gravitational support. The voxel grid can characterize an array of cubic units obtained by uniformly discretizing the physical interaction space in the X, Y, and Z dimensions. Each cubic unit in the array of cubic units is a voxel.
[0024] In some optional implementations of certain embodiments, the execution entity can determine the set of unoccupied agents and the set of available placement locations based on the magnetic attachment relationships between the various magnetic cubes in the magnetic physical agent system through the following steps: First, for each magnetic cube in the above magnetic physical proxy system, perform the following steps: The first sub-step involves determining that, after the magnetic cube is removed from the magnetic physical agent system, all other magnetic cubes in the magnetic physical agent system that are not the aforementioned magnetic cube remain unchanged, and defining the aforementioned magnetic cube as an unoccupied agent. Here, "remain unchanged" indicates that the state of the other magnetic cubes in the magnetic physical agent system that are not the aforementioned magnetic cube has not changed.
[0025] The second step is to determine the obtained unoccupied proxies as a set of unoccupied proxies.
[0026] The third step is to determine the set of available placement locations based on the magnetic attachment relationship between each magnetic cube in the above magnetic physical proxy system.
[0027] In some alternative implementations of certain embodiments, the aforementioned execution entity may determine the set of available placement locations based on the magnetic attachment relationships between each magnetic cube in the aforementioned magnetic physical proxy system through the following steps: First, the physical interaction space is divided into empty voxel grids to obtain an empty voxel map. This empty voxel map represents the set of all voxels not occupied by any entity (such as a magnetic cube or magnetic base) and their spatial coordinates after the physical interaction space is discretized into a voxel grid. In practice, the executing entity can use a three-dimensional voxel discretization method to divide the physical interaction space into a regular voxel grid and mark all unoccupied voxels and their coordinates to obtain the empty voxel map.
[0028] Then, for each empty voxel in the above vacancy voxel map, perform the following steps: The first sub-step involves placing the target magnetic cube at the aforementioned empty voxel. Here, the empty voxel can represent a voxel not occupied by any entity (such as a magnetic cube).
[0029] The second sub-step, in response to determining that the target magnetic cube and the magnetic base have magnetic attachment, or that the target magnetic cube and the magnetic cubes among the various magnetic cubes have magnetic attachment, determines the spatial coordinates corresponding to the empty voxel as a usable placement position.
[0030] Finally, the obtained available placement locations are determined as a set of available placement locations.
[0031] Step 103: Based on the set of unoccupied proxies and the set of available placement locations, determine the interaction attribute group for each unoccupied proxy in the set of unoccupied proxies and each available placement location in the set of available placement locations.
[0032] In some embodiments, the execution entity can determine a set of interaction attributes for each unoccupied agent in the set of unoccupied agents and each available placement location in the set of available placement locations, based on the set of unoccupied agents and the set of available placement locations. The set of interaction attributes can characterize local exposure, global haptic orientation quality, and the availability of unoccupied agents. Local exposure can be a measure of operational convenience obtained by exponentially transforming the number of unoccupied agent or available placement location's unobstructed free surfaces in six orthogonal directions in three-dimensional space. A higher local exposure indicates easier access and operation by the user. Free surfaces can characterize the geometric surfaces of the six orthogonal outer surfaces of an unoccupied agent that are not tightly attached to or obstructed by any entity (including magnetic cubes and magnetic bases), or the geometric surfaces of the six orthogonal outer surfaces of a magnetic cube that are not tightly attached to or obstructed by any entity after placing the magnetic cube in the available placement location. Global haptic orientation quality can characterize the weighted sum of the haptic values of all free surfaces of the unoccupied agent or available placement location in different directions. The aforementioned availability can be characterized as an exponential function of the number of unoccupied agents remaining in the current 3D interaction space after a physical interaction with that location (such as picking up or placing a magnetic cube). Each unoccupied agent in the aforementioned set of unoccupied agents corresponds to a set of interaction attributes. Each available placement location in the aforementioned set of available placement locations also corresponds to a set of interaction attributes.
[0033] In some optional implementations of certain embodiments, the execution entity may determine the interaction attribute group of each unoccupied proxy in the unoccupied proxy set and each available placement location in the available placement location set by the following steps: The first step, for each unoccupied agent in the above set of unoccupied agents and each available placement location in the above set of available placement locations, is to perform the following steps: The first sub-step involves determining the local exposure of the unoccupied agent or the available placement location based on the number of adjacent free faces in the six orthogonal principal directions of the physical interaction space. The number of free faces can represent the number of unoccupied agent's un-occupied geometric surfaces, or the number of un-occupied geometric surfaces of the magnetic cube after it is placed at the available placement location. In practice, the executing entity can first determine a first target value by multiplying the number of free faces by a preset exponential scaling constant. The specific value of the preset exponential scaling constant is not limited here. For example, the preset exponential scaling constant can be 0.3. Then, the local exposure of the unoccupied agent or the available placement location is determined by a function value with the natural constant e as the base and the first target value as the exponent.
[0034] The second sub-step is to determine the global haptic orientation quality of the unoccupied agent or the available placement location based on each free surface of the unoccupied agent or the available placement location.
[0035] The third sub-step involves determining the availability of the unoccupied agents or available placement locations based on the total number of unoccupied agents remaining after the status change of the occupied agents or available placement locations. The total number of unoccupied agents represents the number of unoccupied agents remaining after the status change of the occupied agents or available placement locations. In practice, firstly, the number of unoccupied agents remaining after removing the occupied agents from the magnetic physical agent system is determined as the total number of unoccupied agents corresponding to the occupied agents, or the number of unoccupied agents remaining after placing the magnetic cube in the available placement location is determined as the total number of unoccupied agents for the available placement location. Then, the availability of the unoccupied agents or available placement locations is determined by a function value with a base of 2 and an exponent of the total number of unoccupied agents.
[0036] The fourth sub-step involves determining the aforementioned local exposure, global haptic orientation quality, and availability as the interaction attribute group for the aforementioned unoccupied agent or the aforementioned available placement location.
[0037] In addressing the technical problems mentioned above, when using multiple stackable entity proxy cubes to build multi-layered block structures (such as a tower or bridge) in three-dimensional space according to a virtual template, the following technical problem often arises: For a magnetic cube with five empty faces and only one face attached for support (such as the downward-facing face), the special value of its facing direction (such as the upward-facing face) in operation cannot be recognized. This causes that direction to be assigned the same weight as other ordinary empty faces (such as the front, back, left, and right faces). When the virtual target needs to be grasped from directly above, the system uses the empty side proxy as the mapping target. The user visually perceives that it should be grasped from above, but physically, it can only be touched from the side, disrupting the consistency between tactile and visual directions and thus reducing the user experience. Considering the following requirements for this application scenario: accurate matching of grasping direction consistency, we decided to adopt the following solution: In some optional implementations of certain embodiments, the execution entity may determine the global haptic orientation quality of the unoccupied agent or the available placement location based on each free surface of the unoccupied agent or the available placement location through the following steps: The first step, in response to determining that only one support attachment surface exists for magnetic attachment of the aforementioned unoccupied agent, is to perform the following steps: The first sub-step involves determining the free surface in the direction directly opposite the aforementioned support attachment surface as the optimal contact surface. Here, the aforementioned support attachment surface can represent a geometric surface of the aforementioned unoccupied agent.
[0038] The second sub-step involves defining each free surface in the unoccupied agent that is not the optimal contact surface as a first set of ordinary contact surfaces. The first ordinary contact surfaces in this first set of ordinary contact surfaces can represent the free surfaces in the unoccupied agent that are not the optimal contact surfaces.
[0039] The third sub-step involves determining the global haptic orientation quality of the unoccupied agent based on the first preset weighted score corresponding to the optimal contact surface and the second preset weighted score corresponding to each first ordinary contact surface in the first ordinary contact surface set. The first preset weighted score can represent a pre-set weighted score corresponding to the optimal contact surface. The first preset weighted score can also represent a pre-set weighted score corresponding to an ordinary contact surface. The ordinary contact surface can be a first ordinary contact surface, a second ordinary contact surface, or a third ordinary contact surface. In practice, the executing entity can determine the global haptic orientation quality of the unoccupied agent by summing the first preset weighted score corresponding to the optimal contact surface and the second preset weighted score corresponding to each first ordinary contact surface in the first ordinary contact surface set. Here, the specific values of the first and second preset weighted scores are not limited. For example, if the first preset weighted score is 10 and the second preset weighted score is 2, then the global haptic orientation quality of the unoccupied agent can be 18.
[0040] The second step involves determining, in response to the determination that the aforementioned unoccupied agent has multiple supporting attachment surfaces generating magnetic attachment, that each free surface of the aforementioned unoccupied agent is defined as a second set of ordinary contact surfaces. Here, the second ordinary contact surfaces in the aforementioned set of second ordinary contact surfaces can represent the free surfaces of an unoccupied agent with multiple supporting attachment surfaces.
[0041] The third step involves determining the global haptic orientation quality of the unoccupied agent based on the aforementioned second set of ordinary contact surfaces and the aforementioned second preset weighted score. In practice, the executing entity can determine the global haptic orientation quality of the unoccupied agent by multiplying the number of second ordinary contact surfaces included in the aforementioned second set of ordinary contact surfaces by the aforementioned second preset weighted score.
[0042] The fourth step is to define each vacant face of the aforementioned available placement positions as a third set of ordinary contact faces. The third ordinary contact face in this set can represent the vacant face of the magnetic cube after it has been placed in the aforementioned available placement positions.
[0043] Fifth, based on the aforementioned third set of ordinary contact surfaces and the aforementioned second preset weighted score, determine the global haptic orientation quality of the available placement location. In practice, the executing entity can determine the global haptic orientation quality of the unoccupied agent by multiplying the number of third ordinary contact surfaces included in the aforementioned third set of ordinary contact surfaces by the aforementioned second preset weighted score.
[0044] The above-described technical solution, as an inventive point of this disclosure, solves technical problem two: "the disruption of the directional consistency between touch and vision, thereby reducing the user's experience." The reason for this disruption is as follows: For a magnetic cube with five unused faces supported only by one face (e.g., the downward-facing face), the special value of its facing direction (e.g., the upward-facing face) in operation cannot be recognized. This causes that direction to be assigned the same weight as other ordinary unused faces (e.g., the front, back, left, and right faces). When a virtual target needs to be grasped from directly above, the system uses the unused side face as the mapping target. The user visually perceives it as needing to be grasped from above, but physically can only touch it from the side, thus disrupting the directional consistency between touch and vision and reducing the user's experience. To achieve this effect, the direction-aware 3D spatial haptic redirection method disclosed herein first classifies the free surfaces of unoccupied agents: when an agent generates attachment support through only one surface, the free surface in the direction directly opposite that attachment surface is defined as the optimal contact surface, and the remaining free surfaces are defined as ordinary contact surfaces. When an agent has multiple attachment support surfaces, all free surfaces are defined as ordinary contact surfaces. For available placement positions, all free surfaces are also defined as ordinary contact surfaces. Then, a higher first preset weighted score is assigned to the optimal contact surface, and a lower second preset weighted score is assigned to the ordinary contact surfaces. The global haptic direction quality is calculated by weighted summation. This improves the consistency between haptic and visual directions, thereby enhancing the user experience.
[0045] Step 104: Based on the obtained interaction attribute groups, determine the haptic direction score set corresponding to the set of unoccupied agents and the set of available placement positions.
[0046] In some embodiments, the executing entity can determine a set of haptic direction scores corresponding to the set of unoccupied agents and the set of available placement locations based on the obtained sets of interaction attribute groups. The haptic direction scores in the set of haptic direction scores can be characterized as quantitative indicators for evaluating the priority of the unoccupied agents or the available placement locations in haptic redirection. In practice, firstly, for each of the interaction attribute groups, the executing entity can multiply the local exposure, global haptic direction quality, and availability included in the interaction attribute group to obtain the haptic direction score corresponding to the interaction attribute group. Then, the obtained haptic direction scores are determined as the set of haptic direction scores corresponding to the set of unoccupied agents and the set of available placement locations.
[0047] Step 105: Determine the target tactile direction score set based on the tactile direction score set, the current real hand position, and the virtual target information.
[0048] In some embodiments, the execution entity can determine the target tactile direction score set based on the aforementioned tactile direction score set, the current real hand position, and the virtual target information. The current real hand position can represent the three-dimensional coordinates of the user's hand at the current moment in the physical interaction space. The virtual target information can represent the object the user intends to interact with in the virtual space. The virtual space can be a computer-rendered three-dimensional digital virtual space that can output visual images to the user through VR / AR devices, allowing the user to perform interactive operations such as grasping and touching virtual objects within the virtual space through hand gestures. The target tactile direction score in the aforementioned target tactile direction score set can represent the tactile direction score corresponding to an unoccupied agent or available placement position that simultaneously satisfies the spatial orientation alignment condition and the preset perceptual gain condition.
[0049] In some optional implementations of certain embodiments, the execution entity may determine the target tactile direction score set based on the aforementioned tactile direction score set, the current real hand position, and the virtual target information through the following steps: The first step, for each unoccupied proxy set in the above unoccupied proxy set or each available placement location in the above available placement location set, is to perform the following steps: The first sub-step involves removing the haptic direction scores corresponding to the unoccupied agent or available placement position from the haptic direction score set, in response to determining that the unoccupied agent or available placement position does not meet the spatial orientation alignment condition. The spatial orientation alignment condition can be that the unoccupied agent or available placement position supports physical interaction from the operable approach direction corresponding to the virtual target information, and there are no physical obstructions on the path from the current real hand position to the unoccupied agent or available placement position along the operable approach direction. The operable approach direction can represent a specific spatial orientation in which the user's hand must approach the virtual target information from the outside in order to perform a preset interactive operation (such as grasping, pressing, or inserting). For example, an operable approach direction could be grasping a block from directly above or pressing a button from directly in front.
[0050] The second sub-step, in response to determining that the unoccupied agent or the available placement location satisfies the spatial alignment condition, determines the redirection gain required to redirect from the current real hand position to the unoccupied agent or the available placement location, based on the current real hand position, the spatial pose of the unoccupied agent or the available placement location, and the spatial pose of the virtual target information. The redirection gain can represent horizontal angle gain, vertical angle gain, and translation distance gain. The horizontal angle gain can represent the gain in the horizontal direction. The vertical angle gain can represent the gain in the vertical direction. The translation distance gain can represent the ratio between the straight-line distance moved by the current virtual hand position and the straight-line distance moved by the current real hand position. The current virtual hand position can represent the hand's position coordinates in virtual space at the current moment. In practice, firstly, the three-dimensional coordinates, horizontal and vertical orientation angles of the current real hand position are acquired using the aforementioned color depth camera, along with the spatial pose (including three-dimensional coordinates, horizontal and vertical orientation angles) of the unoccupied proxy or available placement location, and the spatial pose (including three-dimensional coordinates, horizontal and vertical orientation angles) of the virtual target information. Then, the orientation angles of the current virtual hand position in the horizontal and vertical directions are acquired using the inertial measurement unit in the virtual reality device, and the position coordinates (three-dimensional coordinates) of the current virtual hand are acquired using the built-in camera. Next, the Euclidean distance between the three-dimensional coordinates of the spatial pose of the virtual target information and the three-dimensional coordinates corresponding to the current virtual hand position is determined as the virtual three-dimensional spatial translation distance. The difference between the horizontal orientation angle of the spatial pose of the virtual target information and the horizontal orientation angle of the current virtual hand position is determined as the virtual horizontal rotation angle, and the difference between the vertical orientation angle of the spatial pose of the virtual target information and the vertical orientation angle of the current virtual hand position is determined as the virtual vertical rotation angle. Next, the Euclidean distance between the three-dimensional coordinates of the spatial pose of the unoccupied agent or the available placement location and the three-dimensional coordinates of the current real hand position is determined as the real three-dimensional spatial translation distance. The difference between the horizontal direction angle of the spatial pose of the unoccupied agent or the available placement location and the horizontal direction angle of the current real hand position is determined as the real horizontal rotation angle. The difference between the vertical direction angle of the spatial pose of the unoccupied agent or the available placement location and the vertical direction angle of the current real hand position is determined as the real vertical rotation angle.Finally, the ratio between the virtual horizontal rotation angle and the real horizontal rotation angle is determined as the horizontal angle gain, the ratio between the virtual vertical rotation angle and the real vertical rotation angle is determined as the vertical angle gain, and the ratio between the virtual three-dimensional spatial translation distance and the real three-dimensional spatial translation distance is determined as the translation distance gain.
[0051] The third sub-step involves removing the haptic direction fractions corresponding to the unoccupied agents or available placement positions from the haptic direction fraction set, in response to determining that the redirection gain does not meet the preset perception gain condition. The preset perception gain condition can be that the horizontal and vertical angle gains included in the redirection gain are within a preset error threshold range, and the translation distance gain included in the redirection gain is within a preset scaling ratio range. The specific ranges of the preset error threshold range and the preset scaling ratio range are not limited here. For example, the preset error threshold range can be 0.7 to 1.3, and the preset scaling ratio range can be 0.5 to 2.0.
[0052] The second step is to determine the set of tactile direction scores obtained after removal as the target set of tactile direction scores.
[0053] Step 106: In response to determining that the target tactile direction score set is not empty, determine the target physical agent or target placement position corresponding to the virtual target information based on the target tactile direction score set.
[0054] In some embodiments, in response to determining that the target haptic direction score set is not empty, the executing entity may determine the target physical agent or target placement location corresponding to the virtual target information based on the target haptic direction score set. The target physical agent may represent the magnetic cube ultimately selected for mapping the virtual target information. The target placement location may represent the empty voxel ultimately selected for mapping the virtual target information. In practice, the executing entity may determine the unoccupied agent or available placement location corresponding to the target haptic direction score with the largest value in the target haptic direction score set as the target physical agent or target placement location.
[0055] In addressing the technical problems mentioned above, and considering the application scenario of virtual reality block building, when a user builds to a higher level, the lack of unoccupied proxies and available placement positions in the physical interaction space results in a lack of unoccupied proxies and available placement positions around the current hand position that meet the spatial alignment and gain threshold requirements for mapping. This often leads to the following technical problem three: using a fixed position for forced rollback, without considering the spatial correlation between the reset point and subsequent unoccupied proxies and available placement positions, causes the user to frequently reach out to search for available targets after resetting, increasing the number of system resets and the distance the user's arm moves, thus disrupting the continuity of the user's immersive building operation. Considering the following requirements for this application scenario: high requirements for the spatial correlation between the reset point and available proxies, and high requirements for haptic redirection efficiency, we decided to adopt the following solution: Optionally, after step 106, the aforementioned execution entity may also perform the following steps: The first step, in response to the determination that the target tactile direction score set is empty, generates a set of potential reset candidate points centered on the current real hand position. The potential reset candidate points in this set can represent the center coordinates of voxels obtained by expanding the search spherically layer by layer outward from the current real hand position. In practice, firstly, the executing entity can use the three-dimensional coordinates of the current real hand position as the center of a sphere, and discretize the physical interaction space into a regular voxel grid according to a preset voxel side length (e.g., 5 cm). Then, starting from the voxel grid layer closest to the center of the sphere, it expands outward layer by layer, collecting the center coordinates of each voxel grid sequentially. Finally, in response to the determination that the outward expansion radius is greater than or equal to the maximum search radius, the collected center coordinates are determined as the set of reset candidate points. Here, the specific value of the maximum search radius is not limited and can be adjusted according to actual needs.
[0056] The second step involves, for each potential reset candidate point in the aforementioned set of potential reset candidate points, in response to determining that the potential reset candidate point meets preset transition compliance conditions, defining it as an intermediate reset candidate point, thus obtaining a set of intermediate reset candidate points. The preset transition compliance conditions can be that the Euclidean distance between the current actual hand position and the potential reset candidate point is less than or equal to a preset maximum movement distance, and the angular change from the current actual hand position to the potential reset candidate point is less than or equal to a preset maximum rotation angle. The specific values of the preset maximum movement distance and the preset maximum rotation angle are not limited here. For example, the preset maximum movement distance can be 50cm, and the preset maximum rotation angle can be 30°.
[0057] The third step is to determine the target tactile direction score set corresponding to each intermediate reset candidate point in the aforementioned intermediate reset candidate point set. It should be noted that for each intermediate reset candidate point in the aforementioned intermediate reset candidate point set, the method for determining the target tactile direction score set corresponding to the intermediate reset candidate point based on the spatial pose of the hand after moving from the current hand position to the intermediate reset candidate point, the aforementioned unoccupied proxy set, the aforementioned available placement position set, and the aforementioned tactile direction score set is the same as the method for determining the target tactile direction score set of the current hand position based on the spatial pose of the current hand position, the aforementioned unoccupied proxy set, the aforementioned available placement position set, and the aforementioned tactile direction score set. The specific details will not be elaborated further; please refer to steps 103-105.
[0058] The fourth step involves filtering each intermediate reset candidate point in the aforementioned intermediate reset candidate point set based on the obtained target tactile direction score sets, thereby obtaining the target reset candidate point set. In practice, firstly, corresponding to each target tactile direction score set, in response to determining that the aforementioned target tactile direction score set is empty, the executing entity deletes the intermediate reset candidate point corresponding to the aforementioned target tactile direction score set from the aforementioned intermediate reset candidate point set. Then, the intermediate reset candidate point set obtained after deletion is determined as the target reset candidate point set.
[0059] Fifth, for each target reset candidate point in the above target reset candidate point set, perform the following steps: The first sub-step involves determining the highest tactile direction score from the set of target tactile direction scores corresponding to the aforementioned target reset candidate points that satisfies a first preset selection condition. The first preset selection condition can be selecting the target tactile direction score with the largest value from the aforementioned set of target tactile direction scores.
[0060] The second sub-step involves determining a comprehensive score for the target reset candidate point based on the highest tactile direction score and the current hand position. This comprehensive score serves as a quantitative indicator of the overall quality of the target reset candidate point. In practice, firstly, the executing entity determines the product of the highest tactile direction score and a preset adjustment ratio constant as the second target value. The specific value of this preset adjustment ratio constant is not limited; for example, it can be 0.6. Then, the Euclidean distance between the current hand position and the target reset candidate point is determined as the third target value, and the Euclidean distance between the target reset candidate point and the unoccupied physical agent or available placement position corresponding to the highest tactile direction score is determined as the fourth target value. Next, the sum of the third and fourth target values is determined as the fifth target value. Finally, the difference between the second and fifth target values is used to determine the comprehensive score of the target reset candidate point.
[0061] The sixth step is to determine the target reset candidate point corresponding to the comprehensive score that meets the second preset selection condition among the obtained comprehensive scores as the optimal reset point. The second preset selection condition can be to select the comprehensive score with the highest numerical value among the various comprehensive scores.
[0062] Step 7: Determine the physical agent or placement position of the highest tactile direction score corresponding to the above optimal reset point as the target physical agent or target placement position.
[0063] The above-described technical solution, as an inventive point of this disclosure, solves technical problem three: "Increased system reset counts and user arm movement distance, disrupting the continuity of the user's immersive building operation." The reasons for this increased system reset counts and user arm movement distance, disrupting the continuity of the user's immersive building operation, are as follows: Using a fixed position for forced rollback does not consider the spatial correlation between the reset point and subsequent unoccupied proxies and available placement positions. This results in the user still needing to frequently reach out to search for available targets after the reset, increasing the system reset counts and user arm movement distance, thus disrupting the continuity of the user's immersive building operation. To achieve this effect, the direction-aware 3D spatial tactile redirection method of this disclosure generates a set of potential reset candidate points by searching outwards layer by layer from the current real hand position. Then, it filters out the potential reset candidate points corresponding to the target tactile direction score set that meets preset transition compliance conditions and is not empty as target reset candidate points. Next, it selects the point with the highest comprehensive score from the target reset candidate point set as the optimal reset point, guides the user's hand to that point, and locks the corresponding optimal physical target to complete the redirection interaction. This reduces the number of system resets and the distance users need to move their arms, thus improving the continuity of the immersive building process.
[0064] The above-described embodiments of this disclosure have the following beneficial effects: A direction-aware 3D spatial tactile redirection method based on some embodiments of this disclosure can reduce the occurrence of physical structure collapse caused by users picking up key support blocks, improve the directional consistency between touch and vision, and reduce the number of system resets and the distance the user's arm moves, thus improving the user's immersive interactive experience. The reason why physical structure collapse caused by users picking up key support blocks disrupts the directional consistency between touch and vision, increases the number of system resets and the distance the user's arm moves, and severely disrupts the user's immersive interactive experience is that: existing methods only select physical agents based on spatial distance and cannot distinguish the support relationship of agents in a 3D stacked structure, leading to physical structure collapse caused by users picking up key support blocks; simultaneously, existing methods ignore the alignment relationship between the operable approach direction of the virtual target and the free surface direction of the physical agent, disrupting the directional consistency between touch and vision; furthermore, the fixed-position reset strategy does not consider the spatial correlation between the reset point and subsequent available agents, resulting in frequent searches after reset, increasing the number of system resets and the distance the user's arm moves, severely disrupting the user's immersive interactive experience. Based on this, some embodiments of the orientation-aware 3D spatial tactile redirection method disclosed herein first construct a magnetic physical agent system comprising a magnetic base and various magnetic cubes. This yields the magnetic physical agent system. Next, based on the magnetic attachment relationships between the magnetic cubes in the magnetic physical agent system, a set of unoccupied agents and a set of available placement positions are determined. This yields a set of occupied agents and a set of available placement positions. Then, based on the set of unoccupied agents and the set of available placement positions, an interaction attribute group is determined for each unoccupied agent in the set of unoccupied agents and each available placement position in the set of available placement positions. This yields an interaction attribute group corresponding to each unoccupied agent and an interaction attribute group corresponding to each available placement position. Next, based on the obtained interaction attribute groups, a set of tactile direction scores corresponding to the set of unoccupied agents and the set of available placement positions is determined. This yields a tactile direction score corresponding to each unoccupied agent and a tactile direction score corresponding to each available placement position. Finally, based on the set of tactile direction scores, the current real hand position, and virtual target information, a target tactile direction score set is determined. Therefore, a target tactile direction score set can be obtained. Finally, in response to determining that the above target tactile direction score set is not empty, the target physical agent or target placement position corresponding to the above virtual target information is determined based on the above target tactile direction score set. Therefore, the target physical agent or target placement position corresponding to the virtual target information can be obtained.Because it doesn't select physical agents solely based on spatial distance, but first constructs a magnetic physical agent system and clarifies the judgment logic for unoccupied agents (i.e., only agents whose removal will not cause other agents to collapse can be considered as candidates), it effectively distinguishes the support relationships of agents in the 3D stacked structure, reducing the possibility of structural collapse caused by users picking up key support blocks. Furthermore, because it doesn't only focus on the positional matching between virtual target information and physical agents, but introduces a tactile direction score mechanism, and combines the operable approach direction of virtual target information for spatial direction alignment filtering, it solves the problem of inconsistency between tactile and visual directions. Also, because it doesn't use a fixed position for forced backtracking, but proposes an optimal reset point selection method based on volume search, searching spherically layer by layer outward from the current hand position, and filtering to obtain target reset candidate points, it ensures that there are usable physical agents around the target reset candidate points, thereby reducing the number of system resets and the user's arm movement distance, and ensuring the continuity of the immersive interactive experience. This reduces the likelihood of physical structure collapse caused by users picking up key support blocks, improves the consistency between tactile and visual directions, reduces the number of system resets and the distance users need to move their arms, and enhances the user's immersive interactive experience.
[0065] Further reference Figure 2 As an implementation of the methods shown in the above figures, this disclosure provides some embodiments of a direction-aware three-dimensional spatial tactile redirection method. These device embodiments are similar to... Figure 1 Corresponding to the method embodiments shown, the device can be specifically applied to various electronic devices.
[0066] like Figure 2As shown, a direction-aware three-dimensional spatial tactile redirection device 200 in some embodiments includes: a construction unit 201, a first determining unit 202, a second determining unit 203, a third determining unit 204, a fourth determining unit 205, and a fifth determining unit 206. The construction unit 201 is configured to construct a magnetic physical agent system comprising a magnetic base and various magnetic cubes, wherein each of the magnetic cubes has a visual reference marker. The first determining unit 202 is configured to determine an unoccupied agent set and a set of available placement positions based on the magnetic attachment relationships between the magnetic cubes in the magnetic physical agent system. The second determining unit 203 is configured to determine, based on the unoccupied agent set and the set of available placement positions, an interaction attribute group for each unoccupied agent in the unoccupied agent set and each available placement position in the set of available placement positions. The aforementioned interaction attribute groups include local exposure, global haptic direction quality, and availability; the third determining unit 204 is configured to determine the haptic direction score set corresponding to the aforementioned unoccupied agent set and the aforementioned available placement position set based on the obtained interaction attribute groups; the fourth determining unit 205 is configured to determine the target haptic direction score set based on the aforementioned haptic direction score set, the current real hand position, and the virtual target information; the fifth determining unit 206 is configured to determine the target physical agent or target placement position corresponding to the aforementioned virtual target information based on the aforementioned target haptic direction score set in response to determining that the aforementioned target haptic direction score set is not empty.
[0067] It is understandable that the units and references described in the direction-aware three-dimensional spatial tactile redirection device 200 Figure 1 The steps in the described method correspond to each other. Therefore, the operations, features, and beneficial effects described above for the method also apply to the positioning information generation device 200 and the units contained therein, and will not be repeated here.
[0068] The following is for reference. Figure 3 It shows a schematic diagram of the structure of an electronic device 300 (e.g., a computing device) suitable for implementing some embodiments of the present disclosure. Figure 3 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments of this disclosure.
[0069] like Figure 3As shown, the electronic device 300 may include a processing unit 301 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 302 or a program loaded from a storage device 308 into a random access memory (RAM) 303. The RAM 303 also stores various programs and data required for the operation of the electronic device 300. The processing unit 301, ROM 302, and RAM 303 are interconnected via a bus 304. An input / output (I / O) interface 305 is also connected to the bus 304.
[0070] Typically, the following devices can be connected to I / O interface 305: input devices 306 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 307 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 308 including, for example, magnetic tapes, hard disks, etc.; and communication devices 309. Communication device 309 allows electronic device 300 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 3 An electronic device 300 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively. Figure 3 Each box shown can represent a device or multiple devices as needed.
[0071] In particular, according to some embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, some embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication device 309, or installed from storage device 308, or installed from ROM 302. When the computer program is executed by processing device 301, it performs the functions defined in the methods of some embodiments of this disclosure.
[0072] It should be noted that, in some embodiments of this disclosure, the computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium may be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In some embodiments of this disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In some embodiments of this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.
[0073] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.
[0074] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device. The aforementioned computer-readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to: construct a magnetic physical agent system comprising a magnetic base and various magnetic cubes, wherein each of the magnetic cubes is marked with a visual reference mark; determine an unoccupied agent set and an available placement location set based on the magnetic attachment relationships between the magnetic cubes in the magnetic physical agent system; determine an interaction attribute set for each unoccupied agent in the unoccupied agent set and each available placement location in the available placement location set, based on the unoccupied agent set and the available placement location set, wherein the interaction attribute set includes local exposure, global haptic orientation quality, and availability; determine a haptic orientation score set corresponding to the unoccupied agent set and the available placement location set based on the obtained interaction attribute sets; determine a target haptic orientation score set based on the haptic orientation score set, the current real hand position, and virtual target information; and, in response to determining that the target haptic orientation score set is not empty, determine a target physical agent or target placement location corresponding to the virtual target information based on the target haptic orientation score set.
[0075] Computer program code for performing operations of some embodiments of this disclosure can be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, and C++, and conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0076] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.
[0077] The units described in some embodiments of this disclosure can be implemented in software or hardware. The described units can also be housed in a processor, and for example, can be described as: a construction unit, a first determining unit, a second determining unit, a third determining unit, a fourth determining unit, and a fifth determining unit. The names of these units do not necessarily limit the unit itself; for example, a construction unit can also be described as "a unit for constructing a magnetic physical agent system comprising a magnetic base and various magnetic cubes."
[0078] The functions described above in this document can be performed at least in part by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SoCs), complex programmable logic devices (CPLDs), and so on.
[0079] The above description is merely a selection of preferred embodiments of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of the invention involved in the embodiments of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described inventive concept. For example, technical solutions formed by substituting the above-described features with (but not limited to) technical features with similar functions disclosed in the embodiments of this disclosure.
Claims
1. A direction-aware three-dimensional spatial tactile redirection method, comprising: Construct a magnetic physical agent system comprising a magnetic base and individual magnetic cubes, wherein each of the individual magnetic cubes is marked with a visual reference mark; Based on the magnetic attachment relationship between each magnetic cube in the magnetic physical agent system, the set of unoccupied agents and the set of available placement locations are determined. Based on the set of unoccupied proxies and the set of available placement locations, determine the interaction attribute group for each unoccupied proxy in the set of unoccupied proxies and each available placement location in the set of available placement locations, wherein the interaction attribute group includes local exposure, global haptic orientation quality, and availability; Based on the obtained interaction attribute groups, determine the haptic direction score set corresponding to the unoccupied agent set and the available placement position set; Based on the tactile direction score set, the current real hand position, and the virtual target information, determine the target tactile direction score set; In response to determining that the target tactile direction score set is not empty, the target physical agent or target placement position corresponding to the virtual target information is determined based on the target tactile direction score set.
2. The method according to claim 1, wherein, The determination of the set of unoccupied agents and the set of available placement locations based on the magnetic attachment relationships between the various magnetic cubes in the magnetic physical agent system includes: For each magnetic cube in the magnetic physical agent system, perform the following steps: In response to determining that the magnetic cube has been removed from the magnetic physical agent system, all other magnetic cubes in the magnetic physical agent system that are not the magnetic cube remain unchanged, and the magnetic cube is determined to be an unoccupied agent. Each unoccupied proxy is identified as a set of unoccupied proxies; Based on the magnetic attachment relationship between each magnetic cube in the magnetic physical agent system, a set of available placement locations is determined.
3. The method according to claim 2, wherein, The determination of the set of available placement locations based on the magnetic attachment relationships between each magnetic cube in the magnetic physical proxy system includes: The physical interaction space is divided into empty voxel meshes to obtain an empty voxel map; For each empty voxel in the vacancy voxel map, perform the following steps: Place the target magnetic cube at the empty voxel; In response to determining that the target magnetic cube has magnetic attachment to the magnetic base, or that the target magnetic cube has magnetic attachment to the magnetic cubes among the various magnetic cubes, the spatial coordinates corresponding to the empty voxel are determined as a usable placement position. The obtained available placement locations are defined as a set of available placement locations.
4. The method according to claim 1, wherein, The step of determining the interaction attribute group for each unoccupied proxy in the unoccupied proxy set and each available placement location in the available placement location set based on the unoccupied proxy set and the available placement location set includes: For each unoccupied agent in the set of unoccupied agents and each available placement location in the set of available placement locations, perform the following steps: The local exposure of the unoccupied agent or the available placement location is determined based on the number of adjacent free surfaces in the six orthogonal principal directions of the physical interaction space. Determine the global haptic orientation quality of the unoccupied agent or the available placement location based on each free surface of the unoccupied agent or the available placement location; The availability of the unoccupied agents or the available placement locations is determined based on the total number of unoccupied agents remaining after the status of the occupied agents or the available placement locations changes. The local exposure, the global haptic orientation quality, and the availability are determined as the interaction attribute group for the unoccupied agent or the available placement location.
5. The method according to claim 1, wherein determining the target tactile direction score set based on the tactile direction score set, the current real hand position, and the virtual target information comprises: For each unoccupied proxy set in the unoccupied proxy set or each available placement location in the available placement location set, perform the following steps: In response to determining that the unoccupied agent or the available placement location does not meet the spatial orientation alignment condition, the haptic orientation score corresponding to the unoccupied agent or the available placement location in the haptic orientation score set is removed; In response to determining that the unoccupied agent or the available placement location satisfies the spatial orientation alignment condition, based on the current real hand position, the spatial pose of the unoccupied agent or the available placement location, and the spatial pose of the virtual target information, the redirection gain required to redirect from the current real hand position to the unoccupied agent or the available placement location is determined. In response to determining that the redirection gain does not meet the preset perception gain condition, the haptic direction fraction corresponding to the unoccupied agent or the available placement position in the haptic direction fraction set is removed; The set of tactile direction scores obtained after removal is determined as the target tactile direction score set.
6. A three-dimensional spatial tactile redirection device based on direction perception, comprising: The building unit is configured to build a magnetic physical agent system comprising a magnetic base and various magnetic cubes, wherein each of the various magnetic cubes is marked with a visual reference mark. The first determining unit is configured to determine the set of unoccupied agents and the set of available placement locations based on the magnetic attachment relationship between each magnetic cube in the magnetic physical agent system. The second determining unit is configured to determine an interaction attribute group for each unoccupied agent in the unoccupied agent set and each available placement location in the available placement location set, based on the unoccupied agent set and the available placement location set, wherein the interaction attribute group includes local exposure, global haptic orientation quality, and availability. The third determining unit is configured to determine the set of haptic direction scores corresponding to the set of unoccupied agents and the set of available placement positions based on the obtained sets of interactive attribute groups. The fourth determining unit is configured to determine the target tactile direction score set based on the tactile direction score set, the current real hand position, and the virtual target information; The fifth determining unit is configured to, in response to determining that the target tactile direction score set is not empty, determine the target physical agent or target placement position corresponding to the virtual target information based on the target tactile direction score set.
7. An electronic device, comprising: One or more processors; A storage device on which one or more programs are stored; When the one or more programs are executed by the one or more processors, the one or more processors implement the method as described in any one of claims 1 to 5.
8. A computer-readable medium having a computer program stored thereon, wherein, When the computer program is executed by a processor, it implements the method as described in any one of claims 1 to 5.
