Method and device for determining vector for avoiding interference between body parts of animated character

The method addresses real-time motion capture interference by calculating avoidance vectors to prevent arm collisions between animation characters, enhancing the accuracy and naturalness of character animations in real-time virtual content creation.

WO2024237372A1PCT designated stage expired Publication Date: 2024-11-21VLAST CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2023/006735
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-12
Filing Date
2023-05-18
Publication Date
2024-11-21

AI Technical Summary

Technical Problem

Conventional motion capture methods fail to prevent interference between animation characters' bodies in real-time applications, leading to collisions due to the lack of post-processing corrections, especially when applying motion data directly to characters in real-time virtual content creation.

Method used

A method and device that detect collision risks in real-time by generating character bones, setting collision risk check points, performing collision tests, and calculating avoidance vectors based on collision surfaces and movement directions to prevent arm collisions with other body parts.

Benefits of technology

Enables the creation of natural and collision-free animations by eliminating body proportion restrictions and dynamically adjusting character movements to avoid inter-body collisions during real-time motion capture, ensuring smooth and accurate character animation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2023006735_21112024_PF_FP_ABST
    Figure KR2023006735_21112024_PF_FP_ABST
Patent Text Reader

Abstract

An operation method for avoiding interference between body parts of a character, in which the method is executed by at least one processor of a device, comprises the steps of: generating bones of a character corresponding to a user on the basis of images of the user; setting, on the bones of the character, a start point and a target point for testing for the risk of collision between the body parts of the character; performing a collision test of collisions between the start point and the target point and calculating a collision surface between the start point and the target point; and calculating an avoidance vector on the basis of at least one of the collision surface or the movement direction of the character.
Need to check novelty before this filing date? Find Prior Art

Description

Method and device for determining vectors for avoiding body interference of animation characters

[0001] The present invention relates to a method and device for avoiding interference between bodies of an animation character, and more particularly, to a method and device for avoiding interference between bodies of an animation character created in real time using motion capture technology.

[0002] Motion capture refers to the process of digitally recording human movements by attaching sensors to the body or using image sensors. Alternatively, motion capture can refer to a technology that captures a user's motions and records and processes them in the form of computer graphics (CG) animation. In other words, a motion capture system can create an animated character by capturing the actual user's movements and mapping the captured movements to computer-generated objects.

[0003] Conventional motion capture methods for creating animated characters simply apply motion data directly to the character, without considering differences in body proportions between the object and the character. Therefore, using conventional motion capture methods can easily lead to collisions between body parts, such as the character's arms, and other body parts. For example, if the character's arms are longer than the object's, the object may be holding its waist with its hands, but the character's hands, generated based on the object's motion information, may end up buried in the pelvis.

[0004] Conventional motion capture methods have mostly been applied to pre-rendered footage, such as movies. In pre-rendered footage, motion capture data is acquired and then manually corrected by animators through a post-processing process, allowing for the correction of collisions between body parts of animated characters.

[0005] However, demand for real-time virtual content using game engines and other technologies is increasing, and attempts to apply motion capture techniques to characters in real time are also on the rise. Consequently, creating content that applies motion capture data to characters in real time requires applying the data directly to the character without any additional post-processing. Therefore, existing motion capture methods are showing limitations.

[0006] Accordingly, the need for a method for avoiding interference between the bodies of animated characters for real-time motion capture is emerging. The present invention relates to this.

[0007] The present invention has been devised to solve the above problem, and an object of the present invention is to provide a method for avoiding interference between bodies of an animation character by detecting a risk of collision in real time and processing motion capture data to prevent an arm from colliding with another body and applying the data to character animation.

[0008] The technical problems to be achieved through the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.

[0009] An operation method for avoiding collision between bodies of a character, executed by at least one processor of a device according to one embodiment of the present invention, may include: a step of generating a bone of a character corresponding to a user based on an image of the user; a step of setting a start point and a target point for checking a collision risk between the bodies of the character on the bone of the character; a step of performing a collision test between the start point and the target point to calculate a collision surface between the start point and the target point; and a step of calculating an avoidance vector based on at least one of the collision surface and the movement direction of the upper limb of the character.

[0010] Here, the step of calculating the avoidance vector may include a step of calculating a basic avoidance vector, and the step of calculating the basic avoidance vector may include a step of calculating a collision distance ratio based on the positions of the starting point, the target point, and the collision surface; and a step of calculating a first avoidance vector, which is a normal vector of the collision surface between the starting point and the target point.

[0011] Here, the first avoidance vector may be characterized in that it is calculated based on the starting point, target point, and collision surface with the smallest collision distance ratio.

[0012] Here, the step of calculating the basic evasion vector may further include the step of calculating a tendency vector from the spine of the character to the lower limb of the upper limb; and the step of calculating a second evasion vector by adding the tendency vector to the first evasion vector.

[0013] Here, the step of calculating the evasion vector may further include a step of calculating an additional evasion vector based on at least one of a frontal vector of the central axis of the character and a side vector from the spine of the character to the side.

[0014] Here, the step of calculating the additional evasion vector may include a step of calculating a third evasion vector that restricts the basic evasion vector to be parallel to the front vector of the central axis when the basic evasion vector is directed in an opposite direction beyond the center of the character.

[0015] Here, the step of calculating the additional evasion vector may be characterized by including a step of calculating a fourth evasion vector by adding the side vector to the basic evasion vector.

[0016] Here, the step of calculating the fourth evasion vector may include the steps of: setting a first reference point on the upper arm of the character and a second reference point on the spine segment of the character; calculating an upper arm collision ratio based on a distance value between the first reference point and the second reference point and a distance value from the spine to the side; and calculating a weight based on the upper arm collision ratio value, and the fourth evasion vector may be characterized in that it is calculated based on the basic evasion vector, the side vector, and the weight.

[0017] Here, the first reference point is the center point of the character's upper arm, the second reference point is the point closest to the first reference point on the spine segment, and the upper arm collision ratio value may be a value obtained by dividing the distance value from the spine to the side by the distance value between the first reference point and the second reference point.

[0018] Here, the fourth evasion vector may be characterized in that it is calculated by adding the side vector to which the weight is applied to the basic evasion vector.

[0019] Here, if the upper collision ratio value is greater than a preset first value, the size of the side vector to which the weight is applied may be characterized as 0.

[0020] Here, when the upper collision ratio value is less than or equal to the preset second value, the size of the side vector to which the weight is applied may be characterized as being equal to the size of the basic avoidance vector.

[0021] A device of a system for executing an operation method for avoiding collision between bodies of a character according to one embodiment of the present invention comprises: a memory in which at least one program command is stored; and a processor for executing the at least one program command, wherein the at least one program command can be executed to generate a bone of a character corresponding to a user based on an image of the user; set a start point and a target point for checking a collision risk between the bodies of the character on the bone of the character; perform a collision test between the start point and the target point to calculate a collision surface between the start point and the target point; and calculate an avoidance vector based on at least one of the collision surface and the movement direction of the upper limb of the character.

[0022] Here, the at least one program command may be characterized in that, when executed to produce the avoidance vector, the program command is executed to produce a basic avoidance vector; when executed to produce the basic avoidance vector, the program command is executed to produce a collision distance ratio based on the positions of the starting point, the target point, and the collision surface; and the program command is executed to produce a first avoidance vector, which is a normal vector of the collision surface between the starting point and the target point.

[0023] Here, the first avoidance vector may be characterized in that it is calculated based on the starting point, target point, and collision surface with the smallest collision distance ratio.

[0024] Here, in order to produce the basic evasion vector, it may be characterized in that a tendency vector directed from the spine of the character to the lower arm of the upper limb is produced; and a second evasion vector is produced by adding the tendency vector to the first evasion vector.

[0025] Here, in the process of calculating the evasion vector, it may be characterized in that an additional evasion vector is calculated based on at least one of a frontal vector of the central axis of the character and a side vector from the spine of the character to the side.

[0026] Here, when executing to produce the additional evasion vector, it may be characterized in that when the basic evasion vector is directed in the opposite direction beyond the center of the character, the execution is executed to produce a third evasion vector that restricts the basic evasion vector to be parallel to the front vector of the central axis.

[0027] Here, in order to produce the additional evasion vector, it may be characterized in that the process is performed to produce a fourth evasion vector by adding the side vector to the basic evasion vector.

[0028] Here, in order to calculate the fourth evasion vector, the method may be characterized in that the method is executed such that a first reference point on the upper arm of the character and a second reference point on the spine segment of the character are set; an upper arm collision ratio is calculated based on a distance value between the first reference point and the second reference point and a distance value from the spine to the side; and a weight is calculated based on the upper arm collision ratio value, and the fourth evasion vector is calculated based on the basic evasion vector, the side vector, and the weight.

[0029] Here, the first reference point is the center point of the character's upper arm, the second reference point is the point closest to the first reference point on the spine segment, and the upper arm collision ratio value may be a value obtained by dividing the distance value from the spine to the side by the distance value between the first reference point and the second reference point.

[0030] Here, the fourth evasion vector may be characterized in that it is calculated by adding the side vector to which the weight is applied to the basic evasion vector.

[0031] Here, if the upper collision ratio value is greater than a preset first value, the size of the side vector to which the weight is applied may be characterized as 0.

[0032] Here, when the upper collision ratio value is less than or equal to the preset second value, the size of the side vector to which the weight is applied may be characterized as being equal to the size of the basic avoidance vector.

[0033] An operation method for avoiding collision between bodies of a character, executed by at least one processor of a device according to one embodiment of the present invention, may include the steps of: generating a bone of a character corresponding to a user based on an image of the user; setting a start point and a target point for checking a collision risk between the bodies of the character on the bone of the character; performing a collision test between the start point and the target point to derive a collision surface between the start point and the target point; and derive an avoidance vector based on at least one of a normal vector of the collision surface of the character, a tendency vector from the spine of the character toward the lower arm, a frontal vector of the central axis of the character, and a side vector of the character.

[0034] The above-described aspects of the present disclosure are only some of the preferred embodiments of the present disclosure, and various embodiments reflecting the technical features of the present disclosure can be derived and understood by a person having ordinary skill in the art based on the detailed description of the present disclosure to be described below.

[0035] According to an embodiment of the present invention, by detecting the risk of collision in real time and processing motion capture data to prevent the arm from colliding with another body, natural animation can be quickly generated despite the user's dynamic movements.

[0036] According to an embodiment of the present invention, by using a program to detect a risk of collision and processing motion capture data so that the arm does not collide with another body, restrictions on the user's acting and body proportions, etc. can be eliminated.

[0037] The effects that can be obtained through the present invention are not limited to the effects mentioned, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present invention pertains from the description below.

[0038] Figure 1 is a schematic diagram showing the entire system according to the present disclosure.

[0039] FIG. 2 is a block diagram illustrating an embodiment of a configuration of a device constituting a system according to the present disclosure.

[0040] FIG. 3 is a flowchart illustrating one embodiment of a body-to-body interference avoidance operation of an animation character according to the present disclosure.

[0041] FIG. 4 is a drawing illustrating one embodiment of a character body generated as a result of an interference avoidance motion between bodies of an animation character according to the present disclosure.

[0042] FIG. 5 is a drawing illustrating an example of an inspection start line and a target line set on the body of a character generated as a result of an interference avoidance motion between bodies of an animation character according to the present disclosure.

[0043] FIG. 6 is a drawing illustrating an example of a start point and a target point set on the body of a character generated as a result of an inter-body interference avoidance motion of an animation character according to the present disclosure.

[0044] FIG. 7 is a drawing illustrating an example of a distance setting result for a collision test of an inter-body interference avoidance motion of an animation character according to the present disclosure.

[0045] FIG. 8 is a drawing illustrating an example of a start point and a target point set on the body of a character generated as a result of an inter-body interference avoidance motion of an animation character according to the present disclosure.

[0046] FIG. 9 is a drawing illustrating an example of a collision test result of an inter-body interference avoidance motion of an animation character according to the present disclosure.

[0047] FIG. 10 is a flowchart illustrating one embodiment of an operation for calculating an avoidance offset according to the present disclosure.

[0048] FIG. 11 is a diagram illustrating an example of a result of calculating a collision distance ratio according to the present disclosure.

[0049] FIG. 12 is a flowchart illustrating one embodiment of an operation for calculating a basic avoidance vector according to the present disclosure.

[0050] FIG. 13 is a diagram illustrating an embodiment of a first avoidance vector according to the present disclosure.

[0051] FIG. 14 is a diagram illustrating an example of a result of calculating a first avoidance vector based on a collision surface of a character according to the present disclosure.

[0052] FIG. 15 is a diagram illustrating an example of a trend vector based on a user's movement direction according to the present disclosure.

[0053] FIG. 16 is a diagram illustrating an example of a result of calculating a second avoidance vector based on a first avoidance vector and a tendency vector according to the present disclosure.

[0054] FIG. 17 is a diagram illustrating an example of a result of calculating a second avoidance vector according to the present disclosure.

[0055] FIG. 18 is a drawing illustrating an example of a result of calculating a third avoidance vector based on a central axis front vector according to the present disclosure.

[0056] FIG. 19 is a flowchart illustrating one embodiment of an operation for calculating a fourth evasion vector according to the present disclosure.

[0057] FIG. 20 is a diagram illustrating an example of a result of calculating a second avoidance vector or a third avoidance vector according to the present disclosure.

[0058] FIG. 21 is a diagram illustrating an example of a fourth avoidance vector calculated based on a side vector according to the present disclosure.

[0059] The present invention is susceptible to various modifications and embodiments. Specific embodiments are illustrated and described in detail in the drawings. However, this is not intended to limit the present invention to specific embodiments, but rather to encompass all modifications, equivalents, and alternatives falling within the spirit and technical scope of the present invention.

[0060] While terms such as "first" and "second" may be used to describe various components, these components should not be limited by these terms. These terms are used solely to distinguish one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a "second component," and similarly, a second component may also be referred to as a "first component." The term "and / or" includes a combination of multiple related items described herein or any of multiple related items described herein.

[0061] When a component is referred to as being "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components intervening. Conversely, when a component is referred to as being "directly connected" or "connected" to another component, it should be understood that there are no other components intervening.

[0062] The terminology used in this application is only used to describe specific embodiments and is not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly indicates otherwise. In this application, it should be understood that the terms "comprise" or "have" indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but do not preclude the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0063] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and will not be interpreted in an idealized or overly formal sense unless explicitly defined herein.

[0064] Hereinafter, with reference to the attached drawings, preferred embodiments of the present invention will be described in more detail. In order to facilitate an overall understanding in describing the present invention, identical reference numerals will be used for identical components in the drawings, and redundant descriptions of identical components will be omitted.

[0065]

[0066] Figure 1 is a schematic diagram showing the entire system according to the present disclosure.

[0067] Referring to FIG. 1, the entire system may include a user device (102), a server (104), an image capture device (106), an object (108), a display device (110), and a communication network (112). The user device (102) may be connected to the server (104), the image capture device (106), and the display device (110) via the communication network (112).

[0068] The user device (102) may include logic, circuitry, interfaces, and / or code for generating animation. The user device (102) may generate animation of a character based on the movement of an object (108) tracked by the image capture device (106) and output the generated animation through the display device (110). The user device (102) may include, but is not limited to, a gaming device, a video conferencing system, an augmented reality-based device, a computing device, a server, a computer workstation, a mainframe machine, and / or other user devices.

[0069] The server (104) may include circuitry, interfaces, and / or code capable of storing one or more animation models. In one embodiment, the server (104) may include, but is not limited to, an application server, a cloud server, a web server, a database server, a file server, a game server, a mainframe server, or a combination thereof.

[0070] The image capture device (106) may include logic, circuitry, interfaces, and / or code for capturing images and motion of the object (108). The image capture device (106) may capture one or more images and / or poses of the object (108) in real time or within a delayed time. Additionally, the image capture device (106) may determine bone structure information of the object (108) based on the captured images. The bone structure information may include skeletal information of the object (108). The image capture device (106) may transmit the determined bone structure information to the user device (102) via the communication network (112). The image capture device (106) may include, but is not limited to, a depth sensor, an infrared (IR) sensor, and / or a color sensor (such as a red-green-blue (RGB) sensor), a 3D mesh structure generator, an image sensor, and / or a motion detection sensor, which capture one or more poses of the object (108) from a single viewpoint.

[0071] The object (108) may refer to a target object captured by the image capture device (106). The object (108) may be a human, an animal, or a robot capable of mimicking the natural body movements of an actual human or animal. The human body includes a skeleton that provides a framework that supports the body and maintains its shape. The human skeleton includes a hierarchical set of interconnected bones, and joints (also called joints) between the bones can allow a certain degree of movement of body parts such as the head, hands, and feet.

[0072] The display device (110) may comprise suitable logic, circuitry, interfaces, and / or code that may be configured to render an animated model of a character received from the user device (102). In one embodiment, the display device (110) may obtain commands and / or input signals from a user. In such a scenario, the display device (110) may be a touch screen capable of inputting user commands. In other embodiments, the display device (110) may receive input via a virtual keypad, a stylus, gesture-based input, and / or touch-based input. The display device (110) may be implemented via several known technologies, including, but not limited to, liquid crystal display (LCD) display, light emitting diode (LED) display, plasma display, and / or organic LED (OLED) display technologies. According to another embodiment, the display device (110) may be one of a display screen of a smart-glasses device, a see-through display, a projection-based display, an electro-chromic display, and / or a transparent display.

[0073] The communication network (112) may include a communication medium for connecting the user device (102) to the server (104) and / or the display device (110). Examples of the communication network (112) may include, but are not limited to, the Internet, a cloud network, a Wi-Fi network, a local area network (LAN), and / or a metropolitan area network (MAN). Various devices within the system may connect to the communication network (112) according to various wired and wireless communication protocols. According to one embodiment, the wired and wireless communication protocols may include, but are not limited to, at least one of Transmission Control Protocol and Internet Protocol (TCP / IP), User Datagram Protocol (UDP), Hypertext Transfer Protocol (HTTP), File Transfer Protocol (FTP), ZigBee, EDGE, IEEE 802.11, Li-Fi (light fidelity), 802.16, IEEE 802.11s, IEEE 802.11g, multi-hop communication, wireless access point (AP), device-to-device communication, cellular communication protocol, and / or Bluetooth (BT) communication protocol, or combinations thereof.

[0074] The system of FIG. 1 may include at least one device, and the configuration of the devices may be as described below.

[0075]

[0076] FIG. 2 is a block diagram illustrating an embodiment of a configuration of a device constituting a system according to the present disclosure.

[0077] A device (200) included in the system may include at least one processor (210) and a memory (220) that stores instructions that instruct the at least one processor (210) to perform at least one step.

[0078] Here, at least one processor (210) may mean a central processing unit (CPU), a graphics processing unit (GPU), or a dedicated processor on which methods according to embodiments of the present invention are performed. Each of the memory (220) and the storage device (260) may be configured with at least one of a volatile storage medium and a non-volatile storage medium. For example, the memory (220) may be configured with at least one of a read-only memory (ROM) and a random access memory (RAM).

[0079] In addition, the device (200) included in the system may include a transceiver (230) that performs communication via a wireless network. In addition, the device (200) included in the system may further include an input interface device (240), an output interface device (250), a storage device (260), etc. Each component included in the device (200) included in the system may be connected by a bus (270) and communicate with each other.

[0080] Additionally, the device (200) included in the system may further include software components for implementing / driving specific functions. For example, the software components may include a framework, a kernel or device driver, middleware, an application programming interface (API), an application program (or application), etc.

[0081] Using the device of FIG. 2, a system for performing an interference avoidance motion between bodies of an animation character can be implemented as described below.

[0082]

[0083] FIG. 3 is a flowchart illustrating one embodiment of a body-to-body interference avoidance operation of an animation character according to the present disclosure.

[0084] In step S301, the device can generate a character bone corresponding to the user based on the user's image. The character bone may be an object corresponding to the character's skeleton. The device can acquire the user's image, determine the user's preset major skeleton or moving parts, and generate an object corresponding to the determined major skeleton or moving parts. Here, the major skeleton may include the head, spine, upper limbs, and lower limbs of the human body. The major moving parts may include joints such as the neck, shoulders, elbows, wrists, pelvis, and knees of the human body. The device can then generate a mesh on the surface of the character based on the user's image.

[0085] In step S303, the device can set start and target points on the character's body for collision risk detection. Collisions due to differences in body proportions between the user and the character can primarily occur on the lower limbs of the upper limbs. The device can set the lower limb of the character's body as the start line segment. Furthermore, the device can set the head, torso, and lower limbs, which correspond to the main skeleton of the character's body, as the target line segments.

[0086] The device can set a starting point and a target point for collision risk detection on the character's body based on the positional relationship between the starting line segment and the target line segment set on the body. Specifically, the device can set the point on the starting line segment closest to the target line segment as the starting point. Furthermore, the device can set the point on the target line segment closest to the starting line segment as the target point.

[0087] In step S305, the device can perform a collision test between the starting point and the target point to derive a collision surface between the starting point and the target point. The device can set the direction from the starting point to the target point as the inspection direction. Furthermore, the device can check whether a character mesh exists within a preset section in the inspection direction from the starting point. Here, a mesh existing within a preset section in the inspection direction from the starting point can be referred to as a collision surface.

[0088] In step S307, the device can calculate an evasion offset based on the starting point, the target point, and the collision surface. The evasion offset can be a vector for moving the position of a character's bone from an existing bone corresponding to the motion capture source image. The device can calculate a vector that adds to or subtracts from the evasion offset for each frame. In addition, the device can calculate the evasion offset by accumulating the calculated vector to the size of the evasion offset of the previous frame.

[0089] In step S309, the device may apply an evasion offset to the character's bones. In one embodiment, the device may apply the evasion offset to the bones corresponding to the character's upper limbs. The position of the character's upper limb may be determined by adding the evasion offset to the existing position of the character's upper limb corresponding to the original motion capture image.

[0090] At step S311, the device can generate an image of the character based on the character's bones. That is, the device can generate an image of the character based on the character's bones with the evasion offset applied.

[0091] Specific embodiments and operations for creating a character's bone and creating animation based on the created bone may be as described below.

[0092]

[0093] FIG. 4 is a drawing illustrating one embodiment of a character body generated as a result of an interference avoidance motion between bodies of an animation character according to the present disclosure.

[0094] Referring to FIG. 4, the body and mesh of a character (400) generated based on a user's image can be generated as shown.

[0095] In order to check the risk of collision between the bodies of the character (400), the device can determine the position of the character's hand when the motion capture data is applied as is. However, a device using a conventional animation generation method can only obtain the transform value of the generated character's animation. That is, when a collision avoidance solution is directly applied to the bones of the generated character, the device obtains only the transform value after the collision avoidance solution is applied. Therefore, the device cannot obtain the position of the user's hand based on the original motion capture data.

[0096] Therefore, in order to obtain the position information of the user's hand based on the original motion capture data, the device can use a separate bone that directly reflects the motion capture data without being skinned to the character mesh. According to one embodiment, the device can use the virtual bone function of the game engine to generate a separate bone (420) different from the actual bone (410) of the character (400). Specifically, the device can generate a separate bone (420) corresponding to the upper limb of the character (400) based on an image from the collarbone to the hand among the motion capture data. The separate bone (420) generated based on the motion capture data may be data that maintains the original data of the motion capture for calculation. In addition, when the device detects a risk of interference between the body of the character (400), the device can use the separate bone (420) generated based on the streaming motion capture data for calculation. In addition, the device can apply an avoidance solution to the actual bone (410) using the separate bone (420) and apply the result value of the avoidance solution application to the character (400).

[0097]

[0098] FIG. 5 is a drawing illustrating an example of an inspection start line and a target line set on the body of a character generated as a result of an interference avoidance motion between bodies of an animation character according to the present disclosure.

[0099] Referring to FIG. 5, the most common location where collisions occur due to differences in body proportions may be the lower limb (510) of the upper limb, from the elbow to the hand. Other body parts likely to collide with the lower limb (510) may include the head (521), torso (522), and lower limb (523). Accordingly, the device may set the bone corresponding to the character's lower limb (510) as the inspection start line. Furthermore, the bones corresponding to the head (5210), torso (522), and lower limb (523), which are body parts likely to collide with the lower limb (510), may be set as inspection target points and inspection target line segments.

[0100] A specific embodiment of setting a start point and a target point for collision risk inspection on the inspection start line and inspection target line of the character shown in Fig. 5 may be as described below.

[0101]

[0102] FIG. 6 is a drawing illustrating an example of a start point and a target point set on the body of a character generated as a result of an inter-body interference avoidance motion of an animation character according to the present disclosure.

[0103] The device can perform a collision risk check from the starting line of the character (600) toward the target line. Here, the device can set the closest point between the starting line and the target line as the starting point and the target point.

[0104] According to one embodiment, the device may set the point on the lower arm of the character (600) that is closest to the head of the character as a first starting point (611), and the head of the character as a first target point (621). In addition, the device may set the point on the lower arm of the character that is closest to the torso as a second starting point (612), and the point on the torso of the character that is closest to the second starting point (612) as a second target point (622). In addition, the device may set the point on the lower arm of the character that is closest to the lower body as a third starting point (613), and the point on the lower body of the character that is closest to the third starting point (613) as a third target point (623).

[0105] That is, the device can set the closest point between the starting line segment and the target line segment of the character (600) as the starting point and target point for collision risk detection. In addition, the device can set the direction from the starting point toward the target point as the detection direction for collision risk detection.

[0106] However, while the starting point (611, 612, 613) of the collision detection is located on the main body of the character (600), the actual collision risk occurs on the surface of the character (600). Therefore, the accuracy of the collision risk detection may be reduced. Therefore, the device may additionally perform an operation to correct the position of the starting point.

[0107]

[0108] FIG. 7 is a drawing illustrating an example of a distance setting result for a collision test of an inter-body interference avoidance motion of an animation character according to the present disclosure.

[0109] Referring to Figure 7, the bone corresponding to the character's lower arm may be set as the inspection start line segment, and the bones corresponding to the head, torso, and lower limbs may be set as inspection target points and inspection target line segments. Here, among the points on the character's lower arm, the point closest to the lower limb may be set as the starting point. And among the points on the character's lower limb, the point closest to the starting point may be set as the target point.

[0110] However, the starting point of collision detection can be located on the character's body. In contrast, actual collisions between characters' bodies can occur on the character's surface. If collision detection is performed based on the starting point of the character's body, the thickness of the skin from the bone corresponding to the forearm to the forearm area may be included in the test results. Therefore, the device cannot accurately measure the distance between the character's skin and guarantee the accuracy of collision detection.

[0111] Accordingly, the device can measure the thickness from the character's forearm bone to the character's forearm skin. The device can then apply an offset to the starting point based on the measurement results.

[0112] Since the thickness of the forearm may vary for each character, the device may measure the thickness from the character's forearm bone to the character's forearm skin in advance. In one embodiment, a camera may be created that is spaced a preset distance from the center of the forearm. Then, the device may calculate a distance value from the camera to a pixel of the forearm based on a rendered image of the camera. The device calculates the distance between the camera and the forearm based on the calculated value, and by subtracting the calculated distance from the preset distance, the thickness from the forearm to the skin may be calculated. Then, the device may adjust the position of the starting point by adding the calculated thickness value from the forearm to the skin to the starting point.

[0113] If an offset is applied to the starting point, the starting point can be adjusted as follows:

[0114]

[0115] FIG. 8 is a drawing illustrating an example of a start point and a target point set on the body of a character generated as a result of an interference avoidance motion between bodies of an animation character according to the present disclosure.

[0116] Referring to FIG. 8, a bone corresponding to the lower arm of the character may be set as an inspection start line segment, and bones corresponding to the head, torso, and lower limbs may be set as inspection target points and inspection target line segments. Here, initial starting points may be set on the starting line segment. According to one embodiment, among the points of the lower arm of the character, the point closest to the head of the character may be set as a first starting point (811), among the points of the lower arm of the character, the point closest to the torso may be set as a second starting point (812-1), and among the points of the lower arm of the character, the point closest to the lower limb may be set as a third starting point (813-1).

[0117] In addition, the device can set an adjusted second starting point (812-2) and an adjusted third starting point (813-2) by applying an offset to the second starting point (812-1) and the third starting point (813-1) among the initial starting points. Accordingly, the second starting point (812-2) and the adjusted third starting point (813-2) can be located on the outer surface of the character's skin.

[0118] And the collision detection results based on the adjusted starting point (812-2, 813-2) and target point (822, 823) can be derived as follows.

[0119]

[0120] FIG. 9 is a drawing illustrating an example of a collision test result of an inter-body interference avoidance motion of an animation character according to the present disclosure.

[0121] Referring to FIG. 9, a second starting point and a third starting point may be set on the skin of the lower body of the character. In addition, a second target point and a third target point may be set on the skin corresponding to the torso and lower body.

[0122] In addition, the device can perform collision tests in the direction from the second starting point toward the second target point and in the direction from the third starting point toward the third target point. According to one embodiment, the device can perform a raycast inspection from the starting point toward the target direction at a preset distance (910, 920). A raycast inspection refers to an inspection method that projects an invisible virtual light toward a specific location and determines the surface on which the light hits.

[0123] If a collision test result indicates that a mesh of a collided character exists, the device may obtain data about the collided mesh. In one embodiment, the data about the collided mesh may include information such as a normal vector and a collision distance ratio.

[0124] The normal vector of a collided mesh can be a vector that is oriented perpendicular to the expected collision surface. That is, in cases where there is a high possibility of collision between character bodies, the normal vector can be a vector used to adjust the position of the character's body (e.g., the character's lower arm). Here, the normal vector can be a normalized unit vector with a magnitude and direction of 1.

[0125] The collision distance ratio may be a ratio indicating the imminence of a collision between characters' bodies. In one embodiment, the collision distance ratio may be calculated as a value obtained by dividing the distance (911, 921) from the starting point to the collision point by a preset distance (910, 920) used during collision detection. For example, if a collision occurs at a location close to the target point, the value of the collision distance ratio may be close to 1. On the other hand, if a collision occurs at a location close to the starting point, the value of the collision distance ratio may be close to 0.

[0126] And the operation of calculating the avoidance offset based on the collision detection result can be performed as follows.

[0127]

[0128] FIG. 10 is a flowchart illustrating one embodiment of an operation for calculating an avoidance offset according to the present disclosure.

[0129] In step S1001, the device may calculate an evasion vector based on at least one of the movement directions of the character's surface and upper limbs. Here, the evasion vector may be a directional vector, and the magnitude of the evasion vector may be 1. The evasion vector may indicate a direction in which the character's bones should face to avoid collision between the character's bodies in the current frame. The evasion vector may include a basic evasion vector and an additional evasion vector.

[0130] Specifically, the device can calculate a basic evasion vector based on at least one of a collision surface of the character and a movement direction of the lower arm of the upper limb. Furthermore, the device can calculate an additional evasion vector based on at least one of a frontal vector of the character's central axis and a lateral vector from the character's spine to the side. The basic evasion vector is a vector that controls the character's moving direction by considering the primary collision avoidance and the actual motion of the user, and the additional evasion vector is a vector that restricts the character's moving direction to prevent unnatural evasion and collision of the upper arm of the upper limb.

[0131] In step S1003, the device can calculate a collision distance ratio based on the positions of the starting point, the target point, and the collision plane. The device can perform a collision check for a preset inspection distance from the starting point. If a collision plane is derived as a result of the collision check, the device can calculate a collision distance ratio, which is a ratio of the distance from the starting point to the collision plane to the preset inspection distance from the starting point. If the value of the collision distance ratio is close to 1, the collision plane is located far from the starting point, and the possibility of collision may be low. On the other hand, if the value of the collision distance ratio is close to 0, the collision plane is located close to the starting point, and the possibility of collision may be high.

[0132] In step S1005, the device may calculate a weight based on the value of the collision distance ratio. In one embodiment, the weight may be inversely proportional to the collision distance ratio. For example, as the collision distance ratio approaches 0, the value of the weight may be calculated closer to 1. On the other hand, as the collision distance ratio approaches 0.5, the value of the weight may be calculated closer to 0. Here, if the collision distance ratio is within a preset range, the value of the weight may be maintained at 0.

[0133] As a result, the device can calculate an evasion offset based on the evasion vector and weights. The evasion offset can indicate a vector value for adjusting the position of the character's bones from the motion capture source data. Furthermore, the device can calculate an increment vector to be added to or subtracted from the evasion offset for each frame.

[0134] The device can calculate the increase / decrease value of the evasion offset by multiplying the character's bone movement distance between frames by a weight. Since the weight value is calculated dynamically between 0 and 1 depending on the collision distance ratio, the increase / decrease value of the offset can also be calculated dynamically depending on the degree of collision risk. Therefore, the evasion offset increase / decrease vector can be calculated by multiplying the evasion vector by the increase / decrease value of the offset.

[0135] The device can then calculate the evasion offset of the current frame by accumulating the increment vector of the current frame to the evasion offset of the previous frame. That is, the position of the character's bones can be a position derived by adding the evasion offset to the body position of the motion capture source data.

[0136]

[0137] FIG. 11 is a diagram illustrating an example of a result of calculating a collision distance ratio according to the present disclosure.

[0138] Referring to FIG. 11, a second starting point and a third starting point may be set on the skin of the lower body of the character. In addition, a second target point and a third target point may be set on the body corresponding to the torso and lower body of the character. In addition, the device may perform a collision test in the direction from the second starting point to the second target point and in the direction from the third starting point to the third target point. As a result of the collision test, the mesh of the collided character may exist within a preset distance (1110, 1120).

[0139] The collision distance ratio may be a ratio indicating the degree of imminence of a collision between characters' bodies. In one embodiment, the collision distance ratio may be calculated as the distance from the starting point to the collision point divided by a preset distance used during collision detection.

[0140] For example, if a collision occurs at a location close to the target point (1111), the value of the collision distance ratio may approach 1. Therefore, the device may determine that the collision risk is low. On the other hand, if a collision occurs at a location close to the starting point (1112), the value of the collision distance ratio may approach 0. Therefore, the device may determine that the collision risk is high.

[0141]

[0142] FIG. 12 is a flowchart illustrating one embodiment of an operation for calculating a basic avoidance vector according to the present disclosure.

[0143] In step S2801, the device can calculate the first avoidance vector, which is a normal vector of the collision plane between the starting point and the target point. At this time, the first avoidance vector can be calculated based on the starting point, the target point, and the collision plane with the smallest collision distance ratio. Since the collision distance ratio value approaches 0 and thus the collision risk is higher, the device can calculate the first avoidance vector based on the starting point, the target point, and the collision plane with the highest collision risk as a priority.

[0144] In step S2803, the device can generate a trend vector from the character's spine to the lower limb of the upper limb. The trend vector may be a vector for maintaining a trend in the movement direction of the character's lower limb.

[0145] In step S2805, the device may add a trend vector to the first evasion vector to produce a second evasion vector. Specifically, the device may add a trend vector to the first evasion vector and then normalize it to produce a second evasion vector, which is a unit vector of size 1.

[0146] Since the first avoidance vector is the normal vector of the collision surface, if the device performs collision avoidance actions considering only the first avoidance vector, there may be a large difference between the actual user's movement and the movement of the character with collision avoidance applied. In other words, while the actual user's upper limb moves forward, the upper limb of the character with collision avoidance applied considering only the first avoidance vector moves backward in the normal direction from the back of the torso, which may result in a large difference in the position of the actual user's upper limb.

[0147] Accordingly, the device can calculate a second evasion vector by adding a tendency vector to the first evasion vector to maintain the tendency of the character's movement direction. In other words, as the gap between the direction of the first evasion vector and the actual movement direction of the user increases, the direction adjustment of the first evasion vector by the tendency vector can increase. As a result, by calculating the second evasion vector by adding the tendency vector to the first evasion vector, the gap between the actual movement of the user and the movement of the character can be reduced.

[0148] Specific embodiments and operations for generating avoidance vectors to avoid collisions between characters' bodies may be as described below.

[0149]

[0150] FIG. 13 is a diagram illustrating an embodiment of a first avoidance vector according to the present disclosure.

[0151] Referring to FIG. 13, the first avoidance vector (2910) may be a normal vector of the collision surface. That is, the first avoidance vector (2910) may point in an outward direction perpendicular to the surface of the character (2900) at risk of collision. That is, when the avoidance vector is applied in an outward direction perpendicular to the collision surface of the character (2900), body collision can be avoided most simply and reliably. Therefore, the first avoidance vector (2910) may be the avoidance vector that is most primarily considered.

[0152] In addition, the first avoidance vector (2910) can be calculated based on the starting point, the target point, and the collision surface with the smallest collision distance ratio. The device can calculate the collision distance ratio based on the second starting point and the third starting point set on the skin of the lower limb of the character (2900), and the second target point and the third target point set on the bones corresponding to the torso and lower limbs of the character (2900). At this time, when the collision distance ratio for the third starting point and the third target point is the smallest, the device can calculate the first avoidance vector (2910) based on the third starting point, the third target point, and the collision surface between the third starting point and the third target point.

[0153] However, when only the first avoidance vector (2910) is considered, even if collision between the bodies of the characters (2900) can be avoided, the gap between the actual movement of the user and the movement of the character (2900) may increase.

[0154]

[0155] FIG. 14 is a diagram illustrating an example of a result of calculating a first avoidance vector based on a collision surface of a character according to the present disclosure.

[0156] Referring to FIG. 14, the first evasion vector (3010) may be directed outward perpendicular to the collision plane between the third starting point (3001) and the third target point (3002). At this time, the lower arm of the actual user may have a tendency to move forward (3020). That is, since there is a large difference between the direction of the first evasion vector (3010) and the movement direction of the actual user (3020), when evasion is performed by applying only the first evasion vector (3010), the lower arm of the character (3000) may not advance and may be restricted in movement due to the first evasion vector (3010) brushing against the lower arm of the character (3000).

[0157] In order for a character (3000) to move naturally while avoiding collisions between bodies and not significantly different from the actual user's movements, it must move along the user's movement tendencies (3030). Moving along the user's movement tendencies means that the character's movement trajectory and direction are determined by considering the trajectory and direction of movement of the user's lower arm.

[0158] To this end, the device can produce a second avoidance vector by adding a tendency vector having a tendency of the user's movement direction to the first avoidance vector (3010).

[0159]

[0160] FIG. 15 is a diagram illustrating an example of a trend vector based on a user's movement direction according to the present disclosure.

[0161] Referring to FIG. 15, a tendency vector (3110) added to the first evasion vector may have a direction from the spine of the character (3100) toward the lower arm of the character (3100). That is, the device may calculate the tendency vector (3110) so as to reflect the tendency of the movement direction of the user's lower arm in the first evasion vector.

[0162] Therefore, the device can avoid collisions between bodies more naturally through a second avoidance vector that adds a tendency vector (3110) to the first avoidance vector.

[0163]

[0164] FIG. 16 is a diagram illustrating an example of a result of calculating a second avoidance vector based on a first avoidance vector and a tendency vector according to the present disclosure.

[0165] Referring to FIG. 16, the second avoidance vector (3230) can be calculated by adding a tendency vector (3220) to the first avoidance vector (3210). Specifically, the device can add the tendency vector (3220) to the first avoidance vector (3210) and then normalize it to calculate the second avoidance vector (3230), which is a unit vector of size 1.

[0166] When a tendency vector (3220) is added to the first evasion vector (3210), the greater the gap between the first evasion vector (3210) and the direction in which the user's lower arm moves, the greater the direction adjustment of the first evasion vector (3210) by the tendency vector (3220). That is, since the direction of the first evasion vector (3210) is adjusted by the tendency vector (3220) to produce the second evasion vector (3230), the lower arm of the character (3200) can perform natural evasion similar to the movement of the user's lower arm.

[0167] In this way, basic collision avoidance between the body of the character (3200) may be possible with only the basic avoidance vector including the first avoidance vector (3210) and the second avoidance vector (3230). However, if the lower arm of the character (3200) moves beyond the center to the opposite side or if there is a possibility of collision between the upper arm of the character (3200), the device may additionally calculate an additional avoidance vector based on the basic avoidance vector.

[0168]

[0169] FIG. 17 is a diagram illustrating an example of a result of calculating a second avoidance vector according to the present disclosure.

[0170] Referring to FIG. 17, when the lower arm of the character (3300) is positioned opposite the center of the character (3300), there is a high probability that both the first avoidance vector and the tendency vector will point toward the opposite side of the center of the character (3300), and thus the calculated second avoidance vector (3320) may have a direction that points toward the opposite side of the center of the character (3300). Therefore, when avoiding a collision using only the second avoidance vector (3320), the lower arm of the character (3300) may be pushed further away from the center of the character (3300) in the opposite direction, and thus the collision may be avoided unnaturally. In addition, in this case, as the lower arm of the character (3300) is pushed further away from the center of the character (3300) in the opposite direction, the upper arm of the character (3300) may also collide with the torso of the character (3300).

[0171] Accordingly, if the starting point (3310) of the main body of the lower arm of the character (3300) crosses the center of the character (3300) and the primary evasion vector (i.e., the secondary evasion vector (3320)) crosses the center of the character (3300) and points in the opposite direction, the device may calculate a tertiary evasion vector based on the primary evasion vector (i.e., the secondary evasion vector (3320)) to avoid unnatural evasion or another collision by continuously pushing the lower arm of the character (3300) in the opposite direction.

[0172]

[0173] FIG. 18 is a drawing illustrating an example of a result of calculating a third avoidance vector based on a central axis front vector according to the present disclosure.

[0174] Referring to FIG. 18, the device can calculate a third evasion vector (3440) based on the second evasion vector (3420) and the front vector (3430) of the central axis. That is, when the second evasion vector (3420) is directed in the opposite direction beyond the center of the character (3400), the device can limit the second evasion vector (3420) to be parallel to the front vector (3430) of the central axis, and normalize it to calculate the third evasion vector (3440), which is a unit vector of size 1.

[0175] That is, when the lower arm of the character (3400) passes the center of the character (3400) and the second evasion vector (3420) points in the opposite direction, the calculated third evasion vector (3440) can cause the lower arm of the character (3400) to point in the direction of the central axis front vector (3430).

[0176] At this time, the collision of the lower body of the character (3400) is avoided through the generated third avoidance vector (3440), but the upper body of the character (3400) is still in collision with the torso of the character (3400), or a new collision may occur due to this.

[0177]

[0178] FIG. 19 is a flowchart illustrating one embodiment of an operation for calculating a fourth evasion vector according to the present disclosure.

[0179] In step S3501, the device may set a first reference point on the character's upper arm and a second reference point on the character's spine. At this time, the first reference point may be the center point of the character's upper arm, and the second reference point may be the point on the spine that is closest to the first reference point.

[0180] In step S3503, the device may calculate an upper arm impact ratio based on the distance values ​​between the first reference point and the second reference point and the distance value from the spine to the side. At this time, the upper arm impact ratio value may be a value obtained by dividing the distance value from the spine to the side by the distance value between the first reference point and the second reference point.

[0181] According to one embodiment, the device may calculate the distance from the spine to the side by multiplying the distance between the shoulder blades in half by a preset ratio. For example, if the distance from the spine to the side in the character's skeleton is less than the distance between the shoulder blades in half, the device may calculate the distance from the spine to the side by multiplying the distance between the shoulder blades in half by 0.9. However, the present invention is not limited thereto, and as another example, if the distance from the spine to the side is greater than the distance between the shoulder blades in half, the device may calculate the distance from the spine to the side by multiplying the distance between the shoulder blades in half by a number greater than or equal to 1.

[0182] In another embodiment, the device may generate a camera spaced a preset distance from the spine. Then, the device may calculate a distance value from the camera to a pixel of the side based on a rendered image of the camera. The device may calculate a distance between the camera and the side based on the calculated distance value, and may calculate a distance value from the spine to the side by subtracting the calculated distance from the preset distance. In another embodiment, the distance value from the spine to the side may be calculated by measuring a ratio between two distance values, or the distance value from the spine to the side may be directly measured.

[0183] In step S3505, the device may calculate a weight based on the upper arm collision ratio value. If the upper arm collision ratio value is greater than a preset first value, the device may determine that there is no possibility of upper arm collision. In this case, the size of the side vector to which the weight is applied may be 0. Additionally, the size of the preset first value may be approximately 1.4. However, the present invention is not limited thereto.

[0184] If the upper arm collision ratio value is less than or equal to a preset second value, the device can determine that the upper arm collision probability is 100%. In this case, the size of the weighted side vector may be equal to the size of the basic avoidance vector. Additionally, the size of the preset second value may be approximately 1. However, the present invention is not limited thereto.

[0185] In step S3507, the device can calculate a fourth evasion vector based on the basic evasion vector, the side vector, and the weight. That is, the device can calculate the fourth evasion vector by adding the weighted side vector to the basic evasion vector. At this time, the device can calculate the fourth evasion vector, which is a unit vector of size 1, by adding the weighted side vector to the basic evasion vector and then normalizing it. The device can finally apply the fourth evasion vector to avoid collision between characters ( ).

[0186] Specific embodiments and operations for generating a fourth evasion vector to avoid collisions between the character's upper arms may be as described below.

[0187]

[0188] FIG. 20 is a diagram illustrating an example of a result of calculating a second avoidance vector or a third avoidance vector according to the present disclosure.

[0189] Referring to FIG. 20, when avoiding a collision with the lower arm of the character (3600) through the second evasion vector or the third evasion vector, the upper arm of the character (3600) may collide with the torso of the character (3600). That is, since the second evasion vector and the third evasion vector are evasion vectors for avoiding a collision with the lower arm of the character (3600), it may be difficult to avoid a collision with the upper arm of the character (3600) using only the second evasion vector and the third evasion vector. Specifically, the upper arm of the character (3600) may collide with the side of the torso of the character (3600).

[0190] Therefore, to avoid collisions with the upper arm of the character (3600), the device can produce additional avoidance vectors.

[0191]

[0192] FIG. 21 is a diagram illustrating an example of a fourth avoidance vector calculated based on a side vector according to the present disclosure.

[0193] Referring to FIG. 21, the device may calculate a fourth evasion vector (3740), which is an additional evasion vector, to avoid collision with the upper arm of the character (3700). That is, the device may calculate the fourth evasion vector (3740) based on the basic evasion vector (i.e., the second evasion vector) or the third evasion vector and the side vector (3710). For example, if the second evasion vector does not cross the center of the character (3700), the device may not calculate the third evasion vector. Accordingly, in this case, the device may calculate the fourth evasion vector (3750) based on the second evasion vector and the side vector (3710). For another example, if the second evasion vector crosses the center of the character (3700), the device can calculate a third evasion vector and calculate a fourth evasion vector (3740) based on the third evasion vector and the side vector (3710).

[0194] The device can add a side vector (3710) to the base avoidance vector or the third avoidance vector and normalize it to produce a fourth avoidance vector (3740), which is a unit vector of size 1.

[0195] At this time, the device can set a first reference point (3721) on the upper arm of the character (3700) and a second reference point (3722) on the spine segment. In addition, a collision test can be performed between the first reference point (3721) and the second reference point (3722) to calculate a collision surface between the first reference point (3721) and the second reference point (3722). In addition, the device can set the direction from the first reference point (3721) to the second reference point (3722) as the inspection direction. The device can perform a collision test in the direction from the first reference point (3721) to the second reference point (3722).

[0196] According to one embodiment, a collision test may be performed using a ratio between a value obtained by dividing the distance between the shoulder blades of the character (3700) by half and a value obtained by dividing the distance from the spine of the character (3700) to the side, and a fourth avoidance vector (3740) may be calculated. That is, the device may avoid collision with the upper arm of the character (3700) using the fourth avoidance vector (3740).

[0197] Specifically, the device can calculate a distance value (3730) from the spine to the side. For example, if the distance (3730) from the spine to the side in the skeleton of the character (3700) is shorter than the distance between the shoulder blades divided by half, the device can calculate a distance value (3730) from the spine to the side by multiplying the value of the distance between the shoulder blades divided by half by 0.9. However, if the distance (3730) from the spine to the side in the skeleton of the character (3700) is longer than the distance between the shoulder blades divided by half, the device can separately calculate the distance (3730) from the spine to the side.

[0198] A collision test of the upper arm of the character (3700) can be performed based on a distance value (3720) between a first reference point (3721) and a second reference point (3722) and a distance value (3730) from the spine to the side. The device can determine that the collision probability is 100% when the distance value (3720) between the first reference point (3721) and the second reference point (3722) is less than or equal to the distance value (3730) from the spine to the side. In addition, the device can determine that the collision probability is 0% when the distance value (3720) between the first reference point (3721) and the second reference point (3722) is greater than a value obtained by multiplying a distance value (3730) from the spine to the side by a preset first value. That is, if the distance value (3720) between the first reference point (3721) and the second reference point (3722) is greater than the distance value (3730) from the spine to the side and is less than or equal to the value obtained by multiplying the distance value (3730) from the spine to the side by a preset first value, the collision probability may be greater than 0% and less than 100%. Accordingly, the size of the side vector (3710) to be added to the third avoidance vector may vary depending on the collision probability. That is, the size of the side vector (3710) may be calculated differently depending on the weight according to the collision probability.

[0199] That is, the upper arm collision test of the character (3700) can be performed based on the upper arm collision ratio value. The upper arm collision ratio value is a value obtained by dividing the distance value () between the first reference point () and the second reference point () by the distance value () from the spine to the side of the character (), and the device can determine that the collision probability is 100% when the upper arm collision ratio value is less than or equal to 1. In addition, the device can determine that the collision probability is 0% when the upper arm collision ratio value is greater than a preset first value.

[0200] In one embodiment, the weight may be proportional to the collision probability. For example, as the collision probability according to the collision test of the upper arm approaches 100%, the value of the weight may be calculated to be closer to 1. Accordingly, the side vector (3710) to which this weight is applied may be equal to the size of the second avoidance vector or the third avoidance vector. That is, the side vector (3710) may be a unit vector with a size of 1. In addition, as the collision probability according to the collision test of the upper arm approaches 0%, the value of the weight may be calculated to be closer to 0. Accordingly, the size of the side vector (3710) to which this weight is applied may be 0. That is, in this case, the device may not calculate the side vector (3710), but may calculate only the second avoidance vector or the third avoidance vector. If the probability of collision according to the collision test of the upper arm is greater than 0% and less than 100%, the magnitude of the side vector (3710) to which this weight is applied may be greater than 0 and less than 1.

[0201] As a result, the higher the probability of collision of the upper arm of the character (3700), the larger the size of the side vector (3710), so the direction of the second evasion vector or the third evasion vector can be adjusted more to the side.

[0202] However, the present invention is not limited thereto, and according to another embodiment, the device may perform a raycast inspection from a first reference point (3721) toward the inspection direction at a preset distance. If, as a result of the collision test, a mesh of a collided character (3700) exists, the device may obtain data regarding the collided mesh. For example, the data regarding the collided mesh may include information such as a normal vector and a collision distance ratio. Accordingly, the device may avoid collision of the upper arm of the character (3700) through the raycast inspection.

[0203]

[0204] As described above, in order to avoid collision between characters' bodies, the device can calculate the first to fourth avoidance vectors. According to one embodiment, the device calculates up to the basic avoidance vector for collision avoidance, and in some cases, may not calculate additional avoidance vectors. In this case, the device may only apply the basic avoidance vector. For example, if the character's lower arm does not go beyond the character's center, the device may avoid collision between bodies by applying the second avoidance vector without calculating the third avoidance vector. In addition, if there is no possibility of collision between the character's upper arm, the device may avoid collision between bodies by applying the second or third avoidance vector without calculating the fourth avoidance vector.

[0205] In another embodiment, the device may always calculate up to the fourth evasion vector for collision avoidance and apply the fourth evasion vector. However, if the character's lower arm does not cross the character's center, the device may calculate the third evasion vector as the same vector as the second evasion vector. Furthermore, if there is no possibility of collision with the character's upper arm, the device may calculate the fourth evasion vector as the same vector as the third evasion vector. Therefore, in this case, the device may always calculate up to the fourth evasion vector and apply the fourth evasion vector to avoid collision between the characters' bodies. In this case, the first evasion vector to the fourth evasion vector are the same as described above.

[0206] According to another embodiment, the device may calculate an avoidance vector based on at least one of a normal vector, a tendency vector, a frontal vector, and a side vector for body collision avoidance of the character. At this time, the normal vector is a normal vector of the collision surface of the character, the tendency vector has a direction from the spine of the character toward the lower arm, the frontal vector has a direction from the central axis of the character toward the front direction, and the side vector has a direction from the spine of the character toward the side. At this time, the normal vector, the tendency vector, the frontal vector (the frontal vector of the central axis), and the side vector are the same as described above. That is, the device is not limited to calculating the first to fourth avoidance vectors sequentially and applying the avoidance vector, but may calculate and apply various avoidance vectors based on at least one of the normal vector, the tendency vector, the frontal vector, and the side vector.

[0207]

[0208] The methods according to the present invention may be implemented in the form of program instructions that can be executed by various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., either singly or in combination. The program instructions recorded on the computer-readable medium may be those specifically designed and constructed for the present invention, or may be known and available to those skilled in the computer software art.

[0209] Examples of computer-readable media include hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include not only machine language codes generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate with at least one software module to perform the operations of the present invention, and vice versa.

[0210] Although the present invention has been described with reference to the above embodiments, it will be understood by those skilled in the art that various modifications and changes can be made to the present invention without departing from the spirit and scope of the present invention as set forth in the claims below.

Claims

1. In a method for avoiding body interference of a character executed by at least one processor of a device, A step of creating a bone of a character corresponding to the user based on the user's image; A step of setting a start point and a target point for checking the risk of collision between the bodies of the above characters on the body of the above character; A step of performing a collision test between the starting point and the target point to derive a collision surface between the starting point and the target point; and An operating method, comprising: a step of calculating an evasion vector based on at least one of the collision surface of the character and the movement direction of the upper limb; 2. In paragraph 1, The step of calculating the above evasion vector is: comprising a step of calculating a basic evasion vector, The step of calculating the above basic evasion vector is: A step of calculating a collision distance ratio based on the positions of the starting point, the target point, and the collision surface; and An operating method, characterized in that it comprises a step of calculating a first avoidance vector, which is a normal vector of the collision surface between the starting point and the target point.

3. In paragraph 2, An operating method, characterized in that the first avoidance vector is calculated based on the starting point, target point, and collision surface having the smallest collision distance ratio.

4. In paragraph 2, The step of calculating the above basic evasion vector is: A step of calculating a tendency vector from the spine of the character to the lower arm of the upper limb; and An operating method, characterized in that it further comprises a step of calculating a second avoidance vector by adding the tendency vector to the first avoidance vector.

5. In paragraph 4, The step of calculating the above evasion vector is: A method of operation, further comprising: a step of calculating an additional evasion vector based on at least one of a frontal vector of the central axis of the character and a lateral vector from the spine of the character to the side.

6. In paragraph 5, The step of calculating the above additional evasion vector is: An operating method characterized by comprising: a step of calculating a third evasion vector that restricts the basic evasion vector to be parallel to the front vector of the central axis when the basic evasion vector is directed in the opposite direction beyond the center of the character; 7. In paragraph 5, The step of calculating the above additional evasion vector is: An operating method, characterized by comprising a step of calculating a fourth evasion vector by adding the side vector to the basic evasion vector.

8. In paragraph 7, The step of calculating the fourth evasion vector is as follows: A step of setting a first reference point on the upper arm of the character and a second reference point on the spine line of the character; A step of calculating the upper arm impact ratio based on the distance value between the first reference point and the second reference point and the distance value from the spine to the side; and A step of calculating a weight based on the above upper arm collision ratio value is included, The above 4th evasion vector is, An operating method characterized in that it is calculated based on the above basic evasion vector, the side vector, and the weight.

9. In paragraph 8, The first reference point is the center point of the character's upper arm, and the second reference point is the point closest to the first reference point on the spine segment. A method of operation, characterized in that the upper arm collision ratio value is a value obtained by dividing the distance value from the spine to the side by the distance value between the first reference point and the second reference point.

10. In paragraph 8, The above 4th evasion vector is, An operating method characterized in that it is calculated by adding the side vector to which the weight is applied to the basic evasion vector.

11. In paragraph 10, If the above upper collision ratio value is greater than the preset first value, An operating method, characterized in that the size of the side vector to which the weight is applied is 0.

12. In paragraph 10, If the above upper impact ratio value is less than or equal to the preset second value, A method of operation, characterized in that the size of the side vector to which the weight is applied is the same as the size of the basic avoidance vector.

13. In a device of a system for executing a method of motion for avoiding interference between characters' bodies, a memory in which at least one program instruction is stored; and comprising a processor for performing at least one program instruction; At least one program command above, Generate a bone of a character corresponding to the user based on the user's image; Setting the starting point and target point for collision risk check between the bodies of the above characters on the body of the above character; Performing a collision test between the starting point and the target point to derive a collision surface between the starting point and the target point; and A device that is executed to calculate an evasion vector based on at least one of the collision surface of the character and the movement direction of the upper limb.

14. In paragraph 13, At least one program command above, In order to produce the above evasion vector, It is run to produce the basic evasion vector, In order to produce the above basic evasion vector, Calculate the collision distance ratio based on the positions of the above starting point, the above target point, and the above collision surface; and A device characterized in that it is executed to produce a first avoidance vector, which is a normal vector of the collision surface between the starting point and the target point.

15. In paragraph 14, A device characterized in that the first avoidance vector is calculated based on the starting point, target point, and collision surface having the smallest collision distance ratio.

16. In paragraph 14, In order to produce the above basic evasion vector, Calculate a trend vector from the spine of the above character to the lower arm of the above upper limb; and A device characterized in that it is executed to produce a second avoidance vector by adding the tendency vector to the first avoidance vector.

17. In paragraph 16, In order to produce the above evasion vector, A device characterized in that it is executed to produce an additional evasion vector based on at least one of a frontal vector of the central axis of the character and a lateral vector from the spine of the character to the side.

18. In paragraph 17, In order to produce the above additional evasion vector, A device characterized in that, when the basic evasion vector is directed in an opposite direction beyond the center of the character, a third evasion vector is generated by restricting the basic evasion vector to be parallel to the front vector of the central axis.

19. In paragraph 17, In order to produce the above additional evasion vector, A device characterized in that it is executed to produce a fourth evasion vector by adding the side vector to the basic evasion vector.

20. In paragraph 19, In order to produce the fourth evasion vector, Setting a first reference point on the upper arm of the character and a second reference point on the spine line of the character; Calculate the upper arm impact ratio based on the distance value between the first reference point and the second reference point and the distance value from the spine to the side; and It is executed to calculate the weight based on the above upper body collision ratio value, The above 4th evasion vector is, A device characterized in that it is calculated based on the above basic evasion vector, the side vector, and the weight.

21. In paragraph 20, The first reference point is the center point of the character's upper arm, and the second reference point is the point closest to the first reference point on the spine segment. A device characterized in that the above upper arm collision ratio value is a value obtained by dividing the distance value from the spine to the side by the distance value between the first reference point and the second reference point.

22. In paragraph 20, The above 4th evasion vector is, A device characterized in that it is calculated by adding the side vector to which the weight is applied to the basic evasion vector.

23. In paragraph 22, If the above upper collision ratio value is greater than the preset first value, A device characterized in that the size of the side vector to which the weight is applied is 0.

24. In paragraph 22, If the above upper impact ratio value is less than or equal to the preset second value, A device characterized in that the size of the side vector to which the weight is applied is the same as the size of the basic avoidance vector.

25. A method for avoiding body interference of a character executed by at least one processor of a device, A step of creating a bone of a character corresponding to the user based on the user's image; A step of setting a start point and a target point for checking the risk of collision between the bodies of the above characters on the body of the above character; A step of performing a collision test between the starting point and the target point to derive a collision surface between the starting point and the target point; and A method of operation, comprising: a step of calculating an avoidance vector based on at least one of a normal vector of a collision surface of the character, a tendency vector from the spine of the character toward the lower arm, a frontal vector of the central axis of the character, and a side vector of the character.

Citation Information

Patent Citations

  • Simulation method, simulation apparatus, and simulation program

    JP2004030502A

  • Motion reconstruction, retargeting, trajectory tracking and estimation of articulated systems

    JP2009521334A

  • Method and apparatus for shape deforming surface based 3D human model

    KR1020100073174A

  • Apparatus and method to generate realistic rigged three dimensional (3D) model animation for view-point transform

    KR1020180090746A

  • Method for manufacturing synthetic resin mask of velcro inserting type for filter replacement and mask

    KR102318008B1