Information processing apparatus and information processing method

Abstract

The present invention addresses the problem of more appropriately determining posture information of a user model. An information processing device is provided with: an acquisition unit that acquires information indicating a construction angle of a human model and information indicating a height of a hand of the human model; and a determination unit that, on the basis of the information indicating the construction angle, determines whether construction is performed on a wall surface or on a ground surface, determines that the human model is in a squat state when the height of the hand of the human model is lower than a first threshold value when the wall surface is constructed, and determines that the human model is in a squat state when the ground surface is constructed, and determines that the human model is in a non-squat state when the height of the hand of the human model is lower than the first threshold value when the ground surface is constructed. When the height of the hand of the human model is lower than a second threshold value lower than the first threshold value, it is determined that the human model is in a squatting state, and the height of the waist of the human model is determined by artificial intelligence or the like on the basis of whether the construction is performed on the wall surface or the ground surface and whether the human model is in the squatting state.

Description

Technical Field

[0001] This invention relates to an information processing device and an information processing method. Background Technology

[0002] A technique for generating poses of a human model in a simulated environment is known. In generating poses using such a human model, a method is known that assumes that certain reference positions on the human model (e.g., joints, limb ends, etc.) are determined (fixed) and performs inverse operations in a manner that prevents the remaining undetermined positions from becoming kinematically unnatural (e.g., see Patent Document 1).

[0003] Patent Document 1: Japanese Patent Application Publication No. 2013-109696 Summary of the Invention

[0004] However, there is room for improvement in the existing technology, for example, in the determination of pose information using human models.

[0005] The purpose of this invention is to provide a technique that can more appropriately determine the posture information of a human model.

[0006] In a first aspect of the present invention, an information processing apparatus is provided, comprising: an acquisition unit that acquires information representing the construction angle of a mannequin and information representing the height of the mannequin's hands; and a determination unit that, based on the information representing the construction angle, determines whether the construction is on a wall or on the ground; in the case of construction on a wall, if the height of the mannequin's hands is lower than a first threshold, determines that the mannequin is in a squatting state; in the case of construction on the ground, if the height of the mannequin's hands is lower than a second threshold lower than the first threshold, determines that the mannequin is in a squatting state; and determines the waist height of the mannequin based on whether the construction is on a wall or on the ground and whether the mannequin is in a squatting state.

[0007] Furthermore, in the second aspect of the present invention, an information processing method is provided, which includes the following steps: obtaining information representing the construction angle of a human model and information representing the height of the human model's hands; based on the information representing the construction angle, determining whether the construction is on a wall or on the ground; in the case of construction on a wall, determining that the human model is in a squatting state when the height of the human model's hands is lower than a first threshold; in the case of construction on the ground, determining that the human model is in a squatting state when the height of the human model's hands is lower than a second threshold lower than the first threshold; and determining the waist height of the human model based on whether the construction is on a wall or on the ground and whether the human model is in a squatting state.

[0008] Invention Effects

[0009] Based on one side, the posture information of the user model can be more appropriately determined. Attached Figure Description

[0010] Figure 1 This is an example of a flowchart illustrating the configuration of the information processing device involved in the implementation method, an example of the hardware configuration, and a process for generating the working posture of a 3D character.

[0011] Figure 2 This is a flowchart illustrating an example of the process by which the information processing apparatus involved in the embodiment determines the waist height of a human model.

[0012] Figure 3 This diagram illustrates an example of the process by which the information processing device involved in the embodiment determines the waist height of a human model.

[0013] Figure 4 This diagram illustrates an example of the process by which the information processing device involved in the embodiment determines the front-back position of the waist of a human model.

[0014] Figure 5 This is a flowchart illustrating an example of the process by which the information processing apparatus involved in the embodiment determines the position of the head of a human model.

[0015] Figure 6 This diagram illustrates an example of the process by which the information processing apparatus involved in the embodiment determines the position of the head of a human model. Detailed Implementation

[0016] The principles of the present invention are described with reference to several exemplary embodiments. These embodiments are described for illustrative purposes only and are not intended to limit the scope of the invention, but are meant to help those skilled in the art to understand and practice the invention. The invention described herein can be implemented by various methods other than those described below.

[0017] In the following description and claims, unless otherwise defined, all technical and scientific terms used herein have the meanings commonly understood by one of ordinary skill in the art to which this invention pertains. Embodiments of the invention will now be described with reference to the accompanying drawings.

[0018] <Composition>

[0019] refer to Figure 1 (a) The configuration of the information processing apparatus 10 according to the embodiment will be described. Figure 1 (a) is a diagram showing an example of the configuration of the information processing apparatus 10 according to the embodiment. Figure 1In example (a), the information processing apparatus 10 has an acquisition unit 11 and a determination unit 12. These units can be implemented through cooperation between one or more programs installed on the information processing apparatus 10 and hardware such as the processor and memory of the information processing apparatus 10.

[0020] The acquisition unit 11 acquires information representing the construction angle of the mannequin and information representing the height of the mannequin's hands. The determination unit 12 determines whether the construction is on a wall or on the ground based on the information representing the construction angle. Furthermore, the information representing the construction angle may include at least one of information representing the posture of the tools used in the operation and information representing the posture of the processing point.

[0021] Furthermore, when the work is being done on a wall, the determination unit 12 determines that the human model is crouching if the height of the human model's hands is below a first threshold. Similarly, when the work is being done on the ground, the determination unit 12 determines that the human model is crouching if the height of the human model's hands is below a second threshold, which is lower than the first threshold. The determination unit 12 also determines the waist height of the human model based on whether the work is on a wall or the ground and whether the human model is crouching. As a result, computer graphics (CG) animation using the human model can be generated.

[0022] <Hardware Configuration>

[0023] Figure 1 (b) is a diagram illustrating an example of the hardware configuration of each information processing device 10 according to the embodiment. Figure 1 In example (b), the information processing device 10 (computer 100) includes a processor 101, a memory 102, and a communication interface 103. These components can be connected via a bus or the like. The memory 102 stores at least a portion of the program 104. The communication interface 103 includes an interface required for communication with other network elements.

[0024] If program 104 is executed through the cooperation of processor 101 and memory 102, at least a portion of the processing of embodiments of the present invention is performed by computer 100. Memory 102 can be any type of memory. As a non-limiting example, memory 102 can be a non-transitory computer-readable storage medium. Furthermore, memory 102 can be implemented using any suitable data storage technology such as semiconductor-based memory devices, magnetic storage devices and systems, optical storage devices and systems, fixed memory, and removable memory. Although only one memory 102 is shown in computer 100, multiple physically different memory modules may exist in computer 100. Processor 101 can be any type of processor. Processor 101 may include one or more of a general-purpose computer, a special-purpose computer, a microprocessor, a digital signal processor (DSP), and, as a non-limiting example, a processor based on a multi-core processor architecture. Computer 100 may have multiple processors, such as application-specific integrated circuit chips that are time-dependent with a clock that synchronizes the main processor.

[0025] Embodiments of the present invention can be implemented by hardware or dedicated circuitry, software, logic, or any combination thereof. Some implementations can be implemented by hardware, while others can be implemented by firmware or software that can be executed by a controller, microprocessor, or other computing device.

[0026] The present invention also provides at least one computer program product tangibly stored in a non-transitory computer-readable storage medium. The computer program product includes computer-executable commands such as commands included in program modules, and executes on a device on the actual processor or virtual processor of the object, thereby performing the processes or methods of the present invention. Program modules include routines, programs, libraries, objects, classes, components, data structures, etc., that perform specific tasks or implement specific abstract data types. The functionality of program modules can be combined or divided among program modules according to various implementation methods. The machine-executable commands of the program modules can be executed locally or on a distributed device. In a distributed device, the program modules can be configured on both local and remote storage media.

[0027] When the above-described program is read into a computer, it includes a set of commands (or software code) for causing the computer to perform one or more functions described in the embodiments. The program may be stored in a non-transitory computer-readable medium or a tangible storage medium. As non-limiting examples, computer-readable media or tangible storage media include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray disc (registered trademark) or other optical disc storage devices, magnetic tape, magnetic tape, disk storage devices, or other magnetic storage devices. The program may be transmitted on a temporary computer-readable medium or a communication medium. As an example, and not a limitation, temporary computer-readable media or communication media include electrical, optical, acoustic, or other forms of propagation signals.

[0028] <Processing>

[0029] Next, refer to Figure 1 (c) An example of the processing of the work posture of the information processing device 10 for generating 3D characters according to the embodiment will be described. Figure 1 (c) is a flowchart illustrating an example of the processing of the information processing apparatus 10 according to the embodiment to generate the working posture of a 3D character. Figure 1 (c) The processing can be performed, for example, in response to a specific operation by the manager of the information processing device 10.

[0030] In step S101, the acquisition unit 11 acquires information indicating the position and orientation (work angle) of the processing point. The processing point is the point where the work object contacts the tool used in the work. The position and orientation of the processing point can be pre-registered in the information processing device 10 by the operator (manager), or calculated by a 3D simulation program. The information indicating the work angle may include at least one of information indicating the orientation of the tool used in the work and information indicating the orientation of the processing point.

[0031] Next, the determining unit 12 determines (calculates) the position of the human model's hands (e.g., fingertips) (step S102). Here, the determining unit 12 can calculate the position of the fingertips based on the position and posture of the processing point and the relative position information of the tool relative to the human model's hands set for each tool.

[0032] Next, the acquisition unit 11 acquires the position of the feet of the human model (step S103). The position of the feet can be pre-registered in the information processing device 10 by the operator (manager) or the like, or it can be calculated by a program that performs 3D simulation.

[0033] Next, the determination section 12 determines the position of the waist of the human model (step S104). For details of this process, please refer to [link / reference needed]. Figures 2 to 4 This will be described later. Next, the determining unit 12 determines the position of the human model's head (step S105). For details of this process, please refer to [link to relevant documentation]. Figure 5 and Figure 6 This will be discussed later.

[0034] Next, the determination unit 12 determines the positions of other parts of the human model based on the positions of the hands, feet, waist, and head (step S106). Here, the determination unit 12 may use, for example, inverse kinematics or artificial intelligence (AI) to calculate the positions of other parts of the human model.

[0035] <<Treatment for determining the position of the waist>>

[0036] (Determining the height of the waist)

[0037] Next, refer to Figures 2 to 4 Regarding the information processing device 10 involved in the implementation method, Figure 1 (c) will be illustrated by an example of the process of determining the waist height of the human model included in step S104. Figure 2 This is a flowchart illustrating an example of the process by which the information processing apparatus 10 involved in the embodiment determines the waist height of a human model. Figure 3 This diagram illustrates an example of the process by which the information processing device 10 of the embodiment determines the waist height of a human model. Figure 4 This diagram illustrates an example of the process by which the information processing device 10 of the embodiment determines the front-back position of the waist of a human model.

[0038] In step S201, the determining unit 12 determines whether the current job category of the human model is wall construction or floor construction. The determining unit 12 can determine the current job category of the human model based on the construction angle of the processing point. The construction angle of the processing point is the angle of the processing point relative to the horizontal direction in the virtual three-dimensional space constructed by the human model. The construction angle of the processing point can be, for example, the posture (or orientation) of the tool. In addition, the construction angle of the processing point can be an angle that will not make the posture of the human model appear unnatural (for example, a construction angle of 0 to 80 degrees in the case of wall construction, and a construction angle of 80 to 90 degrees in the case of floor construction).

[0039] In the case of construction on a wall (the wall in step S201), the determination unit 12 determines whether the "Should Focus" flag, indicating whether the human model is looking at the processing point, is turned on (step S202). This flag can be pre-registered in the information processing device 10 by the operator (manager) or the like, or it can be calculated by a 3D simulation program. Furthermore, when the flag is turned on, the alignment of the processing point with the height of the human model's head (vertical height in virtual three-dimensional space) can be controlled in the 3D simulation.

[0040] When the "Should Focus" flag is on ("Yes" in step S202), the determination unit 12 determines whether the height of the human model's hands is lower than the first squatting threshold (Xcm) (step S203). If the height of the hands is not lower than the first squatting threshold ("No" in step S203), the determination unit 12 sets (determines) the height of the human model's waist so that the distance between the head and waist becomes constant (step S204) and ends the process. On the other hand, if the height of the hands is lower than the first squatting threshold ("Yes" in step S203), the determination unit 12 determines whether the human model is lower than the threshold during 3D simulation, which is an operation performed simultaneously with movement (step S205).

[0041] If the operation is not performed while the human model is moving ("No" in step S205), the determining unit 12 sets (determines) the waist height of the human model to a first specific value (h1) (step S206) and ends the process. On the other hand, if the operation is performed while the human model is moving ("Yes" in step S205), the determining unit 12 sets (determines) the waist height of the human model to a second specific value (h2) (step S207) and ends the process.

[0042] If the "Should Focus" flag is not on (is off) ("No" in step S202), the determining unit 12 determines whether the height of the human model's hand is lower than a second squatting threshold (Ycm) that is different from the first squatting threshold (step S208). If the hand height is not lower than the second squatting threshold ("No" in step S208), such as Figure 3 As shown in (a), the determination unit 12 sets (determines) the height of the waist of the human model to the third specific value (h3) (step S209) and ends the process. On the other hand, if the height of the hands is lower than the second squatting threshold ("yes" in step S208), the determination unit 12 performs the operation of determining whether the human model is moving in the 3D simulation (step S210).

[0043] If the task is not performed while the human model is moving (No in step S210), such as Figure 3As shown in (b), the determining unit 12 sets (determines) the waist height of the human model to the fourth specific value (h4) (step S211) and ends the process. On the other hand, if the operation is performed while the human model is moving ("Yes" in step S210), the determining unit 12 sets (determines) the waist height of the human model to the fifth specific value (h5) (step S212) and ends the process.

[0044] In the case of construction on the ground (ground in step S201), the determining unit 12 determines whether the height of the human model's hand is lower than a third squatting threshold (Zcm), which is different from the first squatting threshold and the second squatting threshold (step S213). In addition, the third squatting threshold used in the case of construction on the ground can be a value lower than the first squatting threshold and the second squatting threshold used in the case of construction on the wall.

[0045] If the height of the hand is not lower than the third squatting threshold (No in step S213), such as Figure 3 As shown in (c), the determination unit 12 sets (determines) the waist height of the human model to the sixth specific value (h6) (step S214) and ends the process. On the other hand, if the height of the hand is lower than the third squatting threshold ("yes" in step S213), the determination unit 12 performs the operation of determining whether the human model is moving in the 3D simulation (step S215).

[0046] If the task is not performed while the human model is moving (No in step S215), such as Figure 3 As shown in (d), the determining unit 12 sets (determines) the height of the waist of the human model to the 7th specific value (h7) (step S216) and ends the process. On the other hand, if the operation is performed while the human model is moving ("Yes" in step S215), the determining unit 12 sets (determines) the height of the waist of the human model to the 8th specific value (h8) (step S217) and ends the process.

[0047] Furthermore, the first specific value, the second specific value, the third specific value, the fourth specific value, the fifth specific value, the sixth specific value, and the seventh specific value can each be a different value. The first specific value, the second specific value, the third specific value, the fourth specific value, the fifth specific value, the sixth specific value, and the seventh specific value can be pre-registered in the information processing device 10 by the operator (manager), etc.

[0048] The first, second, and third squatting thresholds can be pre-registered in the information processing device 10 by the operator (manager), etc. In the above example, a squatting posture is determined when the height of the human model's hands is lower than the squatting threshold for each situation, and a standing posture is determined when the height of the hands is not lower than the squatting threshold for each situation. Furthermore, in the above example, the waist height is adjusted according to whether the operation involves movement aligned with a moving processing point.

[0049] (Determining the anterior and posterior position of the waist)

[0050] Next, refer to Figure 4 Regarding the information processing device 10 involved in the implementation method, Figure 1 (c) will be explained as an example of the process for determining the anterior-posterior position of the waist of the human model, which is included in step S104. Additionally, Figure 4 An example of construction on the ground is shown, but the same applies to construction on the walls.

[0051] First, the determining unit 12 can calculate the center of gravity position 401 of the human model on the horizontal plane in the three-dimensional virtual space. Furthermore, the determining unit 12 can determine the load position by having the weight of the tool 421 borne by the human model's hands. Moreover, the determining unit 12 can calculate the center of gravity position 402 of the human model holding the tool by performing a center of gravity calculation based on the center of gravity position and load position of the human model. Furthermore, the determining unit 12 can move the position of the human model's waist from position 411 to position 412, i.e., behind the human model, by a distance 403, which is the distance between the center of gravity position 401 and the center of gravity position 402 of the human model.

[0052] <<Processing for Determining Head Position>>

[0053] Next, refer to Figure 5 and Figure 6 Regarding the information processing device 10 involved in the implementation method, Figure 1 (c) will be illustrated by an example of the process of determining the position of the human model’s head included in step S105. Figure 5 This is a flowchart illustrating an example of the process by which the information processing apparatus 10, according to the embodiment, determines the position of the head of a human model. Figure 6 This diagram illustrates an example of the process by which the information processing apparatus 10 of the embodiment determines the position of the head of the human model.

[0054] In step S301, the determining unit 12 determines whether the current job category of the human model is wall construction or floor construction. Furthermore, the processing in step S301 can be combined with... Figure 2 The process of step S201 is the same.

[0055] In the case of wall construction (wall in step S301), the determination unit 12 calculates the front-back position of the mannequin's head (the distance between the mannequin's hand and head) based on the height of the mannequin's hand (step S302). In the case of wall construction, the hand is further forward than the head. Therefore, the determination unit 12 can set the distance between the hand and the head based on the height of the hand. In this case, the determination unit 12 can calculate the front-back position Yh of the mannequin's head using the following formula (1). Furthermore, H is the height of the mannequin's hand, and the coefficients a and b can be obtained experimentally, for example, and can be values ​​set in the information processing device 10.

[0056] Yh=aH+b···(1)

[0057] Next, the determination unit 12 sets (determines) the height of the human model's head so that the distance between the head and waist becomes constant (step S303) and ends the process. Figure 6 (a) shows an example of the head position of a human model during wall construction. Figure 6 In example (a), it is shown that when the height of the mannequin's hand is 601, the front-back position of the mannequin's head is calculated as the horizontal distance 611 between the hand and the head. Furthermore, it is shown that when the height of the mannequin's hand is 602, the front-back position of the mannequin's head is calculated as the horizontal distance 612 between the hand and the head.

[0058] On the other hand, in the case of construction on the ground (ground in step S301), the determining unit 12 sets the distance between the hand and the head (step S304). In addition, the distance between the hand and the head can be preset in the information processing device 10, for example, based on the human model and the standing or squatting posture.

[0059] Next, the determining unit 12 determines the fore-aft position of the mannequin's head based on the distance between the hands and the head (step S305), and proceeds to step S303. In the case of ground construction, the head is positioned further forward than the hands. Therefore, the determining unit 12 can offset the head position setting relative to the hand position towards the front of the mannequin (shift). Figure 6 (b) shows an example of the head position of a human model in the case of ground construction. Figure 6 In example (b), the front-back position of the human model's head is calculated by setting the distance between the human model's hands and head to a set value of 621.

[0060] <Other>

[0061] For example, in construction work environments, various human postures are required for tasks, including those that are difficult to replicate using mannequins. Construction site work postures can be broadly categorized into two types: wall construction and floor construction. A representative example of wall construction is the drilling posture.

[0062] Assume that the torso posture is determined based on the hand position (height). In reality, as with wall construction and floor construction, there are work postures where the hand position is the same but the torso posture is different, thus resulting in postures that cannot be properly represented. Furthermore, as a representative example of floor construction, there is a forward bending posture with the hand extended downwards, which is difficult to represent in existing technology.

[0063] On the other hand, according to the present invention, at least one of the waist height and the front-back position of the head is calculated based on the hand position and the construction posture. Therefore, for example, it is possible to use a human model to perform detailed calculations of complex postures, such as the posture of a person working on a surface in different directions, like a wall or floor, depending on the job content, and to reduce the increase in computational load. For example, when generating the working posture of a moving 3D character in a 3D simulation of a job, it is possible to generate various working postures that cannot be represented by existing animation combinations, such as a posture of bending over and looking down while stirring mortar.

[0064] <Variation Example>

[0065] The information processing device 10 may be a device contained in a housing, but the information processing device 10 of the present invention is not limited thereto. The various parts of the information processing device 10 may be implemented, for example, through cloud computing consisting of one or more computers.

[0066] Furthermore, the present invention is not limited to the above-described embodiments, and appropriate modifications can be made without departing from the spirit of the invention.

[0067] Symbol Explanation

[0068] 10-Information processing device, 11-Acquisition unit, 12-Determination unit.

Claims

1. An information processing device, characterized in that, have: The acquisition unit acquires information representing the construction angle of the human model and information representing the height of the human model's hands; and The determination unit, based on information representing the construction angle, determines whether the construction is on a wall or on the ground. In the case of construction on a wall, if the height of the mannequin's hands is lower than a first threshold, the mannequin is determined to be in a squatting position. In the case of construction on the ground, if the height of the mannequin's hands is lower than a second threshold lower than the first threshold, the mannequin is determined to be in a squatting position. The height of the mannequin's waist is determined based on whether the construction is on a wall or on the ground and whether the mannequin is in a squatting position.

2. The information processing device according to claim 1, characterized in that, The information representing the construction angle includes at least one of information representing the posture of the tool used in the operation and information representing the posture of the processing point.

3. The information processing apparatus according to claim 1 or 2, characterized in that, The determining unit determines the waist height of the human model based on whether the human model is gazing at the processing point.

4. The information processing apparatus according to claim 1 or 2, characterized in that, The determining unit determines the distance between the human model's hand and head based on the height of the human model's hand.

5. An information processing method, comprising the following steps: Obtain information representing the construction angle of the human model and information representing the height of the human model's hands; Based on the information indicating the construction angle, it is determined whether the construction is on the wall or the ground. In the case of wall construction, when the height of the mannequin's hands is below the first threshold, the mannequin is determined to be in a squatting position. In the case of ground construction, when the height of the mannequin's hands is lower than a second threshold that is lower than the first threshold, the mannequin is determined to be in a squatting position. The height of the mannequin's waist is determined based on whether the construction is on a wall or the ground, and whether the mannequin is in a squatting position.

Images