Information processing apparatus and information processing method

Abstract

To more accurately determine posture information using human models. [Solution] An information processing device is provided, comprising: an acquisition unit that acquires information indicating the construction angle of a human model and information indicating the height of the human model's hands; a determination unit that determines whether the construction is on a wall or a floor based on the information indicating the construction angle, determines that the human model is crouching if the height of the human model's hands is below a first threshold when the construction is on a wall, determines that the human model is crouching if the height of the human model's hands is below a second threshold which is lower than the first threshold when the construction is on a floor, and determines the height of the human model's waist, etc., using artificial intelligence, etc., depending on whether the construction is on a wall or a floor and whether the human model is crouching or not.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus and an information processing method.

Background Art

[0002] Techniques for generating the posture of a human model in a simulation environment are known. In posture generation using such a human model, it is assumed that predetermined reference positions (for example, joints, tips of limbs, etc.) on the human model are fixed, and inverse calculations are performed so that the remaining unfixed positions do not become kinematically unnatural (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the prior art, for example, there is room for improvement in determining posture information using a human model.

[0005] An object of the present disclosure is to provide a technique capable of more appropriately determining posture information using a human model.

Means for Solving the Problems

[0006] In a first aspect of the present disclosure, an information processing device is provided, comprising: an acquisition unit that acquires information indicating the construction angle of a human model and information indicating the height of the human model's hands; a determination unit that determines whether the construction is on a wall or a floor based on the information indicating the construction angle, determines that the human model is crouching if the height of the human model's hands is less than a first threshold when the construction is on a wall, determines that the human model is crouching if the height of the human model's hands is less than a second threshold lower than the first threshold when the construction is on a floor, and determines the height of the human model's waist according to whether the construction is on a wall or a floor and whether the human model is crouching or not.

[0007] Furthermore, a second aspect of the present disclosure provides an information processing method which acquires information indicating the construction angle of a human model and information indicating the height of the human model's hands, determines whether the construction is on a wall or a floor based on the information indicating the construction angle, determines that the human model is crouching if the height of the human model's hands is below a first threshold when the construction is on a wall, determines that the human model is crouching if the height of the human model's hands is below a second threshold which is lower than the first threshold when the construction is on a floor, and determines the height of the human model's waist depending on whether the construction is on a wall or a floor and whether the human model is crouching or not. [Effects of the Invention]

[0008] From one perspective, using a human model allows for more appropriate determination of posture information. [Brief explanation of the drawing]

[0009] [Figure 1] This figure shows the configuration of the information processing device according to the embodiment, an example of the hardware configuration, and an example of a flowchart for the process of generating the working posture of a 3D character. [Figure 2] This flowchart shows an example of the process for determining the waist height of a human model in the information processing device according to the embodiment. [Figure 3]This figure shows an example of the process for determining the waist height of a human model in the information processing device according to the embodiment. [Figure 4] This figure shows an example of the process for determining the front-to-back position of the waist of a human model in an information processing device according to the embodiment. [Figure 5] This flowchart shows an example of the process for determining the head position of a human model in an information processing device according to the embodiment. [Figure 6] This figure shows an example of the process for determining the head position of a human model in an information processing device according to the embodiment. [Modes for carrying out the invention]

[0010] The principles of this disclosure will be described with reference to several exemplary embodiments. These embodiments are described for illustrative purposes only and should be understood as helping those skilled in the art to understand and implement this disclosure without implying any limitation on the scope of this disclosure. The disclosures described herein may be implemented in various ways other than those described below.

[0011] In the following description and claims, unless otherwise defined, all technical and scientific terms used herein have the same meanings as those generally understood by those skilled in the art to which this disclosure belongs. Embodiments of this disclosure will be described below with reference to the drawings.

[0012] <Structure> Referring to Figure 1(a), the configuration of the information processing device 10 according to the embodiment will be described. Figure 1(a) is a diagram showing an example of the configuration of the information processing device 10 according to the embodiment. In the example of Figure 1(a), the information processing device 10 has an acquisition unit 11 and a determination unit 12. Each of these units may be realized through the cooperation of one or more programs installed in the information processing device 10 and hardware such as the processor and memory of the information processing device 10.

[0013] The acquisition unit 11 acquires information indicating the construction angle of the human model and information indicating the height of the human model's hands. The determination unit 12 determines whether the work is being done on a wall or a floor based on the information indicating the construction angle. The information indicating the construction angle may include at least one of the following: information indicating the posture of the tools used in the work and information indicating the posture of the processing point.

[0014] The determination unit 12 then determines that the human model is crouching if the height of the human model's hands is below a first threshold when the installation is on a wall. The determination unit 12 also determines that the human model is crouching if the height of the human model's hands is below a second threshold, which is lower than the first threshold, when the installation is on a floor. The determination unit 12 then determines the height of the human model's waist depending on whether the installation is on a wall or a floor, and whether the human model is crouching or not. This may result in the generation of a computer graphics (CG) animation using the human model.

[0015] <Hardware Configuration> Figure 1(b) is a diagram showing an example of the hardware configuration of each information processing device 10 according to the embodiment. In the example in Figure 1(b), the information processing device 10 (computer 100) includes a processor 101, memory 102, and a communication interface 103. These parts may be connected by a bus or the like. The memory 102 stores at least a portion of the program 104. The communication interface 103 includes an interface necessary for communication with other network elements.

[0016] When the program 104 is executed by the cooperation of the processor 101, the memory 102, etc., at least part of the processing of the embodiments of the present disclosure is performed by the computer 100. The memory 102 may be of any type. The memory 102 may be, as a non-limiting example, a non-transitory computer-readable storage medium. Also, the memory 102 may be implemented using any suitable data storage technology such as semiconductor-based memory devices, magnetic memory devices and systems, optical memory devices and systems, fixed memory, and removable memory. Although only one memory 102 is shown for the computer 100, there may be several physically different memory modules in the computer 100. The processor 101 may be of any type. The processor 101 may include one or more of a general-purpose computer, a dedicated computer, a microprocessor, a digital signal processor (DSP), and, as a non-limiting example, a processor based on a multi-core processor architecture. The computer 100 may have multiple processors such as an application-specific integrated circuit chip that is temporally dependent on a clock that synchronizes the main processor.

[0017] Embodiments of the present disclosure may be implemented in hardware or dedicated circuitry, software, logic, or any combination thereof. Some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software that may be executed by a controller, a microprocessor, or other computing device.

[0018] The present disclosure also provides at least one computer program product tangibly stored on a non-transitory computer-readable storage medium. The computer program product includes computer-executable instructions, such as instructions included in program modules, which are executed on a target physical processor or virtual processor on a device to execute the processes or methods of the present disclosure. Program modules include routines, programs, libraries, objects, classes, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The functions of program modules may be combined or divided among program modules as desired in various embodiments. The machine-executable instructions of program modules can be executed within a local or distributed device. In a distributed device, program modules can be arranged on both local and remote storage media.

[0019] The program includes a set of instructions (or software code) for causing a computer to perform one or more functions described in the embodiments when loaded into the computer. The program may be stored on a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, the computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD), or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray (registered trademark) disc, or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage, or other magnetic storage devices. The program may be transmitted on a transitory computer-readable medium or a communication medium. By way of example and not limitation, the transitory computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagated signals.

[0020] <Processing> Next, with reference to Figure 1(c), an example of the process for generating the working posture of a 3D character in the information processing device 10 according to the embodiment will be described. Figure 1(c) is a flowchart of an example of the process for generating the working posture of a 3D character in the information processing device 10 according to the embodiment. The process in Figure 1(c) may be executed, for example, in response to a specific operation by the administrator of the information processing device 10.

[0021] In step S101, the acquisition unit 11 acquires information indicating the position and orientation (working angle) of the processing point. The processing point is the point where the object to be worked on and the tool used for the work come into contact. The position and orientation of the processing point may be registered in advance in the information processing device 10 by an operator (manager), or may be calculated by a program that performs 3D simulation. The information indicating the working angle may include at least one of the information indicating the orientation of the tool used for the work and the information indicating the orientation of the processing point.

[0022] Next, the determination unit 12 determines (calculates) the position of the human model's hands (for example, fingertips) (step S102). Here, the determination unit 12 may calculate the position of the fingertips based on the position and orientation of the machining point and the relative position information of both hands of the human model with respect to the tool, which is set for each tool.

[0023] Next, the acquisition unit 11 acquires the position of the human model's feet (step S103). The position of the feet may be registered in advance in the information processing device 10 by an operator (administrator), or it may be calculated by a program that performs 3D simulation.

[0024] Next, the determination unit 12 determines the position of the human model's waist (step S104). Details of this process will be described later with reference to Figures 2 to 4. Next, the determination unit 12 determines the position of the human model's head (step S105). Details of this process will be described later with reference to Figures 5 and 6.

[0025] Next, the determination unit 12 determines the positions of other parts of the human model based on the positions of both hands, both feet, waist, and head (step S106). Here, the determination unit 12 may calculate the positions of other parts of the human model using, for example, inverse kinematics or artificial intelligence (AI).

[0026] <<Process to determine waist position>> (Process to determine waist height) Next, referring to Figures 2 to 4, an example of the process of determining the waist height of a human model included in step S104 of Figure 1(c) of the information processing device 10 according to the embodiment will be described. Figure 2 is a flowchart of an example of the process of determining the waist height of a human model of the information processing device 10 according to the embodiment. Figure 3 is a diagram showing an example of the process of determining the waist height of a human model of the information processing device 10 according to the embodiment. Figure 4 is a diagram showing an example of the process of determining the front-to-back position of the waist of a human model of the information processing device 10 according to the embodiment.

[0027] In step S201, the determination unit 12 determines whether the current work type of the human model is wall construction or floor construction. The determination unit 12 may also determine the current work type of the human model based on the construction angle of the processing point. The construction angle of the processing point is the angle relative to the horizontal direction in the virtual 3D space where the processing point is performed by the human model. The construction angle of the processing point may also be, for example, the posture (orientation) of the tool. Note that the construction angle of the processing point may be an angle that does not make the posture of the human model unnatural (for example, a construction angle of 0 to 80 degrees for wall construction, and a construction angle of 80 to 90 degrees for floor construction).

[0028] In the case of construction on a wall surface (wall surface in step S201), the determination unit 12 determines whether or not a flag (Should Focus) indicating whether or not the human model is fixated on the processing point is ON (step S202). This flag may be registered in advance in the information processing device 10 by an operator (administrator), etc., or it may be calculated by a program that performs 3D simulation, etc. If this flag is ON, control may be performed in the 3D simulation to match the height of the human model's head (vertical height in virtual 3D space) to the processing point.

[0029] If the flag (Should Focus) is ON (YES in step S202), the determination unit 12 determines whether the height of the human model's hands is less than the first crouching threshold (X cm) (step S203). If the hand height is not less than the first crouching threshold (NO in step S203), the determination unit 12 sets (determines) the height of the human model's waist so that the distance between the head and waist is constant (step S204) and terminates the process. On the other hand, if the hand height is less than the first crouching threshold (YES in step S203), the determination unit 12 determines whether the human model is moving while working in the 3D simulation (step S205).

[0030] If the human model is not moving during the work (NO in step S205), the determination unit 12 sets the waist height of the human model to the first specific value (h1) (determined) (step S206) and terminates the process. On the other hand, if the human model is moving during the work (YES in step S205), the determination unit 12 sets the waist height of the human model to the second specific value (h2) (determined) (step S207) and terminates the process.

[0031] If the flag (Should Focus) is not ON (is OFF) (NO in step S202), the determination unit 12 determines whether the height of the human model's hands is less than a second crouching threshold (Ycm) which is different from the first crouching threshold (step S208). If the hand height is not less than the second crouching threshold (NO in step S208), the determination unit 12 sets (determines) the height of the human model's waist to a third specific value (h3) (step S209) as shown in Figure 3(a) and terminates the process. On the other hand, if the hand height is less than the second crouching threshold (YES in step S208), the determination unit 12 determines whether the human model is moving while working in the 3D simulation (step S210).

[0032] If the human model is not moving during the work (NO in step S210), the determination unit 12 sets (determines) the waist height of the human model to the fourth specific value (h4) (step S211) and terminates the process, as shown in Figure 3(b). On the other hand, if the human model is moving during the work (YES in step S210), the determination unit 12 sets (determines) the waist height of the human model to the fifth specific value (h5) (step S212) and terminates the process.

[0033] In the case of installation on a floor surface (floor surface in step S201), the determination unit 12 determines whether the height of the human model's hands is less than a third crouch threshold (Z cm) which is different from the first and second crouch thresholds (step S213). Note that the third crouch threshold used in the case of installation on a floor surface may be a lower value than the first and second crouch thresholds used in the case of installation on a wall surface.

[0034] If the hand height is not below the third crouching threshold (NO in step S213), the determination unit 12 sets (determines) the waist height of the human model to the sixth specific value (h6) as shown in Figure 3(c) (step S214) and terminates the process. On the other hand, if the hand height is below the third crouching threshold (YES in step S213), the determination unit 12 determines whether or not the human model is moving while working in the 3D simulation (step S215).

[0035] If the human model is not moving during the work (NO in step S215), the determination unit 12 sets (determines) the waist height of the human model to the seventh specific value (h7) as shown in Figure 3(d) (step S216) and terminates the process. On the other hand, if the human model is moving during the work (YES in step S215), the determination unit 12 sets (determines) the waist height of the human model to the eighth specific value (h8) (step S217) and terminates the process.

[0036] Note that the first, second, third, fourth, fifth, sixth, and seventh specific values ​​may each be different values. The first, second, third, fourth, fifth, sixth, and seventh specific values ​​may be registered in the information processing device 10 in advance by an operator (administrator), etc.

[0037] The first crouching threshold, the second crouching threshold, and the third crouching threshold may be pre-registered in the information processing device 10 by an operator (manager), etc. In the example described above, it is determined that the human model is in a crouching position if the height of its hands is below the crouching threshold for each situation, and in a standing position if the height of its hands is not below the crouching threshold for each situation. In addition, in the example described above, the height of the waist is changed depending on whether or not the work involves moving in accordance with the moving processing point.

[0038] (Process to determine the front-to-back position of the waist) Next, referring to Figure 4, an example of the process by which the information processing device 10 according to the embodiment determines the front-to-back position of the waist of the human model included in step S104 of Figure 1(c) will be described. Although Figure 4 shows an example of installation on a floor surface, the process may be similar for installation on a wall surface.

[0039] First, the determination unit 12 may calculate the center of gravity position 401 of the human model alone on the horizontal plane of the three-dimensional virtual space. Then, the determination unit 12 may determine the load position assuming that the weight of the tool 421 is evenly distributed between the hands of the human model. Then, the determination unit 12 may calculate the center of gravity position 402 of the human model holding the tool by calculating the center of gravity position and the load position of the human model. Then, the determination unit 12 may move the position of the human model's waist from position 411 to position 412, backward from the human model, by a distance 403 obtained by subtracting the center of gravity position 402 of the human model alone from the center of gravity position 401 of the human model alone.

[0040] <<Process to determine head position>> Next, with reference to Figures 5 and 6, an example of the process by which the information processing device 10 according to the embodiment determines the position of the human model's head in step S105 of Figure 1(c) will be described. Figure 5 is a flowchart showing an example of the process by which the information processing device 10 according to the embodiment determines the position of the human model's head. Figure 6 is a diagram showing an example of the process by which the information processing device 10 according to the embodiment determines the position of the human model's head.

[0041] In step S301, the determination unit 12 determines whether the current work type of the human model is construction on a wall or construction on a floor. Note that the processing in step S301 may be the same as the processing in step S201 in Figure 2.

[0042] When installed on a wall (wall in step S301), the determination unit 12 calculates the front-to-back position of the human model's head (distance between the human model's hands and head) based on the height of the human model's hands (step S302). When installed on a wall, the hands are in front of the head. Therefore, the determination unit 12 may set the distance between the hands and head according to the height of the hands. In this case, the determination unit 12 calculates the front-to-back position Y of the human model's head using the following equation (1). h The following can be calculated. Note that H is the height of the human model's hand, and the coefficient a and constant b may be values ​​obtained, for example, through experimentation and set in the information processing device 10. Y h = aH + b ···(1)

[0043] Next, the determination unit 12 sets (determines) the height of the human model's head so that the distance between the head and waist remains constant (step S303), and then terminates the process. Figure 6(a) shows an example of the position of the human model's head when installed on a wall. In the example in Figure 6(a), it is shown that when the height of the human model's hands is 601, the front-to-back position of the human model's head is calculated to be the horizontal distance between the human model's hands and head, 611. It is also shown that when the height of the human model's hands is 602, the front-to-back position of the human model's head is calculated to be the horizontal distance between the human model's hands and head, 612.

[0044] On the other hand, in the case of installation on the floor (floor surface in step S301), the determination unit 12 sets the distance between the hands and the head (step S304). The distance between the hands and the head may be pre-set in the information processing device 10 depending on, for example, each person model and whether they are standing or squatting.

[0045] Next, the determination unit 12 determines the front-to-back position of the human model's head based on the distance between the hands and the head (step S305), and proceeds to step S303. When installed on a floor surface, the head is in front of the hands. Therefore, the determination unit 12 may position the head forward of the human model compared to the hand position by the set value of the distance between the hands and the head (offset). Figure 6(b) shows an example of the position of the human model's head when installed on a floor surface. In the example in Figure 6(b), it is shown that the front-to-back position of the human model's head is calculated so that the distance between the hands and the head of the human model is the set value of 621.

[0046] <Other> For example, in environments such as construction sites, various human postures are used for work, and some tasks are difficult to replicate using a human model. Work postures at construction sites can be broadly divided into two categories: wall construction and floor construction. A typical example of wall construction is the posture used when drilling.

[0047] Let's assume that the posture of the torso is determined by the position (height) of the hands. In this case, however, there are working postures where the hand position is the same but the torso posture differs, such as in wall construction and floor construction, so there are postures that cannot be accurately represented. Also, a typical example of floor construction is a bent-over posture with the hands extended downwards, which has been difficult to represent with conventional technology.

[0048] On the other hand, according to this disclosure, at least one of the waist height and the anterior-posterior position of the head is calculated from the hand position and working posture. Therefore, complex postures, such as the posture of a person working on surfaces in different directions, such as walls and floors, depending on the work content, can be precisely calculated using a human model while reducing the increase in computational load. For example, in generating working postures for 3D characters moving in a 3D simulation that simulates work, various working postures that cannot be expressed by combinations of existing animations can be generated, such as a posture of mixing mortar while bending at the waist and looking down.

[0049] <Variation> The information processing device 10 may be a device contained in a single enclosure, but the information processing device 10 of this disclosure is not limited to this. Each part of the information processing device 10 may be implemented by cloud computing, which is composed of, for example, one or more computers.

[0050] It should be noted that the present invention is not limited to the embodiments described above, and can be modified as appropriate without departing from the spirit of the invention. [Explanation of Symbols]

[0051] 10 Information Processing Devices 11 Acquisition Department 12. Decision Section

Claims

1. An acquisition unit that acquires information indicating the construction angle of the human model and information indicating the height of the human model's hands, Based on the information indicating the installation angle, it is determined whether the installation is on a wall or a floor. If the installation is on a wall surface and the height of the human model's hands is below the first threshold, it is determined that the human model is crouching. If the installation is performed on the floor surface, and the height of the human model's hands is below the second threshold, which is lower than the first threshold, then it is determined that the human model is crouching. A determination unit that determines the waist height of the human model depending on whether it is installed on a wall or on a floor, and whether the human model is crouching or not, An information processing device having

2. The information indicating the work angle includes at least one of the following: information indicating the orientation of the tools used in the work, and information indicating the orientation of the processing point. The information processing apparatus according to claim 1.

3. The previous decision-making body was, The height of the human model's waist is determined depending on whether or not the human model is looking at the machining point. The information processing apparatus according to claim 1 or 2.

4. The previous decision-making body was, Based on the height of the human model's hands, the distance between the human model's hands and head is determined. The information processing apparatus according to claim 1 or 2.

5. Information indicating the construction angle of the human model and information indicating the height of the human model's hands are obtained. Based on the information indicating the installation angle, it is determined whether the installation is on a wall or a floor. If the installation is on a wall surface and the height of the human model's hands is below the first threshold, it is determined that the human model is crouching. If the installation is performed on the floor surface, and the height of the human model's hands is below the second threshold, which is lower than the first threshold, then it is determined that the human model is crouching. The waist height of the human model is determined depending on whether the installation is on a wall or a floor, and whether the human model is crouching or not. Information processing methods.

Images