An optical / inertial motion capture system and method

Abstract

The present invention discloses an optical / inertial motion capture system and method. Optical motion capture module: The positions of multiple groups of sensing components located on the acting person are collected and marked through an optical imaging device, and the marked points are recorded on a multi-dimensional simulation software. An independent trajectory record L1 is generated for the trajectory of each group of sensing components on the corresponding multi-dimensional simulation software. Inertial motion capture module: Synchronously records the motion trajectory of the position where the sensing component is located, and marks the position recorded by the sensing component itself as trajectory record L2. Motion correction module: Calculates and compares the position deviation between the trajectory record L1 and the trajectory record L2 of each group of sensing components. Simulation model making module: Simulates and renders the motion trajectory of the animated video after motion correction. Through the mutual cooperation of the optical motion capture module and the inertial motion capture module, the present invention improves the accuracy of the motion trajectory of the acting person during the performance of actions, and more intuitively reflects the authenticity of the performance.

Description

Technical Field

[0001] The present invention belongs to the technical field of animation design, and particularly relates to a light / inertial motion capture system and method. Background Art

[0002] Animation production is based on two-dimensional and three-dimensional animation technologies, providing people with a virtual imaginative space beyond reality. In the process of animation production, the earliest two-dimensional animations mainly appeared in the era of picture-story books with scarce materials. By depicting character animations and drawing text boxes on limited paper, the described scenes were extremely limited.

[0003] Three-dimensional animation is a further improvement based on two-dimensional animation. It adopts a digital layout method. Chinese Patent Application No. CN202110105542.5 discloses an interactive animation production system for animation, which relates to the technical field of animation production, including an animation decomposition and call module, an interactive frame generation module, an interactive animation output module for animation, and an animation database; the provided interactive animation production system for animation can start the interactive animation production process from the finished animation works by changing the way of file storage and reading, making it easy for beginners to get started and the operation simple.

[0004] However, this production method will cause a certain degree of action deviation in the actual animation production process. Especially when editing character actions, some actions directly adopt the three-dimensional animation design method, which will cause the action editing to be unsmooth during design, that is, the continuity of action frames cannot be achieved. In this way, it is necessary to continuously adjust the three-dimensional action editing work, then re-debug, and make modifications after the debugging is completed. This process is repeated, which not only increases the design cost but also prolongs the design cycle. Summary of the Invention

[0005] Aiming at the deficiencies of the prior art, the purpose of the present invention is to provide a light / inertial motion capture system and method, which solves the above technical problems existing in the prior art.

[0006] The purpose of the present invention can be achieved by the following technical solutions:

[0007] A light / inertial motion capture system includes an optical motion capture module, an inertial motion capture module, an action correction module, and a simulation model production module;

[0008] A plurality of sensor components are arranged at the joint positions of the action-performing person, and then placed in an imaging environment, and the action-performing person is made to perform actions within a unit time. A data with a multi-dimensional model is constructed for the space where the sensor components are located, and at the same time, the actual coordinates of the scene are added and corresponding parameters are configured;

[0009] The optical motion capture module: collects and marks the positions of multiple groups of sensing components located on the action figure through an optical imaging device, records the marked points on a multi-dimensional simulation software, and in an action segment of the action figure, as the sensing components of the action figure move, the trajectory of each group of sensing components generates an independent trajectory record L1 on the corresponding multi-dimensional simulation software;

[0010] The inertial motion capture module: synchronously records the motion trajectory of the position where the sensing component is located, and marks the position recorded by the sensing component itself as the trajectory record L2;

[0011] The action correction module: generates an animation video once for all the trajectory records L1 of the sensing component in an action segment, and at the same time generates an animation video once for the trajectory record L2 generated by the movement of the sensing component itself, calculates and compares the position deviation between the trajectory record L1 and the trajectory record L2 of each group of sensing components. When the deviation value is within the preset threshold M1 range, it passes the qualification. When the deviation value exceeds the preset value M1 range, the simulation action drawing of this action is redone;

[0012] The simulation model making module: performs simulation and rendering on the animation video trajectory of the action correction.

[0013] Further, the optical motion capture module records the position positioning of the action segment in a per-frame recording manner within the unit time.

[0014] Further, when the sensing components captured by the optical motion capture module perform trajectory recording, the motion trajectories of each group of sensing components can be selectively hidden or shown.

[0015] Further, the infrared wavelength band of the infrared light source added in the optical motion capture module is 940 - 950 nm.

[0016] Further, after the optical motion capture module collects the motion trajectory points of the sensing components, it performs gray-scale processing, sets an image gray-scale threshold, and performs trajectory record L1 on the motion trajectory points of the sensing components that meet the image gray-scale threshold.

[0017] The method based on the optical / inertial motion capture system includes the following steps:

[0018] S1. First, establish a three-dimensional coordinate system scene within a specified area range, and then place the action figure attached with multiple groups of sensing components into the established three-dimensional coordinate system scene;

[0019] S2. Subsequently, the positions of multiple groups of sensing components on the acting character are collected and marked by an optical imaging device, the marked points are recorded on a multi-dimensional simulation software, and in an action segment of the acting character, as the sensing components on the acting character move, the trajectory of each group of sensing components generates an independent trajectory record L1 on the corresponding multi-dimensional simulation software;

[0020] S3. According to the acting character placed in a three-dimensional left-handed coordinate system scene, the movement trajectories of the positions of the sensing components are synchronously recorded, and the positions recorded by the sensing components themselves are marked as trajectory record L2;

[0021] S4. Calculate and compare the position deviation between the trajectory record L1 and the trajectory record L2 of each group of sensing components. When the deviation value is within the preset threshold M1 range, it passes the qualification. When the deviation value exceeds the preset value M1 range, the simulation action drawing of this action is redone;

[0022] S5. Simulate the trajectory of the corrected anime video and render it into a coherent anime video.

[0023] Further, in S4, when there is a deviation value in the trajectory record of a certain frame, first redraw the two frames before and after the trajectory record L1 and the two frames before and after the trajectory record L2 when the deviation value appears, and use an external software to reshape the trajectory information of the two frames before and after through the simulation action.

[0024] Advantages of the present invention:

[0025] 1. Through the mutual cooperation of the optical motion capture module and the inertial motion capture module, the present invention improves the accuracy of the action trajectory of the acting character during the performance action, and more intuitively reflects the performance authenticity.

[0026] 2. The present invention uses the action correction module for correction. For the abnormal action trajectories of the trajectory points simultaneously captured by the optical motion capture module and the inertial motion capture module, the built-in system can be used for correction, improving the correction accuracy performance and also improving the correction efficiency. Description of the Drawings

[0027] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art.

[0028] Figure 1 It is the overall process schematic diagram of the embodiment of the present invention. Detailed Embodiments

[0029] The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0030] As Figure 1 shown, an embodiment of the present invention provides an optical / inertial motion capture system, including an optical motion capture module, an inertial motion capture module, a motion correction module, and a simulation model making module;

[0031] A plurality of groups of sensing components are arranged at the joint positions of the acting person, and then placed in an imaging environment. The acting person performs action performances within a unit time, constructs data with a multi-dimensional model for the space where the sensing components are located, and at the same time adds the actual coordinates of the scene and configures corresponding parameters;

[0032] Optical motion capture module: Collect and mark the positions of a plurality of groups of sensing components located on the acting person through an optical imaging device, record the marked points on a multi-dimensional simulation software, and in one action session of the acting person, as the sensing components of the acting person move, the trajectory of each group of sensing components generates an independent trajectory record L1 on the corresponding multi-dimensional simulation software; The optical motion capture module records the position of the action session by frame recording within a unit time (of course, according to needs, it can also be recorded every 2 frames or every 3 frames, and the recording can be adjusted according to the action difficulty of the acting person).

[0033] At the same time, when the optical motion capture module captures the trajectory of the sensing components, the motion trajectories of each group of sensing components can be selectively hidden or displayed, which is convenient for individually editing or comparing each trajectory line. When an abnormality occurs in a certain frame of the motion of one of the trajectories, it can be discovered in time to avoid affecting the judgment of the overall trajectory.

[0034] The infrared band of the infrared light source added to the optical motion capture module is 940-950nm. Using this band can receive specific sensing components and avoid the influence of ambient light on the judgment of the trajectory operation after being captured. And according to needs, after the optical motion capture module collects the motion trajectory points of the sensing components, gray processing is performed. After gray processing, the pixel sampling of the trajectory points can be reduced, which can improve the calculation accuracy and operation speed of the collected motion trajectory, and set an image gray threshold to record the trajectory record L1 for the motion trajectory points of the sensing components that meet the image gray threshold.

[0035] Inertial motion capture module: Synchronously record the motion trajectory of the position where the sensing components are located, and mark the position recorded by the sensing components themselves as the trajectory record L2.

[0036] Motion correction module: Generate an animation video once for all the trajectory records L1 of the sensing components in one action session, and generate an animation video once for the trajectory records L2 generated by the movement of the sensing components themselves. Calculate and compare the position deviation between the trajectory record L1 and the trajectory record L2 of each group of sensing components. If the deviation value is within the preset threshold M1, it passes the qualification. When the deviation value exceeds the preset value M1 range, the simulation action drawing of this action is redone.

[0037] Simulation model making module: Simulate and render the animation video trajectory of the motion correction.

[0038] A method based on an optical / inertial motion capture system includes the following steps:

[0039] S1. First, establish a three-dimensional coordinate system scene within a specified area range, and then place the action figure attached with multiple groups of sensing components into the established three-dimensional coordinate system scene; the action figure in the three-dimensional coordinate system can locate the coordinates of the sensing components in real time, reducing the deviation of the actual acquisition of the coordinates of the sensing components.

[0040] S2. Subsequently, collect and mark the positions of multiple groups of sensing components located on the action figure through an optical imaging device, record the marked points on the multi-dimensional simulation software, and in one action session of the action figure, as the sensing components on the action figure move, the trajectory of each group of sensing components generates an independent trajectory record L1 once on the corresponding multi-dimensional simulation software.

[0041] S3. According to the action figure placed in the three-dimensional left coordinate system scene, synchronously record the motion trajectory of the position of the sensing components, and mark the position recorded by the sensing components themselves as the trajectory record L2.

[0042] S4. Calculate and compare the position deviation between the trajectory record L1 and the trajectory record L2 of each group of sensing components. If the deviation value is within the preset threshold M1, it passes the qualification. When the deviation value exceeds the preset value M1 range, the simulation action drawing of this action is redone; for a frame where the deviation value appears in the trajectory record, first redraw the two frames before and after the trajectory record L1 and the two frames before and after the trajectory record L2 when the deviation value appears, and use an external software to reshape the trajectory information of the two frames through the simulation action.

[0043] S5. Simulate and render the animation video trajectory of the motion correction to form a coherent animation video.

[0044] In the present invention, through the mutual cooperation of the optical motion capture module and the inertial motion capture module, the accuracy of the motion trajectory of the action figure during the performance of actions is improved, and the authenticity of the performance is more intuitively reflected.

[0045] At the same time, the motion correction module is used for correction. For abnormal motion trajectories, the built-in system can be used for correction, improving the accuracy and efficiency of correction.

[0046] The foregoing has shown and described the basic principles, main features and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited by the above embodiments. The above embodiments and the descriptions in the specification are only used to illustrate the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention will have various changes and improvements, and all these changes and improvements fall within the scope of the present invention claimed.

Claims

1. An optical / inertial motion capture system, characterized in that, It includes an optical motion capture module, an inertial motion capture module, a motion correction module, and a simulation model making module; Multiple groups of sensing components are set at the joint positions of the acting person, and then placed in the imaging environment. The acting person performs actions within a unit time, constructs data with a multi-dimensional model for the space where the sensing components are located, adds the actual coordinates of the scene, and configures corresponding parameters; The optical motion capture module: Collects and marks the positions of multiple groups of sensing components located on the acting person through an optical imaging device, records the marked points on multi-dimensional simulation software, and in one action segment of the acting person, as the sensing components of the acting person move, the trajectory of each group of sensing components generates an independent trajectory record L1 on the corresponding multi-dimensional simulation software; The inertial motion capture module: Synchronously records the motion trajectory of the position where the sensing components are located, and marks the position recorded by the sensing components themselves as the trajectory record L2; The motion correction module: Generates an animation video once for all the trajectory records L1 of the sensing components in one action segment, and also generates an animation video once for the trajectory record L2 generated by the movement of the sensing components themselves. Calculates and compares the position deviation between the trajectory record L1 and the trajectory record L2 of each group of sensing components. If the deviation value is within the preset threshold M1 range, it passes the qualification. When the deviation value exceeds the preset value M1 range, the simulation action drawing of this action is redone; The simulation model making module: Simulates and renders the animation video trajectory of the motion correction.

2. The optical / inertial motion capture system according to claim 1, wherein The optical motion capture module records the position positioning of the action segment by using a per-frame recording method within a unit time.

3. The optical / inertial motion capture system according to claim 1, wherein When the optical motion capture module records the trajectory of the sensing components, the motion trajectory of each group of sensing components is selectively hidden or shown.

4. The optical / inertial motion capture system according to claim 1, characterized in that, The infrared band of the infrared light source added in the optical motion capture module is 940 - 950 nm.

5. The optical / inertial motion capture system according to claim 1, characterized in that, After the optical motion capture module collects the motion trajectory points of the sensing components, it performs grayscale processing, sets an image grayscale threshold, and records the trajectory of the sensing component motion trajectory points that meet the image grayscale threshold as the trajectory record L1.

6. The method based on the optical / inertial motion capture system according to any one of claims 1-5, characterized in that, It includes the following steps: S1. First, establish a three-dimensional coordinate system scene within a specified area range, and then place the acting person attached with multiple groups of sensing components in the established three-dimensional coordinate system scene; S2. Subsequently, collect and mark the positions of multiple groups of sensing components located on the acting person through an optical imaging device, record the marked points on multi-dimensional simulation software, and in one action segment of the acting person, as the sensing components on the acting person move, the trajectory of each group of sensing components generates an independent trajectory record L1 on the corresponding multi-dimensional simulation software; S3. According to the acting person placed in the three-dimensional left coordinate system scene, synchronously record the motion trajectory of the position where the sensing components are located, and mark the position recorded by the sensing components themselves as the trajectory record L2; S4. Calculate and compare the position deviation between the trajectory records L1 and L2 of each group of sensing components. If the deviation value is within the preset threshold M1, it passes the qualification. If the deviation value exceeds the preset range of M1, the simulation action drawing of this action is redone. S5. Perform a simulation of the corrected anime video trajectory and render it into a coherent anime video.

7. The method based on the optical / inertial motion capture system according to claim 6, characterized in that, In S4, when there is a deviation value in the trajectory record for a certain frame, first redraw the two frames before and after the trajectory record L1 and the two frames before and after the trajectory record L2 when the deviation value appears. Use an external software to reshape the trajectory information of the two frames before and after through the simulation action.

Images