Reference camera device and system based on motion capture system

Abstract

The invention discloses a reference camera device and system based on a motion capture system, and the device comprises a camera connection module which is used for building the signal connection between a reference camera and the motion capture system, and outputting a successful connection result of the reference camera after the successful connection; the synchronous calibration module is used for synchronously calibrating the reference camera and the motion capture camera and outputting a calibration success result after calibration succeeds; the projection module is used for projecting the to-be-measured object in the three-dimensional space to the reference camera for two-dimensional display to obtain virtual scene information; the virtual-real superposition module is used for superposing the virtual scene information and an image actually shot by the reference camera to judge whether the motion capture effect is correct or not, and if the motion capture effect is correct, outputting a motion capture effect correct result; and the data recording module is used for judging whether a recording button in the motion capture system is clicked or not, and if the recording button is clicked, recording to obtain recorded video data information and caching the recorded video data information. The method has the effect of improving the accuracy of virtual and real scene comparison during shooting of the reference camera based on the motion capture system.

Description

Technical Field

[0001] The present application relates to the field of motion capture technology, and in particular to a reference camera device and system based on a motion capture system. Background Art

[0002] At present, motion capture is widely used in film and television animation, games and other fields, which has profoundly changed people's understanding and creation of the virtual world. With the growing demand for motion capture technology in these fields, people's demand for comparing virtual motion capture data with real scenes in the process of recording motion capture data is also increasing accordingly. Therefore, a reference camera based on the motion capture system for comparing virtual motion capture data with real scenes is crucial.

[0003] The existing reference camera based on the motion capture system for comparing virtual motion capture data with real scenes is one or more ordinary USB video cameras. While recording the motion capture data, the actual scene is recorded through OBS or other screen recording software. However, the accuracy of the existing reference camera based on the motion capture system for comparing virtual motion capture data with real scenes is low, and there is room for improvement. Summary of the invention

[0004] In order to improve the accuracy of the comparison between virtual and real scenes when shooting with a reference camera based on a motion capture system, the present application provides a reference camera device and system based on a motion capture system.

[0005] In a first aspect, the present application provides a reference camera system based on a motion capture system, which adopts the following technical solution: A reference camera system based on a motion capture system, comprising: Camera connection module: used to establish a signal connection link between the reference camera and the motion capture system, and output a successful reference camera connection result after the connection is successful; Synchronous calibration module: after receiving the successful connection result of the reference camera, the reference camera and the motion capture camera are synchronously calibrated, and the calibration success result is output after the calibration is successful; Projection module: after receiving the successful calibration result, the object to be measured in the three-dimensional space is projected onto the reference camera for two-dimensional display to obtain virtual scene information; Virtual-reality overlay module: Overlays the virtual scene information with the image actually taken by the reference camera to determine whether the motion capture effect is correct. If the motion capture effect is correct, the correct result of the motion capture effect is output; Data recording module: After receiving the correct result of the motion capture effect, it determines whether the recording button in the motion capture system is clicked. If it is clicked, it records the recorded video data information and performs cache processing.

[0006] Preferably, the motion capture system includes a plurality of motion capture cameras, a switch and a data processing device; Detect the IP address of the reference camera to obtain the camera IP address information, and detect the IP address of the data processing device to obtain the device IP address information; Insert the reference camera into the switch interface to establish a signal connection link between the reference camera and the switch; The camera IP address information is adjusted based on the device IP address information to obtain the camera IP modification address information until the reference camera and the data processing device are adjusted to the same network segment; Access the camera IP to modify the address information and detect whether the data processing device can view the shooting view of the reference camera. If the shooting view of the reference camera can be viewed, the reference camera is connected successfully and the reference camera connection success result is output.

[0007] Preferably, after receiving the successful connection result of the reference camera, the motion capture system further includes a calibration button, detecting whether the calibration button is pressed, and outputting a calibration signal if the calibration button is pressed; When the calibration signal is received, the reference camera mode is adjusted based on the filter, wherein the reference camera mode includes a video camera mode and an infrared camera mode, that is, when the calibration signal is received, the video camera mode is switched to the infrared camera mode; The active light on the calibration rod in the motion capture system emits light to the infrared light emitting device; The active light of the marking point on the calibration rod is captured simultaneously based on the reference camera and the motion capture camera, and the marking point is positioned based on the captured light to obtain the position information of the marking point; Calculating the parameters of a reference camera based on the calibration algorithm and the marker point position information to obtain reference camera parameter information, wherein the reference camera parameter information includes reference camera focal length information, reference camera optical center information, reference camera position information, and reference camera direction information; calculating the parameters of a motion capture camera based on the calibration algorithm and the marker point position information to obtain motion capture camera parameter information, wherein the motion capture camera parameter information includes motion capture camera focal length information, motion capture camera optical center information, motion capture camera position information, and motion capture camera direction information; According to the reference camera parameter information and the motion capture camera parameter information, the reprojection error information of the reference camera and the motion capture camera is calculated based on the back projection algorithm, and the reprojection error information is compared with a preset reprojection error threshold. If the reprojection error information is less than the preset reprojection error threshold, a calibration success result is output; After receiving the calibration success signal, the reference camera mode is switched, that is, the infrared camera mode of the reference camera is switched to the video camera mode.

[0008] Preferably, the three-dimensional coordinates of the object to be measured in the three-dimensional space are detected to obtain the three-dimensional coordinates of the object; The focal length fx and the focal length fy are obtained based on the focal length information of the reference camera, and the principal point coordinates (cx, cy) are obtained based on the optical center information of the reference camera; Obtaining reference camera view window length and width information, wherein the reference camera view window length and width information includes reference camera view window length information H and reference camera view window width information W; Detect the distance between the reference camera and the far clipping plane to obtain the far clipping plane distance F, and detect the distance between the reference camera and the near clipping plane to obtain the near clipping plane distance N; The perspective projection matrix is ​​calculated based on the focal length fx, the focal length fy, the principal point coordinates (cx, cy), the reference camera view window length information H, the reference camera view window width information W, the far clipping plane distance F, and the near clipping plane distance N; The two-dimensional camera view coordinates are calculated based on the three-dimensional coordinates of the object and the perspective projection matrix; Based on the two-dimensional camera view coordinates, the object to be measured is displayed in the view of the reference camera to obtain virtual scene information.

[0009] Preferably, according to the focal length fx, the focal length fy, the principal point coordinates (cx, cy), the reference camera view window length information H, the reference camera view window width information W, the far clipping plane distance F and the near clipping plane distance N, the perspective projection matrix is: .

[0010] Preferably, the display effect types of the reference camera include projection virtual display, real shooting display and 3D overlay display; The object to be measured is photographed based on the reference camera to obtain real photographed image information; Adjust the display effect type of the reference camera to 3D overlay display, overlay the virtual scene information with the real shot image information, and determine whether the motion capture effect of the object to be tested is correct; If the virtual scene information and the real shot image information overlap when superimposed, the motion capture state of the object to be measured is correct, and the correct motion capture effect result is output; If the virtual scene information and the real shot image information do not overlap when superimposed, the motion capture state of the object to be measured is incorrect. In this case, the object to be measured is adjusted or the reference camera is recalibrated until the virtual scene information and the real shot image information overlap when superimposed, and the correct motion capture effect result is output.

[0011] Preferably, after receiving the correct result of the motion capture effect, it is detected whether the recording button in the motion capture system is clicked, and then the recording start result is output; After receiving the recording start result, recording the real shot image information to obtain recorded video data information; The recorded video data information is cached and can be played back and exported.

[0012] In a second aspect, the present application provides a reference camera device based on a motion capture system, which is applied to the reference camera system based on a motion capture system of the present application.

[0013] In summary, the present application includes at least one of the following beneficial technical effects: 1. By detecting whether the calibration button is pressed, if it is pressed, the camera reference mode is adjusted based on the filter, that is, the video camera mode of the reference camera is switched to the infrared camera mode, so as to shield the abnormal reflective points in the venue, thereby improving the calibration accuracy of the reference camera. The active light of the marking point on the calibration rod is captured by the reference camera and the motion capture camera at the same time, and the marking point is located to obtain the position information of the marking point. The marking point position information is analyzed according to the calibration algorithm to obtain the reference camera parameter information and the motion capture camera parameter information. The reprojection error information is obtained according to the reference camera parameter information and the motion capture camera parameter information. Whether the calibration is successful is determined according to the reprojection error information, thereby further improving the calibration accuracy of the reference camera. 2. By detecting the three-dimensional coordinates of the object to be measured in the three-dimensional space, the three-dimensional coordinates of the object are obtained, the reference camera view window length information H and the reference camera view window width information W are obtained, the far clipping plane distance F and the near clipping plane distance N are detected, and the perspective projection matrix is ​​calculated according to the focal length fx, the focal length fy, the principal point coordinates (cx, cy), the reference camera view window length information H, the reference camera view window width information W, the far clipping plane distance F and the near clipping plane distance N. The two-dimensional coordinates of the object in the computer view, namely the two-dimensional camera view coordinates, are obtained by multiplying the three-dimensional coordinates of the object with the perspective projection matrix, and the virtual scene is displayed according to the two-dimensional camera view coordinates, thereby realizing the function of converting the three-dimensional virtual scene in the space into the two-dimensional camera view; 3. Use the reference camera to shoot the object to be tested to obtain real shooting image information, superimpose the virtual scene information with the real shooting image information, and judge whether the motion capture effect of the object to be tested is correct. If the virtual scene information and the real shooting image information coincide when superimposed, the motion capture state of the object to be tested is correct, and the correct motion capture effect result is output. If the virtual scene information and the real shooting image information do not coincide when superimposed, the object to be tested is adjusted or the reference camera is recalibrated until the virtual scene information coincides with the real shooting image information when superimposed, thereby improving the accuracy of the comparison between virtual and real scenes when shooting with the reference camera based on the motion capture system. When the accuracy of the comparison between virtual and real scenes when shooting with the reference camera based on the motion capture system is low, real-time adjustment can be performed, thereby further improving the accuracy of the comparison between virtual and real scenes when shooting with the reference camera based on the motion capture system. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 This is a schematic diagram of the modules of a reference camera system based on a motion capture system, which is mainly embodied in this embodiment.

[0015] Figure numerals: 1. Camera connection module; 2. Synchronous calibration module; 3. Projection module; 4. Virtual-real superposition module; 5. Data recording module. DETAILED DESCRIPTION

[0016] The present application is further described in detail below in conjunction with the accompanying drawings.

[0017] An embodiment of the present application discloses a reference camera system based on a motion capture system.

[0018] Reference Figure 1 , a reference camera system based on a motion capture system, including a camera connection module, a synchronization calibration module, a projection module, a virtual-reality superposition module and a data recording module.

[0019] Camera connection module: used to establish a signal connection link between the reference camera and the motion capture system, and output the reference camera connection success result after the connection is successful.

[0020] The specific implementation of the camera connection module is as follows: The motion capture system includes a plurality of motion capture cameras, a switch and a data processing device.

[0021] The IP address of the reference camera is detected to obtain the camera IP address information, and the IP address of the data processing device is detected to obtain the device IP address information.

[0022] Insert the reference camera into the switch interface to establish a signal connection link between the reference camera and the switch.

[0023] The camera IP address information is adjusted based on the device IP address information to obtain the camera IP modification address information until the reference camera and the data processing device are adjusted to the same network segment.

[0024] Access the camera IP to modify the address information and detect whether the data processing device can view the shooting view of the reference camera. If the shooting view of the reference camera can be viewed, the reference camera is connected successfully and the reference camera connection success result is output.

[0025] In specific applications, by inserting the reference camera into the switch interface, the camera IP address information is adjusted based on the device IP address information to obtain the camera IP modification address information, until the reference camera and the data processing device are in the same network segment, the camera IP modification address information is accessed to detect whether the data processing device can view the shooting view of the reference camera. If so, the reference camera is successfully connected, thereby improving the accuracy of the reference camera connection detection.

[0026] Synchronous calibration module: After receiving the successful connection result of the reference camera, the reference camera and the motion capture camera are synchronously calibrated, and the calibration success result is output after the calibration is successful.

[0027] The specific implementation of the synchronous calibration module is as follows: After receiving the successful connection result of the reference camera, the motion capture system also includes a calibration button to detect whether the calibration button is pressed, and output a calibration signal if the calibration button is pressed.

[0028] When the calibration signal is received, the reference camera mode is adjusted based on the filter, and the reference camera mode includes a video camera mode and an infrared camera mode. That is, when the calibration signal is received, the video camera mode is switched to the infrared camera mode.

[0029] In specific applications, switching the video camera to infrared camera mode facilitates shielding of abnormal reflective points in the venue, reducing the impact of abnormal reflective points in the venue on the calibration process when the reference camera is calibrated, thereby performing accurate calibration and facilitating improving the shooting accuracy of subsequent reference cameras for virtual scenes and real scenes.

[0030] The active light on the calibration rod in the motion capture system emits light to the infrared light emitting device.

[0031] The active light of the marking point on the calibration rod is captured simultaneously based on the reference camera and the motion capture camera, and the marking point is located based on the captured light to obtain the position information of the marking point.

[0032] Based on the calibration algorithm and the marker point position information, the parameters of the reference camera are calculated to obtain the reference camera parameter information, wherein the reference camera parameter information includes the reference camera focal length information, the reference camera optical center information, the reference camera position information and the reference camera direction information. Based on the calibration algorithm and the marker point position information, the parameters of the motion capture camera are calculated to obtain the motion capture camera parameter information, wherein the motion capture camera parameter information includes the motion capture camera focal length information, the motion capture camera optical center information, the motion capture camera position information and the motion capture camera direction information.

[0033] According to the reference camera parameter information and the motion capture camera parameter information, the reprojection error information of the reference camera and the motion capture camera is calculated respectively based on the back projection algorithm, and the reprojection error information is compared with the preset reprojection error threshold. If the reprojection error information is less than the preset reprojection error threshold, the calibration success result is output.

[0034] After receiving the calibration success signal, the reference camera mode is switched, that is, the infrared camera mode of the reference camera is switched to the video camera mode.

[0035] In specific applications, by detecting whether the calibration button is pressed, if it is pressed, the camera reference mode is adjusted based on the filter, that is, the video camera mode of the reference camera is switched to the infrared camera mode, so as to shield abnormal reflective points in the venue, thereby improving the calibration accuracy of the reference camera. The active light of the marking point on the calibration rod is captured by the reference camera and the motion capture camera at the same time, and the marking point is located to obtain the position information of the marking point. The marking point position information is analyzed according to the calibration algorithm to obtain the reference camera parameter information and the motion capture camera parameter information. The reprojection error information is obtained according to the reference camera parameter information and the motion capture camera parameter information. Whether the calibration is successful is determined according to the reprojection error information, thereby further improving the calibration accuracy of the reference camera.

[0036] Projection module: After receiving the successful calibration result, the object to be measured in the three-dimensional space is projected onto the reference camera for two-dimensional display to obtain virtual scene information.

[0037] The specific implementation of the projection module is as follows: The three-dimensional coordinates of the object to be measured in the three-dimensional space are detected to obtain the three-dimensional coordinates of the object.

[0038] The focal length fx and the focal length fy are obtained based on the focal length information of the reference camera, and the principal point coordinates (cx, cy) are obtained based on the optical center information of the reference camera.

[0039] The reference camera view window length and width information is obtained, where the reference camera view window length and width information includes reference camera view window length information H and reference camera view window width information W.

[0040] The distance between the reference camera and the far clipping plane is detected to obtain the far clipping plane distance F, and the distance between the reference camera and the near clipping plane is detected to obtain the near clipping plane distance N.

[0041] The perspective projection matrix is ​​calculated based on the focal length fx, focal length fy, principal point coordinates (cx, cy), reference camera view window length information H, reference camera view window width information W, far clipping plane distance F, and near clipping plane distance N.

[0042] It should be noted that in the embodiment of the present application, after obtaining the focal length fx, the focal length fy, the principal point coordinates (cx, cy), the reference camera view window length information H, the reference camera view window width information W, the far clipping plane distance F, and the near clipping plane distance N, the perspective projection matrix is ​​calculated, where the perspective projection matrix is .

[0043] The two-dimensional camera view coordinates are obtained by multiplying the three-dimensional coordinates of the object and the perspective projection matrix.

[0044] Based on the two-dimensional camera view coordinates, the object to be measured is displayed in the view of the reference camera to obtain virtual scene information.

[0045] In specific application, the three-dimensional coordinates of the object to be measured in the three-dimensional space are obtained by detecting the three-dimensional coordinates of the object, the reference camera view window length information H and the reference camera view window width information W are obtained, the far clipping plane distance F and the near clipping plane distance N are detected, and the perspective projection matrix is ​​calculated according to the focal length fx, the focal length fy, the principal point coordinates (cx, cy), the reference camera view window length information H, the reference camera view window width information W, the far clipping plane distance F and the near clipping plane distance N. The two-dimensional coordinates of the object in the computer view, namely the two-dimensional camera view coordinates, are obtained by multiplying the three-dimensional coordinates of the object with the perspective projection matrix, and the virtual scene is displayed according to the two-dimensional camera view coordinates, thereby realizing the function of converting the three-dimensional virtual scene in the space into a two-dimensional camera view.

[0046] Virtual-reality overlay module: Overlays the virtual scene information with the image actually taken by the reference camera to determine whether the motion capture effect is correct. If the motion capture effect is correct, the correct result of the motion capture effect is output.

[0047] Among them, the specific implementation method of the virtual-real superposition module is as follows: The display effect types of the reference camera include projected virtual display, real shooting display and 3D overlay display.

[0048] The object to be measured is photographed based on the reference camera to obtain the real photographed image information.

[0049] Adjust the display effect type setting of the reference camera to 3D overlay display, overlay the virtual scene information with the real shot image information, and determine whether the motion capture effect of the object to be tested is correct.

[0050] If the virtual scene information and the real shot image information overlap when superimposed, the motion capture state of the object to be measured is correct, and the correct motion capture effect result is output.

[0051] If the virtual scene information and the real shot image information do not overlap when superimposed, the motion capture state of the object to be measured is incorrect. In this case, the object to be measured is adjusted or the reference camera is recalibrated until the virtual scene information and the real shot image information overlap when superimposed, and the correct motion capture effect result is output.

[0052] In specific applications, the object to be tested is photographed by a reference camera to obtain real shooting image information, the virtual scene information is superimposed with the real shooting image information, and it is determined whether the motion capture effect of the object to be tested is correct; if the virtual scene information and the real shooting image information coincide when superimposed, the motion capture state of the object to be tested is correct, and the correct motion capture effect result is output; if the virtual scene information and the real shooting image information do not coincide when superimposed, the object to be tested is adjusted or the reference camera is recalibrated until the virtual scene information coincides with the real shooting image information when superimposed, thereby improving the accuracy of the comparison between virtual and real scenes when the reference camera based on the motion capture system is shooting; when the accuracy of the comparison between virtual and real scenes when the reference camera based on the motion capture system is low, real-time adjustments can be made, thereby further improving the accuracy of the comparison between virtual and real scenes when the reference camera based on the motion capture system is shooting.

[0053] Data recording module: After receiving the correct result of the motion capture effect, it determines whether the recording button in the motion capture system is clicked. If it is clicked, it records the recorded video data information and performs cache processing.

[0054] The specific implementation of the data recording module is as follows: After receiving the correct result of the motion capture effect, it is detected whether the recording button in the motion capture system is clicked, and the recording start result is output.

[0055] After receiving the recording start result, the real shot image information is recorded to obtain recorded video data information.

[0056] The recorded video data information is cached and can be played back and exported.

[0057] An embodiment of the present application further discloses a reference camera device based on a motion capture system, wherein the reference camera device based on a motion capture system is applied to a reference camera system based on a motion capture system.

[0058] The above are all preferred embodiments of the present application, and the protection scope of the present application is not limited thereto. Therefore, any equivalent changes made according to the structure, shape, and principle of the present application should be included in the protection scope of the present application.

Claims

1. A reference camera system based on a motion capture system, characterized in that: include: Camera connection module: used to establish a signal connection link between the reference camera and the motion capture system, and output a successful reference camera connection result after the connection is successful; Synchronous calibration module: after receiving the successful connection result of the reference camera, the reference camera and the motion capture camera are synchronously calibrated, and the calibration success result is output after the calibration is successful; Projection module: after receiving the successful calibration result, the object to be measured in the three-dimensional space is projected onto the reference camera for two-dimensional display to obtain virtual scene information; Virtual-reality overlay module: Overlays the virtual scene information with the image actually taken by the reference camera to determine whether the motion capture effect is correct. If the motion capture effect is correct, the correct result of the motion capture effect is output; Data recording module: After receiving the correct result of the motion capture effect, it determines whether the recording button in the motion capture system is clicked. If it is clicked, it records the recorded video data information and performs cache processing.

2. A reference camera system based on a motion capture system according to claim 1, characterized in that: The specific implementation method of the camera connection module is as follows: The motion capture system includes a plurality of motion capture cameras, a switch and a data processing device; Detect the IP address of the reference camera to obtain the camera IP address information, and detect the IP address of the data processing device to obtain the device IP address information; Insert the reference camera into the switch interface to establish a signal connection link between the reference camera and the switch; The camera IP address information is adjusted based on the device IP address information to obtain the camera IP modification address information until the reference camera and the data processing device are adjusted to the same network segment; Access the camera IP to modify the address information and detect whether the data processing device can view the shooting view of the reference camera. If the shooting view of the reference camera can be viewed, the reference camera is connected successfully and the reference camera connection success result is output.

3. The reference camera system based on the motion capture system according to claim 2, characterized in that: The specific implementation method of the synchronous calibration module is as follows: After receiving the successful connection result of the reference camera, the motion capture system further includes a calibration button, detecting whether the calibration button is pressed, and outputting a calibration signal if the calibration button is pressed; When the calibration signal is received, the reference camera mode is adjusted based on the filter, wherein the reference camera mode includes a video camera mode and an infrared camera mode, that is, when the calibration signal is received, the video camera mode is switched to the infrared camera mode; The active light on the calibration rod in the motion capture system emits light to the infrared light emitting device; The active light of the marking point on the calibration rod is captured simultaneously based on the reference camera and the motion capture camera, and the marking point is positioned based on the captured light to obtain the position information of the marking point; Calculating the parameters of a reference camera based on the calibration algorithm and the marker point position information to obtain reference camera parameter information, wherein the reference camera parameter information includes reference camera focal length information, reference camera optical center information, reference camera position information, and reference camera direction information; calculating the parameters of a motion capture camera based on the calibration algorithm and the marker point position information to obtain motion capture camera parameter information, wherein the motion capture camera parameter information includes motion capture camera focal length information, motion capture camera optical center information, motion capture camera position information, and motion capture camera direction information; According to the reference camera parameter information and the motion capture camera parameter information, the reprojection error information of the reference camera and the motion capture camera is calculated based on the back projection algorithm, and the reprojection error information is compared with a preset reprojection error threshold. If the reprojection error information is less than the preset reprojection error threshold, a calibration success result is output; After receiving the calibration success signal, the reference camera mode is switched, that is, the infrared camera mode of the reference camera is switched to the video camera mode.

4. The reference camera system based on the motion capture system according to claim 3, characterized in that: The specific implementation of the projection module is as follows: Detecting the three-dimensional coordinates of the object to be measured in the three-dimensional space to obtain the three-dimensional coordinates of the object; The focal length fx and the focal length fy are obtained based on the focal length information of the reference camera, and the principal point coordinates (cx, cy) are obtained based on the optical center information of the reference camera; Obtaining reference camera view window length and width information, wherein the reference camera view window length and width information includes reference camera view window length information H and reference camera view window width information W; Detect the distance between the reference camera and the far clipping plane to obtain the far clipping plane distance F, and detect the distance between the reference camera and the near clipping plane to obtain the near clipping plane distance N; The perspective projection matrix is ​​calculated based on the focal length fx, the focal length fy, the principal point coordinates (cx, cy), the reference camera view window length information H, the reference camera view window width information W, the far clipping plane distance F, and the near clipping plane distance N; The two-dimensional camera view coordinates are calculated based on the three-dimensional coordinates of the object and the perspective projection matrix; Based on the two-dimensional camera view coordinates, the object to be measured is displayed in the view of the reference camera to obtain virtual scene information.

5. The reference camera system based on the motion capture system according to claim 4, characterized in that: The step of calculating the perspective projection matrix based on the focal length fx, the focal length fy, the principal point coordinates (cx, cy), the reference camera view window length information H, the reference camera view window width information W, the far clipping plane distance F, and the near clipping plane distance N specifically includes: According to the focal length fx, focal length fy, principal point coordinates (cx, cy), reference camera view window length information H, reference camera view window width information W, far clipping plane distance F and near clipping plane distance N, the perspective projection matrix is 。 6. The reference camera system based on the motion capture system according to claim 5, characterized in that: The specific implementation method of the virtual-real superposition module is as follows: The display effect types of the reference camera include projection virtual display, real shooting display and 3D overlay display; The object to be measured is photographed based on the reference camera to obtain real photographed image information; Adjust the display effect type of the reference camera to 3D overlay display, overlay the virtual scene information with the real shot image information, and determine whether the motion capture effect of the object to be tested is correct; If the virtual scene information and the real shot image information overlap when superimposed, the motion capture state of the object to be measured is correct, and the correct motion capture effect result is output; If the virtual scene information and the real shot image information do not overlap when superimposed, the motion capture state of the object to be measured is incorrect. In this case, the object to be measured is adjusted or the reference camera is recalibrated until the virtual scene information and the real shot image information overlap when superimposed, and the correct motion capture effect result is output.

7. The reference camera system based on the motion capture system according to claim 6, characterized in that: The specific implementation method of the data recording module is as follows: After receiving the correct result of the motion capture effect, detecting whether the recording button in the motion capture system is clicked, and outputting the recording start result; After receiving the recording start result, recording the real shot image information to obtain recorded video data information; The recorded video data information is cached and can be played back and exported.

8. A reference camera device based on a motion capture system, characterized in that: The reference camera device based on the motion capture system comprises the reference camera system based on the motion capture system as claimed in any one of claims 1-7.

Images