High-speed three-dimensional data generation system

The high-speed three-dimensional data generation system addresses the challenge of capturing ultra-high-speed object dynamics by using pattern projection and synchronized high-speed cameras with parallel synchronization, achieving precise, high-resolution data for airbag analysis.

JP2024167792APending Publication Date: 2024-12-04PHOTRON
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023084117
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-22
Publication Date
2024-12-04

AI Technical Summary

Technical Problem

Existing technologies struggle to capture the dynamics of objects moving at ultra-high speeds and objects changing shape in an extremely short period of time with high precision and high time resolution, particularly in volumetric capture and ultra-high-speed imaging.

Method used

A high-speed three-dimensional data generation system utilizing a projector to project patterns onto objects, combined with high-speed cameras and a signal generator for synchronization, enabling high-frame-rate data capture and reconstruction, and employing parallel synchronization signal distribution to minimize timing delays.

Benefits of technology

Enables precise, high-resolution capture and reconstruction of objects' dynamic changes from any direction and position, providing detailed data for airbag research and development.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024167792000001_ABST
    Figure 2024167792000001_ABST
Patent Text Reader

Abstract

To provide a high-speed three-dimensional data generation system which measures a dynamic phase of an object that moves at an ultra high speed, and moment-to-moment shape changes of the object whose shape changes in an extremely short time, for example an airbag that is expanding from arbitrary directions and positions with high precision and high temporal resolution.SOLUTION: A high-speed three-dimensional data generation system 1 comprises: at least one projector that projects patterns onto a surface of an object; multiple high-speed cameras which image the deformation or movement of the object onto which the patterns are projected from multiple directions at a high frame rate of 500 fps (frame per second) or more; and a high-speed three-dimensional data generation device equipped with a 3D data reconstruction function, a rendering function and a display control function being a generation unit which generates three-dimensional data of the object on the basis of the patterns included in the imaging data of the multiple high-speed cameras for each frame captured by the multiple high-speed cameras.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a high-speed three-dimensional data generation system. [Background technology]

[0002] In recent years, a technology called volumetric capture has become known as a field of imaging technology. Volumetric capture is a method of capturing or measuring a subject (i.e., the object being photographed) in 3D like a video. Data created by volumetric capture is called volumetric video.

[0003] In volumetric capture, a target object is photographed from multiple directions using multiple cameras, and a 3D video, i.e., a volumetric video, is generated by reconstructing the multiple videos collected by each camera using a specific processing method. Volumetric capture requires multiple cameras and a dedicated studio, so it has traditionally been used mostly for creating relatively large-scale entertainment content or content for watching sports such as basketball and soccer.

[0004] On the other hand, ultra-high-speed imaging technology using an ultra-high-speed camera is known as a field of imaging technology different from volumetric capture. For example, by imaging at an ultra-high frame rate of 500 to 10,000 fps (frames per second) or more, it becomes possible to observe or measure the movement of an object that cannot be seen with the naked eye. The ultra-high-speed imaging technology makes it possible to accurately measure the dynamics of an object that moves at ultra-high speed, or the behavior of an object whose shape or state changes in an extremely short time (for example, an airbag that is instantly inflated by gas generated by the explosion of a medicine). The ultra-high-speed imaging technology is being widely used, for example, in the fields of science and technology and quality control at manufacturing sites. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent Publication No. 2021-27487 Summary of the Invention [Problem to be solved by the invention]

[0006] One of the problems that the present invention aims to solve is to combine the above-mentioned volumetric capture with ultra-high-speed photography technology to make it possible to measure the dynamics of an object moving at ultra-high speed or an object whose shape changes in an extremely short period of time, such as the moment-to-moment shape changes of an airbag in the process of inflating, from any direction and any position with high accuracy and high time resolution. [Means for solving the problem]

[0007] One embodiment of a high-speed 3D data generation system includes at least one projector that projects a pattern onto a surface of an object, a plurality of high-speed cameras that capture images of the object with the pattern projected onto its surface deforming or moving from a plurality of directions at a high frame rate of 500 fps (frames per second) or more, and a generation unit that generates 3D data of the object for each frame captured by the plurality of high-speed cameras based on the pattern contained in the captured data of the plurality of high-speed cameras. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of the system configuration of a high-speed three-dimensional data generation system according to the present invention. [Diagram 2] 1 is a block diagram showing an example of the arrangement of a high-speed three-dimensional data generation device according to a first embodiment. [Diagram 3] 4 is a flowchart showing an example of the operation of the high-speed three-dimensional data generation system according to the first embodiment. [Figure 4] A diagram showing the operational concept of the high-speed 3D data generation system. [Diagram 5]FIG. 2 is a diagram for explaining a first problem of the high-speed three-dimensional data generation system according to the present invention. [Figure 6] FIG. 2 is a diagram for explaining a means for solving the first problem. [Figure 7] FIG. 11 is a diagram for explaining the means for solving the second problem of the high-speed three-dimensional data generation system according to the present invention, and is a diagram for explaining a first distribution method of a synchronization signal. [Figure 8] FIG. 13 is a diagram for explaining a second distribution method of a synchronization signal. [Figure 9] FIG. 2 is a diagram showing an example of 3D data obtained by photographing a vehicle airbag using the high-speed 3D data generation system of the present embodiment. [Figure 10] FIG. 11 is a block diagram showing an example of the arrangement of a high-speed three-dimensional data generation device according to a second embodiment. [Figure 11] 10 is a flowchart showing an example of the operation of the high-speed three-dimensional data generation system according to the second embodiment. [Figure 12] FIG. 11 is a first diagram showing the operation concept of the high-speed three-dimensional data generation system according to the second embodiment. [Figure 13] FIG. 2 is a second diagram showing the operation concept of the high-speed three-dimensional data generation system according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.

[0010] Fig. 1 is a diagram showing an example of a system configuration of a high-speed 3D data generation system 1 according to the present invention. As shown in Fig. 1, the high-speed 3D data generation system 1 is configured to include at least a high-speed 3D data generation device 10, a plurality of high-speed cameras 20, a projector 30, and a signal generator 40.

[0011] The high-speed 3D data generation system 1 of the present invention realizes a volumetric capture technology that can reconstruct 3D data at a high frame rate of 500 fps or more using image data captured by multiple high-speed cameras 20 that capture images at a high frame rate of 500 fps or more, and is also called an HSVC (High-Speed ​​Volumetric Capture) system.

[0012] 1 is a camera capable of shooting at a high frame rate of, for example, 500 fps or more, as described above. In this high-speed 3D data generation system 1, a plurality of high-speed cameras 20, for example, 40 or more high-speed cameras 20, are arranged around a subject, i.e., an object to be shot, and the object is shot from various directions. The high-speed cameras 20 are not only arranged over 360 degrees around the object in the horizontal direction, but are also arranged at different positions in the height direction (i.e., elevation angle direction), including, for example, a position directly above the object.

[0013] The projectors 30 are arranged around the object to be photographed in order to project a predetermined pattern, for example, a lattice pattern, onto the object. Although the number of projectors 30 may be one, it is preferable to arrange a plurality of projectors 30 at different positions in order to cover the surface of the object to be photographed without gaps. The reason for projecting a predetermined pattern onto the object to be photographed will be described later.

[0014] The signal generator 40 generates a synchronization signal to be distributed to each high-speed camera 20. For example, the signal generator 40 generates, as the synchronization signal, a clock signal having a frequency corresponding to the frame rate of the high-speed camera 20. A specific method of distributing the synchronization signal will also be described later.

[0015] The high-speed 3D data generation device 10 receives frame images, which are 2D images captured from multiple directions by each high-speed camera 20, from each high-speed camera 20 for each frame, and reconstructs the input frame images from multiple directions using a method such as a multi-view stereo method, thereby generating 3D data for each frame. The specific configuration and operation of the high-speed 3D data generation device 10 will be described below.

[0016] (First embodiment) Fig. 2 is a block diagram showing an example of the configuration of the high-speed 3D data generation device 10 of the first embodiment. As shown in Fig. 2, the high-speed 3D data generation device 10 is configured to include a processing circuit 100, a storage circuit 110, a user I / F (interface) 120, a display 130, and an input I / F 140. The high-speed 3D data generation device 10 may be configured as, for example, a personal computer or a workstation.

[0017] As described above, a plurality of high-speed cameras 20 are connected to the high-speed 3D data generator 10, and data of frame images captured at a high frame rate by each high-speed camera 20 is input. The data of these frame images is input to the processing circuit 100 via the input I / F 140.

[0018] The processing circuit 100 has a dedicated or general-purpose processor, and realizes various functions described later by software processing by executing a program stored in the storage circuit 110. The processing circuit 100 may be configured with hardware such as an application specific integration circuit (ASIC) or a programmable logic device such as a field programmable gate array (FPGA). The various functions described later can also be realized by hardware processing using these devices. Moreover, the processing circuit 100 may realize various functions described later by combining software processing and hardware processing.

[0019] The user I / F 120 includes an input device that can be operated by a user and an input circuit that inputs a signal from the input device. The input device can be realized by a trackball, a switch, a mouse, a keyboard, a touchpad that performs input operations by touching the operation surface, a touchscreen that combines a display screen and a touchpad, a non-contact input device that uses an optical sensor, a voice input device, etc.

[0020] The display 130 is configured by a general display output device such as a liquid crystal display or an OLED (Organic Light Emitting Diode) display.

[0021] The storage circuitry 110 stores various processing programs used in the processing circuitry 100, data necessary for executing the programs, and various images. The storage circuitry 110 includes a processor-readable storage medium, such as a magnetic or optical storage medium, or a semiconductor memory.

[0022] In addition to the above configuration, the high-speed 3D data generation device 10 may be provided with interface circuits for various electric communication lines, such as wired / wireless LAN, the Internet, public telephone lines, close-proximity wireless lines such as Bluetooth (registered trademark), etc. Also, it may be provided with interface circuits for storage media such as magnetic disks and optical disks, USB memories, various memory cards, etc.

[0023] 2, the processing circuitry 100 realizes various functions such as a 3D data reconstruction function F01, a rendering function F02, and a display control function F03. For example, the processing circuitry 100 realizes each of the above functions by executing a predetermined program stored in the storage circuitry 110.

[0024] Fig. 3 is a flowchart showing an example of the operation of the high-speed 3D data generation system 1 including the processing of each of the above-mentioned functions. Fig. 4 is a diagram showing the concept of the operation of the high-speed 3D data generation system 1. Below, the operation of the high-speed 3D data generation system 1 will be explained along the flowchart of Fig. 3 with reference to Fig. 4. Fig. 4 shows an example in which a rectangular parallelepiped object as a shooting target changes its size and orientation over time.

[0025] First, in step ST100, the projector 30 projects a predetermined pattern onto the object while the high-speed cameras 20 are synchronized to capture an image of the object.

[0026] In step ST101, frame images are acquired from each high-speed camera 20. As shown in the upper part of Fig. 4, each high-speed camera 20 (e.g., high-speed camera (1) to high-speed camera (N)) collects frame images (two-dimensional images) of an object captured from the position of the respective high-speed camera 20 for each frame time as time t progresses.

[0027] In the next step ST102, the two-dimensional images of each high-speed camera are reconstructed for each frame to generate three-dimensional data. More specifically, in step ST102, the 3D data reconstruction function F01 reconstructs frame images, which are two-dimensional images captured by each high-speed camera 20 from multiple directions, using a method such as a multi-view stereo method to generate three-dimensional data (i.e., volume data). Since each high-speed camera 20 outputs frame images at a high frame rate (for example, a frame rate of 500 fps or more), the generated three-dimensional data is also generated as time-series 3D data corresponding to a frame rate of 500 fps.

[0028] The lower part of Fig. 4 shows an example in which 3D data generated for each frame time is arranged in chronological order from t=t1 to t=tn. As described above, in the example shown in Fig. 4, 3D data of a rectangular parallelepiped whose size and orientation change is generated in response to a high frame rate of, for example, 500 fps or more.

[0029] In step ST103, the three-dimensional data is rendered based on the direction and position designated by the user, for example, to generate a rendered image. The processing in step ST103 is performed by the rendering function F02 of the processing circuit 100. The direction and position of the rendering may be designated by the user via the user I / F 120 such as a mouse, joystick, or touch panel, for example, or a processor in the processing circuit 100 may designate a change in the direction and position programmed in advance.

[0030] In the next step ST104, the generated rendering image is displayed on the display according to the designated playback speed. The process of step ST104 is performed, for example, by the display control function F03 of the processing circuit 100. By adjusting the playback speed, it is possible to play back the image as a super slow-motion video, or to change the playback speed to a value desired by the user.

[0031] FIG. 5 is a diagram for explaining a first problem specific to the high-speed three-dimensional data generation system 1 according to the present invention, and FIG. 6 is a diagram for explaining a means for solving the problem.

[0032] As described above, the high-speed 3D data generation system 1 of the present invention is a high-speed volumetric capture system that generates 3D data using frame images collected by high-speed shooting at a high frame rate of, for example, 500 fps or more. Therefore, as shown in the left column of Figure 5, the frame time of each frame image is short, and the exposure time is also short, so that the amount of exposure is reduced under normal lighting. Therefore, in order to avoid the reduction in the amount of exposure, multiple lights with higher brightness than normal are used.

[0033] On the other hand, there are many objects with plain surfaces, such as airbags used in vehicles, among the objects to be imaged. In particular, when the object to be imaged is a plain white surface or a metal object, a phenomenon called "whiteout" occurs when strong light is irradiated on these objects. In addition, in the area where "whiteout" occurs, gradation disappears. As a result, the pattern matching process between the frame images of the adjacent high-speed cameras, which is necessary in the multi-view stereo method, is not performed properly, and an abnormality occurs in the reconstruction process. For this reason, as shown in the upper right part of FIG. 5, the object is reconstructed as an abnormal shape that is significantly different from the shape of the original object.

[0034] Fig. 6 shows a solution adopted in the high-speed 3D data generation system 1 of the present invention to prevent such inconvenience. Specifically, as shown in Fig. 6, the high-speed 3D data generation system 1 of the present invention includes a plurality of projectors 30 arranged at different positions, and these projectors 30 project a predetermined pattern onto the object to be photographed. The type of pattern is not particularly limited, but for example, a grid pattern can be used.

[0035] Even if the object is a plain white object, by projecting such a pattern, it becomes possible to perform pattern matching processing using this pattern between adjacent frame images of a high-speed camera. As a result, it is possible to prevent the occurrence of the "bloated highlight" phenomenon even under high-intensity lighting, and to avoid the above-mentioned abnormality in the reconstruction processing.

[0036] 7 is a diagram for explaining a means for solving the second problem specific to the high-speed 3D data generation system 1 according to the present invention. In order to generate spatially smooth continuous 3D data from 2D camera images, it is advantageous to arrange a large number of cameras around the object to be photographed. For this reason, the high-speed 3D data generation system 1 according to the present invention uses, for example, about 40 high-speed cameras 20.

[0037] On the other hand, in general, volumetric capture technology that generates 3D video from 2D video requires synchronization between the frame images of each camera, and a method of delivering a common synchronization signal to each camera is used. In conventional volumetric capture for entertainment or sports, a serial delivery method (a delivery method called a daisy chain) is used to deliver synchronization signals to all cameras. When such a serial delivery method is used, a difference in delay time occurs between positions close to the source of the synchronization signal and positions far from it. However, in conventional volumetric capture, the frame rate is low at about 30 fps, so even if the delay time is not large, it does not pose much of a problem.

[0038] In contrast, the high-speed three-dimensional data generation system 1 of the present invention uses high-speed cameras 20 with a high frame rate of 500 fps or more. For this reason, in distributing the synchronization signal, it is necessary to keep the delay time as low as possible and minimize the difference in the timing of the synchronization signal between the high-speed cameras 20.

[0039] Therefore, in the first distribution method of the high-speed three-dimensional data generation system 1 of the present invention, as shown in FIG. 7, the high-speed cameras 20 are all divided into a number of groups (for example, N groups from group (1) to group (N)), and a synchronization signal is distributed in parallel from the signal generator 40 to each group. By using such a parallel distribution method, a synchronization signal with approximately the same delay time can be distributed to each group. Note that within each group, daisy-chain distribution may be used within an allowable range for differences in delay time. Furthermore, when a higher frame rate is used, the above-mentioned first distribution method may not be able to tolerate delay times within each group. In this case, the second distribution method may be used. FIG. 8 is a diagram showing the second distribution method of the high-speed three-dimensional data generation system 1 of the present invention. In this second distribution method, the synchronization signal generated by the signal generator 40 is distributed by a signal distributor to the number of high-speed cameras 20, and the distributed synchronization signal is directly distributed to each high-speed camera 20 without using a daisy chain. Furthermore, the length of the transmission path for distributing the synchronization signal from the signal distributor to each high-speed camera 20 is made approximately the same. With such a second distribution method, it is possible to distribute synchronization signals to all high-speed cameras 20 such that the difference in delay time is substantially zero, and the shooting timing of the frame images captured by each high-speed camera 20 can be almost perfectly matched.

[0040] FIG. 9 is a diagram showing an example of three-dimensional data obtained by photographing an airbag for a vehicle using the high-speed three-dimensional data generation system 1 of this embodiment.

[0041] A vehicle airbag (hereinafter simply referred to as an airbag) is a device provided to ensure the safety of the driver and passengers when the vehicle receives a large impact due to an accident or the like. The airbag is normally stored in a folded state in a specified position inside the vehicle. When the vehicle receives a large impact due to a collision or the like, a sensor detects the impact and activates an ignition device equipped in the airbag device. The activation of the ignition device causes a chemical to explode, generating gas that instantly inflates the folded airbag. The airbag device is configured so that it takes about 30 ms from when the sensor detects the impact until the airbag is fully inflated.

[0042] When the frame rate of the high-speed camera 20 is 500 fps, a frame image is obtained every 2 ms, and the 3D data generated by the reconstruction process can also be obtained every 2 ms.

[0043] 9 is a schematic diagram showing a time series of images obtained by photographing the shape change of an airbag installed in a steering wheel when it inflates using multiple high-speed cameras 20, reconstructing 3D data from the 2D image data photographed in multiple directions, and rendering the reconstructed 3D data from the side and front directions of the steering wheel. Rendering images from the time when the sensor detects an impact (t=0 ms) to 37.5 ms (t=37.5 ms) are extracted and illustrated at t=7.5 ms, 15 ms, 22.5 ms, and 30 ms.

[0044] In a vehicle accident, collisions can occur not only from the front but also from an oblique or side, and the position of the driver's head and upper body is not necessarily in front of the steering wheel. For this reason, in order to ensure the safety of the driver, the shape of the airbag that changes when it is inflated is important not only in the front direction but also in the overall shape including the side direction. With the high-speed three-dimensional data generation system 1 of the embodiment, it is possible to observe the overall shape change of the airbag in a short time (for example, within 30 ms) that cannot be observed with the naked eye or a video camera with a normal frame time of about 30 fps, from a desired rendering direction at an extremely short frame time (for example, every 2 ms). As a result, the high-speed three-dimensional data generation system 1 of the embodiment can provide extremely useful data and information in the research and development of airbags or in the quality control of airbags.

[0045] Second Embodiment 10 is a block diagram showing an example of the configuration of a high-speed 3D data generation device 10 according to the second embodiment. The difference from the first embodiment is that a processing circuit 100 of the second embodiment is configured to realize an acquisition function F04 and an analysis function F05 in addition to the functions of the first embodiment (see FIG. 2).

[0046] Fig. 11 is a flowchart showing an example of the operation of the high-speed three-dimensional data generation system 1 including the processing of the acquisition function F04 and the analysis function F05 in the second embodiment. Fig. 12 and Fig. 13 are diagrams showing the operation concept of the high-speed three-dimensional data generation system 1 according to the second embodiment. Hereinafter, the operation of the high-speed three-dimensional data generation system 1 will be described along the flowchart of Fig. 11 with reference to Figs. 12 and 13. Note that the processing from step ST100 to step ST104 in Fig. 11 is the same as that in the first embodiment described above, and therefore the description will be omitted.

[0047] 11, simulation data obtained by calculating the time-dependent changes in the shape and position of the object to be imaged by a computer, i.e., CAE (Computer Aided Engineering) data of the object to be imaged, is acquired from the outside. The simulation data may be acquired via an electric communication line such as the Internet or a wired / wireless LAN, or simulation data stored in a portable storage medium such as a USB memory may be acquired via the medium I / F 150 of the high-speed 3D data generation device 10. The process of step ST200 is performed by an acquisition function F04 of the processing circuit 100.

[0048] The type of simulation data is not particularly limited, but for example, it is data obtained by simulating the shape or physical quantity of an object within an extremely short time (for example, 100 ms or less) or the state or physical quantity between multiple objects by a computer, etc. In the following, the change in shape or physical quantity of an airbag immediately after an impact is detected by a sensor will be described as an example of simulation data.

[0049] In step ST201, an analysis is performed using the acquired simulation data and the 3D data generated in step ST102 (or the rendering image generated in step ST103). The processing in step ST201 is performed by the analysis function F05 of the processing circuit 100. One example of the analysis is, for example, displaying the acquired simulation data and the generated 3D data on the display 130 of the high-speed 3D data generation device 10 in a comparable manner. Alternatively or in addition to this, a difference between the simulation data and the generated 3D data may be calculated by an analysis process, and the calculated difference may be displayed on the display 130.

[0050] Fig. 12 is a diagram in which simulation data is superimposed on 3D data (the same diagram as Fig. 9) based on data captured by high-speed camera 20 and displayed in a time series. As in Fig. 9, the time when the sensor detects an impact is set to t=0 ms, and the 3D data and simulation data are superimposed and displayed in a comparable manner at each of the times t=0 ms, 7.5 ms, 15 ms, 22.5 ms, 30 ms, and 37.5 ms. As another comparable display mode, the 3D data and simulation data may be displayed side by side, or the two may be displayed while switching between them over time.

[0051] As described above, the airbag is stored in a folded state inside the steering wheel before it is subjected to an impact. It is known that the behavior of the airbag's shape change during inflation depends not only on the material of the airbag itself but also on the way the airbag is folded when stored.

[0052] Airbag developers determine the optimal folding method and material and create a prototype by repeating the process of simulating and calculating the change in shape of the airbag when it inflates, based on the material and folding method of the airbag. However, the behavior of the shape change of the prototype airbag when it inflates cannot be evaluated with the naked eye or with a video camera with a normal frame time of about 30 fps, because the inflation time is too short.

[0053] In contrast, according to the high-speed three-dimensional data generation system 1 of this embodiment, as shown in Fig. 12, the behavior of the actual airbag shape change displayed as 3D data can be compared with the simulation data in a manner that is obvious at a glance with the time resolution of the high-speed camera 20 (for example, with a time resolution of 2 ms). Based on this comparison data, airbag developers can appropriately improve prototypes, thereby reducing development time and costs.

[0054] It is possible to compare 3D data and simulation data not only in terms of changes in shape over time, but also in terms of changes in various physical quantities, such as the volume of an airbag and the temperature at the time of inflation.

[0055] FIG. 13(a) is a schematic graph comparing the change in the volume of the airbag from when the sensor detects an impact until 40 ms has elapsed between the volume calculated from 3D data based on the photographing data of the high-speed camera 20 and the volume based on simulation data.

[0056] The high-speed camera 20 can be configured as a high-speed infrared camera capable of detecting infrared rays, in addition to a visible light camera. In this case, it is possible to capture temperature changes of an object at a high frame rate of 500 fps.

[0057] FIG. 13(b) is a schematic graph comparing the temperature change of the airbag from the time the sensor detected the impact until 40 ms later, between the temperature calculated from 3D data based on the photographed data by the high-speed infrared camera and the temperature based on the simulation data.

[0058] As shown in Figures 13(a) and 13(b), by comparing physical quantities such as volume and temperature calculated from 3D data based on actual measurements of the prototype with those based on simulation data, it is possible to objectively and appropriately evaluate the performance of the prototype and obtain data for further improving the prototype.

[0059] Up to this point, each embodiment has been described, and the 3D data reconstruction function, rendering function, and display control function in the high-speed 3D data generation system 1 according to each embodiment and the description thereof are examples of a generation unit in the claims. Also, the acquisition function and analysis function in the high-speed 3D data generation system 1 according to each embodiment and the description thereof are examples of an acquisition unit and an analysis unit in the claims, respectively.

[0060] According to the high-speed 3D data generation system of each embodiment described above, it is possible to measure the dynamics of an object moving at ultra-high speed or an object whose shape changes in an extremely short time, such as the moment-to-moment shape change of an airbag in the middle of inflation, from any direction and any position with high accuracy and high time resolution.

[0061] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, modifications, and combinations of embodiments can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents as described in the claims, as well as in the scope and spirit of the invention. [Explanation of symbols]

[0062] 1. High-speed 3D data generation system 10. High-speed 3D data generation device 20 High-Speed ​​Camera 100 Processing circuit 110 Memory circuit 120 User I / F (Interface) 130 Display 140 Input I / F (Interface) 150 Media I / F (Interface) F01 3D data reconstruction function F02 Rendering function F03 Display control function F04 Acquisition function F05 Analysis function

Claims

1. At least one projector for projecting a pattern onto a surface of an object; a plurality of high-speed cameras that capture images of the deformation or movement of the object on whose surface the pattern is projected from a plurality of directions at a high frame rate of 500 fps or more; a generation unit that generates three-dimensional data of the object for each frame captured by the plurality of high-speed cameras based on the patterns included in the captured data of the plurality of high-speed cameras; A high-speed 3D data generation system equipped with the above.

2. Further equipped with a display, The generation unit is displaying the three-dimensional data of the object generated for each frame on the display as a video at any frame rate including super slow-motion video; 2. The high speed three-dimensional data generation system according to claim 1.

3. an acquisition unit that acquires simulation data obtained by calculating a time change of at least one of a shape and a position of the object by a computer; The high-speed three-dimensional data generation system according to claim 2 , further comprising:

4. The generation unit is the simulation data and the three-dimensional data of the object generated for each frame are compared and displayed on the display in a comparative manner; 4. The high speed three-dimensional data generation system according to claim 3.

5. an analysis unit that compares the simulation data with the three-dimensional data of the object generated for each frame to determine a difference; 5. The high-speed three-dimensional data generation system according to claim 3 or 4, further comprising:

6. The generation unit is displaying on the display a difference between the simulation data and the three-dimensional model of the object generated for each frame; 6. A high-speed three-dimensional data generation system according to claim 5.

7. the at least one projector is a plurality of projectors; The plurality of projectors include projecting the predetermined pattern onto the surface of the object from multiple directions; 2. The high speed three-dimensional data generation system according to claim 1.

8. the object is an airbag, The plurality of high-speed cameras include Photographing the deployment of the airbag with the pattern projected onto a surface from multiple directions; 2. The high speed three-dimensional data generation system according to claim 1.

9. the pattern projected by the projector is a grid pattern; 2. The high speed three-dimensional data generation system according to claim 1.

Citation Information

Patent Citations

  • Video presentation processing apparatus and program therefor

    JP2021027487A