Video processing device, video processing method, and program
The video processing system addresses tracking challenges in Log and Bake materials by applying a tracking look based on meta information, enhancing tracking quality and stability for RAW, Log, and Bake materials.
Patent Information
- Application Number
- PCT/JP2024/024554
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-07-28
- Filing Date
- 2024-07-08
- Publication Date
- 2025-02-06
AI Technical Summary
Existing video processing technologies face challenges in tracking feature points within video data encoded as Log or Bake materials due to low contrast, high or low saturation, and other factors, leading to potential tracking failures or reduced quality.
A video processing system applies a tracking look suitable for processing, based on meta information associated with the video data, to optimize brightness, saturation, and contrast, enhancing the tracking algorithm's effectiveness for RAW, Log, and Bake materials.
The system improves tracking quality by automatically adjusting video data to optimize it for tracking, reducing the likelihood of tracking failures and stabilizing the tracking process, while reducing user intervention and processing time.
Smart Images

Figure JP2024024554_06022025_PF_FP_ABST
Abstract
Description
Video processing device, video processing method, and program
[0001] The present disclosure relates to an image processing device, an image processing method, and a program, and more particularly to an image processing device, an image processing method, and a program that enable better tracking quality to be obtained.
[0002] Conventionally, a technique has been developed for tracking the movement of feature points in an image over time in order to synthesize two-dimensional or three-dimensional CG (Computer Graphics) in accordance with the movement of a subject shown in the image.
[0003] For example, Patent Document 1 discloses a synthesis method for synthesizing three-dimensional CG in real time, in which positions on an image are identified by inter-frame tracking of feature points from pre-captured moving image data.
[0004] Japanese Patent Application Laid-Open No. 2008-15576
[0005] Incidentally, when saving video data, imaging devices can save video data that has been encoded from RAW material into Log material, Bake material, or the like, or can save the RAW material video data as is. However, Log material video data has low contrast, making it difficult to find feature points, making it unsuitable for use in tracking a subject. Furthermore, depending on the selected Bake material, feature points may also be difficult to find. To use RAW material video data for tracking, it must be developed into Log material, which, like Log material video data, makes feature points difficult to find. In addition to low contrast, various factors are thought to make it difficult to find feature points, such as when the image is too dark or too bright, or when the saturation is too high or too low.
[0006] Therefore, when tracking is performed using video data from Log or Bake materials as is, it is expected that there is a high possibility of tracking failure or poor tracking quality. Also, when a user creates video data suitable for tracking from video data from Log or Bake materials and performs tracking, not only does it take time to create video data suitable for tracking, but the tracking quality varies depending on the user's level of proficiency, making it difficult to consistently achieve good tracking quality.
[0007] The present disclosure has been made in view of such circumstances, and makes it possible to obtain better tracking quality.
[0008] A video processing device according to one aspect of the present disclosure includes a tracking look application unit that applies a tracking look, which is a look suitable for tracking processing, to video data in accordance with meta information associated with the video data, and a tracking processing unit that performs tracking processing using the video data to which the tracking look has been applied.
[0009] A video processing method or program according to one aspect of the present disclosure includes applying a tracking look, which is a look suitable for tracking processing, to video data in accordance with meta information associated with the video data, and performing tracking processing using the video data to which the tracking look has been applied.
[0010] In one aspect of the present disclosure, a tracking look that is suitable for tracking processing is applied to the video data according to meta information associated with the video data, and tracking processing is performed using the video data to which the tracking look has been applied.
[0011] Fig. 1 is a block diagram showing an example configuration of an embodiment of a video processing system to which the present technology is applied. Fig. 2 is a block diagram showing an example configuration of a tracking look application unit. Fig. 3 is a diagram showing an example of a UI image for turning on / off the application of a tracking look to video data of Log material. Fig. 4 is a diagram showing an example of a UI image for turning on / off the application of a tracking look to video data of Bake material. Fig. 5 is a flowchart for explaining an example of video processing. Fig. 6 is a block diagram showing an example configuration of an embodiment of a computer to which the present technology is applied.
[0012] Hereinafter, specific embodiments to which the present technology is applied will be described in detail with reference to the drawings.
[0013] <Configuration Example of Video Processing System> FIG. 1 is a block diagram showing a configuration example of an embodiment of a video processing system to which the present technology is applied.
[0014] 1, the video processing system 11 is made up of a camera 21 and a personal computer 22. In the video processing system 11, video data acquired by shooting with the camera 21 is recorded, for example, in a recording medium 23 using a predetermined recording method, and the personal computer 22 can perform video processing on the video data read from the recording medium 23.
[0015] In the following, in this embodiment, the recording methods of video data recorded on the recording medium 23 will be described using RAW material, Log material, and Bake material.
[0016] RAW material is raw data that stores almost exactly the brightness information captured on an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor through the lens of the camera 21. Because the data is incomplete in its current state, it is a recording format that assumes that it will be edited (developed). For example, by recording video data as RAW material, it is possible to freely set brightness, white balance, sharpness, and the like.
[0017] Log material is compressed data that has had its color tone, saturation, and gradation processed from RAW material, and is a recording format that assumes that editing such as color correction and color grading will be performed. For example, by recording video data as Log material, it is possible to suppress the occurrence of white blowout and black crush with a high dynamic range.
[0018] Bake material is compressed data that has had its color tone, saturation, and gradation processed from RAW material to create an image look with the desired texture and color, and is a recording method that does not assume that editing such as color correction or color grading will be performed.
[0019] The camera 21 comprises a video acquisition unit 31 , a Log material encoding unit 32 , a Bake material encoding unit 33 , a meta information generation unit 34 , and a recording media drive 35 .
[0020] The video acquisition unit 31 acquires RAW material video data of a predetermined size (FHD (Full High Definition) / 4K / 8K, etc.) by capturing images using an image sensor, and supplies the data to the Log material encoding unit 32, the Bake material encoding unit 33, or the recording media drive 35.
[0021] When RAW material video data is supplied from the video acquisition unit 31, the Log material encoding unit 32 encodes the RAW material video data in accordance with the Log specifications, and supplies the Log material video data obtained by the encoding to the recording media drive 35.
[0022] When RAW material video data is supplied from the video acquisition unit 31, the Bake material encoding unit 33 encodes the RAW material video data in accordance with the Bake specifications, and supplies the Bake material video data obtained by the encoding to the recording media drive 35.
[0023] The meta information generation unit 34 generates meta information including various pieces of information set in the camera 21 at the time the video acquisition unit 31 acquired the video data, and supplies the generated meta information to the recording media drive 35. For example, the meta information may include exposure settings, CDL (Color Decision List) parameters, OETF / EOTF (Opto-Electronic Transfer Function / Electro-Optical Transfer Function), and information associated with the look at the time of shooting. For example, the American Society of Cinematographers (ASC)-CDL may be used as the CDL. Furthermore, the output of a 6-axis sensor provided in the camera 21 for image stabilization may be included in the meta information.
[0024] The recording media drive 35 records the RAW material video data supplied from the video acquisition unit 31, the Log material video data supplied from the Log material encoding unit 32, or the Bake material video data supplied from the Bake material encoding unit 33 onto the recording media 23. At this time, the recording media drive 35 records the meta information supplied from the meta information generation unit 34 onto the recording media 23 in association with the video data.
[0025] The personal computer 22 comprises a recording media drive 41 , a development processing section 42 , a tracking look application section 43 , a tracking processing section 44 , a video processing section 45 , and a display section 46 .
[0026] When RAW material video data is recorded on the recording medium 23, the recording media drive 41 reads the RAW material video data from the recording medium 23 and supplies it to the development processing unit 42 and the video processing unit 45. When Log material video data or Bake material video data is recorded on the recording medium 23, the recording media drive 41 reads the Log material video data or Bake material video data from the recording medium 23 and supplies it to the tracking look application unit 43 and the video processing unit 45. Furthermore, the recording media drive 41 reads meta information recorded in association with the video data from the recording medium 23 and supplies it to the tracking look application unit 43.
[0027] The development processing unit 42 performs development processing such as demosaic on the RAW material video data supplied from the recording media drive 41, and supplies the Log material video data obtained as a result to the tracking look application unit 43. Hereinafter, the Log material video data (developed video data) after the development processing has been performed on the RAW material video data in the development processing unit 42 will be treated in the same way as the Log material video data read out from the recording media drive 41.
[0028] The tracking look application unit 43 applies a tracking look to the Log material video data or the Bake material video data in accordance with meta information associated with each video data so that the video data has a look suitable for tracking processing (for example, image creation in which contrast, brightness, saturation, etc. are optimized for a tracking algorithm). For example, by applying a tracking look in accordance with the meta information to create video data with high contrast, detail emphasis, etc., tracking can be made easier.
[0029] For example, the tracking look application unit 43 may use a tracking look that is set in advance for each piece of predetermined meta information, or may use a tracking look that is automatically generated so as to correspond to the meta information associated with each piece of video data. The tracking look application unit 43 then supplies the video data to which the tracking look has been applied to the tracking processing unit 44 and the display unit 46.
[0030] The tracking processing unit 44 performs a tracking process to track a subject shown in the video using the video data to which the tracking look supplied from the tracking look application unit 43 has been applied. The tracking processing unit 44 then supplies tracking information indicating the results of the tracking process (for example, information indicating the position, size, posture, etc. of the subject shown in the video, or information indicating the position, posture, etc. of the camera 21 determined relatively from the movement of the subject in the video) to the video processing unit 45.
[0031] The video processing unit 45 performs video processing on the video data supplied from the recording media drive 41 based on the tracking information supplied from the tracking processing unit 44. Here, the target of video processing by the video processing unit 45 is not the video data to which the tracking look has been applied, but the original video data (RAW material, Log material, or Bake material) before the tracking look has been applied.
[0032] For example, the video processing unit 45 can perform video processing based on the tracking information, such as two-dimensional or three-dimensional CG synthesis, as well as live-action synthesis, cut editing, color correction, color grading, etc. on the video data. The video processing unit 45 then supplies the processed video data to the display unit 46.
[0033] The display unit 46 displays video in accordance with the video data that has been subjected to video processing and that is supplied from the video processing unit 45. The display unit 46 can also switch between displaying video in accordance with the Log material video data or the Bake material video data that is supplied via the video processing unit 45, and video in accordance with the video data to which a tracking look has been applied that is supplied from the tracking look application unit 43 (see FIGS. 3 and 4, which will be described later).
[0034] The video is then processed in the video processing unit 45, and the completed video can be recorded or subjected to further video processing at a later stage.
[0035] FIG. 2 is a block diagram showing first and second configuration examples of the tracking look application unit 43. As shown in FIG.
[0036] The tracking look application unit 43A of the first configuration example shown in FIG. 2A is configured to include a 1D_LUT processing unit 51, a matrix application unit 52, and a gain adjustment unit 53.
[0037] The 1D_LUT processing unit 51 performs conversion processing to convert the color contrast of the video data supplied to the tracking look application unit 43A individually into each of RGB using a 1D_LUT (Lookup Table), which is a one-dimensional color correspondence table set based on meta information. In this way, the 1D_LUT processing unit 51 obtains video data with a color contrast suitable for tracking processing, and supplies the video data to the matrix application unit 52.
[0038] The matrix application unit 52 applies a filter that emphasizes details using a matrix to the video data supplied from the 1D_LUT processing unit 51. In this way, the matrix application unit 52 obtains video data with details suitable for tracking processing, and supplies the video data to the gain adjustment unit 53.
[0039] The gain adjustment unit 53 adjusts the brightness of the video data supplied from the matrix application unit 52 to obtain video data adjusted to appropriate brightness suitable for tracking processing, and supplies the data to the downstream tracking processing unit 44 (Figure 1).
[0040] A tracking look application unit 43B of the second configuration example shown in FIG. 2B is configured to include a 3D_LUT processing unit 54.
[0041] The 3D_LUT processing unit 54 performs conversion processing to convert the color contrast of the video data supplied to the tracking look application unit 43B in conjunction with RGB, using a 3D_LUT, which is a three-dimensional color correspondence table set based on meta information. In this way, the 3D_LUT processing unit 54 obtains video data with a color contrast suitable for tracking processing, and supplies it to the downstream tracking processing unit 44 (FIG. 1).
[0042] The tracking look application unit 43 is not limited to the first or second configuration example shown in FIG. 2, but can be configured to perform various signal processing, such as adding offset or sharpness.
[0043] The video processing system 11 is configured as described above and can automatically apply a tracking look to video data of RAW material, Log material, or Bake material according to the meta information associated with the video data. This allows the video processing system 11 to perform tracking using video data to which a tracking look has been applied, thereby achieving better tracking quality. In other words, the video processing system 11 can avoid tracking failures and poor tracking quality.
[0044] Furthermore, the video processing system 11 can reduce the time required for video processing, stably achieve good tracking quality, and prevent careless user mistakes, compared to when a user creates video data suitable for tracking from video data of Log material or Bake material, for example.
[0045] The video processing system 11 can then perform video processing based on the tracking information on the original video data (RAW material, Log material, or Bake material) before the tracking look is applied, rather than on the video data to which the tracking look has been applied.
[0046] <Display Example of UI Image> A UI (User Interface) image for turning on / off the application of a tracking look will be described with reference to FIGS. 3 and 4. FIG.
[0047] 3A and 3B are diagrams showing examples of UI images for turning on / off the application of a tracking look to Log material video data. A of Fig. 3 shows a UI image that is displayed on the display unit 46 when the application of a tracking look to Log material video data is turned off. B of Fig. 3 shows a UI image that is displayed on the display unit 46 when the application of a tracking look to Log material video data is turned on.
[0048] 4A and 4B are diagrams showing examples of UI images for turning on / off the application of a tracking look to video data of baked materials. A of Fig. 4A shows a UI image displayed on the display unit 46 when the application of a tracking look to video data of baked materials is turned off. B of Fig. 4B shows a UI image displayed on the display unit 46 when the application of a tracking look to video data of baked materials is turned on.
[0049] For example, when the personal computer 22 executes a tracking application or the like to perform tracking in the tracking processing unit 44, it can display a switch GUI (Graphical User Interface) 61 for switching application of a tracking look on and off on the display unit 46, as shown in Figures 3 and 4. Then, the user can switch application of the tracking look on and off by operating the switch GUI 61.
[0050] For example, when a user operates the switch GUI 61 in a state where the application of the tracking look is off as shown in the upper part of Figures 3 and 4, the switch GUI 61 changes to a state where the application of the tracking look is on, as shown in the lower part of Figures 3 and 4. Accordingly, in the personal computer 22, the tracking look application unit 43 applies the tracking look to the video data of the Log material or the video data of the Bake material, and the video display changes as shown in the lower part of Figures 3 and 4.
[0051] At this time, the personal computer 22 can visually indicate to the user that a tracking look has been applied by changing the notation "Log material" or "Bake material" to "Look that is easy to track." Of course, such a visual indication does not have to be given.
[0052] When the personal computer 22 executes a tracking application or the like, the switch GUI 61 may be always hidden and the application of the tracking look may always be in an on state.
[0053] 5, an example of video processing executed in the personal computer 22 will be described. For example, the processing starts when the user inserts the recording medium 23 into the recording medium drive 41 of the personal computer 22 and performs an operation to instruct the execution of video processing based on tracking information.
[0054] In step S11, the recording media drive 41 reads video data from the recording media 23. For example, if RAW material video data is recorded on the recording media 23, the recording media drive 41 supplies the RAW material video data read from the recording media 23 to the development processing unit 42 and the video processing unit 45. Furthermore, if Log material video data or Bake material video data is recorded on the recording media 23, the recording media drive 41 supplies the Log material video data or Bake material video data read from the recording media 23 to the tracking look application unit 43 and the video processing unit 45. Furthermore, the recording media drive 41 reads meta information recorded in association with the video data from the recording media 23, and supplies the meta information to the tracking look application unit 43.
[0055] In step S12, the development processing unit 42 performs development processing on the RAW material video data supplied in step S11, and supplies the Log material video data obtained as a result to the tracking look application unit 43. Note that if Log material video data or Bake material video data has been recorded on the recording media 23, the processing of step S12 is skipped.
[0056] In step S13, the tracking look application unit 43 applies a tracking look to the video data of the Log material or the video data of the Bake material in accordance with the meta information supplied in step S11. Then, the tracking look application unit 43 supplies the video data to which the tracking look has been applied to the tracking processing unit 44.
[0057] In step S14, the tracking processing unit 44 performs a tracking process to track a subject shown in the video using the video data to which the tracking look supplied in step S13 has been applied. The tracking processing unit 44 then supplies tracking information indicating the results of the tracking process to the video processing unit 45.
[0058] In step S15, the video processing unit 45 performs video processing based on the tracking information supplied in step S14 on the video data supplied in step S11 (i.e., the original RAW material, Log material, or Bake material video data before the tracking look is applied).The video processing unit 45 then supplies the processed video data to the display unit 46, and an image according to the video data is displayed on the display unit 46.
[0059] By performing the above-described video processing, the video processing system 11 can obtain better tracking quality by applying a tracking look to video data of RAW material, Log material, or Bake material according to the meta information associated with the video data.
[0060] In this embodiment, CG compositing processing refers to compositing CG with video captured by the camera 21 in subsequent editing. The CG also needs to move in accordance with the movement of the camera 21. Tracking refers to tracking feature points in the video captured by the camera 21, such as objects in the video, to perform 2D tracking or 3D camera tracking. 2D tracking refers to tracking objects in the video using feature points and an acceleration sensor in the video captured by the camera 21, and is used, for example, when it is desired to have a mosaic constantly follow a person in the video. 3D camera tracking refers to analyzing how the camera 21 was moved to capture the video based on an acceleration sensor, feature points, etc., and generating a virtual camera. Generally, 3D camera tracking links the CG and the virtual camera, allowing the composited CG to move in the same way in accordance with the movement of the video, enabling a natural composition.
[0061] <Example of Computer Configuration> Next, the above-described series of processes (video processing method) can be performed by hardware or software. When the series of processes is performed by software, a program constituting the software is installed in a general-purpose computer or the like.
[0062] FIG. 6 is a block diagram showing an example of the configuration of an embodiment of a computer in which a program for executing the above-described series of processes is installed.
[0063] The program can be recorded in advance on the hard disk 105 or ROM 103 as a recording medium built into the computer.
[0064] Alternatively, the program can be stored (recorded) on a removable recording medium 111 driven by the drive 109. Such a removable recording medium 111 can be provided as a so-called package software. Here, examples of the removable recording medium 111 include a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto Optical) disk, a DVD (Digital Versatile Disc), a magnetic disk, and a semiconductor memory.
[0065] The program can be installed into the computer from the removable recording medium 111 as described above, or can be downloaded to the computer via a communication network or a broadcasting network and installed on the built-in hard disk 105. That is, the program can be transferred to the computer wirelessly from a download site via an artificial satellite for digital satellite broadcasting, or transferred to the computer by wire via a network such as a LAN (Local Area Network) or the Internet.
[0066] The computer includes a CPU (Central Processing Unit) 102 , to which an input / output interface 110 is connected via a bus 101 .
[0067] When a user inputs a command via the input / output interface 110 by operating the input unit 107, the CPU 102 executes a program stored in a read-only memory (ROM) 103 in accordance with the command. Alternatively, the CPU 102 loads a program stored on a hard disk 105 into a random access memory (RAM) 104 and executes the program.
[0068] As a result, the CPU 102 performs processing according to the flowchart described above or processing performed by the configuration of the block diagram described above. Then, the CPU 102 outputs the processing results from the output unit 106 via the input / output interface 110, transmits them from the communication unit 108, or records them on the hard disk 105, as necessary.
[0069] The input unit 107 is made up of a keyboard, a mouse, a microphone, etc. The output unit 106 is made up of an LCD (Liquid Crystal Display), a speaker, etc.
[0070] In this specification, the processing performed by a computer according to a program does not necessarily have to be performed in chronological order according to the order described in the flowchart. In other words, the processing performed by a computer according to a program also includes processing that is executed in parallel or individually (for example, parallel processing or object-based processing).
[0071] The program may be processed by a single computer (processor), or may be distributed among multiple computers. Furthermore, the program may be transferred to and executed on a remote computer.
[0072] Furthermore, in this specification, a system refers to a collection of multiple components (devices, modules (components), etc.), regardless of whether all of the components are contained in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device housed in a single housing with multiple modules, are both systems.
[0073] Also, for example, a configuration described as one device (or processing unit) may be divided and configured as multiple devices (or processing units). Conversely, configurations described above as multiple devices (or processing units) may be combined and configured as one device (or processing unit). Of course, configurations other than those described above may be added to the configuration of each device (or each processing unit). Furthermore, as long as the configuration and operation of the entire system are substantially the same, part of the configuration of one device (or processing unit) may be included in the configuration of another device (or other processing unit).
[0074] Furthermore, for example, the present technology can be configured as a cloud computing system in which a single function is shared and processed collaboratively by a plurality of devices via a network.
[0075] Furthermore, for example, the above-described program can be executed in any device, as long as the device has the necessary functions (functional blocks, etc.) and can obtain the necessary information.
[0076] Also, for example, each step described in the above flowchart can be executed by one device or can be shared and executed by multiple devices. Furthermore, if one step includes multiple processes, the multiple processes included in that one step can be executed by one device or can be shared and executed by multiple devices. In other words, multiple processes included in one step can be executed as multiple step processes. Conversely, processes described as multiple steps can be executed collectively as a single step.
[0077] In addition, the processing of the steps of a program executed by a computer may be executed in chronological order according to the order described in this specification, or may be executed in parallel or individually at the required timing, such as when a call is made. In other words, as long as no contradiction occurs, the processing of each step may be executed in an order different from the order described above. Furthermore, the processing of the steps of this program may be executed in parallel with the processing of another program, or may be executed in combination with the processing of another program.
[0078] It should be noted that the present technologies described in this specification can be implemented independently and singly, unless a contradiction arises. Of course, any two or more of the present technologies can also be implemented in combination. For example, part or all of the present technologies described in any embodiment can be implemented in combination with part or all of the present technologies described in other embodiments. Furthermore, part or all of any of the present technologies described above can also be implemented in combination with other technologies not described above.
[0079] <Examples of Combinations of Configurations> Note that the present technology can also be configured as follows. (1) A video processing device comprising: a tracking look application unit that applies a tracking look, which is a look suitable for tracking processing, to video data in accordance with meta information associated with the video data; and a tracking processing unit that performs tracking processing using the video data to which the tracking look has been applied. (2) The video processing device according to (1) above, further comprising: a video processing unit that performs video processing on the video data based on tracking information that indicates a result of the tracking processing in the tracking processing unit. (3) The video processing device according to (2) above, wherein the tracking look application unit applies the tracking look to developed video data obtained by subjecting RAW material video data to development processing, Log material video data, or Bake material video data, and the video processing unit performs video processing on the original RAW material video data, the original Log material video data, or the original Bake material video data to which the tracking look has been applied by the tracking look application unit. (4) The video processing device according to any one of (1) to (3), wherein the tracking look application unit is configured with: a 1D_LUT processing unit that performs a conversion process to convert the color contrast of the video data using a 1D_LUT (Lookup Table) that is a one-dimensional color correspondence table set based on the meta information, a matrix application unit that applies a filter that emphasizes details using a matrix to the video data that has been subjected to the conversion process by the 1D_LUT processing unit, and a gain adjustment unit that adjusts the brightness of the video data to which the filter has been applied by the matrix application unit. (5) The video processing device according to any one of (1) to (3), wherein the tracking look application unit is configured with: a 3D_LUT processing unit that performs a conversion process to convert the color contrast of the video data using a 3D_LUT (Lookup Table) that is a three-dimensional color correspondence table set based on the meta information.(6) A video processing method, including: a video processing device applying a tracking look to video data, the tracking look being a look suitable for tracking processing, in accordance with meta information associated with the video data, and performing tracking processing using the video data to which the tracking look has been applied. (7) A program for causing a computer of the video processing device to execute video processing, including: applying a tracking look to video data, the tracking look being a look suitable for tracking processing, in accordance with meta information associated with the video data, and performing tracking processing using the video data to which the tracking look has been applied.
[0080] It should be noted that the present embodiment is not limited to the above-described embodiment, and various modifications are possible within the scope of the gist of the present disclosure. Furthermore, the effects described in this specification are merely examples and are not intended to be limiting, and other effects may also be obtained.
[0081] REFERENCE SIGNS LIST 11 Video processing system, 21 Camera, 22 Personal computer, 23 Recording media, 31 Video acquisition unit, 32 Log material encoding unit, 33 Bake material encoding unit, 34 Meta information generation unit, 35 Recording media drive, 41 Recording media drive, 42 Development processing unit, 43 Tracking look application unit, 44 Tracking processing unit, 45 Video processing unit, 46 Display unit, 51 1D_LUT processing unit, 52 Matrix application unit, 53 Gain adjustment unit, 54 3D_LUT processing unit
Claims
1. A video processing device comprising: a tracking look application unit that applies a tracking look, which is a look suitable for tracking processing, to video data in accordance with meta information associated with the video data; and a tracking processing unit that performs tracking processing using the video data to which the tracking look has been applied.
2. The image processing device according to claim 1, further comprising an image processing unit that performs image processing on the image data based on tracking information indicating a result of the tracking processing in the tracking processing unit.
3. The image processing device according to claim 2, wherein the tracking look application unit applies the tracking look to developed image data obtained by subjecting RAW material image data to development processing, Log material image data, or Bake material image data, and the image processing unit performs image processing on the original RAW material image data, the original Log material image data, or the original Bake material image data to which the tracking look is applied by the tracking look application unit.
4. The image processing device of claim 1, wherein the tracking look application unit is configured to include: a 1D_LUT processing unit that performs a conversion process to convert the color contrast of the image data using a 1D_LUT (Lookup Table), which is a one-dimensional color correspondence table set based on the meta information; a matrix application unit that applies a filter that emphasizes details using a matrix to the image data that has been converted by the 1D_LUT processing unit; and a gain adjustment unit that adjusts the brightness of the image data to which the filter has been applied by the matrix application unit.
5. The image processing device of claim 1, wherein the tracking look application unit is configured to include a 3D_LUT processing unit that performs conversion processing to convert the color contrast of the image data using a 3D_LUT (Lookup Table), which is a three-dimensional color correspondence table set based on the meta information.
6. A video processing method including: a video processing device applying a tracking look to video data, the tracking look being a look suitable for tracking processing, in accordance with meta information associated with the video data; and performing tracking processing using the video data to which the tracking look has been applied.
7. A program for causing a computer of a video processing device to execute video processing including: applying a tracking look to video data, the tracking look being a look suitable for tracking processing, in accordance with meta information associated with the video data; and performing tracking processing using the video data to which the tracking look has been applied.
Citation Information
Patent Citations
Camera switching method and device, and UAV
CN109218598A
Aerial photograph imaging method and aerial photograph imaging device
JP2012242321A
Portable imaging device with a display that offers improved visibility under adverse conditions.
JP2013520934A
Image processing apparatus and image processing method
JP2023067164A