Information processing device, information processing method, and program

JP7634942B2Active Publication Date: 2025-02-25CANON KK
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2020060487
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-03-30
Publication Date
2025-02-25
Estimated Expiration
2040-03-30

Smart Images

  • Figure 0007634942000001
    Figure 0007634942000001
  • Figure 0007634942000002
    Figure 0007634942000002
  • Figure 0007634942000003
    Figure 0007634942000003
Patent Text Reader

Abstract

To reduce the load of developing processing.SOLUTION: A server includes: editing means for performing a predetermined editing process on a moving image according to editing information transmitted from a PC; and developing means for performing either a normal developing process or a simple developing process having a smaller processing load than the normal developing process for a temporal or image area range included in the moving image. The developing means performs the simple developing process for a range where the predetermined editing process indicated by at least one piece of editing information is performed by one or more other user devices.SELECTED DRAWING: Figure 6
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program for executing a development process. [Background technology]

[0002] In recent years, a technology has been used in which a server processes still images and videos uploaded from a user device such as a personal computer (PC) used by a user and presents the processing results to the user device. The above technology realizes efficient image processing (video processing) using the high processing power of the server. It is expected that in the future, the above technology will be widely applied to large-capacity videos such as RAW videos in which data from an image sensor is recorded as is for each frame.

[0003] Patent Document 1 discloses a technique for reducing the load of development processing by extracting data indicated in editing information that specifies a playback section of RAW data from storage and executing development processing on the extracted data. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2009-171060 A Summary of the Invention [Problem to be solved by the invention]

[0005] Patent Document 1 is a technology related to development processing by a single user, and does not assume the presence of multiple users. In cases where multiple users process one RAW video on a server (for example, multiple parents process a video of a child's recital), one RAW video is edited and developed according to the preferences and requests of each user. Therefore, in such cases, it becomes necessary to execute multiple development processes for one RAW video in response to different instructions from multiple users. However, if multiple development processes are executed within a short period of time, the processing load on the server becomes excessive. The above problems may also occur in development processes for videos other than RAW videos.

[0006] In view of the above circumstances, an object of the present invention is to provide an information processing device, an information processing method, and a program that can reduce the load of video development processing. [Means for solving the problem]

[0007] In order to achieve the above object, the information processing device of the present invention comprises: a user device and other user devices. According to the editing information sent from, The edit information was sent an editing unit that performs a predetermined editing process on the RAW video to identify a range that is unnecessary for a user of the device; and a developing unit that performs either a first developing process or a second developing process having a smaller processing load than the first developing process on a temporal range of the RAW video, and when a playback request for the RAW video is received from the user device, and the editing information transmitted from the user device is not stored. The developing means develops the RAW video within a time range of the RAW video. The above Identified according to editing information sent from other user devices The above The second development process is performed on a range that is not required for a user of another user device, and the first development process is performed on another temporal range of the RAW video. Effect of the Invention

[0008] According to the present invention, the load of video development processing in an information processing device is reduced. [Brief description of the drawings]

[0009] [Figure 1] 1 is an overall configuration diagram of an information processing system according to a first embodiment of the present invention. [Diagram 2] 1 is a block diagram showing the configurations of a server and a PC according to a first embodiment of the present invention; [Diagram 3] FIG. 2 is an explanatory diagram illustrating a display screen of an application according to the first embodiment of the present invention. [Figure 4] 5 is a flowchart showing the operations of a server and a PC in the first embodiment of the present invention. [Diagram 5] 5 is a flowchart showing a development control process of the server in the first embodiment of the present invention. [Figure 6] FIG. 2 is an explanatory diagram of a common cut section (simple development section) in the first embodiment of the present invention. [Figure 7] 10 is a flowchart showing a development control process of a server in a second embodiment of the present invention. [Figure 8] FIG. 11 is an explanatory diagram of a common uncropped area (simple development area) in the second embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiments of the present invention will be described in detail with reference to the accompanying drawings. Each embodiment described below is merely one example of a configuration that can realize the present invention. Each of the following embodiments can be appropriately modified or changed depending on the configuration of the device to which the present invention is applied and various conditions. Therefore, the scope of the present invention is not limited by the configuration described in each of the following embodiments. For example, a configuration that combines multiple configurations described in the embodiments can be adopted as long as there is no mutual contradiction.

[0011] First Embodiment 1 is a diagram showing the overall configuration of an information processing system S according to a first embodiment of the present invention. The information processing system S has a server 100 (information processing device) and a plurality of PCs 150 (user devices). Each PC 150 can communicate with the server 100 via a network.

[0012] In general, the server 100 executes development processing on the RAW video stored in the server 100 in accordance with the editing contents transmitted from each PC 150, and transmits the development results to each PC.

[0013] The configurations of the server 100 and the PC 150 according to the first embodiment of the present invention will be described with reference to Fig. 2. Fig. 2(a) is a block diagram showing the configuration of the server 100 according to the present embodiment, and Fig. 2(b) is a block diagram showing the configuration of the PC 150 according to the present embodiment.

[0014] 2(a), the server 100 includes a CPU 101, a ROM 102, a RAM 103, a HDD 104, a network IF 105, a user IF 106, a VRAM 107, an image processing unit 108, and a display control unit 109. The above elements are connected to each other by an internal bus 115, which is a transmission path for control signals and data signals.

[0015] The CPU 101 (control means) is a processing circuit that executes various calculations in the server 100. The ROM 102 is a non-volatile storage medium, and stores various control programs and data used by the CPU 101. The RAM 103 is a volatile storage medium, and stores setting values ​​used by the CPU 101 and functions as a working memory in which various programs are deployed. The hard disk drive (HDD) 104 is a non-volatile storage medium, and stores various programs and data that constitute the application AP and the operating system (OS).

[0016] The network IF 105 is a connection interface with the network 111, and is, for example, a network interface card (NIC). The user IF 106 is a connection interface with an input device 112 such as a mouse 113 and a keyboard 114, and is, for example, a USB interface.

[0017] The VRAM 107 is a volatile storage medium that stores image data. The image processing unit 108 is a processing device that processes image data and supplies the image data to the display control unit 109. The display control unit 109 is a control device that displays an image on a display 110 connected to the server 100.

[0018] 2(b), the PC 150 has a CPU 151, a ROM 152, a RAM 153, a HDD 154, a network IF 155, a user IF 156, a VRAM 157, an image processing unit 158, and a display control unit 159. The above elements are connected to each other by an internal bus 165 which is a transmission path for control signals and data signals. The above elements are configured in the same manner as the corresponding elements of the server 100.

[0019] The above-mentioned CPUs 101, 151 of the server 100 and the PC 150 respectively read out and execute programs stored in the ROMs 102, 152 and the HDDs 104, 154 into the RAMs 103, 153, thereby implementing various processes according to this embodiment. The HDD 104 stores RAW moving images that are the subject of editing processes described below.

[0020] In the following, the execution of a certain process X by CPU 101 of server 100 while collectively controlling other elements in server 100 may be expressed simply as "server 100 executes process X." Similarly, the execution of a certain process Y by CPU 151 of PC 150 while collectively controlling other elements in PC 150 may be expressed simply as "PC 150 executes process Y."

[0021] 3 is an explanatory diagram illustrating a display screen of an application AP according to the first embodiment of the present invention. This application AP is executed in the PC 150, and processes video in response to a user's operation on the input device 112. When the PC 150 executes the application AP, a display screen 300 including the following display areas is displayed on the display 160.

[0022] As shown in FIG. 3, a display screen 300 includes a moving image list area 310, a preview area 320, a control area 330, and a timeline area 340 as display areas.

[0023] The moving image list area 310 is an area that displays the file names of the RAW moving images stored in the HDD 104 of the server 100 and the HDD 154 of the PC 150. The PC 150 can obtain the file names of the RAW moving images in the HDD 104 of the server 100 via the network. In Fig. 3, four RAW moving images AAAA, BBBB, CCCC, and DDDD stored in the folder 311 are displayed. Thumbnails of the RAW moving images may be displayed in the moving image list area 310 together with the file names.

[0024] Preview area 320 is an area in which a RAW video selected by the user is played back and displayed. Server 100 develops a specific frame of the RAW video selected by the user, and transmits the developed display data (development result) to PC 150. PC 150 displays the developed display data received from server 100 in preview area 320.

[0025] The control area 330 is an area that displays software buttons for controlling the playback of the RAW moving image displayed in the preview area 320. The user can control the playback of the moving image by operating the software buttons with the mouse 113.

[0026] The timeline area 340 is an area used for editing (cut editing, etc.) the RAW video. A rectangle 341 that chronologically indicates the playback range of the RAW video selected by the user is displayed in the timeline area 340. Editing positions 342, 343 are marks that indicate the section (temporal range) that remains after cut editing processing that deletes a portion of the RAW video, and their positions are changed based on the user's operation. The playback bar 350 is a mark that indicates the current playback position in the RAW video.

[0027] The application AP has functions not shown in FIG. 3, such as a function for adjusting RAW development parameters such as white balance, color temperature, brightness, and sharpness, and a function for setting parameters when exporting a RAW video file in a different format.

[0028] The operations of the server 100 and the PC 150 according to the first embodiment of the present invention will be described with reference to FIGS.

[0029] Figures 4(a) and 4(b) are flowcharts showing the operations of the server 100 and the PC 150 when developing and displaying a RAW video. More specifically, Figure 4(a) shows the operation of the PC 150 which displays the development result of the RAW video in the preview area 320 described above, and Figure 4(b) shows the operation of the server 100 which transmits the development result of the RAW video developed based on a development request from the PC 150. Figures 4(a) and 4(b) are executed in parallel with the cooperation of the server 100 and the PC 150.

[0030] In step S401, PC 150 determines whether the user has used input device 112 to instruct to display the RAW video. The above display instruction is an instruction to update the image displayed in preview area 320, and may include information indicating a specific frame from which display should start. A user operation equivalent to a display instruction is, for example, an operation to select a RAW video displayed in video list area 310, or an operation to move playback bar 350 displayed in timeline area 340. If the user simply selects the RAW video itself, the display instruction may mean an instruction to start displaying from the first frame of the RAW video. When PC 150 receives a display instruction (S401: YES), it proceeds to step S402, and while it has not received a display instruction (S401: NO), it repeats the waiting loop of step S401.

[0031] In step S402, PC 150 transmits a request to server 100 to develop the RAW video indicated in the display instruction related to the determination in step S401. The development request includes the file name of the RAW video to be developed, the number of the specific frame from which display should start, and RAW development parameters. After transmitting the development request, PC 150 proceeds to step S403.

[0032] In step S411, the server 100 determines whether or not a development request for a RAW video has been received from the PC 150. If the server 100 receives a development request (S411: YES), the server 100 proceeds to step S412, and while the server 100 has not received a development request (S411: NO), the server 100 repeats the wait loop of step S411.

[0033] In step S412, the server 100 reads frame data of a specific frame number from the RAW moving image file stored in the HDD 104 based on the file name of the RAW moving image and the number of the specific frame indicated in the development request received from the PC 150.

[0034] In step S413, the server 100 executes a development process on the frame data read in step S412 using the RAW development parameters indicated in the development request received from the PC 150. The development result obtained by the above development process is, for example, RGB format image data developed based on the RAW development parameters. The development result may be compressed according to any compression method such as JPEG.

[0035] In step S414, the server 100 transmits the development result from the development process executed in step S413 to the PC 150 that transmitted the development request, and ends the process of FIG. 4(b).

[0036] In step S403, PC 150 determines whether or not the development results corresponding to the development request transmitted in step S402 have been received from server 100. If PC 150 receives the development results (S403: YES), it proceeds to step S404, and repeats the waiting loop of step S403 while the development results have not been received (S403: NO).

[0037] In step S404, the PC 150 displays the received development result determined in step S403 in the preview area 320, and ends the processing in FIG.

[0038] Figures 4(c) and 4(d) are flowcharts showing the operations of the server 100 and the PC 150 when the user has finished editing the RAW video. More specifically, Figure 4(c) shows the operation of the PC 150 transmitting editing information indicating the editing contents by the user to the server 100, and Figure 4(d) shows the operation of the server 100 receiving the editing information from the PC 150. As described above, Figures 4(c) and 4(d) are executed in parallel with the cooperation of the server 100 and the PC 150.

[0039] In step S421, PC 150 determines whether or not the user has used input device 112 to issue an instruction to complete editing of the RAW video. The above completion instruction may be, for example, an operation to cut-edit the RAW video and export it in another file format, or an operation to temporarily save the cut-edited RAW video. When PC 150 receives the completion instruction (S421: YES), it proceeds to step S422, and while the completion instruction is not received (S421: NO), it repeats the wait loop of step S421.

[0040] In step S422, the PC 150 transmits editing information for the RAW video related to the completion instruction in step S421 to the server 100, and ends the process in Fig. 4(c) The above editing information includes identification information such as a user identifier that identifies the user who instructed the editing, the file name of the edited RAW video, the numbers or time codes of the first and last frames that identify the cut section, and the development settings for each frame.

[0041] In step S431, server 100 determines whether or not editing information has been received from PC 150. If server 100 receives editing information (S431: YES), the process proceeds to step S432, and while server 100 has not received editing information (S431: NO), the wait loop of step S431 is repeated.

[0042] In step S432, the server 100 stores the editing information received from the PC 150 in the HDD 104, and ends the process of FIG.

[0043] 4(a) and 4(c) may be executed by a plurality of PCs 150 that can access the server 100. Editing information transmitted from each of the plurality of PCs 150 based on the editing work of a plurality of users is stored in the HDD 104 of the server 100 in association with a user identifier.

[0044] Fig. 5 is a flowchart showing development control processing related to playback of a RAW video by the server 100. Fig. 5(b) is a flowchart showing in detail step S503 in Fig. 5(a).

[0045] In step S501, the server 100 determines whether or not a playback request for a RAW video has been received from the PC 150. If the server 100 receives a playback request (S501: YES), the server 100 proceeds to step S502, and while the server 100 has not received a playback request (S501: NO), the server 100 repeats the wait loop of step S501.

[0046] The above playback request is data that PC 150 transmits to server 100 in response to a user operation such as pressing a play button in control area 330. The above playback request also includes the file name and playback position of the RAW video to be played (e.g., the frame number indicating the target frame of the RAW video being displayed), as well as the user identifier of the user who performed the operation related to the playback request. Hereinafter, the user of PC 150 who transmitted the playback request for the RAW video is referred to as the "requesting user," and users other than the requesting user may be referred to as "other users."

[0047] In step S502, server 100 determines whether or not editing information associated with the user identifier included in the playback request for the RAW video related to the playback request received in step S501 is stored in HDD 104. If editing information of the requesting user exists (S502: YES), server 100 proceeds to step S504, and if editing information of the requesting user does not exist (S502: NO), server 100 proceeds to step S503.

[0048] In step S503, the server 100 executes steps S511 to S516 shown in Fig. 5(b). Although details will be described later, generally speaking, the development process is controlled based on the editing information of other users.

[0049] In step S504, the server 100 reads out from the HDD 104 and acquires the editing information of the requesting user for the RAW video to be played back.

[0050] In step S505, server 100 executes development processing based on the development settings indicated in the editing information of the requesting user read in step S504 at the playback position (target frame) indicated by the playback request, and transmits the development results to PC 150 that sent the playback request. PC 150 displays the development results received from server 100 in preview area 320.

[0051] Thereafter, the server 100 continues the development process of the RAW video starting from the playback position indicated by the playback request and the transmission process of the development results. However, when a playback stop request is received from the PC 150 that sent the playback request, or when playback of the RAW video ends (i.e., when the development process and transmission process for the final frame of the RAW video is completed), the server 100 stops the development process and transmission process.

[0052] Next, the processes of steps S511 to S516 included in step S503 will be described with reference to FIG. 5(b).

[0053] In step S511, the server 100 reads and acquires editing information of other users for the target frame on which development processing is to be performed from the HDD 104. When step S511 is performed for the first time, the target frame is the position at which playback indicated by the playback request is to start.

[0054] In step S512, the server 100 determines whether the number n of editing information pieces (number of edits) of other users in the target frame is equal to or greater than a predetermined threshold value N. If the number n of editing information pieces is equal to or greater than the threshold value N (S512: YES), the server 100 proceeds to step S513, and if the number of editing information pieces is less than the threshold value N (S512: NO), the server 100 proceeds to step S515.

[0055] In step S513, the server 100 determines whether the number m of editing information whose editing content is “cut” (the number of cut edits) among the editing information of other users in the target frame is equal to or greater than a predetermined threshold value M. If the number m of the corresponding editing information is equal to or greater than the threshold value M (S513: YES), the server 100 proceeds to step S514, and if the number m of the corresponding editing information is less than the threshold value M (S512: NO), the server 100 proceeds to step S515.

[0056] In step S514, server 100 executes simple development processing (simple development) on the target frame, and transmits the development result of the simple development to PC 150 that transmitted the playback request. PC 150 displays the development result received from server 100 in preview area 320.

[0057] The above simplified development processes impose a lighter processing load on the CPU 101 than normal development processes, such as development processes that omit some processes or development processes for RAW moving images with reduced resolution. Examples of processes that may be omitted include, but are not limited to, sharpness processing, noise removal processing, false color suppression processing, and moire suppression processing.

[0058] In step S515, server 100 executes normal development processing (normal development) on the target frame, and transmits the development result of the normal development to PC 150 that sent the playback request. PC 150 displays the development result received from server 100 in preview area 320.

[0059] In step S516, the server 100 determines whether the current target frame is the final frame of the RAW video. If the target frame is the final frame (S516: YES), the server 100 ends the process, and if the target frame is not the final frame (S516: NO), the server 100 advances the target frame to the next frame and returns the process to step S511.

[0060] Fig. 6 is an explanatory diagram of the target section of simplified development (simple development section) realized by the above process (particularly steps S513 and S514 in Fig. 5(b)). Fig. 6 shows a partial playback range (00:00:00:00 to 00:05:00:00) of RAW videos related to multiple users using time codes.

[0061] As shown in the figure, three other users 1 to 3 each capture different sections (time Like Other user 1 cuts the section 00:02:00:00 to 00:03:00:00, other user 2 cuts the section 00:02:10:00 to 00:02:50:00, and other user 3 cuts the section 00:01:45:00 to 00:02:55:00.

[0062] The section cut in common by the three other users 1 to 3 is the common cut section 00:02:10:00 to 00:02:50:00. In other words, the number of cut edits m in the common cut section 00:02:10:00 to 00:02:50:00 is "3." When the threshold value M in step S513 is "3," the determination in step S513 is YES in the above common cut sections, and NO in the other sections. As a result, simple development is applied to the common cut section 00:02:10:00 to 00:02:50:00.

[0063] Since sections cut by many users are likely to be sections of low importance to the users, there is little possibility that problems will occur even if the video quality is low. By applying simple development to the RAW video (target frames) of sections that are likely to be cut by other users in response to a playback request from a requesting user who has not performed editing, it is possible to achieve both video quality of sections (ranges) of high importance and a reduction in the processing load on the server 100.

[0064] 6, simple development is applied to the sections cut by multiple other users in common (i.e., the parts where multiple cut sections are combined under an AND condition) (M=number of editing users). However, simple development may also be applied to the sections cut by any of the multiple other users (i.e., the parts where multiple cut sections are combined under an OR condition) (M=1).

[0065] According to the configuration of the present embodiment described above, a development processing method for a RAW video (target frame) is selected according to editing information indicating the editing contents by the user. As a result, the load of video development processing on the server 100 can be reduced.

[0066] <Second embodiment> The second embodiment of the present invention will be described below. In each of the embodiments exemplified below, the elements whose actions and functions are equivalent to those of the first embodiment will be designated by the same reference numerals as those in the above description, and the description of each will be omitted as appropriate. The configurations and operations of the first embodiment shown in Figs. 1 to 4 are applied mutatis mutandis to the second embodiment.

[0067] In the first embodiment, the development process is controlled based on editing information that indicates the editing content (cut editing, etc.) for a section that is a time range. In the second embodiment, the development process is controlled based on editing information that indicates the editing content (crop editing, etc.) for an image area range.

[0068] Fig. 7 is a flowchart showing the development control process of the server 100 regarding the playback of a RAW video. Fig. 7(b) is a flowchart detailing step S703 in Fig. 7(a). Steps S701, S702, S704, and S705 in Fig. 7(a) are similar to steps S501, S502, S504, and S505 in Fig. 5(a) of the first embodiment, and therefore will not be described.

[0069] With reference to Fig. 7(b), the processing of steps S711 to S717 included in step S703 will be described. Steps S711, S712, S716, and S717 in Fig. 7(b) are similar to steps S511, S512, S515, and S516 in Fig. 5(b) of the first embodiment, and therefore description thereof will be omitted.

[0070] In step S713, the server 100 determines whether the number m of editing information whose editing content is "crop" (the number of crop edits) among the editing information of other users read in step S711 is equal to or greater than a predetermined threshold value M. Here, crop means an editing process of cutting out a part of the entire area of ​​a frame, and will be described later with reference to Fig. 8. If the number m of the corresponding editing information is equal to or greater than the threshold value M (S713: YES), the server 100 proceeds to the process of step S714, and if the number m of the corresponding editing information is less than the threshold value M (S712: NO), the server 100 proceeds to the process of step S716.

[0071] In step S714, the server 100 refers to the editing information related to crop editing, and identifies a common uncropped area (areas 0 to s1, e3 to W in FIG. 8) that has not been cropped by any other user in the target frame.

[0072] In step S715, the server 100 performs simplified development on the common uncropped area identified in step S714, while performing normal development on the other cropped areas. The server 100 transmits the development results of the target frame including the simplified development area and the normal development area to the PC 150 that transmitted the playback request. The PC 150 displays the development results received from the server 100 in the preview area 320.

[0073] Fig. 8 is an explanatory diagram of the target area of ​​simplified development (simple development area) realized by the above process (particularly steps S713 to S715 in Fig. 7(b)). Fig. 8 shows image areas 0 to W in one frame of a RAW video.

[0074] As shown in the figure, three other users 1 to 3 are cropping and editing different regions (spatial ranges) of the same RAW video frame. Other user 1 crops the region s1 to e1, other user 2 crops the region s2 to e2, and other user 3 crops the region s3 to e3.

[0075] The areas cropped by any of the three other users 1 to 3 are cropped areas s1 to e3. In other words, the areas not cropped by any of the three other users 1 to 3 (common uncropped areas) are areas 0 to s1 and e3 to W. Therefore, the above common uncropped areas are identified in step S714, and simplified development is performed on the common uncropped areas in step S715.

[0076] Areas that are not cropped by many users are likely to be areas that are of low importance to the users, so there is a low possibility that problems will occur even if the video quality is low. By applying simple development to areas within a frame that are not cropped by other users in response to a playback request from a requesting user who is not editing, it is possible to achieve both video quality in areas (ranges) that are of high importance and a reduction in the processing load on the server 100.

[0077] In Fig. 8, simplified development is applied to an area that is not cropped by multiple other users (i.e., a portion where multiple uncropped areas are combined with an AND condition). However, simplified development may be applied to an area that is not cropped by a predetermined number of other users.

[0078] 8, for simplicity of explanation, a configuration in which crop editing is applied in the horizontal direction is described, but the processing of this embodiment can also be applied to a configuration in which crop editing is applied in the vertical direction, and to a configuration in which crop editing is applied in both the horizontal and vertical directions.

[0079] According to the configuration of the present embodiment described above, a development processing method for a RAW video (target area) is selected according to editing information indicating the editing contents by the user. As a result, the load of video development processing on the server 100 can be reduced.

[0080] <Modification> The above embodiment can be modified in various ways. Specific modified aspects are exemplified below. Two or more aspects selected from the above embodiment and the following examples can be appropriately combined as long as they are not mutually inconsistent.

[0081] In the above-described embodiment (particularly, steps S514 and S715), the processing load of the server 100 is reduced by executing simplified development on the specified range (section, area). However, other development processes with reduced load, such as a process of thinning out frames of a RAW video at regular intervals, may also be executed.

[0082] With respect to the above embodiment, the server 100 may adjust the processing contents of the simplified development in accordance with the number of other users who performed cut editing or crop editing (the number m of corresponding editing information). For example, the server 100 may change the processing contents so that the more the number m of corresponding editing information is, the more processing in the development process is omitted, and thus the processing load is reduced. In addition, when the total number T of users who edit RAW videos (total number of users) is determined, the server 100 may determine whether or not to perform simplified development based on the ratio (m / T) of the number m of corresponding editing information to the total number T of users.

[0083] With regard to the above-described embodiment, when a specific instruction such as pausing is given to a frame that has been simply developed, or when development parameters are adjusted for a frame that has been simply developed, the server 100 may re-send the normal development result of that frame to the PC 150.

[0084] In the embodiment described above, the section to which simplified development is applied may be clearly indicated by a predetermined figure such as an icon or mark in the timeline area 340 of the display screen 300.

[0085] Regarding the above-described embodiment, the server 100 may perform personal authentication of a user who accesses the server 100 using the PC 150. A plurality of users may be grouped based on a profile. For example, the server 100 may form a group of users with matching attributes or preferences. The server 100 preferably counts the number n, m of editing information indicating execution of a predetermined editing process from among the editing information corresponding to the users included in the group. In addition, the server 100 may weight the count value based on the profile.

[0086] In the above embodiment, the application AP of the server 100 may have a function of confirming with the user who generated the editing information whether or not he / she permits other users to use the editing information. It is preferable that the server 100 does not include the editing information of a user who has not obtained permission to use the editing information in the number n and m of editing information.

[0087] In the above embodiment, the application AP is executed in the PC 150. However, the application AP may be executed at any location. For example, the server 100 may execute the application AP. In this case, it is preferable that the server 100 transmits data indicating the display screen 300 to the PC 150 to display it on the display 160, and the PC 150 transmits data indicating an operation on the display screen 300 to the server 100.

[0088] In the above-described embodiment, the development process (playback process) for RAW moving images is controlled. However, the configuration of the present invention can be applied to moving images (original moving images) in any format, such as H.264 format moving images. For example, for sections with low importance, the load of the decoding process can be reduced by thinning out frames at regular intervals during playback.

[0089] Although the preferred embodiment of the present invention has been described above, the present invention is not limited to the above-mentioned embodiment, and various modifications and changes are possible within the scope of the gist of the present invention. For example, the present invention can be realized by supplying a program that realizes one or more functions of the above-mentioned embodiment to a system or device via a network or a storage medium, and having one or more processors of a computer in the system or device read and execute the program. Under the control of an application AP, some or all of the functions of the above-mentioned embodiment may be realized by an operating system running on a computer. The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0090] The program code read from the storage medium or supplied from the network realizes the functions in the above-mentioned embodiments, and the storage medium itself that stores the program code also constitutes the present invention. Examples of the above-mentioned storage medium include, but are not limited to, a hard disk, a ROM, a RAM, a non-volatile memory card, a CD-ROM, a CD-R, a DVD, an optical disk, a magneto-optical disk, and an MO. Examples of the above-mentioned network include, but are not limited to, a LAN (local area network) and a WAN (wide area network). [Explanation of symbols]

[0091] 100 Server (information processing device) 101 CPU (editing means, developing means) 150 PC (user device)

Claims

1. an editing means for executing a predetermined editing process on the RAW video in accordance with editing information transmitted from a plurality of devices including a user device and another user device, in order to identify a time range of the RAW video that is unnecessary for a user of the device that transmitted the editing information; a developing unit that executes either a first developing process or a second developing process having a smaller processing load than the first developing process for a time range of the RAW moving image, An information processing device characterized in that when a request to play the RAW video is received from the user device and the editing information transmitted from the other user device is not held, the developing means performs the second developing process on a range of the temporal range of the RAW video that is unnecessary for a user of the other user device, which range is identified in accordance with the editing information transmitted from the other user device, and performs the first developing process on another temporal range of the RAW video.

2. when the number of multiple pieces of editing information that at least partially overlap the temporal range of the RAW moving image for which the predetermined editing process is performed is equal to or greater than a threshold, the developing unit performs the second developing process on the temporal range of the RAW moving image that is specified in accordance with the multiple pieces of editing information; 2. The information processing device according to claim 1, characterized in that, when the number of multiple pieces of editing information that overlap at least a portion of the temporal range of the RAW video for which the specified editing process is performed is not equal to or greater than a threshold, the developing means performs the first developing process on the temporal range of the RAW video specified in accordance with the multiple pieces of editing information.

3. the developing means adjusts the load by omitting a part of the second developing process for an unnecessary range specified in accordance with each piece of editing information in accordance with the number of pieces of editing information indicating execution of the predetermined editing process; 3. The information processing apparatus according to claim 1, wherein the greater the number of pieces of editing information, the more processes are omitted from the second development processing.

4. The information processing device according to claim 2 or claim 3, characterized in that the number of editing information indicating the execution of the specified editing process is counted from among the editing information transmitted from user devices of multiple users included in a group to which the user of the user device that transmitted the editing information belongs.

5. An information processing device as described in any one of claims 2 to 4, characterized in that when counting the number of editing information indicating the execution of the specified editing process, the number of editing information transmitted from a user device that does not permit other user devices to use the editing information is not counted.

6. 6. An information processing device according to claim 1, wherein when the developing means receives from the user device an instruction to pause playback for the range on which the second developing process has been performed or an instruction to adjust development parameters for the range on which the second developing process has been performed, the developing means performs the first developing process for the range.

7. The information processing apparatus according to claim 1 , further comprising a display unit that displays, using a graphic, the range to which the second development processing has been applied.

8. An information processing device as described in any one of claims 1 to 7, characterized in that the specified editing process executed in accordance with editing information transmitted from a user device is a cut edit that prevents unnecessary ranges of the time range of the RAW video identified by the specified editing process from being played back when playback of the RAW video is requested from the user device.

9. an editing means for executing a predetermined editing process on the RAW video in accordance with editing information transmitted from a plurality of devices including a user device and another user device, in order to identify a range of an image area of ​​the RAW video that is necessary for a user of the device that transmitted the editing information; a developing unit that executes either a first developing process or a second developing process having a smaller processing load than the first developing process on an image area of ​​the RAW moving image, An information processing device characterized in that when a request to play the RAW video is received from the user device and the editing information transmitted from the other user device is not retained, the developing means performs the first developing process on a range of image area-like ranges of the RAW video that is necessary for the user of the other user device, which range is identified in accordance with the editing information transmitted from the other user device, and performs the second developing process on other image area-like ranges of the RAW video.

10. when the number of multiple pieces of editing information that overlap at least a portion of the image area-like range of the RAW video on which the predetermined editing process is performed is equal to or greater than a threshold, the developing unit performs the second developing process on the image area-like range of the RAW video specified in accordance with the multiple pieces of editing information; 10. The information processing device according to claim 9, characterized in that, when the number of multiple pieces of editing information that overlap at least a portion of the image area-like range of the RAW video on which the specified editing process is performed is not equal to or greater than a threshold, the developing means performs the first developing process on the image area-like range of the RAW video specified in accordance with the multiple pieces of editing information.

11. the developing means adjusts the load by omitting a part of the second developing process for a range other than a necessary range specified in accordance with each editing information in accordance with the number of editing information indicating execution of the predetermined editing process; 11. The information processing apparatus according to claim 9, wherein the greater the number of pieces of the editing information, the more processes in the second development process are omitted.

12. The information processing device according to claim 10 or 11, characterized in that the number of editing information indicating the execution of the specified editing process is counted from among the editing information transmitted from user devices of multiple users included in a group to which the user of the user device that transmitted the editing information belongs.

13. An information processing device as claimed in any one of claims 10 to 12, characterized in that when counting the number of pieces of editing information indicating the execution of the specified editing process, the number of pieces of editing information transmitted from a user device that does not permit other user devices to use the editing information is not counted.

14. 14. The information processing device according to claim 9, wherein when the developing means receives from the user device an instruction to pause playback for the range on which the second developing process has been performed or an instruction to adjust development parameters for the range on which the second developing process has been performed, the developing means performs the first developing process for the range.

15. The information processing apparatus according to claim 9 , further comprising a display unit that displays a range to which the second development processing has been applied using a graphic.

16. executing a predetermined editing process on the moving image in accordance with editing information transmitted from a plurality of devices including the user device and another user device, for identifying a time range of the RAW moving image that is unnecessary for a user of the device that transmitted the editing information; executing either a first development process or a second development process having a smaller processing load than the first development process for a time range of the RAW moving image; an information processing method comprising: when a request to play the RAW video is received from the user device and the editing information transmitted from the other user device is not held, the second development process is performed on a range of the temporal range of the RAW video that is unnecessary for a user of the other user device, which range is identified in accordance with the editing information transmitted from the other user device; and the first development process is performed on another temporal range of the RAW video.

17. executing a predetermined editing process on the RAW video in accordance with editing information transmitted from a plurality of devices including the user device and another user device, for identifying a range of an image area of ​​the RAW video that is necessary for a user of the device that transmitted the editing information; executing either a first development process or a second development process having a smaller processing load than the first development process on an image area-like range of the RAW moving image; An information processing method characterized in that, when a request to play the RAW video is received from the user device and the editing information transmitted from the other user device is not retained, the first development process is performed on a range of the image area of ​​the RAW video that is necessary for the user of the other user device and is identified in accordance with the editing information transmitted from the other user device, and the second development process is performed on other image area ranges of the RAW video.

18. A program for causing a computer to function as each of the means of the information processing device according to any one of claims 1 to 15.

Citation Information

Patent Citations

  • Image processing device and its control method

    JP2009171060A

  • Device, method, and program for managing image, and recording medium

    JP2010206718A

  • Picture processing system and picture imaging apparatus

    JP2015171042A

  • Image processing apparatus

    JP2018182550A