Program, information processing system and information processing method

Abstract

To provide a technique for avoiding complicated situations when editing image (moving image) data.SOLUTION: There is provided a program used at an imaging site. The program causes a computer to execute the following steps: a reception step of receiving first image data captured by an imaging device; a reading step of reading second image data stored in advance in a storage unit; and a display control step of superimposing the second image data on the first image data being captured and continuously displaying them on a preview screen, where the preview screen is configured to allow adjustment of transparency of one of the first image data and the second image data with respect to the other.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a program, an information processing system, and an information processing method.

Background Art

[0002] In the prior art, a technique for editing color data and the like of image (video) data photographed at a shooting site according to an instruction such as supervision has been disclosed (Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When editing image (video) data, for example, if the position of the subject is deviated from the desired position, there is a concern that the work load of data editing increases and a complicated situation occurs.

[0005] In view of the above circumstances, the present invention aims to provide a technique for avoiding a complicated situation when editing image (video) data.

Means for Solving the Problems

[0006] According to one aspect of the present invention, a program used at a shooting site is provided. This program causes a computer to execute the following steps. In the reception step, first image data being imaged by an imaging device is received. In the reading step, second image data stored in a storage unit in advance is read out. In the display control step, on a preview screen, the second image data is superimposed on the first image data being imaged and continuously displayed. The preview screen is configured to be able to adjust the transparency of one of the first image data and the second image data with respect to the other.

[0007] According to the present disclosure, when editing image (video) data, it is possible to avoid a complicated situation.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Mode for Carrying Out the Invention

[0009] [Embodiment] Hereinafter, embodiments of the present invention will be described with reference to the drawings. Various characteristic matters shown in the following embodiments can be combined with each other.

[0010] Incidentally, the program for realizing the software that appears in this embodiment may be provided as a non-transitory computer-readable medium that can be read by a computer, may be provided so as to be downloadable from an external server, or may be provided so that the program is started on an external computer and its functions are realized on a client device (so-called cloud computing).

[0011] Also, in this embodiment, the “section” may include, for example, a combination of hardware resources implemented by a circuit in a broad sense and information processing of software that can be specifically realized by these hardware resources. Also, in this embodiment, various types of information are handled, and these types of information are represented, for example, by physical values of signal values representing voltage and current, the high and low of signal values as a set of binary bits composed of 0 or 1, or quantum superposition (so-called quantum bits), and communication and calculation can be executed on a circuit in a broad sense.

[0012] Also, a circuit in a broad sense is a circuit realized by appropriately combining at least a circuit, circuitry, a processor, a memory, and the like. That is, it includes an application specific integrated circuit (ASIC), a programmable logic device (for example, a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)), and the like.

[0013] 1. System Configuration 1.1 Information Processing System 1 FIG. 1 is an example of the system configuration of the information processing system 1. In one example, the information processing system 1 includes an information processing apparatus 2, a plurality of imaging apparatuses 3, and a display apparatus 4. The plurality of imaging apparatuses 3 are connected to the information processing apparatus 2 via a general-purpose or dedicated communication standard. The display apparatus 4 is connected to the information processing apparatus 2 via a general-purpose or dedicated communication standard. Here, the system exemplified in the information processing system 1 is composed of one or more devices or components. Therefore, even the information processing apparatus 2 alone is included in the system exemplified in the information processing system 1. Hereinafter, each component included in the information processing system 1 will be further described.

[0014] 1.2 Information Processing Apparatus 2 FIG. 2 is a block diagram showing the hardware configuration of the information processing apparatus 2. The information processing apparatus 2 has a communication unit 21, a storage unit 22, a control unit 23, and an input unit 25, and these components are electrically connected via a communication bus 20 inside the information processing apparatus 2. Each component will be further described.

[0015] The communication unit 21 preferably uses wired communication means such as USB, IEEE1394, Thunderbolt (registered trademark), and wired LAN network communication. However, wireless LAN network communication, mobile communication such as 3G / LTE / 5G, Bluetooth (registered trademark) communication, etc. may be included as necessary. That is, it is more preferable to implement it as a set of these multiple communication means. That is, the information processing apparatus 2 may communicate various information from the outside via the communication unit 21 and the communication network. Particularly preferably, the communication unit 21 is connected to the plurality of imaging apparatuses 3 and the display apparatus 4 via a general-purpose or dedicated communication standard, respectively.

[0016] The storage unit 22 stores various types of information defined by the foregoing description. This can be implemented, for example, as a storage device such as a Solid State Drive (SSD) that stores various programs and the like related to the information processing apparatus 2 executed by the control unit 23, or as a memory such as a Random Access Memory (RAM) that stores temporarily necessary information (arguments, arrays, etc.) related to the calculation of programs. The storage unit 22 stores various programs, variables, etc. related to the information processing apparatus 2 executed by the control unit 23.

[0017] The control unit 23 performs processing and control of the overall operation related to the information processing apparatus 2. The control unit 23 is, for example, a Central Processing Unit (CPU) not shown in the figure. The control unit 23 realizes various functions related to the information processing apparatus 2 by reading a predetermined program stored in the storage unit 22. That is, the information processing by software stored in the storage unit 22 is specifically realized by the control unit 23 which is an example of hardware, and can be executed as each functional unit included in the control unit 23. These will be described in more detail in the next section. Note that the control unit 23 is not limited to being single, and may be implemented to have a plurality of control units 23 for each function, or a combination thereof. That is, the control unit 23 is an example of a processor capable of executing a program for executing each step described later.

[0018] The input unit 25 may be included in the housing of the information processing apparatus 2 or may be externally attached. For example, the input unit 25 may be implemented as a touch panel integrated with the display device 4 described later. In the case of a touch panel, the user can input a tap operation, a swipe operation, etc. Of course, instead of the touch panel, a switch button, a mouse, a QWERTY keyboard, etc. may be adopted. That is, the input unit 25 receives the operation input made by the user. The input is transferred as a command signal to the control unit 23 via the communication bus 20, and the control unit 23 can execute predetermined control and calculation as necessary.

[0019] Note that the information processing apparatus 2 may be a computer installed with a general-purpose OS, or may be a dedicated device equipped with a dedicated circuit related to signal processing.

[0020] 1.3 Imaging device 3 The imaging device 3 is a so-called vision sensor (camera) configured to be able to acquire external information as an image. The resolution of the imaging device 3 is not particularly limited, and an imaging device 3 with high spatial resolution (resolution) may be adopted, or an imaging device 3 with high temporal resolution (frame rate) is preferably adopted. In one example, as n imaging devices 3, imaging devices 3-1, 3-2, 3-3 ··· 3-n are connected to the information processing apparatus 2.

[0021] The resolution of the imaging device 3 may be below Full HD, or Full HD, or WQHD, or 2K, or 4K, or 8K, or more.

[0022] Specifically, for example, the frame rate of the imaging device 3 is 1, 2, 10, 15, 20, 25, 30, 45, 60, 100, 125, 150, 175, 200, 225, 250, 275, 300, 325, 350, 375, 400, 425, 450, 475, 500, 525, 550, 575, 600, 625, 650, 675, 700, 725, 750, 775, 800, 825, 850, 875, 900, 925, 950, 975, 1000, 1025, 1050, 1075, 1100, 1125, 1150, 1175, 1200, 1225, 1250, 1275, 1300, 1325, 1350, 1375, 1400, 1425, 1450, 1475, 1500, 1525, 1550, 1575, 1600, 1625, 1650, 1675, 1700, 1725, 1750, 1775, 1800, 1825, 1850, 1875, 1900, 1925, 1950, 1975, 2000 fps, and it may also be within the range between any two of the values exemplified here. Alternatively, a processing rate having one second or more per frame may also be acceptable.

[0023] 1.4 Display device 4 The display device 4 is configured to be able to display a time-series image (video) output from the information processing device 2. The display device 4 is, for example, a CRT display, a liquid crystal display, an organic EL display, a plasma display, or the like. Further, the display device 4 may include an audio output unit (not shown). The audio output unit is configured to be able to output the audio of the video output from the information processing device 2. Note that the information processing system 1 may be implemented to have a plurality of display devices 4.

[0024] 2. Functional configuration In this section, the functional configuration of the present embodiment will be described. As described above, the information processing by the software stored in the storage unit 22 is specifically realized by the control unit 23 which is an example of hardware, so that each functional unit included in the control unit 23 can be executed.

[0025] FIG. 3 is a block diagram showing the functions realized by the control unit 23 and the like in the information processing device 2 according to the present embodiment. Specifically, the information processing device 2 includes, as each functional unit, a reading unit 231, a receiving unit 232, a superimposing processing unit 233, and an output unit 235.

[0026] The reading unit 231 is configured to read various information stored in the storage unit 22 by writing it into the cache memory of the storage unit 22.

[0027] The receiving unit 232 is configured to receive various information from the outside. Preferably, it receives the video output from the imaging device 3.

[0028] The superimposing processing unit 233 superimposes another image (video) on the video (image or video) captured by the imaging device 3.

[0029] The output unit 235 causes a display device 4 to display various information, or a screen, an image, etc. including these in a visible manner. The output unit 235 may generate only rendering information for causing the display device 4 to display visual information. Further, the output unit 235 may output audio data or may output metadata.

[0030] 3. Flow of Operations of Information Processing System 1 An example of preferable information processing executed in the information processing system 1 of the embodiment will be described.

[0031] 3.1 Outline of Information Processing The program according to the embodiment is a program used at the shooting site. And this program causes a computer to execute the following respective steps. That is, the program causes the computer to execute a reception step, a reading step, and a display control step as described below.

[0032] Further, the information processing system 1 includes at least one processor (for example, the control unit 23) capable of executing the program so that each step of this program is performed.

[0033] Further, the information processing method executed by the information processing system 1 includes each step of the program.

[0034] Note that regarding the above respective steps, the order of start is not limited to the order of description. For example, regarding the order of the reception step and the reading step, the reading step may be started first, or vice versa, or they may be simultaneous.

[0035] FIG. 4 is an activity diagram showing an example of information processing according to the embodiment. Hereinafter, the description will be continued with reference to the activity diagram shown in FIG. 4. Here, an example will be taken in which each image captured by the imaging device 3 having the number of channels n is processed in the information processing device 2 and the output image is displayed on the display device 4.

[0036] When the user executes the application of the information processing system 1 according to the embodiment, the reading unit 231 reads out the program according to the embodiment from the storage unit 22, and various processes described later are executed.

[0037] (Activity A001) In Activity A001, the captured image (an example of the first image data) captured by the imaging device 3 with the number of channels n is transmitted to the information processing device 2. Activity A001 is an example of a configuration (step) in which, in the reception step, the first image data being captured by the imaging device 3 is received. In other words, the reception unit 232 of the information processing device 2 receives, as the reception step, the captured image output by at least one imaging device 3 connected to the information processing device 2. Note that the reception unit 232 may receive audio data together with the captured image.

[0038] (Activity A002) In Activity A002, the output unit 235 of the information processing device 2 outputs the data related to the preview screen to the display device 4, and the display device 4 starts displaying the preview screen. Note that the configuration of the interface of the preview screen will be described later. This preview screen may include the number of captured images corresponding to the number of channels n, and the number can be set appropriately by the user.

[0039] (Activity A003) In Activity A003, the reading unit 231 of the information processing device 2 reads out the selected image (an example of the second image data) from the storage unit 22. Activity A003 is an example of a configuration (step) in which, in the reading step, the second image data stored in advance in the storage unit is read out.

[0040] Here, in the embodiment, the selected image is an image selected by the user. That is, in the reading step, the second image data can be selected by the user. Thereby, the user can select the second image data according to the shooting situation, which is excellent in convenience.

[0041] In the embodiment, the image is selectable by the user, but it is not limited to this and may be predetermined. For example, the information processing apparatus 2 can automatically determine second image data considered appropriate according to the content of the captured image, and use this as the data to be read in this activity A003.

[0042] (Activity A004) In activity A004, the superimposing processing unit 233 of the information processing apparatus 2 sets the transparency. Activity A004 is an example of a configuration in which the preview screen is configured to be able to adjust the transparency of one of the first image data and the second image data with respect to the other. In the embodiment, an example of the first image data is a captured image, and an example of the second image data is a selected image, but it is the captured image whose transparency can be adjusted. The form in which the selected image can be adjusted will be described later in the modification example.

[0043] The information processing apparatus 2 has a function of continuously displaying by superimposing the image selected in activity A003 on the captured image, and in doing so, the transparency of the captured image can be adjusted. Here, for example, alpha blending can be adopted for the adjustment of the transparency by the information processing apparatus 2. In this case, the alpha value is an example of the transparency.

[0044] In a state where the set value of the transparency has not yet been received from the user, such as immediately after the preview screen is displayed, the superimposing processing unit 233 sets the initial value as the transparency. The initial value may be, for example, a predetermined value, or may be the value of the transparency set when the user previously started the application of the information processing system 1 according to the embodiment.

[0045] In addition, the reception unit 232 of the information processing apparatus 2 sequentially receives the transparency input from the user, and when there is an input of the transparency from the user, the superimposing processing unit 233 sets the transparency corresponding to the input.

[0046] (Activity A005) In Activity A005, the superimposing processing unit 233 of the information processing apparatus 2 generates a superimposed image 51 based on the captured image, the selected image, and the transparency.

[0047] The superimposed image 51 is an image in which the selected image is superimposed on the captured image. However, the captured image in the superimposed image 51 is an image adjusted to the transparency set in Activity A004. The larger the set transparency, the thinner the content corresponding to the captured image among the images displayed on the preview screen.

[0048] By repeating Activity A004 and Activity A005, the information processing system 1 can sequentially accept the transparency and display the superimposed image 51 reflecting the transparency on the preview screen.

[0049] In the information processing system 1, the captured image is continuously accepted in Activity A001, the preview screen is displayed in Activity A002, and Activity A004 and Activity A005 are repeatedly executed to sequentially generate the superimposed image 51. These series of processes are an example of a configuration (step) in which, in the display control step, on the preview screen, the second image data is superimposed on the first image data being captured and continuously displayed.

[0050] Note that the above series of activities are merely examples.

[0051] For example, in the above, it has been described that the captured image is displayed on the preview screen at the timing before the superimposed image 51 is generated (the timing of Activity A002), but it is not limited to this.

[0052] For example, after completing the first Activity A005 and generating the superimposed image 51 for the first time, a process may be performed to display the captured image together with the selected image on the preview screen.

[0053] 3.2 Details of Information Processing The detailed part of the information processing described above will be further described with reference to FIGS. 5 to 8.

[0054] FIG. 5 is a diagram showing the schematic configuration of a preview screen displayed on the display device 4. In FIG. 5, the case where the number of channels N = 4 is shown as an example.

[0055] FIG. 6 is a diagram showing an overlapping image 51 of any one channel included in the preview screen shown in FIG. 5 and an object for adjusting the transparency.

[0056] As shown in FIG. 5, in the preview screen, the captured images of each channel (each imaging device 3-n) are displayed in parallel on the preview screen. The display mode may be such that the captured images are displayed in independent windows, or may be arranged side by side horizontally in one window as shown in FIG. 5. Also, the plurality of captured images may be arranged side by side not only horizontally but also vertically.

[0057] 3.2.1 Information Processing Regarding the Arrangement of the Preview Screen A configuration example of the preview screen displayed in the above-described activity A002 will be described.

[0058] The preview screen has a display area 30 and an object 31.

[0059] The display area 30 is an area where various images (for example, a single captured image, a single selected image, an overlapping image 51, etc.) are displayed.

[0060] Object 31 is configured to adjust the transparency of one of the first image data and the second image data with respect to the other. As described above, in the embodiment, an example of the first image data is a captured image, and an example of the second image data is a selected image. Therefore, here, the object 31 can adjust the transparency for the captured image, which is an example of the first image data. In the information processing system 1, since the object 31 visualized on the preview screen in this way is displayed, the user can operate the object 31 on the preview screen to adjust the transparency according to the user's preference.

[0061] Object 31 may be arranged inside the display area 30, but it is preferably arranged outside the display area 30 because various images become difficult to see. Note that the object 31 may be configured to be movable to a desired position by the user, for example.

[0062] As shown in FIG. 6, the object 31 is a slider for adjusting the transparency. The object 31 may be a box into which a numerical value of the transparency can be input, but in the form of a slider, the operation of adjusting the transparency is easy.

[0063] 3.2.2 Information Processing Regarding Transparency Setting The transparency of the superimposed image 51 generated in the above-described activity A005 will be described in detail.

[0064] Here, a maximum transparency state and a minimum transparency state are defined.

[0065] In the maximum transparency state, the maximum set value is set as the transparency, and it is assumed that the captured image looks thinnest in the information processing apparatus 2.

[0066] In the minimum transparency state, the minimum set value is set as the transparency, and it is assumed that the captured image looks darkest in the information processing apparatus 2.

[0067] The superimposing processing unit 233 can adjust the transparency at a plurality of levels from the maximum setting value to the minimum setting value. In the embodiment, when the user operates the object 31, the transparency will be adjusted. Specifically, the number of adjustable levels can adopt any number from 2 to 256 (where each step is an integer), and it may also be within the range between any two of the numbers exemplified here.

[0068] In addition, when the number of levels is two, the user can select only the maximum setting value and the minimum setting value as the transparency.

[0069] Also, in the maximum transparency state and the minimum transparency state, it may be adjustable or fixed regarding how much transparency is given to the captured image.

[0070] For example, in the maximum transparency state, the captured image may not be displayed on the preview screen, or the captured image may be displayed on the preview screen although it is the thinnest display.

[0071] Also, in the minimum transparency state, the captured image itself may be displayed, or it may be displayed on the preview screen as a slightly thinner display.

[0072] 3.2.3 Information Processing Regarding the Selected Image For the selected image to be displayed on the preview screen, the contour image 40 can be adopted. In the embodiment, the contour image 40 has a contour body 41. The contour body 41 has a shape along the contour of the object to be imaged. Here, the object to be imaged corresponds to the first image data, and the contour body corresponds to the second image data.

[0073] In the display control step, on the preview screen, a contour body 41 having a shape corresponding to the contour of the object being imaged is continuously superimposed and displayed on the object being imaged during imaging. As a result, a person (e.g., an actor) captured by the imaging device 3 can face the shooting while checking their own position by looking at the contour body 41 on the preview screen of the display device 4 in a state of being at the position (shooting location) where the person is. By looking at the preview screen of the imaging device 3, the person captured by the imaging device 3 can easily notice that their position is outside the contour body 41 and can adjust their position to enter inside the contour body 41.

[0074] In the embodiment, since the object being imaged is a human, the contour body 41 has a first element 41a corresponding to the human head and a second element 41b corresponding to the human torso. Further, in the embodiment, the second element 41b is arranged below the first element, and its lateral width is larger than that of the first element 41a.

[0075] Also, in the display control step, the display position of the second image data on the preview screen can be set to a predetermined position. That is, the user can change the position of the contour body 41 as needed. Thereby, the user can set the position of the second image data to a desired position according to the shooting situation, which is excellent in convenience. Note that the method of changing the position may be a mode of inputting position coordinates or a mode in which the contour body 41 can be moved with the pointer 50.

[0076] 3.2.4 Information Processing Regarding Parallel Reception In the embodiment, the information processing apparatus 2 is configured to be able to acquire image data in parallel from a plurality of imaging devices 3 and generate data of a preview screen that displays each piece of image data. As a result, on the display device 4, a plurality of pieces of image data being captured are to be displayed in the preview screen at the same time. In other words, in the reception step, a plurality of first pieces of image data being captured by the plurality of imaging devices 3 are received in parallel. Then, in the display control step, a plurality of first pieces of image data being captured are simultaneously displayed on the preview screen. Thereby, in the embodiment, it is possible to support multi-channels.

[0077] Note that, at least one of the plurality of first pieces of image data has second image data superimposed thereon and is continuously displayed. That is, it is not necessary for the image data corresponding to all channels to be the superimposed image 51. For example, only the channel selected by the user can be made the superimposed image 51.

[0078] Note that, in the embodiment, although an example of a form in which the information processing system 1 is a multi-channel has been described, the present invention is not limited to this, and a single-channel form may also be used. That is, the information processing system 1 may be premised on a configuration that acquires image data from one imaging device 3.

[0079] 4. Method of Utilizing the Information Processing System 1 FIG. 7 is a diagram showing a state after adjusting the transparency setting to be larger than the transparency of the captured image shown in FIG. 6. FIG. 8 shows a state in which the subject (a human in the embodiment) has deviated from the contour of the selected image. With reference to FIG. 6 described above and FIGS. 7 and 8, a utilization example of the information processing system 1 will be described.

[0080] Staff such as a director at the shooting site may instruct the position of a person (subject) captured by the imaging device, and the person moves to a desired position and shooting may be performed. This is a measure taken in consideration of subsequent data editing work.

[0081] However, it is also conceivable that staff such as the director may have forgotten about the editing itself, or may have been distracted by the person's expression or mannerisms and not noticed that the position of the person shown in the captured image has shifted. And when editing the resulting image data (video data), if the position of the subject (such as a person) is shifted from the assumed position, there is a concern that it will lead to a complicated situation where the workload of subsequent editing increases and rework is required.

[0082] Therefore, it is preferable that the staff such as the director at the shooting site instruct the position of the person shown in the imaging device. As such an instruction, for example, expressions such as "a little more to the left" are assumed. However, it is ambiguous whether "left" is to the left as seen by the director or to the left as seen by oneself, and also, "a little more" is subjective in terms of how much distance it means, and this is also ambiguous. For this reason, there is a concern that it is difficult for the person shown in the imaging device to take appropriate actions.

[0083] On the other hand, in the embodiment, in order to continuously display the second image data (selected image) superimposed on the first image data (captured image), the person shown in the imaging device can easily correct his / her position based on the second image data (selected image) shown on the preview screen. For example, as shown in FIG. 8, the person shown in the imaging device can easily recognize that he / she is outside the contour body 41 as an example of the second image data, and can easily adjust his / her position so as to enter the inside of this contour body 41. In this way, the information processing system 1 can avoid a situation where an ambiguous instruction is given at the scene and the person shown in the imaging device 3 is confused.

[0084] Also, as shown in FIGS. 6 and 7, in the embodiment, it is possible to adjust the transparency of the first image data. Therefore, it is possible to easily distinguish and visually recognize the display object related to the first image data and the display object related to the second image data. That is, when the first image data and the second image data are difficult to see, the user can appropriately adjust the transparency as needed and can appropriately visually recognize both image data. Thereby, it is possible to avoid the photographed object being photographed at a position shifted from the assumed position, and it is possible to avoid complicated situations in the future.

[0085] Note that the contour image 40, which is an example of the second image data, has a mode in which the inside is completely transparent. Therefore, for the user, the inside portion of the contour body 41 in the captured image is visible. Here, instead of the contour image 40, an image that does not allow the inside to be transparent can also be used. Examples of such an image include a person's image (video). For example, if a performer could be photographed well in the past, the image data generated by that photographing can be used as the second image data (selected image).

[0086] However, in this case, when the display object related to the first image data and the display object related to the second image data overlap, there is a high concern that the display object of the first image data will not be visible. Then, although it can be known that the position of the person shown in the imaging device is inside the display object related to the second image data, the expression or the like of the person shown in the imaging device cannot be confirmed, which is inconvenient. On the other hand, in the embodiment, since the transparency of the first image data can be adjusted, even if the person's image data is used as the second image data, such inconveniences can be effectively avoided.

[0087] In addition to the above-described contour image 40 and the person's image, the second image data may be an indoor room (for example, a room in a house or an apartment, a room in an office, a room in a restaurant, etc.) or an outdoor scenery.

[0088] [Modification Example] FIG. 9 shows an example of the superimposed image 51 and the object 31 in the preview screen of the information processing system according to the modified example.

[0089] In the embodiment, it has been described that only the transparency of the captured image can be adjusted, but the present invention is not limited to this. In this modified example, both the transparency of the captured image (an example of the first image data) and the transparency of the selected image (an example of the second image data) can be adjusted. As shown in FIG. 9, for example, the object 31 has a slider for adjusting the transparency of the captured image (for example, arranged in the upper part) and a slider for adjusting the transparency of the selected image (for example, arranged in the lower part). Thereby, the user can select which image's transparency to adjust according to the situation, and can more effectively view both image data.

[0090] Note that in the embodiment, it has been described that only the transparency of the captured image can be adjusted, and in this modified example, it has been described that both the transparency of the captured image and the transparency of the selected image can be adjusted, but the present invention is not limited to this. Only the transparency of the selected image may be adjustable.

[0091] Also, in the embodiment, it has been described that the image data to be superimposed is one selected image, but the present invention is not limited to this, and a plurality of selected images may be superimposed on the captured image. In other words, in the display control step, a configuration may be adopted in which a plurality of second image data are superimposed on the first image data being captured and continuously displayed on the preview screen.

[0092] In the embodiment, an example of the form in which the information processing system 1 is used at the shooting site has been described, but the present invention is not limited to this. For example, the imaging device 3 may be a surveillance camera.

[0093] In the embodiment, an example of the form in which the image being captured by the imaging device 3 is displayed on the preview screen has been described, but the present invention is not limited to this. Instead of the image data being captured, a selected image may be superimposed on the recorded image data to generate the superimposed image 51.

[0094] It may be provided in each of the aspects described below.

[0095] (1) A program used at a shooting site, which causes a computer to execute the following steps: In the reception step, the first image data being captured by an imaging device is received; in the reading step, the second image data stored in a storage unit in advance is read out; in the display control step, on a preview screen, the second image data is superimposed on the first image data being captured and continuously displayed, where the preview screen is configured to be able to adjust the transparency of one of the first image data and the second image data with respect to the other.

[0096] According to such an aspect, a more user-friendly technology used at a shooting site can be provided. Specifically, when editing image (video) data captured at a shooting site, if the position of the subject (such as a person) is deviated from the assumed position, there is a concern that the workload of subsequent editing will increase and a cumbersome situation such as the need for re-shooting will occur. In one embodiment, the user can use the second image data as a reference while viewing the preview screen to grasp the position of the image (the first image data) being captured. Here, the transparency of one of the first image data and the second image data with respect to the other can be adjusted, and when the first image data and the second image data are difficult to see, the user can appropriately adjust the transparency and can appropriately view both image data. Thereby, it is possible to avoid the subject being photographed at a position deviated from the assumed position and to avoid a cumbersome situation occurring later.

[0097] (2) In the program described in (1) above, the preview screen has an object, and the object is configured to adjust the transparency of one of the first image data and the second image data with respect to the other.

[0098] According to such an aspect, the user can adjust the transparency according to his or her preference by operating the object on the preview screen.

[0099] (3) In the program according to (2) above, the object is a slider for adjusting the transparency.

[0100] According to such an aspect, the adjustment of the transparency is by a slider instead of numerical input, and the operation of adjusting the transparency is easy.

[0101] (4) In the program according to any one of (1) to (3) above, in the display control step, on the preview screen, a contour body having a shape corresponding to the contour of the object being imaged is superimposed and continuously displayed on the object being imaged, the object being imaged corresponds to the first image data, and the contour body corresponds to the second image data.

[0102] According to such an aspect, the user can face the shooting while viewing the contour body.

[0103] (5) In the program according to any one of (1) to (4) above, in the reception step, a plurality of the first image data being imaged by a plurality of the imaging devices are received in parallel, and in the display control step, on the preview screen, a plurality of the first image data being imaged are simultaneously displayed, where at least one of the plurality of the first image data has the second image data superimposed and continuously displayed.

[0104] According to such an aspect, it is also possible to support multi-channel.

[0105] (6) In the program according to any one of (1) to (5) above, in the display control step, the display position of the second image data on the preview screen can be set to a predetermined position.

[0106] According to such an aspect, the user can set the position of the second image data to a desired position according to the shooting situation, which is excellent in convenience.

[0107] (7) The program according to any one of (1) to (6) above, wherein in the reading step, the second image data is selectable by the user.

[0108] According to such an aspect, the user can select the second image data according to the shooting situation, which is excellent in convenience.

[0109] (8) An information processing system, comprising at least one processor capable of executing the program so that each step of the program according to any one of (1) to (7) above is performed.

[0110] According to such an aspect, it is possible to provide a technology used in a more user-friendly album art production site.

[0111] (9) An information processing method, comprising each step of the program according to any one of (1) to (8) above.

[0112] According to such an aspect, it is possible to provide a technology used in a more user-friendly album art production site. Of course, this is not the limit.

[0113] Finally, although various embodiments of the present invention have been described, these are presented as examples and are not intended to limit the scope of the invention. The novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. The embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and its equivalent scope.

Description of Reference Numerals

[0114] 1: Information processing system 2: Information processing device 20: Communication bus 21: Communication unit 22: Memory unit 23: Control unit 231: Reading unit 232: Reception unit 233: Superimposition processing unit 235: Output unit 25: Input unit 3: Imaging device 3-1: Imaging device 3-n: Imaging device 30: Display area 31: Object 4: Display device 40: Contour image 41: Contour body 41a: First element 41b: Second element 50: Pointer 51: Superimposed image

Claims

1. A program for use on set, Have the computer perform the following steps: In the receiving step, first image data being captured by the imaging device is received; In the reading step, the second image data stored in advance in the storage unit is read out; In the display control step, the second image data is superimposed on the first image data being captured on a preview screen and continuously displayed, and the preview screen is configured to be capable of adjusting the transparency of one of the first image data and the second image data relative to the other.

2. The program according to claim 1, the preview screen has an object; The object is configured to adjust the transparency of the first image data and the second image data relative to the other of the first image data and the second image data.

3. The program according to claim 2, A program, wherein the object is a slider that adjusts the transparency.

4. The program according to claim 1, In the display control step, a contour object having a shape corresponding to a contour of the object to be imaged is superimposed on the object to be imaged on the preview screen and continuously displayed; the object to be imaged corresponds to the first image data; The contour corresponds to the second image data.

5. The program according to claim 1, In the receiving step, a plurality of pieces of first image data being captured by a plurality of the imaging devices are received in parallel, In the display control step, a plurality of the first image data being captured is simultaneously displayed on the preview screen, and the second image data is superimposed on at least one of the plurality of the first image data and continuously displayed.

6. The program according to claim 1, A program, wherein in the display control step, a display position of the second image data on the preview screen can be set to a predetermined position.

7. The program according to claim 1, A program, wherein in the reading step, the second image data is selectable by a user.

8. An information processing system, A system comprising at least one processor capable of executing the program according to any one of claims 1 to 7 so as to perform each step of the program.

9. 1. An information processing method, comprising: A method comprising the steps of the program according to any one of claims 1 to 8.

Images