Image processing program and image processing apparatus

Abstract

To provide an image processing program for controlling the motion of an object disposed in a two-dimension space or an AR space. The present invention also provides an image processing device that controls the motion of an object placed in a two-dimension space or an AR space.SOLUTION: Acquiring, from data of a given object for generating first moving image data, position coordinates of the object in a first state at a first time point and position coordinates of the object in a second state at a second time point; The program causes the information processing apparatus to execute creating second moving image data in which a first period from a first time point to a second time point is changed to a second period different from the first period, and displacement of an object from position coordinates in a first state to position coordinates in a second state is performed in the second period.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to an image processing program and an image processing device, and more particularly to an image processing program and an image processing device that are applied to an object placed in a two-dimensional space or a space realized by augmented reality (hereinafter also referred to as AR). [Background technology]

[0002] With the spread of social networking services (SNS), communication tools using characters and photographed images are becoming more and more common. There is also a growing demand for the ability to easily edit these images using smartphones and tablet devices.

[0003] Augmented reality (AR) technology is becoming commonplace as a new technology that utilizes smartphones and tablet devices. Game applications that utilize AR technology are also widely used. For example, Patent Document 1 describes the use of AR technology in information processing for games and the like. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-41126 Summary of the Invention [Problem to be solved by the invention]

[0005] One of the image processing techniques known is a filter that adds a specific effect to an image. In AR technology, there is also a technique that recognizes an object placed in an AR space, such as a human face, and adds decorations that match its movement, but an image processing method such as a motion filter that adds a specific effect to the movement of an object has not been known until now.

[0006] In one embodiment, an image processing program is provided for controlling the movement of an object placed in two-dimensional or three-dimensional space. Also, in another embodiment, an image processing device is provided for controlling the movement of an object placed in two-dimensional or three-dimensional space. [Means for solving the problem]

[0007] According to one embodiment of the present invention, an image processing program is provided for causing an information processing device to obtain position coordinates of a first state of the object at a first time point and position coordinates of a second state of the object at a second time point from data of a given object for generating first moving image data, change a first period from the first time point to the second time point to a second period different from the first period, and generate second moving image data in which the object is displaced from the position coordinates of the first state to the position coordinates of the second state during the second period.

[0008] A designation of motion modification data for creating second moving image data based on the first moving image data may be accepted, and the second period may be set based on the motion modification data.

[0009] The first state and the second state may be determined based on a movement included in the first video data that satisfies a predetermined first condition.

[0010] The first state and the second state may be determined based on the playback time point of audio that satisfies a predetermined second condition, among the audio data that is played back in synchronization with the first video data.

[0011] At least a part of a playback period of a predetermined waveform of the audio data may be included between the first time point and the second time point in the first video data.

[0012] The first moving image data and the second moving image data may each be reproducible by an information processing device.

[0013] Furthermore, according to one embodiment of the present invention, there is provided an image processing device comprising: a storage unit that stores first moving image data of a given object; and an image processing unit that acquires, from the first moving image data of the given object, position coordinates of the object in a first state at a first time point and position coordinates of the object in a second state at a second time point, changes a first period from the first time point to a second period different from the first period, and creates second moving image data in which the object displaces from the position coordinates of the first state to the position coordinates of the second state during the second period. [Effects of the Invention]

[0014] In one embodiment, an image processing program is provided for controlling the movement of an object arranged in two-dimensional or three-dimensional space. Also, in one embodiment, an image processing device is provided for controlling the movement of an object arranged in two-dimensional or three-dimensional space. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a schematic diagram showing an image processing program providing system 1 according to an embodiment of the present invention. [Figure 2] 1 is a block diagram illustrating a terminal 10 according to an embodiment of the present invention. [Figure 3] FIG. 1 is a schematic diagram showing a server 30 according to an embodiment of the present invention. [Figure 4] FIG. 1 is a schematic diagram illustrating an example of video data (first video data) including an object 90 according to an embodiment of the present invention. [Figure 5] 1(a) is a schematic diagram showing the X-axis coordinate of a right hand 91 according to one embodiment of the present invention plotted against the time axis of first moving image data, and FIG. 1(b) is a schematic diagram showing the X-axis coordinate of a right hand 91 in second moving image data generated by applying motion modification data to the first moving image data plotted against the time axis. [Figure 6] FIG. 2 is a flowchart showing the processing of an image processing program according to an embodiment of the present invention. [Figure 7] 1(a) is a schematic diagram showing the X-axis coordinate of the right hand 91 in the second video data generated by an image processing program that applies motion modification data according to one embodiment of the present invention, plotted against the time axis; and FIG. 1(b) is a schematic diagram showing the X-axis coordinate of the right hand 91 in the second video data generated by an image processing program that applies motion modification data 11c that accelerates and changes the punching motion of the object 90, plotted against the time axis. [Figure 8] 3 shows a flow of image processing by an image processing program according to an embodiment of the present invention. [Figure 9] 3 shows a flow of image processing by an image processing program according to an embodiment of the present invention. [Figure 10] 1 shows a schematic diagram in which audio data reproduced in synchronization with first image data according to one embodiment of the present invention is plotted on a time axis. DETAILED DESCRIPTION OF THE INVENTION

[0016] The image processing program and image processing device according to the present invention will be described below. However, the image processing program and image processing device according to the present invention should not be construed as being limited to the description of the following embodiments and examples.

[0017] [Image processing program provision system] FIG. 1 is a schematic diagram showing an image processing program providing system 1 according to an embodiment of the present invention. The image processing program providing system 1 includes, for example, a terminal 10 (an example of an information processing device) and an image processing program providing server (hereinafter also referred to as a server) 30 connected via a network 20. The network 20 may be the Internet, and the server 30 connects to the network 20 via a wired connection 21 using a high-speed communication line such as optical fiber. The terminals 10 include, for example, a mobile phone terminal 10A such as a smartphone, a portable data terminal 10B such as a tablet terminal, and a personal computer (hereinafter also referred to as a PC) 10C. The mobile phone terminal 10A and the portable data terminal 10B connect to the network 20 via wireless communication 23 such as a mobile communication network or a wireless LAN. The PCs 10C include desktop PCs, laptop PCs, notebook PCs, tablet PCs, etc., and connect to the network 20 via the wired connection 21 or the wireless communication 23.

[0018] [Terminal (Image Processing Device)] The terminal 10 will be further described with reference to Fig. 2. Fig. 2 is a block diagram illustrating the terminal 10 according to one embodiment of the present invention. The terminal 10 includes, for example, a control unit 11, a storage unit 13, an input unit 15, a display unit 17, a communication unit 18, and a power supply unit 19.

[0019] The control unit 11 is a control device that controls the terminal 10, and includes, for example, a central processing unit (CPU) and a main storage device such as a semiconductor memory. The control unit 11 also includes a program that controls the terminal 10. The program that controls the terminal 10 is stored in the storage unit 13 and executed by the control unit 11. In one embodiment, the control unit 11 also includes an operating system (hereinafter also referred to as OS) that controls the terminal 10 and an image processing unit 11a that performs image processing. The image processing unit 11a includes an application program or module for image processing. The terminal 10 can also function as an image processing device by including the image processing unit 11a. In one embodiment, the image processing unit 11a can also include a condition detection unit 11b and motion modification data 11c, as will be described later.

[0020] The storage unit 13 is an auxiliary storage device such as a hard disk or a solid state disk (SSD), and stores an OS executed by the control unit 11 and application programs or modules for image processing that constitute the image processing unit 11a. When the image processing unit 11a executes image processing, the control unit 11 reads the application program or module for image processing from the storage unit 13.

[0021] The input unit 15 can be a general input device, such as a keyboard, a mouse, or a touch panel. The display unit 17 is a display device for displaying images processed by the image processing unit 11a, and can be, for example, a liquid crystal display or an organic EL display, but is not limited to these. The communication unit 18 is a communication device for connecting to the network 20 via a wired connection 21 or wireless communication 23. For example, the communication unit 18 includes a wired LAN adapter for the wired connection 21, or communication means conforming to wireless communication standards such as Wi-Fi (registered trademark) (a communication means using the IEEE 802.11 standard) or Bluetooth (registered trademark) for the wireless communication 23. The power supply unit 19 is a power supply device connected to an external power source, and a known power supply device can be used.

[0022] [server] Next, the server 30 will be described with reference to Fig. 3. Fig. 3 is a schematic diagram showing the server 30 according to one embodiment of the present invention. The server 30 includes, for example, a control unit 31, a storage unit 33, an input unit 35, a display unit 37, a communication unit 38, and a power supply unit 39.

[0023] The control unit 31 is a control device that controls the server 30 and includes, for example, a central processing unit (CPU) and a main storage device such as a semiconductor memory. The control unit 31 also includes a program that controls the server 30. The program that controls the server 30 is stored in the storage unit 33 and executed by the control unit 31. In one embodiment, the control unit 31 also includes an operating system (hereinafter also referred to as OS) that controls the server 30, an image processing program providing unit 31a that provides the terminal 10 with an image processing program, and a motion modification data providing unit 31b that provides the terminal 10 with motion modification data used by the terminal 10 for image processing. The image processing program providing unit 31a is configured as an application program or module for providing the image processing program to the terminal 10. The motion modification data providing unit 31b is configured as an application program or module for providing the terminal 10 with motion modification data. In one embodiment, the control unit 31 may further include an object data providing unit 31c that provides object data to the terminal 10.

[0024] The storage unit 33 is an auxiliary storage device such as a hard disk or solid state disk (SSD), and stores the OS, image processing program, and motion change data executed by the control unit 31. When the image processing program providing unit 31a provides the image processing program to the terminal 10, the image processing program providing unit 31a reads the image processing program from the storage unit 33. When the motion change data providing unit 31b provides the motion change data to the terminal 10, the motion change data providing unit 31b reads the motion change data from the storage unit 33.

[0025] The input unit 35 can be a general input device, such as a keyboard or a mouse. The display unit 37 is a display device for displaying a user interface for operating the server 30, and can be, for example, a liquid crystal display or an organic EL display, but is not limited to these. The communication unit 38 is a communication device for connecting to the network 20 via the wired connection 21. For example, the communication unit 38 is a network adapter or network interface card for making a high-speed wired connection 21, and may also be an on-board network controller. The communication unit 38 is compatible with Gigabit Ethernet (registered trademark), preferably 10 Gigabit Ethernet. (registered trademark) standard. The power supply unit 39 is a power supply device that connects to an external power source, and a known power supply device can be used.

[0026] In response to a request from terminal 10, image processing program providing unit 31a reads an image processing program from storage unit 33. Image processing program providing unit 31a provides the image processing program to terminal 10 from communication unit 38 via network 20. Terminal 10 may store the image processing program received from server 30 via communication unit 18 in storage unit 13, or control unit 11 may read the image processing program. The image processing program read by control unit 11 constitutes image processing unit 11a, which executes image processing in terminal 10.

[0027] Furthermore, the motion change data providing unit 31b reads motion change data from the storage unit 33 in response to a request from the terminal 10. The motion change data providing unit 31b provides the motion change data to the terminal 10 from the communication unit 38 via the network 20. The terminal 10 may store the motion change data received from the server 30 via the communication unit 18 in the storage unit 13, or the control unit 11 may read the motion change data. The motion change data read by the control unit 11 functions as a filter for image processing in the image processing unit 11a.

[0028] [Image processing program] An image processing program according to one embodiment of the present invention will be described with reference to Fig. 4. Fig. 4 is a schematic diagram illustrating an example of video data (first video data) including an object 90. Fig. 4 shows four representative images in the video data. Although two-dimensional images are shown in Fig. 4 for the sake of simplicity, the image processing program according to the present invention can also perform image processing on three-dimensional images. It will be obvious to those skilled in the art that image processing on three-dimensional images can be performed by performing the image processing in two-dimensional coordinates described here in three-dimensional coordinates.

[0029] In FIG. 4, image P1 shows a human-shaped object 90 standing upright. In FIG. 4, the movement will be described with particular attention to the right hand 91 of the object 90. The direction in which the object 90 stands upright is the Y-axis direction, and the direction perpendicular to the Y-axis direction is the X-axis direction. FIG. 5(a) is a schematic diagram in which the X-axis coordinate of the right hand 91 is plotted against the time axis of the first moving image data. Image P2 shows a state in which the object 90 has moved the right hand 91 in the Y-axis and X-axis directions to deliver a punch. Image P3 shows a state in which the object 90 has delivered a punch and then further moved the right hand 91 in the X-axis direction while the Y-axis coordinate remains approximately constant. Image P4 shows a state in which the object 90 has returned from a punching state to a ready-to-punch state, in which the X-axis coordinate of the right hand 91 has returned while the Y-axis coordinate remains approximately constant. That is, images P1 to P4 show four states of the object 90 (first state to fourth state).

[0030] The first video data may be video data acquired by the terminal 10 via the network 20, or may be video data generated by the terminal 10. When the first video data is generated by the terminal 10, the terminal 10 may acquire data of the object 90 via the network 20. For example, the data of the object 90 may be provided from the server 30. For example, the control unit 31 of the server 30 may further include an object data providing unit 31c, and may provide, in response to a request from the terminal 10, data of the object stored in the storage unit 33 to the terminal 10 from the communication unit 38 via the network 20. In one embodiment, the data of the object 90 may be provided from a server 50 other than the server 30. That is, the image processing program according to the present invention may process images of video data generated using data of the object 90 provided from another server 50, or may process images of video data provided from another server 50.

[0031] For example, the data of object 90 includes coordinate data defining the skeleton of object 90, such as the length, range of motion, and distance between each part of object 90, and skin data defining the surface of object 90, such as width and color. The first moving image data can be generated, for example, based on the four images P1 to P4 shown in Fig. 4, by generating the number of images required for the moving image data that complement each of the images using the data of object 90.

[0032] The first video data generated in this manner is video data in which the first to fourth states of object 90 are evenly arranged along the time axis from the first to fourth time points (T1 to T4), as shown in FIG. 5(a). When the first video data is played back on terminal 10, the punching movements of object 90 become monotonous, resulting in a video that lacks impact. An image processing program according to one embodiment of the present invention applies motion modification data (motion filter) to the first video data, making it possible to create video data in which the movement of object 90 is changed in accordance with the motion filter.

[0033] Fig. 5(b) is a schematic diagram showing the X-axis coordinate of the right hand 91 in the second video data generated by applying motion modification data to the first video data by an image processing program according to an embodiment of the present invention, plotted against the time axis. Fig. 6 is a flow diagram showing the processing of the image processing program according to an embodiment of the present invention. The image processing unit 11a reads data of a given object 90 for generating the first video data, which is stored in the control unit 11 (S101).

[0034] From the data of the object 90 that has been read, the image processing unit 11a obtains the position coordinates of a first state at a first time point T1 in an image P1 in which the object 90 is standing upright, the position coordinates of a second state at a second time point T2 in an image P2 in which the object 90 is ready to punch, the position coordinates of a third state at a third time point in an image P3 in which the object 90 has punched, and the position coordinates of a fourth state at a fourth time point in an image P4 in which the object 90 has returned from the punching state to the ready to punch state (S103).

[0035] For example, the image processing unit 11a compares the distance D1 between the position coordinates in the first state and the position coordinates in the second state with the distance D2 between the position coordinates in the second state and the position coordinates in the third state, and detects that the distance D2 is greater than the distance D1, and by comparing the position coordinates in the second state and the position coordinates in the third state, it is found that the Y-axis coordinate of the right hand 91 remains almost constant while the X-axis coordinate has moved significantly, thereby detecting that the object 90 has punched.

[0036] The image processing unit 11a reads motion modification data 11c corresponding to the "punch" motion from the storage unit 13 (S105). For example, the motion modification data 11c specifies that the duration of the punching motion is to be shortened, and changes the first period from the second time point T2 to the third time point T3 to a second period that is different (shorter) from the first period. That is, the third time point T3 is changed to a third time point T3' (S107). The image processing unit 11a may also change the fourth time point T4 to a fourth time point T4' so as not to change the length of the period from the third time point T3 in image P3, where the object 90 punches, to the fourth time point T4 in image P4, where the object 90 has returned from the punching state to a ready state to punch.

[0037] The image processing unit 11a creates second moving image data in which the object is displaced from the position coordinates of the first state to the position coordinates of the second state over a second period of time. The image processing program according to one embodiment of the present invention can cause the terminal 10 to execute these image processes. In this way, the image processing program can generate powerful second moving image data.

[0038] [Motion change data variation] In the above-described embodiment, an example was shown in which the movement of the object 90 was made sharper by shortening the time for the movement of the object 90, but the motion modification data according to the present invention is not limited to this. Below, an example will be described in which slow motion is applied or the movement is made smoother.

[0039] See Figure 5(a) for a schematic diagram in which the X-axis coordinate of the right hand 91 in the first video is plotted against the time axis of the first video data. Figure 7(a) shows a schematic diagram in which the X-axis coordinate of the right hand 91 in the second video data generated by an image processing program that applies motion modification data according to a modified example of the present invention is plotted against the time axis. See Figure 6 for the image processing flow. The image processing unit 11a reads data of a given object 90 for generating the first video data, which is stored in the control unit 11 (S101).

[0040] From the data of the object 90 that has been read, the image processing unit 11a obtains the position coordinates of a first state at a first time point T1 in an image P1 in which the object 90 is standing upright, the position coordinates of a second state at a second time point T2 in an image P2 in which the object 90 is ready to punch, the position coordinates of a third state at a third time point in an image P3 in which the object 90 has punched, and the position coordinates of a fourth state at a fourth time point in an image P4 in which the object 90 has returned from the punching state to the ready to punch state (S103).

[0041] For example, the image processing unit 11a compares the distance D1 between the position coordinates in the first state and the position coordinates in the second state with the distance D2 between the position coordinates in the second state and the position coordinates in the third state, and detects that the distance D2 is greater than the distance D1, and by comparing the position coordinates in the second state and the position coordinates in the third state, it is found that the Y-axis coordinate of the right hand 91 remains almost constant while the X-axis coordinate has moved significantly, thereby detecting that the object 90 has punched.

[0042] The image processing unit 11a reads motion modification data 11c corresponding to the "punch" motion from the storage unit 13 (S105). The motion modification data 11c specifies that slow motion is performed by lengthening the duration of the punching motion, and changes the first period from the second time point T2 to the third time point T3 to a second period that is different (longer) from the first period. That is, the third time point T3 is changed to a third time point T3' (S107). The image processing unit 11a may also change the fourth time point T4 to a fourth time point T4' so as not to change the length of the period from the third time point T3 in image P3 where the object 90 punches to the fourth time point T4 in image P4 where the object 90 has returned from the punching state to a ready state to punch.

[0043] The image processing unit 11a creates second moving image data in which the object is displaced from the position coordinates of the first state to the position coordinates of the second state over a second period. The image processing program according to this modification can cause the terminal 10 to execute these image processes. In this way, the image processing program can generate second moving image data in which slow motion or smooth movement is applied.

[0044] Another modified example is shown in Figure 7(b). Figure 7(b) is a schematic diagram plotting the X-axis coordinate of the right hand 91 against the time axis in second moving image data generated by an image processing program that applies motion modification data 11c that accelerates and changes the punching motion of object 90. The linear change in the X-axis coordinate during the second period from second time point T2 to third time point T3' shown in Figure 5(b) is changed to a nonlinear change in the X-axis coordinate during the second period from second time point T2 to third time point T3' shown in Figure 7(b), and so the image processing method is the same as that described above, and detailed description thereof will be omitted. The image processing program according to the present invention applies motion modification data 11c to generate second moving image data, thereby imparting various effects to the movement of object 90 in the played moving image data.

[0045] [Detecting when to apply a filter] As described above, the image processing program according to the present invention can detect the movement of the object 90 from the first moving image data, select the motion modification data 11c, and execute the movement defined in the motion modification data 11c on the terminal 10. The method for detecting the timing to apply a filter will be further described below.

[0046] 8 shows a flow of image processing of an image processing program according to an embodiment of the present invention. For example, image processing unit 11a reads first moving image data stored in storage unit 33 (S201). From the read data of object 90, image processing unit 11a obtains position coordinates of a first state at a first time point T1 in image P1 in which object 90 is standing upright, position coordinates of a second state at a second time point T2 in image P2 in which object 90 is ready to punch, position coordinates of a third state at a third time point in image P3 in which object 90 has punched, and position coordinates of a fourth state at a fourth time point in image P4 in which object 90 has returned from the punching state to the ready to punch state.

[0047] The image processing unit 11a determines whether the movement of the object 90 included in the first video data satisfies a predetermined condition (first condition) (S203). The first condition may be, for example, that a difference between a distance D1 between the position coordinates of the object 90 in the first state and the second state and a distance D2 between the position coordinates of the object 90 in the second state and the position coordinates of the object 90 in the third state exceeds or falls below a predetermined threshold. In addition, in three-dimensional coordinates, the first condition may be set using angular velocity as an index instead of just a change in distance.

[0048] The image processing unit 11a determines a period in the first video data that satisfies a first condition. The image processing unit 11a determines a first state and a second state based on the movement included in the first video data that satisfies the first condition (S205). The second state can be determined as the start point of the movement to be processed, and the third state can be determined as the end point of the movement to be processed. Note that the first state and the second state may be selected from a point other than the start point and end point of the movement in the first video data.

[0049] The image processing unit 11a selects motion modification data 11c corresponding to the detected movement from the motion modification data stored in the storage unit 13 (S207). The image processing unit 11a receives a designation of the motion modification data 11c for creating a second moving image based on the first moving image data (S209).

[0050] The image processing unit 11a can set the second period based on the motion modification data 11c and generate second moving image data from the first moving image data (S211). As described above, the image processing program according to the present invention can detect the movement of the object 90 from the first moving image data, select a filter suitable for the detected movement, and generate second moving image data. This makes it possible to impart various effects to the movement of the object 90 in the played back moving image data.

[0051] [Modification of detection of timing to apply filter] In the above-described embodiment, an example has been described in which the timing to apply a filter is detected based on the movement of an object 90 included in the first video data. The image processing program according to the present invention may also detect the timing to apply a filter based on audio data played back in synchronization with the first video data. FIG. 9 shows the image processing flow of the image processing program according to an embodiment of the present invention. FIG. 10 also shows a schematic diagram in which the coordinate of the right hand 91 in the X-axis direction is plotted against the time axis of the first video data, and a schematic diagram in which audio data played back in synchronization with the first video data is plotted against the time axis.

[0052] For example, the image processing unit 11a reads first moving image data stored in the storage unit 33 and audio data to be played back in synchronization with the first image data (S301). From the read data of the object 90, the image processing unit 11a obtains position coordinates of a first state at a first time point T1 in an image P1 in which the object 90 is standing upright, position coordinates of a second state at a second time point T2 in an image P2 in which the object 90 is ready to punch, position coordinates of a third state at a third time point in an image P3 in which the object 90 has punched, and position coordinates of a fourth state at a fourth time point in an image P4 in which the object 90 has returned from the punching state to the ready to punch state.

[0053] The image processing unit 11a determines whether the audio data includes audio data that satisfies a predetermined condition (second condition) (S303). In FIG. 10, a sound effect is added to the audio data at a third time point T3 corresponding to image P3 in which object 90 punches. A peak S1 appears from a baseline S0 in audio data of a specific wavelength. The image processing unit 11a can detect peak S1 by setting the second condition that the audio data exceeds a predetermined threshold. In one embodiment, as shown in FIG. 10, at least a portion of the playback period of a predetermined waveform of the audio data (the playback period of peak S1) is included between second time point T2 and third time point T3 in the first moving image data.

[0054] The image processing unit 11a determines the first state and the second state based on the playback time point of the audio that satisfies the second condition, among the audio data that is played back in synchronization with the first image data (S305).

[0055] The image processing unit 11a selects motion modification data 11c corresponding to the detected movement from the motion modification data stored in the storage unit 13 (S307). The image processing unit 11a receives a designation of the motion modification data 11c for creating a second moving image based on the first moving image data (S309).

[0056] The image processing unit 11a can set a second period based on the motion modification data 11c and generate second video data from the first video data (S311). As described above, the image processing program according to the present invention can detect movement and timing from audio data played back in synchronization with the first video data, select a filter appropriate for the detected movement and timing, and generate second video data. Furthermore, the terminal 10 can select a filter to be applied from a plurality of filters based on a user operation, and generate the second video data based on the selected filter. This allows various effects to be applied to the movement of the object 90 in the played video data.

[0057] [Placing objects in AR space] In one embodiment, the image processing program described above can also be applied to video data including an object having three-dimensional coordinates. The terminal 10 further includes an imaging unit, and the second image data generated by the image processing program can be combined with a real image captured by the imaging unit to place the object 1 in the AR space. For example, the object 1 can be placed in the AR space by setting a reference point on the real image and associating the three-dimensional coordinates of the second image data with the reference point. [Explanation of symbols]

[0058] 1 Image processing program providing system, 10 Terminal, 10A Mobile phone terminal, 10B Portable data terminal, 10C Personal computer, 11 Control unit, 11a Image processing unit 11b Condition detection unit, 11c Motion change data, 11C Motion change data, 13 Storage unit, 15 Input unit, 17 Display unit, 18 Communication unit, 19 Power supply unit, 20 Network, 21 Wired connection, 23 Wireless communication, 30 Image processing program providing server, 31 Control unit, 31a Image processing program providing unit, 31b Motion change data providing unit, 31c Object data providing unit, 33 Storage unit, 35 Input unit, 37 Display unit, 38 Communication unit, 39 Power supply unit, 50 Server, 90 Object, 91 Right hand

Claims

1. obtaining, from data of a given object for generating first moving image data, position coordinates of the object in a first state at a first time point and position coordinates of the object in a second state at a second time point; changing a first period from the first time point to the second time point to a second period different from the first period; an image processing program for causing an information processing device to generate second moving image data in which the object is displaced from the position coordinates of the first state to the position coordinates of the second state during the second period;

2. accepting designation of motion modification data for creating the second moving image data based on the first moving image data; The image processing program according to claim 1 , wherein the second period is set based on the motion modification data.

3. 3. The image processing program according to claim 1, wherein the first state and the second state are determined based on a movement included in the first video data that satisfies a predetermined first condition.

4. 3. The image processing program according to claim 1, wherein the first state and the second state are determined based on the playback time of audio data that satisfies a predetermined second condition among audio data that is played in synchronization with the first moving image data.

5. 5. The image processing program according to claim 4, wherein at least a part of a playback period of a predetermined waveform of the audio data is included between the first time point and the second time point in the first moving image data.

6. 6. The image processing program according to claim 1, wherein the first moving image data and the second moving image data can be reproduced by an information processing device.

7. a storage unit for storing first video data of a given object; an image processing unit that acquires, from first moving image data of the given object, position coordinates of the object in a first state at a first time point and position coordinates of the object in a second state at a second time point, changes a first period from the first time point to the second time point to a second period different from the first period, and generates second moving image data in which the object is displaced from the position coordinates of the first state to the position coordinates of the second state during the second period.

Images