Information processing method, information processing system, and program

The information processing method generates and adjusts motion changes in image sequences efficiently, enhancing computer performance and accuracy without additional hardware.

JP7596003B1Active Publication Date: 2024-12-09XENOTOON CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2024157482
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-09-11
Publication Date
2024-12-09
Estimated Expiration
2044-09-11

AI Technical Summary

Technical Problem

Existing image generation devices do not adjust changes in motion expressed in generated image sequences effectively.

Method used

An information processing method that includes acquiring first image data and state information, generating intermediate image data to create a sequence, adjusting motion changes based on input information, and outputting an adjusted image sequence without requiring a special device.

Benefits of technology

This method allows for faster computer processing, reduced power consumption, increased communication speed, and resource utilization for other functions while improving the accuracy of motion adjustments in generated images.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007596003000001_ABST
    Figure 0007596003000001_ABST
Patent Text Reader

Abstract

An information processing method, an information processing system, a program, and the like are provided that are capable of adjusting changes in movement expressed in a generated image sequence. [Solution] According to one aspect of the present invention, there is provided an information processing method comprising an acquisition step, a generation step, an adjustment step, and an output step, in which the acquisition step acquires first image data and status information, the status information being at least one of second image data showing an image after a change to the first image data and a prompt showing a state after the change to the first image data, the generation step generates a plurality of intermediate image data which are image data that interpolate between the first image data and the status information, the generation step generates a first image sequence which is data in which the first image data, the plurality of intermediate image data, and the status information are arranged in chronological order, the adjustment step adjusts changes in movement represented in the first image sequence based on the first image sequence and input adjustment information, the adjustment information is information for adjusting the changes in movement, and the output step outputs a second image sequence which is the adjusted image sequence.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an information processing method, an information processing system, and a program. [Background technology]

[0002] Patent Document 1 discloses an image generating device.

[0003] The image generating device of Patent Document 1 includes an image generator that has been trained to output a generated image at a generation time that is not a reference time, using time-series information including a combination of training images at each reference time and training structure information that indicates the structure of the training images. This image generator has been trained by receiving feedback from an image classifier that has been trained to distinguish whether an input image is a training image or a generated image. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2020-126442 Summary of the Invention [Problem to be solved by the invention]

[0005] However, although the image generating device disclosed in Patent Document 1 automatically generates in-between images that interpolate between images, it does not adjust changes in movement expressed in the generated image sequence.

[0006] In view of the above circumstances, the present invention provides an information processing method, an information processing system, a program, and the like that are capable of adjusting changes in movement expressed in a generated image sequence. [Means for solving the problem]

[0007] According to one aspect of the present invention, there is provided an information processing method comprising an acquisition step, a generation step, an adjustment step, and an output step, wherein the acquisition step acquires first image data and status information, the status information being at least one of second image data showing an image after a change to the first image data and a prompt showing a status after the change to the first image data, the generation step generates a plurality of intermediate image data which are image data that interpolate between the first image data and the status information, the generation step generates a first image sequence which is data in which the first image data, the plurality of intermediate image data, and the status information are arranged in chronological order, the adjustment step adjusts changes in movement expressed in the first image sequence based on the first image sequence and input adjustment information, the adjustment information being information for adjusting the changes in movement, and the output step outputs a second image sequence which is the adjusted image sequence.

[0008] In one aspect of the method, a first image sequence in which the first image data and the status information (at least one of the second image data and the prompt) change at a constant speed is obtained by interpolating a plurality of intermediate image data. Then, the first image sequence is adjusted using the input adjustment information to impart an accelerated motion. Since no special device is required to impart this accelerated motion, the method has a simple configuration.

[0009] Therefore, the method of this aspect can improve the functionality of a computer so as to achieve at least one of the following (1) to (4): (1) Speeding up computer processing, (2) Saving power consumption of a computer, (3) Speeding up computer communication speed, and (4) The saved resources in the computer can be used for other core functions.

[0010] According to this aspect, it is possible to adjust for changes in motion in the generated image sequence. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a configuration diagram illustrating an information processing system 100. [Figure 2] FIG. 2 is a block diagram showing the hardware configuration of an information processing device 200. [Figure 3] FIG. 2 is a block diagram showing the hardware configuration of the terminal 300. [Figure 4] FIG. 2 is a block diagram showing functions realized by an information processing device 200 (control unit 210). [Figure 5] 1 is an activity diagram showing the flow of an information processing method executed by information processing device 200. FIG. [Figure 6] 1 is an activity diagram showing the flow of an information processing method executed by information processing device 200. FIG. [Figure 7] 1 is an activity diagram showing the flow of an information processing method executed by information processing device 200. FIG. [Figure 8] FIG. 10 is a diagram illustrating an example of a graph editor used when inputting adjustment information. [Figure 9] FIG. 10 is a diagram showing a process of generating a second image sequence after adjusting for changes in motion from the first image data and the second image data. [Figure 10] FIG. 10 is a diagram supplementing the processing of activity A280. [Figure 11] This is a diagram supplementing the processing of activities A310 to A340. [Figure 12] This is a diagram supplementing the processing of activities A310 to A340. [Figure 13] This is a diagram supplementing the processing of activities A310 to A340. [Figure 14] This is a diagram supplementing the processing of activities A310 to A340. [Figure 15] FIG. 10 is a diagram supplementing the processing of activity A430. [Figure 16] 10A and 10B are diagrams illustrating a comparison between image data subjected to color reduction processing using the method of the present embodiment and image data subjected to color reduction processing using a conventional method. [Figure 17] 10A and 10B are diagrams illustrating a comparison between image data subjected to color reduction processing using the method of the present embodiment and image data subjected to color reduction processing using a conventional method. [Figure 18] FIG. 10 is a diagram illustrating a prompt, which is an example of state information. [Figure 19] FIG. 10 is a diagram showing an example of how to set a line graph in the graph editor. DETAILED DESCRIPTION OF THE INVENTION

[0012] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below with reference to the accompanying drawings. Various features shown in the following embodiments can be combined with each other.

[0013] Incidentally, the program for realizing the software appearing in one embodiment may be provided as a non-transitory computer-readable medium, or may be provided so that it can be downloaded from an external server, or may be provided so that the program is started on an external computer and its functions are realized on a client terminal (so-called cloud computing).

[0014] Furthermore, various information processing according to an embodiment may realize input and output corresponding to the input. Here, the form of information referenced in such information processing (hereinafter referred to as reference information) is not limited as long as an output is obtained as a result of the input. The reference information may be, for example, rule-based information such as a database, a lookup table, or a predetermined function (including a decision formula such as a regression formula constructed using a statistical method), a trained model that has previously trained the correlation between input and output, or a large-scale language model that can output a desired result by inputting a prompt.

[0015] In one embodiment, a "unit" may include, for example, a combination of hardware resources implemented by a circuit in the broad sense and software information processing that can be specifically realized by these hardware resources. In one embodiment, various information is handled, and this information is represented, for example, by physical values ​​of signal values ​​representing voltage and current, high and low signal values ​​as a binary bit set consisting of 0 or 1, or quantum superposition (so-called quantum bits), and communication and calculations can be performed on a circuit in the broad sense.

[0016] Furthermore, a circuit in the broad sense is a circuit realized by at least an appropriate combination of a circuit, circuitry, processor, memory, etc. The processor may be a general-purpose processor or a dedicated circuit. That is, it includes an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)), etc.

[0017] 1. Hardware Configuration In Section 1, the hardware configuration of this embodiment will be described.

[0018] 1-1. Information Processing System 100 FIG. 1 is a configuration diagram showing an information processing system 100. The information processing system 100 includes an information processing device 200 and a terminal 300, which are connected via a network. These components will be further described. Here, a system exemplified as the information processing system 100 is composed of one or more devices or components. Therefore, for example, even the information processing device 200 alone can become a system exemplified as the information processing system 100.

[0019] 1-2. Information processing device 200 2 is a block diagram showing the hardware configuration of information processing device 200. Information processing device 200 has a control unit 210, a storage unit 220, and a communication unit 250, and these components are electrically connected via a communication bus 260 inside information processing device 200. Information processing device 200 is, for example, a server. Each component will be further described.

[0020] The control unit 210 processes and controls the overall operations related to the information processing device 200. The control unit 210 is, for example, a central processing unit (CPU) not shown. The control unit 210 realizes various functions related to the information processing device 200 by reading out predetermined programs stored in the storage unit 220. In other words, information processing by software stored in the storage unit 220 is specifically realized by the control unit 210, which is an example of hardware, and can be executed as each functional unit included in the control unit 210. This will be further explained in Section 2. Note that the control unit 210 is not limited to being a single unit, and multiple control units 210 may be provided for each function. A combination of these may also be used.

[0021] The storage unit 220 stores various information necessary for information processing by the information processing device 200. This may be implemented, for example, as a storage device such as a solid state drive (SSD) that stores various programs related to the information processing device 200 executed by the control unit 210, or as a memory such as a random access memory (RAM) that stores information (arguments, arrays, etc.) temporarily required for program calculations. Alternatively, it may be implemented as a combination of these.

[0022] The communication unit 250 is preferably a wired communication means such as USB, IEEE1394, Thunderbolt (registered trademark), wired LAN network communication, etc., but may also include wireless LAN network communication, mobile communication such as 5G / LTE / 3G, Bluetooth (registered trademark) communication, etc. as necessary. In other words, it is more preferable to implement it as a collection of multiple communication means. In other words, the information processing device 200 communicates various information with the terminal 300 via the communication unit 250 over a network.

[0023] 1-3. Terminal 300 3 is a block diagram showing the hardware configuration of terminal 300. Terminal 300 has a control unit 310, a storage unit 320, a display unit 330, an input unit 340, and a communication unit 350, and these components are electrically connected inside terminal 300 via a communication bus 360. Terminal 300 is, for example, a desktop personal computer. Descriptions of control unit 310, storage unit 320, and communication unit 350 are omitted because they are substantially the same as the descriptions of control unit 210, storage unit 220, and communication unit 250 in information processing device 200.

[0024] The display unit 330 may be included in the housing of the terminal 300 or may be externally attached. The display unit 330 displays a screen of a graphical user interface (GUI) that can be operated by the user. This is preferably implemented by selectively using display devices such as a CRT display, a liquid crystal display, an organic EL display, and a plasma display depending on the type of terminal 300. In the following description, the display unit 330 is assumed to be included in the housing of the terminal 300.

[0025] The input unit 340 may be included in the housing of the terminal 300 or may be externally attached. For example, the input unit 340 may be implemented as a touch panel integrated with the display unit 330. A touch panel allows a user to input tapping, swiping, and the like. Of course, a switch button, a mouse, a QWERT keyboard, or the like may be used instead of a touch panel. That is, the input unit 340 accepts an operation input made by the user. The input is transferred as a command signal to the control unit 310 via the communication bus 360. The control unit 310 can then execute predetermined control and calculation as necessary.

[0026] 2. Functional configuration The functional configuration of this embodiment will be described in Section 2. As described above, information processing by software stored in the storage unit 220 is specifically realized by the control unit 210, which is an example of hardware, and can be executed as each functional unit included in the control unit 210.

[0027] FIG. 4 is a block diagram showing functions realized by the information processing device 200 (control unit 210). As described above, the information processing device 200 (information processing system 100) includes the control unit 210. Specifically, the information processing device 200 (control unit 210) is configured to execute each step in the information processing method of this embodiment. The information processing device 200 (control unit 210) includes an acquisition unit 211, a generation unit 212, an adjustment unit 213, an output unit 214, a deletion unit 215, a separation unit 216, a color reduction unit 217, and an integration unit 218, corresponding to each step of the information processing method of this embodiment. Each unit and each step will be described below in association with each other.

[0028] The acquisition unit 211 is configured to acquire various information. The acquisition unit 211 is configured to execute an acquisition step. For example, the acquisition unit 211 acquires first image data and status information. The first image data is assumed to be reference image data. Here, the status information is at least one of second image data indicating an image after the first image data has changed, and a prompt indicating a status after the first image data has changed. In addition, the acquisition unit 211 acquires third image data which is colored image data.

[0029] The generating unit 212 is configured to generate various information. The generating unit 212 is configured to execute a generating step. For example, the generating unit 212 generates a plurality of in-between image data, which is image data that interpolates between the first image data and the status information. The generating unit 212 also generates a first image sequence, which is data in which the first image data, the plurality of in-between image data, and the status information are arranged in chronological order.

[0030] The adjustment unit 213 is configured to adjust various pieces of information. The adjustment unit 213 is configured to execute an adjustment step. For example, the adjustment unit 213 adjusts a change in movement expressed in the first image sequence based on the first image sequence and the input adjustment information. Here, the adjustment information is information for adjusting a change in movement expressed in the image sequence.

[0031] The output unit 214 is configured to output various information. The output unit 214 is configured to execute an output step. For example, the output unit 214 outputs a second image sequence that is an adjusted image sequence. The output unit 214 also outputs fourth image data that is image data after color reduction.

[0032] The deletion unit 215 is configured to delete various information. The deletion unit 215 is configured to execute a deletion step. For example, when a second image sequence is confirmed, the deletion unit 215 deletes data related to the second image sequence from the storage unit. Also, when fourth image data is confirmed, the deletion unit 215 deletes data related to the fourth image data from the storage unit.

[0033] The separation unit 216 is configured to separate various pieces of information. The separation unit 216 is configured to perform a separation step. For example, the separation unit 216 separates line drawing portions and painted portions from the third image data.

[0034] The color reduction unit 217 is configured to reduce the colors of various information. The color reduction unit 217 is configured to execute a color reduction step. For example, the color reduction unit 217 performs a clustering process on the colors included in the third image data, and reduces the colors of the third image data according to post-color reduction information indicating the colors corresponding to each cluster. Here, the colors corresponding to each cluster are colors determined using the most frequent values ​​of each cluster. Note that the colors after color reduction are, for example, colors such as blue, yellow, and red, and will also be referred to as the types of colors after color reduction in the following description.

[0035] The integrating unit 218 is configured to integrate various pieces of information. The integrating unit 218 is configured to perform an integration step. For example, the integrating unit 218 integrates a line drawing portion with a color-reduced painted portion.

[0036] 3. Information Processing Method Section 3 describes the flow of the information processing method of the information processing device 200. This information processing method includes an acquisition step, a generation step, an adjustment step, an output step, a deletion step, a separation step, a color reduction step, and an integration step. Each of these steps is executed by the control unit 210 in the information processing device 200, as described in Section 2.

[0037] 5 to 7 are activity diagrams showing the flow of an information processing method executed by information processing device 200. The following description will be given along with each activity in these activity diagrams. In this embodiment, it is assumed that first image data and second image data are prepared in advance in terminal 300. It is assumed that the first image data is reference image data. The second image data is data showing an image after the first image data has been changed. Here, it is assumed that the first image data and second image data are colored image data. In this manner, according to an aspect in which colored image data is used as input images, it is possible to improve the accuracy of the finally generated image sequence compared to conventional methods.

[0038] First, the control unit 310 in the terminal 300 transmits the first image data and the second image data to the information processing device 200 (activity A110). The second image data is an example of "status information" in the claims. The status information is at least one of second image data indicating an image after the first image data has changed, and a prompt indicating the status of the first image data after the change. The prompt will be described later. In activity A110, for example, the following two-stage information processing is performed: (1) The control unit 310 reads out the first image data and the second image data from the storage unit 320. (2) The control unit 310 transmits the first image data and the second image data to the information processing device 200 via the communication unit 350.

[0039] Next, the control unit 210 in the information processing device 200 receives the first image data and second image data from the terminal 300 (activity A120). In other words, in the acquisition step, the first image data and status information are acquired. In activity A120, for example, the following two-stage information processing is executed: (1) The communication unit 250 receives the first image data and second image data from the terminal 300. (2) The control unit 210 stores the first image data and second image data in the memory unit 220.

[0040] Next, the control unit 210 in the information processing device 200 generates image data (hereinafter also referred to as "intermediate image data") that interpolates between the first image data and the second image data (activity A130). In other words, in the generation step, a plurality of intermediate image data, which is image data that interpolates between the first image data and the status information, is generated. In activity A130, for example, the following three-stage information processing is executed: (1) The control unit 210 reads out the first image data and the second image data from the storage unit 220. (2) The control unit 210 executes the generation process and generates a plurality of intermediate image data. (3) The control unit 210 stores the plurality of intermediate image data in the storage unit 220.

[0041] Next, the control unit 210 in the information processing device 200 generates an image sequence (hereinafter also referred to as the "first image sequence") in which the first image data, the plurality of in-between image data, and the second image data are arranged in chronological order (activity A140). In other words, in the generation step, the first image sequence is generated, which is data in which the first image data, the plurality of in-between image data, and the status information are arranged in chronological order. In activity A140, for example, the following three-stage information processing is performed: (1) The control unit 210 reads out the first image data, the plurality of in-between image data, and the second image data from the storage unit 220. (2) The control unit 210 performs a generation process, arranging the first image data, the plurality of in-between image data, and the second image data in chronological order to generate the first image sequence. (3) The control unit 210 stores the first image sequence in the storage unit 220.

[0042] Next, the control unit 210 in the information processing device 200 transmits the first image sequence to the terminal 300 (activity A150). In activity A150, for example, the following two-stage information processing is executed: (1) The control unit 210 reads out the first image sequence from the storage unit 220. (2) The control unit 210 transmits the first image sequence to the terminal 300 via the communication unit 250.

[0043] Next, the control unit 310 in the terminal 300 receives the first image sequence from the information processing device 200 (activity A160). In activity A160, for example, the following two-stage information processing is executed: (1) The communication unit 350 receives the first image sequence from the information processing device 200. (2) The control unit 310 stores the first image sequence in the memory unit 320.

[0044] Next, the control unit 310 in the terminal 300 causes the display unit 330 to display the first image sequence (activity A170). In activity A170, for example, the following two-stage information processing is executed: (1) The control unit 310 reads out the first image sequence from the storage unit 320. (2) The control unit 310 causes the display unit 330 to display the first image sequence.

[0045] Next, the control unit 310 in the terminal 300 receives adjustment information for adjusting the changes in the motions expressed in the first image sequence (activity A180). Here, the adjustment information is information for adjusting the changes in the motions expressed in the first image sequence. The adjustment information also includes image count information that indicates the number of image data included in the second image sequence.

[0046] If the control unit 310 determines that the adjustment information has been received, it proceeds to processing activity A190 (YES in activity A180). If the control unit 310 determines that the adjustment information has not been received, it proceeds to processing activity A260 (NO in activity A180). In activity A180, for example, the following four stages of information processing are executed: (1) If the input unit 340 has received the adjustment information, it transmits an acceptance signal to the control unit 310 via the communication bus 360. (2) If the input unit 340 has not received the adjustment information, it transmits a non-acceptance signal to the control unit 310 via the communication bus 360. (3) If the control unit 310 has received an acceptance signal, it stores the adjustment information in the memory unit 320 and proceeds to processing activity A190. (4) If the control unit 310 has received a non-acceptance signal, it proceeds to processing activity A260.

[0047] Next, the control unit 310 in the terminal 300 transmits adjustment information, which is information for adjusting changes in movement expressed in the first image sequence, to the information processing device 200 (activity A190). In activity A190, for example, the following two-stage information processing is executed: (1) The control unit 310 reads out the adjustment information from the storage unit 320. (2) The control unit 310 transmits the adjustment information to the information processing device 200 via the communication unit 350.

[0048] FIG. 8 is a diagram showing an example of a graph editor used when inputting adjustment information. Graph editor 410 displays a line graph 411, a setting area 412, and a graph area 413. Line graph 411 is a graph for adjusting the degree of change between first image data A and second image data B. Setting area 412 is an area for setting the number of image data (image number information) included in the second image sequence to be output after adjusting the change in movement. Graph area 413 is a variable area of ​​line graph 411. The lower base of graph area 413 is the first image data A, and the upper base is the second image data B. In other words, the closer to the lower base of line graph 411, the closer it is to the representation of the first image data A, and the closer to the upper base, the closer it is to the representation of the second image data B.

[0049] The shape of the line graph 411 can be changed by dragging and dropping a total of six movable points. The example shown in Fig. 8 shows a gradual change from the first image data A to the second image data B over time.

[0050] In this way, the adjustment information is information input via the graph editor 410. According to this aspect, it is possible to adjust the change in movement while visually checking it. Furthermore, here, the graph editor 410 is an editor that inputs the adjustment information using a line graph. According to this aspect, it is possible to more easily adjust the change in movement while visually checking it.

[0051] Returning to the explanation of Fig. 5, the control unit 210 in the information processing device 200 then receives, from the terminal 300, adjustment information for adjusting changes in movement expressed in the first image sequence (activity A200). In activity A200, for example, the following two-stage information processing is executed: (1) The communication unit 250 receives the adjustment information from the terminal 300. (2) The control unit 210 stores the adjustment information in the storage unit 220.

[0052] Next, the control unit 210 of the information processing device 200 deletes some of the intermediate image data included in the first image sequence based on the first image sequence and the input adjustment information (activity A210). In other words, in the adjustment step, the movement changes expressed in the first image sequence are adjusted based on the first image sequence and the input adjustment information. More specifically, in the adjustment step, some of the intermediate image data among the plurality of intermediate image data are deleted from the first image sequence to adjust the movement changes. According to this aspect, the data volume of the image sequence can be reduced to adjust the movement changes. Furthermore, in the adjustment step, the number of image data included in the second image sequence is adjusted based on image number information indicating the number of image data included in the second image sequence. According to this aspect, the second image sequence can be changed quickly in a short period of time or slowly over a relatively long period of time by balancing the frame rate of the second image sequence with the number of image data included in the second image sequence.

[0053] In activity A210, for example, the following three-stage information processing is executed: (1) The control unit 210 reads out the first image sequence and adjustment information from the storage unit 220. (2) The control unit 210 executes adjustment processing and deletes some of the in-between image data included in the first image sequence. (3) The control unit 210 stores the image sequence after adjustment processing (hereinafter also referred to as the "second image sequence") in the storage unit 220.

[0054] 9 is a diagram showing the process of generating a second image sequence after adjusting for changes in motion from the first image data and the second image data. First, first image data A and second image data B are prepared. Next, intermediate image data 1 to 10 are generated between the first image data A and the second image data B. Next, intermediate image data 2, 5, 8, and 9 are deleted to generate the second image sequence.

[0055] In the example of Fig. 9, the frame rate of the first image sequence is set to 12 fps. The number of image data included in the second image sequence is set to 8. The second image sequence can show an accelerating change from intermediate image data 1 to 3, an accelerating change from intermediate image data 4 to 6, and an accelerating change from intermediate image data 7 to 10.

[0056] Here, when the frame rate of the second image sequence is set to 12 fps, the speed of change of the second image sequence is changed to the same speed as the speed of change of the first image sequence, and accelerates by skipping the deleted portions of the in-between image data. Also, when the frame rate of the second image sequence is set to 8 fps, the speed of change of the second image sequence becomes gentler overall, and becomes equivalent to the speed of change of the first image sequence by skipping the deleted portions of the in-between image data.

[0057] Returning to the explanation of Figure 5, the control unit 210 in the information processing device 200 then transmits the second image sequence to the terminal 300 (activity A220). In other words, in the output step, the second image sequence, which is the adjusted image sequence, is output. In activity A220, for example, the following two-stage information processing is executed: (1) The control unit 210 reads out the second image sequence from the storage unit 220. (2) The control unit 210 transmits the second image sequence to the terminal 300 via the communication unit 250.

[0058] Next, the control unit 310 in the terminal 300 receives the second image sequence from the information processing device 200 (activity A230). In activity A230, for example, the following two-stage information processing is executed: (1) The communication unit 350 receives the second image sequence from the information processing device 200. (2) The control unit 310 stores the second image sequence in the memory unit 320.

[0059] Next, the control unit 310 in the terminal 300 causes the display unit 330 to display the second image sequence (activity A240). In activity A240, for example, the following two-stage information processing is executed: (1) The control unit 310 reads out the second image sequence from the storage unit 320. (2) The control unit 310 causes the display unit 330 to display the second image sequence.

[0060] We now move on to the description of FIG. 6. Next, the control unit 310 in the terminal 300 receives adjustment information, which is information for adjusting changes in movement expressed in the first image sequence (activity A250). If the control unit 310 determines that the adjustment information has been received, it proceeds to processing activity A190 (YES in activity A250). If the control unit 310 determines that the adjustment information has not been received, it proceeds to processing activity A260 (NO in activity A250). In activity A250, for example, the following four stages of information processing are executed: (1) If the input unit 340 receives the adjustment information, it transmits an acceptance signal to the control unit 310 via the communication bus 360. (2) If the input unit 340 does not receive the adjustment information, it transmits a non-acceptance signal to the control unit 310 via the communication bus 360. (3) If the control unit 310 receives the acceptance signal, it stores the adjustment information in the storage unit 320 and proceeds to processing activity A190. (4) When the control unit 310 receives a non-acceptance signal, it proceeds to the processing of activity A260.

[0061] Next, the control unit 310 in the terminal 300 transmits setting information including the number of colors after color reduction to the information processing device 200 (activity A260). In this embodiment, it is assumed that the setting information is set by default. In activity A260, for example, the following two-stage information processing is executed: (1) The control unit 310 reads the setting information from the storage unit 320. (2) The control unit 310 transmits the setting information to the information processing device 200 via the communication unit 350.

[0062] Next, the control unit 210 in the information processing device 200 receives the setting information from the terminal 300 (activity A270). In activity A270, for example, the following two-stage information processing is executed: (1) The communication unit 250 receives the setting information from the terminal 300. (2) The control unit 210 stores the setting information in the storage unit 220.

[0063] Next, the control unit 210 in the information processing device 200 separates each image data included in the second image sequence into a line drawing portion and a painted portion (activity A280). In other words, in the separation step, the line drawing portion and the painted portion are separated from the image data. In activity A280, for example, the following three-stage information processing is executed: (1) The control unit 210 reads the second image sequence and an image separation program from the storage unit 220. (2) The control unit 210 executes the separation process and separates each image data included in the second image sequence into a line drawing portion and a painted portion. (3) The control unit 210 stores the line drawing portion and the painted portion (hereinafter simply referred to as "line drawing portion" and "painted portion") of each image data in the storage unit 220.

[0064] 10 is a diagram supplementing the processing of activity A280. Image data 510 is assumed to be any one of the image data included in the second image sequence. In activity A280, image data 510 is separated into a line drawing portion 520 and a painted portion 530.

[0065] Returning to the description of FIG. 6, the control unit 210 in the information processing device 200 then performs color reduction processing on the painted portion (activity A290). In other words, in the color reduction step, the colors in the painted portion (colors included in the third image data) are clustered, and the painted portion (third image data) is color-reduced according to color-reduced information indicating the colors corresponding to each cluster. Here, the color corresponding to each cluster is determined using the most frequent value of each cluster. The number of clusters in the clustering process corresponds to the number of colors after color reduction included in the setting information. That is, in the color reduction step, the painted portion (image data) is color-reduced according to the set number of colors. According to this aspect, the number of colors after color reduction can be set arbitrarily. Furthermore, in the color reduction step, first color-reduced information and second color-reduced information are generated according to the set number of colors. Here, both the first color-reduced information and the second color-reduced information indicate the colors corresponding to each cluster and are mutually equivalent.

[0066] In activity A290, for example, the following three-stage information processing is executed: (1) The control unit 210 reads the setting information and the painted portion from the storage unit 220. (2) The control unit 210 performs a clustering process on the colors in the painted portion and reduces the colors of the painted portion according to the colors corresponding to each cluster. (3) The control unit 210 stores the painted portion after color reduction and the type of color in the painted portion after color reduction (hereinafter also referred to as "post-color reduction information") in the storage unit 220.

[0067] Next, the control unit 210 in the information processing device 200 transmits the painted portion after color reduction and the type of color in the painted portion after color reduction to the terminal 300 (activity A300). In activity A300, for example, the following three-stage information processing is executed: (1) The control unit 210 reads out the painted portion after color reduction and the second color-reduction information from the storage unit 220. (2) The control unit 210 transmits the painted portion after color reduction and the second color-reduction information to the terminal 300 via the communication unit 250.

[0068] Next, the control unit 310 in the terminal 300 receives the color-reduced painted portion and the color type of the color-reduced painted portion from the information processing device 200 (activity A310). In activity A310, for example, the following two-stage information processing is executed: (1) The communication unit 350 receives the color-reduced painted portion and second color-reduced information from the information processing device 200. (2) The control unit 310 stores the color-reduced painted portion and second color-reduced information in the storage unit 320.

[0069] Next, the control unit 310 in the terminal 300 causes the display unit 330 to display the color-reduced painted portion and the type of color in the color-reduced painted portion (activity A320). In other words, in the color-reducing step, the color-reduced painted portion and second color-reduced information are displayed according to the set number of colors. In activity A320, for example, the following two-stage information processing is executed: (1) The control unit 310 reads the color-reduced painted portion and the second color-reduced information from the storage unit 320. (2) The control unit 310 causes the display unit 330 to display the color-reduced painted portion and the second color-reduced information.

[0070] Next, the control unit 310 in the terminal 300 accepts an operation to change the type of color after color reduction (second color-reduction information) (activity A330). If the control unit 310 determines that the change operation has been accepted, it proceeds to processing of activity A340 (YES in activity A330). If the control unit 310 determines that the change operation has not been accepted, it proceeds to processing of activity A410 (NO in activity A330). In activity A330, for example, the following four stages of information processing are executed: (1) If the input unit 340 accepts the change operation, it transmits an acceptance signal to the control unit 310 via the communication bus 360. (2) If the input unit 340 does not accept the change operation, it transmits a non-acceptance signal to the control unit 310 via the communication bus 360. (3) If the control unit 310 receives the acceptance signal, it stores the change operation in the memory unit 320 and proceeds to processing of activity A340. (4) When the control unit 310 receives a non-acceptance signal, it proceeds to the processing of activity A410.

[0071] Next, the control unit 310 in the terminal 300 generates modification information for changing the type of color after color reduction (second color-reduction information) (activity A340). In activity A340, for example, the following three-stage information processing is executed: (1) The control unit 310 reads the modification operation from the storage unit 320. (2) The control unit 310 executes a generation process to generate modification information for changing the type of color after color reduction (second color-reduction information). (3) The control unit 310 stores the modification information in the storage unit 320.

[0072] 11 to 14 are diagrams that supplement the processing of activities A310 to A340. FIG. 11 shows a palette 600 displayed before the data received by activity A310 is read. The palette 600 displays a color count area 610, a color reduction method area 620, and an add button 630. The color count area 610 allows the number of colors after color reduction to be set. The color reduction method area 620 allows the algorithm for color reduction processing to be set; in this case, the algorithm of this embodiment (clustering processing using the most frequent value) is set. The add button 630 is a button for increasing the number of colors after color reduction.

[0073] FIG. 12 shows a palette 600 displayed after transitioning to processing of activity A320. Palette 600 corresponds to the "second color-reduction information" in the claims. Palette 600 displays a color number area 610, a color-reduction method area 620, an add button 630, and color types 640. Each color type 640 displays a delete button 641. The delete button 641 is a button for deleting that color. Each color in color types 640 is a color extracted by clustering processing using the most frequent value.

[0074] 13 shows the state where processing has shifted to activity A330, and the delete buttons 641 for three of the colors displayed in color types 640 have been clicked, bringing the number of colors after color reduction to 15. In the color reduction step, if any color is deleted from the colors after color reduction, the deleted color is further subtracted from the painted portion.

[0075] FIG. 14(A) shows a state in which the add button 630 in FIG. 13 has been clicked and color 642 has been added. When color 642 is selected, color setting box 650 is displayed as shown in FIG. 14(B). Areas 651, 652, and 653 are displayed in color setting box 650. Color 642 is set by entering an arbitrary color in area 651, operating the slider in area 652, and entering a numerical value in area 653. In the color reduction step, if an arbitrary color is added to the colors after color reduction, the added color is added to the painted portion.

[0076] Here, the first color-reduced information is stored in the storage unit 220 in the information processing device 200. Therefore, the first color-reduced information is not changed, and the colors corresponding to each cluster can be maintained.

[0077] Returning to the explanation of Fig. 6, the control unit 310 in the terminal 300 then transmits modification information for changing the type of color after color reduction (second post-color-reduction information) to the information processing device 200 (activity A350). In activity A350, for example, the following two-stage information processing is executed: (1) The control unit 310 reads out the modification information from the storage unit 320. (2) The control unit 310 transmits the modification information to the information processing device 200 via the communication unit 350.

[0078] Next, the control unit 210 in the information processing device 200 receives, from the terminal 300, modification information for modifying the type of color after color reduction (second post-color-reduction information) (activity A360). In activity A360, for example, the following two-stage information processing is executed: (1) The communication unit 250 receives the modification information from the terminal 300. (2) The control unit 210 stores the modification information in the storage unit 220.

[0079] We now move on to the description of FIG. 7. Next, the control unit 210 in the information processing device 200 reflects the type of color after color reduction included in the modification information in the painted portion (activity A370). In other words, in the color reduction step, if the second color-reduced information is changed, the second color-reduced information after the change is reflected in the painted portion (image data). In activity A370, for example, the following three-stage information processing is performed: (1) The control unit 210 reads the painted portion after color reduction and the modification information from the storage unit 220. (2) The control unit 210 performs a reflection process to reflect the type of color after color reduction included in the modification information in the painted portion. (3) The control unit 210 stores the painted portion after the reflection process (hereinafter also referred to as the "reflected painted portion") in the storage unit 220. According to this aspect, it is possible to maintain each cluster in the first color-reduced information while changing the second color-reduced information to change the color corresponding to each cluster.

[0080] Next, the control unit 210 in the information processing device 200 transmits the painted portion after the reflection processing to the terminal 300 (activity A380). In activity A380, for example, the following two-stage information processing is executed: (1) The control unit 210 reads the reflected painted portion from the storage unit 220. (2) The control unit 210 transmits the reflected painted portion to the terminal 300 via the communication unit 250.

[0081] Next, the control unit 310 in the terminal 300 receives the painted portion after the reflection process from the information processing device 200 (activity A390). In activity A390, for example, the following two-stage information processing is executed: (1) The communication unit 350 receives the reflected painted portion from the information processing device 200. (2) The control unit 310 stores the reflected painted portion in the memory unit 320.

[0082] Next, the control unit 310 in the terminal 300 accepts an operation to change the type of color after color reduction (second color-reduction information) (activity A400). If the control unit 310 determines that the change operation has been accepted, it proceeds to processing of activity A340 (YES in activity A400). If the control unit 310 determines that the change operation has not been accepted, it proceeds to processing of activity A410 (NO in activity A400). In activity A400, for example, the following four stages of information processing are executed: (1) If the input unit 340 accepts the change operation, it transmits an acceptance signal to the control unit 310 via the communication bus 360. (2) If the input unit 340 does not accept the change operation, it transmits a non-acceptance signal to the control unit 310 via the communication bus 360. (3) If the control unit 310 receives the acceptance signal, it stores the change operation in the memory unit 320 and proceeds to processing of activity A340. (4) When the control unit 310 receives a non-acceptance signal, it proceeds to the processing of activity A410.

[0083] Next, the control unit 310 in the terminal 300 transmits an end signal, which is a signal to terminate the color reduction processing, to the information processing device 200 (activity A410). The end signal is generated, for example, by executing an end operation in the palette 600. In activity A410, for example, the following two-stage information processing is executed: (1) The control unit 310 reads the end signal from the storage unit 320. (2) The control unit 310 transmits the end signal to the information processing device 200 via the communication unit 350.

[0084] Next, the control unit 210 in the information processing device 200 receives an end signal, which is a signal to end the color reduction processing, from the terminal 300 (activity A420). In activity A420, for example, the following two-stage information processing is executed: (1) The communication unit 250 receives the end signal from the terminal 300. (2) The control unit 210 stores the end signal in the storage unit 220.

[0085] Next, the control unit 210 in the information processing device 200 integrates the line drawing portions of each image data included in the second image sequence with the painted portions of each image data after the reflection process (activity A430). In other words, in the integration step, the line drawing portions are integrated with the painted portions after the color reduction process. In activity A430, for example, the following three-stage information processing is executed: (1) The control unit 210 reads out the line drawing portions and the painted portions after the reflection process from the storage unit 220. (2) The control unit 210 executes the integration step and integrates the line drawing portions with the painted portions after the reflection process. (3) The control unit 210 stores the integrated image data (hereinafter also referred to as "fourth image data") in the storage unit 220.

[0086] 15 is a diagram supplementing the processing of activity A430. In activity A430, a line drawing portion 520 and a color-reduced painted portion 540 are integrated to generate integrated image data 550 (fourth image data). The line drawing portion 520, the color-reduced painted portion 540, and the integrated image data 550 are assumed to be any one of the image data. In activity A430, the line drawing portion 520 and the color-reduced painted portion 540 of each image data in the second image sequence are integrated, respectively, to generate an integrated image sequence in which each integrated image data 550 is used as an image sequence.

[0087] Next, the control unit 210 in the information processing device 200 transmits the combined image sequence to the terminal 300 (activity A440). In other words, in the output step, the fourth image data, which is the image data after color reduction, is output. In activity A440, for example, the following two-stage information processing is executed: (1) The control unit 210 reads the combined image sequence from the storage unit 220. (2) The control unit 210 transmits the combined image sequence to the terminal 300 via the communication unit 250.

[0088] Next, the control unit 210 in the information processing device 200 deletes data related to the second image sequence and data related to the fourth image data from the storage unit 220 (activity A450). In other words, in the deleting step, when the second image sequence is confirmed, data related to the second image sequence is deleted from the storage unit. According to this aspect, it is possible to protect information related to the image sequence in which a change in movement has been confirmed. Furthermore, in the deleting step, when the fourth image data is confirmed, data related to the fourth image data is deleted from the storage unit. According to this aspect, it is possible to protect information related to the image data after the color reduction process.

[0089] In activity A450, for example, the following two-stage information processing is executed: (1) The control unit 210 reads data related to the second image sequence and data related to the fourth image data from the storage unit 220. (2) The control unit 210 executes a deletion process and deletes the data related to the second image sequence and data related to the fourth image data from the storage unit 220.

[0090] Next, the control unit 310 in the terminal 300 receives the integrated image sequence from the information processing device 200 (activity A460). In activity A460, for example, the following two-stage information processing is executed: (1) The communication unit 350 receives the integrated image sequence from the information processing device 200. (2) The control unit 310 stores the integrated image sequence in the storage unit 320.

[0091] Next, the control unit 310 in the terminal 300 causes the integrated image sequence to be displayed on the display unit 330 (activity A470). In activity A470, for example, the following two-stage information processing is executed: (1) The control unit 310 reads out the integrated image sequence from the storage unit 320. (2) The control unit 310 causes the integrated image sequence to be displayed on the display unit 330.

[0092] 16 and 17 are diagrams comparing image data subjected to color reduction processing using the method of this embodiment with image data subjected to color reduction processing using a conventional method. Original image 700 is image data before color reduction processing. Comparative example data 710 is image data subjected to color reduction processing using a conventional method (k-means). Comparative example data 720 is image data subjected to color reduction processing using another conventional method (DBSCAN). Example data 730 is image data subjected to color reduction processing using the method of this embodiment.

[0093] 17, which is an enlarged view of region 740 in FIG. 16, shows that color noise occurred in both comparative example data 710 and comparative example data 720. On the other hand, no color noise occurred in example data 730, similar to original image 700. This demonstrates that the color reduction processing of this embodiment can improve color reproducibility after color reduction processing compared to conventional methods.

[0094] The information processing method of this embodiment makes it possible to adjust changes in movement expressed in a generated image sequence. Furthermore, the information processing method of this embodiment makes it possible to improve color reproducibility after color reduction processing compared to conventional methods. Furthermore, because of its simple configuration, the saved resources can be used for other core functions.

[0095] Although the embodiment of the present invention has been described above, the present invention is not limited to this and can be modified as appropriate within the scope of the technical idea of ​​the invention.

[0096] 4. Variations Modifications of this embodiment will be described in Section 4. The following modifications can be combined as appropriate.

[0097] An aspect of the present embodiment may be a program configured to cause a computer to execute each step of the information processing method of the present embodiment.

[0098] The control unit 210 performs write processing (storage processing) and read processing of various data and information to the memory unit 220, but this is not limited to this, and for example, the information processing of each activity may be performed using a register or cache memory within the control unit 210.

[0099] In this embodiment, the second image data is described as being one image, but this is not limited to this. The second image data may be two or more images. In this case, intermediate image data is generated between the first image data and each of the second image data.

[0100] Figure 18 is a diagram illustrating a prompt, which is an example of state information. Figure 18(A) is a diagram illustrating an input box for the prompt. Figure 18(B) is a diagram illustrating an example of a graph editor corresponding to the prompt.

[0101] When the state information is a prompt, an arbitrary prompt is entered in the input box 420 in activity A110. Here, it is assumed that "Angry" is entered. After that, a graph editor 430 is displayed in activity A180. In the graph editor 430, a line graph 431, a setting area 432, and a graph area 433 are displayed.

[0102] Line graph 431 is a graph for adjusting the degree of change between the first image data A and Anger. Setting area 432 is an area for setting the number of image data (image number information) included in the second image sequence to be output after adjusting the change in movement. Graph area 433 is a variable area of ​​line graph 431. Graph area 433 has the first image data A as its lower base and Angry as its upper base. That is, the closer line graph 431 is to the lower base, the closer it is to the representation of the first image data A, and the closer it is to the upper base, the closer it is to the representation of Angry.

[0103] In the example of Figure 18, if the first image data A is an image showing a normal facial expression, the image shows a state in which the facial expression gradually changes to an angry expression over time. Here, the type of prompt is not particularly limited as long as it is in a natural language. Therefore, for example, it may be "sorrow" showing sadness or "joy" showing joy, or it may be in a natural language other than English.

[0104] FIG. 19 is a diagram showing an example of setting a line graph in a graph editor. Graph editor 440 displays line graph 441, setting area 442, and graph area 443. Line graph 441 shows a sudden change from first image data A to near second image data B, then a sudden change from near second image data B to near first image data A, then a gradual change from near first image data A toward second image data B, and then a change from second image data B toward first image data A. In this way, the adjustment information may be information for adjusting a movement that changes from the first image data toward the status information and a movement that changes from the status information toward the first image data. According to this aspect, it is possible to adjust changes in movements that require repetition, such as blinking or lip-syncing.

[0105] The type of color after the change included in the change information generated in activity A350 may be applicable to image data other than the third image data or the fourth image data. In this case, the type of color after the change may be stored in the storage unit 220 of the information processing device 200, in the storage unit 320 of the terminal 300, or in an external hard disk drive. According to this aspect, the type of color set as the color after color reduction can be applied to another image.

[0106] In this embodiment, the color-reduced information has been described as first color-reduced information and second color-reduced information, but is not limited to this. In the color-reduced step, the color-reduced information may be displayed according to the set number of colors. In the color-reduced step, if the color-reduced information is changed, the changed color-reduced information may be reflected in the painted portion (image data). According to this aspect, the color after color reduction can be changed arbitrarily.

[0107] In this embodiment, the adjustment information is input by manipulating a line graph, but the present invention is not limited to this. For example, the adjustment information may be input by manipulating a bar graph or a pie chart, or may be input by inputting a predetermined index other than a graph.

[0108] Activities A110 to A250 and activities A260 to A470 may be executed independently. In this case, activity A260 may transmit colored image data to information processing device 200, and activity A270 may receive colored image data. In other words, the acquisition step acquires third image data, which is colored image data.

[0109] In the present embodiment, the information processing method of the present embodiment has been described as being executed between the information processing device 200 and the terminal 300, but the present invention is not limited to this. For example, when the program of the present embodiment is installed in the terminal 300, the information processing method of the present embodiment may be executed by the terminal 300 alone.

[0110] In the present embodiment, a CPU has been given as an example of the control unit 210 in the information processing device 200 and the control unit 310 in the terminal 300, but the present invention is not limited to this. The control unit 210 and the control unit 310 may each be a CPU, a graphics processing unit (GPU), a neural processing unit (NPU), a tensor processing unit (TPU), or a combination of these processors. In other words, the control unit 210 and the control unit 310 may represent one or more of the above processors, and these processors may cooperate to execute the information processing method of the present embodiment.

[0111] 5.Other It may be provided in the following manner.

[0112] (1) An information processing method comprising an acquisition step, a generation step, an adjustment step, and an output step, wherein the acquisition step acquires first image data and status information, the status information being at least one of second image data showing an image after a change to the first image data and a prompt showing a status after the change to the first image data, the generation step generates a plurality of intermediate image data that are image data that interpolate between the first image data and the status information, the generation step generates a first image sequence that is data in which the first image data, the plurality of intermediate image data, and the status information are arranged in chronological order, the adjustment step adjusts changes in movement expressed in the first image sequence based on the first image sequence and input adjustment information, the adjustment information being information for adjusting the changes in movement, and the output step outputs a second image sequence that is the adjusted image sequence.

[0113] According to this aspect, it is possible to adjust the change in motion expressed in the generated image sequence, and because of the simple configuration, the saved resources can be used for other core functions.

[0114] (2) The information processing method according to (1) above, wherein the adjustment information is information input via a graph editor.

[0115] According to this aspect, it is possible to adjust the change in movement while visually checking it.

[0116] (3) The information processing method according to (2) above, wherein the graph editor is an editor for inputting the adjustment information using a line graph.

[0117] According to this embodiment, it is possible to more easily adjust the change in movement while visually checking it.

[0118] (4) In the information processing method described in any one of (1) to (3) above, in the adjustment step, the change in movement is adjusted by deleting some of the intermediate image data from the first image sequence.

[0119] According to this aspect, it is possible to reduce the data volume of the image sequence and adjust the change in movement.

[0120] (5) In the information processing method described in any one of (1) to (4) above, the adjustment information is information for adjusting the movement changing from the first image data to the status information, and the movement changing from the status information to the first image data.

[0121] According to this embodiment, it is possible to adjust for changes in movements that require repetition, such as blinking or lip-syncing.

[0122] (6) In the information processing method described in any one of (1) to (5) above, the adjustment information includes image number information that indicates the number of image data included in the second image sequence, and in the adjustment step, the number of image data included in the second image sequence is adjusted based on the image number information.

[0123] According to this aspect, by balancing the frame rate of the second image sequence with the number of image data included in the second image sequence, the second image sequence can be changed quickly in a short period of time or slowly over a relatively long period of time.

[0124] (7) The information processing method according to any one of (1) to (6) above, further comprising a deletion step, in which, when the second image sequence is confirmed, data relating to the second image sequence is deleted from the storage unit.

[0125] According to this aspect, it is possible to protect information about the image sequence in which a change in movement has been determined.

[0126] (8) The information processing method according to any one of (1) to (7) above, wherein the image data is colored image data.

[0127] According to this aspect, the accuracy of the finally generated image sequence can be improved compared to the conventional art.

[0128] (9) An information processing system comprising a control unit, the control unit being configured to execute each step of the information processing method described in any one of (1) to (8) above.

[0129] According to this aspect, it is possible to adjust the change in motion expressed in the generated image sequence, and because of the simple configuration, the saved resources can be used for other core functions.

[0130] (10) A program configured to cause a computer to execute each step of the information processing method described in any one of (1) to (8) above.

[0131] According to this aspect, it is possible to adjust the change in motion expressed in the generated image sequence, and because of the simple configuration, the saved resources can be used for other core functions. Of course, this is not the case. [Explanation of symbols]

[0132] 1: In-between image data 2: Intermediate image data 3: In-between image data 4: In-between image data 5: In-between image data 6: Intermediate image data 7: In-between image data 8: Intermediate image data 9: In-between image data 10: Intermediate image data 100: Information Processing Systems 200: Information processing device 210: Control unit 211: Acquisition Department 212 :Generation part 213: Adjustment section 214: Output section 215: Deleted section 216: Separation section 217: Color reduction part 218: Integration Department 220: Storage section 250: Communications Department 260: Communication bus 300: Terminal 310: Control unit 320: Storage section 330: Display section 340: Input section 350: Communications Department 360: Communication bus 410: Graph Editor 411: Line graph 412: Settings area 413:Graph area 420: Input box 430: Graph Editor 431: Line graph 432: Setting area 433:Graph area 440: Graph Editor 441: Line graph 442: Settings area 443:Graph area 510: Image data 520: Line drawing 530: Painted area 540: Painted area 550: Integrated image data 600: Pallet 610: Color space 620: Color reduction method area 630: Add button 640: Type 641: Delete button 642: Color 650: Color setting box 651 :Area 652: area 653: area 700: Original image 710: Comparative example data 720: Comparative example data 730: Example data 740: area A: First image data B: Second image data

Claims

1. 1. An information processing method, comprising: The method includes an acquisition step, a generation step, an adjustment step, and an output step, In the acquiring step, first image data and status information are acquired; The state information is at least one of second image data indicating an image after the change of the first image data and a prompt indicating a state after the change of the first image data, In the generating step, a plurality of intermediate image data are generated, the intermediate image data being image data that is interpolated between the first image data and the state information; In the generating step, a first image sequence is generated, which is data in which the first image data, the plurality of intermediate image data, and the status information are arranged in a time series; In the adjustment step, a change in a movement expressed in the first image sequence is adjusted based on the first image sequence and input adjustment information; the adjustment information is information for adjusting the change in the movement and is information input via a graph editor; In the output step, a second image sequence is output, which is the adjusted image sequence. Information processing methods.

2. 2. The information processing method according to claim 1, the graph editor is an editor for inputting the adjustment information using a line graph; Information processing methods.

3. 2. The information processing method according to claim 1, In the adjustment step, a part of the intermediate image data among the plurality of intermediate image data is deleted from the first image sequence to adjust the change in the movement. Information processing methods.

4. 2. The information processing method according to claim 1, the adjustment information is information for adjusting a movement changing from the first image data to the status information and a movement changing from the status information to the first image data. Information processing methods.

5. 2. The information processing method according to claim 1, the adjustment information includes image number information that is information indicating the number of image data included in the second image sequence, In the adjustment step, a number of image data included in the second image sequence is adjusted based on the image number information. Information processing methods.

6. 2. The information processing method according to claim 1, Further, a deletion step is provided, In the deleting step, when the second image sequence is confirmed, data related to the second image sequence is deleted from a storage unit. Information processing methods.

7. 2. The information processing method according to claim 1, The first image data and the second image data are colored image data. Information processing methods.

8. An information processing system, A control unit is provided, The control unit is configured to execute each step of the information processing method according to any one of claims 1 to 7. Information processing system.

9. A program, A method for processing information according to any one of claims 1 to 7, program.

Citation Information

Patent Citations

  • Video data processing method and device, electronic equipment and storage medium

    CN109922372A

  • Animation display method and computer readable recording medium recording animation display program

    JP1998275244A

  • Image processor and image processing method

    JP2010244450A

  • Image generation device, image discriminator, image generation program, and image generation method

    JP2020126442A

  • Method for creating moving image and method for creating animation

    JP2022090830A