Information processing device, information processing system, and program

Abstract

To generate a dynamic image more easily by using vector data generated when a still image of a raster format is converted to a still image of a vector format.SOLUTION: As a management server 10 as an information processor has a controller 11. In the controller 11, a format converter 102 converts at least a part of a still image of a raster format to a still image of a vector format, and an image generation unit 105 generates a dynamic picture of a vector format in which at least a part of a target region is made to be a video, on the basis of the vector data of the target region of the still image of a vector format.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an information processing device, a data structure of a moving image file, an information processing system, and a program. [Background technology]

[0002] Moving images that incorporate motion effects into parts of still images are also known as cinemagraphs, and are widely used as eye-catching images in web advertisements, etc. Conventional methods for generating moving images with motion effects include a method for generating raster-format moving images with motion effects from raster-format still images or moving images, and a method for generating vector-format moving images with motion effects from vector-format still images (e.g., Patent Documents 1 to 3). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-156962 [Patent Document 2] Patent No. 6888098 [Patent Document 3] Japanese Patent Application Laid-Open No. 2016-129281 Summary of the Invention [Problem to be solved by the invention]

[0004] However, with conventional techniques, it has been difficult to convert a portion of a raster-format still image to generate a vector-format moving image.

[0005] An object of the present invention is to generate moving images more easily than ever before by utilizing vector data generated when converting still images in raster format into vector format. [Means for solving the problem]

[0006] The invention described in claim 1 includes a processor, the processor being configured to: The target area to be animated, as specified by the user into a second still image in vector format, and generate a vector format moving image in which at least a portion of the target area is animated based on the vector data of the target area. The invention described in claim 2 is the information processing device described in claim 1, characterized in that the processor generates the moving image based on the difference between the vector data of the target area before processing and the vector data of the target area after processing. The invention described in claim 3 is the information processing device described in claim 2, characterized in that the processor generates the moving image based on the differences in attribute information that constitute each of the vector data before and after processing. The invention described in claim 4 is an information processing device described in claim 3, characterized in that the processor generates multiple third still images in vector format based on a history of path data modifications as differences in the attribute information, and generates the moving image based on the multiple generated third still images. Claim 5 The invention described in claim 1 is characterized in that the user specifies the target area using predetermined application software. 1 The information processing device is described in Claim 6 The invention described in a processor; The processor: Raster format A target region including a predetermined object is extracted from the first still image. and convert it into a second still image in vector format. , Subject to video production Modifying the vector data of the target region; At least a portion of the target area is animated in vector format. The information processing device is characterized by generating moving images. Claim 7 The invention described in claim 1 is characterized in that the processor extracts the target region including, as the predetermined object, an object whose position or appearance at least changes over time. 6 The information processing device is described in Claim 8 The invention described in claim 1 is characterized in that the processor extracts the target region including at least one of a natural object and an artificial object as the object whose position or appearance at least changes over time. 7 The information processing device is described in Claim 9 The invention described in claim 1 is characterized in that the processor extracts the target region including an object whose appearance changes in shading over time as the object whose position or appearance changes over time. 7 The information processing device is described in Claim 10 The invention described in claim 1 is characterized in that the processor generates the moving image by correcting the vector data in accordance with the characteristics of the object whose position or appearance at least changes over time. 7 The information processing device is described in Claim 11 The invention described in claim 1 is characterized in that the processor extracts the target region and modifies the vector data using a machine learning model. 10 The information processing device is described in Claim 12 The invention described in claim 1 is characterized in that the processor generates the moving image by correcting the vector data in accordance with characteristics of the object that are predetermined for each of the objects. 10 The information processing device is described in Claim 13 The invention described in claim 1 is characterized in that the information indicating the characteristics of the object is associated with each object in advance and stored in a database. 12 The information processing device is described in Claim 14The invention described in the above includes a processor, wherein the processor receives a first input operation for converting a part or all of a first still image in a raster format into a second still image in a vector format, and when a part or all of the first still image has been converted into the second still image, the processor receives a second input operation for processing a target area of ​​the second still image that is to be animated. and input operations for changing the position or appearance of objects included in the target region. Accept an input operation for changing a position or an appearance of an object included in the target area is performed using predetermined application software, and the input operation performed using the application software is an operation for changing a position of an anchor of a path graphic; When a vector-format moving image in which at least a part of the target area is animated is generated, the information processing device performs control to display the moving image. Claim 15 The invention described in The target area to be animated, as specified by the user into a second still image in vector format; conversion means for converting part or all of the first still image into the second still image; second reception means for accepting a second input operation for processing the target area; generation means for generating a vector-format moving image that animates at least a part of the target area; and display means for displaying the generated moving image. Claim 16 The invention described in The target area to be animated, as specified by the user into a second still image in vector format, and to generate a moving image in vector format in which at least a portion of the target area is animated based on the vector data of the target area. [Effects of the Invention]

[0007] According to the present invention of claim 1, it is possible to provide an information processing device that can generate moving images more easily than before by utilizing vector data generated when converting still images in raster format into vector format. Furthermore, it is possible to animate objects contained in an area designated by the user. According to the present invention of claim 2, eye-catching motion effects and web-friendly moving images can be generated by processing vector format still images. According to the present invention of claim 3, eye-catching motion effects and web-friendly moving images can be generated by operations that cause differences in the attribute information that constitutes vector data. According to the present invention of claim 4, it is possible to generate eye-catching motion effects and web-friendly moving images based on a plurality of vector format still images generated from the history of path data modifications. Claim 5 According to the present invention, it is possible to animate an object contained in a region designated by an input operation using application software. Claim 6 According to the present invention, It is possible to provide an information processing device that can generate moving images more easily than before by using vector data generated when converting a still image in raster format into a vector format. The user can create moving images with motion effects without having to consider the image of the animation or perform any special input operations. Claim 7 According to the present invention, a user can create a moving image in which at least one of the position or appearance of an object changes over time without having to consider the image of the animation or perform any special input operations. Claim 8 According to the present invention, a user can create a moving image in which at least one of the position or appearance of a natural or artificial object changes over time, without having to consider the image of the animation or perform any special input operations. Claim 9 According to the present invention, a user can create a moving image in which the external shading of an object changes without having to consider the image of the moving image or perform any special input operation. Claim 10 According to the present invention, a user can create a moving image in which an object changes according to the characteristics of the object, without having to consider the image of the animation or perform any special input operations. Claim 11 According to the present invention, a user can create moving images of changing objects using the results of machine learning without having to consider the image of the animation or perform any special input operations. Claim12 According to the present invention, a user can create a moving image in which an object changes according to the characteristics of the object that are predetermined for each object, without having to consider the image of the animated image or perform any special input operations. Claim 13 According to the present invention, the characteristics of each object are associated with the object and stored in advance in a database, thereby enabling efficient processing. Claim 14 According to the present invention, it is possible to provide an information processing device that can generate moving images more easily than before by utilizing vector data generated when converting a still image in raster format into a vector format. Furthermore, by changing the vector-format still image, it is possible to change the position and appearance of an object included in the target area. Furthermore, the operation of changing the vector-format still image can be performed using predetermined application software. Furthermore, as an operation of changing the vector-format still image, it is possible to perform an operation of changing the position of the anchor of a path graphic using predetermined application software. Claim 15 According to the present invention, it is possible to provide an information processing system that can generate moving images more easily than before by utilizing vector data generated when converting still images in raster format into vector format. Furthermore, it is possible to animate objects contained in an area designated by the user. Claim 16 According to the present invention, it is possible to provide a program that makes it possible to generate moving images more easily than before by utilizing vector data that is generated when a still image in raster format is converted into a vector format. Furthermore, it is possible to animate objects contained in an area designated by the user. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating an example of the overall configuration of an information processing system to which the present embodiment is applied. [Figure 2] FIG. 2 illustrates a hardware configuration of a management server. [Figure 3] FIG. 2 is a diagram illustrating a functional configuration of a control unit of the management server. [Figure 4] FIG. 2 is a diagram illustrating the functional configuration of a control unit of the user terminal. [Figure 5] 10 is a flowchart showing the flow of processing by the management server. [Figure 6] 10 is a flowchart showing the flow of processing of a user terminal. [Figure 7]1A is a diagram showing a specific example of a still image, and FIG. 1B is a diagram showing a specific example of a data structure when the still image in FIG. 1A is expressed in a raster format. [Figure 8] FIG. 10 is a diagram showing a specific example of a raster format still image. [Figure 9] 10A and 10B are diagrams showing specific examples of a user interface displayed on a user terminal when vector data of an image of a target area converted into vector format is processed. [Figure 10] FIG. 10 is a diagram showing a specific example of the data structure of vector data of an image of a target area converted into vector format. [Figure 11] FIG. 10 is a diagram showing a specific example of the data structure of vector data of a vector-format video image including an animated target region. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. (Configuration of information processing system) FIG. 1 is a diagram showing an example of the overall configuration of an information processing system 1 to which the present embodiment is applied. The information processing system 1 is configured by connecting a management server 10 and a user terminal 30 via a network 90. ​​The network 90 is, for example, a LAN (Local Area Network) or the Internet.

[0010] The management server 10 is an information processing device that serves as a server that manages the information processing system 1. For example, the management server 10 converts part or all of a raster-format still image transmitted from the user terminal 30 into a vector-format still image, and generates a vector-format moving image by animating at least a part of the target area of ​​the still image based on vector data of the target area. Also, for example, the management server 10 converts a target area of ​​a raster-format still image transmitted from the user terminal 30 into a vector-format still image, and generates a vector-format moving image by animating at least a part of the target area based on the vector data of the still image. Details of these processes performed by the management server 10 will be described later.

[0011] Here, "raster format" refers to an image description format that represents an image using pixels of different densities or various colors, and is often used to represent complex shading, such as in photographs. Raster format images are saved in file formats such as BMP, JPEG, TIFF, GIF, and PNG. "Vector format" refers to an image description format that represents an image using vector data. "Vector data" is data that represents points, lines, polygons, etc. using coordinate values ​​and attribute information. Vector format images are saved in file formats such as SVG, PDF, and HTML. Generally, the amount of data required for illustrations and graphic data can be reduced by using vector format rather than raster format. In this specification, the term "image" includes "image data."

[0012] The user terminal 30 is an information processing device such as a personal computer, tablet terminal, or smartphone operated by a user. For example, the user terminal 30 transmits a raster-format still image to the management server 10. Also, for example, the user terminal 30 acquires and displays a vector-format still image transmitted from the management server 10. Also, for example, the user terminal 30 accepts a designation of a target area in the vector-format still image and transmits information relating to the designation of the target area (hereinafter referred to as "designation information") to the management server 10. Also, for example, the user terminal 30 acquires and displays a vector-format moving image transmitted from the management server 10. Details of these processes performed by the user terminal 30 will be described later.

[0013] The functions of each of the management server 10 and the user terminal 30 constituting the information processing system 1 described above are merely examples, and it is sufficient that the information processing system 1 as a whole has the above functions. Therefore, some or all of the above functions may be shared or cooperated within the information processing system 1. That is, some or all of the functions of the management server 10 may be functions of the user terminal 30, or some or all of the functions of the user terminal 30 may be functions of the management server 10. Furthermore, some or all of the functions of the management server 10 and the user terminal 30 constituting the information processing system 1 may be transferred to another server (not shown), etc. This promotes processing in the information processing system 1 as a whole and also enables the processes to complement each other.

[0014] (Management server hardware configuration) FIG. 2 is a diagram showing the hardware configuration of the management server 10. As shown in FIG. The management server 10 has a control unit 11, a memory 12, a storage unit 13, a communication unit 14, an operation unit 15, and a display unit 16. These units are connected by a data bus, an address bus, a PCI (Peripheral Component Interconnect) bus, etc.

[0015] The control unit 11 is a processor that controls the functions of the management server 10 through the execution of various software such as an OS (operating system) and application software. The control unit 11 is configured, for example, by a CPU (Central Processing Unit). The memory 12 is a storage area that stores various software and data used for executing the software, and is used as a working area for calculations. The memory 12 is configured, for example, by a RAM (Random Access Memory).

[0016] The storage unit 13 is a storage area that stores input data for various software programs, output data from various software programs, etc. The storage unit 13 is configured with, for example, an HDD (Hard Disk Drive), an SSD (Solid State Drive), a semiconductor memory, etc. that are used to store programs, various setting data, etc. The storage unit 13 stores databases that store various information, such as an object DB 801 that stores information indicating the characteristics of various objects, and an image DB 802 that stores images (still images, moving images), etc.

[0017] The communication unit 14 transmits and receives data to and from the user terminal 30 and the outside via the network 90. ​​The operation unit 15 is composed of, for example, a keyboard, a mouse, mechanical buttons, and switches, and accepts input operations. The operation unit 15 also includes a touch sensor that forms a touch panel integrally with the display unit 16. The display unit 16 is composed of, for example, a liquid crystal display or an organic EL (Electro Luminescence) display used to display information, and displays images, text data, and the like.

[0018] (Hardware configuration of user terminal) The hardware configuration of the user terminal 30 is similar to the hardware configuration of the management server 10 shown in Fig. 2. Therefore, illustration and description of the hardware configuration of the user terminal 30 will be omitted.

[0019] (Functional configuration of the control unit of the management server) FIG. 3 is a diagram showing the functional configuration of the control unit 11 of the management server 10. As shown in FIG. In the control unit 11 of the management server 10, an information acquisition unit 101, a format conversion unit 102, a target area extraction unit 103, a vector data extraction unit 104, an image generation unit 105, and a transmission control unit 106 function.

[0020] The information acquisition unit 101 acquires various types of information. For example, the information acquisition unit 101 acquires a raster format still image transmitted from the user terminal 30. The raster format still image acquired by the information acquisition unit 101 is stored and managed in the image DB 802 (see FIG. 2) of the storage unit 13. The information acquisition unit 101 also acquires designation information transmitted from the user terminal 30. The "designation information" refers to information related to the designation of a target area by the user.

[0021] The format conversion unit 102 converts the format of some or all of the images (still images, moving images). For example, the format conversion unit 102 converts some or all of the raster-format still images acquired by the information acquisition unit 101 into vector-format still images. Also, for example, the format conversion unit 102 converts vector-format still images into raster-format still images.

[0022] The target area extraction unit 103 extracts a target area from a raster format still image or a vector format still image. When designation information has been acquired by the information acquisition unit 101, the target area extraction unit 103 extracts a target area identified by the designation information from the raster format still image or the vector format still image. On the other hand, when designation information has not been acquired by the information acquisition unit 101, the target area extraction unit 103 automatically identifies and extracts the target area. Specifically, the target area extraction unit 103 analyzes the raster format still image or the vector format still image, and extracts a target area from the raster format still image or the vector format still image that was the subject of the analysis based on the analysis results.

[0023] A predetermined object is included in part or all of the target area extracted by the target area extraction unit 103. An example of a "predetermined object" is an object whose position or appearance at least changes over time. When extracting a target area that includes, in part or in whole, an object whose position or appearance at least changes over time, the target area extraction unit 103 can also use a machine learning model that uses AI (artificial intelligence).

[0024] The "objects whose position or appearance at least changes over time" included in the target area include natural objects and man-made objects. Examples of "natural objects" include the ocean, rivers, mountains, lakes, waterfalls, water surfaces, steam, animals including humans, plants, clouds, shadows, smoke, rain, snow, lightning, and light. Examples of "man-made objects" include buildings, automobiles, bicycles, airplanes, trains, motorcycles, gears, wheels, drinks, jelly, pudding, lighting, lights, train windows, rotating objects, and moving objects.

[0025] Note that "at least one of the position or appearance changes over time" is a concept that includes changes in the appearance of shadows over time. For this reason, even if an object itself does not move, or if it moves but the movement is not visible, if its appearance changes due to light or shadow (such as a building or mountain), it is included in the above-mentioned man-made object or natural object.

[0026] The vector data extraction unit 104 extracts vector data of the still image that has been partially or entirely converted into vector format by the format conversion unit 102. The vector data extracted by the vector data extraction unit 104 includes vector data of the target region extracted by the target region extraction unit 103.

[0027] Furthermore, when the vector data of the target area is processed, the vector data extraction unit 104 extracts attribute information constituting the vector data of the target area before and after the processing. The vector data extraction unit 104 also extracts a difference as the difference between the attribute information before and after the processing. Path data, for example, can be cited as an example of "attribute information."

[0028] "Path data" is character string data that is a component of vector data. The area enclosed by lines obtained by executing a command according to the character string of path data is called a "path graphic." Differences in attribute information can be obtained, for example, from the history of path data modifications. Note that the method for processing vector data is not particularly limited, and for example, an existing vector graphic editor or the like may be used. Specific examples of vector data processing will be described later with reference to FIG. 9.

[0029] The image generation unit 105 generates a vector-format moving image in which at least a part of the target area is animated based on the vector data of the target area included in the raster-format still image. Specifically, the image generation unit 105 generates a vector-format moving image in which at least a part of the target area is animated based on the difference between the vector data of the target area before processing and the vector data of the target area after processing.

[0030] More specifically, the image generation unit 105 generates a vector-format moving image in which at least a part of the target area is animated, based on the difference between path data as attribute information of the vector data of the target area before processing and the path data of the vector data of the target area after processing. In this case, the image generation unit 105 can generate a vector-format moving image in which at least a part of the target area is animated, based on the history of corrections to the path data.

[0031] For example, if a user corrects path data constituting the vector data of a target area once, a moving image can be created consisting of two still images: a vector-format still image containing the path data before the correction, and a vector-format still image containing the path data after the correction. Also, if a user corrects path data constituting the vector data of a target area twice, a moving image can be created consisting of three still images: a vector-format still image containing the path data before the correction, a vector-format still image containing the path data after the first correction, and a vector-format still image containing the path data after the second correction. In this way, a moving image is generated from multiple vector-format still images generated each time path data is corrected. Therefore, for example, by narrowing the range of each path data correction and increasing the number of corrections, a smoother moving image can be generated.

[0032] The image generation unit 105 can also modify the vector data of the target area according to the characteristics of an object whose position or appearance at least changes over time, and generate a vector-format moving image in which at least a portion of the target area is animated. That is, the image generation unit 105 can automatically modify the vector data of the target area without relying on modifications by the user. In this case, the modification is performed according to the characteristics of the object included in the target area, thereby preventing unnatural animation.

[0033] For example, if the object included in the target area is an automobile, the vector data of the target area is corrected according to the characteristics of the automobile. In this case, the vector data of the target area is corrected according to the characteristics of the automobile, such as the fact that the overall shape of the vehicle body does not change, but the entire vehicle body moves back and forth due to the rotation of the tires. This makes it possible to realize natural animation of the object included in the target area. Note that information indicating the object characteristics used to correct the vector data of the target area is stored in association with each object in the object DB 801 (see FIG. 2) of the storage unit 13.

[0034] The transmission control unit 106 controls the transmission of various types of information to the user terminal 30. For example, the transmission control unit 106 controls the transmission of still image data obtained by converting part or all of a raster format still image acquired by the information acquisition unit 101 into a vector format still image to the user terminal 30. The transmission control unit 106 also controls the transmission of a vector format moving image obtained by moving at least part of a target area of ​​a vector format still image to the user terminal 30.

[0035] (Functional configuration of the control unit of the user terminal) FIG. 4 is a diagram showing the functional configuration of the control unit of the user terminal 30. As shown in FIG. In the control section of the user terminal 30, an input receiving section 301, a transmission control section 302, an information acquisition section 303, and a display control section 304 function.

[0036] The input accepting unit 301 acquires information input by a user operation. Specifically, the input accepting unit 301 accepts an input operation for selecting a raster-format still image to be partially animated. The input accepting unit 301 also accepts an input operation for transmitting the raster-format still image selected by the user to the management server 10. The input accepting unit 301 also accepts an input operation for specifying a target area of ​​a raster-format still image or a vector-format still image. The input accepting unit 301 also accepts an input operation for correcting vector data of the target area. Specifically, the input accepting unit 301 accepts an input operation for correcting path data as attribute information constituting the vector data of the target area.

[0037] The input receiving unit 301 receives an input operation for modifying path data, which is an input operation for processing at least a part of a target area of ​​a vector-format still image. Specifically, the input receiving unit 301 receives an input operation for changing the position or appearance of an object included in the target area. The input operation for changing the position or appearance of an object included in the target area is an operation for changing the position of an anchor of a path figure.

[0038] The input operation performed by the user to change the position of the anchor of the path graphic may be performed, for example, via a user interface displayed on the display unit by activating dedicated application software installed on the user terminal 30, or via a user interface displayed on the display unit by accessing a dedicated website. A specific example of the input operation to change the position of the anchor of the path graphic will be described later with reference to FIG. 9.

[0039] The transmission control unit 302 controls the transmission of raster format still images selected as targets for animation by a user's input operation to the management server 10. The transmission control unit 302 also controls the transmission of designation information to the management server 10.

[0040] The information acquisition unit 303 acquires various types of information. For example, the information acquisition unit 303 acquires a still image in vector format transmitted from the management server 10. The information acquisition unit 303 also acquires a moving image in vector format in which at least a part of a target area is animated.

[0041] The display control unit 304 controls the display of images acquired by the information acquisition unit 101. Specifically, the display control unit 304 controls the display of still images in vector format acquired by the information acquisition unit 101. The display control unit 304 also controls the display of moving images in vector format in which at least a part of a target area acquired by the information acquisition unit 101 is animated. The display of these images may be performed via the above-mentioned user interface.

[0042] (Management server processing) FIG. 5 is a flowchart showing the flow of processing by the management server 10. When a raster format still image is transmitted from the user terminal 30 (YES in step 601), the management server 10 acquires the raster format still image (step 602). On the other hand, if a raster format still image has not been transmitted from the user terminal 30 (NO in step 601), the management server 10 repeats the processing of step 601 until a raster format still image is transmitted from the user terminal 30.

[0043] When designation information for the raster-format still image acquired in step 602 is transmitted to the management server 10 (YES in step 603), the management server 10 acquires the designation information (step 604) and extracts a target area based on the designation information (step 605). Specifically, the management server 10 extracts a target area including a predetermined object. On the other hand, if designation information is not transmitted from the user terminal 30 (NO in step 603), the management server 10 extracts a target area based on the analysis results of the still image (step 606). Specifically, for example, the management server 10 analyzes the raster-format still image acquired in step 602 and extracts a target area including a predetermined object based on the analysis results.

[0044] The management server 10 converts the still image of the target area extracted in step 605 or step 606 into vector format (step 607) and extracts vector data of the still image of the target area (step 608). Then, if the vector data of the target area is processed by a user's input operation (YES in step 609), attribute information constituting the vector data of the target area before and after processing and the difference therebetween are extracted (step 610). On the other hand, if the vector data of the target area has not been processed (NO in step 609), step 609 is repeated until the vector data of the target area is processed. Then, based on the extracted difference, the management server 10 generates a vector-format moving image in which at least a portion of the target area is animated (step 611), and controls transmission of the generated vector-format moving image to the user terminal 30 (step 612).

[0045] (User terminal processing) FIG. 6 is a flowchart showing the flow of processing performed by the user terminal 30. When an input operation is performed to select a raster-format still image to be animated (YES in step 701), the user terminal 30 accepts the input operation (step 702). On the other hand, when an input operation is not performed to select a raster-format still image to be animated (NO in step 701), the user terminal 30 repeats step 701 until an input operation is performed to select a raster-format still image to be animated.

[0046] When an input operation is performed to transmit the selected raster format still image to the management server 10 (YES in step 703), the user terminal 30 accepts the input operation (step 704). On the other hand, when an input operation is not performed to transmit the selected raster format still image to the management server 10 (NO in step 703), the user terminal 30 repeats step 703 until an input operation is performed to transmit the selected raster format still image to the management server 10.

[0047] When an input operation to designate a target area is performed (YES in step 705), the user terminal 30 accepts the input operation (step 706) and extracts the target area based on the designation information (step 707). On the other hand, when an input operation to designate a target area is not performed (NO in step 705), the management server 10 extracts the target area based on the analysis result of the still image (step 708).

[0048] When an input operation is performed to modify the vector data of the target area extracted based on the specified information or the analysis result of the still image (YES in step 709), the user terminal 30 accepts the input operation (step 710). On the other hand, when an input operation to modify the vector data of the target area is not performed (NO in step 709), the user terminal 30 repeats step 709 until an input operation to modify the vector data of the target area is performed.

[0049] When the management server 10 generates a vector-format moving image in which at least a portion of the target area is animated and transmits the moving image from the management server 10 (YES in step 711), the user terminal 30 acquires the moving image (step 712) and controls to display it on the display unit (step 713). On the other hand, if the vector-format moving image in which at least a portion of the target area is animated has not been transmitted (NO in step 711), the user terminal 30 repeats step 711 until the vector-format moving image in which at least a portion of the target area is animated is transmitted.

[0050] (Example) Fig. 7(A) is a diagram showing a specific example of a still image, and Fig. 7(B) is a diagram showing a specific example of a data structure when the still image of Fig. 7(A) is expressed in raster format. The still image shown in Figure 7(A) is an image in which a colored rectangle is placed in the center of a rectangular area. Figure 7(B) shows the data structure when the image in Figure 7(A) is represented in raster format. As shown in Figure 7(B), the raster format is a format for representing images using data composed of pixels represented by the RGB color model arranged in a vertical and horizontal grid pattern. For example, "(0,0,0)" represents a white pixel, and "(99,8,5)" represents a colored pixel. Images represented in raster format become grainy and degrade when enlarged. For this reason, in order to prevent image degradation, it is necessary to increase the number of pixels and increase the resolution, but increasing the resolution increases the amount of data accordingly.

[0051] FIG. 8 is a diagram showing a specific example of a raster format still image. The raster-format still image shown in Figure 8 is a graphic image of a tiger's head. Now, let's say a user wants to incorporate a motion effect into part of the still image in Figure 8 and use it in their company's web advertisement. As mentioned above, moving images that incorporate a motion effect into part of a still image are also called cinemagraphs, and are widely used in web advertisements and other applications as eye-catching images.

[0052] Conventional techniques for generating moving images with motion effects include generating raster-format moving images with motion effects from raster-format still images or moving images, and generating vector-format moving images with motion effects from vector-format still images. Displaying moving images with motion effects as web advertisements and the like requires web compatibility, which allows them to be compatible with devices of various sizes. For example, raster-format images, as mentioned above, degrade when enlarged, so their resolution must be increased. However, this increases the amount of data required, making it impossible to ensure web compatibility. In contrast, vector-format images do not degrade when enlarged, but complex shading images require extensive calculations to be digitized, limiting the variety of eye-catching effects they can produce.

[0053] Therefore, in this embodiment, a vector-format moving image is generated by animating at least a portion of a target area, taking advantage of the advantages of both raster-format images and vector-format images. Specifically, as described above, a portion or all of a raster-format still image is converted into a vector-format still image, and a vector-format moving image is generated by animating at least a portion of the target area based on changes in the vector data representing the target area. Vector-format moving images generated using this method are suitable for simple animation, have high web compatibility, and require less data. In the example of Figure 8, the user performs an input operation to specify a target area G, which represents the mouth of the tiger's head. The image of the target area G is then converted into vector format, and vector data is extracted.

[0054] 9A and 9B are diagrams showing a specific example of a user interface displayed on the user terminal 30 when processing is applied to the vector data of the image of the target area G converted into vector format. Note that Fig. 9A shows the state before processing is applied, and Fig. 9B shows the state after processing is applied. The user can use application software such as an existing vector graphic editor to process the vector data of the image of the target area G that has been converted into vector format. When the user uses the vector graphic editor installed on the user terminal 30 to display the path graphic of the target area G, a user interface that allows editing of the path graphic is displayed on the display unit of the user terminal 30, as shown in Fig. 9(A), for example.

[0055] The user performs an operation to move the position of the anchor P of the path graphic displayed on the interface. This allows the shape of the part of the tongue in the tiger's mouth to be changed. For example, the user can change the position of the anchor P shown in FIG. 9(A) to the position of the anchor P shown in FIG. 9(B). This results in one correction of the path data.

[0056] As a result of such corrections, it becomes possible to animate two images, with the path figure of the target area G shown in Fig. 9(A) as the first frame image and the path figure of the target area G shown in Fig. 9(B) as the second frame image. Note that Fig. 9 shows an example in which the path data is corrected only once, but this is not limiting, and corrections may be made two or more times. Increasing the number of corrections increases the number of still images used for animation, making it possible to express smoother tongue movements.

[0057] Fig. 10 shows a specific example of the data structure of vector data of the image of the target area G converted into vector format. Fig. 10(A) shows the state before the path data is corrected, and Fig. 10(B) shows the state after the path data is corrected. Comparing the vector data shown in Figure 10(A) with the vector data shown in Figure 10(B), a difference has occurred in the character strings of the path data. Specifically, a difference has occurred in the underlined character strings D1 and D2 of the path data. This difference occurs because the position of the anchor P shown in Figure 9(A) has been corrected to the position of the anchor P shown in Figure 9(B) by a user input operation.

[0058] FIG. 11 is a diagram showing a specific example of the data structure of vector data of a moving image in vector format that includes an animated target region G. When animation is performed according to this embodiment based on the vector data shown in Fig. 10(A) and the vector data shown in Fig. 10(B), the vector data shown in Fig. 11 is generated. Character string D3 of the path data constituting the vector data shown in Fig. 11 is a combination of character string D1 of the path data constituting the vector data shown in Fig. 10(A) and character string D2 of the path data constituting the vector data shown in Fig. 10(B). Therefore, the first half of character string D3 has the same structure as character string D1, and the second half of character string D3 has the same structure as character string D2.

[0059] 11 shows an example in which animation is created based on two still images obtained by modifying the path data constituting the vector data once, but this is not limiting. Animation may also be created based on n+1 still images obtained by modifying the path data constituting the vector data n times (n is an integer value of 2 or greater).

[0060] Although the present embodiment has been described above, the present invention is not limited to the above-described embodiment. Furthermore, the effects of the present invention are not limited to those described in the above-described embodiment. For example, the configuration of the information processing system 1 shown in FIG. 1 and the hardware configuration of the management server 10 shown in FIG. 2 are merely examples for achieving the object of the present invention and are not particularly limited. Furthermore, the functional configuration of the management server 10 shown in FIG. 3 and the functional configuration of the user terminal 30 shown in FIG. 4 are also merely examples and are not particularly limited. It is sufficient for the information processing system 1 of FIG. 1 to be provided with a function that can execute the above-described processing as a whole, and the functional configuration used to realize this function is not limited to the examples of FIGS. 3 and 4.

[0061] 5 and 6 are merely examples and are not particularly limited. The steps are not necessarily performed in chronological order according to the illustrated order of steps, but may be performed in parallel or individually. Specific examples shown in FIGS. 7 to 11 are also merely examples and are not particularly limited. [Explanation of symbols]

[0062] 1...information processing system, 10...management server, 11...control unit, 30...user terminal, 90...network, 101...information acquisition unit, 102...format conversion unit, 103...target area conversion unit, 104...vector data extraction unit, 105...image generation unit, 106...transmission control unit, 301...input reception unit, 302...transmission control unit, 303...information acquisition unit, 304...display control unit

Claims

1. a processor; The processor: converting a target area of ​​the first still image in raster format, which is designated by the user and to be animated, into a second still image in vector format; A vector format moving image is generated based on the vector data of the target area, in which at least a part of the target area is animated. Information processing device.

2. The processor generates the moving image based on a difference between vector data of the target area before processing and vector data of the target area after processing. The information processing device according to claim 1 .

3. The processor generates the moving image based on the difference in attribute information constituting each of the vector data before and after processing. The information processing device according to claim 2 .

4. The processor: generating a plurality of third still images in vector format based on a history of path data corrections as differences in the attribute information; The moving image is generated based on the generated plurality of third still images. The information processing device according to claim 3 .

5. The user specifies the target area using predetermined application software. The information processing device according to claim 1 .

6. A processor is provided, The processor: extracting a target area including a predetermined object from a first still image in raster format and converting the extracted target area into a second still image in vector format; The vector data of the target area to be animated is modified to generate a vector format moving image in which at least a part of the target area is animated. Information processing device.

7. The processor is characterized in that it extracts the target region including, as the predetermined object, an object whose position or appearance at least changes over time. The information processing device according to claim 6 .

8. The processor is characterized in that the target region includes at least one of a natural object and an artificial object as the object whose position or appearance at least changes over time. The information processing device according to claim 7 .

9. the processor extracts the target region including an object whose appearance changes in shading over time as the object whose position or appearance changes over time. The information processing device according to claim 7 .

10. the processor generates the moving image by correcting the vector data in accordance with characteristics of the object whose position or appearance changes over time. The information processing device according to claim 7 .

11. The processor extracts the target region and modifies the vector data using a machine learning model. The information processing device according to claim 10.

12. the processor modifies the vector data in accordance with characteristics of the object that are predetermined for each object, and generates the moving image. The information processing device according to claim 10.

13. The information indicating the characteristics of the object is previously associated with each object and stored in a database. The information processing device according to claim 12.

14. a processor; The processor: accepting a first input operation for converting a part or all of a first still image in a raster format into a second still image in a vector format; When a part or all of the first still image is converted into the second still image, an input operation for changing a position or an appearance of an object included in a target area to be animated is received as a second input operation for processing the target area of ​​the second still image; an input operation for changing a position or an appearance of an object included in the target area is performed using predetermined application software; the input operation performed using the application software is an operation for changing the position of an anchor of a path graphic; When a vector-format moving image in which at least a part of the target area is animated is generated, control is performed to display the moving image. Information processing device.

15. a first receiving means for receiving a first input operation for converting a target area to be animated, which is designated by a user, of a first still image in raster format into a second still image in vector format; a conversion means for converting a part or all of the first still image into the second still image; a second receiving means for receiving a second input operation for processing the target area; a generating means for generating a vector-format moving image by animating at least a portion of the target area; a display means for displaying the generated moving image; characterized in that it has Information processing system.

16. On the computer, a function of converting a target area of ​​a first still image in raster format, which is designated by a user and to be animated, into a second still image in vector format; a function of generating a vector format moving image in which at least a part of the target area is animated based on the vector data of the target area; A program to achieve this.

Images