Information processing device, information processing method, and information processing program

Abstract

To provide an information processing device, information processing method and information processing program, which allow users to have drawing experience similar to real drawing experience.SOLUTION: An information processing device provided herein is configured to provide a material selection screen for allowing a user to select a drawing material to be drawn, provide a means selection screen for allowing the user to select drawing means for drawing using the drawing material, provide a drawing surface selection screen for allowing the user to select a drawing surface to be used to draw the drawing material, display a drawing of the drawing material made on the drawing surface using the drawing means, and expressing temporal change of the drawing material on the displayed drawing.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] Drawing programs that allow users to draw pictures, etc. on a computer display screen have been known for some time. In the drawing programs, users can select the type of brush to be used for drawing, the drawing color, the thickness of the lines to be drawn, etc., and then operate an input device such as a mouse to draw pictures, etc.

[0003] There is also a technology for representing the bleeding of ink or the like that occurs when drawing on actual paper as drawing data. For example, Patent Document 1 describes a technology for modeling the structure of paper fibers, creating paper fiber structure data in which the data on the paper fiber structure is set so as to correspond to each pixel in a figure, modeling the flow of ink in the gaps between the fibers in the paper, creating image data representing a figure with bleeding based on the paper fiber structure data, and displaying an image of the figure with bleeding on a display device based on this image data. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 8-202850 Summary of the Invention [Problem to be solved by the invention]

[0005] However, since the physical properties of real paint or ink change over time after it is applied to a drawing surface such as paper or canvas, the dripping or bleeding of the paint or ink also changes over time. For this reason, conventional drawing programs that express bleeding as the drawing progresses can sometimes have difficulty providing users with a drawing experience similar to that of a real drawing in which paint or ink changes over time.

[0006] The present invention has been made in consideration of the above circumstances, and one object of the present invention is to provide an information processing device, an information processing method, and an information processing program that can give users a drawing experience similar to real drawing. [Means for solving the problem]

[0007] In order to solve the above problems, the information processing device of the embodiment is an information processing device that allows a user to experience drawing on the display unit of a user terminal used by the user, and is equipped with a material selection screen providing unit that provides a material selection screen for selecting the material to be drawn on, a means selection screen providing unit that provides a means selection screen for selecting a drawing means for drawing using the material to be drawn on, a drawing surface selection screen providing unit that provides a drawing surface selection screen for selecting a drawing surface on which the material to be drawn on will be drawn, a drawing display unit that displays a drawing of the material to be drawn on the drawing surface using the drawing means, and a time-change representation unit that represents the change over time in the material to be drawn in the drawing displayed on the drawing display unit. [Effects of the Invention]

[0008] According to one embodiment of the present invention, a material selection screen is provided for selecting the material to be drawn on, a tool selection screen is provided for selecting a drawing tool for drawing using the material to be drawn on, a drawing surface selection screen is provided for selecting a drawing surface on which the material to be drawn is to be drawn, a drawing of the material to be drawn on the drawing surface using the drawing tool is displayed, and changes in the material to be drawn on the displayed drawing over time are expressed, thereby providing a drawing experience similar to that of real drawing to the user. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of an outline of a drawing process using an information processing device according to an embodiment. [Figure 2] 1A is a diagram illustrating an example of sagging of a drawing material using an information processing device according to an embodiment, and FIG. 1B is a diagram illustrating an example of the expression of sagging of a drawing material. [Figure 3] 10A to 10C are diagrams illustrating an example of how bleeding of a drawing material is expressed using the information processing device according to the embodiment. [Figure 4] FIG. 1 illustrates an example of a configuration of an information processing device according to an embodiment. [Figure 5] FIG. 1 illustrates an example of a hardware configuration of an information processing apparatus according to an embodiment. [Figure 6] 10 is a flowchart illustrating an example of an operation of the information processing device according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] An information processing device, an information processing method, and an information processing program according to an embodiment of the present invention will be described in detail below with reference to the drawings. Note that in the following description of each figure, the same components in the figures will be assigned the same reference numerals and their description may be omitted.

[0011] First, an outline of a drawing process using an information processing device will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of an outline of a drawing process using an information processing device according to an embodiment.

[0012] In FIG. 1, steps S1 to S3 show the details of the drawing process executed by the information processing device 1. The processes of steps S1 and S2, and steps S2 and S3 can be transitioned by a user's operation or automatically. The processes of steps S1 to S3 are executed using a display unit of a user terminal used by the user. In this embodiment, the drawing refers to a virtual drawing displayed on the display unit of the user terminal by a drawing program, and the information processing device provides the user with a simulated drawing experience. The display unit of the user terminal refers to the display unit of the information processing device or the display unit of a device communicatively connected to the information processing device. The user terminal is, for example, a device in which the main body and the display unit are integrated, such as a tablet PC, a smartphone, or a notebook PC. The user terminal may also be a device in which the main body and the display unit are separated, such as a desktop PC.

[0013] In the art material selection process of step S1, an art material selection process is executed for the user to select art materials. In this embodiment, art materials refer to the material to be drawn, the drawing tool, and the drawing surface. The art material selection process of step S1 includes a process for selecting the material to be drawn, a process for selecting the drawing tool, and a process for selecting the drawing surface.

[0014] In the drawing material selection process, a material selection screen is provided for the user to select a drawing material, and a process is executed to select the drawing material. The drawing material is a virtual material used in a drawing displayed on the display unit of the user terminal, and includes, for example, types of drawing material such as oil paint, watercolor paint (transparent watercolor paint or opaque watercolor paint), acrylic paint, India ink, ink, crayon or pencil (note that drawing materials such as crayons or pencils can be used alone without the need for a drawing tool, which will be described later, and therefore do not require the selection of a drawing tool). These types of drawing material are selected on the material selection screen.

[0015] The material selection screen may allow the user to select the color, transparency, viscosity, drying speed, etc. of the material to be drawn on. The material selection screen may allow the user to select the amount of material to be used for drawing (for example, the amount to be squeezed onto a palette, etc.). The material selection screen may allow the user to select one or more materials to be drawn on. The selected materials may be saved in a storage location where materials to be drawn on are temporarily saved. The storage location is a virtual storage location displayed on the display unit of the user terminal. For example, if the material to be drawn on is oil paint, the storage location is a palette. Alternatively, if the material to be drawn on is India ink, the storage location may be an inkstone, etc. By saving the material to be drawn on a storage location, the user can experience preparing for a drawing that is similar to an actual drawing.

[0016] In the drawing tool selection process, a tool selection screen is provided for the user to select a drawing tool, and a process is executed to select the drawing tool. A drawing tool is a tool for drawing a drawing material on the display unit of the user terminal, such as a paintbrush, brush, spray, or fountain pen. The type of drawing tool is selected on the tool selection screen.

[0017] The means selection screen may allow the user to select the thickness of the drawing means. For example, if a thick drawing means is selected on the means selection screen, the thickness of the drawn line can be increased. The means selection screen may also allow the user to select the amount of drawing material held in the drawing means, or the amount of drawing material consumed by drawing from the drawing means. For example, if a drawing means that holds a large amount of drawing material is selected on the means selection screen, the length of the drawing material that can be drawn can be increased. Furthermore, if a drawing means that consumes a large amount of drawing material is selected on the means selection screen, the apparent thickness of the drawing material expressed by drawing can be increased.

[0018] In the drawing surface selection process, a drawing surface selection screen is provided for the user to select a drawing surface, and a process for selecting a drawing surface is executed. A drawing surface is a drawing target for drawing a drawing material on the display unit of a user terminal, and is a flat or three-dimensional surface. The drawing surface may be, for example, canvas, Western paper, Japanese paper, or cloth. The drawing surface may also be wood, brick, concrete, or other materials.

[0019] The image of the drawing may be changed depending on the combination of each drawing surface with the drawing material. For example, if canvas is selected on the drawing surface selection screen and oil paint is selected on the drawing material selection screen, the drawing may be given the image of an oil painting. Giving the image of an oil painting means, for example, processing to express the texture of the canvas and the gloss or three-dimensionality of the oil paint. Furthermore, if Japanese paper and India ink are selected, the drawing may be given the image of a calligraphy work or an ink painting. Giving the image of a calligraphy work or an ink painting means, for example, processing to express the texture of the Japanese paper and the shades of the India ink spread on the Japanese paper. The drawing surface selection screen may also allow the user to select the texture or roughness of the drawing surface. For example, for canvas, the user may be able to select coarse, medium, or fine grain, or whether or not a primer is applied. For Western paper, the user may be able to select whether or not gloss is applied. For Japanese paper, the user may be able to select the thickness or density of the Japanese paper fibers. The drawing surface selection screen may also allow the user to select the penetration or bleeding ability of the drawing material into the drawing surface. For example, in the case of Japanese paper, it may be possible to select the ink penetration power or bleeding tendency.

[0020] After the process of step S1 is executed, the process of step S2 is executed. In the drawing process of step S2, the user draws on the display of the user terminal using the drawing materials selected in the drawing material selection process of step S1. The drawing process of step S2 includes a palette / inkstone display process, a drawing display process, and a drawing erasure process.

[0021] The palette / inkstone display process is a palette display process or inkstone display process that displays on the display unit of the user terminal how the drawing material selected in the drawing material selection process is saved in the palette or inkstone storage location.

[0022] For example, when the material to be drawn is oil paint or the like, a palette display process is executed. In the palette display process, an amount of oil paint or the like of a color selected by the user is squeezed out and displayed on a predetermined position on the palette, specified by the user. In the palette display process, a display process may be performed in which the oil paint or the like squeezed out on the palette is diluted with virtual water or solvent. In addition, in the palette display process, a display process may be performed in which the oil paint or the like of a different color is mixed on the palette.

[0023] Furthermore, if the material to be drawn is India ink, an inkstone display process is executed. In the inkstone display process, a display is performed in which the ink selected by the user is poured into the inkstone in an amount specified by the user. The ink selected by the user may also contain water that does not contain ink. In the inkstone display process, a display may be performed in which the ink is ground with the ink poured into the inkstone. For example, in the inkstone display process, a display may be performed in which the strength of the ink changes depending on the type of ink selected by the user or the number of times the ink is ground.

[0024] The drawing display process is a process for displaying a drawing made by a user on the display unit of a user terminal using the drawing material selected in the drawing material selection process. In the drawing display process, a user terminal whose display unit has the functionality of an input device such as a touch panel can be used. Furthermore, in the drawing display process, if the display unit of the user terminal does not have the functionality of an input device, an external input device such as a mouse or pointing device may be used. In the example described below, a case where the display unit has the functionality of an input device such as a touch panel is exemplified. On a touch panel, drawing can be performed using the selected drawing tool by operating a touch pen or the user's finger on the touch panel.

[0025] The drawing display process may include a first process of attaching a drawing means such as a paintbrush to a storage location for the drawing material such as a palette, and incorporating the drawing material into the drawing means, and a second process of operating the drawing means incorporating the drawing material on the drawing surface to perform drawing.

[0026] In the first process, the amount of material to be impregnated with the drawing material may be changed depending on the length of time the drawing means is in contact with the material stored in the storage location. For example, if the material is India ink, the amount of India ink impregnated in the drawing brush may be increased by increasing the time the drawing brush is dipped in the ink of the inkstone. Also, in the first process, the drawing means may be used to mix multiple materials to be drawn stored in the storage location.

[0027] In the second process, a drawing tool containing the drawing material is operated on the drawing surface, thereby displaying the drawing on the drawing surface on the display unit. In the second process, the amount of the drawing material on the drawing surface can be changed by the amount of the drawing material contained in the drawing tool or the writing pressure of the drawing tool. The amount of the drawing material contained in the drawing tool may be reduced depending on the distance or time the drawing tool moves on the drawing surface. For example, when a line segment is drawn on the drawing surface using a drawing tool containing the drawing material in the first process, a large amount of the drawing material is drawn on the drawing surface because the drawing tool contains a large amount of the drawing material at the starting point of the line segment. In the second process, when a large amount of the drawing material is drawn on the drawing surface, the color of the drawing material becomes darker, the thickness of the drawn line segment becomes thicker, or the thickness of the drawn line segment (the height of the drawing material represented on the two-dimensional drawing surface) is displayed as being larger. In this embodiment, the drawing is displayed two-dimensionally on the display unit of the information processing device, so the thickness of the drawing material on the drawing surface is represented by shading or the like added to the drawing material, as described below. The writing pressure of the drawing tool can be detected by the contact area of ​​the touch panel with the touch pen, etc. When the writing pressure of the drawing tool is high, the amount of the drawing material on the drawing surface can be increased.

[0028] On the other hand, the amount of material to be drawn contained in the drawing means is reduced depending on the distance the drawing means moves on the drawing surface or the distance traveled, so that the amount of material to be drawn contained in the drawing means is reduced at the end point of the line. When the amount of material to be drawn is reduced in the second process, the color of the material to be drawn becomes lighter, the thickness of the drawn line becomes thinner, the line becomes blurred, or the drawn line appears lower in height. By changing the display of the drawing on the drawing surface depending on the amount of material to be drawn contained in the drawing means, it is possible to give the user a simulated experience of drawing using actual art supplies.

[0029] In the drawing erasure process, a process for erasing the drawing displayed in the drawing display process is performed. The drawing erasure process may include, for example, a process for returning the drawing performed in the drawing display process to the state before the drawing, a process for erasing the drawing of the movement trajectory of the pointer of a predetermined size, or a process for erasing only the drawing of a predetermined drawing material.

[0030] After the process of step S2 is executed, the process of step S3 is executed. In the process of expressing changes over time in step S3, a process is executed to express changes over time in the material drawn on the drawing surface in the drawing process of step S2. The changes over time expressed in the process of expressing changes over time in step S3 include drying, dripping, bleeding, mixing, and solidification.

[0031] A drying effect is an effect in which the material being drawn on dries over time. The drying effect can be expressed, for example, by the gloss of the material being drawn on disappearing over time. The gloss of the material being drawn on can be expressed by light reflected on the surface of the material being drawn on. The speed at which the material being drawn on dries may be changed depending on, for example, the type of material being drawn on, the type of surface being drawn on, or the amount of material being drawn on the surface being drawn on. The speed at which the material being drawn on dries may also be changed based on the measurement results of an environmental sensor that measures the environment near the user terminal. Details of the environmental sensor that measures the environment near the user terminal will be described later.

[0032] The sagging representation is a representation of the material being drawn dripping over time due to the influence of gravity. The sagging representation is represented, for example, by the shape of the material being drawn changing over time. Here, the sagging of the material being drawn will be explained using FIG. 2. FIG. 2 shows (A) an example of the sagging of the material being drawn using an information processing device in an embodiment, and (B) an example of the representation of the sagging of the material being drawn. FIG. 2(A) is a virtual diagram that represents a planar drawing in three dimensions to explain the shape of the material being drawn displayed on the display unit of the information processing device 1.

[0033] In Figures 2(A) and 2(B), the left diagram shows the state of the drawing material immediately after drawing, and the right diagram shows the state of the drawing material as it changes over time. Figure 2(A) shows that the display unit of the information processing device 1 is tilted at an angle θ from the horizontal state. In this example, the display unit of the information processing device 1 is provided on the upper side of the information processing device 1 in the figure and is flat. In addition, the information processing device 1 in this example is shown as a user terminal having the above-mentioned touch panel. Because the information processing device 1 and the display unit are integrated, in the following description, the display unit of the information processing device 1 may be abbreviated as information processing device 1.

[0034] In the left diagram of FIG. 2(A), the drawing target material p01 has a shape that is even on both sides relative to the information processing device 1 immediately after drawing. The left diagram of FIG. 2(B) is a diagram that expresses the drawing target material p01 in the state shown in the left diagram of FIG. 2(A). In the left diagram of FIG. 2(B), contour lines t01 are added to the drawing target material p01. By adding the contour lines t01 evenly on both sides, it is expressed that the shape of the drawing target material p01 is even on both sides. Note that, in order to express the shape of the drawing target material p01, shading may be added to the drawing target material p01 instead of the contour lines t01. A shading is the shape of a shadow when the drawing target material p01 is illuminated with a virtual light source.

[0035] Immediately after drawing, the drawing target material p01 is subjected to a force parallel to the information processing device 1 due to gravity. If gravity is g, the force parallel to the information processing device 1 is expressed as g·sinθ. That is, when the information processing device 1 is horizontal, θ=0, and the force parallel to the information processing device 1 is 0 (g·sinθ=0). As the inclination of the information processing device 1 increases, the force parallel to the information processing device 1 also increases, and when the information processing device 1 becomes vertical (θ=π / 2), the force parallel to the information processing device 1 becomes the same as gravity (g·sinθ=g). The angle θ can be measured by an inclination sensor, which will be described later. Note that the angle θ may be set to any angle rather than being the result of measurement by an inclination sensor.

[0036] In the right diagram of Figure 2(A), the drawing target p01a shows its shape after a predetermined time has passed since drawing. The right diagram of Figure 2(B) is a diagram that expresses the drawing target p01a in the state shown in the right diagram of Figure 2(A). In the right diagram of Figure 2(B), a contour line t01a has been added to the drawing target p01. By adding the contour line t01a unevenly on the left and right, it is expressed that the shape of the drawing target p01a is hanging to the left.

[0037] In the dripping representation, the dripping speed of the drawing material p01a can be made proportional to the force (g·sinθ) parallel to the information processing device 1. In other words, the dripping speed may be made faster as the tilt of the information processing device 1 increases. The dripping speed may also be changed based on the measurement results of an environmental sensor (described below) that measures the environment near the user terminal. The dripping representation may be made to end after a predetermined time has elapsed. For example, the dripping representation may end when the drawing material has dried after a predetermined time has elapsed in the above-mentioned dried representation. The dripping representation of the drawing material dripping over time allows the user to have a simulated experience of drawing with real paints, etc.

[0038] Returning to FIG. 1, the bleeding effect is an effect in which the drawing material is absorbed into the drawing surface and diffuses over time. The bleeding effect is expressed, for example, by the shape of the drawing material on the drawing surface diffusing over time. Here, the bleeding of the drawing material will be explained using FIG. 3. FIG. 3 is a diagram illustrating an example of the bleeding effect of the drawing material using the information processing device of the embodiment.

[0039] In Figure 3, the left diagram shows the state of the drawing material immediately after drawing, and the right diagram shows the state of the drawing material as it changes over time. In the left diagram of Figure 3, the drawing material p02 immediately after drawing is drawn linearly on the information processing device 1. In the left diagram of Figure 3, the information processing device 1 displays the drawing material p02 and a smear p02a that appears when a predetermined time has passed since drawing. The smear p02a spreads out in a plane centered on the drawing material p02.

[0040] In the bleeding effect, the bleeding speed can be changed by selecting the drawing surface and the drawing material. For example, if Japanese paper is selected as the drawing surface, the bleeding speed can be increased. Furthermore, if oil paint is selected as the drawing material, the bleeding speed can be decreased. The bleeding speed may also be changed depending on the amount of drawing material applied to the drawing surface. For example, the bleeding speed may be increased at the start of the drawing and decreased at the end of the drawing. The bleeding speed may also be changed based on the measurement results of an environmental sensor (described below) that measures the environment near the user terminal. The bleeding effect may end after a predetermined time has elapsed. For example, the dripping effect may end when the drawing material has dried after a predetermined time has elapsed in the above-mentioned drying effect. The bleeding effect of the drawing material, which bleeds over time, allows users to have a simulated experience of drawing with real art supplies.

[0041] Returning to Figure 1, a blending effect is an effect in which multiple materials blend together over time on a drawing surface. The blending effect can be expressed, for example, by the color of the materials on the drawing surface changing over time. For example, if watercolors are selected as the materials and black watercolors are layered on top of white watercolors, the blending effect changes the color of the overlaid black material from black to gray over time. The blending effect may be terminated after a predetermined time has elapsed. For example, when a predetermined time has elapsed since the white watercolors were applied and the materials have dried in the above-mentioned drying effect, the blending effect may be terminated even if black watercolors are layered on top. The blending effect of the materials blending over time allows users to have a simulated experience of drawing with real art materials.

[0042] A solidification representation is a representation of a drawn material solidifying over time on a drawing surface. This solidification representation can be expressed, for example, by the hardness of the drawn material on the drawing surface changing over time. The hardness of the drawn material can be expressed by a change in the shape of the drawn material when it comes into contact with a drawing tool. For example, if oil paint is selected as the drawn material and a paintbrush comes into contact with the oil paint drawn on the drawing surface, the shape of the oil paint can be easily changed by the paintbrush immediately after drawing. On the other hand, the solidification of the oil paint can be expressed by making the shape of the oil paint less changeable by the paintbrush over time. The solidification rate of the drawn material may be varied depending on the type of material. Furthermore, the solidification rate may be varied based on the measurement results of an environmental sensor (described below) that measures the environment near the user terminal. By representing the solidification of the drawn material over time, users can have a simulated experience of drawing with real art supplies.

[0043] In FIG. 1, the process between step S1 and step S2, and the process between step S2 and step S3 are shown as examples where transitions between steps are possible. However, step S1 and step S3 may be made transitionable. The transition between each step may be made by an explicit instruction from the user, for example, by operating a button for transition. Furthermore, the transition between each step may be made automatically, for example, after a predetermined time has elapsed.

[0044] Next, the configuration of the information processing device 1 will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of the configuration of the information processing device 1 according to the embodiment.

[0045] 4, information processing device 1 is communicably connected to information storage DB2 via network 9. Information processing device 1 has the following functional units: material selection screen providing unit 11, means selection screen providing unit 12, drawing surface selection screen providing unit 13, drawing display unit 14, time-varying change representing unit 15, measurement result acquiring unit 16, and vibration device driving unit 17. Each of the above functional units of information processing device 1 in this embodiment will be described as a functional module realized by an information processing program (software) in this embodiment.

[0046] The material selection screen providing unit 11 provides a material selection screen for selecting the material to be drawn on. The material selection screen is displayed on the display unit of the information processing device 1. The means selection screen providing unit 12 provides a means selection screen for selecting a drawing means for drawing using the material to be drawn on. The means selection screen is displayed on the display unit of the information processing device 1. The drawing surface selection screen providing unit 13 provides a drawing surface selection screen for selecting a drawing surface on which the material to be drawn on is to be drawn. The drawing surface selection screen providing unit 13 is displayed on the display unit of the information processing device 1. The drawing display unit 14 displays a drawing of the material to be drawn on the drawing surface using the drawing means. The time-dependent change representation unit 15 represents the time-dependent change of the material to be drawn in the drawing displayed on the drawing display unit.

[0047] The measurement result acquisition unit 16 acquires the measurement results of an environmental sensor that measures the environment near the user terminal. The environmental sensor is a sensor that is connected to the information processing device 1 and measures the environment near the user terminal, and is, for example, an inclination sensor that measures the inclination of the display unit of the information processing device 1. The inclination sensor may be, for example, an acceleration sensor built into the user terminal. The environmental sensor may be a sensor that measures at least one of temperature, humidity, wind speed, and location information near the user terminal.

[0048] The time-dependent change representation unit 15 may represent the change over time of the material to be drawn based on the measurement results acquired by the measurement result acquisition unit 16. For example, the time-dependent change representation unit 15 may represent a drooping state based on the measurement results of a tilt sensor. The time-dependent change representation unit 15 may also represent a drying state, a drooping state, or a solidification state based on the measurement results of a temperature sensor that measures the temperature near the user terminal. The time-dependent change representation unit 15 may also represent a drying state, a drooping state, or a solidification state based on the measurement results of a temperature sensor that measures the temperature near the user terminal, a humidity sensor that measures humidity, a wind speed sensor that measures wind speed, or a location information sensor that measures location information. For example, when the temperature is high, the humidity is low, or the wind speed is high, the drying rate of the material to be drawn increases, the dripping rate decreases, or the solidification rate increases. The weather conditions at the current location can be retrieved using a location information sensor that measures location information. The time-dependent change representation unit 15 may represent the change over time of the material to be drawn based on the retrieved weather conditions.

[0049] The vibration device driver 17 drives the vibration device built into the display unit of the information processing device 1. The time-dependent change representation unit 15 represents, based on the change in vibration of the display unit of the information processing device 1 caused by the vibration device driver 17, the tactile change of the drawing material when the user touches the display unit as a time-dependent change. The dry or solidified state of the actual paint or the like can be sensed by the vibration received from the paint or the like when the user touches it with a paintbrush or finger. For example, when the user receives a smooth (slippery) vibration from the paint or the like, the user can sense that the paint or the like is wet or unsolidified. On the other hand, when the user receives a rough (chunky) vibration from the paint or the like, the user can sense that the paint or the like is dry or solidified. The time-dependent change representation unit 15 can represent the dry or solidified state of the drawing material by changing the vibration of the vibration device via the vibration device driver 17.

[0050] In addition, the time-dependent change expression unit 15 may express the texture of the drawing surface (smooth, rough, etc.) by changing the vibration of the vibration device when the user touches the drawing surface.

[0051] Furthermore, the change over time in time-change expression unit 15 may be expressed using data generated by AI (Artificial Intelligence). For example, the relationship between the change in vibration (vibration waveform) of the display unit and the resulting tactile sensation may differ depending on the user, and by accumulating the results of an investigation into what kind of vibration change results in what kind of tactile sensation as learning data, it becomes possible to generate an appropriate expression of the change over time.

[0052] The information storage DB2 stores information used in the information processing device 1 or information generated in the information processing device 1. For example, the information storage DB2 may store information on a drawing material, drawing means, or drawing surface selected in the information processing device 1. The information storage DB2 may also store information representing changes over time executed in the information processing device 1. The information storage DB2 may also store drawing data drawn by a user.

[0053] Note that the above-described functional units of the information processing device 1 are merely examples of the functional units of the information processing device 1, and do not limit the functions of the information processing device 1. For example, the information processing device 1 does not need to have all of the above-described functional units, and may have only some of the functional units. Furthermore, the information processing device 1 may have functions other than those described above.

[0054] As described above, the functional units of the information processing device 1 are implemented by software. However, at least one of the functional units may be implemented by hardware.

[0055] Furthermore, any of the above functional units may be implemented by dividing one functional unit into multiple functional units. Also, any two or more of the above functional units may be implemented by integrating them into one functional unit. Furthermore, the above description expresses the functions of the information processing device 1 using functional blocks, and does not indicate, for example, that each functional unit is configured by a separate program file or the like.

[0056] Furthermore, the information processing device 1 may be a device realized by a single housing, or may be a system realized by multiple devices connected via a network or the like. For example, the information processing device 1 may have some or all of its functions realized by a virtual device, such as a cloud service provided by a cloud computing system. That is, the information processing device 1 may have at least one or more of the above-mentioned functional units realized by another device. Furthermore, the information processing device 1 may be a general-purpose computer such as a desktop PC, or may be a dedicated device with limited functions.

[0057] Next, the hardware configuration of the information processing device 1 will be described with reference to Fig. 5. Fig. 5 is a block diagram showing an example of the hardware configuration of the information processing device in the embodiment.

[0058] The information processing device 1 has a CPU (Central Processing Unit) 101, a RAM (Random Access Memory) 102, a ROM (Read Only Memory) 103, an I / O device 104, and a communication I / F (Interface) 105. The information processing device 1 also has a tilt sensor 106, a temperature sensor 107, a humidity sensor 108, a wind speed sensor 109, a GPS (Global Positioning System) antenna 110, and a vibration device 111. These pieces of hardware included in the information processing device 1 may be built into the information processing device 1, or may be arranged outside the information processing device 11 and connected to the information processing device 1 so as to be able to communicate with it.

[0059] The CPU 101 controls the information processing device 1 by executing an information processing program stored in the RAM 102 or the ROM 103. The information processing program is obtained, for example, from a recording medium on which the program is recorded or a program distribution server via a network, and installed in the ROM 103, and is read out and executed by the CPU 101.

[0060] The I / O device 104 has an operation input function and a display function (operation display function). The I / O device 104 is, for example, a touch panel. The touch panel enables the user of the information processing device 1 to input operations using a fingertip, a touch pen, or the like. In this embodiment, the I / O device 104 is described as using a touch panel with an operation display function, but the I / O device 104 may also have a display device with a display function and an operation input device with an operation input function, separately. In this case, the display screen of the touch panel can be implemented as the display screen of the display device, and operation of the touch panel can be implemented as operation of the operation input device. The I / O device 104 may also be implemented in various forms, such as a head-mounted, eyeglass-type, or wristwatch-type display.

[0061] The communication I / F 105 is an I / F for communication. The communication I / F 105 executes short-distance wireless communication such as wireless LAN, wired LAN, infrared, etc. Although the figure shows only the communication I / F 105 as the communication I / F, the information processing device 1 may have communication I / Fs for each of a plurality of communication methods.

[0062] The tilt sensor 106 measures the tilt of the information processing device 1. The temperature sensor 107 measures the temperature near the information processing device 1. The humidity sensor 108 measures the humidity near the information processing device 1. The wind speed sensor 109 measures the wind speed near the information processing device 1. The GPS antenna 110 acquires position information from GPS satellites. Furthermore, the vibration device 111 vibrates the information processing device 1.

[0063] Next, the operation of the information processing device 1 will be described with reference to Fig. 6. Fig. 6 is a flowchart showing an example of the operation of the information processing device 1 in the embodiment. Note that, although the process in the flowchart described below is performed by the information processing device 1, each process is actually performed by each functional unit of the information processing device 1 described above.

[0064] In FIG. 6, the information processing device 1 provides an art material selection screen (step S11). As described above, the art material selection screen includes at least one of a drawing material selection screen, a drawing tool selection screen, and a drawing surface selection screen. After executing the processing of step S11, the information processing device 1 determines whether or not the selection of art materials has been completed (step S12). If it determines that the selection of art materials has not been completed (step S12: NO), the information processing device 1 repeats the processing of step S12 and waits until the selection of art materials has been completed.

[0065] On the other hand, if it is determined that the selection of the drawing material is complete (step S12: YES), the information processing device 1 provides a drawing surface for drawing (step S13). After executing the process of step S13, the information processing device 1 determines whether or not a drawing has been made on the drawing surface (step S14). If it determines that no drawing has been made (step S14: NO), the information processing device 1 repeats the process of step S14 and waits for a drawing to be made.

[0066] On the other hand, if it is determined that a drawing has been made (step S14: YES), the information processing device 1 expresses a change over time (step S15). After executing the process of step S15, the information processing device 1 determines whether or not to change the art material (step S16). If it is determined that the art material should be changed (step S16: YES), the information processing device 1 returns to the process of step S11 and enables the change of the art material.

[0067] On the other hand, if it is determined that the drawing material will not be changed (step S16: NO), the information processing device 1 determines whether or not to end the drawing (step S17). If it is determined that the drawing will not be ended (step S17: NO), the information processing device 1 returns to the processing of step S14 and continues drawing. On the other hand, if it is determined that the drawing will be ended (step S17: YES), the information processing device 1 ends the operation shown in the flowchart.

[0068] Note that the operations shown in the above flowcharts are merely examples of the operations of the information processing device 1, and do not limit the order of processing. For example, specific processing may be performed in an order or at a timing different from the processing order in the flowcharts.

[0069] The touch panel and touch pen used in the display unit of the information processing device 1 can be an AES (Active Electrostatic) compatible electrostatic touch panel and an AES compatible pen. Using an AES compatible electrostatic touch panel and an AES compatible pen allows for drawing with less delay. Also, by reducing the spatial distance between the surface glass of the touch panel and the LCD (Liquid Crystal Display), parallax can be reduced and a thin touch pen can be used. By reducing parallax and using a thin touch pen, visual effects can be reduced when drawing. Also, a combination of the touch panel pen tip and protective film that reduces friction can be used. Using a combination that reduces friction allows for a smooth frictional feel and reduces stress when drawing.

[0070] The above describes an embodiment of the present invention with reference to the drawings, but the specific configuration is not limited to this embodiment, and various modifications are also included within the scope that does not deviate from the spirit of the present invention. [Explanation of symbols]

[0071] 1. Information processing equipment 2 Information storage DB 9 Network 11 Material selection screen provider 12. Means selection screen provision section 13 Drawing surface selection screen provision section 14 Drawing display section 15 Time-dependent change expression section 16 Measurement result acquisition unit 17 Vibration device drive unit 101 CPU 102 RAM 103 ROM 104 Touch Panel 105 Communication I / F 106 Inclination Sensor 107 Temperature Sensor 108 Humidity Sensor 109 Wind Speed ​​Sensor 110 GPS antenna 111 Vibration device

Claims

1. An information processing device that allows a user to experience drawing on a display unit of a user terminal used by the user, a material selection screen providing unit that provides a material selection screen for allowing the user to select a material to be drawn; a means selection screen providing unit that provides a means selection screen for allowing the user to select a drawing means for drawing using the drawing material; a drawing surface selection screen providing unit that provides a drawing surface selection screen for allowing the user to select a drawing surface on which to draw the material; a drawing display unit that displays a drawing of the material to be drawn on the drawing surface using the drawing means; a time-varying change representation unit that represents a time-varying change of the drawing material in the drawing displayed on the drawing display unit; An information processing device comprising:

2. The information processing apparatus according to claim 1 , wherein the time-dependent change representation unit represents the drying state of the drawing material as the time-dependent change.

3. The information processing apparatus according to claim 1 , wherein the time-dependent change representation unit represents sagging of the drawing material as the time-dependent change.

4. The information processing apparatus according to claim 1 , wherein the time-dependent change representation unit represents bleeding of the drawing material onto the drawing surface as the time-dependent change.

5. The information processing device according to claim 1 , wherein the time-dependent change representation unit represents the time-dependent change based on a measurement result of an environmental sensor that measures an environment near the user terminal.

6. The information processing device according to claim 5 , wherein the time-dependent change representation unit represents the time-dependent change based on a measurement result obtained by using, as the environmental sensor, an inclination sensor that measures an inclination of the display unit.

7. The information processing device described in claim 5, wherein the time-dependent change representation unit represents the time-dependent change based on measurement results using a sensor that measures at least one of temperature, humidity, wind speed, or location information near the user terminal as the environmental sensor.

8. The information processing apparatus according to claim 1 , wherein the time-dependent change representation unit represents a mixture of the plurality of materials to be drawn as the time-dependent change.

9. The display device further includes a vibration device driving unit for driving a vibration device that vibrates the display unit, 3. The information processing device according to claim 1, wherein the time-dependent change representation unit represents a tactile change in the drawing material when a user touches the display unit as the time-dependent change based on a change in vibration of the display unit caused by the vibration device drive unit.

10. An information processing method for allowing a user to experience drawing on a display unit of a user terminal used by the user, comprising: a material selection screen providing step of providing a material selection screen for allowing the user to select a material to be drawn; a means selection screen providing step of providing a means selection screen for allowing the user to select a drawing means for drawing using the drawing material; a drawing surface selection screen providing step of providing a drawing surface selection screen for allowing the user to select a drawing surface on which the drawing material is to be drawn; a drawing display step of displaying a drawing of the material to be drawn on the drawing surface using the drawing means; a time-dependent change representation step of representing a time-dependent change of the material to be drawn in the drawing displayed in the drawing display step; An information processing method, including:

11. An information processing program that allows a user to experience drawing on a display unit of a user terminal used by the user, a material selection screen providing process for providing a material selection screen for selecting a material to be drawn; a means selection screen providing process for providing a means selection screen for allowing the user to select a drawing means for drawing using the drawing material; a drawing surface selection screen providing process for providing a drawing surface selection screen for allowing the user to select a drawing surface on which the drawing material is to be drawn; a drawing display process for displaying a drawing of the material to be drawn on the drawing surface using the drawing means; a time-dependent change representation process for representing a time-dependent change in the material to be drawn in the drawing displayed in the drawing display process; An information processing program that enables a computer to achieve the above.

Images