Image processing device, control method for tactile perception, program and storage medium

Abstract

Image processing device comprising: a tactile perception generating device configured to generate a stimulus that can be noticed by a user touching a section of an input device, the input device being provided to a display device for displaying a drawing object; and a control device configured to control the tactile perception generation device such that the stimulus is generated when a touch input is made at a position corresponding to the drawing object and editing processing is performed on the drawing object, wherein The editing process is a process for deleting the drawing object at the position where the touch input is performed; and The control device is configured to delete the drawing object and to control the tactile perception generation device so that the stimulus is generated.

Description

BACKGROUND OF THE INVENTION Area of ​​the invention

[0001] The present invention relates to an image processing device, a control method for tactile perception, a program and a storage medium. Description of the state of the art

[0002] In recent years, the number of devices featuring a touch panel has increased. Due to the feature that allows the user to freely position the touch panel on the screen, many of these devices include an editing function for existing images as well as a drawing function. As disclosed in Japanese patent application JP 2012-124612 A, the drawing function is a feature for creating and drawing images. Within the drawing function, the user can select a line type and color and draw a line freely, or they can erase the drawn line by selecting an eraser icon or similar tool.

[0003] However, if an editing operation (delete, draw lines, color, or similar) is performed on a drawing object via touch input on an input screen provided on a display screen, and this operation is performed on the drawing object created on the display screen using a drawing function or similar tool, the problem arises that it is difficult to confirm whether the editing operation has actually been carried out on the section touched by a finger, stylus, or similar device. In the case of deleting the drawing object on the display screen as an editing operation, the touched section is obscured by the finger, and the problem arises that it is difficult for the user to confirm whether the drawing object they intend to delete has actually been deleted.

[0004] US Patent 2012 / 0327006 A1 discloses an image capture device that can be combined with a touch display to generate a tactile map of an environment, wherein the touch display generates an electrical signal corresponding to tactile perception. A user can determine the relative spatial arrangement of objects in the environment and the like based on this tactile perception. US Patent 2013 / 0154987 A1 discloses a device wherein a selection operation with respect to a string of characters displayed on a display device is performed by touching a touch panel, the type of character at a touch position is determined, and tactile perception is generated based on information added by each character. REVELATION OF THE INVENTION

[0005] One aspect of the invention is to solve all or at least one of the preceding problems. The object of the present invention is, in particular, to provide a mechanism such that, in the case of deleting a drawing object as an editing process, the user can confirm whether the drawing object that the user intends to delete has actually been deleted. This object is achieved by the features of claim 1 and by the features of the dependent claims.

[0006] According to one aspect of the invention, an image processing device as specified in claims 1 to 8 is provided.

[0007] According to another aspect of the invention, a control method for tactile perception as specified in claim 9 is provided.

[0008] According to another aspect of the invention, a program as specified in claim 10 and a storage medium as specified in claim 11 are provided.

[0009] Further features of the present invention will become clear from the following description of embodiments with reference to the accompanying drawings.

[0010] Each embodiment of the present invention described below can be implemented individually or as a combination of several of the embodiments or features thereof, where necessary or where the combination of elements or features of individual embodiments in a single embodiment is advantageous. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The accompanying drawings, which are included in the specification and form part of it, illustrate embodiments, features and aspects of the invention and, together with the description, serve to explain the basics of the invention. Fig. Figure 1 is a diagram illustrating an electronic device. Fig. Figure 2 is a diagram to describe a multiplication function. Fig. Figure 3 is a flowchart illustrating a control processing for tactile perception according to the first embodiment. Fig. Figure 4 is a flowchart illustrating a control processing for tactile perception according to the second embodiment. Fig. Figure 5 is a diagram illustrating an example of a correspondence table. Fig. Figure 6 is a diagram illustrating an example of a correspondence table according to a modification. Fig. Figure 7 is a flowchart illustrating a control processing for tactile perception according to the third embodiment. DESCRIPTION OF THE EXECUTION FORMS

[0012] Various embodiments, features and aspects of the invention are described in detail below with reference to the drawings. (First embodiment)

[0013] Fig. Figure 1 is a diagram illustrating an electronic device 100 serving as an image processing device according to the first embodiment. The electronic device 100 can be a mobile phone, smartphone, tablet terminal, or the like. As shown in Figure 1, the electronic device 100 can be a mobile phone, smartphone, tablet terminal, or the like. Fig. As illustrated in Figure 1, a CPU 101, a memory 102, a non-volatile memory 103, an image processing unit 104, a display 105, an operator unit 106, a labeling medium I / F (interface) 107, an external I / F 109, and a communication I / F 110 are connected to an internal bus 150. An imaging unit 112, a tactile perception generator 122, and a vibration generator 123 are also connected to the internal bus 150. Each unit connected to the internal bus 150 can transmit and receive data bidirectionally over the internal bus 150.

[0014] Memory 102, for example, contains RAM (volatile memory or the like, which uses a semiconductor device). The CPU 101 controls each function of the electronic device 100 by using memory 102 as working memory according to a program stored, for example, in non-volatile memory 103. Image data, audio data, other data, various types of programs with which the CPU 101 operates, and the like are stored in non-volatile memory 103. Non-volatile memory 103 contains, for example, a hard disk (HD), ROM, or the like.

[0015] The image processing unit 104 performs various types of image processing on the image data based on control from the CPU 101. The image data subjected to image processing includes image data stored in the non-volatile memory 103 or a markup medium 108, a video signal received via the external I / F 109, image data received via the communication I / F 110, image data captured by the imaging unit 112, and the like.

[0016] Image processing operations performed by the image processing unit 104 include analog-to-digital conversion (ADC), digital-to-analog conversion (DAC), image data encoding, compression, decoding, resizing, noise reduction, color conversion, and similar operations. The image processing unit 104 is, for example, a dedicated circuit block for performing specific image processing. Alternatively, the CPU 101 can perform image processing according to a program, depending on the image processing type. According to the embodiment, the CPU 101 performs blur filter processing.

[0017] The display 105, as a display device, shows a GUI screen or the like, which forms an image or a GUI (Graphical User Interface), based on the control of the CPU 101. The CPU 101 controls each component of the electronic device 100 in such a way that a display control signal is generated according to a program, that a video signal to be displayed on the display 105 is generated, and that these signals are output to the display 105. The display 105 displays a video image based on the video signal.

[0018] As another example, it is also possible to configure the electronic device 100 in such a way that it does not have a display 105 but rather an interface for outputting the video signal to be displayed on the display 105. In such a case, the electronic device 100 displays an image or the like on an externally mounted monitor (television or the like).

[0019] The operating device 106, as an input device, is a character information input device such as a keyboard or the like, or an input device for receiving user input such as a pointing device like a mouse, touch panel 120, button, dial, joystick, touch-sensitive sensor, touchpad, or the like. The touch panel 120, as an input device, overlays the display 105 in such a way as to form a flat shape and is an input device for outputting coordinate information corresponding to a touched position. The touch panel 120 is an example of the input display screen.

[0020] The markup medium 108, such as a memory card, CD, DVD, or similar, can be loaded into the markup medium I / F 107. The markup medium I / F 107 reads data from the loaded markup medium 108 and writes data to the loaded markup medium 108 based on the control of the CPU 101.

[0021] The external I / F 109 is an interface that connects to an external device via a wired or wireless cable and is used to input and output video and audio signals. The communication I / F 110 is an interface for transmitting and receiving various types of data, such as files, commands, and the like, by communicating (including telephone communication) with the external device, Internet 111, or similar.

[0022] The imaging device 112 is a camera device comprising an imaging element such as a CCD sensor, CMOS sensor, or the like, a zoom lens, a focusing lens, a shutter, an iris diaphragm, a distance measuring device, an A / D converter, and the like. The imaging device 112 can capture a still image and a moving image. Image data from the image captured by the imaging device 112 is transferred to the image processing device 104, subjected to various processing operations in the image processing device 104, and recorded as a still image file or a moving image file in the recording medium 108.

[0023] The CPU 101 receives the coordinate information of the touch position, output by the touch panel 120, via an internal bus 150. Based on this coordinate information, the CPU 101 detects the following operations or states.

[0024] An operation to touch the Touch-Panel 120 with a finger or stylus-like pen (hereinafter referred to as "Touch-Down")

[0025] A state where a finger or stylus-like pen touches the Touch-Panel 120 (hereinafter referred to as "Touch-On")

[0026] An operation to move a finger or stylus-like pen while remaining in contact with the Touch Panel 120 (hereinafter referred to as "Move")

[0027] An operation to remove a finger or stylus touching the Touch Panel 120 (hereafter referred to as "PICK-UP")

[0028] A state where nothing is in contact with the Touch-Panel 120 (hereinafter referred to as “TOUCHLESS” (English: “Touch-Off”)).

[0029] When MOVEMENT is detected, the CPU 101 further distinguishes a direction of movement from the finger or stylus based on a change in the coordinates of the touch position. More precisely, the CPU 101 distinguishes a vertical component and a horizontal component in the direction of movement on the Touch Panel 120.

[0030] The CPU 101 also detects any operation consisting of a stroke, flick, drag, and the like. If lift from place via move, the CPU 101 detects the stroke. If move is detected over a predetermined distance or longer and at a predetermined speed or greater, and then lift is detected, the CPU 101 detects the swipe. If move is detected over a predetermined distance or longer and at a speed less than the predetermined speed, the CPU 101 detects the drag. A swipe is an operation where the finger is quickly moved over a distance of a certain extent while remaining in contact with the Touch Panel 120, and the finger is then removed from the Touch Panel 120 as is. That is, SWIPING is an operation where the finger quickly rubs the 120 touch panel.

[0031] The Touch-Panel 120 can use any of different types of touch panel, such as a type with resistance film, a type with electrical capacitance, a type with surface sound, a type with infrared beam, a type with electromagnetic induction, a type with image recognition, a type with photosensor, and the like.

[0032] A load detection device 121 is integrated with the touch panel 120 by means of adhesion or the like. The load detection device 121 is a strain gauge sensor. By utilizing the phenomenon that the touch panel 120 is bent (stretched) by a small amount according to the pressure force of the touch operation, the load detection device 121 detects a load (pressure force) applied to the touch panel 120. As another example, the load detection device 121 can be integrated with the display 105. In this case, the load detection device 121 detects a load applied to the touch panel 120 via the display 105.

[0033] The tactile perception generator 122 generates a tactile sensation that is applied to an operating device such as a finger, a stylus, or the like to operate the touch panel 120. That is, the tactile perception generator 122 creates a stimulus across the touch area that can be perceived by the user currently touching it. The tactile perception generator 122 is integrated with the touch panel 120 by adhesion or the like. The tactile perception generator 122 is a piezoelectric element, more precisely a piezoelectric vibrator, and vibrates at any desired amplitude and frequency under the control of the CPU 101, which acts as the control unit for the tactile perception generator 122.Therefore, the touch panel 120 is curved and vibrates, and this vibration from the touch panel 120 is transmitted to the control device as tactile feedback. That is, the tactile feedback generator 122 vibrates itself; it transmits the tactile feedback to the control device via the touch panel 120.

[0034] As another example, the tactile perception generation device 122 can be integrated with the display 105. In this case, the tactile perception generation device 122 causes the touch panel 120 to curve and vibrate via the display 105.

[0035] The CPU 101 can generate tactile perceptions with different patterns by changing the amplitude and frequency of the tactile perception generating device 122 and by vibrating the tactile perception generating device 122 with the different patterns.

[0036] The CPU 101 can control tactile perception based on the touch position detected on the touch panel 120 and the pressure force detected by the load detection device 121. For example, it is assumed that, corresponding to the touch operation of the control device, the CPU 101 detects the touch position according to a button symbol displayed on the display 105, and the load detection device 121 detects the pressure force with a predetermined value or more. In this case, the CPU 101 generates vibrations before and after a certain period of time. Therefore, the user can perceive a tactile sensation such as a click, as if a mechanical button had been pressed.

[0037] Furthermore, it is assumed that the CPU 101 only executes the function of a button symbol when a pressure force of the predetermined value or higher is detected in a state where a touch has been detected at a position of the button symbol. That is, if a weak pressure force is detected, such as when the button symbol is merely touched, the CPU 101 does not execute the function of the button symbol. Thus, the user can operate it with a sensation similar to that of pressing a mechanical button.

[0038] The load detection device 121 is not limited to the strain gauge sensor. As another example, the load detection device 121 can incorporate a piezoelectric element. In this case, the load detection device 121 detects a load based on a voltage output by the piezoelectric element according to the pressure force. Furthermore, the piezoelectric element, as the load detection device 121, can in this case be combined with a pressure element as the generation device for tactile perception 122.

[0039] The tactile perception generating device 122 is not limited to a device that generates vibration through the pressure element. As another example, the tactile perception generating device 122 can generate an electrical tactile perception. For example, the tactile perception generating device 122 has a plate with a conductive layer and a plate made of insulating material. In a manner similar to the touch panel 120, the plate with the conductive layer and the plate made of insulating material are mounted over the display 105 to form a flat shape. When the user touches the plate made of insulating material, positive charges are charged into the plate made of insulating material. That is, the tactile perception generating device 122 can generate a tactile perception as an electrical stimulus by charging the plate made of insulating material with positive charges.The tactile perception generating device 122 can convey a feeling (tactile perception) that the user's skin is being pulled by a Coulomb force.

[0040] As another example, the tactile perception generating device 122 can have a plate with a conductive layer such that for each position on the plate, it can be selected whether the positive charges are charged or not. The CPU 101 controls a charging position of the positive charges. Therefore, the tactile perception generating device 122 can convey different tactile perceptions to the user, such as a "rough feeling," a "gravelly feeling," a "powdery feeling," and the like.

[0041] The vibration generating device 123, which can also be referred to together with the tactile perception generating device 122 as the tactile perception generating device, generates a tactile perception by vibrating the entire electronic device 100. The vibration generating device 123 has, for example, an eccentric motor or the like and implements a well-known vibration function or the like. Therefore, the electronic device 100 can, through the vibration generated by the vibration generating device 123, convey tactile perception to a hand or the like of the user who grasps the electronic device 100.

[0042] When a delete (edit) instruction is entered on the drawing object displayed on the screen 105 via touch operation on the touch panel 120, the electronic device 100, according to the embodiment, performs tactile control processing to transmit the tactile perception to a finger or the like from the user who performed the touch input. The drawing and deletion (edit) of the drawing object is realized by the drawing function, and an object drawn by the drawing function is called a drawing object. The drawing object is an object that displays an image, symbol, or the like. The drawing function is described below. The drawing function is a function for receiving a selection of a pen type and color from the user and for drawing an image.

[0043] Fig. Figure 2 is a diagram illustrating an example of a drawing screen displayed on display 105 when the drawing function is executed. Fig. 2. A pencil symbol 201, a crayon symbol 202, a paintbrush symbol 203, an eraser symbol 204, and a canvas 209 are displayed on the screen 105. The user can select a pen type by touching one of the desired symbols 201 to 203. It is assumed that the pen types set are a pencil, a crayon, a paintbrush, and so on. The type of line drawn differs depending on the pen type. That is, the pen type is an example of a line type.

[0044] When the user touches the canvas 209 in a state where the pen type has been selected, the CPU 101 draws (editing) a line with the selected pen type to a position on the display 105 that corresponds to the touch position where the touch input was made. If the user touches the canvas 209 after touching the eraser icon, the CPU 101 erases (editing) the line (drawing object) that is drawn at the position on the display 105 that corresponds to the touch position on the touch panel 120. The drawing object drawn at the position on the display that corresponds to the touch position is simply called a drawing object drawn at the touch position.

[0045] Palettes 205 to 208, used to select colors, and a blur filter icon 210 are displayed on the screen 105. When the user touches the palette of the color they wish to draw, the CPU 101 changes the color at the moment a line is drawn to the color of the selected palette. If the user touches the canvas 209 after touching the blur filter icon, the CPU 101 performs filtering processing to blur the line drawn at the touched position.

[0046] The CPU 101 stores handwritten data in memory 102, representing the drawing object created by the painting function. This handwritten data contains information about the pen type and color for each pixel forming the canvas 209. The color information is expressed as a combination of three colors, R, G, and B, and the color intensity is indicated by a range from 0 to 255 for each color.

[0047] It is now assumed that the upper left corner of canvas 209 is set as the origin, a vertical direction is set as the X-axis, and a horizontal direction is set as the Y-axis. By setting a coordinate on the X-axis and a coordinate (pixel) on the Y-axis, CPU 101 can retrieve any handwritten data on canvas 209. If no handwritten data exists at the set coordinate position, the information about the pen type and color at the set coordinate position is not stored in memory 102. If handwritten data exists at the set coordinate position, the information about the pen type and color at the set coordinate position is stored in memory 102.

[0048] When the eraser icon is selected and the erase function is used, the CPU 101 deletes (edit processing) the line (drawing object) drawn at the coordinates of the touch position. More precisely, the CPU 101 sets (edit processing) a pixel value of the color defined as the background color for the pixel at the touch position, instead of a pixel value of the drawing object, thus deleting the drawing object.

[0049] Fig. Figure 3 is a flowchart illustrating the control processing for tactile perception by the electronic device 100 in the embodiment. The control processing for tactile perception is executed when the eraser symbol 204 is selected in the drawing function. The control processing for tactile perception is executed repeatedly over a period of time during which the state in which the eraser symbol 204 is selected is maintained. The control processing for tactile perception is terminated when the eraser symbol 204 is deselected. The control processing for tactile perception is implemented by a method whereby the CPU 101 reads and executes a program stored in memory 102 or non-volatile memory 103.

[0050] In S301, CPU 101 distinguishes whether or not a touch input has been performed on the touch panel 120. If a touch input is detected (YES in S301), CPU 101 proceeds to S302. If a touch input is not detected (NO in S301), CPU 101 terminates the control processing for tactile perception.

[0051] In S302, the CPU 101 defines coordinate information (hereinafter referred to as touch coordinates) of the touch position on the panel. Subsequently, in S303, the CPU 101 distinguishes whether a drawing object exists at the position on the display 105 that corresponds to the touch coordinates defined in S302.

[0052] If a drawing object exists (YES in S303), CPU 101 advances processing to S304. If no drawing object exists (NO in S303), CPU 101 advances processing to S307.

[0053] In S304, CPU 101 erases the drawing object drawn at the touch position (erase operation). Subsequently, in S305, CPU 101, which also acts as a tactile perception intensity setting device, adds "1" to a tactile perception intensity value to increase the intensity of the tactile perception conveyed to the user. Tactile perception intensity is information indicating the intensity of a stimulus (tactile perception) generated by the tactile perception generating device 122 that can be perceived by the user. It is assumed that the tactile perception intensity is stored in memory 102. The greater the tactile perception intensity, the greater the stimulus (tactile perception) conveyed to the user.Based on the intensity of tactile perception stored in memory 102, the CPU 101 controls at least the amplitude and / or the frequency of the piezoelectric element as the tactile perception generation device 122. Therefore, the tactile perception generation device 122 can generate the stimulus (tactile perception) with varying tactile perception intensity.

[0054] Subsequently, in S306, the CPU 101 controls the tactile perception generator 122 to transmit the tactile perception with the intensity set in memory 102 (control processing). Under the control of the CPU 101, the tactile perception generator 122 generates the vibration at the touch position according to the intensity set in memory 102. That is, the tactile perception generator 122 transmits the stimulus (tactile perception) to the finger or similar, which serves as the input device via the touch panel 120 (tactile perception generation processing). As a further example, the CPU 101 can execute the processing of S304 after the processing of S305 and S306 is complete.

[0055] In S307, CPU 101 resets the tactile perception intensity to an initial value of "0". This modifies the tactile perception intensity to minimize the tactile sensation conveyed to the user. In S308, CPU 101 determines whether or not a lift has been performed on touch panel 120. If a lift is detected (YES in S308), CPU 101 proceeds to S310. If a lift is not detected (NO in S308), CPU 101 proceeds to S309. The case where a lift is not detected indicates that the touch state continues.

[0056] In S309, CPU 101 determines whether or not a MOVING action has been performed on the touch panel 120. If MOVING is detected (YES in S309), CPU 101 advances processing to S302. That is, CPU 101 continues the control processing for tactile perception. If MOVING is not detected (NO in S309), CPU 101 advances processing to S308. That is, CPU 101 waits until LIFTING or MOVING is detected. In S310, CPU 101 resets the tactile perception intensity value to the initial value "0". The processing in S310 is a reset operation to the initial setting regarding the removal of the user's finger from the touch panel 120 as the end of the erasure operation. In this way, the control processing for tactile perception is completed.

[0057] As mentioned above, the electronic device 100, according to the first embodiment, generates a tactile sensation when the drawing object is deleted. Therefore, the electronic device 100 allows the user to intuitively recognize that the deletion has been performed and also to identify the location where the deletion took place. That is, the electronic device 100 can provide a mechanism that allows the user to confirm whether the processing corresponding to the operation performed by them has been completed or not.

[0058] Furthermore, in the repeated processing steps of S303 to S309, the intensity of tactile perception is increased by "1" each time MOVEMENT is detected. This means that CPU 101 determines the intensity of tactile perception based on the area (line length) of a position line of the touch input. The processing steps of S305, S307, and S310 are shown as an example of the determination processing of the intensity of tactile perception.

[0059] The larger the object being erased or the thicker the line being erased, the larger the area of ​​the touch input for erasure becomes. Conversely, the larger the area of ​​the touch input line, the more the electronic device 100, according to the embodiment, increases the intensity of tactile perception. Therefore, the user can obtain a stronger tactile perception with an increasing area of ​​the erasure target. Thus, the electronic device 100, according to the embodiment, can enable the user to intuitively recognize which section is currently being erased.

[0060] As a first modification of the first embodiment, the CPU 101 can erase the drawing object by changing (editing) its color at the touch position to a transparent color. For example, it is assumed that the drawing function has a feature that can edit the image across multiple display layers. In this case, since the drawing object is changed to a transparent color, the image is displayed in the lower display layer at the touch position. If the lower display layer does not exist because the drawing object is changed to a transparent color, a user interface element such as touch buttons, menus, and the like is displayed at the touch position to be penetrating.

[0061] As a second modification, in S306, CPU 101 can control the vibration generation device 123 instead of the tactile perception generation device 122. More precisely, the tactile perception intensity of vibration generation device 123 has been stored in memory 102. In S305, CPU 101 adds "1" to the tactile perception intensity value of vibration generation device 123. In S306, CPU 101 controls vibration generation device 123 to provide tactile perception with the tactile perception intensity set in memory 102.

[0062] As a third modification, it is sufficient that the handwritten data representing the drawing object is information that can express the drawing object and is not limited to information indicating the pen type and color of each set of coordinates. As a further example, the handwritten data could be information that contains details about the shape and size of a figure, a direction of rotation, and a position on an image, or the like.

[0063] As a fourth modification, the touch panel 120 can be positioned remotely from the display 105. In this case as well, the position on the touch panel 120 and the position on the display 105 are correspondingly mapped to each other. The CPU 101 can receive an instruction entered for the corresponding position on the display 105 in accordance with the touch input at any position on the touch panel 120. (Second embodiment)

[0064] The electronic device 100 according to the second embodiment is then described. In the case of erasing the drawing object created by the drawing function, the electronic device 100 according to the second embodiment controls the type of tactile perception that is generated, based on the pen type of the drawing object as the erasure target. The electronic device 100 according to the second embodiment is subsequently described with reference to parts that differ from the electronic device according to the first embodiment.

[0065] Fig. Figure 4 is a flowchart illustrating the control processing for tactile perception by the electronic device 100 according to the second embodiment. Among the processing operations in the Fig. In the 4 illustrated control processing for tactile perception, essentially the same processing operations as those in the control processing for tactile perception according to the first embodiment are designated with the same reference numerals.

[0066] In S303, CPU 101 determines whether a drawing object exists at the contact position. If a drawing object exists, CPU 101 advances processing to S304. If no drawing object exists, CPU 101 advances processing to S308. After processing S304 is complete, CPU 101, which also acts as a type specification device, advances processing to S401. In S401, CPU 101 specifies the pen type (line type) of the drawing object drawn at the contact position (type specification processing). More precisely, CPU 101 specifies the pen type in memory 102 according to the contact coordinates obtained in S302.

[0067] Subsequently, in S402, CPU 101, which also acts as a type-determining device, determines the tactile perception type as an object type based on the pen type defined in S401 (type-determining processing). More precisely, CPU 101 determines the tactile perception type based on the correspondence table for mapping the pen type to the tactile perception type. Fig. Figure 5 is a diagram illustrating an example of a correspondence table. In a Fig. In the illustrated correspondence table 501, the tactile perception type "rough" is assigned to the pen type "pencil". In correspondence table 501, the tactile perception type "gravel-like" is assigned to the pen type "crayon", and the tactile perception type "powder-like" is assigned to the pen type "brush".

[0068] Back in Fig. 4. After processing S402, CPU 101 advances the processing to S403. In S403, CPU 101 controls the tactile perception generator 122 to mediate the tactile perception with the specified type of tactile perception (control processing). Conversely, the tactile perception generator 122 generates the tactile perception (vibration) with the specified type of tactile perception (tactile perception generation processing).

[0069] Subsequently, in S308, CPU 101 terminates the control processing for tactile perception if LIFT is detected (YES in S308). If LIFT is not detected (NO in S308), CPU 101 proceeds to S309.

[0070] Other embodiments and processing of the electronic device 100 according to the second embodiment are similar to those of the electronic device 100 according to the first embodiment.

[0071] As mentioned above, the electronic device 100 according to the second embodiment can change the type of tactile perception according to the pen type (line type). Therefore, the electronic device 100 can enable the user to intuitively recognize the line type of the erasure target.

[0072] As a modification of the second embodiment, the drawing object type defined by the CPU 101 in S401 is not limited to the pen type. As another example, the CPU 101 can define at least one hue, brightness, and / or intensity of the drawing object as the drawing object type. In this case, the CPU 101 specifies the tactile perception type by referring to a correspondence table in which the hue and the like are mapped to the tactile perception type.

[0073] Fig. Figure 6 is a diagram illustrating an example of a correspondence table according to a modification of the second embodiment. In a Fig. In the illustrated correspondence table 601, the tactile perception type "rough" (R, G, B) = (0, 0, 0) (black) is assigned accordingly. In correspondence table 601, the tactile perception type "gravelly" (R, G, B) = (255, 0, 0) (red) is assigned accordingly, and the tactile perception type "powdery" (R, G, B) = (0, 0, 255) (blue) is assigned accordingly.

[0074] As a further modification of the second embodiment, the CPU 101 can calculate an intensity of the drawing object drawn at the touch position and increase the intensity of tactile perception with increasing intensity. (Third embodiment)

[0075] The electronic device 100 according to the third embodiment is then described. When a blur filter is applied to the drawing object, the electronic device 100 according to the third embodiment controls the intensity of tactile perception based on the degree of blurring. The electronic device 100 according to the third embodiment is subsequently described with reference to parts that differ from the electronic devices according to the other embodiments.

[0076] Fig. Figure 7 is a flowchart illustrating a control processing step for tactile perception by the electronic device 100 according to the third embodiment. Among the processing steps in the Fig.The 7 illustrated control processing for tactile perception essentially uses the same processing operations as those in the control processing for tactile perception according to the first embodiment, with the same reference numerals.

[0077] In S303, CPU 101 determines whether a drawing object exists at the contact position. If a drawing object exists, CPU 101 proceeds to S701. If no drawing object exists, CPU 101 proceeds to S308. In S701, CPU 101 stores the handwritten data from the drawing object that is not subject to the smear processing in memory 102. This handwritten data is used for comparison with the handwritten data from the drawing object obtained after the smear processing.

[0078] Subsequently, in S702, CPU 101 performs the blurring process on the drawing object existing at the contact position and its neighboring drawing objects. It is assumed that an area serving as the target of the blurring process has been predefined as an area in which the contact position is set as the center point of the area to be blurred.

[0079] Subsequently, in S703, CPU 101 compares the drawing objects before and after the blur processing, calculating a difference between them. More precisely, CPU 101 calculates the difference between the color information of the drawing objects before and after the blur processing with respect to each of the R, G, and B coordinates. CPU 101 thus performs processing with respect to all coordinates within the area targeted by the blur processing and calculates the difference as a sum of the processing results. The difference is shown as an example of the extent of a change between the drawing objects before and after the blur processing (edit processing).

[0080] Subsequently, in S704, CPU 101 sets a tactile perception intensity based on the difference calculated in S703 (tactile perception intensity setting processing). More precisely, CPU 101 increases the tactile perception intensity as the difference increases. Then, in S705 (control processing), CPU 101 controls the tactile perception generator 122 to transmit the tactile perception at the intensity set in S704. Under the control of CPU 101, the tactile perception generator 122 generates a vibration corresponding to the set tactile perception intensity, thus transmitting the tactile perception to the control device (tactile perception generation processing).

[0081] Other embodiments and processing of the electronic device 100 according to the third embodiment are similar to those of the electronic devices 100 according to the other embodiments.

[0082] As mentioned above, according to the third embodiment, the electronic device 100 determines the intensity of tactile perception according to the extent of change in the drawing objects before and after the blurring process. Therefore, the electronic device 100 allows the user to intuitively recognize the extent of change resulting from the blurring process.

[0083] Generally, if the blurring filter is applied to the same section many times, its effectiveness diminishes. However, according to the embodiment, the electronic device 100 can provide tactile feedback regarding the degree of change. Therefore, the user can intuitively recognize whether repeated application of the blurring filter is effective or not.

[0084] As a modification of the third embodiment, the blurring process can be performed by the image processing unit 104 instead of the CPU 101. In this case, the CPU 101 assigns the blurring process to the image processing unit 104. The image processing unit 104 then executes the blurring process in response to the instruction from the CPU 101.

[0085] As a further modification of the third embodiment, the electronic device 100 can control the intensity of tactile perception in an editing process other than the blurring process based on the extent of change to the drawing objects before and after the editing process.

[0086] Although in the foregoing embodiment an example of blur processing has been described as an editing process, the type or intensity of the tactile perception generated when performing the operation can be changed for various other types of editing processes, such as edge enhancement processing, color conversion processing, and the like, according to the properties of the image displayed on the touched section. (Other embodiments)

[0087] Embodiment(s) of the present invention can also be implemented by a computer of a system or apparatus which reads and executes computer-executable instructions (e.g., one or more programs) recorded on a storage medium (which can also be more fully described as a "non-volatile, computer-readable storage medium") in order to perform the functions of one or more of the embodiment(s) described above, and / or which includes one or more circuits (e.g.,A user-specific integrated circuit (ASIC) comprises, for performing the functions of one or more of the embodiment(s) described above, a method carried out by the computer of the system or apparatus, for example, reading and executing the computer-executable instructions from the storage medium to perform the functions of one or more of the embodiment(s) described above, and / or controlling the one or more circuits to perform the functions of one or more of the embodiment(s) described above. The computer may comprise one or more processors (e.g., central processing unit (CPU), microprocessor unit (MPU)) and may include a network of separate computers or separate processors to read and execute the computer-executable instructions.The computer-executable instructions can be provided to the computer, for example, by a network or the storage medium. The storage medium can include, for example, one or more from a hard disk, random access memory (RAM), read-only memory (ROM), distributed computing system memory, an optical disc (such as a Compact Disc (CD), Digital Versatile Disc (DVD), or Blu-ray Disc (BD)™), a flash memory device, a memory card, and the like.

[0088] Although the present invention has been described with reference to embodiments, it is understood that the invention is not limited to the disclosed embodiments. It is also understood that this invention has only been described above by way of examples, and that detailed modifications can be made within the scope of this invention.

Claims

[1] Image processing device comprising: a tactile perception generating device configured to generate a stimulus that can be noticed by a user touching a section of an input device, the input device being provided to a display device for displaying a drawing object; and a control device configured to control the tactile perception generation device such that the stimulus is generated when a touch input is made at a position corresponding to the drawing object and editing processing is performed on the drawing object, wherein The editing process is a process for deleting the drawing object at the position where the touch input is performed; and The control device is configured to delete the drawing object and to control the tactile perception generation device so that the stimulus is generated. [2] Image processing device according to claim 1, wherein the processing for deletion is a processing for changing a color of the drawing object at the position where the touch input is performed to a background color. [3] Image processing device according to claim 1, wherein the processing for deletion is a processing for changing a color of the drawing object at the position where the touch input is performed to a transparent color. [4] Image processing device according to one of claims 1 to 3, furthermore, a comprehensive setting device for a tactile perception intensity that is configured to set a tactile perception intensity indicating a stimulus intensity based on an area of ​​a locus of touch input; and wherein the control device is configured to control the tactile perception generating device such that a tactile perception is mediated with the intensity of tactile perception specified by the tactile perception intensity setting device. [5] Image processing device according to any one of claims 1 to 4, further comprising: a type specification device configured to specify a type of drawing object drawn at the position where touch input is performed; as well as a type-specifying device that is configured to specify a type of stimulus based on the type specified by the type-specifying device; wherein the control device is configured to control the tactile perception generating device such that the stimulus is conveyed with the type specified by the type-specifying device. [6] Image processing device according to claim 5, wherein the type specification device is configured to specify a line type of the drawing object as the type of the drawing object. [7] Image processing device according to claim 5, wherein the type specification device is configured to specify at least one hue, brightness and / or intensity of the drawing object as the type of the drawing object. [8] Image processing device according to any one of claims 1 to 7, furthermore, a comprehensive setting device for the intensity of tactile perception, which is configured to set an intensity of tactile perception that indicates an intensity of the stimulus, based on an extent of change of the drawing object before and after editing processing; wherein the control device is configured to control the tactile perception generating device such that a tactile perception is mediated with the intensity of tactile perception specified by the tactile perception intensity setting device. [9] Control method for tactile perception, which is executed by an image processing device, and includes: a tactile perception generation step to generate a stimulus that can be noticed by a user touching a section of an input device, the input device being provided in accordance with a display device for displaying a drawing object; and a control step for controlling the generation step for tactile perception such that the stimulus is generated when a touch input is performed at a position corresponding to the drawing object and an editing process is performed on the drawing object, wherein The editing process is a process for deleting the drawing object at the position where the touch input is performed; and The control step includes a step to control the generation step for tactile perception such that the drawing object is deleted and the stimulus is generated. [10] Program which continuously causes on a device to perform a method according to claim 9. [11] Computer-readable storage medium that stores a program according to claim 10.

Images