Information processing device, information processing method, and computer-readable recording medium

Abstract

An information processing device according to one embodiment of the present invention comprises a display control unit. The display control unit: controls a display device so as to display a target object to be corrected; and controls the display device so as to change the target object to an intermediate object between the target object and a reference object corresponding to the target object, in accordance with the display state of the target object after the target object is displayed.

Description

[Technical Field]

[0001] The present technology relates to an information processing device, an information processing method, and a computer-readable recording medium that perform display correction. [Background technology]

[0002] Conventionally, technologies for correcting display objects displayed on displays and the like have been developed. For example, Patent Document 1 describes a method for correcting a display object displayed to a communication partner when remote communication is performed. In this method, for example, a photographed image of the space in which the user is present is displayed as a display object to the other party. At this time, if the other party is not gazing at the display object, the appearance of the display object is corrected. This makes it possible to decorate the space in which the user is present or himself or herself without the other party realizing it (see, for example, paragraphs

[0025] ,

[0054] , and

[0058] , and Figure 6 of the specification of Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2019 / 176236 Summary of the Invention [Problem to be solved by the invention]

[0004] In this way, if a user were to observe the moment when a displayed object is corrected, the correction itself may be conspicuous. For this reason, there is a demand for a technology that can correct a display without the user noticing.

[0005] In view of the above circumstances, an object of the present technology is to provide an information processing device, an information processing method, and a computer-readable recording medium that are capable of correcting a display without the user noticing. [Means for solving the problem]

[0006] In order to achieve the above object, an information processing device according to an embodiment of the present technology includes a display control unit. The display control unit controls the display device to display a target object to be corrected, and controls the display device to change the target object into an intermediate object between the target object and a reference object corresponding to the target object, depending on the display state of the target object after the target object is displayed.

[0007] In this information processing device, a target object to be corrected is output by a display device. Then, depending on the display state of the target object after output, the display device is controlled so that the target object changes to an intermediate object between the target object and its corresponding reference object. In this way, by changing the target object depending on the display state of the target object, it is possible to correct the display without the user noticing.

[0008] The display control unit may detect the display state that causes visual change blindness in a user viewing the target object, and may control the display device to change the target object into the intermediate object at the timing when the display state that causes visual change blindness is detected.

[0009] The display control unit may control the display device so that the intermediate object approaches the reference object every time the display state that causes the visual change blindness is detected.

[0010] The display control unit may detect, as the display state, a state in which display parameters including at least one of the position, size, and posture of the target object are changing in response to an input operation by a user, and may control the display device to change the target object into the intermediate object based on the detection result.

[0011] The input operation by the user may include at least one of a movement operation, a resizing operation, and a rotation operation by the user on the target object.

[0012] The display control unit may control the display device to change the target object into the intermediate object in accordance with the timing at which at least one of the amount of change in the display parameter, the time during which the display parameter is changing, and the rate of change of the display parameter exceeds a predetermined threshold.

[0013] The display control unit may detect, as the display state, a state in which the display of the target object is obstructed, and may control the display device to change the target object into the intermediate object based on the detection result.

[0014] The display control unit may generate a screen image that is output from the display device, and detect a state in which the target object is occluded in the screen image or a state in which the target object is blurred in the screen image.

[0015] The display device may have a display surface, and in this case, the display control unit may detect a state in which display of the target object on the display surface is obstructed.

[0016] The display control unit may detect an inhibition area in which the display of the target object is inhibited, and control the display device to change the target object included in the inhibition area into the intermediate object.

[0017] The display control unit may control the display device to discontinuously change the target object into the intermediate object.

[0018] The display control unit may generate the intermediate object so that an intermediate process of change from the target object to the intermediate object cannot be identified.

[0019] The display control unit may generate the intermediate object by performing a morphing process that brings the target object closer to the reference object.

[0020] The target object may be a handwritten object representing the result of handwritten input by a user, and in this case, the reference object may be an estimated object obtained by estimating the content of the handwritten input.

[0021] The display control unit may generate the intermediate object by performing a morphing process to bring the hand-drawn object closer to the estimated object, and may set a proportion of the morphing process to be applied to the hand-drawn object that is smaller than a proportion of the morphing process when the result of the morphing process matches the estimated object.

[0022] The handwritten object may be at least one of an object representing a character handwritten by the user and an object representing an image handwritten by the user.

[0023] The target object may be a first image object, in which case the reference object may be a second image object different from the first image object.

[0024] An information processing method according to one embodiment of the present technology is an information processing method executed by a computer system, and includes controlling a display device to display a target object to be corrected, and controlling the display device to change the target object into an intermediate object between the target object and a reference object corresponding to the target object, depending on a display state of the target object after the target object is displayed.

[0025] A computer-readable recording medium according to one embodiment of the present technology records a program that causes a computer system to execute the following steps. A step of controlling a display device to display a target object to be corrected, and controlling the display device to change the target object into an intermediate object between the target object and a reference object corresponding to the target object, depending on the display state of the target object after the target object is displayed. [Brief explanation of the drawings]

[0026] [Figure 1] 1 is a schematic diagram illustrating an external appearance of a terminal device according to an embodiment of the present technology; [Figure 2] FIG. 2 is a block diagram illustrating an example of the configuration of a terminal device. [Figure 3] FIG. 1 illustrates an example of visual change blindness. [Figure 4] 10 is a flowchart illustrating an example of an operation of the terminal device. [Figure 5] FIG. 10 is a schematic diagram illustrating an example of a morphing process. [Figure 6] FIG. 10 is a schematic diagram for explaining a method for displaying a correction result. [Figure 7] FIG. 10 is a schematic diagram showing an example of character correction accompanying a move operation. [Figure 8] FIG. 10 is a schematic diagram showing an example of character correction accompanying an enlargement operation. [Figure 9] 10A and 10B are schematic diagrams illustrating an example of character correction accompanying a rotation operation. [Figure 10] 10A and 10B are schematic diagrams illustrating an example of correction due to occlusion of a target object in a screen image. [Figure 11] 10A and 10B are schematic diagrams illustrating an example of correction associated with occlusion of a target object on the display surface of a display. [Figure 12] FIG. 10 is a schematic diagram showing an example of morphing processing for a hand-drawn illustration. [Figure 13] FIG. 10 is a schematic diagram showing an example of correction for a hand-drawn illustration. [Figure 14] FIG. 10 is a schematic diagram illustrating an example of correction for an image object. DETAILED DESCRIPTION OF THE INVENTION

[0027] Hereinafter, embodiments of the present technology will be described with reference to the drawings.

[0028] [Terminal device configuration] 1 is a schematic diagram showing the appearance of a terminal device according to an embodiment of the present technology. The terminal device 100 is a device equipped with a touch-operable display 30 (touch display). The terminal device 100 may be, for example, a tablet terminal or a smartphone terminal. Various display objects are output to the display 30 of the terminal device 100. Here, the display objects are objects displayed on the display 30. Display objects include any object such as text, illustrations, photographs, drawings, and the like.

[0029] A user 1 using the terminal device 100 can, for example, view display objects displayed on the display 30, and by touching the display 30, intuitively perform input operations such as moving or zooming the display objects, or editing the display objects. The user 1 can also input characters, images, etc. by handwriting via the display 30. In this case, a display object representing the input result of the handwriting input by the user 1 is displayed on the display 30. In this way, the terminal device 100 allows direct writing on the display 30.

[0030] FIG. 1 schematically illustrates a state in which a user 1 uses a touch pen 2 to input a character (here, the capital letter "A") onto a display 30 of a terminal device 100. For example, when a user 1 writes a character on the display 30 by operating the touch pen 2, the trajectory of the tip of the touch pen 2 that comes into contact with the display 30 is detected by the touch sensor 31. Then, an object representing the trajectory of the tip of the touch pen 2 is displayed on the display 30 as a display object.

[0031] In the terminal device 100, a display object to be corrected among these display objects displayed on the display 30 is corrected according to its display state. Hereinafter, the display object to be corrected is referred to as a target object 10. For example, an object (handwritten object 20) showing the trajectory of the tip of the touch pen 2 shown in FIG. 1 is an example of a target object 10 to be corrected.

[0032] Furthermore, in this embodiment, the target object 10 is gradually corrected, for example, in multiple steps. Therefore, a target object 10 that has been corrected once (an intermediate object, which will be described later) may become a target for correction again. In other words, the display object to be corrected becomes the target object 10, regardless of whether it is an object that has already been corrected or not. The method for correcting the target object 10 will be explained in detail later.

[0033] Fig. 2 is a block diagram showing an example of the configuration of the terminal device 100. As shown in Fig. 2, the terminal device 100 includes a communication unit 32, a storage unit 33, and a controller 40 in addition to the display 30 and touch sensor 31 described above.

[0034] The display 30 has a display surface 34, and is placed on the terminal device 100 with the display surface 34 facing outward. The display surface 34 is a surface on which display objects are displayed. Data of a screen image 35 generated by a controller 40 (described later) is input to the display 30. Here, the screen image 35 is an image that constitutes a screen displayed on the entire display surface 34. This screen image 35 includes various display objects. The display 30 may be, for example, an LCD (Liquid Crystal Display) having a liquid crystal display element, an organic EL display, or the like. There are no other limitations on the specific configuration of the display 30. In this embodiment, the display 30 corresponds to a display device.

[0035] The touch sensor 31 is a sensor that detects contact of the user 1's finger, the touch pen 2, or the like with the display surface 34. The touch sensor 31 detects whether the user 1's finger is in contact with the display surface 34 and the contact position on the display surface 34. For example, a capacitance-type contact detection sensor or the like provided on the display surface 34 (display 30) is used as the touch sensor 31. Alternatively, a camera or the like that captures an image of the user 1's finger or the touch pen 2 on the display surface 34 may be used as the touch sensor 31. Other than this, the specific configuration of the touch sensor 31 is not limited.

[0036] The communication unit 32 is a module for performing network communication, short-range wireless communication, etc. with other devices. The communication unit 32 may be provided with, for example, a wireless LAN module such as WiFi, or a communication module such as Bluetooth (registered trademark). In addition, a communication module capable of communication via a wired connection may also be provided.

[0037] The storage unit 33 is a non-volatile storage device. For example, a recording medium using a solid-state element such as an SSD (Solid State Drive) or a magnetic recording medium such as an HDD (Hard Disk Drive) is used as the storage unit 33. In addition, the type of recording medium used as the storage unit 33 is not limited, and any recording medium that non-temporarily records data may be used. The storage unit 33 stores a control program according to this embodiment. The control program is, for example, a program that controls the overall operation of the terminal device 100. The storage unit 33 also stores data on reference objects, which will be described later. Other information stored in the storage unit 33 is not limited to this. In this embodiment, the storage unit 33 corresponds to a computer-readable recording medium on which a program is recorded, and the control program corresponds to a program recorded on the recording medium.

[0038] The controller 40 controls the operation of the terminal device 100. The controller 40 has hardware components necessary for a computer, such as a CPU and memory (RAM, ROM). The CPU loads a control program stored in the storage unit 33 into the RAM and executes it, thereby executing various processes. The controller 40 corresponds to an information processing device according to this embodiment.

[0039] A device such as a PLD (Programmable Logic Device) such as an FPGA (Field Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit) may be used as the controller 40. Alternatively, a processor such as a GPU (Graphics Processing Unit) may be used as the controller 40.

[0040] In this embodiment, the CPU of the controller 40 executes a program (control program) according to this embodiment, thereby realizing functional blocks including an input detection unit 41, a reference object acquisition unit 42, and a display control unit 43. These functional blocks then execute the information processing method according to this embodiment. Note that dedicated hardware such as an IC (integrated circuit) may be used as appropriate to realize each functional block.

[0041] The input detection unit 41 detects handwritten input by the user 1. Specifically, the input detection unit 41 generates input data representing the input content of the handwritten input based on the detection result of contact with the display surface 34 (display 30) detected by the touch sensor 31. For example, suppose that user 1 writes "A" by hand as shown in FIG. 1. In this case, stroke data representing the handwriting of user 1 is detected as input data based on the detection result of touch sensor 31. Here, stroke data is, for example, vector data representing one continuous handwriting (stroke). For example, the stroke data of "A" shown in FIG. 1 is data including three strokes, each consisting of two adjacent lines at the top of the figure and a line connecting the two lines.

[0042] Furthermore, the input detection unit 41 estimates the content of the handwritten input by the user 1 based on the input data. Specifically, a predetermined recognition process is executed on the handwritten input data (stroke data) to estimate the content of the handwritten input by the user 1. For example, from the handwritten input data shown in FIG. 1, it is estimated that the content written by the user 1 is the uppercase alphabet "A."

[0043] It is also possible to estimate the content of an image such as an illustration handwritten by user 1 (see FIG. 12, etc.). For example, the type and shape of the line input by user 1, such as whether it is a straight line or a curved line, can be estimated. Also, for example, if user 1 draws a circular image, the type of circle, such as whether the image is an ellipse or a perfect circle, can be estimated. The method for estimating the content of handwritten input is not limited, and for example, a method for performing character recognition or graphic recognition using pattern matching, machine learning, or the like may be used as appropriate.

[0044] The reference object acquisition unit 42 acquires data of a reference object. Here, the reference object is an object that is referenced when correcting the target object 10 displayed on the display 30, and is an object that serves as a reference for correcting the target object 10. For example, once the target object 10 to be corrected is determined, data of a reference object corresponding to the target object 10 is read from the storage unit 33. Alternatively, a reference object corresponding to the target object 10 is newly generated. Other than this, the method of acquiring the data of the reference object is not limited.

[0045] The display control unit 43 controls the display on the display 30 (the output of the display 30). Specifically, the display control unit 43 generates a screen image 35 that is the output of the display 30. By appropriately generating this screen image 35, the content displayed on the display 30 is controlled. In this embodiment, the display control unit 43 controls the display 30 to display the target object 10 to be corrected. Specifically, a screen image 35 including the target object 10 is generated and output to the display 30.

[0046] Furthermore, the display control unit 43 executes a correction process for the target object 10 in accordance with the display state of the target object 10 displayed on the display 30. Here, the display state of the target object 10 refers to the display of the target object 10, that is, the state of how the target object 10 appears. For example, the display state (appearance) of the target object 10 differs between a state in which the target object 10 is displayed stationary and a state in which the target object 10 is displayed moving. In addition, when the target object 10 is hidden by another object or when light is reflected on the display surface 34, the display of the target object 10 is obstructed. The target object 10 is corrected depending on the appearance of the target object 10.

[0047] In this embodiment, the target object 10 is corrected by changing the target object 10 into an intermediate object. Here, the intermediate object is an object between the target object 10 and the reference object 13 that serves as the basis for correction. For example, in an object representing a handwritten character, an object in which each stroke is made closer to a reference object (such as a font object) becomes an intermediate object (see FIG. 5).

[0048] In this way, the display control unit 43 controls the display 30 to change the target object 10 into an intermediate object between the target object 10 and the reference object corresponding to the target object 10, depending on the display state of the target object 10 after the target object 10 is displayed. For example, a screen image 35 in which an intermediate object is placed in place of the target object 10 that had been displayed up until that point is generated and output to the display 30. As a result, the target object 10 on the display 30 is switched to the intermediate object, and the target object 10 is corrected. The timing of this correction is determined according to the display state of the target object 10.

[0049] In this embodiment, the display control unit 43 detects a display state that causes visual change blindness in the user 1 viewing the target object 10. Then, at the timing when the display state that causes visual change blindness is detected, the display 30 is controlled to change the target object 10 into an intermediate object. Here, visual change blindness is a human characteristic in which a person cannot notice (or has difficulty noticing) changes in an object that they visually recognize under certain conditions. Therefore, a display state that causes visual change blindness in user 1 can be said to be a state in which it is difficult to notice a change in target object 10 before and after the change.

[0050] FIG. 3 is a diagram illustrating an example of visual change blindness. The left side of Fig. 3 shows a target object 10 to be corrected (a handwritten object 20 in which the letter "A" is handwritten). The right side of Fig. 3 shows an intermediate object 11 obtained by correcting the target object 10 based on a predetermined reference object. The center of Fig. 3 also shows an occluding object 21 (here, a mosaic pattern) that occludes the target object 10.

[0051] For example, suppose that the display on the display 30 changes from the left to the center to the right in this order in Figure 3. That is, suppose that the target object 10 is switched to the occluding object 21, and then the occluding object 21 is switched to the intermediate object 11. At this time, the user 1 looking at the target object 10 will have difficulty noticing the change in each stroke of the letter "A" before and after the occluding object 21 is displayed. In this way, the occlusion of the target object 10 causes visual change blindness in the user 1, making it difficult for the user 1 to notice that the target object 10 has been corrected to the intermediate object 11. It should be noted that visual change blindness does not only occur when an object is occluded, but can also occur when an object is moved, as will be described later.

[0052] The terminal device 100 utilizes such visual change blindness to correct the target object 10. For example, the target object 10 is switched to the intermediate object 11 in accordance with the timing at which visual change blindness occurs. This makes it possible to correct the target object 10 without the user 1 noticing. Hereinafter, visual change blindness may be simply referred to as change blindness.

[0053] [Handwriting correction] The following describes a method for correcting handwritten input by user 1. In this case, the target object 10 is a handwritten object 20 that represents the input result of handwritten input by user 1. For example, the object representing the trajectory of the tip of the touch pen 2 shown in FIG. 1 is an example of the handwritten object 20. As will be described later, the handwritten object 20 is gradually corrected, for example, in multiple steps. A series of objects transformed by these corrections are all included in the handwritten object 20 that represents the input result of handwriting input by the user 1.

[0054] In this embodiment, the handwritten object 20 is generated by the display control unit 43 and output to the display 30. For example, when handwriting input is performed by user 1, handwritten object 20 is generated based on input data representing the handwritten input content generated by input detection unit 41. Then, screen image 35 including handwritten object 20 is generated and output to display 30. As a result, handwritten object 20 before correction is displayed on display 30 as target object 10. Furthermore, for example, when a correction process is executed on the handwritten object 20, a screen image 35 including the corrected handwritten object 20 (intermediate object 11) is generated and output to the display 30. As a result, the corrected handwritten object 20 is displayed on the display 30. When the corrected handwritten object 20 (intermediate object 11) is further corrected, the corrected handwritten object 20 becomes a new target object 10.

[0055] 4 is a flowchart showing an example of the operation of the terminal device 100. Here, the process of correcting handwritten input by the user 1 will be described with reference to FIG.

[0056] First, the input detection unit 41 detects a handwritten input by the user 1 (step 101). For example, when the user 1 performs handwriting input on the display 30 (display surface 34), the trajectory of the contact position is detected by the touch sensor 31. Input data representing the handwritten input content is generated based on the detection result of the touch sensor 31. Then, the handwritten input content is estimated based on the input data. For example, predetermined character recognition or graphic recognition is performed on the input data, and the type of handwritten input character or image is estimated.

[0057] Furthermore, at the timing when the user 1 performs handwritten input, the display control unit 43 generates a handwritten object 20 based on the input data generated by the input detection unit 41. The generated handwritten object 20 is output to the display 30 as a part of the screen image 35.

[0058] The reference object acquisition unit 42 acquires a reference object corresponding to the handwritten object 20 (step 102). Specifically, an inferred object obtained by inferring the input content of the handwritten input is acquired as the reference object. For example, based on the inferred result of the handwritten input of user 1 by input detection unit 41, data of the inferred object stored in storage unit 33 is read. Alternatively, based on the inferred result of the handwritten input, an inferred object is generated.

[0059] For example, if the user 1 inputs characters by handwriting, the handwritten object 20 becomes an object representing the characters handwritten by the user. A font object representing each character is stored in storage unit 33 as an estimated object for correcting handwritten characters. When the content of the handwritten input by user 1 is a character, a font object (estimated object) corresponding to the estimated result of the character is read from storage unit 33.

[0060] Furthermore, for example, if the user 1 inputs an image by handwriting, the handwritten object 20 becomes an object that represents the image handwritten by the user. In this case, an estimated object for correcting the handwritten image is generated based on the estimation result. Specifically, an estimated object (estimated object) representing the estimation result of the content of the image (type of lines, shapes, etc.) is generated. Here, the icon object is, for example, stroke data including strokes corresponding to an icon drawn by user 1. For example, if it is estimated that user 1 has drawn an ellipse, an icon object including ellipse-shaped strokes is generated.

[0061] The display control unit 43 detects the display state for executing correction on the handwritten object 20 (target object 10) currently displayed on the display 30 (step 103). Specifically, a display state that causes visual change blindness for the user 1 is detected as a display state for which correction is to be performed. Generally, the display state of each object on the display 30 differs for each object (or each area in which each object is displayed). Here, a display state that causes change blindness for each handwritten object 20 (target object 10) displayed on the display 30 is detected. For example, it is determined whether or not the display of each handwritten object 20 currently displayed on the display 30 is in a state that causes change blindness. This determination process is continued until a display state that causes change blindness is detected.

[0062] When a display state that requires correction, that is, a display state that causes change blindness, is detected, the display control unit 43 executes a correction process for correcting the target handwritten object 20 (step 104). In this embodiment, a morphing process is performed to bring the hand-drawn object 20 (target object 10) closer to the estimated object (reference object), and an intermediate object 11 is generated. Then, the intermediate object 11 is displayed in place of the hand-drawn object 20 that had been displayed on the display until then. As a result, the hand-drawn object 20 is corrected. The morphing process may be performed in advance at a stage before a display state that causes change blindness is detected.

[0063] 5A to 5C are schematic diagrams showing an example of morphing processing. Handwritten objects 20 representing the uppercase alphabets "A," "B," "C," "D," and "E" are each shown using solid black lines. Each line constituting each handwritten object 20 becomes stroke data (vector strokes). 5A to 5C, an estimated object 22 (reference object 13) corresponding to each handwritten object 20 is schematically illustrated as a gray area. The estimated object 22 is stroke data representing each character ("A", "B", "C", "D", "E") in a predetermined font.

[0064] 5A to 5C, a gauge indicating the rate of morphing is schematically illustrated. The rate of morphing represents, for example, the rate at which the hand-drawn object 20 approaches the estimated object 22. Here, it is assumed that the closer the rate of morphing approaches 1 from 0, the closer the hand-drawn object 20 becomes to the estimated object 22.

[0065] In Fig. 5A, the morphing process ratio is set to 0. Therefore, each handwritten object 20 shown in Fig. 5A is an object to which no correction by morphing process has been applied, and is an object that directly represents the input result of handwriting input by user 1. 5B, the morphing process ratio is set between 0 and 1 (for example, 0.5). In this case, each handwritten object 20 becomes an intermediate object 11 that is corrected so as to approach the estimated object 22 according to the morphing process ratio. 5C, the morphing process ratio is set to 1. Therefore, each handwritten object 20 shown in FIG.

[0066] In this embodiment, the display control unit 43 sets the rate of morphing processing to increase each time a correction is made to the handwritten object 20 (target object 10). Therefore, the intermediate object 11 generated during correction gradually changes to an object closer to the estimated object 22. In the terminal device 100, the intermediate object 11 that becomes closer to the estimated object 22 with each correction is output to the display 30. In this way, every time a display state that causes visual change blindness is detected, the display control unit 43 controls the display 30 so that the intermediate object 11 approaches the estimated object 22 (reference object 13). This makes it possible to avoid correction that would abruptly change the handwritten object 20, and to avoid discomfort or the like caused by the correction.

[0067] Furthermore, when the handwritten object 20 is the correction target (target object 10), an upper limit may be set for the rate of morphing processing. In other words, the final correction result of the handwritten object 20 does not have to match the estimated object 22. In this case, the display control unit 43 sets the ratio of the morphing process to be applied to the handwritten object 20 to be smaller than the ratio of the morphing process when the result of the morphing process matches the estimated object 22 (here, 1). For example, if the morphing process ratio ultimately becomes 1, it may become obvious that the handwritten object 20 has been corrected. In such a case, the morphing process ratio is appropriately adjusted to a value less than 1. This makes it possible to correct the handwritten input result while preserving the user's personal input habits and characteristics. This allows user 1 to save beautifully corrected characters, etc. as data while retaining their own unique style.

[0068] 6 is a schematic diagram for explaining a method for displaying the correction result. Here, a method for switching the target object 10 (hand-drawn object 20) to be corrected to the intermediate object 11 that is the correction result will be explained. 6 illustrates the correction of the handwritten object 20, which is the target object 10, divided into five frames 25a to 25e. For example, frames 25a to 25e are displayed in this order along the time axis. At this time, suppose that a display state that requires correction of the target object 10 (a display state that causes change blindness) is detected when frame 25b is displayed. In this case, the target object 10 displayed in frames 25a and 25b is completely switched to the intermediate object 11 in frame 25c.

[0069] As described above, in this embodiment, the display control unit 43 controls the display 30 to discontinuously change the target object 10 into the intermediate object 11. That is, the correction of the target object 10 is performed instantaneously. As described above, this correction is performed in a situation where change blindness occurs. Therefore, it is possible to correct the target object 10 without the user 1 being aware that the target object 10 has changed.

[0070] Returning to FIG. 4, once the handwritten object 20 has been corrected, it is determined whether or not the correction process for the handwritten object 20 has been completed (step 105). For example, when multiple handwritten objects 20 are displayed, it is determined whether the morphing process has been completed for all of the handwritten objects 20. In other words, it is determined whether the rate of morphing for each handwritten object 20 has reached a predetermined upper limit. For example, if it is determined that correction has been completed for all handwritten objects 20 (Yes in step 105), the correction process ends. Furthermore, for example, if there are any handwritten objects 20 that have not been corrected and it is determined that correction has not been completed for all of the handwritten objects 20 (No in step 105), the processing from step 101 onwards is executed again.

[0071] The timing for correcting the target object 10 will be specifically described below. The timing of the correction may be triggered by an input operation by the user 1 (interaction with the target object 10), or by a change in the visual environment that occurs independently of the user's actions. Here, the timing of correction using each trigger will be described, mainly taking as an example a case where a character (handwritten object 20 representing a character) input by handwriting by the user 1 is corrected.

[0072] [Correction triggered by user input] Generally, when tracking a moving object, the human gaze shifts. When gaze shifts in this way, instantaneous visual changes tend to be difficult to perceive (saccadic suppression). Furthermore, when an object is being enlarged or rotated, instantaneous visual changes tend to be difficult to perceive. In this embodiment, such human perception characteristics are utilized to correct the target object 10. For example, when the user 1 is operating the target object 10, a process is executed in which the amount of movement of the user's line of sight, etc. is estimated, and if the amount is equal to or greater than a certain amount, a correction is applied. This amount of movement of the line of sight may be detected directly from the line of sight of the user 1, or may be estimated based on a change in the display parameters of the target object 10, etc.

[0073] In this embodiment, the display control unit 43 detects, as the display state of the target object 10, a state in which display parameters including at least one of the position, size, and attitude of the target object 10 are changed in response to an input operation by the user 1. That is, a state in which the target object 10 is moving, enlarged / reduced, rotated, or the like due to the input operation by the user 1 is detected. Then, based on the detection result, the display 30 is controlled to change the target object 10 into the intermediate object 11. For example, if a change in the display parameters of the target object 10 satisfies a predetermined condition, the target object 10 is switched to the intermediate object 11 because a visual change that occurs instantaneously is difficult to perceive. This makes it possible to correct the target object 10 without the user noticing.

[0074] FIG. 7 is a schematic diagram showing an example of character correction accompanying a move operation. Here, as an input operation by the user 1, a movement operation (drag operation or scroll operation) by the user 1 is performed on the target object 10.

[0075] In Fig. 7A, the target object 10a is corrected to an intermediate object 11a during the movement operation. In Fig. 7B, the intermediate object 11a corrected in Fig. 7A is corrected to an intermediate object 11b as a new target object 10b during the movement operation. In Figs. 7A and 7B, the object (frame) displayed during the movement operation is schematically illustrated using gray lines. In addition, at the bottom of each figure, the target object 10 and the intermediate object 11 displayed on the display 30 before and after the movement operation (before and after correction) are respectively illustrated.

[0076] As shown in FIG. 7A, a target object 10a representing the letter "A" is moved by a movement operation performed by the user 1. While this movement operation is being performed, a change in the position of the target object 10a is detected. Then, when it is determined that the change in position satisfies a predetermined condition, the target object 10a is switched to an intermediate object 11b. Hereinafter, the timing at which the target object 10 is switched to the intermediate object 11 will be referred to as a correction timing Tc. Note that the correction timing Tc does not have to coincide with the timing at which a change in position (change in display parameters) satisfies a predetermined condition.

[0077] For example, immediately after the start of the moving operation, the change in position does not satisfy a predetermined condition, and the target object 10a is displayed. After that, when it is determined that the change in position does satisfy the predetermined condition, the intermediate object 11a is displayed in place of the target object 10a. In the example shown in Fig. 7A, the timing one frame before the end of the moving operation is the correction timing Tc.

[0078] 7A becomes a correction target when it is displayed on the display 30. In Fig. 7B, the intermediate object 11a, which has become the new target object 10b, is moved and corrected to the intermediate object 11b during the movement. In the example shown in Fig. 7B, the timing one frame before the movement operation ends is the correction timing Tc. Note that the intermediate object 11b is an object with a higher degree of correction (proportion of morphing processing) than the intermediate object 11a. In this way, the degree of correction of the object to be corrected gradually increases each time it is moved. This makes it possible to achieve natural correction processing with a desired amount of correction without the user 1 noticing.

[0079] The predetermined conditions for determining a change in the position of the target object 10 include conditions related to the amount of change in position, the time of change, the speed of change, and the like. For example, in the process of determining a change in the position of the target object 10, it is determined whether or not the amount of change in the position of the target object 10 (movement distance) exceeds a threshold. Alternatively, it may be determined whether or not the time (movement time) during which the position of the target object 10 is changing exceeds a threshold. Alternatively, it may be determined whether or not the speed of change in the position of the target object 10 (movement speed) exceeds a threshold. Furthermore, the predetermined conditions may be set by appropriately combining the movement distance, movement time, and movement speed.

[0080] As described above, in this embodiment, the display 30 is controlled to change the target object 10 into the intermediate object 11 at the timing when a change in the position of the target object 10 (a change in the display parameters) satisfies a predetermined condition. This makes it possible to make the change caused by switching from the target object 10 to the intermediate object 11 at the correction timing Tc less noticeable. In this way, in the example shown in Fig. 7, it can be said that change blindness occurs to the user 1 before and after the movement operation. This makes it possible to correct the target object 10 without the user 1 noticing.

[0081] FIG. 8 is a schematic diagram showing an example of character correction accompanying an enlargement operation. Here, as an input operation by the user 1, a size change operation (zoom-in operation / zoom-out operation) by the user 1 is performed on the target object 10.

[0082] In Fig. 8A, target object 10a is corrected to intermediate object 11a during an enlargement operation. In Fig. 8B, intermediate object 11a corrected in Fig. 8A is corrected to intermediate object 11b as new target object 10b during a reduction operation. Also, at the bottom of each figure, the target object 10 and intermediate object 11 displayed on display 30 before and after each resizing operation (before and after correction) are respectively shown.

[0083] As shown in Fig. 8A, a target object 10a representing the letter "A" is enlarged by a zoom-in operation performed by a user 1. While this zoom-in operation is being performed, a change in the size of the target object 10a is detected. Then, when it is determined that the change in size satisfies a predetermined condition, the target object 10a is switched to an intermediate object 11b. Similarly, in FIG. 8B, the intermediate object 11a, which has become the new target object 10b, is reduced and corrected to the intermediate object 11b during this process.

[0084] The predetermined conditions for determining the change in size of the target object 10 include conditions related to the amount of change in size, the time period for change, the speed of change, and the like. For example, in the process of determining the change in size of the target object 10, it is determined whether the amount of change in size (enlargement rate / reduction rate) of the target object 10 exceeds a threshold. Alternatively, it may be determined whether the time during which the size of the target object 10 is changing (size change time) exceeds a threshold. Alternatively, it may be determined whether the speed at which the size of the target object 10 is changing (size change speed) exceeds a threshold. Furthermore, these may be appropriately combined to set predetermined conditions.

[0085] In this way, in this embodiment, the display 30 is controlled to change the target object 10 into the intermediate object 11 at the timing when a change in size (change in display parameters) of the target object 10 satisfies a predetermined condition. In this way, even when the size changes, change blindness may occur for the user 1. Therefore, by appropriately setting a predetermined condition, it is possible to correct the target object 10 during a zoom-in or zoom-out operation without the user 1 noticing.

[0086] FIG. 9 is a schematic diagram showing an example of character correction accompanying a rotation operation. Here, as an input operation by the user 1, a rotation operation by the user 1 is performed on the target object 10.

[0087] In Fig. 9A, target object 10a is corrected to intermediate object 11a during a rotation operation in which it rotates counterclockwise. In Fig. 9B, intermediate object 11a corrected in Fig. 9A is corrected to intermediate object 11b as new target object 10b during a rotation operation in which it rotates clockwise. In addition, at the bottom of each figure, the target object 10 and intermediate object 11 displayed on display 30 before and after each rotation operation (before and after correction) are respectively illustrated.

[0088] As shown in FIG. 9A, a target object 10a representing the letter "A" is rotated by a rotation operation performed by the user 1. While this rotation operation is being performed, a change in the posture of the target object 10a is detected. Then, when it is determined that the change in posture satisfies a predetermined condition, the target object 10a is switched to an intermediate object 11b. Similarly, in FIG. 8B, the intermediate object 11a, which has become the new target object 10b, is rotated and corrected to intermediate object 11b in the process.

[0089] The predetermined conditions for determining a change in the posture of the target object 10 include conditions related to the amount of change in posture, the time period during which the change occurs, and the speed of the change. For example, in the process of determining a change in the attitude of the target object 10, it is determined whether or not the amount of change (amount of rotation) in the attitude of the target object 10 exceeds a threshold. Alternatively, it may be determined whether or not the time (rotation time) during which the attitude of the target object 10 is changing exceeds a threshold. Alternatively, it may be determined whether or not the speed (rotation speed) of the change in the attitude of the target object 10 exceeds a threshold. Furthermore, these may be appropriately combined to set predetermined conditions.

[0090] In this way, in this embodiment, the display 30 is controlled to change the target object 10 into the intermediate object 11 at the timing when a change in the posture of the target object 10 (a change in the display parameters) satisfies a predetermined condition. In this way, even when the posture changes, change blindness may occur to the user 1. Therefore, by appropriately setting a predetermined condition, it is possible to correct the target object 10 during a rotation operation without the user 1 noticing.

[0091] [Correction triggered by changes in the visual environment] As explained with reference to Figure 3, when discontinuous visual stimuli are presented in the visual environment of user 1, visual change blindness occurs, making it difficult for the user to perceive changes before and after the visual stimulus is applied. In this embodiment, a pattern that generates such discontinuous visual stimuli is detected on the display 30, which is the actual visual environment, to perform correction utilizing change blindness.

[0092] In this embodiment, the display control unit 43 detects a state in which the display of the target object 10 is obstructed as the display state of the target object 10, and controls the display to change the target object 10 into an intermediate object 11 based on the detection result. Here, a state in which the display of the target object 10 is obstructed includes a state in which the target object 10 is not visible (a state in which the target object 10 is occluded) or a state in which the target object 10 is difficult to see.

[0093] For example, the target object 10 may be obscured by other windows or the like being displayed in the GUI (Graphical User Interface) representation (GUI representation on the screen image 35) of the terminal device 100, or the target object 10 may be made difficult to see by a representation that blurs the entire screen (afocus). Also, the target object 10 may become invisible due to light reflection from the display surface 34 itself, etc. In this embodiment, the target object 10 is corrected by utilizing the state in which the display of the target object 10 is obstructed.

[0094] Specifically, the display control unit 43 detects an inhibition area in which the display of the target object 10 is inhibited, and then controls the display 30 to change the target object 10 included in the inhibition area into an intermediate object. Therefore, only when the display of the target object 10 is obstructed, the obstructed target object 10 is selectively corrected. Note that correction is not performed on the target object 10 whose display is not obstructed. This makes it possible to correct only the parts that are difficult for the user 1 to notice, and to secretly realize correction that does not create a sense of incongruity.

[0095] 10 is a schematic diagram showing an example of correction due to occlusion of the target object 10 in the screen image 35. Here, as an example of GUI representation, it is assumed that a pop-up window 26 is displayed on the screen image 35 including the target object 10. 10A to 10C are schematic diagrams illustrating screen images 35 (terminal device 100) before, during, and after the pop-up window 26 is displayed.

[0096] In FIG. 10A, five target objects 10 corresponding to five handwritten characters from "A" to "E" are displayed in a horizontal row. In this state, as shown in FIG. 10B, a pop-up window 26 is displayed in the center of the screen. At this time, in FIG. 10B, the target objects 10 corresponding to "B", "C", and "D" are hidden by the pop-up window 26 and cannot be seen. Note that the target objects 10 corresponding to "A" and "E" remain displayed on the display 30 even while the pop-up window 26 is displayed.

[0097] Here, the display control unit 43 detects a state in which the target object 10 is occluded in the screen image 35. For example, an inhibition region 27 obstructed by the pop-up window 26 is detected. Here, the entire region of the pop-up window 26 is detected as the inhibition region 27. Then, the target objects 10 included in the inhibition region 27 (here, the target objects 10 corresponding to "B", "C", and "D") are identified. In this way, it is detected whether or not there is an occluded target object 10. If there is an occluded target object 10, the object is corrected.

[0098] Specifically, a process is executed to change the target objects 10 included in the inhibition region 27 into the corresponding intermediate objects 11. As a result, as shown in FIG. 10C , after the pop-up window 26 disappears, the intermediate objects 11 corresponding to "B", "C", and "D" are displayed in the areas where the target objects 10 corresponding to "B", "C", and "D" were displayed. It should be noted that the target objects 10 corresponding to "A" and "E" remain displayed on the display 30 even after the pop-up window 26 disappears. In this way, the target object 10 that was hidden by the pop-up window 26 is selectively corrected. Note that, because change blindness occurs due to the display being blocked by the pop-up window 26, the change accompanying the switch from the target object 10 to the intermediate object 11 is not noticeable.

[0099] Alternatively, a state in which the target object 10 is blurred in the screen image 35 may be detected as a state in which the target object 10 is occluded in the screen image 35. For example, when the entire screen is blurred using a predetermined blur filter, the entire screen is detected as an occluded area. Then, while the blur filter is applied, all of the target objects 10 included in the screen image 35 are corrected. Therefore, after the blurring filter is released, the corresponding intermediate object 11 is displayed in place of each target object 10. Even in such a case, it is possible to correct the target object 10 without the user 1 noticing.

[0100] 11 is a schematic diagram showing an example of correction associated with occlusion of target object 10 on display surface 34 of display 30. Here, it is assumed that the brightness of display surface 34 changes due to external light 28 (e.g., sunlight filtering through the trees) emitted from the surrounding environment of user 1, causing target object 10, etc. displayed on display 30, to become invisible. 11A to 11C schematically show a screen image 35 (terminal device 100) before, during, and after irradiation with external light 28. In an actual visual environment, external light 28 is constantly changing, and therefore external light 28 as shown in FIG. 11B is continuously irradiated with varying brightness and area.

[0101] In FIG. 11A, five target objects 10 corresponding to "A" to "E" are displayed side by side in a single horizontal row. In this state, assume that external light 28 is irradiated onto the display surface 34 as shown in FIG. 11B. At this time, in FIG. 11B, the target objects 10 corresponding to "A", "B", and "E" become almost invisible due to the reflection of the external light 28. Note that the target objects 10 corresponding to "C" and "D" are not irradiated with the external light 28.

[0102] Here, the display control unit 43 detects a state in which the display of the target object 10 on the display surface 34 is obstructed. For example, the time and area in which the target graphic momentarily becomes invisible due to irradiation with external light 28 are detected. That is, an obstruction area 27 corresponding to the moment when the target graphic becomes invisible or difficult to see due to external light 28 is detected. The obstruction area 27 is detected as an area on the display surface 34 where the brightness exceeds a predetermined threshold, for example. To detect such a state of the display surface 34, an image of the display surface 34 captured using an external camera or the like is used. Alternatively, an optical sensor or the like provided on the display surface 34 may be used to detect the area illuminated by external light 28. 11, inhibition regions 27 are detected at the same time on the left and right sides of the display surface 34. Target objects 10 included in these inhibition regions 27 (here, target objects 10 corresponding to "A", "B", and "E") are identified. In this way, it is detected whether or not there is a target object 10 whose display is obstructed by the external light 28. If there is a target object 10 whose display is obstructed, the object is corrected.

[0103] 10, a process is executed to change the target objects 10 included in the inhibition region 27 into the corresponding intermediate objects 11. As a result, as shown in FIG. 11C, after the external light 28 is no longer irradiated, the intermediate objects 11 corresponding to "A", "B", and "E" are displayed in the areas where the target objects 10 corresponding to "A", "B", and "E" were displayed. It should be noted that the target objects 10 corresponding to "C" and "D" remain displayed on the display 30 even after the external light 28 has disappeared. In this way, the target object 10 that was obscured by the external light 28 is selectively corrected. Note that, because change blindness occurs when the display is blocked by the external light 28, the change accompanying the switch from the target object 10 to the intermediate object 11 is not noticeable.

[0104] [Correction of hand-drawn illustrations] The above description mainly deals with the process of correcting the handwritten object 20 representing handwritten characters as the target object 10. However, the present technology is not limited to this, and it is also possible to apply the present technology to a handwritten object 20 representing a handwritten image (handwritten illustration).

[0105] FIG. 12 is a schematic diagram showing an example of morphing processing for a hand-drawn illustration. 12A shows a hand-drawn object 20 with the morphing rate set to 0, which is an object that directly represents the hand-drawn image by user 1. Here, a cylindrical illustration is drawn that is curved so that the sides are concave.

[0106] 12C shows an estimated object 22 (reference object) estimated from the handwritten object 20 in FIG. 12A, which is an object with a morphing processing ratio of 1. Here, the shapes of the upper and lower surfaces of the cylindrical illustration are estimated to be ellipses. Also, the curves representing the side surfaces are estimated to be line-symmetric curves connecting to each ellipse.

[0107] 12B shows an intermediate object 11 between the handwritten object 20 and the estimated object 22. The intermediate object 11 is an object in which each part of the illustration (here, the curves that form the upper, lower, and side surfaces) has been corrected based on the estimated object 22 in accordance with the set morphing processing ratio. Even when the handwritten object 20 representing the handwritten image is corrected, the intermediate object 11 is generated so as to approach the estimated object 22 each time the correction is made.

[0108] 13A and 13B are schematic diagrams showing an example of correction of a handwritten illustration. In Fig. 13A, a user 1 performs a movement operation on a target object 10 (for example, the handwritten object 20 shown in Fig. 12A). During this process, the target object 10 is switched to a corresponding intermediate object 11 (for example, the intermediate object 11 shown in Fig. 12B). Specifically, while a movement operation is being performed, a change in the position of the target object 10 is detected, and if it is determined that the change in position satisfies a predetermined condition, the target object 10 is switched to the intermediate object 11 (see FIG. 7). In the example shown in FIG. 13, the timing one frame before the movement operation ends is the correction timing Tc at which the target object 10 is switched to the intermediate object 11.

[0109] In addition, it is also possible to correct the target object 10 representing a hand-drawn illustration when the resizing and rotating operations described with reference to Figures 8 and 9 are performed. Furthermore, as described with reference to Figures 10 and 11, it is also possible to perform correction by utilizing a state in which the display of the target object 10 representing a hand-drawn illustration is obstructed by other objects, external light, etc. In either case, by utilizing the characteristics of change blindness, it is possible to realize correction that is not noticed by the user 1.

[0110] As described above, in the controller 40 according to this embodiment, the target object 10 to be corrected is output by the display 30. Then, depending on the display state of the target object 10 after output, the display 30 is controlled so that the target object 10 changes into an intermediate object 11 between the target object 10 and the corresponding reference object 13. In this way, by changing the target object 10 depending on the display state of the target object 10, it is possible to correct the display without the user 1 noticing.

[0111] For example, in a method that automatically corrects the content entered by the user immediately, the moment the correction is made is obvious, so the user feels that the content they entered has been corrected, which may lead to the user feeling that the corrected displayed content was not what they entered themselves. One way to avoid this situation is to correct the object at the moment when the user is not looking at the object. In this case, the user will perceive the moment when the object is corrected, but while the user is gazing at the object, the object may not be corrected sufficiently.

[0112] In this embodiment, when the terminal device 100 automatically applies correction, the correction of the target object 10 is performed by utilizing the timing of visual change blindness that is not noticed by the user 1. For example, the target object 10 is corrected when the user 1 moves the target object 10 or when the target object 10 becomes difficult to see. This makes the correction of the target object 10 less noticeable, and makes it possible to implicitly correct the target object 10. As a result, even if the input content has been corrected, the user 1 can still perform the input while maintaining the feeling that he or she has actually performed the action.

[0113] Furthermore, even if the user 1 is paying attention to the target object 10, correction is performed at the timing when a movement operation or an enlargement operation is performed on the target object 10. This makes it possible to sufficiently correct the target object 10 without the user 1 noticing, even when, for example, the target object 10 is being edited. As a result, it becomes possible to sufficiently support the input operation, etc., by the user 1 without impairing the sense of the user 1's action.

[0114] <Other embodiments> The present technology is not limited to the above-described embodiments, and various other embodiments can be realized.

[0115] The above description has mainly focused on a terminal device equipped with a touch panel. However, the present technology is not limited to this and can be applied to any display device. For example, a notebook PC equipped with a trackpad or the like, a desktop PC, or the like may be used. In either case, the object to be corrected is corrected according to the display state of the object to be corrected on the display that displays the processing content.

[0116] The above description mainly deals with a method of correcting the strokes of a handwritten object on an object-by-object basis (character or image basis). However, the present invention is not limited to this method, and for example, the strokes that make up a single handwritten object may be corrected individually. For example, if it is detected that some strokes in a handwritten object are difficult to see, it is possible to correct only those strokes.

[0117] In the above example of handwritten input, stroke data was described, but handwritten input allows for a variety of expressions depending on, for example, the writing pressure, stroke, input speed, and the like when inputting. Furthermore, not only monochrome input but also color and other expressions can be expressed. For example, input data including such data may be generated, and the target object 10 that reproduces the pen pressure, brushstrokes, color, and the like may be corrected. For example, the present technology may be applied when the user 1 creates a handwritten sketch, watercolor painting, or the like. In this case, for example, parts that exceed a threshold, parts where the color density changes suddenly, or parts where the line width changes suddenly are implicitly and gradually corrected. In this case, the direction of correction may be automatically recognized by recognizing the input habits of user 1. This allows user 1 to beautifully finish a creation that is uniquely his or her own while maintaining a high sense of action.

[0118] FIG. 14 is a schematic diagram showing an example of correction for an image object. The above description mainly deals with the case of correcting a handwritten object 20 that represents the input result of handwritten input by the user 1. However, the present technology is not limited to this, and may be applied, for example, when correcting an image object 29 displayed on the display 30. 14, an image object 29a displayed at time t1 is corrected to an image object 29b by time tn. In this example, the target object 10 is the image object 29a, and the reference object 13 is another image object 29b different from the image object 29a. The object displayed at time t3 is the intermediate object 11 between the image object 29a and the image object 29b.

[0119] When correcting pixel data (image object 29) such as a photograph or a picture, a morphing process is performed from the pixel data to be corrected (image object 29a) to pixel data (image object 29b) that will be the final correction result. The pixel data morphing process is not, for example, a process such as alpha blending, which simply displays two overlapping images, but rather a process in which the intermediate object 11 stands alone as an image. For example, the image (intermediate object 11) shown at time t3 is an image that can be recognized as a face by itself, and is not an image in which, for example, two faces are displayed overlapping each other.

[0120] In this way, the intermediate object 11 is generated so that the process of change from the target object 10 to the intermediate object 11 cannot be identified. For example, image object 29a and image object 29b are converted into vector data in the same feature space. An image object represented by a point on a path (trajectory) connecting two points represented by each vector is generated as intermediate object 11. Alternatively, intermediate object 11 may be generated by a morphing process using machine learning or the like. This makes it possible to display intermediate object 11 that can stand alone as a single image.

[0121] 14, for example, after an image object 29a is displayed at time t1, a pop-up window 26 is displayed at time t2. At this time, the image object 29a is temporarily hidden by the pop-up window 26. In this way, the image object 29a (target object 10) is switched to the intermediate object 11 at the timing when the image object 29a is hidden.

[0122] Therefore, when the pop-up window 26 disappears at time t3, the intermediate object 11 is displayed in place of the image object 29a. After that, from time t4 to tn, the intermediate object 11 is gradually switched and displayed so as to approach the image object 29b without being noticed. This makes it possible to gradually correct the image object 29 without the user 1 noticing. This makes it possible, for example, to decorate oneself without the other party in communication noticing.

[0123] The above describes a case where the information processing method according to the present technology is executed by a computer such as a terminal device operated by a user. However, the information processing method and the program according to the present technology may be executed by another computer that can communicate with the computer installed in the terminal device via a network or the like.

[0124] In other words, the information processing method and program according to the present technology can be executed not only in a computer system composed of a single computer, but also in a computer system in which multiple computers operate in conjunction with each other. In this disclosure, a system refers to a collection of multiple components (devices, modules (components), etc.), regardless of whether all the components are in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device housed in a single housing and multiple modules, are both systems.

[0125] The execution of the information processing method and program according to the present technology by a computer system includes both cases where a process for controlling a display device to change a target object into an intermediate object is executed by a single computer and cases where each process is executed by a different computer. Furthermore, the execution of each process by a specific computer includes having another computer execute part or all of the process and obtaining the results.

[0126] In other words, the information processing method and program according to the present technology can also be applied to a cloud computing configuration in which a single function is shared and processed jointly by multiple devices via a network.

[0127] It is also possible to combine at least two of the features of the present technology described above. That is, the various features described in each embodiment may be arbitrarily combined without distinction between the embodiments. Furthermore, the various effects described above are merely examples and are not limiting, and other effects may also be achieved.

[0128] In this disclosure, the terms "same," "equal," "orthogonal," etc. are concepts that include "substantially the same," "substantially equal," "substantially orthogonal," etc. For example, they also include states that fall within a predetermined range (e.g., a range of ±10%) based on "completely the same," "completely equal," "completely orthogonal," etc.

[0129] The present technology can also be configured as follows. (1) A display control unit that controls a display device to display a target object to be corrected, and controls the display device to change the target object into an intermediate object between the target object and a reference object corresponding to the target object, depending on a display state of the target object after the target object is displayed. An information processing device comprising: (2) The information processing device according to (1), The display control unit detects the display state that causes visual change blindness in a user who views the target object, and controls the display device to change the target object into the intermediate object in accordance with the timing at which the display state that causes visual change blindness is detected. Information processing device. (3) The information processing device according to (2), The display control unit controls the display device so that the intermediate object approaches the reference object every time the display state that causes the visual change blindness is detected. Information processing device. (4) An information processing device according to any one of (1) to (3), The display control unit detects, as the display state, a state in which a display parameter including at least one of a position, a size, and an attitude of the target object is changing in response to an input operation by a user, and controls the display device to change the target object into the intermediate object based on the detection result. Information processing device. (5) The information processing device according to (4), The input operation by the user includes at least one of a movement operation, a resizing operation, and a rotation operation by the user on the target object. Information processing device. (6) The information processing device according to (4) or (5), The display control unit controls the display device to change the target object into the intermediate object in accordance with the timing at which at least one of the amount of change in the display parameter, the time during which the display parameter is changing, and the rate of change in the display parameter exceeds a predetermined threshold. Information processing device. (7) An information processing device according to any one of (1) to (6), The display control unit detects, as the display state, a state in which display of the target object is obstructed, and controls the display device to change the target object into the intermediate object based on the detection result. Information processing device. (8) The information processing device according to (7), The display control unit generates a screen image to be output from the display device, and detects a state in which the target object is occluded in the screen image or a state in which the target object is blurred in the screen image. Information processing device. (9) The information processing device according to (7) or (8), the display device has a display surface; The display control unit detects a state in which the display of the target object on the display surface is obstructed. Information processing device. (10) An information processing device according to any one of (7) to (9), The display control unit detects an inhibition area in which display of the target object is inhibited, and controls the display device to change the target object included in the inhibition area into the intermediate object. Information processing device. (11) An information processing device according to any one of (1) to (10), The display control unit controls the display device to discontinuously change the target object into the intermediate object. Information processing device. (12) An information processing device according to any one of (1) to (11), The display control unit generates the intermediate object so that the change from the target object to the intermediate object cannot be identified. Information processing device. (13) An information processing device according to any one of (1) to (12), The display control unit generates the intermediate object by performing a morphing process that brings the target object closer to the reference object. Information processing device. (14) The information processing device according to any one of (1) to (13), the target object is a handwritten object representing a result of handwritten input by a user; The reference object is an estimated object obtained by estimating the input content of the handwritten input. Information processing device. (15) The information processing device according to (14), The display control unit generates the intermediate object by performing a morphing process that brings the hand-drawn object closer to the estimated object, and sets a ratio of the morphing process to be applied to the hand-drawn object smaller than a ratio of the morphing process when a result of the morphing process matches the estimated object. Information processing device. (16) The information processing device according to (14) or (15), The handwritten object is at least one of an object representing a character handwritten by the user and an object representing an image handwritten by the user. Information processing device. (17) The information processing device according to any one of (1) to (16), the target object is a first image object; The reference object is a second image object that is different from the first image object. Information processing device. (18) Controlling a display device to display a target object to be corrected, and controlling the display device to change the target object into an intermediate object between the target object and a reference object corresponding to the target object according to a display state of the target object after the target object is displayed. An information processing method implemented by a computer system. (19) A step of controlling a display device to display a target object to be corrected, and controlling the display device to change the target object into an intermediate object between the target object and a reference object corresponding to the target object according to a display state of the target object after the target object is displayed. A computer-readable recording medium on which a program for executing the above is recorded. [Explanation of symbols]

[0130] 1...User 10, 10a, 10b...Target object 11, 11a, 11b...Intermediate objects 13...Reference object 20...Handwritten Objects 22…Estimated Object 27...Inhibition area 29a, 29b...Image objects 30...Display 33...Storage section 34…Display surface 35...Screen image 40...Controller 41...Input detection unit 42...Reference object acquisition unit 43...Display control unit 100...Terminal device

Claims

1. a display control unit that controls a display device to display a target object to be corrected, detects a change blindness-causing display state of the target object after the target object has been displayed, which state causes visual change blindness in a user viewing the target object, and controls the display device to change the target object into an intermediate object between the target object and a reference object corresponding to the target object in accordance with the timing at which the change blindness-causing display state is detected. Equipped with The display control unit detects, as the change blindness occurrence display state, a state in which a display parameter including at least one of a position, a size, and an orientation of the target object is changed in response to an input operation by a user, and controls the display device to change the target object into the intermediate object based on the detection result. Information processing device.

2. 2. The information processing device according to claim 1, The display control unit controls the display device so that the intermediate object approaches the reference object every time the change blindness occurrence display state is detected. Information processing device.

3. 2. The information processing device according to claim 1, The input operation by the user includes at least one of a movement operation, a resizing operation, and a rotation operation by the user on the target object. Information processing device.

4. 2. The information processing device according to claim 1, The display control unit controls the display device to change the target object into the intermediate object in accordance with a timing at which at least one of the amount of change in the display parameter, the time during which the display parameter is changing, and the rate of change in the display parameter exceeds a predetermined threshold. Information processing device.

5. 2. The information processing device according to claim 1, The display control unit detects a state in which display of the target object is obstructed as the change blindness occurrence display state, and controls the display device to change the target object into the intermediate object based on the detection result. Information processing device.

6. 6. The information processing device according to claim 5, The display control unit generates a screen image to be output from the display device, and detects a state in which the target object is occluded in the screen image or a state in which the target object is blurred in the screen image. Information processing device.

7. 6. The information processing device according to claim 5, the display device has a display surface; The display control unit detects a state in which the display of the target object on the display surface is obstructed. Information processing device.

8. 6. The information processing device according to claim 5, The display control unit detects an inhibition area in which display of the target object is inhibited, and controls the display device to change the target object included in the inhibition area into the intermediate object. Information processing device.

9. 2. The information processing device according to claim 1, The display control unit controls the display device to discontinuously change the target object into the intermediate object. Information processing device.

10. 2. The information processing device according to claim 1, The display control unit generates the intermediate object so that the change from the target object to the intermediate object cannot be identified. Information processing device.

11. 2. The information processing device according to claim 1, The display control unit generates the intermediate object by performing a morphing process that brings the target object closer to the reference object. Information processing device.

12. 2. The information processing device according to claim 1, the target object is a handwritten object representing a result of handwritten input by a user; The reference object is an estimated object obtained by estimating the input content of the handwritten input. Information processing device.

13. 13. The information processing device according to claim 12, The display control unit generates the intermediate object by performing a morphing process that brings the hand-drawn object closer to the estimated object, and sets a ratio of the morphing process to be applied to the hand-drawn object smaller than a ratio of the morphing process when a result of the morphing process matches the estimated object. Information processing device.

14. 13. The information processing device according to claim 12, The handwritten object is at least one of an object representing a character handwritten by the user and an object representing an image handwritten by the user. Information processing device.

15. 2. The information processing device according to claim 1, the target object is a first image object; The reference object is a second image object different from the first image object. Information processing device.

16. a display control step of controlling a display device to display a target object to be corrected, detecting a change blindness-causing display state that is a display state of the target object after the target object has been displayed and that causes visual change blindness in a user viewing the target object, and controlling the display device to change the target object into an intermediate object between the target object and a reference object corresponding to the target object in accordance with the timing at which the change blindness-causing display state is detected; An information processing method executed by a computer system, The display control step detects, as the change blindness occurrence display state, a state in which a display parameter including at least one of a position, a size, and an orientation of the target object is changed in response to an input operation by a user, and controls the display device to change the target object into the intermediate object based on the detection result. Information processing methods.

17. a display control step of controlling a display device to display a target object to be corrected, detecting a change blindness-causing display state that is a display state of the target object after the target object has been displayed and that causes visual change blindness in a user viewing the target object, and controlling the display device to change the target object into an intermediate object between the target object and a reference object corresponding to the target object in accordance with the timing at which the change blindness-causing display state is detected; A computer-readable recording medium on which a program for executing the above is recorded, The display control step detects, as the change blindness occurrence display state, a state in which a display parameter including at least one of a position, a size, and an orientation of the target object is changed in response to an input operation by a user, and controls the display device to change the target object into the intermediate object based on the detection result. A computer-readable recording medium.

18. a display control unit that controls a display device to display a target object to be corrected, detects a change blindness-causing display state of the target object after the target object has been displayed, which state causes visual change blindness in a user viewing the target object, and controls the display device to change the target object into an intermediate object between the target object and a reference object corresponding to the target object in accordance with the timing at which the change blindness-causing display state is detected. Equipped with the display device has a display surface; the display control unit generates a screen image to be output from the display device; The display control unit detects, as the change blindness occurrence display state, a state in which display of the target object is obstructed, such as a state in which the target object is occluded in the screen image, a state in which the target object is blurred in the screen image, or a state in which display of the target object is obstructed on the display surface, and controls the display device to change the target object into the intermediate object based on the detection result. Information processing device.

19. a display control step of controlling a display device to display a target object to be corrected, detecting a change blindness-causing display state that is a display state of the target object after the target object has been displayed and that causes visual change blindness in a user viewing the target object, and controlling the display device to change the target object into an intermediate object between the target object and a reference object corresponding to the target object in accordance with the timing at which the change blindness-causing display state is detected; An information processing method executed by a computer system, The display control step detects, as the change blindness occurrence display state, a state in which the display of the target object is obstructed, such as a state in which the target object is occluded in a screen image that is an output of the display device, a state in which the target object is blurred in the screen image, or a state in which the display of the target object is obstructed on a display surface of the display device, and controls the display device to change the target object into the intermediate object based on the detection result. Information processing methods.

20. a display control step of controlling a display device to display a target object to be corrected, detecting a change blindness-causing display state that is a display state of the target object after the target object has been displayed and that causes visual change blindness in a user viewing the target object, and controlling the display device to change the target object into an intermediate object between the target object and a reference object corresponding to the target object in accordance with the timing at which the change blindness-causing display state is detected; A computer-readable recording medium on which a program for executing the above is recorded, The display control step detects, as the change blindness occurrence display state, a state in which the display of the target object is obstructed, such as a state in which the target object is occluded in a screen image that is an output of the display device, a state in which the target object is blurred in the screen image, or a state in which the display of the target object is obstructed on a display surface of the display device, and controls the display device to change the target object into the intermediate object based on the detection result. A computer-readable recording medium.

Images