Processing device, processing method, and program

Abstract

To make the subject's eyes move naturally. [Solution] A processing device 10 of the present disclosure has a micro movement control unit 11 that causes the pupil of the drawing target to perform a first operation of repeating micro movements. The micro movement control unit 11 determines an allowed area that is allowed as a destination of the pupil in the micro movement and an excluded area that is excluded as a destination of the pupil in the micro movement. The micro movement control unit 11 then determines the destination of the pupil in the micro movement from among areas within the allowed area and outside the excluded area, and repeats the process of moving the pupil to the determined destination.

Description

[Technical field]

[0001] The present disclosure relates to a processing device, a processing method, and a program. [Background technology]

[0002] Even when the human eye is fixed, it performs minute eye movements called microsaccades. Characters and avatars are drawn on game screens and various UI (user interface) screens, and by making the characters and avatars perform these eye movements, it becomes possible to draw them more realistically.

[0003] Related technology is disclosed in Non-Patent Document 1. Non-Patent Document 1 discloses a technology for making a character perform microsaccades. This technology generates the eye movement using a probabilistic model. When performing fixational eye movement, the duration is determined first, and then the time interval between microsaccades is calculated, and the number of microsaccades that will occur during one fixational eye movement is determined. The direction of fixational eye movement is determined by random numbers so that it is uniform within a 360° range, since no significant bias was observed when averaging the observation results of the entire subjects. [Prior art documents] [Non-patent literature]

[0004] [Non-Patent Document 1] Tomoyo Iwao and 4 others, "Analysis and synthesis of eye movements during dialogue based on a probabilistic model," [online], The Journal of the Institute of Image Electronics Engineers of Japan Vol. 42 No. 5 (2013), pp. 661-670, [Retrieved January 11, 2024], Internet,<URL:https: / / www.jstage.jst.go.jp / article / iieej / 42 / 5 / 42_661 / _pdf> Summary of the Invention [Problem to be solved by the invention]

[0005] As described above, in Non-Patent Document 1, the direction of fixational eye movement is determined by random numbers so that it is uniform within a range of 360°, since no significant bias was observed when averaging the observation results of all subjects. In other words, in Non-Patent Document 1, the content of the character's microsaccade is determined so that it is similar to the observation results of fixational eye movement of a human (subject).

[0006] However, the appearance of human eyes and the eyes of a character or avatar may differ. For example, the eyes of a character or avatar may take up a larger proportion of the entire face than human eyes. Also, the pupil (black part of the eye (including the pupil and iris; same below)) of a character or avatar may be a larger proportion of the entire eye than human eyes. Also, the shape of the pupil (black part of the eye) of a character or avatar may differ from the shape of a human's pupil (black part of the eye). For example, the shape of the pupil of a character or avatar may be vertically elongated.

[0007] For example, there are differences in appearance between the eyes of a human being and the eyes of a character or avatar, such as the above. For this reason, if a character or avatar were to perform microsaccades that are actually performed by the human eye, it may look unnatural.

[0008] In view of the above-mentioned problems, an example of an objective of the present disclosure is to provide a processing device, a processing method, and a program that cause the pupils of a drawing target to move in a natural manner. [Means for solving the problem]

[0009] According to the present disclosure, Computer, functioning as a minute movement control means for causing the pupil of the drawing target to perform a first operation of repeating minute movements; The fine movement control means includes: determining an allowed area that is allowed as a destination of the pupil during the minute movement and an excluded area that is excluded as a destination of the pupil during the minute movement; A program is provided that repeats a process of determining a destination of the pupil in the minute movement from within the permitted area and outside the excluded area, and moving the pupil to the determined destination.

[0010] Further, according to the present disclosure, a minute movement control unit that causes a first operation of repeating minute movements to be performed on a pupil of a drawing target; The fine movement control unit includes: determining an allowed area that is allowed as a destination of the pupil during the minute movement and an excluded area that is excluded as a destination of the pupil during the minute movement; A processing device is provided that determines a destination of the pupil in the minute movement from within the permitted area and outside the excluded area, and repeats the process of moving the pupil to the determined destination.

[0011] Further, according to the present disclosure, One or more computers A micro-movement control step is carried out to cause the pupil of the drawing target to perform a first operation of repeating micro-movements; In the fine movement control step, determining an allowed area that is allowed as a destination of the pupil during the minute movement and an excluded area that is excluded as a destination of the pupil during the minute movement; There is provided a processing method for determining a destination of the pupil in the minute movement from within the permitted area and outside the excluded area, and repeating the process of moving the pupil to the determined destination. Effect of the Invention

[0012] According to one aspect of the present disclosure, a processing device, a processing method, and a program are provided that cause a drawing target to perform natural pupil movement. [Brief description of the drawings]

[0013] [Figure 1] FIG. 2 illustrates an example of a functional block diagram of a processing device according to the present disclosure. [Diagram 2]FIG. 2 is a diagram illustrating an example of a hardware configuration of a processing device according to the present disclosure. [Diagram 3] FIG. 13 is a diagram illustrating another example of a functional block diagram of a processing device according to the present disclosure. [Figure 4] FIG. 10 is a diagram illustrating an example of a screen displayed by the processing device according to the present disclosure. [Diagram 5] FIG. 2 is a diagram for explaining processing of a processing device according to the present disclosure. [Figure 6] FIG. 11 is another diagram for explaining the processing of the processing device according to the present disclosure. [Figure 7] FIG. 11 is another diagram for explaining the processing of the processing device according to the present disclosure. [Figure 8] FIG. 11 is another diagram for explaining the processing of the processing device according to the present disclosure. [Figure 9] FIG. 11 is another diagram for explaining the processing of the processing device according to the present disclosure. [Figure 10] 1 is a flowchart illustrating an example of a processing flow of a processing device according to the present disclosure. [Figure 11] FIG. 11 is another diagram for explaining the processing of the processing device according to the present disclosure. [Figure 12] 13 is a flowchart showing another example of the processing flow of the processing device according to the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In the present disclosure, the drawings relate to one or more embodiments. In all the drawings, similar components are denoted by similar reference numerals, and descriptions thereof will be omitted as appropriate.

[0015] <<First embodiment>> 1 is a functional block diagram showing an overview of a processing device 10. As shown in FIG.

[0016] The minute movement control unit 11 causes the pupil of the drawing target to perform a first movement of repeating minute movements. The first movement is a movement simulating a microsaccade.

[0017] Specifically, the minute movement control unit 11 determines an allowed area that is allowed as a destination of the pupil during the minute movement and an excluded area that is excluded as a destination of the pupil during the minute movement. The minute movement control unit 11 then determines the destination of the pupil during the minute movement from among areas within the allowed area and outside the excluded area, and repeats the process of moving the pupil to the determined destination.

[0018] With such a processing device 10, the destination of the pupil during slight movement can be controlled to some extent by using the permitted area and excluded area. By controlling the destination of the pupil during slight movement to some extent, it becomes possible to make the pupil of the drawing subject move in a natural manner.

[0019] <<Second embodiment>> <Summary> The processing apparatus 10 of the second embodiment is a specific embodiment of the configuration of the processing apparatus 10 of the first embodiment, which will be described in detail below.

[0020] <Hardware configuration> An example of the hardware configuration of the processing device 10 will be described. Each functional unit of the processing device 10 is realized by any combination of hardware and software. Those skilled in the art will understand that there are various variations in the realization method and device. The software includes programs that are stored in the device before it is shipped, and programs downloaded from recording media such as CDs (Compact Discs) and servers on the Internet.

[0021] Fig. 2 is a block diagram illustrating a hardware configuration of the processing device 10. As shown in Fig. 2, the processing device 10 has a processor 1A, a memory 2A, an input / output interface 3A, a peripheral circuit 4A, and a bus 5A. The peripheral circuit 4A includes various modules. The processing device 10 does not have to have the peripheral circuit 4A. The processing device 10 may be composed of multiple devices that are physically and / or logically separated. In this case, each of the multiple devices can have the above hardware configuration.

[0022] The bus 5A is a data transmission path for the processor 1A, the memory 2A, the peripheral circuit 4A, and the input / output interface 3A to transmit and receive data to each other. The processor 1A is, for example, a central processing unit (CPU) or a graphics processing unit (GPU). The memory 2A is, for example, a random access memory (RAM) or a read only memory (ROM). The input / output interface 3A includes an interface for acquiring information from an input device, an external device, an external server, an external sensor, a camera, etc., and an interface for outputting information to an output device, an external device, an external server, etc. The input / output interface 3A also includes an interface for connecting to a communication network such as the Internet. The input device is, for example, a keyboard, a mouse, a microphone, a physical button, a touch panel, a controller dedicated to a game machine, etc. The output device is, for example, a display, a projection device, a speaker, a printer, a mailer, etc. The processor 1A can issue commands to each module and perform calculations based on the results of those calculations.

[0023] <Functional configuration> An example of the functional configuration of the processing device 10 will be described. An example of a functional block diagram of the processing device 10 is shown in Fig. 3. As shown in the figure, the processing device 10 has a display control unit 13. The display control unit 13 has a minute movement control unit 11 and a normal movement control unit 12.

[0024] The display control unit 13 causes an output device to output a screen showing the drawing target.

[0025] The "drawing subject" is a concept that includes at least one of a character and an avatar.

[0026] A "screen" is a screen that includes a drawing target and provides various information to a user.

[0027] An example of a screen is a game screen showing a scene from a game. The game screen can be realized using any well-known technology.

[0028] Another example of the screen is a UI screen that provides various kinds of guidance to the user. An example of such a UI screen is a UI screen for a chat service. Other examples include a UI screen that outputs various kinds of guidance prepared in advance according to a user's selection. In one example, in such a UI screen, the drawing target is displayed as a concierge or the like. Such a UI screen may be provided by an application (software), may be provided by a web page, may be provided by a dedicated system, or may be provided by other means.

[0029] It should be noted that the screens illustrated here are merely examples and are not limited to these examples.

[0030] The display control unit 13 may generate a screen and cause the output device to output the generated screen. Alternatively, the display control unit 13 may receive a screen from an external device and cause the output device to output the received screen.

[0031] In one example, the processing device 10 is an operation terminal operated by a user. In this example, the operation terminal (processing device 10) includes a display control unit 13. The display control unit 13 generates a screen and causes the generated screen to be output to an output device included in the operation terminal (processing device 10) or an output device connected to the operation terminal (processing device 10).

[0032] The term "terminal device" refers to a game device, a smartphone, a tablet terminal, a personal computer, a mobile phone, a terminal dedicated to a service installed in a facility, etc., but is not limited to these.

[0033] In another example, the processing device 10 is a client terminal operated by a user. In this example, the client terminal (processing device 10) includes a display control unit 13. The display control unit 13 receives a screen from the server and outputs the received screen to an output device included in the client terminal (processing device 10) or an output device connected to the client terminal (processing device 10).

[0034] The "client terminal" may be, but is not limited to, a game device, a smartphone, a tablet terminal, a personal computer, a mobile phone, a terminal dedicated to a service installed in a facility, etc. The client terminal operates in conjunction with the server.

[0035] In another example, the processing device 10 is a server. In this example, the server (processing device 10) includes a display control unit 13. The display control unit 13 generates a screen and causes the generated screen to be output to a client terminal (output device).

[0036] Fig. 4 shows an example of a screen output by the display control unit 13 to the output device. The illustrated screen includes a drawing target C. Note that, in the example screen of Fig. 4, a drawing target C with a close-up of the face is included, but the drawing target may be included so that the whole body is visible, or so that only the upper body is visible (i.e., the lower body is not visible), or may be included in other forms.

[0037] Returning to FIG. 3, the micro movement control unit 11 causes the pupil of the drawing target to perform a first operation of repeating micro movements. The first operation is an operation simulating a microsaccade. The normal movement control unit 12 moves the pupil by normal movement. The normal movement is a movement different from the micro movement of the first operation, and is, for example, a movement of the pupil caused by a change in the line of sight of the drawing target. By coordinating the micro movement control unit 11 and the normal movement control unit 12 in this way, it is possible to cause the pupil of the drawing target to perform a natural movement. This will be explained in detail below.

[0038] The normal movement control unit 12 moves the pupil of the drawing target included on the screen by normal movement.

[0039] As shown in FIG. 4, the black part of the eye is the pupil e in this embodiment.

[0040] The normal movement control unit 12 manages the position of the pupil e. When an event occurs that moves the position of the pupil e by normal movement, the normal movement control unit 12 determines a destination of the pupil e, and moves the pupil e to the determined destination.

[0041] The position of the pupil e can be managed by various methods, and any method can be adopted, but in this embodiment, the position ec of the center of the pupil e (see FIG. 5) is managed. That is, the "position of the pupil e" managed in this embodiment is the "position ec of the center of the pupil e."

[0042] The "normal movement" is a movement different from the minute movement of the first operation, that is, the minute movement realized by the control by the minute movement control unit 11. The normal movement is, for example, a movement of the pupil caused by a change in the line of sight due to the drawing subject. The normal movement is realized by a control different from the control that realizes the minute movement of the first operation.

[0043] An "event for moving the position of the pupil e by normal movement" (hereinafter, may be referred to as a "normal movement event") may occur in response to a user input, for example. The normal movement event may occur at a period longer than the period for performing the minute movement of the first operation.

[0044] In one example, the user performs various inputs via an input device. This input may be an input related to the progress of the game, an input for operating a drawing object displayed on the screen, an input for touching an operation object (such as a button or other object) displayed on the screen, an input for selecting at least one of presented options, or any other input.

[0045] When the user input as described above is performed, the normal movement control unit 12 determines whether the user input satisfies a condition for generating a normal movement event. If the condition is satisfied, the normal movement control unit 12 generates a normal movement event. The condition is determined in advance.

[0046] In this example, the normal movement control unit 12 determines the destination of the pupils in response to the user input. The algorithm for determining the destination of the pupils based on the user input is a design matter. For example, if the user input is an input to change the line of sight of the drawing target, the normal movement control unit 12 may determine the destination of the pupils based on that input. Alternatively, if the user input is an input to touch an operation target (such as a button or other object) displayed on the screen, the normal movement control unit 12 may determine the destination of the pupils so as to direct the gaze towards the touched operation target.

[0047] Alternatively, the normal movement event may occur in response to a user's action. In this example, the normal movement control unit 12 monitors the user's action using a device such as a camera, a microphone, or a radar. When the normal movement control unit 12 detects that the user has performed a predetermined action, it generates a normal movement event accordingly.

[0048] In this example, the normal movement control unit 12 determines the destination of the pupils according to the detected user's motion. The algorithm for determining the destination of the pupils based on the detected user's motion is a design matter. For example, the normal movement control unit 12 may detect a body part of the user that has moved, and determine the destination of the pupils so as to direct the gaze of the drawing target in the direction of that body part.

[0049] Note that the manner in which the normal movement event occurs and the manner in which the destination of the pupil during normal movement is determined as described here are merely examples, and normal movement of the pupil of the drawing target can be achieved using any other widely known method.

[0050] 5 and 6 show an example in which the pupil e of a drawing target included on the screen is moved by normal movement. FIG. 5 shows the state before normal movement, and FIG. 6 shows the state in which the pupil e has been moved to the destination determined as described above (state in which normal movement is completed). It takes several frames to move the pupil e from the state in FIG. 5 to the state in FIG. 6. That is, in normal movement, it is possible to move the pupil e to the determined destination over one to several frames. As shown in FIG. 5 and FIG. 6, the movement distance of the pupil e in normal movement may be large. In this respect, normal movement differs from the minute movement of the first operation in which the movement distance is limited.

[0051] Hereinafter, the destination of the normal movement determined by normal movement control unit 12 will be referred to as the "reference position." The pupil of the drawing target transitions between the multiple reference positions determined by the normal movement. Then, the pupil of the drawing target performs the slight movement of the first operation at each reference position.

[0052] Returning to FIG. 3, the minute movement control unit 11 causes the pupil of the drawing target to perform a first operation of repeating minute movements.

[0053] Specifically, the minute movement control unit 11 determines an allowed area that is allowed as a destination of the pupil in the minute movement of the first action, and an excluded area that is excluded as a destination of the pupil in the minute movement of the first action.The minute movement control unit 11 then determines the destination of the pupil in the minute movement of the first action from among areas within the allowed area and outside the excluded area, and repeats the process of moving the pupil to the determined destination.

[0054] Here, a method for determining the permitted area will be described.

[0055] When the minute movement control unit 11 causes the pupil at the first reference position in the above-mentioned normal movement to perform the first action, the minute movement control unit 11 determines an allowed area based on the first reference position. Specifically, the minute movement control unit 11 determines the interior of a predetermined area centered on the first reference position as the allowed area. The shape and size of the predetermined area are determined in advance. In one example, the predetermined area is a circle, and the radius of the circle is determined in advance. As described above, the pupil of the drawing target transitions between multiple reference positions determined in the normal movement. The first reference position is the reference position where the pupil of the drawing target is currently located.

[0056] The permitted area is illustrated using Figure 7. Figure 7 shows the pupil e after it has been moved to position ec1 by normal movement. The reference position at this time is position ec1. In this case, the minute movement control unit 11 determines the inside of a predetermined area centered on this reference position (position ec1), for example the inside of a circle of a predetermined radius centered on this reference position (position ec1), as the permitted area a.

[0057] As described above, the permitted area a is determined based on the "reference position (position ec1)" which is the destination of the normal movement. Therefore, while there is no movement of the pupil e due to the normal movement, the position of the permitted area a does not change. In other words, even if the pupil e moves due to the slight movement of the first operation, the position of the permitted area a does not change unless there is movement of the pupil e due to the normal movement. In this way, by determining the permitted area a based on the "reference position (position ec1)" which is the destination of the normal movement, it is possible to suppress the inconvenience that the position of the pupil e changes significantly due to repeated slight movements of the first operation.

[0058] Next, a method for determining the excluded area will be described.

[0059] The micro movement control unit 11 determines the exclusion area based on the current position of the pupil. Specifically, the micro movement control unit 11 determines the inside of a predetermined area centered on the current position of the pupil as the exclusion area. If the micro movement of the first operation has not been performed even once after the normal movement, the current position is the reference position after the normal movement. On the other hand, if the micro movement of the first operation has been performed at least once after the normal movement, the current position is the position of the pupil after the micro movement.

[0060] The shape and size of the predetermined area for determining the excluded area are predetermined. In one example, the predetermined area here is a horizontally long ellipse, and the shape and size of the horizontally long ellipse are predetermined. The predetermined area here may be another shape, such as a vertically long ellipse or a circle. However, the inventors have confirmed that when the excluded area is a horizontally long ellipse, the pupil of the drawing target can be made to move more naturally than when the excluded area is made to have another shape. For example, when the shape of the pupil of the drawing target is vertically long, by making the excluded area a horizontally long ellipse, the inventors have confirmed that the pupil of the drawing target can be made to move more naturally than when the excluded area is made to have another shape. The shape of the excluded area can be adjusted according to the design of the drawing target, etc.

[0061] The exclusion area is illustrated using Figure 7. Figure 7 shows pupil e which has not undergone any micro-movement of the first operation after moving to position ec1 by normal movement. The current position at this time is position ec1. In this case, the micro-movement control unit 11 determines the inside of a predetermined area centered on this current position (position ec1), for example, the inside of a horizontally elongated ellipse of a predetermined shape and a predetermined size centered on this current position (position ec1), as the exclusion area f.

[0062] As described above, the exclusion area f is determined based on the current position, which changes due to the normal movement and the micro movement of the first action. Therefore, the position of the exclusion area f changes every time there is a change due to the normal movement and the micro movement of the first action. In this way, by determining the exclusion area f as a predetermined area centered on the current position based on the "current position," it is possible to move a certain distance or more with each micro movement.

[0063] Next, a process for determining the movement destination of the pupil in the slight movement of the first operation from within the permitted area and outside the excluded area will be described.

[0064] In the example of Fig. 7, the areas within the permitted area a and outside the excluded area f are shaded areas. The slight movement control unit 11 randomly determines the destination of the pupil e in the slight movement of the first operation from among the shaded areas. For example, the destination d is determined as shown in Fig. 8.

[0065] The minute movement control unit 11 may determine a movement destination that does not satisfy a predetermined prohibition condition from within an area that is within the permitted area and outside the excluded area.

[0066] The prohibited condition is that the angle between the line connecting the current position of the pupil and the destination and the predetermined direction is less than a reference angle. The inventor discovered that moving the pupil of the drawing target in a predetermined direction by the small movement of the first operation may look unnatural. By setting such a prohibited condition, it is possible to suppress the inconvenience of moving the pupil of the drawing target in a predetermined direction, i.e., a direction that looks unnatural, by the small movement of the first operation.

[0067] The direction of pupil movement that looks unnatural with the slight movement of the first operation is, for example, the up-down direction of the pupil (which can also be expressed as the up-down direction of the eye or the up-down direction of the face). In this case, the prohibition condition can be that the angle between the line connecting the current position of the pupil and the destination and the up-down direction of the pupil (which can also be expressed as the up-down direction of the eye or the up-down direction of the face) is less than a reference angle. The direction in which pupil movement is prohibited can be determined according to the design of the drawing object, etc.

[0068] After determining the destination of the pupil in the micro-movement of the first operation as described above, the micro-movement control unit 11 moves the pupil to the determined destination. The distance of movement of the pupil in the micro-movement of the first operation is limited by the permitted area and is a relatively small value. Therefore, the micro-movement control unit 11 can move the pupil to the determined destination in one frame or an equivalently small number of frames. The micro-movement control unit 11 may control the movement in a fixed time (one frame or an equivalently small number of frames) without varying the time spent moving the pupil to the determined destination depending on the distance of the micro-movement.

[0069] After the destination d is determined as shown in Fig. 8, the state in which the pupil e is moved to the determined destination d is shown in Fig. 9. In Fig. 9, the position ec2 of the pupil e (the position of the center of the pupil e) coincides with the destination d.

[0070] When determining the destination of the next minute movement after the minute movement shown in FIG. 9, the minute movement control unit 11 determines the permitted area a and excluded area f as shown in FIG.

[0071] As described above, permitted area a is determined based on the "reference position (position ec1)" which is the destination of normal movement. For this reason, even if pupil e moves due to the slight movement of the first operation, the position of permitted area a will not change if pupil e does not move due to normal movement. Comparing Figure 8, which shows the state before the slight movement of the first operation, with Figure 9, which shows the state after the slight movement of the first operation, it can be seen that the position of permitted area a has not changed.

[0072] As described above, the exclusion area f is determined based on the current position that changes due to normal movement and the slight movement of the first motion. Therefore, when the pupil e moves due to the slight movement of the first motion, the position of the exclusion area f changes. Comparing Fig. 8, which shows the state before the slight movement of the first motion, with Fig. 9, which shows the state after the slight movement of the first motion, it can be seen that the position of the exclusion area f has changed.

[0073] When determining the destination of the next micro-movement after the micro-movement shown in Fig. 9, the micro-movement control unit 11 randomly determines the destination of the pupil e in the next micro-movement from among the areas indicated by diagonal lines that are within the permitted area a and outside the excluded area f shown in Fig. 9. Comparing Fig. 8, which shows the state before the micro-movement of the first operation, with Fig. 9, which shows the state after the micro-movement of the first operation, it can be seen that the area to which the pupil can be moved in the next micro-movement (area indicated by diagonal lines) changes in response to the micro-movement.

[0074] The minute movement control unit 11 generates an event (hereinafter, may be referred to as a "first operation event") that causes the pupil of the drawing target to perform a first operation at a predetermined timing. Then, in response to the occurrence of the first operation event, the minute movement control unit 11 causes the pupil of the drawing target to perform the first operation.

[0075] For example, the micro movement control unit 11 generates a first operation event once every predetermined time. The predetermined time is several seconds (e.g., 2 to 4 seconds). The predetermined time may be randomly determined within a range of several seconds (e.g., 2 to 4 seconds). In this case, the micro movement control unit 11 randomly determines, within a predetermined time, the time interval for generating the next micro movement after performing a certain micro movement. Then, the micro movement control unit 11 generates the first operation event in response to the elapse of the determined time. The micro movement control unit 11 can randomly determine, within a predetermined time, the time interval for generating the next micro movement for each micro movement.

[0076] Although detailed description will be omitted, the display control unit 13 may have a control unit that controls the movement of other parts of the drawing target (eyebrows, nose, mouth, hands, arms, legs, etc.).

[0077] Next, an example of the flow of processing of the processing device 10 implemented by the minute movement control unit 11 will be described with reference to the flowchart of FIG.

[0078] The processing device 10 waits for the occurrence of a first operational event (S10).

[0079] When a first action event occurs (Yes in S10), the processing device 10 determines a movement destination of the pupil in the small movement of the first action based on the permitted area and the excluded area (S11). Then, the processing device 10 moves the pupil to the determined movement destination (S12).

[0080] Thereafter, unless an instruction to end the process is given (No in S13), the processing device 10 repeats the same process.

[0081] The permitted area and the excluded area may be determined before the first operation event occurs, or may be determined after the first operation event occurs.

[0082] 10, the processing device 10 may perform S11 before the occurrence of a first action event and determine the movement destination of the pupil in the next small movement of the first action. Then, when the first action event occurs (Yes in S10), the processing device 10 may move the pupil to the movement destination determined in advance (S12).

[0083] "Action and effect" The processing device 10 of this embodiment achieves the same effects as the processing device 10 of the first embodiment. That is, the processing device 10 of this embodiment can cause the pupil of the drawing target to perform a natural first movement (movement simulating a microsaccade).

[0084] Furthermore, by determining the permitted area and excluded area using a distinctive method such as the processing device 10 of this embodiment, it is possible to perform small movements of a sufficient distance in the first operation while suppressing the inconvenience of the position of the pupil e changing significantly due to repeated small movements in the first operation.

[0085] Furthermore, as with the processing device 10 of this embodiment, by using conditions (prohibited conditions) that prohibit the destination of the pupil during the micro-movement of the first action to determine the destination of the pupil during the micro-movement of the first action, it is possible to cause the pupil to perform a natural first action (action simulating a microsaccade).

[0086] <<Third embodiment>> The processing device 10 of this embodiment can cause the pupil of the drawing target to perform a plurality of successive micro-movements in response to the occurrence of one first operation event. The processing device 10 of this embodiment has a characteristic configuration for making such a plurality of successive micro-movements into natural movements. This will be described in detail below.

[0087] The minute movement control unit 11 can cause the pupil of the drawing target to perform a plurality of successive minute movements in response to the occurrence of one first action event.

[0088] "Multiple times" means two or more times. However, the inventors have confirmed that performing two small movements in succession is the most natural motion, and performing three or more small movements in succession may result in a somewhat unnatural motion. For this reason, it is preferable to perform two small movements in succession in response to the occurrence of one first motion event.

[0089] The time interval between successive micro-movements is less than 1 second, for example, about 0.4 to 0.8 seconds. The micro-movement control unit 11 can perform a second micro-movement after the time has elapsed from the timing when the first micro-movement ended. The time interval between successive micro-movements may be fixed or variable. If it varies, the micro-movement control unit 11 may determine the time interval randomly within a predetermined time.

[0090] The micro-movement control unit 11 may randomly determine the number of micro-movements to be performed in response to the occurrence of one first action event. When the number of micro-movements to be performed in response to the occurrence of one first action event is one or two, the micro-movement control unit 11 randomly determines the number of times from among these options. The micro-movement control unit 11 can randomly determine the number of micro-movements to be performed in response to each occurrence of a first action event for each occurrence of a first action event. Then, the micro-movement control unit 11 can cause the pupil of the drawing target to perform the determined number of micro-movements in response to the occurrence of one first action event.

[0091] An example of this is shown in Fig. 11. Fig. 11 shows occurrence timings of first motion events and execution timings of minute movements executed in response to each of the first motion events.

[0092] As described in the second embodiment, the time interval between successive first motion events can be determined randomly within a predetermined time, so the lengths of t1, t2, and t3 in the figure are different from each other.

[0093] In the illustrated example, two successive micro movements are performed in response to the occurrence of the first first motion event in the figure. The time interval t4 between the two successive micro movements is shorter than the time intervals t1, t2, and t3 between the successive first motion events.

[0094] In the illustrated example, one minute movement is performed in response to the occurrence of the second first motion event in the figure, and one minute movement is performed in response to the occurrence of the third first motion event in the figure.

[0095] In the illustrated example, two successive micro movements are performed in response to the occurrence of the fourth first motion event in the figure. The time interval t5 between the two successive micro movements is shorter than the time intervals t1, t2, and t3 between the successive first motion events. As described above, t4 and t5 may be the same (fixed) or different (variable).

[0096] Next, a feature for making the first motion a natural motion when small movements are performed multiple times in succession in response to the occurrence of one first motion event will be described.

[0097] When the micro movement control unit 11 performs micro movements multiple times in succession in response to one first operation event, when determining the destination of the pupil in the second or subsequent micro movements, the size of the permitted area and excluded area is made smaller than the permitted area and excluded area when determining the destination of the pupil in the first micro movement. Hereinafter, the permitted area and excluded area when determining the destination of the pupil in the first micro movement are referred to as the "first permitted area" and "first excluded area." And, the permitted area and excluded area when determining the destination of the pupil in the second or subsequent micro movement are referred to as the "second or subsequent permitted area" and "second or subsequent excluded area."

[0098] For example, the minute movement control unit 11 can set the size of the permitted area and excluded area from the second time onwards to half the size of the permitted area and excluded area from the first time. Note that the center of the first permitted area and the center of the permitted area from the second time onwards are the same, and only the size is different. The first excluded area and the second excluded area from the second time onwards have different centers and sizes.

[0099] By making the allowed area from the second time onwards smaller than the allowed area for the first time in this way, it is possible, with a certain probability, to bring the pupil position closer to the reference position (the centre of the allowed area) with small movements from the second time onwards.

[0100] Furthermore, by making the second and subsequent exclusion areas smaller than the first exclusion area, it is possible, with a certain probability, to make the pupil movement distance in the second and subsequent micro-movements smaller than the pupil movement distance in the first micro-movement.

[0101] The inventors have confirmed that by performing such movements in multiple successive small movements, it is possible to cause the pupil of the subject to be imaged to perform a natural first movement (movement simulating a microsaccade).

[0102] At least one of the following conditions 1 to 3 may be set as a prohibition condition for performing multiple small movements in succession in response to the occurrence of one first motion event. Then, the small movement control unit 11 may determine a movement destination that does not satisfy the prohibition condition from among areas within the permitted area and outside the excluded area.

[0103] (Condition 1) The direction of pupil movement in the first micro-movement is the same as the direction of pupil movement in the second and subsequent micro-movements (Condition 2) The distance the pupil moves in the second and subsequent micro-movements is greater than the distance the pupil moves in the first and subsequent micro-movements (Condition 3) The destination of the second or subsequent small movement is farther away from the first reference position than the current position.

[0104] The inventors have confirmed that when a plurality of micro movements are made in succession in response to the occurrence of one first motion event, if the movement directions of the plurality of continuous micro movements are the same, the first motion becomes unnatural. According to condition 1, such unnatural motion can be avoided. And, it is possible to make the pupil of the drawing target perform a natural first motion (motion simulating a microsaccade).

[0105] As mentioned above, by making the permitted area from the second time onwards smaller than the first allowed area, there is a certain probability that the pupil position can be brought closer to the reference position (the center of the permitted area) with the second and subsequent micro-movements. However, this is not guaranteed. By setting condition 2, it is possible to reliably bring the pupil position closer to the reference position (the center of the permitted area) with the second and subsequent micro-movements. This makes it possible to have the pupil of the drawing target perform a natural first movement (movement simulating a microsaccade).

[0106] Furthermore, as described above, by making the second and subsequent exclusion areas smaller than the first exclusion area, it is possible, with a certain probability, to make the distance the pupil moves in the second and subsequent micro movements smaller than the distance the pupil moves in the first micro movement. However, this is not absolute. By setting condition 3, it is possible to reliably make the distance the pupil moves in the second and subsequent micro movements smaller than the distance the pupil moves in the first micro movement. This makes it possible to have the pupil to be drawn perform a natural first movement (a movement that simulates a microsaccade).

[0107] Next, an example of the flow of processing of the processing device 10 implemented by the minute movement control unit 11 will be described with reference to the flowchart of FIG.

[0108] The processing device 10 waits for the occurrence of a first operational event (S20).

[0109] When the first action event occurs (Yes in S20), the processing device 10 randomly determines the number of times to perform the small movement (S21). Here, the number is randomly determined to be either 1 time or 2 times.

[0110] If the determined number of times is two ("twice" in S22), the processing device 10 determines the destination of the pupil in the micro-movement of the first operation based on the permitted area and the excluded area (S23). The processing device 10 then moves the pupil to the determined destination (S24). Next, the processing device 10 determines the destination of the pupil in the second micro-movement based on the permitted area and the excluded area (S25). The processing device 10 then moves the pupil to the determined destination (S26).

[0111] On the other hand, if the determined number of times is one ("one time" in S22), the processing device 10 determines the movement destination of the pupil in the slight movement of the first operation based on the permitted area and the excluded area (S27). Then, the processing device 10 moves the pupil to the determined movement destination (S28).

[0112] Thereafter, unless an instruction to end the process is given (No in S29), the processing device 10 repeats the same process.

[0113] The timing for determining the number of micro-movements, the timing for determining the permitted area, the timing for determining the excluded area, and the timing for determining the destination of the pupil in the micro-movement are not limited to the example shown in FIG. 12. These timings can be changed to other timings within a range in which the same action and effect can be obtained. For example, when two micro-movements are performed consecutively in response to the occurrence of one first action event, the processing device 10 may randomly determine the time from the end of the second micro-movement to the occurrence timing of the next first action event within a predetermined time. In addition, when two micro-movements are performed consecutively in response to the occurrence of one first action event, the processing device 10 may randomly determine the time from the end of the first micro-movement to the occurrence timing of the next first action event within a predetermined time.

[0114] Other configurations of the processing apparatus 10 of this embodiment are similar to those of the processing apparatus 10 of the first and second embodiments.

[0115] According to the processing apparatus 10 of this embodiment, the same effects as those of the processing apparatus 10 of the first and second embodiments are achieved.

[0116] Moreover, the processing device 10 of this embodiment can perform a plurality of micro movements in succession in response to the occurrence of one first motion event. Moreover, the processing device 10 of this embodiment can randomly determine the number of micro movements to be performed in response to the occurrence of one first motion event. According to the processing device 10 of this embodiment, the first motion simulating a microsaccade can be made more realistic and natural.

[0117] In addition, the processing device 10 of this embodiment can impose the above-mentioned characteristic restriction on the first motion simulating a microsaccade when a plurality of small movements are continuously performed in response to the occurrence of one first motion event. The inventors have confirmed that such a restriction can make the first motion simulating a microsaccade look natural when a plurality of small movements are continuously performed in response to the occurrence of one first motion event.

[0118] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-mentioned embodiments. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be appropriately combined with other embodiments.

[0119] In addition, in the flowcharts used in the above description, multiple steps (processes) are described in order. However, the order of the steps performed in each embodiment is not limited to the order described. In each embodiment, the order of the steps shown in the drawings can be changed as long as it does not affect the content.

[0120] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. 1. Connect your computer to functioning as a minute movement control means for causing the pupil of the drawing target to perform a first operation of repeating minute movements; The fine movement control means includes: determining an allowed area that is allowed as a destination of the pupil during the minute movement and an excluded area that is excluded as a destination of the pupil during the minute movement; a program for repeating a process of determining a destination of the pupil during the minute movement from within the permitted area and outside the excluded area, and moving the pupil to the determined destination; 2. The computer determining a reference position to which the pupil is to be moved in a normal movement different from the minute movement, and further functioning as a normal movement control means for moving the pupil to the determined reference position; The fine movement control means includes: When the first action is performed on a pupil at a first reference position, determining the permitted area based on the first reference position; The program according to claim 1, further comprising: determining the exclusion area to be excluded as a destination of the pupil in the next micro-movement based on the first reference position or a current position which is the position of the pupil after at least one micro-movement. 3. The program described in 2, wherein the micro-movement control means determines the inside of a predetermined area centered on the first reference position as the permitted area. 4. The program according to 2 or 3, wherein the micro-movement control means determines the inside of a predetermined area centered on the previous current position as the excluded area. 5. The micro movement control means generating an event at a predetermined timing to cause the pupil to perform the first action; determining whether to perform one small movement or a plurality of small movements in succession in response to one of the events; 5. The program according to any one of 1 to 4, which causes the micro-movement to be performed a determined number of times in response to one occurrence of the event. 6. The fine movement control means When the slight movement is performed multiple times in succession in response to one event, The program described in 5, wherein when determining the destination of the pupil in the second or subsequent micro-movements, the size of the permitted area and the excluded area are made smaller than the permitted area and the excluded area when determining the destination of the pupil in the first micro-movement. 7. The fine movement control means When determining a destination of the pupil in the minute movement, a destination that does not satisfy a predetermined prohibition condition is determined; The program according to any one of 1 to 6, wherein the prohibition condition is that an angle between a line connecting the current position of the pupil and the destination position and a predetermined direction is less than a reference angle. 8. The fine movement control means When determining a destination of the pupil in the minute movement, a destination that does not satisfy a predetermined prohibition condition is determined; The prohibition condition for determining a movement destination of the pupil in the second or subsequent minute movements in a case where the minute movements are performed consecutively a plurality of times in response to one event is: The direction of movement of the pupil in the first minute movement is the same as the direction of movement of the pupil in the second or subsequent minute movements. The distance of movement of the pupil in the second or subsequent minute movements is greater than the distance of movement of the pupil in the first or subsequent minute movements, and a destination of the second or subsequent minute movements is farther away from the first reference position than the current position; 7. The program according to 5 or 6, comprising at least one of the following: 9. A micro-movement control unit that causes the pupil of the drawing target to perform a first operation of repeating micro-movements; The fine movement control unit includes: determining an allowed area that is allowed as a destination of the pupil during the minute movement and an excluded area that is excluded as a destination of the pupil during the minute movement; a processing device that determines a destination of the pupil during the minute movement from within the permitted area and outside the excluded area, and repeats a process of moving the pupil to the determined destination. 10. One or more computers: A micro-movement control step is carried out to cause the pupil of the drawing target to perform a first operation of repeating micro-movements; In the fine movement control step, determining an allowed area that is allowed as a destination of the pupil during the minute movement and an excluded area that is excluded as a destination of the pupil during the minute movement; A processing method for determining a destination of the pupil in the minute movement from within the permitted area and outside the excluded area, and repeating a process of moving the pupil to the determined destination. [Explanation of symbols]

[0121] 10 Processing equipment 11 Micro movement control unit 12 Normal movement control section 13 Display control section 1A Processor 2A Memory 3A input / output I / F 4A Peripheral circuit 5A Bus

Claims

1. Computer, functioning as a minute movement control means for causing the pupil of the drawing target to perform a first operation of repeating minute movements; The fine movement control means includes: determining an allowed area that is allowed as a destination of the pupil during the minute movement and an excluded area that is excluded as a destination of the pupil during the minute movement; a program for repeating a process of determining a destination of the pupil during the minute movement from within the permitted area and outside the excluded area, and moving the pupil to the determined destination;

2. The computer, determining a reference position to which the pupil is to be moved in a normal movement different from the minute movement, and further functioning as a normal movement control means for moving the pupil to the determined reference position; The fine movement control means includes: When the first action is performed on a pupil located at a first reference position, determining the permitted area based on the first reference position; The program according to claim 1 , further comprising: determining the exclusion area to be excluded as a destination of the pupil in the next minute movement, based on the first reference position or a current position which is the position of the pupil after at least one minute movement.

3. 3. The program according to claim 2, wherein the minute movement control means determines, as the permitted area, an interior of a predetermined area having the first reference position as a center.

4. 3. The program according to claim 2, wherein the minute movement control means determines, as the excluded area, an area inside a predetermined area having the current position as its center.

5. The fine movement control means includes: generating an event at a predetermined timing to cause the pupil to perform the first action; determining whether to perform one small movement or a plurality of small movements in succession in response to one of the events; 2. The program according to claim 1, further comprising: a step of performing a determined number of the slight movements in response to one occurrence of the event.

6. The fine movement control means includes: When the slight movement is performed multiple times in succession in response to one event, The program according to claim 5, wherein when determining the destination of the pupil in the second or subsequent micro-movements, the size of the permitted area and the excluded area is made smaller than the permitted area and the excluded area when determining the destination of the pupil in the first micro-movement.

7. The fine movement control means includes: When determining a destination of the pupil in the minute movement, a destination that does not satisfy a predetermined prohibition condition is determined; 2. The program according to claim 1, wherein the prohibition condition is that an angle between a line connecting a current position of the pupil and a destination of the pupil and a predetermined direction is less than a reference angle.

8. The fine movement control means includes: determining a destination of the pupil in the minute movement when the pupil is caused to perform the first operation at a first reference position, the destination not satisfying a predetermined prohibition condition; The prohibition condition for determining a movement destination of the pupil in the second or subsequent minute movement in the case where the minute movement is performed multiple times in succession in response to one event is: the direction of movement of the pupil in the first minute movement is the same as the direction of movement of the pupil in the second or subsequent minute movements; The distance of movement of the pupil in the second or subsequent minute movements is greater than the distance of movement of the pupil in the first or subsequent minute movements, and a destination of the second or subsequent minute movements is farther away from the first reference position than the current position; The program according to claim 5, comprising at least one of the following:

9. a micro-movement control unit that causes a first operation of repeating micro-movements to be performed on a pupil of a drawing target; The fine movement control unit includes: determining an allowed area that is allowed as a destination of the pupil during the minute movement and an excluded area that is excluded as a destination of the pupil during the minute movement; a processing device that determines a destination of the pupil during the minute movement from within the permitted area and outside the excluded area, and repeats a process of moving the pupil to the determined destination.

10. One or more computers A micro-movement control step is carried out to cause the pupil of the drawing target to perform a first operation of repeating micro-movements; In the fine movement control step, determining an allowed area that is allowed as a destination of the pupil during the minute movement and an excluded area that is excluded as a destination of the pupil during the minute movement; A processing method for determining a destination of the pupil in the minute movement from within the permitted area and outside the excluded area, and repeating a process of moving the pupil to the determined destination.

Images