Processing apparatus, processing method, and program

Abstract

To control a drawing target to perform natural eye movements.SOLUTION: A processing apparatus 10 includes a fine movement control unit 11 that controls eyes of a drawing target to perform first motion that repeats fine movements. The fine movement control unit 11 determines a permission area permitted as a destination of fine movements of the eyes and an exclusion area which is excluded from the destination of fine movements of the eyes. The fine movement control unit 11 determines a destination of fine movements of the eyes from the permission area and areas other than the exclusion area, and repeats processing to move the eyes to the determined destination.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a processing device, a processing method, and a program. [Background technology]

[0002] Even when the human eye is fixed, it makes minute eye movements called microsaccades. Characters and avatars are drawn on game screens and various UI (user interface) screens, and by making the characters and avatars also make these eye movements, it becomes possible to draw them more realistically.

[0003] Related technology is disclosed in Non-Patent Document 1. Non-Patent Document 1 discloses a technology for making a character perform microsaccades. This technology generates the eye movement using a probabilistic model. When performing fixational eye movement, the duration is first determined, then the time interval between microsaccades is calculated, and the number of microsaccades that will occur during one fixational eye movement is determined. The direction of fixational eye movement is determined using random numbers so that it is uniform within a 360° range, as no significant bias was observed when averaging the observation results across all subjects. [Prior art documents] [Non-patent literature]

[0004] [Non-Patent Document 1] Tomoyoshi Iwao and four others, "Analysis and synthesis of eye movements during dialogue based on a probabilistic model," [online], The Journal of the Institute of Image Electronics Engineers of Japan Vol. 42 No. 5 (2013), pp. 661-670, [Retrieved January 11, 2024], Internet,<URL:https: / / www.jstage.jst.go.jp / article / iieej / 42 / 5 / 42_661 / _pdf> Summary of the Invention [Problem to be solved by the invention]

[0005] As mentioned above, in Non-Patent Document 1, the direction of fixational eye movement is determined by random numbers so that it is uniform within a range of 360°, since no significant bias was observed when averaging the observation results of all subjects. In other words, in Non-Patent Document 1, the content of the character's microsaccades is determined so that it is similar to the observation results of fixational eye movement of a human (subject).

[0006] However, the appearance of human eyes and the eyes of characters or avatars may differ. For example, the eyes of a character or avatar may take up a larger proportion of the entire face than those of a human. Also, the pupil (black part of the eye (including the pupil and iris; the same applies below)) of a character or avatar may be a larger proportion of the entire eye than those of a human. Also, the shape of the pupil (black part of the eye) of a character or avatar may differ from the shape of the pupil (black part of the eye) of a human. For example, the shape of the pupil of a character or avatar may be vertically elongated.

[0007] For example, there are differences in appearance between the eyes of a human and the eyes of a character or avatar, such as the following. For this reason, if a character or avatar were to perform microsaccades that are actually performed by the human eye, it may look unnatural.

[0008] In view of the above-mentioned problems, an example of an object of the present disclosure is to provide a processing device, a processing method, and a program that cause the pupils of a drawing target to move in a natural manner. [Means for solving the problem]

[0009] According to the present disclosure, Computer, functioning as minute movement control means for causing the pupil of the drawing target to perform a first operation of repeating minute movements; The minute movement control means determining an allowed area that is allowed as a destination of the pupil during the minute movement and an excluded area that is excluded as a destination of the pupil during the minute movement; A program is provided that determines a destination of the pupil during the minute movement from within the permitted area and outside the excluded area, and repeats the process of moving the pupil to the determined destination.

[0010] Further, according to the present disclosure, a minute movement control unit that causes the pupil of the drawing target to perform a first operation of repeating minute movements; The minute movement control unit determining an allowed area that is allowed as a destination of the pupil during the minute movement and an excluded area that is excluded as a destination of the pupil during the minute movement; A processing device is provided that determines a destination of the pupil in the minute movement from within the permitted area and outside the excluded area, and repeats the process of moving the pupil to the determined destination.

[0011] Further, according to the present disclosure, One or more computers executing a minute movement control step of causing the pupil of the drawing target to perform a first operation of repeating minute movements; In the fine movement control step, determining an allowed area that is allowed as a destination of the pupil during the minute movement and an excluded area that is excluded as a destination of the pupil during the minute movement; A processing method is provided in which a destination of the pupil in the minute movement is determined from an area within the permitted area and outside the excluded area, and the process of moving the pupil to the determined destination is repeated. [Effects of the Invention]

[0012] According to one aspect of the present disclosure, a processing device, a processing method, and a program are provided that cause a drawing target to perform natural pupil movement. [Brief explanation of the drawings]

[0013] [Figure 1] FIG. 1 illustrates an example of a functional block diagram of a processing device according to the present disclosure. [Figure 2]FIG. 1 is a diagram illustrating an example of a hardware configuration of a processing device according to the present disclosure. [Figure 3] FIG. 10 is a diagram illustrating another example of a functional block diagram of a processing device according to the present disclosure. [Figure 4] FIG. 10 is a diagram schematically illustrating an example of a screen displayed by a processing device according to the present disclosure. [Figure 5] FIG. 2 is a diagram for explaining processing of a processing device according to the present disclosure. [Figure 6] FIG. 10 is another diagram for explaining the processing of the processing device according to the present disclosure. [Figure 7] FIG. 10 is another diagram for explaining the processing of the processing device according to the present disclosure. [Figure 8] FIG. 10 is another diagram for explaining the processing of the processing device according to the present disclosure. [Figure 9] FIG. 10 is another diagram for explaining the processing of the processing device according to the present disclosure. [Figure 10] 10 is a flowchart illustrating an example of a processing flow of a processing device according to the present disclosure. [Figure 11] FIG. 10 is another diagram for explaining the processing of the processing device according to the present disclosure. [Figure 12] 10 is a flowchart illustrating another example of the processing flow of the processing device according to the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0014] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In this disclosure, the drawings relate to one or more embodiments. In all drawings, similar components are designated by similar reference numerals, and descriptions thereof will be omitted as appropriate.

[0015] <<First embodiment>> 1 is a functional block diagram showing an overview of a processing device 10. As shown in FIG.

[0016] The minute movement control unit 11 causes the pupil of the drawing target to perform a first operation of repeating minute movements. The first operation is an operation that simulates a microsaccade.

[0017] Specifically, the minute movement control unit 11 determines an allowed area that is allowed as a destination of the pupil during minute movement and an excluded area that is excluded as a destination of the pupil during minute movement. The minute movement control unit 11 then determines the destination of the pupil during minute movement from among areas within the allowed area and outside the excluded area, and repeats the process of moving the pupil to the determined destination.

[0018] With this type of processing device 10, it is possible to control to some extent the destination of the pupil during slight movement by using the permitted area and excluded area. By controlling to some extent the destination of the pupil during slight movement, it is possible to make the pupil of the drawing target move in a natural manner.

[0019] <<Second embodiment>> <Summary> The processing apparatus 10 of the second embodiment is a specific embodiment of the configuration of the processing apparatus 10 of the first embodiment, which will be described in detail below.

[0020] <Hardware configuration> An example of the hardware configuration of the processing device 10 will be described below. Each functional unit of the processing device 10 is realized by any combination of hardware and software. Those skilled in the art will understand that there are many variations in the realization method and device. The software includes programs that are pre-loaded in the device before shipping, and programs downloaded from recording media such as CDs (Compact Discs) or servers on the Internet.

[0021] FIG. 2 is a block diagram illustrating an example of the hardware configuration of a processing device 10. As shown in FIG. 2, the processing device 10 has a processor 1A, a memory 2A, an input / output interface 3A, a peripheral circuit 4A, and a bus 5A. The peripheral circuit 4A includes various modules. The processing device 10 does not necessarily have to have the peripheral circuit 4A. Note that the processing device 10 may be composed of multiple devices that are physically and / or logically separated. In this case, each of the multiple devices may have the above hardware configuration.

[0022] The bus 5A is a data transmission path for the processor 1A, memory 2A, peripheral circuit 4A, and input / output interface 3A to mutually transmit and receive data. The processor 1A is, for example, a central processing unit (CPU) or a graphics processing unit (GPU). The memory 2A is, for example, a random access memory (RAM) or a read-only memory (ROM). The input / output interface 3A includes interfaces for acquiring information from input devices, external devices, external servers, external sensors, cameras, etc., and interfaces for outputting information to output devices, external devices, external servers, etc. The input / output interface 3A also includes an interface for connecting to a communication network such as the Internet. Examples of input devices include a keyboard, mouse, microphone, physical buttons, touch panel, and dedicated game console controller. Examples of output devices include a display, projection device, speaker, printer, and mailer. The processor 1A can issue commands to each module and perform calculations based on the results of those calculations.

[0023] <Functional configuration> An example of the functional configuration of the processing device 10 will be described. Fig. 3 shows an example of a functional block diagram of the processing device 10. As shown in the figure, the processing device 10 has a display control unit 13. The display control unit 13 has a minute movement control unit 11 and a normal movement control unit 12.

[0024] The display control unit 13 causes the output device to output a screen showing the drawing target.

[0025] The "drawing subject" is a concept that includes at least one of a character and an avatar.

[0026] A "screen" is a screen that includes a drawing target and provides various information to the user.

[0027] An example of a screen is a game screen showing a scene from a game. The game screen can be realized using any well-known technology.

[0028] Another example of a screen is a UI screen that provides various kinds of guidance to the user. Examples of such a UI screen include a UI screen for a chat service. Other examples include a UI screen that outputs various kinds of guidance prepared in advance in response to a user's selection. In one example, on such a UI screen, the drawing target is displayed as a concierge or the like. Such a UI screen may be provided by an application (software), a web page, a dedicated system, or other means.

[0029] The screens shown here are merely examples, and the present invention is not limited to these examples.

[0030] The display control unit 13 may generate a screen and output the generated screen to an output device. Alternatively, the display control unit 13 may receive a screen from an external device and output the received screen to an output device.

[0031] In one example, the processing device 10 is an operation terminal operated by a user. In this example, the operation terminal (processing device 10) includes a display control unit 13. The display control unit 13 generates a screen and causes the generated screen to be output to an output device included in the operation terminal (processing device 10) or an output device connected to the operation terminal (processing device 10).

[0032] The "terminal device" may be, but is not limited to, a game device, a smartphone, a tablet terminal, a personal computer, a mobile phone, a terminal dedicated to a service installed in a facility, etc.

[0033] In another example, the processing device 10 is a client terminal operated by a user. In this example, the client terminal (processing device 10) includes a display control unit 13. The display control unit 13 receives a screen from the server and outputs the received screen to an output device included in the client terminal (processing device 10) or an output device connected to the client terminal (processing device 10).

[0034] A "client terminal" is, but is not limited to, a game device, a smartphone, a tablet terminal, a personal computer, a mobile phone, a terminal dedicated to a service installed in a facility, etc. The client terminal operates in conjunction with a server.

[0035] In another example, the processing device 10 is a server. In this example, the server (processing device 10) includes a display control unit 13. The display control unit 13 generates a screen and causes the generated screen to be output to a client terminal (output device).

[0036] Fig. 4 shows an example of a screen output by the display control unit 13 to the output device. The screen shown in the figure includes a drawing object C. Note that, in the example screen of Fig. 4, a close-up of the face of drawing object C is included, but the drawing object may be included so that the entire body is visible, or so that only the upper body is visible (i.e., the lower body is not visible), or may be included in other ways.

[0037] Returning to FIG. 3, the minute movement control unit 11 causes the pupil of the drawing target to perform a first operation of repeating minute movements. The first operation is an operation simulating a microsaccade. The normal movement control unit 12 moves the pupil by normal movement. The normal movement is a movement different from the minute movement of the first operation, and is, for example, a movement of the pupil caused by a change in the line of sight of the drawing target. By coordinating the minute movement control unit 11 and the normal movement control unit 12 in this way, it is possible to cause the pupil of the drawing target to perform natural movement. This will be explained in detail below.

[0038] The normal movement control unit 12 moves the pupil of the drawing target included on the screen by normal movement.

[0039] As shown in FIG. 4, the black part of the eye is the pupil e in this embodiment.

[0040] The normal movement control unit 12 manages the position of the pupil e. When an event occurs that moves the position of the pupil e by normal movement, the normal movement control unit 12 determines the destination of the pupil e and moves the pupil e to the determined destination.

[0041] The position of the pupil e can be managed using various methods, and any method can be adopted, but in this embodiment, the position ec of the center of the pupil e (see FIG. 5) is managed. That is, the "position of the pupil e" managed in this embodiment is the "position ec of the center of the pupil e."

[0042] "Normal movement" is movement different from the minute movement of the first operation, i.e., the minute movement realized by control by the minute movement control unit 11. Normal movement is, for example, movement of the pupil caused by a change in the line of sight depending on the drawing target. Normal movement is realized by control different from the control that realizes the minute movement of the first operation.

[0043] An "event that moves the position of the pupil e by normal movement" (hereinafter, may be referred to as a "normal movement event") may occur in response to a user input, for example. The normal movement event may occur at a longer cycle than the cycle of the slight movement of the first operation.

[0044] In one example, the user performs various inputs via an input device, which may be inputs related to the progress of the game, inputs for operating a drawing object displayed on the screen, inputs for touching an operation object (such as a button or other object) displayed on the screen, inputs for selecting at least one of presented options, or other inputs.

[0045] When a user input such as that described above is made, the normal movement control unit 12 determines whether the user input satisfies the condition for generating a normal movement event. If the condition is satisfied, the normal movement control unit 12 generates a normal movement event. The condition is determined in advance.

[0046] In this example, the normal movement control unit 12 determines the destination of the pupils in accordance with the user input. The algorithm for determining the destination of the pupils based on the user input is a design matter. For example, if the user input is an input to change the line of sight of the drawing target, the normal movement control unit 12 may determine the destination of the pupils based on that input. Alternatively, if the user input is an input to touch an operation target (such as a button or other object) displayed on the screen, the normal movement control unit 12 may determine the destination of the pupils so that the line of sight is directed toward the touched operation target.

[0047] Alternatively, a normal movement event may occur in response to a user's action. In this example, the normal movement control unit 12 monitors the user's action using devices such as a camera, a microphone, and a radar. When the normal movement control unit 12 detects that the user has performed a predetermined action, it generates a normal movement event accordingly.

[0048] In this example, the normal movement control unit 12 determines the destination of the pupils in accordance with the detected user's movement. The algorithm for determining the destination of the pupils based on the detected user's movement is a design matter. For example, the normal movement control unit 12 may detect a part of the user's body that has moved, and determine the destination of the pupils so that the gaze of the drawing target is directed in the direction of that body part.

[0049] Note that the way in which a normal movement event occurs and the way in which the destination of the pupil during normal movement is determined are merely examples, and normal movement of the pupil of the drawing target can be achieved using any other widely known method.

[0050] 5 and 6 show an example in which the pupil e of the drawing target included on the screen is moved by normal movement. FIG. 5 shows the state before normal movement, and FIG. 6 shows the state in which the pupil e has been moved to the destination determined as described above (the state in which normal movement is completed). It takes several frames for the pupil e to move from the state in FIG. 5 to the state in FIG. 6. In other words, with normal movement, it is possible to move the pupil e to the determined destination over one to several frames. As shown in FIGS. 5 and 6, the movement distance of the pupil e with normal movement may be large. In this respect, normal movement differs from the minute movement of the first operation, in which the movement distance is limited.

[0051] Hereinafter, the destination of the normal movement determined by normal movement control unit 12 will be referred to as the "reference position." The pupil of the drawing target moves through the multiple reference positions determined by the normal movement. Then, at each reference position, the pupil of the drawing target performs a slight movement of the first operation.

[0052] Returning to FIG. 3, the minute movement control unit 11 causes the pupil of the drawing target to perform a first operation of repeating minute movements.

[0053] Specifically, the minute movement control unit 11 determines an allowed area that is allowed as a destination of the pupil during the minute movement of the first action, and an excluded area that is excluded as a destination of the pupil during the minute movement of the first action. The minute movement control unit 11 then determines the destination of the pupil during the minute movement of the first action from among areas within the allowed area and outside the excluded area, and repeats the process of moving the pupil to the determined destination.

[0054] Here, a method for determining the permitted area will be described.

[0055] When the fine movement control unit 11 causes the pupil located at the first reference position during the normal movement described above to perform the first action, the fine movement control unit 11 determines an allowed area based on the first reference position. Specifically, the fine movement control unit 11 determines the interior of a predetermined area centered on the first reference position as the allowed area. The shape and size of the predetermined area are determined in advance. In one example, the predetermined area is a circle, and the radius of the circle is determined in advance. As described above, the pupil of the drawing target moves between multiple reference positions determined during the normal movement. The first reference position is the reference position where the pupil of the drawing target is currently located.

[0056] The permitted area is illustrated in Figure 7. Figure 7 shows pupil e after it has been moved to position ec1 by normal movement. The reference position at this time is position ec1. In this case, minute movement control unit 11 determines the inside of a predetermined area centered on this reference position (position ec1), for example, the inside of a circle of a predetermined radius centered on this reference position (position ec1), as permitted area a.

[0057] As described above, the permitted area a is determined based on the "reference position (position ec1)" which is the destination of normal movement. Therefore, the position of the permitted area a does not change while the pupil e is not moving due to normal movement. In other words, even if the pupil e moves due to the slight movement of the first operation, the position of the permitted area a does not change as long as the pupil e does not move due to normal movement. In this way, by determining the permitted area a based on the "reference position (position ec1)" which is the destination of normal movement, it is possible to prevent the inconvenience of the position of the pupil e changing significantly due to repeated slight movements of the first operation.

[0058] Next, a method for determining the exclusion area will be described.

[0059] The minute movement control unit 11 determines the exclusion area based on the current position of the pupil. Specifically, the minute movement control unit 11 determines the inside of a predetermined area centered on the current position of the pupil as the exclusion area. If the minute movement of the first operation has not been performed even once after the normal movement, the current position is the reference position after the normal movement. On the other hand, if the minute movement of the first operation has been performed at least once after the normal movement, the current position is the position of the pupil after that minute movement.

[0060] The shape and size of the predetermined area for determining the exclusion area are predetermined. In one example, the predetermined area here is a horizontally elongated ellipse, and the shape and size of the horizontally elongated ellipse are predetermined. Note that the predetermined area here may be another shape, such as a vertically elongated ellipse or a circle. However, the inventors have confirmed that when the exclusion area is a horizontally elongated ellipse, the pupil of the drawing target can be made to move more naturally than when the exclusion area is another shape. For example, when the shape of the pupil of the drawing target is vertically elongated, the inventors have confirmed that when the exclusion area is a horizontally elongated ellipse, the pupil of the drawing target can be made to move more naturally than when the exclusion area is another shape. Note that the shape of the exclusion area can be adjusted depending on the design of the drawing target, etc.

[0061] The exclusion area is illustrated using Figure 7. Figure 7 shows pupil e which has moved to position ec1 by normal movement and has not yet undergone the first operation's minute movement even once. The current position at this time is position ec1. In this case, the minute movement control unit 11 determines the inside of a predetermined area centered on this current position (position ec1), for example, the inside of a horizontally elongated ellipse of a predetermined shape and a predetermined size centered on this current position (position ec1), as the exclusion area f.

[0062] As described above, the exclusion area f is determined based on the current position, which changes due to the normal movement and the minute movement of the first action. Therefore, the position of the exclusion area f changes every time there is a change due to the normal movement and the minute movement of the first action. By determining the exclusion area f as a predetermined area centered on the current position based on the "current position" in this way, it is possible to move a certain distance or more with each minute movement.

[0063] Next, a process for determining the destination of the pupil in the slight movement of the first operation from within the permitted area and outside the excluded area will be described.

[0064] In the example of Figure 7, the areas within the permitted area a but outside the excluded area f are shaded. The slight movement control unit 11 randomly determines the destination of the pupil e in the slight movement of the first operation from within the shaded areas. For example, the destination d is determined as shown in Figure 8.

[0065] The minute movement control unit 11 may determine a destination that does not satisfy a predetermined prohibition condition from among areas that are within the permitted area and outside the excluded area.

[0066] The prohibition condition is that the angle between the line connecting the current position of the pupil and the destination and the predetermined direction is less than a reference angle. The inventor discovered that moving the pupil of the drawing target in a predetermined direction by a small movement of the first operation can look unnatural. By setting such a prohibition condition, it is possible to suppress the inconvenience of moving the pupil of the drawing target in a predetermined direction, i.e., a direction that looks unnatural, by a small movement of the first operation.

[0067] The direction of pupil movement that appears unnatural due to the slight movement of the first operation is, for example, the up-down direction of the pupil (which can also be expressed as the up-down direction of the eye or the up-down direction of the face). In this case, the prohibition condition can be that the angle between the line connecting the current position of the pupil and the destination and the up-down direction of the pupil (which can also be expressed as the up-down direction of the eye or the up-down direction of the face) is less than a reference angle. The direction in which pupil movement is prohibited can be determined depending on the design of the drawing object, etc.

[0068] After determining the destination of the pupil in the micro-movement of the first operation as described above, the micro-movement control unit 11 moves the pupil to the determined destination. Note that the distance of pupil movement in the micro-movement of the first operation is limited by the permitted area and is a relatively small value. Therefore, the micro-movement control unit 11 can move the pupil to the determined destination in one frame or a small number of frames equivalent thereto. The micro-movement control unit 11 may control the movement of the pupil in a fixed time (one frame or a small number of frames equivalent thereto) without varying the time taken to move the pupil to the determined destination depending on the distance of the micro-movement.

[0069] After the destination d is determined as shown in Fig. 8, the state in which the pupil e is moved to the determined destination d is shown in Fig. 9. In Fig. 9, the position ec2 of the pupil e (the position of the center of the pupil e) coincides with the destination d.

[0070] When determining the destination of the next minute movement after the minute movement shown in FIG. 9, the minute movement control unit 11 determines the permitted area a and the excluded area f as shown in FIG.

[0071] As described above, permitted area a is determined based on the "reference position (position ec1)" which is the destination of normal movement. For this reason, even if pupil e moves due to the slight movement of the first operation, the position of permitted area a will not change unless pupil e moves due to normal movement. Comparing Figure 8, which shows the state before the slight movement of the first operation, with Figure 9, which shows the state after the slight movement of the first operation, it can be seen that the position of permitted area a has not changed.

[0072] Furthermore, as described above, the exclusion area f is determined based on the current position, which changes due to normal movement and the slight movement of the first movement. Therefore, when the pupil e moves due to the slight movement of the first movement, the position of the exclusion area f changes. Comparing Figure 8, which shows the state before the slight movement of the first movement, with Figure 9, which shows the state after the slight movement of the first movement, it can be seen that the position of the exclusion area f has changed.

[0073] When determining the destination of the next minute movement after the minute movement shown in Fig. 9, the minute movement control unit 11 randomly determines the destination of the pupil e in the next minute movement from among the areas indicated by diagonal lines that are within the permitted area a and outside the excluded area f shown in Fig. 9. Comparing Fig. 8, which shows the state before the minute movement of the first operation, with Fig. 9, which shows the state after the minute movement of the first operation, it can be seen that the area to which the pupil can move in the next minute movement (the area indicated by diagonal lines) changes depending on the minute movement.

[0074] The minute movement control unit 11 generates an event (hereinafter, may be referred to as a "first movement event") that causes the pupil of the drawing target to perform a first movement at a predetermined timing. Then, in response to the generation of the first movement event, the minute movement control unit 11 causes the pupil of the drawing target to perform the first movement.

[0075] For example, the micro movement control unit 11 generates a first action event once every predetermined time. The predetermined time is several seconds (e.g., 2 to 4 seconds). The predetermined time may be randomly determined within a range of several seconds (e.g., 2 to 4 seconds). In this case, the micro movement control unit 11 randomly determines, within the predetermined time, the time interval for generating the next micro movement after performing a certain micro movement. Then, the micro movement control unit 11 generates the first action event when the determined time has elapsed. For each micro movement, the micro movement control unit 11 can randomly determine, within the predetermined time, the time interval for generating the next micro movement.

[0076] Although detailed description will be omitted, the display control unit 13 may also have a control unit that controls the movement of other parts of the drawing target (eyebrows, nose, mouth, hands, arms, legs, etc.).

[0077] Next, an example of the flow of processing by the processing device 10 implemented by the minute movement control unit 11 will be described with reference to the flowchart of FIG.

[0078] The processing device 10 waits for the occurrence of a first operational event (S10).

[0079] When a first action event occurs (Yes in S10), the processing device 10 determines a destination of the pupil in the slight movement of the first action based on the permitted area and the excluded area (S11), and then moves the pupil to the determined destination (S12).

[0080] Thereafter, unless an instruction to end the process is given (No in S13), the processing device 10 repeats the same process.

[0081] The permitted area and the excluded area may be determined before the first action event occurs, or may be determined after the first action event occurs.

[0082] 10, the processing device 10 may perform S11 before the occurrence of a first action event and determine the destination of the pupil in the next small movement of the first action. Then, when the first action event occurs (Yes in S10), the processing device 10 may move the pupil to the previously determined destination (S12).

[0083] "Action and effect" The processing device 10 of this embodiment achieves the same effects as the processing device 10 of the first embodiment. That is, the processing device 10 of this embodiment can cause the pupil of the drawing target to perform a natural first movement (movement simulating a microsaccade).

[0084] Furthermore, by determining the permitted area and excluded area using a distinctive method like the processing device 10 of this embodiment, it is possible to perform small movements of a sufficient distance in the first operation while suppressing the inconvenience of the position of the pupil e changing significantly due to repeated small movements in the first operation.

[0085] Furthermore, as in the processing device 10 of this embodiment, by determining the destination of the pupil during the micro-movement of the first action using conditions (prohibition conditions) that prohibit the destination of the pupil during the micro-movement of the first action, it is possible to make the pupil of the drawing target perform a natural first action (action that simulates a microsaccade).

[0086] <<Third embodiment>> The processing device 10 of this embodiment can cause the pupil of the drawing target to perform a plurality of consecutive small movements in response to the occurrence of a single first operation event. The processing device 10 of this embodiment has a characteristic configuration for making such a plurality of consecutive small movements appear natural. This will be described in detail below.

[0087] The minute movement control unit 11 can cause the pupil of the drawing target to perform minute movements multiple times in succession in response to the occurrence of one first operation event.

[0088] "Multiple times" means two or more times. However, the inventors have confirmed that performing two consecutive small movements is the most natural motion, and performing three or more consecutive small movements may result in a somewhat unnatural motion. For this reason, it is preferable to perform two consecutive small movements in response to the occurrence of one first motion event.

[0089] The time interval between successive micro-movements is less than 1 second, for example, about 0.4 to 0.8 seconds. The micro-movement control unit 11 can cause a second micro-movement to be performed after the time has elapsed since the first micro-movement ended. The time interval between successive micro-movements may be fixed or may vary. If it varies, the micro-movement control unit 11 may determine the time interval randomly within a predetermined time.

[0090] The micro-movement control unit 11 may randomly determine the number of micro-movements to be performed in response to the occurrence of one first action event. If the number of micro-movements to be performed in response to the occurrence of one first action event is one or two, the micro-movement control unit 11 randomly determines the number from among these options. The micro-movement control unit 11 can randomly determine the number of micro-movements to be performed in response to each occurrence of a first action event, for each occurrence of a first action event. Then, the micro-movement control unit 11 can cause the pupil of the drawing target to perform the determined number of micro-movements in response to the occurrence of one first action event.

[0091] An example of this is shown in Fig. 11. Fig. 11 shows the occurrence timings of first motion events and the execution timings of minute movements executed in response to each of the first motion events.

[0092] As explained in the second embodiment, the time interval between successive first motion events can be determined randomly within a predetermined time, so the lengths of t1, t2, and t3 in the figure are different from one another.

[0093] In the illustrated example, two successive micro-movements are performed in response to the occurrence of the first first motion event in the figure. The time interval t4 between the two successive micro-movements is shorter than the time intervals t1, t2, and t3 between the successive first motion events.

[0094] In the illustrated example, one minute movement is performed in response to the occurrence of the second first motion event in the figure, and one minute movement is performed in response to the occurrence of the third first motion event in the figure.

[0095] In the illustrated example, two consecutive micro-movements are performed in response to the occurrence of the fourth first motion event in the figure. The time interval t5 between the two consecutive micro-movements is shorter than the time intervals t1, t2, and t3 between the consecutive first motion events. As described above, t4 and t5 may be the same (fixed) or different (variable).

[0096] Next, a description will be given of features for making the first action a natural action when small movements are made multiple times in succession in response to the occurrence of one first action event.

[0097] When minute movement control unit 11 performs minute movements multiple times in succession in response to a single first operation event, when determining the destination of the pupil in the second or subsequent minute movements, it makes the size of the permitted area and excluded area smaller than the permitted area and excluded area used when determining the destination of the pupil in the first minute movement. Hereinafter, the permitted area and excluded area used when determining the destination of the pupil in the first minute movement will be referred to as the "first permitted area" and "first excluded area." Furthermore, the permitted area and excluded area used when determining the destination of the pupil in the second or subsequent minute movements will be referred to as the "second or subsequent permitted area" and "second or subsequent excluded area."

[0098] For example, the minute movement control unit 11 can set the size of the allowed area and excluded area for the second and subsequent times to half the size of the allowed area and excluded area for the first time. Note that the center of the allowed area for the first time and the center of the allowed area for the second and subsequent times are the same, only the size is different. The center and size of the excluded area for the first time and the excluded area for the second and subsequent times are different.

[0099] By making the allowed area from the second time onwards smaller than the first allowed area in this way, it is possible, with a certain probability, to move the pupil position closer to the reference position (the centre of the allowed area) with small movements from the second time onwards.

[0100] Furthermore, by making the exclusion area for the second and subsequent times smaller than the exclusion area for the first time, it is possible, with a certain probability, to make the movement distance of the pupil in the second and subsequent minute movements smaller than the movement distance of the pupil in the first minute movement.

[0101] The inventors have confirmed that by performing such movements in multiple consecutive small movements, it is possible to cause the pupil of the drawing target to perform a natural first movement (a movement simulating a microsaccade).

[0102] Note that at least one of the following conditions 1 to 3 may be defined as a prohibition condition for performing multiple consecutive micro-movements in response to the occurrence of one first operation event. Then, the micro-movement control unit 11 may determine a destination that does not satisfy the prohibition condition from among areas that are within the permitted area and outside the excluded area.

[0103] (Condition 1) The direction of pupil movement in the first micro-movement is the same as the direction of pupil movement in the second and subsequent micro-movements. (Condition 2) The distance the pupil moves in the second and subsequent micro-movements is greater than the distance the pupil moves in the first and subsequent micro-movements. (Condition 3) The destination of the second or subsequent micro-movement is farther from the first reference position than the current position.

[0104] The inventors have confirmed that when a plurality of micro movements are made consecutively in response to the occurrence of a single first movement event, if the movement directions of the consecutive micro movements are the same, the first movement becomes unnatural. According to condition 1, such unnatural movement can be avoided. Furthermore, it is possible to make the pupil of the drawing target perform a natural first movement (movement simulating a microsaccade).

[0105] As mentioned above, by making the allowed area smaller from the first time onwards, there is a certain probability that the pupil position can be moved closer to the reference position (the center of the allowed area) with the second and subsequent micro-movements. However, this is not guaranteed. By setting condition 2, it is possible to reliably move the pupil position closer to the reference position (the center of the allowed area) with the second and subsequent micro-movements. This makes it possible to have the pupil of the drawing target perform a natural first movement (a movement that simulates a microsaccade).

[0106] Furthermore, as described above, by making the exclusion area for the second and subsequent times smaller than the first exclusion area, it is possible, with a certain probability, to make the distance the pupil moves in the second and subsequent micro-movements smaller than the distance it moved in the first micro-movement. However, this is not guaranteed. By setting condition 3, it is possible to reliably make the distance the pupil moves in the second and subsequent micro-movements smaller than the distance it moved in the first micro-movement. This makes it possible to have the pupil of the drawing target perform a natural first movement (a movement that simulates a microsaccade).

[0107] Next, an example of the flow of processing by the processing device 10 implemented by the minute movement control unit 11 will be described with reference to the flowchart of FIG.

[0108] The processing device 10 waits for the occurrence of a first operational event (S20).

[0109] When the first action event occurs (Yes in S20), the processing device 10 randomly determines the number of times of minute movement (S21). Here, the number of times is determined randomly from one or two.

[0110] If the determined number of times is two ("twice" in S22), the processing device 10 determines the destination of the pupil in the slight movement of the first operation based on the permitted area and the excluded area (S23). The processing device 10 then moves the pupil to the determined destination (S24). Next, the processing device 10 determines the destination of the pupil in the second slight movement based on the permitted area and the excluded area (S25). The processing device 10 then moves the pupil to the determined destination (S26).

[0111] On the other hand, if the determined number of times is one ("one time" in S22), the processing device 10 determines the destination of the pupil in the slight movement of the first operation based on the permitted area and the excluded area (S27).Then, the processing device 10 moves the pupil to the determined destination (S28).

[0112] Thereafter, unless an instruction to end the process is given (No in S29), the processing device 10 repeats the same process.

[0113] The timing for determining the number of micro-movements, the timing for determining the permitted area, the timing for determining the excluded area, and the timing for determining the destination of the pupil during the micro-movement are not limited to the example shown in FIG. 12 . These timings can be changed to other timings as long as the same operational effect is obtained. For example, when two consecutive micro-movements are performed in response to the occurrence of one first action event, the processing device 10 may randomly determine the time from the end of the second micro-movement to the occurrence of the next first action event within a predetermined time. Alternatively, when two consecutive micro-movements are performed in response to the occurrence of one first action event, the processing device 10 may randomly determine the time from the end of the first micro-movement to the occurrence of the next first action event within a predetermined time.

[0114] Other configurations of the processing apparatus 10 of this embodiment are similar to those of the processing apparatus 10 of the first and second embodiments.

[0115] According to the processing apparatus 10 of this embodiment, the same effects as those of the processing apparatus 10 of the first and second embodiments are achieved.

[0116] Furthermore, the processing device 10 of this embodiment can cause a plurality of micro-movements to be performed consecutively in response to the occurrence of one first motion event. Furthermore, the processing device 10 of this embodiment can randomly determine the number of micro-movements to be performed in response to the occurrence of one first motion event. According to the processing device 10 of this embodiment, the first motion simulating a microsaccade can be made more realistic and natural.

[0117] Furthermore, when the processing device 10 of this embodiment performs a plurality of small movements consecutively in response to the occurrence of a single first movement event, it is possible to impose the above-described characteristic restriction on the first movement simulating a microsaccade. The inventors have confirmed that, by using such a restriction, when performing a plurality of small movements consecutively in response to the occurrence of a single first movement event, it is possible to make the first movement simulating a microsaccade appear natural.

[0118] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0119] In addition, in the flowcharts used in the above description, multiple steps (processes) are described in order. However, the order of the steps performed in each embodiment is not limited to the order described. In each embodiment, the order of the steps shown in the drawings can be changed as long as it does not cause any problems in terms of the content.

[0120] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes. 1. Turn your computer functioning as minute movement control means for causing the pupil of the drawing target to perform a first operation of repeating minute movements; The minute movement control means determining an allowed area that is allowed as a destination of the pupil during the minute movement and an excluded area that is excluded as a destination of the pupil during the minute movement; a program for determining a destination of the pupil during the minute movement from within the permitted area and outside the excluded area, and repeating the process of moving the pupil to the determined destination; 2. The computer determining a reference position to which the pupil is to be moved in a normal movement different from the minute movement, and further functioning as a normal movement control means for moving the pupil to the determined reference position; The minute movement control means When the first action is performed on the pupil at the first reference position, determining the permitted area based on the first reference position; The program described in 1 determines the exclusion area to be excluded as the destination of the pupil in the next micro-movement based on the first reference position or the current position, which is the position of the pupil after at least one micro-movement. 3. The program according to 2, wherein the minute movement control means determines the interior of a predetermined area centered on the first reference position as the permitted area. 4. The program according to 2 or 3, wherein the minute movement control means determines the exclusion area to be the interior of a predetermined area centered on the current position. 5. The fine movement control means generating an event at a predetermined timing that causes the pupil to perform the first action; determining whether to perform one minute movement or a plurality of consecutive minute movements in response to one event; 5. The program according to any one of 1 to 4, wherein the micro-movement is performed a determined number of times in response to one occurrence of the event. 6. The fine movement control means When the minute movement is performed multiple times in succession in response to one event, A program described in 5, wherein when determining the destination of the pupil in the second or subsequent micro-movements, the size of the allowed area and the excluded area is made smaller than the allowed area and the excluded area when determining the destination of the pupil in the first micro-movement. 7. The fine movement control means When determining a destination of the pupil in the minute movement, a destination that does not satisfy a predetermined prohibition condition is determined; 7. The program according to any one of 1 to 6, wherein the prohibition condition is that the angle between a line connecting the current position of the pupil and the destination and a predetermined direction is less than a reference angle. 8. The fine movement control means When determining a destination of the pupil in the minute movement, a destination that does not satisfy a predetermined prohibition condition is determined; When the slight movement is performed multiple times in succession in response to one event, the prohibition condition for determining the movement destination of the pupil in the second or subsequent slight movement is: the direction of movement of the pupil in the first minute movement is the same as the direction of movement of the pupil in the second or subsequent minute movement; The distance of movement of the pupil in the second or subsequent minute movement is greater than the distance of movement of the pupil in the first or subsequent minute movement, and a movement destination in the second or subsequent minute movement is farther away from the first reference position than the current position; 7. The program according to 5 or 6, comprising at least one of the following: 9. A minute movement control unit that causes the pupil of the drawing target to perform a first operation of repeating minute movements, The minute movement control unit determining an allowed area that is allowed as a destination of the pupil during the minute movement and an excluded area that is excluded as a destination of the pupil during the minute movement; a processing device that determines a destination of the pupil during the minute movement from within the permitted area and outside the excluded area, and repeats the process of moving the pupil to the determined destination; 10. One or more computers: executing a minute movement control step of causing the pupil of the drawing target to perform a first operation of repeating minute movements; In the fine movement control step, determining an allowed area that is allowed as a destination of the pupil during the minute movement and an excluded area that is excluded as a destination of the pupil during the minute movement; A processing method for repeatedly determining a destination of the pupil for the minute movement from within the permitted area and outside the excluded area, and moving the pupil to the determined destination. [Explanation of symbols]

[0121] 10 Processing equipment 11 Micro-movement control unit 12 Normal movement control unit 13 Display control unit 1A processor 2A Memory 3A input / output I / F 4A peripheral circuit 5A Bus

Claims

1. Computer, causing the pupil of the drawing target to function as a minute movement control means for performing a first operation of repeating minute movements; The minute movement control means determining an allowed area that is allowed as a destination of the pupil during the minute movement and an excluded area that is excluded as a destination of the pupil during the minute movement; a program for determining a destination of the pupil during the minute movement from within the permitted area and outside the excluded area, and repeating the process of moving the pupil to the determined destination;

2. The computer determining a reference position to which the pupil is to be moved in a normal movement different from the minute movement, and further functioning as a normal movement control means for moving the pupil to the determined reference position; The minute movement control means When the first action is performed on a pupil at a first reference position, determining the permitted area based on the first reference position; The program according to claim 1 , wherein the exclusion area to be excluded as a destination of the pupil in the next minute movement is determined based on the first reference position or a current position which is the position of the pupil after at least one minute movement.

3. 3. The program according to claim 2, wherein the minute movement control means determines the inside of a predetermined area centered on the first reference position as the permitted area.

4. 3. The program according to claim 2, wherein the minute movement control means determines the exclusion area to be within a predetermined area having the current position as its center.

5. The minute movement control means generating an event at a predetermined timing that causes the pupil to perform the first action; determining whether to perform one minute movement or a plurality of consecutive minute movements in response to one event; 2. The program according to claim 1, wherein the micro-movement is performed a determined number of times in response to one occurrence of the event.

6. The minute movement control means When the minute movement is performed multiple times in succession in response to one event, The program of claim 5, wherein when determining the destination of the pupil in the second or subsequent micro-movements, the size of the permitted area and the excluded area is made smaller than the permitted area and the excluded area when determining the destination of the pupil in the first micro-movement.

7. The minute movement control means When determining a destination of the pupil in the minute movement, a destination that does not satisfy a predetermined prohibition condition is determined; 2. The program according to claim 1, wherein the prohibition condition is that an angle formed by a line connecting the current position of the pupil and the destination and a predetermined direction is less than a reference angle.

8. The minute movement control means When determining a destination of the pupil in the minute movement, a destination that does not satisfy a predetermined prohibition condition is determined; When the slight movement is performed multiple times in succession in response to one event, the prohibition condition for determining the movement destination of the pupil in the second or subsequent slight movement is: the direction of movement of the pupil in the first minute movement is the same as the direction of movement of the pupil in the second or subsequent minute movement; The movement distance of the pupil in the second or subsequent minute movement is greater than the movement distance of the pupil in the first or subsequent minute movement, and a movement destination in the second or subsequent minute movement is farther from the first reference position than the current position; 6. The program according to claim 5, comprising at least one of the following:

9. a minute movement control unit that causes a pupil of a drawing target to perform a first operation of repeating minute movements; The minute movement control unit determining an allowed area that is allowed as a destination of the pupil during the minute movement and an excluded area that is excluded as a destination of the pupil during the minute movement; a processing device that determines a destination of the pupil during the minute movement from within the permitted area and outside the excluded area, and repeats the process of moving the pupil to the determined destination;

10. One or more computers a minute movement control step of causing the pupil of the drawing target to perform a first operation of repeating minute movements; In the fine movement control step, determining an allowed area that is allowed as a destination of the pupil during the minute movement and an excluded area that is excluded as a destination of the pupil during the minute movement; A processing method for repeatedly determining a destination of the pupil for the minute movement from within the permitted area and outside the excluded area, and moving the pupil to the determined destination.

Images