Information processing device, information processing method, and program

Abstract

An information processing device according to the present invention uses a virtual space to acquire vision information that is information about one or both of the use of the line of sight of a user and the aberration sensitivity of the user and, on the basis of the acquired vision information, finds design data needed for design of an eyeglass lens.

Description

Information processing device, information processing method, and program

[0001] The present disclosure relates to an information processing device, an information processing method, and a program.

[0002] BACKGROUND ART Techniques are known that enable the visual performance of spectacle lenses to be evaluated for each spectacle wearer.

[0003] Japanese Patent Application Laid-Open No. 2003-177076

[0004] According to a first aspect of the present disclosure, there is provided an information processing device that uses a virtual space to acquire visual information that is information on both or either of how a user uses their line of sight and the user's aberration sensitivity, and that obtains design data necessary for designing eyeglass lenses based on the acquired visual information.

[0005] According to a second aspect of the present disclosure, there is provided an information processing method for acquiring user design data necessary for designing eyeglass lenses, the information processing method including: an arrangement step for arranging a specific object within a virtual space displayed on a display unit; an acquisition step for acquiring visual information which is information regarding both or either of how the user uses their line of sight when viewing the object in the virtual space and the user's aberration sensitivity when viewing the object; and a calculation step for determining the design data based on the visual information.

[0006] According to a third aspect of the present disclosure, there is provided a program for acquiring user design data necessary for designing eyeglass lenses, the program causing a computer to place a specific object in a virtual space displayed on a display unit, and to calculate the design data based on information on both or either of the user's use of the line of sight when viewing the object in the virtual space and the user's aberration sensitivity when viewing the object.

[0007] 1 is a schematic configuration diagram of a data acquisition system according to the present embodiment. FIG. 1 is a perspective view showing an example of the appearance of a display terminal according to the present embodiment. FIG. 2 is a functional block diagram of a display unit according to the present embodiment. FIG. 3 is a functional block diagram of an information processing device according to the present embodiment. FIG. 4 is a functional block diagram of a processor for executing design data acquisition processing according to the present embodiment. FIG. 5 is a diagram explaining an outline of a design data setting method according to the present embodiment. FIG. 6 is a diagram explaining a measurement scene of gaze data in a virtual space according to the present embodiment. FIG. 7 is a diagram schematically showing how a first specific object appears in a virtual space according to the present embodiment. FIG. 8 is a diagram explaining the display of a first specific object in a virtual space according to the present embodiment. FIG. 9 is a flow diagram explaining the operation flow of a first step according to the present embodiment. FIG. 10 is a diagram explaining right and left disparity angles according to the present embodiment. FIG. 11 is a diagram explaining an object vector according to the present embodiment. FIG. 12 is a diagram showing a first example of changes in right and left disparity angles during gaze time according to the present embodiment. FIG. 13 is a diagram showing a second example of changes in right and left disparity angles during gaze time according to the present embodiment. FIG. 14 is a diagram showing a third example of changes in right and left disparity angles during gaze time according to the present embodiment. FIG. 15 is a diagram showing a near clipping plane according to the present embodiment. FIG. 16 is a diagram showing a coordinate system of the near clipping plane according to the present embodiment. FIG. 17 is a diagram explaining blur distribution according to the present embodiment. FIG. 18 is a diagram explaining blur distribution according to the present embodiment. FIG. 1 is a diagram schematically showing moving the blur distribution according to the present embodiment. FIG. 2 is a diagram showing a state in which the blur distribution of the left eye according to the present embodiment is located at an initial value. FIG. 3 is a diagram showing a state in which the blur distribution of the left eye according to the present embodiment is moved to the left. FIG. 4 is a diagram showing a state in which the blur distribution of the left eye according to the present embodiment is moved to the right. FIG. 5 is a diagram schematically showing a situation in which an acceptable level of blur amount for the right eye according to the present embodiment is obtained. FIG. 6 is a diagram explaining a subjective evaluation level according to the present embodiment. FIG. 7 is a flow diagram explaining the operation of the second step according to the present embodiment. FIG. 8 is a diagram showing an example of visual information obtained in the first step and the second step according to the present embodiment. FIG. 9 is a diagram explaining a design acceptable value obtained in the third step according to the present embodiment.10A and 10B are diagrams illustrating design tolerances in each radial direction of a left-eye lens according to the present embodiment and in a 45° direction among the radial directions.

[0008] The present invention will be described below through embodiments of the invention, but the following embodiments do not limit the scope of the invention according to the claims. Furthermore, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention.

[0009] In the following description, the terms front, back, top, bottom, right, and left refer to the front, back, top, bottom, right, and left directions as seen by the wearer wearing the display terminal 100. The front-to-back direction is the direction facing the wearer. The left-to-right direction is the direction perpendicular to the front-to-back direction and the vertical direction.

[0010] To design eyeglass lenses that suit a user, it is necessary to understand visual information such as the user's dominant eye level relative to an object and aberration sensitivity (also known as blur sensitivity). Therefore, to design eyeglass lenses that suit a user, it is necessary to measure visual information under various environments, such as by appropriately changing the position of an object or the distance to the object to measure the line of sight or blur sensitivity. However, changing the measurement environment in a physical space is not easy and takes time. In this embodiment, an arbitrary measurement environment is created in a virtual space rather than a physical space, and visual information is measured in that measurement environment. This configuration makes it possible to easily obtain visual information and design eyeglass lenses that suit the user.

[0011] FIG. 1 is a schematic diagram of a data acquisition system according to this embodiment. The data acquisition system 1 according to this embodiment acquires design data necessary for designing eyeglass lenses using a virtual space. Specifically, the data acquisition system 1 acquires visual information of a user's (e.g., a spectacle wearer's) eyes using the virtual space and acquires design data based on that visual information. This configuration makes it possible to recreate various environments, such as arbitrary distances, arbitrary positions, arbitrary brightness, and arbitrary blur distributions, in the virtual space and acquire visual information of the user's eyes examined in the recreated virtual space. This allows the data acquisition system 1 to easily acquire visual information for use in various environments. Furthermore, the data acquisition system 1 can acquire design data for designing eyeglass lenses tailored to the user.

[0012] The visual information is, for example, information on how the user uses their line of sight and / or information on the user's sensitivity to aberrations. The design data is set for each eyeglass wearer, and is, for example, the allowable value of the power deviation of the eyeglass lenses.

[0013] As shown in FIG. 1 , the data acquisition system 1 includes a display terminal 100 and an information processing device 200 .

[0014] The display terminal 100 is capable of displaying a virtual space. The display terminal 100 is connected to the information processing device 200 via wired or wireless communication. The display terminal 100 may be a stationary type or a portable type. The display terminal 100 may be a terminal that is attached to a user when used. For example, the display terminal 100 is a VR head-mounted display or VR goggles. FIG. 2 is a perspective view showing an example of the appearance of the display terminal 100 of this embodiment. The display terminal 100 illustrated in FIG. 2 is a VR head-mounted display. The data acquisition system 1 is installed in, for example, an eyeglass store. A user is, for example, a customer who visits the eyeglass store.

[0015] In the following description, a case will be described in which the display terminal 100 is the VR head-mounted display shown in Fig. 2 as an example, but the display terminal 100 is not limited to this. The display terminal 100 may be any terminal that is capable of displaying a virtual space.

[0016] The display terminal 100 is connected to the information processing device 200 by a connection cable C. As shown in FIG.

[0017] The support part 101 fixes the main body 102 to the user's head so as to maintain the positional relationship between the user's face and the main body 102 .

[0018] The main body 102 includes, for example, left and right imaging lenses 111L and 111R, a lens holder 110, and a display unit 120.

[0019] The imaging lens 111L is a lens for the left eye. The imaging lens 111R is a lens for the right eye. When there is no need to distinguish between the imaging lens 111L and the imaging lens 111R, they may be referred to as the "imaging lens 111." The imaging lens 111 is configured to include one or more lenses. The imaging lens 111 forms an image of light from the display unit 120 on the eye of a user wearing the display terminal 100. The lens holding unit 110 holds the imaging lenses 111L and 111R.

[0020] The display unit 120 receives image information from the information processing device 200 via the connection cable C. The display unit 120 displays an image of the virtual space on the display section 121 of the display unit 120 based on the image information received from the information processing device 200.

[0021] The display unit 120 is disposed on the front surface of the lens holding portion 110. Fig. 3 is a functional block diagram of the display unit 120. As shown in Figs. 2 and 3, the display unit 120 includes a display section 121, a gaze measurement sensor 122, and a control device 123.

[0022] The display unit 121 includes a left eye display panel 121L and a right eye display panel 121R. The left eye display panel 121L is an example of a left eye display screen, and the right eye display panel 121R is an example of a right eye display screen.

[0023] The left eye display panel 121L displays an image for the left eye (hereinafter referred to as "left eye image") to the left eye of the user. The left eye display panel 121L is arranged to face the imaging lens 111L. Light emitted from the left eye display panel 121L passes through the imaging lens 111L and enters the left eye of the user. The right eye display panel 121R displays an image for the right eye (hereinafter referred to as "right eye image") to the right eye of the user. Light emitted from the right eye display panel 121R passes through the imaging lens 111R and enters the right eye of the user. The left eye image and the right eye image are both images in a virtual space.

[0024] The gaze measurement sensor 122 measures the gaze of each of the left and right eyes of a user using the display terminal 100. The gaze measurement sensor 122 includes, for example, various sensors for eye tracking using photocorneal reflex (PCCR). The gaze measurement sensor 122 may include, for example, a near-infrared LED for generating a light reflection point on the user's cornea, an eye tracking camera (e.g., an infrared camera) for capturing an image of the light reflection point generated on the cornea, and the like. In other words, the gaze measurement sensor 122 only needs to be able to measure the gaze of a user using the display terminal 100, and any known technology can be used.

[0025] The control device 123 includes a communication I / F 130 , a processor 131 , and a storage device 132 .

[0026] The communication I / F 130 transmits and receives information by communicating with the information processing device 200. For example, the communication I / F 130 communicates with the information processing device 200 via a connection cable C. The communication I / F 130 receives image information from the information processing device 200. The communication I / F 130 transmits data related to the gaze of the user's eyes measured by the gaze measurement sensor 122 (hereinafter referred to as "gaze data") to the information processing device 200. That is, the communication I / F 130 transmits gaze data of the left eye and gaze data of the right eye measured by the gaze measurement sensor 122 to the information processing device 200. For example, the gaze data includes data on the gaze direction and may further include data on the gaze point and gaze movement.

[0027] The processor 131 executes a program (hereinafter referred to as a "display terminal program") stored in the storage device 132, displays an image for the left eye corresponding to image information on the left eye display panel 121L, and displays an image for the right eye corresponding to image information on the right eye display panel 121R. The processor 131 includes, for example, one or more of a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), and an FPGA (Field-Programmable Gate Array).

[0028] A display terminal program executed by the processor 131 is installed in the storage device 132. The storage device 132 may also store data processed by the display terminal program, gaze data measured by the gaze measurement sensor 122, and the like.

[0029] The storage device 132 may include, for example, non-volatile and volatile semiconductor memories. The storage device 132 may include, for example, a random access memory (RAM), a read-only memory (ROM), a flash memory, an erasable programmable read-only memory (EPROM), or an electrically erasable programmable read-only memory (EEPROM). The storage device 132 may also include one or both of a hard disk drive (HDD) and a solid state drive (SSD).

[0030] The display terminal program may be provided by a computer-readable storage medium, which is a recording medium that can be read by a computer. The display terminal program is read from the computer-readable storage medium, installed in the storage device 132, which is also an example of a computer-readable storage medium, and executed by the processor 131. The display terminal program may also be in a form that is downloaded from an external device via a wired or wireless communication network. In other words, the display terminal program may be provided via a computer-readable storage medium or a telecommunications line such as a network.

[0031] Examples of computer-readable media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, etc. More specific examples of computer-readable media may include floppy disks, diskettes, hard disks, random access memories (RAMs), read-only memories (ROMs), erasable programmable read-only memories (EPROMs or flash memories), electrically erasable programmable read-only memories (EEPROMs), static random access memories (SRAMs), compact disc read-only memories (CD-ROMs), digital versatile discs (DVDs), Blu-ray (RTM) discs, memory sticks, integrated circuit cards, etc.

[0032] 4 is a functional block diagram of an information processing device 200 according to this embodiment. As shown in FIG. 4, the information processing device 200 sets design data required for designing eyeglass lenses for each user. The information processing device 200 includes a communication I / F 201, a storage device 202, and a processor 203.

[0033] The communication I / F 201 is a communication interface for communicating with an external device. The communication network through which the communication I / F 201 communicates may be wired, wireless, or both. As an example, the communication I / F 201 transmits and receives information to and from the display terminal 100 via a connection cable C. When the communication I / F 201 communicates with a device other than the display terminal 100, the communication I / F 201 may communicate with the device via a wired or wireless connection.

[0034] A display device 301 and an input device 302 may be connected to the information processing device 200. The input device 302 is a keyboard, a mouse, a touch panel provided on the display device 301, or the like. For example, a worker can cause the information processing device 200 to execute a specific process by operating the input device 302. The display device 301 can display information output from the information processing device 200. The information processing device 200 can display information (for example, visual information and / or design data) on the display device 301. The worker is, for example, a clerk at an eyeglass store.

[0035] The storage device 202 may include, for example, non-volatile and volatile semiconductor memory. The storage device 202 may include, for example, RAM, ROM, flash memory, EPROM, or EEPROM. The storage device 202 may also include either or both of an HDD and an SSD.

[0036] A program Pr (hereinafter referred to as a "data acquisition program") for acquiring design data necessary for designing eyeglass lenses using a virtual space is installed in the storage device 202. The storage device 202 also stores data to be processed by the data acquisition program Pr, etc. The data acquisition program Pr may be provided by a computer-readable storage medium, which is a recording medium that can be read by a computer. The data acquisition program Pr is read from the computer-readable storage medium, installed in the storage device 202, which is also an example of a computer-readable storage medium, and executed by the processor 203. The data acquisition program Pr may be downloaded from an external device via a wired or wireless communication network. In other words, the data acquisition program Pr may be provided via a computer-readable storage medium or an electric communication line such as a network.

[0037] The processor 203 includes, for example, one or more of a CPU, an MPU, a GPU, and an FPGA. The processor 203 executes a design data acquisition process to acquire design data according to the characteristics of the user's eyes by executing a data acquisition program Pr stored in the storage device 202. Fig. 5 is a functional block diagram of the processor 203 for executing the design data acquisition process according to this embodiment. As shown in Fig. 5, the processor 203 includes a display control unit 210 and an information processing unit 220.

[0038] The display control unit 210 causes the left eye display panel 121L to display an image for the left eye and the right eye display panel 121R to display an image for the right eye by transmitting image information of the virtual space to the display terminal 100. The display control unit 210 controls the display of each image on the left eye display panel 121L and the right eye display panel 121R.

[0039] When acquiring design data, the display control unit 210 places one or more specific objects (hereinafter referred to as "specific objects") in the virtual space of the virtual space image displayed on the display unit 121. The specific object may be an object of a predetermined shape that is easy to fixate on, such as a sphere or a cube. The specific object may also be an object that can be used to check for the presence or absence of a Landolt ring or character recognition.

[0040] The display control unit 210 executes a first display step of arranging an object of a predetermined shape that is easy to fixate, such as a sphere or a cube, as a specific object in the virtual space. After the first display step, the display control unit 210 executes a second display step of arranging both a Landolt ring and / or a character as a specific object in the virtual space and setting a blur distribution. Note that the first display step and the second display step are examples of an arranging step.

[0041] The information processing unit 220 acquires visual information, which is information on both or either the user's use of the line of sight and the user's aberration sensitivity in the virtual space displayed on the display terminal 200 by the display control unit 210, and calculates the design data necessary for designing eyeglass lenses based on the acquired visual information.

[0042] For example, the information processing unit 220 acquires, as visual information, information on both or either of how the user uses their line of sight in the virtual space when looking at a specific object and the user's aberration sensitivity when looking at the specific object in the virtual space. Then, the information processing unit 220 obtains design data according to the characteristics of the user's eyes based on the visual information.

[0043] For example, in the first display step, the information processing unit 220 acquires gaze data of each of the user's left and right eyes in the virtual space when the user looks at a specific object from the gaze measurement sensor 122. Then, the information processing unit 220 calculates a dominant eye level indicating the degree of the user's dominant eye based on the gaze data of each of the user's left and right eyes. The dominant eye level is an example of how the user uses their gaze.

[0044] For example, in the second display step, the information processing unit 220 acquires evaluation data indicating how the user's subjective view of the specific object appears when the user views the specific object with the blur distribution set. The information processing unit 220 then determines the acceptable level of the amount of blur (hereinafter referred to as the "acceptable level of blur") from the evaluation data. The acceptable level of blur is an example of aberration sensitivity. The information processing unit 220 then determines design data for the eyeglass lens based on either or both of the dominant eye level and the acceptable level of blur. The information processing unit 220 may use the dominant eye level as the design data, or may use the acceptable level of blur as the design data.

[0045] A method for setting design data using the design data acquisition process according to this embodiment will be described below. Fig. 6 is a diagram illustrating a rough flow of the design data setting method according to this embodiment. As shown in Fig. 6, the design data calculation method according to this embodiment roughly includes a first step (step S10) of examining how the left and right eyes are used, a second step (step S11) of examining aberration sensitivity after the first step, and a third step (step S12) of obtaining design data.

[0046] In the first step, a first display step is executed, and the information processing device 200 acquires gaze data of each of the left and right eyes of the user wearing the display terminal 100 from the gaze measurement sensor 122. Then, the information processing device 200 calculates the dominant eye level of each of the left and right eyes based on the acquired gaze data.

[0047] In the second step, a second display step is executed, and the information processing device 200 acquires evaluation data for each of the left and right eyes that indicates the subjective appearance when a user wearing the display terminal 100 views a specific object in a virtual space image for which a blur distribution is set. Then, the information processing device 200 calculates the acceptable level of the amount of blur for each of the left and right eyes based on the acquired evaluation data.

[0048] In the third step, the information processing device 200 uses the dominant eye level for each of the left and right eyes obtained in the first step and the allowable blur level for each of the left and right eyes obtained in the second step to obtain design data for the left and right eyeglass lenses to design appropriate lenses.

[0049] The first step, the second step, and the third step will be described below. Note that, hereinafter, the specific object displayed in the first step may be referred to as a "first specific object OA," and the specific object displayed in the second step may be referred to as a "second specific object OB." Note that the third step is an example of a calculation step. The first step and the second step are examples of an acquisition step.

[0050] <First Step> First, a user visits an eyeglass store that has the data acquisition system 1 installed to purchase eyeglass lenses that suit the characteristics of their eyes. The visiting user puts on the display terminal 100. Once the user puts on the display terminal 100, a staff member at the eyeglass store operates the input device 302 to start measuring gaze data in the first step. When an operation to start measuring gaze data is performed, the information processing device 200 sends image information to the display terminal 100, thereby causing the display unit 121 to display an image of a virtual space in which a first specific object OA is placed.

[0051] 7 is a diagram illustrating a measurement scene of gaze data in a virtual space according to this embodiment. In a first step, the display control unit 210 executes a first display step in which an object of a predetermined shape that is easy to fixate, such as a sphere or a cube, is placed in the virtual space as a first specific object OA. In order to measure gazes not only in the front direction but also in left, right, up, down, and diagonal directions, the display control unit 210 can place the first specific object OA at an arbitrary position (hereinafter referred to as an "inspection position") on a plane (hereinafter referred to as a "measurement plane") located a distance H in the front direction from the user in the virtual space.

[0052] In the example shown in Fig. 7, the display control unit 210 places a first specific object OA at test position K1, which is the center position of a circle with a radius r, and at test positions K2 to K9, which are arbitrary positions on the circumference of the circle, on a measurement plane along the vertical direction. Test position K1 is, for example, a position directly in front of the user. Fig. 8 is a diagram schematically showing how the first specific object OA appears in the virtual space to the left eye and the right eye.

[0053] 7 and 8, the inspection positions K2 to K9 are arranged at equal intervals. For example, the inspection position K2 is in the 0° direction, the inspection position K3 is in the 45° direction, the inspection position K4 is in the 90° direction, the inspection position K5 is in the 135° direction, the inspection position K6 is in the 180° direction, the inspection position K7 is in the 225° direction, the inspection position K8 is in the 270° direction, and the inspection position K9 is in the 315° direction.

[0054] 7 and 8 show all of the first specific objects OA, but in reality, the first specific objects OA are displayed one by one, as shown in Fig. 9. That is, the display control unit 210 does not simultaneously display multiple first specific objects OA as shown in Fig. 9, but displays one first specific object OA in the virtual space multiple times while changing the display position. For example, in the first display step, the display control unit 210 selects only one of the inspection positions K1 to K9 in any order or random order, and displays the first specific object OA in the virtual space only at the selected inspection position.

[0055] The information processing unit 220 acquires left and right gaze data of the user in the virtual space when the user looks at the first specific object OA for each first specific object OA. Then, the information processing unit 220 calculates the left and right dominant eye levels for each first specific object OA based on the acquired left and right gaze data. In other words, the information processing unit 220 acquires left and right gaze data for each test position and calculates the left and right dominant eye levels of the user for each test position based on the gaze data.

[0056] 10 is a flow diagram illustrating the flow of the operation of the first step according to this embodiment. The display control unit 210 selects one inspection position from among a plurality of inspection positions randomly or in a predetermined order as an inspection position (hereinafter referred to as the "first display position") at which the first specific object OA will be displayed (step S20). Note that, in step S20, an inspection position once selected as the first display position is excluded from selection of the first display position from the next time onward.

[0057] The display control unit 210 displays a first specific object OA at the selected first display position (step S21). When the first specific object OA is displayed, the information processing unit 220 acquires gaze data of each of the user's left and right eyes in the virtual space when the user views the first specific object OA from the gaze measurement sensor 122 (step S22). Based on the gaze data of each of the user's left and right eyes acquired in step S22, the information processing unit 220 calculates the dominant eye levels of each of the left and right eyes when viewing the first specific object OA (step S23).

[0058] The series of processes from step S20 to step S23 is executed until the dominant eye level is calculated at all the test positions K1 to K9. That is, the series of processes from step S20 to step S23 is executed every time the first display position is changed randomly or in any order, and ends when the dominant eye level is calculated at all the test positions K1 to K9.

[0059] An example of a method for calculating the dominant eye level will be described below. In step S22, the user is asked to constantly gaze at the first specific object OA for a predetermined time (hereinafter referred to as the "gaze time"). The gaze time is, for example, 5 seconds. During the gaze time, the information processing unit 220 acquires gaze data for each of the left and right eyes from the gaze measurement sensor 122. This gaze data is, for example, data indicating the gaze direction. The following description will be given taking as an example a case where the gaze data is a gaze vector.

[0060] The information processing unit 220 receives the gaze vector g of the right eye from the gaze measurement sensor 122. Ｒ and the gaze vector of the left eye gＬ The information processing unit 220 acquires the line-of-sight vector g Ｒ and the object vector V of the right eye ｅｒ→ｖｔ The angle θ between ｄｆＲ Calculate the right eye deviation angle θ ｄｆＲ is the angular deviation of the line of sight of the user's right eye with respect to the first specific object OA.

[0061] The information processing unit 220 calculates the line-of-sight vector g Ｌ and the left eye object vector V ｅｌ→ｖｔ The angle between ｄｆＬ Calculate the left eye deviation angle θ ｄｆＬ is the angular deviation of the line of sight of the user's left eye relative to the first specific object OA.

[0062] 11 is a diagram illustrating the right eye deviation angle and the left eye deviation angle according to this embodiment. ｅｒ→ｖｔ is a vector from the right eye to the first specific object OA. The object vector V ｅｌ→ｖｔ is a vector from the left eye toward the first specific object OA. ｄｆＲ indicates the amount of deviation of the line of sight of the right eye when the user looks at the first specific object OA. ｄｆＬ indicates the amount of deviation of the line of sight of the left eye when the user looks at the first specific object.

[0063] In this way, the information processing unit 220 calculates, as an example, the amount of deviation of the line of sight, the angle between the line of sight vector and the object vector. ｅｌ→ｖｔ and the object vector V of the right eye ｅｒ→ｖｔ is expressed by, for example, the following equation (1): Fig. 12 is a diagram illustrating an object vector according to this embodiment.

[0064]

[0065] Pvt indicates the first display position. The information processing unit 220 calculates the head position h and the head posture M as shown in FIG. ｖ→ｗ Using the matrixｖ el and the position of the right eye P ｖ er and the world space position P ｗ el, P ｗ er. Then, the information processing unit 220 converts the world space position P ｗ el, P ｗ er and the position (first display position) Pvt of the first specific object OA into equation (1), the object vector V of the left eye is obtained. ｅｌ→ｖｔ and the object vector V of the right eye ｅｒ→ｖｔ and get.

[0066] The information processing unit 220 calculates the head posture M ｖ→ｗ Using the matrix, the line of sight vector g ｖ r (right eye gaze vector), g ｖ l (the gaze vector of the left eye) is expressed as the world space vector g ｗ l, g ｗ The information processing unit 220 converts the left eye object vector V ｅｌ→ｖｔ and the world space vector g ｗ The inner product with l (V ｅｌ→ｖｔ ・g ｗ l), cos(θ ｄｆＬ ) is calculated. The information processing unit 220 also calculates the object vector V ｅｒ→ｖｔ and the world space vector g ｗ The inner product with r (V ｅｒ→ｖｔ ・g ｗ r), the cos(θ ｄｆＲ The information processing unit 220 calculates cos(θ ｄｆＬ ) and cos(θ ｄｆＲ ) to the left eye deviation angle θ ｄｆＬ and right eye deviation angle θ ｄｆＲ Ask for.

[0067] 13 is a diagram showing an example of changes in the right eye disparity angle and the left eye disparity angle during the gaze time according to this embodiment. As shown in FIG. 13 , when the right eye disparity angle θ ｄｆＲ and left eye deviation angle θ ｄｆＬfluctuates over time. This is because the gaze vectors of the right and left eyes fluctuate. Therefore, the information processing unit 220 calculates the gaze vectors only during a relatively stable time period during the gaze time as the right eye deviation angle θ ｄｆＲ and left eye deviation angle θ ｄｆＬ This is used as data to calculate

[0068] For example, the information processing unit 220 calculates the gaze vector during the period of the gaze time up until the time t1 during which the gaze vector is unstable has elapsed (hereinafter referred to as the “first period”) and the gaze vector during the period from the end to t2 seconds before (hereinafter referred to as the “second period”), based on the right eye deviation angle θ ｄｆＲ and left eye deviation angle θ ｄｆＬ The first period is, for example, a transition time required for the eyes to adapt, and is set to 1.0 second in Fig. 11. The second period is, for example, a movement time of the object to be displayed, and is set to 0.5 second in the example shown in Fig. 11.

[0069] Therefore, the information processing unit 220 calculates the final right eye misalignment angle θ as a representative value (for example, an average value) of the right eye misalignment angle for 3.5 seconds from 1 second after the start of gaze to 0.5 seconds before the end of gaze in FIG. 13 . ｄｆＲ In addition, the information processing unit 220 calculates the final left eye disparity angle θ as a representative value (for example, an average value) of the left eye disparity angle for 3.5 seconds from 1 second after the start of gaze to 0.5 seconds before the end of gaze in FIG. ｄｆＬ In the example shown in FIG. 13, the information processing unit 220 calculates the final right eye deviation angle θ ｄｆＲ = 1.37, and the final left eye deviation angle θ ｄｆＬ = 2.04°.

[0070] As illustrated in FIG. 14 , the information processing unit 220 calculates the final left eye deviation angle θ by calculating an average value over a predetermined time period W1 (for example, 0.5 seconds) that includes the time when the line of sight of the left eye is closest to the first specific object. ｄｆＬ Similarly, the information processing unit 220 may calculate the final right eye deviation angle θ by calculating an average value over a predetermined time period W2 (for example, 0.5 seconds) that includes the time when the line of sight of the right eye is closest to the first specific object.ｄｆＲ In the example shown in FIG. 14, the information processing unit 220 calculates the final right eye deviation angle θ ｄｆＲ = 1.15, and the final left eye deviation angle θ ｄｆＬ = 1.77°.

[0071] As illustrated in FIG. 15, the information processing unit 220 calculates the average vector g of the gaze vectors in a predetermined time span (for example, 0.5 seconds) that includes the time when the gaze of the left eye approaches the first specific object OA closest to the first specific object OA. ａｖｅ Calculate the mean vector g ａｖｅ and the left eye object vector V ｅｌ→ｖｔ The deviation angle from the left eye is the final left eye deviation angle θ ｄｆＬ Similarly, the information processing unit 220 may calculate the average vector g of the gaze vectors in a predetermined time span (for example, 0.5 seconds) that includes the time when the gaze of the right eye approaches the first specific object closest to the first specific object. ａｖｅ Calculate the mean vector g ａｖｅ and the object vector V of the right eye ｅｒ→ｖｔ The deviation angle from the right eye is the final right eye deviation angle θ ｄｆＲ It may also be possible to use the following.

[0072] The information processing unit 220 calculates the final right eye deviation angle θ ｄｆＲ and left eye deviation angle θ ｄｆＬ is calculated, the dominant eye level PE of the left eye is calculated using the following equation (2): Ｌ and right dominant eye level PE Ｒ The dominant eye level PE Ｌ and right dominant eye level PE Ｒ are set to add up to 1.

[0073]

[0074] The information processing unit 220 calculates, for example, the final right eye deviation angle θ ｄｆＲ and left eye deviation angle θ ｄｆＬ If each of these is less than a certain angle, the dominant eye level PE Ｌ = 1 / 2, PE Ｒ That is, when the final right eye disparity angle and the final left eye disparity angle are equal to or larger than a certain angle, the information processing unit 220 calculates the dominant eye level PEＬ , P.E. Ｒ If the angle is less than a certain angle, the dominant eye level PE Ｌ = 1 / 2, PE Ｒ = 1 / 2 may also be used.

[0075] The certain angle can be set arbitrarily, for example, (the visual angle of the object) / 2. However, this is not limited to this, and the information processing unit 220 calculates the dominant eye level PE Ｌ , P.E. Ｒ In this way, the information processing unit 220 may calculate the dominant eye level PE Ｌ , P.E. Ｒ is calculated for each of the first specific objects.

[0076] As shown in FIG. 11, the information processing unit 220 calculates the line-of-sight passing position P on the near clip plane for each of the left and right eyes. Ｌ , P Ｒ Calculate the line of sight position P Ｌ , P Ｒ is stored in the storage device 202. Fig. 16 is a diagram showing a near clipping plane according to this embodiment. Fig. 17 is a diagram showing a coordinate system of the near clipping plane according to this embodiment. The line of sight passing position P of the left eye Ｌ is the intersection of the line of sight vector of the left eye and the near clipping plane. Ｒ is the intersection of the line of sight vector of the right eye and the near clipping plane. Ｌ , P Ｒ is mainly used in the second step.

[0077] <Second Step> The display control unit 210 places a second specific object OB, which is either or both of a Landolt ring and a character (including a sentence), in the virtual space, and sets a blur distribution (aberration function) between the second specific object OB and the eye. The display control unit 210 displays one second specific object OB in the virtual space multiple times while changing the display position, and applies the blur distribution to each display. Note that, as in the first step, the display control unit 210 displays the second specific objects OB one by one at each of the test positions K1 to K9 in any order or random order.

[0078] The display control unit 210 sets the blur distribution for each second specific object OB. When applying the blur distribution, for example, the display control unit 210 applies the blur distribution by performing image processing on each frame of the moving image on the display unit 121.

[0079] 18, 19, and 20 are diagrams illustrating the blur distribution according to this embodiment. The blur distribution can be set arbitrarily. For example, as illustrated in FIG. 18, the blur distribution may be a function set so that the amount of blur increases linearly as one moves left and right from the center (a horizontal linear function). As illustrated in FIG. 19, the blur distribution may be a function set so that the amount of blur is zero in the central region and increases linearly as one moves left and right. As illustrated in FIG. 20, the blur distribution may be a function set so that the amount of blur increases linearly radially (a radial linear function).

[0080] The display control unit 210 sets a blur distribution and moves the blur distribution stepwise or continuously to gradually increase the amount of blur. The timing of the movement of the blur distribution may be controlled by an operator such as a clerk at an eyeglass store. For example, the operator moves the blur distribution stepwise or continuously to gradually increase the amount of blur. Figures 21 and 22 are diagrams that schematically show the movement of the blur distribution. In the following description, the blur distribution shown in Figure 18 or Figure 19 will be described.

[0081] 21 is a diagram showing a schematic diagram of a situation when obtaining an acceptable level of blur for the left eye. As an example, the display control unit 210 first sets the center position U of the blur distribution for the left eye at the line-of-sight passing position P Ｌ The center position U of the blur distribution for the right eye is set to the line of sight P R Arrange them according to the

[0082] Next, while the user is viewing the second specific object OB, the display control unit 210, as shown in FIG. 21, acquires the allowable level of blur for the left eye by gradually increasing the amount of blur by moving only the blur distribution displayed on the left eye display panel 121L for the left eye to the left or right.

[0083] Fig. 22 is a diagram showing a state in which the blur distribution for the left eye is located at its initial value. Fig. 23 is a diagram showing a state in which the blur distribution for the left eye has moved to the left. Fig. 24 is a diagram showing a state in which the blur distribution for the left eye has moved to the right. When the blur distribution for the left eye is moved, the blur distribution for the right eye displayed on the right eye display panel 121R remains in its initial state and does not move.

[0084] Point SP indicates the position of the gaze of the left eye when it passes through the blur distribution. The position of point SP does not change in Figures 22, 23, and 24, and the gaze of the left eye does not change even if the blur distribution of the left eye moves. The user visually recognizes the second specific object OB through the moving blur distribution of the left eye, and tells the operator their subjective evaluation, such as whether the second specific object OB is "clearly visible" or "the characters can be recognized, but they are difficult to read or take a long time to read, which is strange."

[0085] FIG. 25 is a schematic diagram illustrating the situation when calculating the acceptable level of blur for the right eye. As shown in FIG. 25 , when acquiring the acceptable level of blur for the right eye, the display control unit 210 gradually increases the amount of blur by shifting only the blur distribution displayed on the right eye display panel 121R left or right. At this time, the blur distribution for the left eye displayed on the left eye display panel 121L remains in its initial state and does not move. The user visually recognizes the second specific object OB through the moving blur distribution for the right eye and communicates to the operator a subjective evaluation of the second specific object, such as whether it is “clearly visible” or “the characters are recognizable but difficult to read, or it takes a long time to read, or there is some discomfort.” Note that if the blur distribution is a linear function in the radial direction as shown in FIG. 21 , the display control unit 210 may shift the distribution diagonally, not just left or right.

[0086] The subjective evaluation is divided into, for example, five subjective evaluation levels as shown in Fig. 26. The user may inform the worker of which of the five subjective evaluation levels shown in Fig. 26 the second specific object OB that the user is currently viewing belongs to.

[0087] The worker may acquire a subjective evaluation level from the user and input the acquired subjective evaluation level into the information processing device 200 by operating the input device 302. For example, the worker acquires a subjective evaluation level from the user each time the blur distribution is moved a predetermined distance and inputs the acquired subjective evaluation level into the information processing device 200. This allows the information processing unit 220 to acquire a subjective evaluation level for each position of the blur distribution. However, this is not limited to this, and the user may input the subjective evaluation level into the information processing device 200 by operating the input device 302.

[0088] The information processing unit 220 determines the acceptable level of the amount of blur from the subjective evaluation level of the user. For example, the information processing unit 220 sets the amount of blur when the subjective evaluation level is "3" as the acceptable level of the amount of blur.

[0089] Here, the information processing unit 220 has information on the amount of blur corresponding to the position of the blur distribution, for example. That is, when the blur distribution is moved, for example, the information processing unit 220 can grasp the current amount of blur from the position of the blur distribution. The information processing unit 220 acquires the amount of blur corresponding to the position of the blur distribution when the subjective evaluation level becomes "3" and sets this amount of blur as the blur amount tolerance level. Note that the blur amount tolerance level may be a value converted into the diopter deviation amount [D]. Note that when the blur amount tolerance level is 2.0D or higher, the information processing unit 220 may treat it as 2.0D.

[0090] The information processing unit 220 acquires the allowable level of blur for each of the left and right eyes. The information processing unit 220 also acquires the allowable level of blur for each of the left and right eyes for each of the second specific objects OB placed at the test positions K1 to K9. That is, the information processing unit 220 obtains the allowable level of blur for each of the left and right eyes for each test position.

[0091] 27 is a flow diagram illustrating the operation of the second step according to this embodiment. The display control unit 210 selects one inspection position from the plurality of inspection positions randomly or in a predetermined order as the inspection position (hereinafter referred to as the "second display position") at which the second specific object OB will be displayed (step S30). For example, the display control unit 210 may select the inspection positions as the second display positions in the same order as the order in which the first display positions were selected in step S20. Note that an inspection position once selected as the second display position in step S30 is excluded from subsequent selections of the second display position.

[0092] The display control unit 210 displays the second specific object OB at the selected second display position (step S31). The display control unit 210 displays the blur distribution at the initial position on the left eye display panel 121L and the right eye display panel 121R (step S32). Note that steps S31 and S32 may be performed simultaneously.

[0093] The display control unit 210 moves the blur distribution for the left eye by a predetermined distance (step S33). The information processing unit 220 indirectly or directly acquires from the user the subjective evaluation level when the user views the second specific object OB after the blur distribution has moved by the predetermined distance (step S34). The information processing device 200 repeats steps S33 and S34 a predetermined number of times to acquire the subjective evaluation level for each position of the blur distribution for the left eye. Note that the predetermined number of times can be adjusted arbitrarily by the user. The information processing unit 220 calculates the amount of blur when the subjective evaluation level for the left eye reaches "3" as the left eye blur amount tolerance level B. Ｌ (step S35).

[0094] Next, the display control unit 210 positions the blur distribution for the left eye at its initial position and moves the blur distribution for the right eye by a predetermined distance (step S36). After the blur distribution has moved by the predetermined distance, the information processing unit 220 indirectly or directly acquires from the user the subjective evaluation level when the user views the second specific object OB (step S37).

[0095] The information processing device 200 repeats steps S36 and S37 a predetermined number of times to obtain the subjective assessment level for each position of the blur distribution for the right eye. The information processing unit 220 calculates the amount of blur when the subjective assessment level for the right eye becomes "3" as the blur amount tolerance level B for the right eye. Ｒ (step S38).

[0096] The series of processes from step S30 to step S38 is executed until the dominant eye levels of the left and right eyes are calculated for all of the second specific objects. That is, the series of processes from step S20 to step S28 is executed until the permissible blur levels B of the left and right eyes are calculated for all of the test positions H1 to H9. Ｌ , B Ｒ It should be noted that in the second step, steps S36 to S38 may be executed first, followed by steps S33 to S35.

[0097] The information processing device 200 may repeat the series of processes in steps S33 and S34 and the series of processes in steps S36 and S37 until it acquires a subjective evaluation level of "3" instead of a predetermined number of times. <Third Step> By executing the first step and the second step, the information processing unit 220 acquires, as visual information, the dominant eye levels PE of the left and right eyes, as shown in FIG. Ｌ , P.E. Ｒ and the blur tolerance level B for each eye. Ｌ , B Ｒ The information processing unit 220 acquires the dominant eye level PE Ｌ , P.E. Ｒ and blur tolerance level B Ｌ , B Ｒ Based on this, the design tolerance ε of the power deviation in each line of sight of the spectacle lens of the left eye Ｌ and the design tolerance ε of the power deviation in each line of sight direction of the spectacle lens of the right eye. Ｒ The line of sight direction is the direction of the line of sight inspected when acquiring visual information, and corresponds to the direction of the inspection position.

[0098] Design tolerance ε for each line of sightＬ is the dominant eye level PE in that gaze direction Ｌ and blur tolerance level B Ｌ The design tolerance ε for each line of sight is set based on the following: Ｒ is the dominant eye level PE in that gaze direction Ｒ and blur tolerance level B Ｒ For example, the information processing unit 220 calculates the design tolerance ε Ｌ and design tolerance ε Ｒ Ask for.

[0099]

[0100] As shown in FIG. 29, the information processing unit 220 calculates the design tolerance ε of the power deviation in each line of sight direction. Ｌ and design tolerance ε Ｒ Then, the information processing unit 220 calculates the design tolerance ε for the power deviation in each line of sight direction. Ｌ and design tolerance ε Ｒ may be displayed on the display device 301 as design data for the eyeglass lens, may be sent to a pre-specified terminal (e.g., a terminal for ordering lenses), or may be stored in the storage device 202.

[0101] The designer or the design computer who designs the eyeglass lens using the design data output by the information processing unit 220 may, for example, determine a design tolerance ε Ｌ In P.E. Ｌ If PE is zero, the design allows for a deviation in power up to the allowable level of blur in the radial direction. Ｌ is 1, the lens is designed to aim for zero power deviation in that radial direction. That is, the designer or the design computer designs the spectacle lens so that the allowable aberration value at the time of design is large in the gaze direction where the allowable level of blur is large or the gaze direction where the dominant eye level is low. On the other hand, the designer or the design computer designs the spectacle lens so that the allowable aberration value is low in the gaze direction where the allowable level of blur is small or the gaze direction where the dominant eye level is high.

[0102] As an example, FIG. 30 shows the design tolerance ε for each line of sight direction in the lens for the left eye and the 45° direction among the line of sight directions. Ｌ As shown in Fig. 30, for example, in designing the power of a spectacle lens at a line of sight of 45° from the center, a designer or a design computer determines whether a deviation from a preset design power is within a design tolerance ε Ｌ Set it so that it does not exceed

[0103] As described above, the information processing device 200 according to this embodiment sets design data related to the user's eyes that is necessary for designing eyeglass lenses. The information processing device 200 includes a display control unit 210 and an information processing unit 220. The display control unit 210 places a specific object (specific object) in a virtual space displayed on the display unit 121. The information processing unit 220 acquires visual information, which is information on both or either of how the user uses each of the user's left and right eyes in the virtual space when viewing the specific object (e.g., dominant eye level) and the user's aberration sensitivity when viewing the specific object in the virtual space (e.g., acceptable amount of blur). The information processing unit 220 sets the design data based on the visual information.

[0104] In this way, visual information can be acquired using a virtual space, making it easy to acquire visual information in various environments, such as at any distance, in any position, with any brightness, with any blur distribution, etc. Furthermore, eyeglass lenses that are suited to the user can be designed based on the sensitivity of each of the user's eyes.

[0105] To design eyeglass lenses that suit a user, it is necessary to understand visual information such as the user's dominant eye and blur sensitivity. This visual information changes depending on the position of the object being viewed, etc. Therefore, to design eyeglass lenses that suit a user, it is necessary to measure visual information in various measurement environments, but changing the measurement environment in physical space is not easy and takes time. In this embodiment, an arbitrary measurement environment is created in a virtual space rather than a physical space, and visual information is measured in that measurement environment. With this configuration, visual information can be easily obtained, and eyeglass lenses that suit a user can be designed.

[0106] In the above description, the inspection positions are K1 to K9, but the present invention is not limited to this. That is, there is no particular limitation on the number of inspection positions as long as there is a plurality of inspection positions.

[0107] The execution order of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings, is not specifically indicated as "before," "prior to," or the like. It should also be noted that the execution order of each process can be implemented in any order, as long as the output of a previous process is not used in a subsequent process. Even if the operational flow in the claims, specifications, and drawings is described using "first," "next," or the like for convenience, this does not mean that the process must be implemented in this order. Furthermore, to the extent permitted by law, the disclosures of Japanese Patent Application No. 2024-100536 and all documents cited in the embodiments are incorporated herein by reference.

[0108] 1... data acquisition system, 100... display terminal, 200... information processing device, 102... main body, 120... display unit, 121... display section, 122... line-of-sight measurement sensor, 123... control device

Claims

1. An information processing device that uses a virtual space to acquire visual information, which is information on both or either the user's line of sight and the user's aberration sensitivity, and obtains design data necessary for designing eyeglass lenses based on the acquired visual information.

2. An information processing device as described in claim 1, comprising: a display control unit that places a specific object within a virtual space displayed on a display unit; and an information processing unit that acquires, as the visual information, information on both or either of the user's use of the line of sight within the virtual space when the user views the object and the aberration sensitivity when the user views the object in the virtual space, wherein the information processing unit determines the design data based on the visual information.

3. The information processing device described in claim 2, wherein the information processing unit calculates a dominant eye level indicating the degree of the user's dominant eye as the visual information based on gaze data including the direction of gaze of the user's left and right eyes in the virtual space when the user looks at the object.

4. The information processing device according to claim 3, wherein the information processing unit calculates the dominant eye level based on an angular deviation of the line of sight of the user's left eye relative to the object and an angular deviation of the line of sight of the user's right eye relative to the object.

5. The information processing device described in claim 2, wherein the display control unit sets an aberration function for a left eye display screen that presents an image to the user's left eye, and sets the aberration function for a right eye display screen that presents an image to the user's right eye, and the information processing unit acquires the user's aberration sensitivity from evaluation data that indicates the user's subjective view of the object when the user views the object when the aberration function is set.

6. The information processing device according to claim 5, wherein the aberration sensitivity is a tolerable amount of blur.

7. An information processing device according to any one of claims 2 to 6, wherein the display control unit displays one of the objects in the virtual space multiple times while changing the display position, and the information processing unit acquires the visual information for each of the objects and determines the design data for each of the display positions based on the visual information.

8. The information processing device of claim 2, wherein the display control unit executes a first display step of arranging an object of a predetermined shape as the object in the virtual space, and a second display step of arranging, after the first display step, both a Landolt ring and / or a character as the object in the virtual space and setting an aberration function, and the information processing unit acquires, as the visual information, the dominant eye levels of the user's left and right eyes in the virtual space when the user views the object arranged in the first display step, and the aberration sensitivity of the user when the user views the object arranged in the second display step, and calculates, as the design data, a tolerance for power deviation of the eyeglass lens based on the acquired visual information.

9. An information processing method for acquiring user design data necessary for designing eyeglass lenses, comprising: an arrangement step for arranging a specific object within a virtual space displayed on a display unit; an acquisition step for acquiring visual information which is information on both or either the manner in which the user uses their line of sight when viewing the object in the virtual space and the user's aberration sensitivity when viewing the object; and a calculation step for determining the design data based on the visual information.

10. The information processing method of claim 9, wherein the placement step includes: a first display step of displaying an object of a predetermined shape in the virtual space as the object; and a second display step of, after the first display step, placing both or either of a Landolt ring and a character as the object in the virtual space and setting an aberration function; the acquisition step acquires, as the visual information, the dominant eye levels of the user's left and right eyes when the user views the object placed in the first display step and the aberration sensitivity of the user when the user views the object displayed in the second display step; and the calculation step calculates, as the design data, a tolerance for power deviation of the eyeglass lens based on the dominant eye level and the aberration sensitivity.

11. A program for acquiring user design data necessary for designing eyeglass lenses, the program causing a computer to place a specific object in a virtual space displayed on a display unit, and to calculate the design data based on information on both or either of the user's line of sight when looking at the object in the virtual space and the user's aberration sensitivity when looking at the object.

Images