Apparatus, system, and method for determining one or more parameters of a lens

Abstract

To provide apparatuses, systems and methods for determining one or more parameters of a lens.SOLUTION: A method of determining one or more optical parameters of a lens is provided, comprising processing at least one depth map including depth information captured via the lens, and determining the one or more parameters of the lens based at least on the depth map.SELECTED DRAWING: Figure 8

Description

Technical Field

[0001] Cross-reference This application claims the benefit and priority of U.S. Provisional Patent Application No. 62 / 790,614, filed on January 10, 2019, with the title "APPARATUS, SYSTEM AND METHOD OF DETERMINING ONE OR MORE OPTICAL PARAMETERS OF A LENS (Apparatus, system, and method for determining one or more optical parameters of a lens)", the entire disclosure of which is incorporated herein by reference.

[0002] Technical Field The embodiments described herein generally relate to determining one or more parameters of a lens.

Background Art

[0003] Glasses and / or prescription glasses may include lenses assembled to a frame of the glasses.

[0004] The lens may have one or more optical parameters. The optical parameters of the lens may include, for example, spherical power, cylindrical power, and / or cylindrical axis.

[0005] Determining the spherical power, cylindrical power, and / or cylindrical axis of a lens may be useful, for example, when a user of glasses desires to duplicate the glasses and / or when a spare lens for the glasses is desired to be manufactured.

Summary of the Invention

Means for Solving the Problems

[0006] An apparatus, system, and / or method for determining one or more parameters of a lens are provided.

Brief Description of the Drawings

[0007] For simplicity and clarity, the elements shown in the diagrams are not necessarily drawn to scale. For example, the dimensions of some elements may be exaggerated relative to others for clarity. Furthermore, reference figures may be repeated in multiple diagrams to indicate corresponding or similar elements. A list of the diagrams is provided below.

[0008] [Figure 1] Figure 1 is an explanatory diagram of a schematic block diagram of a system according to several empirical embodiments. [Figure 2] Figure 2 is a schematic diagram of three measurement schemes according to several empirical embodiments. [Figure 3] Figure 3 is an explanatory diagram of a measurement system that may be implemented according to several demonstrative embodiments. [Figure 4] Figure 4 is a schematic diagram of a first depth map of a first spherical lens and a second depth map of a second spherical lens according to several empirical embodiments. [Figure 5] Figure 5 is a schematic diagram of a graph plotting depth values ​​versus spherical frequencies according to several empirical embodiments. [Figure 6] Figure 6 is an explanatory diagram of a schematic flowchart illustrating a method for determining the spherical power of a lens according to several empirical embodiments. [Figure 7] Figure 7 is a schematic diagram of a first depth map of a lens and a second depth map of the same lens according to several empirical embodiments. [Figure 8] Figure 8 is a schematic diagram of a measurement scheme according to several empirical embodiments. [Figure 9] Figure 9 is a schematic diagram of a measurement scheme according to several empirical embodiments. [Figure 10] Figure 10 is a schematic diagram of a measurement scheme according to several empirical embodiments. [Figure 11] Figure 11 is a schematic diagram of a measurement scheme according to several empirical embodiments. [Figure 12]Figure 12 is a schematic diagram of a first depth map of a cylindrical lens at a first angle and a second depth map of a cylindrical lens rotated at a second angle, according to several empirical embodiments. [Figure 13] Figure 13 is a schematic diagram of an ellipse with a lens angle according to several empirical embodiments. [Figure 14] Figure 14 is a schematic flowchart illustrating a method for determining one or more parameters of a lens according to several empirical embodiments. [Figure 15] Figure 15 is a schematic diagram of the product according to several empirical embodiments. [Modes for carrying out the invention]

[0009] The following detailed description includes numerous specific details to provide a complete understanding of several embodiments. However, it will be apparent to those skilled in the art that some embodiments may be carried out without these specific details. In other examples, well-known methods, procedures, components, units and / or circuits are not described in detail so as not to obscure the discussion.

[0010] Some parts of the following detailed description are presented in terms of algorithms and symbolic representations of operations on data bits or binary digital signals in computer memory. These descriptions and representations of algorithms may be techniques used by those skilled in the field to communicate the nature of their work to others skilled in the field.

[0011] An algorithm, as used herein and generally, is considered to be a self-consistent set of actions or operations that produce a desired result. These include the physical manipulation of physical quantities. While not always, these quantities usually take the form of electrical or magnetic signals that can be stored, transferred, combined, compared, and otherwise manipulated. It has been found that it is sometimes convenient, primarily for reasons of common usage, to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, etc. However, it should be understood that all these terms and similar terms are related to the appropriate physical quantities and are merely convenient labels applied to those quantities.

[0012] For example, discussions in this specification using terms such as “processing,” “computing,” “calculating,” “decision,” “establishment,” “analysis,” and “checking” may refer to operations and / or processes of a computer, computing platform, computing system, or other electronic computing device that manipulate and / or convert data represented as physical (e.g., electronic) quantities in the computer’s registers and / or memory to other data similarly represented as physical quantities in the computer’s registers and / or memory, or in other information storage media that may store instructions for performing operations and / or processes.

[0013] As used herein, the terms "plurality" and "a plurality" include, for example, "many" or "two or more." For example, "multiple items" includes two or more items.

[0014] References to "one embodiment," "one embodiment," "demonstrative embodiment," "various embodiments," etc., indicate that the described embodiment(s) may include certain features, structures, or characteristics, but not all embodiments necessarily include those specific features, structures, or characteristics. Furthermore, repeated use of the phrase "in one embodiment" does not necessarily refer to the same embodiment, but it may refer to the same embodiment.

[0015] When used herein, unless otherwise specified, the use of ordinal numbers such as "first," "second," "third," etc., to describe common objects merely indicates that different instances of similar objects are being referred to, and is not intended to imply that the objects described in this way must be in a predetermined order, whether temporally, spatially, sequentially, or otherwise.

[0016] Some embodiments may take the form of, for example, a completely hardware embodiment, a completely software embodiment, or an embodiment that includes elements of both hardware and software. Some embodiments may be implemented in software, including but not limited to firmware, resident software, microcode, etc.

[0017] Furthermore, some embodiments may take the form of a computer program product accessible from a computer-enabled medium or computer-readable medium that provides program code for use by or in connection with a computer or any instruction execution system. For example, the computer-enabled medium or computer-readable medium may be any device that can contain, store, communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device, and may include such a device.

[0018] In some demonstrative embodiments, the medium may be an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system (or apparatus or device), or a propagation medium. Some demonstrative examples of computer-readable media may include semiconductor memory or solid-state memory, magnetic tape, removable computer diskettes, random-access memory (RAM), read-only memory (ROM), flash memory, rigid magnetic disks, and optical disks. Some demonstrative examples of optical disks include compact disk-read-only memory (CD-ROM), compact disk-read / write (CD-R / W), and DVD.

[0019] In some demonstrative embodiments, a data processing system suitable for storing and / or executing program code may include at least one processor directly or indirectly coupled to memory elements, for example, via a system bus. The memory elements may include, for example, local memory used during the actual execution of the program code, bulk storage, and cache memory which may provide temporary storage for at least some program code to reduce the number of times the code must be retrieved from bulk storage during execution.

[0020] In some demonstrative embodiments, input / output devices or I / O devices (including, but not limited to, keyboards, displays, and pointing devices) may be coupled to the system directly or via an intermediary I / O controller. In some demonstrative embodiments, a network adapter may be coupled to the system so that the data processing system can be coupled to other data processing systems or remote printers or storage devices, for example, via an intermediary private or public network. In some demonstrative embodiments, modems, cable modems, and Ethernet cards are demonstrative examples of types of network adapters. Other suitable components may be used.

[0021] Some embodiments may include one or more wired or wireless links, utilize one or more components of wireless communication, utilize one or more methods or protocols of wireless communication, and so on. Some embodiments may utilize wired communication and / or wireless communication.

[0022] Some embodiments may be used in combination with various devices and systems, such as mobile phones, smartphones, mobile computers, laptop computers, notebook computers, tablet computers, handheld computers, handheld devices, personal digital assistant (PDA) devices, handheld PDA devices, mobile or portable devices, non-mobile or non-portable devices, cellular phones, wireless phones, devices having one or more internal and / or external antennas, wireless handheld devices, etc.

[0023] Please refer to Figure 1, which schematically shows block diagrams of several empirical embodiments of System 100.

[0024] As shown in Figure 1, in some demonstrative embodiments, the system 100 may include a computing device 102.

[0025] In some demonstrative embodiments, device 102 may be implemented using appropriate hardware and / or software components, such as a processor, controller, memory unit, storage unit, input unit, output unit, communication unit, operating system, and application.

[0026] In some demonstrative embodiments, device 102 may include, for example, a computing device, a mobile device, a mobile phone, a smartphone, a cellular phone, a notebook, a mobile computer, a laptop computer, a notebook computer, a tablet computer, a handheld computer, a handheld device, a PDA device, a handheld PDA device, a wireless communication device, and the like.

[0027] In some demonstrative embodiments, device 102 may include, for example, one or more of the following: a processor 191, an input unit 192, an output unit 193, a memory unit 194, and / or a storage unit 195. Device 102 may optionally include other suitable hardware and / or software components. In some demonstrative embodiments, some or all of one or more components of device 102 may be housed in a common housing or packaging, interconnected or operably associated using one or more wired or wireless links. In other embodiments, one or more components of device 102 may be distributed across multiple or separate devices.

[0028] In some demonstrative embodiments, the processor 191 may include, for example, a central processing unit (CPU), a digital signal processor (DSP), one or more processor cores, a single-core processor, a dual-core processor, a multi-core processor, a microprocessor, a host processor, a controller, multiple processors or controllers, a chip, a microchip, one or more circuits, electrical circuits, logic units, integrated circuits (ICs), application-specific integrated circuits (ASICs), or other suitable multipurpose or application-specific processors or controllers. The processor 191 may execute instructions for, for example, the operating system (OS) of device 102 and / or one or more suitable applications.

[0029] In some demonstrative embodiments, the input unit 192 may include, for example, a keyboard, keypad, mouse, touchscreen, touchpad, trackball, stylus, microphone, or other suitable pointing or input device. The output unit 193 may include, for example, a monitor, screen, touchscreen, flat panel display, light-emitting diode (LED) display unit, liquid crystal display (LCD) display unit, plasma display unit, one or more audio speakers or earphones, or other suitable output device.

[0030] In some demonstrative embodiments, the memory unit 194 includes, for example, random access memory (RAM), read-only memory (ROM), dynamic RAM (DRAM), synchronous DRAM (SD-RAM), flash memory, volatile memory, non-volatile memory, cache memory, buffers, short-term memory units, long-term memory units, or other suitable memory units. The storage unit 195 may include, for example, a hard disk drive, a solid-state drive (SSD), or other suitable removable or non-removable storage units. The memory unit 194 and / or the storage unit 195 may store, for example, data processed by device 102.

[0031] In some demonstrative embodiments, device 102 may be configured to communicate with one or more other devices via a wireless network and / or a wired network 103.

[0032] In some demonstrative embodiments, network 103 may include a wired network, a local area network (LAN), a wireless LAN (WLAN) network, a wireless network, a cellular network, a wireless fidelity (Wi-Fi) network, an IR network, a Bluetooth® (BT) network, and the like.

[0033] In some demonstrative embodiments, device 102 may allow one or more users to interact with one or more processes, applications and / or modules of device 102, as described herein, for example.

[0034] In some demonstrative embodiments, device 102 may be configured to perform and / or execute one or more operations, modules, processes, procedures, etc.

[0035] In some demonstrative embodiments, the device 102 may be configured to determine one or more parameters, such as one or more optical parameters and / or other parameters, of a lens, such as a vision correction lens and / or any other type of lens, provided, for example, by a user of the device 102 or any other user, as described below.

[0036] In some demonstrative embodiments, the vision-correcting lens may include a lens configured to improve visual acuity.

[0037] In one example, the vision-correcting lens may be assembled into, or configured to be assembled into, eyeglasses belonging to the user of device 102 or any other user.

[0038] In another example, vision-correcting lenses may include contact lenses, intraocular lenses, swimming goggle lenses, and the like.

[0039] In another example, the vision-correcting lens may include any other optical lens configured to improve vision, such as a prescription lens or any other lens.

[0040] Several demonstrative embodiments are described herein relating to determining one or more parameters of vision-correcting lenses and / or eyeglasses. In other embodiments, one or more of the apparatus, systems and / or methods described herein may be used to determine one or more parameters of any other lenses and / or any other devices including one or more lenses.

[0041] In some demonstrative embodiments, the system 100 may be configured to perform lens analysis using a lensmeter or lens meter without using, for example, auxiliary optical means, as described below.

[0042] In some demonstrative embodiments, one or more parameters of a lens may include the spherical power (also called “sphere”), cylindrical power (also called “cylinder”), cylindrical axis (also called “axis”), prism power (also called “prism”), additional power or additive power (also called “addition”), lens center, lens distortion, and / or any other parameters of the lens.

[0043] In some demonstrative embodiments, the system 100 may be configured to analyze, for example, the focal refractive power and / or near focal length of a spherical lens, for example, the focal refractive power, cylindrical axis and / or near focal length of a cylindrical lens, the difference in focal lengths across the lens, for example, the difference in focal lengths between the "far," "intermediate," and / or "near" portions of the lens, a focal length map of the entire lens, and / or any other parameters of the lens, as described below.

[0044] In some demonstrative embodiments, the system 100 may include at least one service, module, controller, and / or application 160 configured to determine one or more parameters of a lens provided by a user of device 102, as described below, for example.

[0045] In some demonstrative embodiments, application 160 may include and / or perform the functionality of a lens measuring module configured to perform, for example, lens analysis using a lens meter or lens measuring instrument.

[0046] In some demonstrative embodiments, application 160 may include, or be implemented as, software, software modules, applications, programs, subroutines, instructions, instruction sets, computing code, words, values, symbols, etc.

[0047] In some demonstrative embodiments, application 160 may include a local application executed by device 102. For example, memory unit 194 and / or storage unit 195 may store instructions that bring application 160, as described below, and / or processor 191 may be configured to execute instructions that bring application 160 and / or to perform one or more calculations and / or processes of application 160.

[0048] In other embodiments, application 160 may include a remote application run on any suitable computing system, for example, server 170.

[0049] In some demonstrative embodiments, server 170 may include at least a remote server, a web-based server, a cloud server, and / or any other server.

[0050] In some demonstrative embodiments, the server 170 may include a suitable memory and / or storage unit 174 that stores instructions for bringing the application 160 thereon, and a suitable processor 171 for executing those instructions, as described below, for example.

[0051] In some demonstrative embodiments, application 160 may include a combination of remote and local applications.

[0052] In one example, application 160 may be downloaded and / or received by the user of device 102 from another computing system, such as server 170, so that application 160 can be run locally by the user of device 102. For example, instructions may be received and stored, for example, temporarily, in the memory of device 102 or any suitable short-term memory or buffer before being executed by, for example, the processor 191 of device 102.

[0053] In another example, application 160 may include a front-end that runs locally on device 102 and a back-end that runs on server 170. For example, the front-end may include and / or be implemented as a local application, web application, website, web client, such as a Hypertext Markup Language (HTML) web application.

[0054] For example, as described below, one or more first operations determining one or more parameters of the lens may be performed locally by device 102, and / or one or more second operations determining one or more parameters of the lens may be performed remotely by server 170, for example.

[0055] In other embodiments, application 160 may include any other suitable computing arrangement and / or computing scheme.

[0056] In some demonstrative embodiments, the system 100 may include an interface 110 that interfaces between the user of device 102 and one or more elements of the system 100, such as an application 160.

[0057] In some demonstrative embodiments, interface 110 may be implemented using any suitable hardware and / or software components, such as a processor, controller, memory unit, storage unit, input unit, output unit, communication unit, operating system, and / or application.

[0058] In some embodiments, interface 110 may be implemented as part of any suitable module, system, device, or component of system 100.

[0059] In other embodiments, interface 110 may be implemented as a separate element of system 100.

[0060] In some demonstrative embodiments, interface 110 may be implemented as part of device 102. For example, interface 110 may be associated with and / or included as part of device 102.

[0061] In one example, interface 110 may be implemented, for example, as middleware and / or as part of any suitable application on device 102. For example, interface 110 may be implemented as part of application 160 and / or as part of the OS of device 102.

[0062] In some demonstrative embodiments, interface 160 may be implemented as part of server 170. For example, interface 110 may be associated with and / or included as part of server 170.

[0063] In one example, interface 110 may include, or be part of, a web-based application, website, web page, plugin, ActiveX control, rich content component, such as a Flash or Shockwave component.

[0064] In some demonstrative embodiments, interface 110 may be associated with and / or include, for example, a gateway (GW) 112 and / or an application programming interface (API) 114 for communicating information and / or information between elements of system 100 and / or with one or more other parties, users, applications and / or systems, such as internal or external parties, users, applications and / or systems.

[0065] In some embodiments, interface 110 may include any suitable graphical user interface (GUI) 116 and / or any other suitable interface.

[0066] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of a lens based on a depth map acquired through the lens, for example, as described below.

[0067] In some demonstrative embodiments, the lens may include a spherical lens, a cylindrical lens (also called a “spherical cylindrical lens” or “spherical cylindrical lens”), a bifocal (progressive) lens, a multifocal lens, or any other type of lens.

[0068] In some demonstrative embodiments, device 102 may include a depth mapper 118 (also called a “depth sensor”) or any other device or system configured to acquire, create, and / or determine a depth map of the environment, as described below, for example.

[0069] In one example, application 160 may be configured to locally determine one or more parameters of the lens, for example, if application 160 is implemented locally by device 102. According to this example, depth mapper 118 may be configured to create a depth map, as described below, for example, and application 160 may be configured to receive a depth map from depth mapper 118 and determine one or more parameters of the lens.

[0070] In another example, for instance, if application 160 is implemented by server 170, or if the backend of application 160 is implemented by server 170 and the frontend of application 160 is implemented by device 102, application 160 may be configured to remotely determine one or more parameters of the lens. In this example, depth mapper 118 may be configured to create a depth map, the frontend of application 160 may be configured to receive the depth map, and server 170 and / or the backend of application 160 may be configured to determine one or more parameters of the lens based on the information received from the frontend of application 160.

[0071] In one example, the front end of device 102 and / or application 160 may be configured to send a depth map and optionally additional information, such as those described below, to a server 170 via network 103, and / or the back end of server 170 and / or application 160 may be configured to receive the depth map and determine one or more lens parameters based on the depth map from device 102, for example.

[0072] In some demonstrative embodiments, the depth mapper 118 may include two or more cameras, e.g., dual cameras, stereo cameras, multiple cameras, or any other camera system configured to create a depth map, as described below, for example.

[0073] In some demonstrative embodiments, the depth mapper 118 may include a structured optical stereo camera, as described below, for example.

[0074] In some demonstrative embodiments, the depth mapper 118 may include, for example, an infrared (IR) source and an IR sensor in a structured optical system, as described below.

[0075] In some demonstrative embodiments, the depth mapper 118 may include a time-of-flight (ToF) depth sensor, which may be configured to determine the depth map according to ToF measurements, as described below, for example.

[0076] In some demonstrative embodiments, the depth mapper 118 may include any other additional or alternative sensors, elements, and / or components configured to create a depth map of the environment.

[0077] In one example, one or more calculations described herein may be suitable for implementations using multiple different types of depth mappers 118. For example, one or more calculations may differ slightly for different types, for example, based on IR wavelength and / or visible light spectrum.

[0078] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of a lens based on a depth map acquired by depth mapper 118, for example, when the lens is positioned to change the depth map created by depth mapper 118, using a standard configuration, for example, as described below.

[0079] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of a lens based on techniques, calculations, methods and / or algorithms, which may be configured with respect to one or more features (aspects) of the spherical cylindrical lens, for example, as described below.

[0080] In some empirical embodiments, calculations for a spherical cylindrical lens may be generalized to, for example, one or more other types of lenses, such as more complex lenses, such as an imager (imaging device), assuming, for example, that the camera aperture of the depth mapper 118 may be relatively small, and the fact that the camera aperture of the depth mapper 118 may be relatively small may support local sampling of the lens under test.

[0081] In some demonstrative embodiments, the lens may be modeled and / or considered as a spherical cylindrical lens, for example, as described below, where three parameters are determined, such as spherical power, cylindrical power, and cylindrical axis.

[0082] In one example, the three parameters described above may be defined, for example, as the low-order Zernike aberration of an ideal lens, and / or in any other arbitrary way.

[0083] In one example, the creation of a depth map may be based on, for instance, the parallax of a point captured or projected from different coordinates in the real world.

[0084] In some demonstrative embodiments, application 160 may be configured to use depth information and / or depth data acquired through the lens to determine, for example, one or more parameters of the lens, as described below.

[0085] In some demonstrative embodiments, application 160 may be configured to process at least one depth map containing depth information acquired through a lens, as described below, for example.

[0086] In some demonstrative embodiments, application 160 may be configured to determine one or more lens parameters based on depth information, as described below, for example.

[0087] In some demonstrative embodiments, one or more parameters of the lens may include, for example, the spherical power of the lens, the cylindrical power of the lens, the cylindrical axis of the lens, the sign of the lens, and / or the optical center of the lens, as described below.

[0088] In other embodiments, any other additional or alternative parameters of the lens may be determined.

[0089] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of a lens, for example, a spherical cylindrical lens, as described below.

[0090] In some demonstrative embodiments, application 160 may be configured to determine one or more lens parameters for bifocal and / or multifocal lenses, as described below, for example.

[0091] In some demonstrative embodiments, application 160 may be configured, for example, via GUI 116, to instruct the user to position a lens between the depth sensor 118 and an object so that the depth information includes depth information of the object acquired by the depth sensor 118 via the lens, as described below.

[0092] In some demonstrative embodiments, application 160 may be configured to identify one or more depth values ​​acquired through a lens in a depth map, for example as described below, and to determine one or more parameters of the lens based on the one or more depth values ​​acquired through that lens.

[0093] In some demonstrative embodiments, application 160 may be configured to identify a depth value corresponding to an object in a depth map, and to determine one or more parameters of a lens based on the depth value corresponding to that object, a first distance, and a second distance, as described below, for example.

[0094] In some demonstrative embodiments, the first distance may be the distance between the object and the depth sensor 118, as described below, for example.

[0095] In some demonstrative embodiments, the second distance may be the distance between the depth sensor and the lens, as described below, for example.

[0096] In some demonstrative embodiments, application 160 may be configured to identify depth information acquired without a lens in a depth map, for example, as described below, and to determine the first distance and / or second distance based on that depth information acquired without a lens.

[0097] In some demonstrative embodiments, application 160 may be configured to identify areas (regions) in the depth map that correspond to elements on the surface of the lens, and to determine the second distance based on the depth information in the areas corresponding to those elements, as described below, for example.

[0098] In some demonstrative embodiments, the elements described above may include, for example, an opaque rim for the lens, a frame for holding the lens, and / or any other elements attached to and / or on the same plane as the lens, as described below.

[0099] In some demonstrative embodiments, application 160 may be configured to identify an area in the depth map corresponding to a surface containing an object, as described below, for example, and to determine a second distance based on depth information in the area corresponding to the surface containing that element.

[0100] In some demonstrative embodiments, the object may include walls, as described below, for example.

[0101] In other embodiments, the object may include any other flat surface behind the lens, such as a table or floor.

[0102] In some demonstrative embodiments, application 160 may be configured to instruct the user to position and / or move the depth sensor 118 and / or lens between one or more relative positions, as described below, for example.

[0103] In some demonstrative embodiments, application 160 may be configured to instruct the user to move the depth sensor 118 and / or lens until it reaches a specific setting of, for example, a first distance and / or a second distance, as described below.

[0104] In some demonstrative embodiments, application 160 may be configured to instruct the user to position a lens on the mirror such that, for example, the first distance may include an optical distance where the first distance is twice the distance between the depth sensor 118 and the mirror, as described below.

[0105] In some demonstrative embodiments, application 160 may be configured to instruct the user to position the lens relative to the depth sensor 118, for example, by moving the depth sensor 118 and / or lens, such that the second distance may be half the first distance, as described below, for example.

[0106] In some demonstrative embodiments, application 160 may be configured to identify an area corresponding to a lens in a depth map, as described below, for example, and to determine one or more parameters of the lens based on the dimensions of that area.

[0107] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of a lens based on multiple different depth maps acquired through the lens, for example, as described below.

[0108] In some demonstrative embodiments, the above-mentioned multiple different depth maps may include, for example, a first depth map and a second depth map, as described below.

[0109] In some demonstrative embodiments, for example, as described below, a first depth map may be acquired via the lens when the lens is in a first position relative to the depth sensor 118, and a second depth map may be acquired via the lens when the lens is in a second position different from the first position relative to the depth sensor 118.

[0110] In some demonstrative embodiments, as described below, for example, the first depth map may include a depth map acquired through the lens when the lens is at a first rotation angle in the lens plane, and the second depth map may include a depth map acquired through the lens when the lens is at a second rotation angle in the lens plane.

[0111] In some demonstrative embodiments, application 160 may be configured to determine the cylindrical axis and / or cylindrical power of the lens based on, for example, a first depth map and a second depth map, as described below.

[0112] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of a lens based on a single depth map acquired through the lens, for example, as described below.

[0113] In some demonstrative embodiments, application 160 may be configured to identify, for example, one or more first depth values ​​acquired through a lens and one or more second depth values ​​acquired without a lens in a depth map, and to determine, for example, one or more parameters of the lens based on these first and second depth values, as described below.

[0114] In some demonstrative embodiments, application 160 may be configured to process image information of an image of an object acquired by the camera through a lens when the lens is between the camera and the object, for example, as described below.

[0115] In some demonstrative embodiments, application 160 may be configured to determine a magnification value based on, for example, the magnification between the imaged dimensions of an object and the actual dimensions of an object, as described below.

[0116] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of a lens based on, for example, depth information and magnification values, as described below.

[0117] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of a lens based on one or more configuration parameters of a depth sensor 118 (i.e., the depth map is provided from the depth sensor 118), for example, as described below.

[0118] In some demonstrative embodiments, one or more of the above configuration parameters may include, for example, the type of depth sensor 118, as described below.

[0119] In some demonstrative embodiments, one or more of the above configuration parameters may include, for example, the wavelength of electromagnetic radiation used by the depth sensor 118 to generate a depth map, as described below.

[0120] For example, if the lens is made of an optical glass material, such as BK7 material, the lens may have a first refractive index of, for example, 1.5185 for a first wavelength, for example, 0.55 micrometers, and / or a second refractive index of, for example, 1.5108 for a second wavelength, for example, 0.8 micrometers. According to this example, calculation adjustments can be applied based on wavelength, and for example, an adjustment of about 0.08 diopters can be made for a spherical plano-convex / concave lens with a radius of 100 mm.

[0121] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of a lens based on predefined (predetermined) mapping information for mapping between multiple depth map measurements and multiple estimated optical parameters, for example, as described below.

[0122] In some demonstrative embodiments, as described below, for example, application 160 may be configured to determine one or more parameters of a lens by processing depth information as depth information for structured optical depth measurement, for example, when the depth mapper 118 includes a structured optical sensor.

[0123] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of a lens, for example, by processing depth information as depth information for ToF depth measurement, for example, when the depth mapper 118 includes a ToF sensor, as described below.

[0124] In some demonstrative embodiments, application 160 may be configured to determine, for example, one or more parameters of a lens using depth information of a reference object acquired through the lens, as described below.

[0125] In some demonstrative embodiments, the lens may be placed between the depth mapper 118 and the reference object to acquire depth information of the reference object via the lens, for example, as described below.

[0126] In one example, the depth information of a reference object acquired through a lens may differ from the depth information of a reference object acquired without a lens, for example, without a lens.

[0127] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of a lens based on, for example, an approximate formula for a thin lens, such as the following:

number

[0128] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of a lens, for example, based on depth information via the lens and a statistical model, instead of or in addition to Equation 1, as described below.

[0129] In some demonstrative embodiments, Application 160 may be configured to use a dataset of measured lens power versus depth data, as described below, for example, to fit this dataset to an empirical model using, for example, data interpolation or an arbitrary learning process, and to use that dataset to predict, for example, the lens power of the lens under test.

[0130] In some demonstrative embodiments, the accuracy of one or more estimated parameters of the lens may be based, for example, on the resolution of the depth map, which may differ for different systems and / or depth mappers.

[0131] In one example, using a composition containing several different depth maps may improve the accuracy of one or more estimated parameters of a lens, as described below, for example.

[0132] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of a lens based on, for example, depth information of a reference object and depth information of the reference object through the lens, as described below.

[0133] In some demonstrative embodiments, application 160 may be configured to trigger, control, and / or cause depth mapper 118 to acquire a first depth map containing depth information of a reference object when acquired without a lens, and a second depth map containing depth information of the reference object acquired through a lens, as described below, for example.

[0134] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of a lens based on, for example, a first depth map and a second depth map, as described below.

[0135] In some demonstrative embodiments, application 160 may be configured to, for example, determine a first estimated distance of a reference object when it is captured without a lens, based on first depth information, for example; determine a second estimated distance of the reference object when it is captured through a lens, based on second depth information, for example; and determine one or more parameters of the lens, for example, based on the first and second estimated distances, for example.

[0136] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of a lens based on multiple depth maps corresponding to each of multiple rotations of the lens ("lens rotations"), for example, as described below.

[0137] In some demonstrative embodiments, the rotation of the lens may include, for example, a relative rotation and / or angle between the lens and the depth mapper 118 about at least one axis, as described below.

[0138] In some demonstrative embodiments, for example, the rotation of the lens may include a relative rotation and / or angle with respect to the lens axis, the axis of the depth mapper 118, and / or at least one predefined axis, as described below, for example.

[0139] In some demonstrative embodiments, application 160 may be configured to instruct the user of device 102 to change the relative rotation between device 102 and the lens, for example, via GUI 116 or any other interface, as described below, according to multiple lens rotations of the lens.

[0140] In one example, the user of device 102 may be instructed to change the relative rotation of the lens by rotating the lens itself.

[0141] In another example, the user of device 102 may be instructed to change the relative rotation of the lens by rotating device 102.

[0142] In another example, the user of device 102 may be instructed to change the relative rotation of the lens by rotating both the lens and device 102.

[0143] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of the lens based on, for example, an image of the reference object through the lens, such as a red, green, blue (RGB) image and / or any other type of image, in addition to depth information of the reference object through the lens, as described below, for example.

[0144] In some demonstrative embodiments, application 160 may be configured to trigger, control, and / or cause the depth mapper 118 to, for example, acquire a depth map containing depth information and an image of the reference object using, for example, a camera 119 without a lens when the lens is not between the depth mapper 118 and the reference object, and to acquire a second image of the reference object via the lens using, for example, a camera 119, as described below.

[0145] In one example, the camera 119 may be part of the depth mapper 118. In another example, the camera 119 and the depth mapper 118 may be implemented as separate elements of the device 102.

[0146] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of a lens based on a depth map and a first and second image, for example, as described below.

[0147] In some demonstrative embodiments, the reference object may include one or more features, each having one or more sizes, as described below, for example.

[0148] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of a lens based on a comparison, for example, of one or more first sizes of features in a first image and one or more second sizes of features in a second image, as described below.

[0149] In some demonstrative embodiments, the lens may include a spherical lens, as described below, for example, and application 160 may be configured to determine one or more parameters of the spherical lens, for example, by determining the spherical power of the spherical lens.

[0150] In some demonstrative embodiments, application 160 may determine the spherical power of a spherical lens based on, for example, a first depth map containing depth information of a reference object and a second depth map containing depth information of the reference object through the lens, as described below.

[0151] Please refer to Figure 2, which schematically shows measurement schemes 210, 220, and 230 according to several empirical embodiments.

[0152] In some demonstrative embodiments, measurement schemes 210, 220, and 230 may be used to determine the spherical power of a spherical lens.

[0153] As shown in Figure 2, the depth mapper 218 may include elements represented as "Q1 and Q2," such as a dual camera, a stereo camera, or an IR source and sensors of a structured optical system, which may be used to acquire a depth map containing depth map information corresponding to a reference object 212 located at a distance represented as "D1" from the depth mapper 218, such as a wall.

[0154] As shown in the measurement scheme 210, the depth mapper 218 may determine the depth distance represented as "D3" from a point represented as "p" on the reference object 212, for example, when there is no object between the reference object 212 and the depth mapper 218.

[0155] As shown in the measurement scheme 220, the acquired depth distance D3 of point p may be changed by placing a lens 214, for example a negative lens, between the reference object 212 and the depth mapper 218 at a distance represented as "D2" from the depth mapper 218. For example, the depth information of point p from the depth mapper 218 via the lens 214 may represent a position 217.

[0156] As shown in the measurement scheme 230, the acquired depth distance D3 of point p may be changed by placing a lens 216, for example a positive lens, between the reference object 212 and the depth mapper 218 at a distance D2 from the depth mapper 218. For example, the depth information of point P from the depth mapper 218 via the lens 216 may represent a position 219.

[0157] In one example, object 212 may be located at a distance D1 from depth mapper 218, optical lenses 214 and / or 216 may be positioned between object 212 and depth mapper 218, for example at a distance D2, and depth information via lenses 214 and / or 216, for example depth distance D3, may be different from D1 and D2 and / or depend on the optical parameters of the lens under test.

[0158] In one example, the relationship between the spherical power, represented as P, of a vision-correcting lens and the distances D1, D2, and D3 may be determined, for example, as follows:

number

[0159] For example, substituting these values ​​into Equation 1 may result in the following:

number

[0160] In one example, Equation 3 may be suitable for a divergent lens, such as a negative lens, e.g., optical lens 214 in measurement scheme 220. However, similar calculations may be performed for a converging lens, such as a positive lens, e.g., optical lens 216 in measurement scheme 230.

[0161] In some demonstrative embodiments, for example, in one or more scenarios and / or measurement schemes, the distance D2 between the lens 214 and the depth mapper 218 may be substantially equal to zero, for example, D2 = 0. For example, in one scenario, the lens 214 may be positioned close to or on (touching) the depth mapper 118. 118.

[0162] In some demonstrative embodiments, the depth mapper 218 may analyze and / or sense the object 212 through the lens 214, for example, when the distance D2 is zero.

[0163] In one example, both the first and second cameras of the depth mapper 218 may capture object 212 via lens 214, for example, if the depth mapper 218 is implemented using two cameras.

[0164] In another example, the structured light projector of the depth mapper 218 may project a structured object through the lens 214, for example, when the depth mapper 218 is implemented using a structured light projector, and the depth sensor of the depth mapper 218 may sense the structured object through the lens 214. For example, the signal from the depth sensor of the depth mapper 218 may pass through the lens 214 and be returned to the IR camera of the depth mapper 218 through the lens 214.

[0165] According to these embodiments, application 160 (Figure 1) may be configured to determine one or more optical parameters of lens 214, for example, according to equation 3, when the value of distance D2 is zero.

[0166] In some demonstrative embodiments, the depth mapper 218 sensor may capture or sense the object 212 without going through the lens 214.

[0167] In one example, the first camera of the depth mapper 218 may capture the object 212 through the lens 214, while the second camera of the depth mapper 218 may capture the object 212 without the lens 214.

[0168] In another example, the structured light projector of the depth mapper 218 may project a structured object through the lens 214, while the depth sensor of the depth mapper 218 may sense the structured object without going through the lens 214. For example, the signal from the depth mapper 218 may pass through the lens 214 and be returned to the IR camera of the depth mapper 218, which may be outside the area of ​​the lens 214.

[0169] According to these embodiments, application 160 (Figure 1) may be configured to determine one or more optical parameters of lens 214 using, for example, one or more calculations, as described below.

[0170] In some demonstrative embodiments, for example, in one or more scenarios and / or measurement schemes, the lens 214 may be positioned close to the user's face when, for example, the lens 214 is assembled into the glasses and the user wears the glasses on their face, for example, in a normal manner.

[0171] In some demonstrative embodiments, application 160 (Figure 1) may be configured to instruct the user to hold device 102 (Figure 1) while the glasses are on the user's face, and / or to take an image of their own face, e.g., a “selfie”.

[0172] According to these embodiments, distance D1 may be determined as the distance between the depth mapper 118 (Figure 1) and the facial features of the face, and / or distance D2 may be determined as the distance between the depth mapper 118 (Figure 1) and the frame of the eyeglasses.

[0173] In some demonstrative embodiments, application 160 (Figure 1) may be configured to determine one or more optical parameters of lens 214, for example, by instructing the user to take one image, or by instructing the user to take two consecutive images, for example, a first image of the face wearing glasses and a second image of the face not wearing glasses, and comparing the first and second images.

[0174] Please refer to Figure 3, which schematically shows some demonstrative embodiments of the measurement system 300.

[0175] In some demonstrative embodiments, the measurement system 300 may be implemented to determine one or more optical parameters of the lens.

[0176] As shown in Figure 3, the measurement system 300 may include a depth mapper 318, for example, a dual camera, stereo camera, or IR source and sensor of a structured optical system, a ToF depth mapper, and / or any other type of depth mapper, which may be implemented by a mobile phone, a lens 315 of the object to be measured, a reference object 312, for example, a wall, and an opaque object 317, for example, an opaque lens, located at the same distance D2 from the depth mapper 318 to the lens 315.

[0177] Please refer to Figure 4, which schematically shows a first depth map 410 of a first spherical lens and a second depth map 420 of a second spherical lens according to several empirical embodiments.

[0178] In one example, the first spherical lens may include, for example, a negative lens of -3 diopters, and / or the second spherical lens may include, for example, a positive lens of +6 diopters.

[0179] For example, depth map 410 may be acquired using the measurement system 300 (Figure 3) when, for example, lens 315 (Figure 3) includes a negative lens, and / or depth map 420 may be acquired using the measurement system 300 (Figure 3) when, for example, lens 315 (Figure 3) includes a positive lens.

[0180] As shown in Figure 4, the depth information 413 of the reference object 312 (Figure 3) via a positive lens in the depth map 420 may differ from the depth information 423 of the reference object 312 (Figure 3) via a negative lens in the depth map 410, while the depth information of the opaque object 317 (Figure 3) and the wall, for example, without a lens, is the same in depth maps 410 and 420.

[0181] Please refer to Figure 5, which schematically shows graph 500 plotting depth values ​​versus spherical frequencies according to several empirical embodiments.

[0182] In one example, the depth value may include the mean value of the depth map inside the spherical lens versus the spherical power of the lens, for example, a value in diopters.

[0183] As shown in Figure 5, there may be a strong correlation between the spherical power of the lens and the depth value of the lens's depth map.

[0184] Returning to Figure 1, in some demonstrative embodiments, application 160 may be configured to determine one or more optical parameters of a bifocal lens, as described below, for example.

[0185] In some demonstrative embodiments, application 160 may be configured to determine the optical parameters of a bifocal lens using a method similar to that used for spherical lenses. For example, the bifocal lens may be treated as two different spherical lenses.

[0186] In some demonstrative embodiments, application 160 may be configured to determine one or more optical parameters of a multifocal lens, as described below, for example.

[0187] In some demonstrative embodiments, application 160 may be configured to determine the optical parameters of a multifocal lens, for example, using a method similar to that used for a spherical lens. For example, an analysis of gradually changing depth along a vision-correcting lens may be performed based on the resolution of a depth map.

[0188] In some demonstrative embodiments, application 160 may be configured to process a depth map of a multifocal lens, such as one obtained by a depth mapper 118, which may include, for example, a set of D2 distances. In one example, each point in the set of distances may sample the lens at a specific location, for example, a location related to the lens boundary. In one example, application 160 may be configured to determine a set of frequencies P corresponding to a set of distances D2. For example, the set of distances D2 may correlate with a set of frequencies P, thereby creating a topological frequency map of the lens and / or the optical center design of the lens.

[0189] In some demonstrative embodiments, application 160 may be configured to determine distance prescriptions and / or near prescriptions, e.g., distance prescriptions and “additions,” based on a topological prescription map. In one example, the topological prescription map may determine the design of a multifocal lens, e.g., a set of primary lens prescriptions, e.g., spherical, cylindrical, axial, addition, and / or additional focal lengths, e.g., zones, and their positions in the field of view, where these zones and their positions in the field of view may identify “channels” for intermediate zones.

[0190] In some demonstrative embodiments, application 160 may be configured to determine the optical parameters of bifocal and / or multifocal lenses based on the method for spherical lenses, as described above, for example. For example, a bifocal lens may be represented by two different standard lenses, and / or the measurement of a multifocal lens may depend on the resolution of a depth mapper 118 to analyze the depth which gradually changes along the multifocal lens, for example.

[0191] In some empirical embodiments, the magnification of bifocal and / or multifocal lenses does not have to be fixed on the vision correction lens. Therefore, unlike spherical or cylindrical lenses where the magnification may be the same across the entire vision correction lens, assuming, for example, that the vision correction lens is uniform, the calculation of optical parameters may be performed, for example, locally.

[0192] In some demonstrative embodiments, the lens surface of a bifocal lens may be divided into two surfaces, in which case the calculation of the vision correction lens may be performed separately for each surface, similar to the case of a spherical cylindrical uniform lens.

[0193] In some demonstrative embodiments, for example, the lens surface of a bifocal lens may vary uniformly along the vision-correcting lens. Therefore, the depth map of a multifocal lens may be expected to vary uniformly and / or continuously.

[0194] In some demonstrative embodiments, application 160 may determine the spherical power of a spherical cylindrical lens based on prior knowledge of, for example, the cylinder of the lens, for example, the cylinder. For example, the cylinder may be the same for both areas, for example, in the case of a bifocal lens, and / or the cylinder may be the same along the passage between near and far vision, for example, in the case of a typical multifocal lens.

[0195] In some demonstrative embodiments, the depth map may include first depth information for a first area within the lens, and at least second depth information for at least a second area within the lens.

[0196] In some demonstrative embodiments, application 160 may be configured to determine the optical parameters of a bifocal or multifocal lens based on, for example, first depth information and second depth information, as described below.

[0197] In some demonstrative embodiments, application 160 may be configured to determine, for example, a first optical parameter of a bifocal or multifocal lens based on first depth information and / or, for example, a second optical parameter of a bifocal or multifocal lens based on second depth information, as described below.

[0198] In one example, the calculation of the cylindrical axis and / or cylindrical power of a bifocal and / or multifocal lens may be based on the assumption that, for either a bifocal or multifocal lens, the cylinder may be the same for all areas of the corrective lens.

[0199] In another example, depth mapping information may be applied to multiple lens portions of a multifocal lens, which may have different spherical and / or cylindrical properties. For example, application 160 may be configured to process depth map information from depth mapper 118 to identify portion-specific depth map information corresponding to a particular portion of the lens, and to determine the power and / or cylindrical value of that particular lens portion based on the portion-specific depth map information corresponding to that particular portion of the lens. In one example, application 160 may be configured to perform this portion-based processing of depth map information to determine optical parameters for multiple portions of a lens, such as the "near," "intermediate," "far," and / or any other portions of a multifocal lens.

[0200] In some demonstrative embodiments, application 160 may be configured to instruct a user of device 102 to perform one or more operations, and / or trigger, control, and / or cause one or more elements of device 102 to perform one or more operations, for example, as described below, in order to assist application 160 in the process of determining one or more optical parameters of a spherical lens, a bifocal lens, and / or a multifocal lens.

[0201] Please refer to Figure 6, which schematically illustrates a method for determining one or more optical parameters of a spherical lens according to several demonstrative embodiments. For example, one or more operations of the method in Figure 6 may be performed by a system, e.g., system 100 (Figure 1), a mobile device, e.g., device 102 (Figure 1), a server, e.g., server 170 (Figure 1), and / or an application, e.g., application 160 (Figure 1).

[0202] In some demonstrative embodiments, as shown in block 602, the method may include, for example, a step of processing at least one depth map and, optionally, image information, while instructing the user to position, for example, a lens and / or depth sensor 118 (Figure 1), as described above.

[0203] In some demonstrative embodiments, as shown in block 604, the method may include, for example, the step of determining distances D1, D2, and / or D3 based on statistical methods, for example, using computer vision such as classical or data-driven, and / or using, for example, the mean, median, etc., applied to the depth map, for example, as described above.

[0204] In some demonstrative embodiments, as shown in block 606, the method may include the step of determining the spherical power P of the lens, for example, based on distances D1, D2, and D3, according to, for example, formula 3, as described above.

[0205] Returning to Figure 1, in some demonstrative embodiments, application 160 may be configured to determine the spherical power of the lens based, for example, on an object captured through the lens and a background object, as described below.

[0206] In some demonstrative embodiments, background objects may include, for example, walls, tables, floors, etc.

[0207] In some demonstrative embodiments, application 160 may be configured to instruct the user of device 102 to hold device 102, which includes the depth mapper 118, in front of a background object, such as a wall.

[0208] In one example, a featureless wall may be suitable for a structured light system.

[0209] In another example, a display with a surface containing multiple features, such as a checkerboard pattern, or a grid with features of a given frequency, may be suitable for a multi-camera and / or stereo camera-based system.

[0210] In some demonstrative embodiments, application 160 may be configured to instruct the user of device 102 to position the device at a distance D1 from a wall, for example, about 30 cm or any other distance, with the assistance of, for example, a depth mapper 118 and / or any other position and / or orientation sensor.

[0211] In some demonstrative embodiments, application 160 may be configured to segment a region of interest in a depth map, for example, three areas or any other number of areas, using, for example, one or more computer vision techniques for determining distances D1, D2 and / or D3.

[0212] In some demonstrative embodiments, the three areas described above may also include areas outside the lens, such as the outer wall of the lens, the opaque rim of the lens, and areas inside the lens.

[0213] In other embodiments, any other additional or alternative areas may be used.

[0214] In some demonstrative embodiments, the distance D1 is a convenient distance D1 based on, for example, an accuracy criterion or any other criterion. * It may be used to guide the user to place a depth mapper.

[0215] In one example, distance D1 * A specific value, such as the "sweet spot," may be pre-calculated and / or pre-defined based on a series of experiments, for example, and may be set in Application 160 as a hardcoded value, for example.

[0216] In another example, distance D1 * The specific values ​​may be learned during a particular user process, for example, using computer vision techniques to analyze the size of objects and / or lenses in depth maps and / or acquired RGB images.

[0217] In some demonstrative embodiments, application 160 may be configured to instruct the user of device 102 to position the lens at a distance D2 from the depth mapper 118, for example, midway between the wall and device 102, or at any other distance.

[0218] In some demonstrative embodiments, the distance D2 may be determined, for example, by assuming that the lens is midway between the wall and the device 102, such as D2 = 0.5 × D1 = approximately 15 cm.

[0219] In one example, assuming D2 = 0.5 × D1, the partial derivative of equation 1, for example

number

[0220] In some demonstrative embodiments, application 160 may be configured to instruct the user of device 102 to activate depth mapper 118 to acquire depth map information via the lens when the lens is between device 102 and a background object.

[0221] In some demonstrative embodiments, application 160 may be configured to activate depth mapper 118 to acquire depth map information via the lens and / or to perform the acquisition of depth map information via the lens, for example, when the lens is between device 102 and a background object.

[0222] In some demonstrative embodiments, the distance D2 may be determined, for example, by a depth mapper 118, based on, for example, the opaque rim of a lens, the frame of eyeglasses, and / or any other reference object.

[0223] In some demonstrative embodiments, application 160 may be configured to determine a depth distance D3 from a depth map, for example, by an image processing segmentation method, in order to determine an area corresponding to a corrective lens, for example, within the opaque rim or frame of a spectacle, in a depth map.

[0224] In one example, for a bifocal or multifocal lens, application 160 may be configured to determine the depth distance D3 twice, for example, once for the far zone of the lens and once for the near zone of the lens.

[0225] In some demonstrative embodiments, application 160 may be configured to determine the spherical power P of a vision correction lens based on distances D1, D2, and D3, for example, using equations 1 to 3.

[0226] In some empirical embodiments, the spherical frequency P may be predicted from an empirical regression model, for example, using a regression learning model, with a pre-calculated correlation between distances D1, D2, and D3 and the spherical frequency P.

[0227] In some demonstrative embodiments, application 160 may be configured to determine the spherical power of a lens based on a detected object, for example, as described below.

[0228] In some demonstrative embodiments, the detected objects may include, for example, predefined shapes on displays such as mobile phones, tablets, and computer screens, coins, fingers, and / or any other objects.

[0229] In one example, the detected object may include an object detectable by general computer vision techniques, based on the system's available input data modalities, for example, by the depth mapper 118, and / or any other images and / or information acquired by the depth mapper 118, camera 119, and / or any other sensors of device 102.

[0230] In some demonstrative embodiments, application 160 may be configured to instruct the user of device 102 to hold device 102, which includes the depth mapper 118, in front of a detected object, such as a coin.

[0231] In some demonstrative embodiments, application 160, with the assistance of, for example, a depth mapper 118, measures the distance D1 from the detected object, which is best suited for measurement. * The device may be configured to instruct the user of device 102 to place device 102.

[0232] In one example, distance D1 * A specific value, such as "working distance," may be pre-calculated and / or pre-defined based on a series of experiments, for example, and may be set in application 160 as a hardcoded value, for example.

[0233] In another example, distance D1 * The specific values ​​may be learned during a particular user process, for example, using computer vision techniques to analyze the size of objects and / or lenses in depth maps and / or acquired RGB images.

[0234] In some demonstrative embodiments, application 160 is used, for example, at a distance D1 * To ensure that the device does not change, the device may be configured to instruct the user of device 102 to keep the device in the same position, for example, to keep the device stationary.

[0235] In some demonstrative embodiments, application 160 may be configured to instruct the user of device 102 to position the lens at a distance D2 from the depth mapper 118, for example, midway between the object and device 102, or at any other distance.

[0236] In some demonstrative embodiments, application 160 may be configured to determine the depth distance D3, for example, from a calibrated depth map, by an image processing method.

[0237] In some demonstrative embodiments, the distance D2 may be determined, for example, by assuming that the lens is midway between the detected object and the device 102, such as D2 = 0.5 × D1 = approximately 15 cm.

[0238] In one example, assuming D2 = 0.5 × D1, we may obtain a maximum error proportional to the partial derivative of Equation 1.

[0239] In some demonstrative embodiments, application 160 may be configured to instruct the user of device 102 to activate depth mapper 118 to acquire depth map information via the lens when the lens is between device 102 and the detected object.

[0240] In some demonstrative embodiments, application 160 may be configured to activate depth mapper 118 to acquire depth map information via the lens and / or to perform the acquisition of depth map information via the lens, for example, when the lens is between device 102 and the detected object.

[0241] In some demonstrative embodiments, the distance D2 may be determined, for example, by a depth mapper 118, based on, for example, the opaque rim of a lens, the frame of eyeglasses, and / or any other reference object.

[0242] In some demonstrative embodiments, application 160 may be configured to determine the spherical power P of a vision-correcting lens based on, for example, distances D1, D2, and / or D3 using equations 1 to 3.

[0243] In some empirical embodiments, the spherical frequency P may be predicted from an empirical regression model, for example, using a regression learning model, with a pre-calculated correlation between distances D1, D2 and / or D3 and the spherical frequency P.

[0244] In some demonstrative embodiments, application 160 may be configured to determine the spherical power of a lens based on an object detected in the mirrored image, for example, when using a mirror, as described below.

[0245] In some demonstrative embodiments, application 160 may be configured to instruct the user of device 102 to hold device 102, including the depth mapper 118, in front of a mirror, for example.

[0246] In some demonstrative embodiments, the detectable object may include, for example, a displayed object, such as a predefined shape on the display of device 102, which may be reflected by a mirror.

[0247] In some demonstrative embodiments, application 160 may be configured to instruct the user of device 102 to position the device at a distance D2 from a mirror that is deemed suitable for measurement, for example with the assistance of depth mapper 118.

[0248] In some exemplary embodiments, application 160 may determine the spherical power of the lens based on, for example, some or all of the operations described above, while using distance D2 and using the distance of the object displayed on the screen of device 102 reflected by the mirror as distance D1. For example, application 160 may determine the spherical power of the lens while setting distance 1 to twice distance D2, for example, according to Equation 3.

[0249] In some exemplary embodiments, memory 194 may store a pre - calculated mapping between spherical power P and distances D1, D2, and D3, for example, based on empirical results. For example, application 160 may accumulate measurements between distances D1, D2, and D3 and spherical power P and may be configured to determine a pre - calculated mapping based on the accumulated measurements. For example, application 160 may access the pre - calculated mapping information in memory 194 to determine the spherical power P corresponding to the measured depth map obtained through the lens.

[0250] In some exemplary embodiments, depth mapper 118 may include a structured - light depth sensor, such as a structured - light stereo camera sensor.

[0251] In some exemplary embodiments, application 160 may be configured to determine one or more parameters of the lens by processing depth information from depth mapper 118 as structured - light depth measurements performed by the structured - light depth sensor.

[0252] In some exemplary embodiments, the first component of depth mapper 118 may not be "looking through" the lens, while the second component of depth mapper 118 may be "looking through" the lens.

[0253] In some demonstrative embodiments, the camera structured light depth mapper 118 may not "look through" a lens, for example, when the depth mapper 118 includes a structured light depth sensor.

[0254] In one example, since distances D1 and D2 may increase, the assumption that both cameras "look through" a lens may not be correct.

[0255] In one example, according to experiments, as the distance increases, both components of the depth mapper 118 may not look through the lens being tested for some of the field points, and it has been shown that this may occur for all field points as the distance is further increased.

[0256] In another example, at very large distances, the beam cannot pass through the lens and return to the sensor.

[0257] Please refer to FIG. 7, which schematically shows a first depth map 710 of a lens and a second depth map 720 of a lens according to some demonstrative embodiments.

[0258] In one example, depth maps 710 and 720 may be obtained by a structured light depth sensor.

[0259] In some demonstrative embodiments, as shown in FIG. 7, the common area 702 may include a central area through which both parts of the depth sensor may have a clear view.

[0260] In some demonstrative embodiments, depth map 710 may be obtained at a first distance D2, and depth map 720 may be obtained at a second distance D2 greater than the first distance.

[0261] In some demonstrative embodiments, as shown in FIG. 7, the common area 702 may increase as the distance D2 decreases.

[0262] In some demonstrative embodiments, application 160 (Figure 1) may be configured to instruct the user of device 102 (Figure 1) to position the lens, device 102, and / or reference object at appropriate distances to achieve a larger common area 702, for example, as described below.

[0263] In one example, calculations for the area surrounding the common area 702 may differ because, for example, the introduction of a lens may scale (enlarge or reduce) and / or shift the feature field across an object, such as a wall.

[0264] Please refer to Figure 8, which schematically shows measurement schemes 800 according to several empirical embodiments.

[0265] In one example, the measurement scheme 800 may include a reference object, for example, a planar object, and a depth mapper 118 (Figure 1) for acquiring a depth map through the lens under test. For example, this depth mapper may include a structured optical configuration for when the observation camera is not "seeing" through the lens under test, or a stereo camera configuration for when the observation camera is not "seeing" through the lens under test.

[0266] In one example, the feature field of the entire reference object may be scaled, for example, by introducing a test lens between the depth mapper 118 (Figure 1) and the planar object, as described below.

[0267] In one example, as shown in Figure 8, one or more features may be projected onto the projection surface via a test lens by, for example, a structured light projector of the depth mapper 118 (Figure 1), and acquired (imaged) by a camera that is "not looking" through the test lens, for example, the camera of the depth mapper 118 (Figure 1).

[0268] In another example, one or more features may be captured on a projection plane by a first camera of a stereo camera depth mapper 118 (FIG. 1) through a lens under test, and may be captured by a second camera that is "not looking" through the lens under test, for example, the second camera of the stereo camera depth mapper 118 (FIG. 1).

[0269] In some demonstrative embodiments, the position of a feature, e.g., each feature, for a spherical lens may be determined, for example, as follows. x p_壁_レンズあり =tan(x p / f) * (u2-(u1-f) * (u2 / f L -1))- Xp * (u2 / f L -1) X p_壁_レンズなし =tan(x p / f) * (u1+u2-f) (4)

[0270] In some demonstrative embodiments, as shown in FIG. 8, the introduction of a lens may affect the size and / or position of one or more features.

[0271] In some demonstrative embodiments, the application 160 (FIG. 1) may determine the depth of a feature, for example, based on a change in the size of the feature in a depth map, as described below.

[0272] In one example, for example, since the depth of a feature may not be related to the size of the feature, the diopter of a lens represented by f, for example, may be determined based on the depth of the feature. L and may be determined based on the depth of the feature.

[0273] For example, an assumed depth represented by z f may be based on the size of the captured feature represented by sze f as follows, for example. Z f =k1 * szef +k2 (5)

[0274] In one example, when a feature is projected through the lens under test, the feature may be resized and / or made direction-dependent, and thus the lens depth of the feature through the lens (denoted as zf) may be determined, for example, as follows. Z f ’=k1 * sze f ’+k2 (6) In the above formula, sze f ’ may be a function of the spherical power f L and the azimuth (orientation).

[0275] For example, some depth maps for several lens angles of an aspherical lens may be used to determine one or more optical parameters of, for example, a cylindrical lens.

[0276] In some demonstrative embodiments, for example, as described below, in order to obtain a depth map through the lens under test, the lens under test may be disposed in proximity to a depth mapper 118 (FIG. 1), for example, by placing the lens in the depth mapper 118 (FIG. 1).

[0277] In some demonstrative embodiments, the distance between the lens under test and the depth mapper 118 (FIG. 1), for example, the distance u1, may be set to zero, for example, u1 = 0, when the lens under test is disposed in proximity to the depth mapper 118 (FIG. 1).

[0278] In some demonstrative embodiments, the application 160 (FIG. 1) may determine the position of a feature, for example, according to Equation 4, when the value of u1 is set to zero.

[0279] In some demonstrative embodiments, the depth of a feature may be determined, for example, as described below, based on, for example, a change in the position of the feature, for example, a shift of the feature.

[0280] Please refer to Figure 9, which schematically shows the measurement scheme 900 according to several empirical embodiments.

[0281] In one example, the measurement scheme 900 may include a reference object, for example, a planar object, and a depth mapper 118 (Figure 1) for acquiring a depth map through the lens under test. For example, this depth mapper may include a structured optical configuration for when the observation camera is not "seeing" through the lens under test, or a stereo camera configuration for when the observation camera is not "seeing" through the lens under test.

[0282] In one example, the feature field of the entire reference object may be scaled, for example, by introducing a test lens between the depth mapper 118 (Figure 1) and the planar object, as described below.

[0283] In one example, as shown in Figure 9, one or more features may be projected onto the projection surface via a test lens by, for example, a structured light projector of the depth mapper 118 (Figure 1), and acquired (imaged) by a camera that is "not looking" through the test lens, for example, the camera of the depth mapper 118 (Figure 1).

[0284] In another example, one or more features may be captured on the projection plane via the lens of a test by, for example, the first camera of the stereo camera depth mapper 118 (Figure 1), and captured by a second camera that is "not seeing" via the lens of a test, for example, the second camera of the stereo camera depth mapper 118 (Figure 1).

[0285] In some demonstrative embodiments, as shown in Figure 9, the introduction of the lens may affect the size and / or position of one or more features.

[0286] In some demonstrative embodiments, application 160 (Figure 1) may determine feature depth based on, for example, a change in feature position, such as a feature shift, as described below.

[0287] In some empirical embodiments, the feature shift may be defined, for example, as the difference between the position of the feature with the lens and the position of the feature without the lens, based on Equation 4, for example, as follows: Feature shift = δx = X p_壁_レンズあり -X p_壁_レンズなし = =tan(x p / f) * (u2-(u1-f) * (u2 / f L -1))- Xp * (u2 / f L -1)-tan(x p / f) * (u1+u2-f) (7)

[0288] In some empirical embodiments, as shown in Figure 8, the feature shift may result in a parallax change.

[0289] In some demonstrative embodiments, the relationship between the depth reported from the depth sensor 118 (Figure 1) and the parallax may be determined, for example, as follows: 1 / (z+δz)=1 / z ref +d1 / (bf o ) 1 / z = 1 / z ref +d2 / (bf o ) (8) In the above formula, d1 represents the measured disparity for the p-th feature with the test lens present, and d2 represents the measured disparity for the p-th feature without the test lens present.

[0290] In some empirical embodiments, the following relationship may be determined, for example, according to Equation 8. (d1-d2) / δ x= f / z (9) In the above formula, δx represents the lens power.

[0291] Returning to Figure 1, in some demonstrative embodiments, the depth mapper 118 may include a ToF depth mapper.

[0292] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of a lens by processing depth information from, for example, a depth mapper 118 as depth information for ToF depth measurement.

[0293] In one example, ToF depth mapping technology may be based on the time-of-flight principle and / or on the parallax of points acquired at different coordinates in the real world or points projected from different coordinates.

[0294] In some empirical embodiments, the ToF depth measurement may include a phase shift (phase difference) / time delay, which may be converted to a distance measurement, for example, under the assumption of free space.

[0295] In some demonstrative embodiments, object points may be illuminated by a modulated optical signal and imaged onto the sensor surface, for example, using a ToF optical system.

[0296] In some demonstrative embodiments, the contributing rays to a given pixel, excluding, for example, stray light, may travel approximately the same optical distance, which may be due to imaging conditions.

[0297] In some demonstrative embodiments, the introduction of the lens under test may result in a change in the optical distance of the contributing rays, for example, resulting in a different set of rays departing from the object point. If the illumination path may also pass through the lens under test, the overall path difference, for example, the path difference from a scenario without the lens, may have two contributing rays, and as a result, the depth reading may change.

[0298] In some demonstrative embodiments, application 160 may be configured to determine the power of the lens under test based, for example, the amount of change in the ToF measurement and one or more configuration parameters of the ToF measurement.

[0299] In some demonstrative embodiments, for example, the lens deflects the beamlet / ray by refraction or reflection depending on its curvature, so the lens under test may be, for example, spherical, spherical cylindrical, or cylindrical.

[0300] Please refer to Figure 10, which schematically shows measurement scheme 1000 according to several empirical embodiments.

[0301] In one example, the measurement scheme 1000 may include a reference object, for example, a planar object, and a depth mapper 118 (Figure 1) for acquiring a depth map through the lens under test. For example, this depth mapper 118 (Figure 1) may include, for example, a ToF depth mapper, in which case the light rays from the illumination source of the ToF depth mapper do not have to "pass" through the lens under test.

[0302] In some demonstrative embodiments, the lens under test may include two intersecting cylindrical lenses, each deflecting light according to its power across the principal meridian.

[0303] In one example, the path of one or more contributing rays in the ToF measurement may be altered by introducing a test lens between the depth mapper 118 (Figure 1) and the planar object.

[0304] In some demonstrative embodiments, for example, the route レンズなし The first light path is represented as, and the path レンズ There may be a path difference, represented as a Δ path, between the first path and the second light path, which is represented as . For example, the first path, path レンズなし , may be a second path, path レンズ, may also be the distance from the ToF depth mapper as it passes through the lens under test to the second pixel coordinate represented as H'.

[0305] In some demonstrative embodiments, application 160 may be configured to determine the path difference Δ path, for example, as follows: route レンズなし =l o +l1+l3 route レンズあり =l o +l2+l4 l4=l o +l2 l 2 3=l 2 4+d 2 2·(tan(β)-tan(α)) 2 -2·l4·d2(tan(β)-tan(α)) l2 = d2 / cos(α) l1 = d2 / cos(β) Δpath = path レンズあり -route レンズなし = l2 + l4 - l1 - l3 (10)

[0306] In some demonstrative embodiments, the depth sensor may measure a value directly related to the optical path, so the path difference Δpath may be related, for example, to the power of the lens being tested.

[0307] Please refer to Figure 11, which schematically shows some measurement schemes 1100 according to several empirical embodiments.

[0308] In one example, the measurement scheme 1100 may include a reference object, for example, a planar object, and a depth mapper 118 (Figure 1) for acquiring a depth map through a test lens. For example, this depth mapper may include a ToF depth mapper, such that the light rays from the illumination source of the ToF depth mapper "pass through" the test lens.

[0309] In some demonstrative embodiments, the lens under test may include two intersecting cylindrical lenses, each deflecting light according to its power across the principal meridian.

[0310] In one example, the path of one or more contributing rays from the illumination source may be altered by introducing a test lens between the depth mapper 118 (Figure 1) and the planar object.

[0311] In some demonstrative embodiments, for example, the path difference, represented as Δpath, is the illumination path. レンズなし The first light path, represented as and the illumination path レンズあり It may exist between the first light path and the second light path represented as follows: For example, the first path, the illumination path レンズなし , may be a second path, illumination path, which may be a path from the ToF depth mapper to a first pixel coordinate represented as H without passing through the lens under test. レンズあり , may also be the distance from the ToF depth mapper as it passes through the lens under test to the second pixel coordinate represented as H'.

[0312] In some demonstrative embodiments, application 160 may be configured to determine the path difference Δ path, for example, as follows: Lighting path レンズあり =l 31 +l 32 Imaging path レンズあり = l1 + l0 Lighting path レンズなし =l 41 +l 42 Imaging path レンズなし = l2 + l0 Δpath = Δpath 照明 +Δ path 撮像 (11)

[0313] In some demonstrative embodiments, the depth sensor may measure a value directly related to the difference in sensor depth readings, so the path difference Δpath may be related, for example, to the power of the lens being tested.

[0314] In some demonstrative embodiments, in a different configuration, the light may be reflected from the front of the lens and reach the depth sensor. The light ray may be processed in a manner similar to that described above, and the path difference may be determined in a similar manner.

[0315] Returning to Figure 1, in some demonstrative embodiments, application 160 may be configured to determine the optical center of the lens, as described below, for example.

[0316] In some demonstrative embodiments, application 160 may be configured to determine, for example, the optical center with respect to the lens boundary of a lens. In one example, the frame of eyeglasses containing the lens may serve as a reference point for determining the center of the lens. For example, application 160 may determine the displacement of the optical center from the reference point based, for example, on lateral distance information from the depth mapper 118.

[0317] In one example, the optical center may be characterized by the fact that beamlets passing through it may not be deflected. For example, not being deflected may mean the same depth measurement. Thus, information about where the optical center is located may be provided by identifying the field associated with a particular point on the lens where the depth measurement passing through the lens is the same as the depth measurement without the lens.

[0318] In some demonstrative embodiments, application 160 may be configured to determine the optical center by, for example, identifying the location of a depth measurement that has the same value as a depth value at the same location, for example, acquired through a lens and without a lens, for example, its position relative to a reference point.

[0319] In some demonstrative embodiments, application 160 may be configured to determine the pupillary distance (PD) of eyeglasses based on the optical center of the eyeglass lenses, for example, as described below.

[0320] In some demonstrative embodiments, application 160 may be configured to identify the positions of the optical centers of the two lenses of the eyeglasses, as described below, for example, and to determine the PD of the eyeglasses based on the identified positions of the optical centers of the lenses of the eyeglasses.

[0321] In some demonstrative embodiments, application 160 may be configured to determine the distance between the optical centers of two lenses based on depth information from, for example, a depth sensor 118. In one example, application 160 may be configured to utilize depth information from the depth sensor 118 in the form of three-dimensional (3D) information, including, for example, information regarding the orientation and size of the glasses, which may be used to determine the relative positions of the two optical centers.

[0322] In some demonstrative embodiments, application 160 may be configured to utilize 3D information, including the orientation and size of the glasses, to refine the depth values ​​of depth information from depth mapper 118, for example, these depth values ​​are used to determine, for example, one or more parameters of the lenses.

[0323] In some demonstrative embodiments, application 160 may be configured to determine the surface of the eyeglasses based, for example, on depth information corresponding to the eyeglasses.

[0324] In some demonstrative embodiments, application 160 may be configured to determine the distance between two optical centers based on any other additional or alternative information and / or procedures. In one example, application 160 may be configured to determine the distance between two optical centers based on calibration and / or calculation, for example, by comparing an image of an object of known scale with an image of the eyeglasses taken by, for example, camera 119 and / or any other camera.

[0325] In some demonstrative embodiments, the lens under test may include a cylindrical lens, and application 160 may be configured to determine one or more optical parameters of the cylindrical lens, as described below, for example.

[0326] In one example, if the depth mapper 118 includes a structured optical stereo camera, the deflection direction of the beamlet refracted by the cylindrical lens may be important. For example, the lens power along the meridian in the direction of the camera or IR source-sensor displacement vector may "disappear," as described below.

[0327] In this example, the measurement of a cylindrical lens may utilize, for example, multiple depth map images rotated at different angles, as described below.

[0328] In another example, the measurement of a cylindrical lens may utilize the solution method for a spherical cylindrical lens, as described above.

[0329] In some demonstrative embodiments, application 160 may be configured to determine one or more of the spherical power, cylindrical power, and cylindrical axis of a cylindrical lens, for example, some or all of them, as described below.

[0330] In some demonstrative embodiments, application 160 may be configured to determine one or more optical parameters of a cylindrical lens based on multiple depth maps corresponding to multiple lens angles of the lens, for example, as described below.

[0331] In some demonstrative embodiments, the depth maps of multiple depth maps may correspond, for example, to lens rotations of the lens at different angles.

[0332] In some demonstrative embodiments, lens rotation may include relative rotation between the lens and the device 102.

[0333] In one example, lens rotation of a vision-correcting lens may be performed, for example, by rotating the lens while keeping the device 102 in a stationary position.

[0334] In another example, lens rotation may be performed, for example, by rotating device 102 while keeping the lens stationary. In this example, lens rotation may be determined, for example, based on the orientation sensor of device 102, such as a gyroscope and / or any other sensor.

[0335] In another example, lens rotation may be performed, for example, by rotating both the lens and the device 102.

[0336] In one example, if the depth mapper 118 includes a stereo camera, a dual camera, etc., the direction of the light beam refracted by the lens may be based on the cylindrical degree and cylindrical axis of the cylindrical lens. For example, the cylindrical degree of the lens along the meridian in the direction of the stereo camera or IR source-sensor of the depth mapper 118 may be "vanished", as described below, for example.

[0337] In this example, the cylindrical axis of a cylindrical lens may be estimated correctly, for example, by using multiple depth maps rotated at different angles.

[0338] In some demonstrative embodiments, application 160 may be configured to determine the cylindrical power and / or cylindrical axis of the lens, for example, based on pre-calculated depth map information and / or any other method and / or algorithm.

[0339] In one example, a spherical cylindrical lens may include a lens having a major aberration, such as one described by a Zernike quadratic term.

[0340] In some demonstrative embodiments, Application 160 may be configured to determine the spherical power across two main lens meridians and the axes of the two main lens meridians, for example, in a world standard frame. For example, in spectacle lenses, the axis measurement may be relative to the horizontal line of the frame, and the optical parameters may include sphere, cylinder, and axis.

[0341] Refer to Figure 12, which schematically shows a first depth map 1210 of a cylindrical lens at a first angle and a second depth map 1220 of a cylindrical lens rotated at a second angle, according to some empirical embodiments.

[0342] In one example, depth maps 1210 and 1220 may be acquired using the measurement system 300 (Figure 3), for example, when lens 315 (Figure 3) includes a cylindrical lens.

[0343] In one example, depth map 1210 may be obtained when the cylindrical lens is rotated so that the cylindrical axis of the lens is vertical.

[0344] In one example, depth map 1220 may be obtained when the cylindrical lens is rotated so that the cylindrical axis of the lens is horizontal.

[0345] As shown in Figure 12, for example, when the cylindrical axis is vertical, the depth information 1213 through the cylindrical lens is different from the depth information 1223 through the cylindrical lens when the cylindrical axis is horizontal, while for example, the depth information of depth maps 1210 and / or 1220 may be the same for opaque objects 1217, for example, object 317 (Figure 3), and walls, in areas captured without the lens. For example, according to depth information 1223, the lens may appear to "disappear".

[0346] Returning to Figure 1, in some demonstrative embodiments, application 160 may be configured to determine the complete formulation of a cylindrical lens, including, for example, the sphere, cylinder and / or axis of the cylindrical lens, by repeating the process for, for example, a cylindrical lens, as described above, while the lens or depth mapper 118 rotates, for example, in the plane of the lens. In one example, the stereo vision depth map for magnification calculation may have limitations on the guidance axis system.

[0347] In some demonstrative embodiments, application 160 may be configured to evaluate the magnification along the lens meridian and to match the result to an ellipse, which may define the sphere, cylinder and / or axis of the cylindrical lens.

[0348] In one example, to precisely define that ellipse, for example, to obtain a perfect prescription for a cylindrical lens, five different lens angles might theoretically be suitable.

[0349] In another example, more than five different lens angles may be used to improve the accuracy of the prescription.

[0350] In some demonstrative embodiments, application 160 may be configured to determine the complete prescription of a cylindrical lens without lens rotation, for example, as described below.

[0351] In some demonstrative embodiments, the device 102 may include multiple depth mappers 118, for example, obtained using separate or optically supported division of a single sensor by spatial multiplexing.

[0352] In some demonstrative embodiments, the multiple depth mappers 118 may provide depth information corresponding to multiple lens orientations or meridians, such that the depth maps acquired by the depth mappers may correspond to different lens effects, for example, different angles / meridians.

[0353] In some demonstrative embodiments, application 160 may be configured to perform one or more calculations to determine one or more parameters of a lens, for example, using a set of equations, each having an unknown parameter, for example, a degree along a meridian, based on measurements of multiple meridians.

[0354] Please refer to Figure 13, which schematically shows an ellipse 1300 of the lens angle according to several empirical embodiments.

[0355] As shown in Figure 13, five different lens angles may be suitable for precisely defining the ellipse 1300, for example, to obtain a complete prescription for a cylindrical lens.

[0356] In some demonstrative embodiments, application 160 may be configured to determine, for example, a formulation of a cylindrical lens, including the sphere, cylinder and / or axis of the cylindrical lens, for example, a partial or complete formulation, by analyzing two or more meridians of the cylindrical lens, for example, without rotating the lens and / or device 102, as described below.

[0357] In one example, the light from the IR emitter of the depth mapper 118 may be split and projected at different angles onto, for example, two or more meridians via a beam splitter and / or different prisms, so that two or more meridians can be analyzed simultaneously. According to this example, application 160 may determine the entire lens prescription without, for example, rotating device 102 and / or the lens.

[0358] In some demonstrative embodiments, for example, the relative angle of the lens with respect to at least one predefined axis when the depth map is acquired (captured) by the depth mapper 118 may affect one or more optical parameters of the lens, such as at least the nominal lens power of the lens, as described below, for example.

[0359] In one example, the predefined axes described above may include axes perpendicular to the optical axes of the depth mapper 118. For example, the optical axes of the depth mapper 118 may include axes that the depth mapper 118 uses as a reference and / or reference axis when providing depth maps.

[0360] In some demonstrative embodiments, the relative angles of the lenses may be changed, for example, when changing the orientation of device 102 and / or the orientation of the lenses.

[0361] In some demonstrative embodiments, as described below, for example, application 160 may be configured to perform one or more operations and / or instruct the user to perform one or more operations so that application 160 can take into account the effect of the relative angles of the lenses.

[0362] In some demonstrative embodiments, application 160 may be configured to instruct the user to tilt a lens or eyeglasses containing a lens to multiple lens tilts along a predefined axis, and to obtain multiple depth maps at the multiple lens tilts.

[0363] In some demonstrative embodiments, application 160 may be configured to derive the nominal lens power of a lens based on information from the multiple depth maps described above, for example.

[0364] In some demonstrative embodiments, application 160 may be configured to determine the relative angles of the lenses, as described below, for example, and to determine one or more optical parameters of the lenses based on the relative angles of the lenses when a depth map is acquired.

[0365] In some demonstrative embodiments, application 160 may be configured to estimate the relative angle between the lens and the depth sensor axis when a depth map is acquired, for example, via the occlusion features of the frame holding the lens, as described below.

[0366] In one example, geometric information may be obtained from, for example, a visible sensor between 400 and 700 nanometers (nm), or any other wavelength sensor, which may be used to estimate lens and / or spectacle deformation, such as changes in the viewpoint of the spectacle, assuming the symmetry of the spectacle. For example, the right portion of the spectacle may be larger than the left portion of the spectacle, based on the relative angles of the lens and / or spectacle with respect to a predefined axis.

[0367] In another example, a depth map of occlusion features may be used, for example, to estimate the frame angle by comparing it to the depth sensor axis. For example, a set of several distance information pixels across the entire frame may be used, for example, to describe the orientation of the entire frame.

[0368] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of a lens based on a determined relative angle, represented by θ, between the lens and a predefined axis, when a depth map is acquired by depth mapper 118, for example, as described below.

[0369] In some demonstrative embodiments, application 160, for example, uses F based on the relative angle θ, as follows: SPH To correct the estimated spherical frequencies expressed as, F NEWSPH You may decide on a frequency correction expressed as follows.

number

[0370] In some demonstrative embodiments, Application 160 corrects the estimated cylindrical frequencies based on, for example, relative angle θ and frequency correction, as follows: INDCYL It may be configured to determine a cylindrical correction value expressed as follows. C INDCYL =F NEWSPH ·tan2 θ (13)

[0371] In some demonstrative embodiments, application 160 may be configured to determine the refractive index (n) of a lens based on multiple images acquired with multiple lens rotations (tilts), for example, as described below.

[0372] In some demonstrative embodiments, application 160 may be configured to determine the refractive index of a lens by, for example, analyzing two or more images acquired at different lens tilts, e.g., tilts with respect to the axis between the depth sensor and the lens, deriving at least two angles of the lens, and determining the refractive index based on, for example, the change in perceived power at each of the lens tilts and the angle of the lens tilt.

[0373] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of the lens under test based, for example, on an image of the reference object through the lens, such as an RGB image, in addition to depth information of the reference object through the lens.

[0374] In one example, the depth map may be combined with the RGB image of a reference object through a lens by, for example, applying registration between the depth map and the RGB image when the depth map is acquired, and by using image processing techniques to analyze, for example, the size of the reference object through the lens and the depth map data.

[0375] In some demonstrative embodiments, application 160 may be configured to determine, for example, the cylindrical degree and / or cylindrical axis of a cylindrical lens based on an RGB image and a depth map, as described below.

[0376] In some demonstrative embodiments, the reference object may include a planar object having different sizes and, for example, having one or more features scattered across the planar object.

[0377] In some demonstrative embodiments, application 160 may be configured to determine the size and / or location of one or more features based on a depth map of a reference object, for example.

[0378] In some demonstrative embodiments, application 160 may be configured to process a first acquired image including an image of one or more features acquired without a lens, process a second acquired image including an image of one or more features acquired through a lens, and determine one or more optical parameters of a lens based on, for example, a comparison of the size of the image of one or more features acquired through a lens with the size of the image of one or more features not acquired through a lens, and the size and position of one or more features.

[0379] In some demonstrative embodiments, application 160 may be configured to determine one or more parameters of a cylindrical lens using a depth mapper including, for example, a calibrated stereo camera, such that each camera in the depth mapper is calibrated, and a planar object. For example, focusing the camera on the planar object may not be required.

[0380] In some demonstrative embodiments, application 160 may be configured to trigger, cause, and / or control the depth mapper 118 to acquire, for example, a first image of a planar object by at least one of the depth mapper 118's cameras while the cylindrical lens is not present.

[0381] In some demonstrative embodiments, application 160 may be configured to detect features in a first image and assign a metric characteristic to each feature. For example, the position (x, y, z) of each feature in the camera coordinate system may be determined, for example, based on depth information and / or visual information.

[0382] In some demonstrative embodiments, application 160 may be configured to instruct the user of device 102 to position the cylindrical lens at a distance D2 from the depth mapper 118, for example, midway between the wall and device 102, or at any other distance.

[0383] In one example, the distance D2 may be determined, for example, by assuming that the cylindrical lens is midway between the wall and the device 102, as described above, or by the depth mapper 118, for example, from the opaque rim of the lens or eyeglasses.

[0384] In some demonstrative embodiments, application 160 may be configured to instruct the user of device 102 to activate depth mapper 118 to acquire depth map information via the lens when the lens is between device 102 and a background object.

[0385] In some demonstrative embodiments, application 160 may be configured to activate depth mapper 118 to acquire depth map information via the lens when the lens is between device 102 and a background object, and / or to cause depth mapper 118 to acquire depth map information via the lens.

[0386] In some demonstrative embodiments, application 160 may be configured to trigger, cause, and / or control the depth mapper 118 to acquire a second image of the features through a cylindrical lens, for example, by at least one camera of the depth mapper 118.

[0387] In some demonstrative embodiments, application 160 may be configured to detect features and / or map the features to a first image.

[0388] In some demonstrative embodiments, application 160 may be configured to determine a transformation function or transformation matrix from a first image, e.g., the original unlensed feature map, to a second image, e.g., a "lensed" feature map.

[0389] In one example, for a degenerate spherical lens, the above transformation may include translation and scaling, where the scale parameter is used to compute the sphere.

[0390] In another example, for a spherical cylindrical lens, the above transformation may include translation, rotation, and / or scaling operations.

[0391] In some demonstrative embodiments, application 160 may be configured to separate the rotation axis and scale in the transformation direction in order to determine, for example, one or more optical parameters, by decomposing the transformation matrix into a translation matrix, a rotation matrix and / or a scale matrix. For example, the scale parameter and rotation parameter for determining one or more optical parameters may be defined and / or determined using any suitable method.

[0392] Please refer to Figure 14, which schematically illustrates a method for determining one or more parameters of a lens according to several demonstrative embodiments. For example, one or more operations of the method in Figure 14 may be performed by a system, e.g., system 100 (Figure 1), a device, e.g., device 102 (Figure 1), a server, e.g., server 170 (Figure 1), and / or an application, e.g., application 160 (Figure 1).

[0393] In some demonstrative embodiments, as shown in block 1402, the method may include the step of processing at least one depth map containing depth information acquired through a lens. For example, application 160 (Figure 1) may process at least one depth map from depth mapper 118 (Figure 1) containing depth information acquired through a lens, as described above, for example.

[0394] In some demonstrative embodiments, as shown in block 1404, the method may include the step of determining one or more lens parameters based on depth information. For example, application 160 (Figure 1) may determine one or more lens parameters based on depth information from depth mapper 118 (Figure 1), as described above.

[0395] Refer to Figure 15, which schematically illustrates Product 1500 in several demonstrative embodiments. Product 1500 may include one or more tangible computer-readable non-transient storage media 1502, which may include computer-executable instructions, for example, implemented by logic 1504, and when executed by at least one computer processor, that at least one computer processor may perform one or more operations (calculations) in device 102 (Figure 1), server 170 (Figure 1), depth mapper 118 (Figure 1), and / or application 160 (Figure 1), and / or one or more operations, communications and / or functionalities relating to Figures 1-14, and / or one or more operations described herein. The expression “non-transient machine-readable media” is intended to include all computer-readable media with the sole exception of transient propagating signals.

[0396] In some demonstrative embodiments, product 1500 and / or machine-readable storage medium 1502 may include one or more types of computer-readable storage medium capable of storing data, including volatile memory, non-volatile memory, removable or non-removable memory, erasable or non-erasable memory, writable or rewritable memory, and the like. For example, the machine-readable storage medium 1502 may include RAM, DRAM, double data-rate DRAM (DDR-DRAM), SDRAM, static RAM (SRAM), ROM, programmable ROM (PROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), compact disk ROM (CD-ROM), recordable compact disk (CD-R), rewritable compact disk (CD-RW), flash memory (e.g., NOR flash memory or NAND flash memory), associative memory (CAM), polymer memory, phase-change memory, ferroelectric memory, silicon oxide-nitride-oxide-silicon (SONOS) memory, disks, solid-state drives (SSDs), floppy disks, hard drives, optical disks, magnetic disks, cards, magnetic cards, optical cards, tapes, cassettes, etc. Computer-readable storage media may include any suitable medium involved in the download or transfer of computer programs from a remote computer to a requesting computer, carried by data signals embodied on a carrier wave or other propagating medium via a communication link, such as a modem, wireless connection, or network connection.

[0397] In some demonstrative embodiments, logic 1504 may include instructions, data, and / or code which, when executed by the machine, cause the machine to perform the methods, processes, and / or operations described herein. The machine may include, for example, any suitable processing platform, computing platform, computing device, processing device, computing system, processing system, computer, processor, etc., and may be implemented using any suitable combination of hardware, software, firmware, etc.

[0398] In some demonstrative embodiments, logic 1504 may include, or be implemented as, software, software modules, applications, programs, subroutines, instructions, instruction sets, computing code, words, values, symbols, etc. Instructions may include any appropriate type of code, such as source code, compiled code, interpreted code, executable code, static code, dynamic code, etc. Instructions may be implemented according to a predefined computer language, method, or syntax for instructing the processor to perform a particular function. Instructions may be implemented using any appropriate high-level, low-level, object-oriented, visual, compiled and / or interpreted programming language, such as C, C++, Java, BASIC, Matlab, Pascal, Visual BASIC, assembly language, machine code, etc. [Examples]

[0399] The following example illustrates a further embodiment.

[0400] Example 1 includes a product comprising one or more tangible computer-readable non-transient storage media, which include computer-executable instructions that, when executed by at least one computer processor, enable at least one computer processor to cause a computing device to process at least one depth map containing depth information acquired through a lens, and to determine one or more parameters of the lens based on this depth information.

[0401] Example 2 includes the subject matter of Example 1, and optionally, when the above instruction is executed, causes the computing device to identify the depth value corresponding to an object in the depth map, and to determine one or more parameters of the lens based on the depth value corresponding to the object, a first distance, and a second distance, wherein the first distance is between the object and the depth sensor, and the second distance is between the depth sensor and the lens.

[0402] Example 3 includes the subject matter of Example 2, and optionally, when the above instruction is executed, causes the computing device to identify depth information acquired without the lens in the depth map, and to determine at least one of the first distance or the second distance based on the depth information acquired without the lens.

[0403] Example 4 includes the subject matter of Example 2 or Example 3, and optionally, when the instruction is executed, causes the computing device to identify areas in the depth map corresponding to elements on the surface of the lens, and to determine the second distance based on the depth information in the areas corresponding to the elements.

[0404] Example 5 includes the subject of Example 4, and optionally, the elements include an opaque rim for the lens or a frame for holding the lens.

[0405] Example 6 includes the subject of any one of Examples 2 to 5, and optionally, when the instruction is executed, causes the computing device to identify an area in the depth map corresponding to a surface containing the object, and to determine the second distance based on the depth information in the area corresponding to the surface containing the element.

[0406] Example 7 includes the subject of any one of Examples 2 through 6, and optionally, the object includes a wall.

[0407] Example 8 includes the subject matter of any one of Examples 2 to 7, and optionally, when executed, the instruction causes the computing device to instruct the user to move at least one of the depth sensor or lens until it reaches a specific setting of at least one of the first distance or the second distance.

[0408] Example 9 includes the subject matter of any one of Examples 2 through 8, and optionally, when the instruction is executed, causes the computing device to instruct the user to position the lens on the mirror such that the first distance includes an optical distance where the first distance is twice the distance between the depth sensor and the mirror.

[0409] Example 10 includes the subject matter of any one of Examples 2 through 9, and optionally, when the instruction is executed, causes the computing device to instruct the user to position the lens relative to the depth sensor such that the second distance is half the first distance.

[0410] Example 11 includes the subject of any one of Examples 1 through 10, and optionally, the instruction causes the computing device to instruct the user to position the lens between the depth sensor and the object such that, when executed, the depth information includes the depth information of the object acquired by the depth sensor through the lens.

[0411] Example 12 includes the subject of any one of Examples 1 to 11, and optionally, when the instruction is executed, causes the computing device to identify an area in the depth map corresponding to the lens, and to determine one or more parameters of the lens based on the dimensions of the area corresponding to the lens.

[0412] Example 13 includes the subject of any one of Examples 1 to 12, and optionally, when the instruction is executed, causes the computing device to determine one or more parameters of the lens based on a plurality of different depth maps acquired through the lens.

[0413] Example 14 includes the subject matter of Example 13, and optionally, the plurality of different depth maps include at least a first depth map and a second depth map, wherein the first depth map is acquired through the lens when the lens is in a first position relative to the depth sensor, and the second depth map is acquired through the lens when the lens is in a second position different from the first position relative to the depth sensor.

[0414] Example 15 includes the subject matter of Example 13 or Example 14, and optionally the plurality of different depth maps include at least a first depth map and a second depth map, wherein the first depth map includes a depth map acquired through the lens when the lens is at a first rotation angle in the plane of the lens, and the second depth map includes a depth map acquired through the lens when the lens is at a second rotation angle in the plane of the lens.

[0415] Example 16 includes the subject matter of Example 15, and optionally, when the instruction is executed, causes the computing device to determine at least one of the cylindrical axis of the lens or the cylindrical power of the lens based on the first depth map and the second depth map.

[0416] Example 17 includes the subject of any one of Examples 1 through 12, and optionally, when the instruction is executed, causes the computing device to determine one or more parameters of the lens based on a single depth map acquired through the lens.

[0417] Example 18 includes the subject of any one of Examples 1 to 17, and optionally, when the instruction is executed, causes the computing device to identify one or more depth values ​​acquired through the lens in the depth map, and to determine one or more parameters of the lens based on the one or more depth values ​​acquired through the lens.

[0418] Example 19 includes the subject of any one of Examples 1 to 18, and optionally, when the instruction is executed, causes the computing device to identify in the depth map one or more first depth values ​​obtained through the lens and one or more second depth values ​​obtained without the lens, and to determine one or more parameters of the lens based on the first and second depth values.

[0419] Example 20 includes the subject of any one of Examples 1 to 19, and optionally, when the instruction is executed, causes the computing device to process image information of an image of an object acquired by the camera through the lens when the lens is between the camera and the object, to determine a magnification value based on the magnification between the imaged dimensions of the object and the actual dimensions of the object, and to determine one or more parameters of the lens based on the depth information and the magnification value.

[0420] Example 21 includes the subject of any one of Examples 1 to 20, and optionally, when the instruction is executed, causes the computing device to determine one or more parameters of the lens based on one or more configuration parameters of a depth sensor that provides the depth map.

[0421] Example 22 includes the subject matter of Example 21, and optionally, one or more of the above configuration parameters include the type of depth sensor.

[0422] Example 23 includes the subject matter of Example 21 or Example 22, and optionally, one or more of the above configuration parameters include the wavelength of electromagnetic radiation used by the depth sensor to generate the above depth map.

[0423] Example 24 includes the subject of any one of Examples 1 to 23, and optionally, when the instruction is executed, causes the computing device to determine one or more parameters of the lens by processing the depth information as depth information for structured optical depth measurement.

[0424] Example 25 includes the subject of any one of Examples 1 to 23, and optionally, when the instruction is executed, causes the computing device to determine one or more of the parameters of the lens by processing the depth information as time-of-flight (ToF) depth information.

[0425] Example 26 includes the subject of any one of Examples 1 to 25, and optionally, when the instruction is executed, causes the computing device to determine one or more of the parameters of the lens based on predefined mapping information for mapping between multiple depth map measurements and multiple estimated optical parameters.

[0426] Example 27 includes the subject of any one of Examples 1 through 26, and optionally, when the instruction is executed, causes the computing device to determine one or more of the optical parameters for a spherical cylindrical lens.

[0427] Example 28 includes the subject of any one of Examples 1 to 26, and optionally, when the instruction is executed, causes the computing device to determine one or more optical parameters for a bifocal or multifocal lens.

[0428] Example 29 includes the subject of any one of Examples 1 to 28, and optionally, one or more parameters of the lens include at least one of the following: the spherical power of the lens, the cylindrical power of the lens, the cylindrical axis of the lens, the sign of the lens, or the center of the lens.

[0429] Example 30 includes a device comprising a depth sensor for generating a depth map containing depth information acquired through a lens, and a lens measuring module for determining one or more parameters of the lens based on the depth map.

[0430] Example 31 includes the subject matter of Example 30, and optionally, the lens measuring module identifies a depth value corresponding to an object in the depth map, and determines one or more parameters of the lens based on the depth value corresponding to the object, a first distance, and a second distance, wherein the first distance is between the object and the depth sensor, and the second distance is between the depth sensor and the lens.

[0431] Example 32 includes the subject matter of Example 31, and optionally, the lens measuring module identifies depth information acquired without the lens in the depth map and determines at least one of the first distance or the second distance based on the depth information acquired without the lens.

[0432] Example 33 includes the subject matter of Example 31 or Example 32, and optionally, the lens measuring module identifies an area in the depth map corresponding to an element on the surface of the lens, and determines the second distance based on the depth information in the area corresponding to the element.

[0433] Example 34 includes the subject matter of Example 33, and optionally, the elements include an opaque rim for the lens or a frame for holding the lens.

[0434] Example 35 includes a subject from any one of Examples 31 to 34, and optionally, the lens measuring module identifies an area in the depth map corresponding to a plane containing the object, and determines the second distance based on the depth information in the area corresponding to the plane containing the element.

[0435] Example 36 includes the subject of any one of Examples 31 through 35, and optionally, the object includes a wall.

[0436] Example 37 includes the subject of any one of Examples 31 to 36, and optionally instructs the user to move the depth sensor or at least one of the lenses until a specific setting of at least one of the first distance or the second distance is reached.

[0437] Example 38 includes the subject of any one of Examples 31 to 37, and optionally instructs the user that the lens measuring module positions the lens on the mirror such that the first distance includes an optical distance where the first distance is twice the distance between the depth sensor and the mirror.

[0438] Example 39 includes the subject of any one of Examples 31 to 38, and optionally, the lens measuring module instructs the user to position the lens relative to the depth sensor such that the second distance is half the first distance.

[0439] Example 40 includes the subject of any one of Examples 30 to 39, and optionally, the lens measuring module instructs the user to position the lens between the depth sensor and the object such that the depth information includes depth information of the object acquired by the depth sensor through the lens.

[0440] Example 41 includes the subject of any one of Examples 30 to 40, and optionally, the lens measuring module identifies an area corresponding to the lens in the depth map and determines one or more parameters of the lens based on the dimensions of the area corresponding to the lens.

[0441] Example 42 includes the subject of any one of Examples 30 to 41, and optionally, the lens measuring module determines one or more of the above parameters of the lens based on a plurality of different depth maps obtained through the lens.

[0442] Example 43 includes the subject matter of Example 42, and optionally, the plurality of different depth maps include at least a first depth map and a second depth map, wherein the first depth map is acquired through the lens when the lens is in a first position relative to the depth sensor, and the second depth map is acquired through the lens when the lens is in a second position different from the first position relative to the depth sensor.

[0443] Example 44 includes the subject matter of Example 42 or Example 43, and optionally the plurality of different depth maps include at least a first depth map and a second depth map, wherein the first depth map includes a depth map acquired through the lens when the lens is at a first rotation angle in the plane of the lens, and the second depth map includes a depth map acquired through the lens when the lens is at a second rotation angle in the plane of the lens.

[0444] Example 45 includes the subject matter of Example 44, and optionally, the lens measuring module determines at least one of the cylindrical axis of the lens or the cylindrical power of the lens based on the first depth map and the second depth map.

[0445] Example 46 includes the subject of any one of Examples 30 to 41, and optionally, the lens measuring module determines one or more of the above parameters of the lens based on a single depth map obtained through the lens.

[0446] Example 47 includes the subject of any one of Examples 30 to 46, and optionally, the lens measuring module identifies one or more depth values ​​obtained through the lens in the depth map, and determines one or more parameters of the lens based on the one or more depth values ​​obtained through the lens.

[0447] Example 48 includes the subject of any one of Examples 30 to 47, and optionally, the lens measuring module identifies in the depth map one or more first depth values ​​obtained through the lens and one or more second depth values ​​obtained without the lens, and determines one or more parameters of the lens based on the first and second depth values.

[0448] Example 49 includes the subject of any one of Examples 30 to 48, and optionally, the lens measuring module processes image information of an image of an object acquired by the camera through the lens when the lens is between the camera and the object, determines a magnification value based on the magnification between the imaged dimensions of the object and the actual dimensions of the object, and determines one or more parameters of the lens based on the depth information and the magnification value.

[0449] Example 50 includes the subject of any one of Examples 30 to 49, and optionally, the lens measuring module determines the one or more parameters of the lens based on one or more configuration parameters of a depth sensor from which the depth map is provided.

[0450] Example 51 includes the subject matter of Example 50, and optionally, one or more of the above configuration parameters include the type of depth sensor.

[0451] Example 52 includes the subject matter of Example 50 or Example 51, and optionally, one or more of the above configuration parameters include the wavelength of electromagnetic radiation used by the depth sensor to generate the above depth map.

[0452] Example 53 includes the subject of any one of Examples 30 to 52, and optionally, the lens measuring module determines one or more of the above parameters of the lens by processing the above depth information as depth information for structured optical depth measurement.

[0453] Example 54 includes the subject of any one of Examples 30 to 52, and optionally, the lens measuring module determines one or more of the above parameters of the lens by processing the above depth information as depth information for time-of-flight (ToF) depth measurement.

[0454] Example 55 includes the subject of any one of Examples 30 to 54, and optionally, the lens measuring module determines one or more of the above parameters of the lens based on predefined mapping information for mapping between multiple depth map measurements and multiple estimated optical parameters.

[0455] Example 56 includes the subject of any one of Examples 30 to 55, and optionally, the lens measuring module determines one or more of the optical parameters for a spherical cylindrical lens.

[0456] Example 57 includes the subject of any one of Examples 30 to 55, and optionally, the lens measuring module determines one or more of the optical parameters for a bifocal or multifocal lens.

[0457] Example 58 includes the subject of any one of Examples 30 to 57, and optionally, one or more of the above parameters of the lens include at least one of the following: the spherical power of the lens, the cylindrical power of the lens, the cylindrical axis of the lens, the sign of the lens, or the center of the lens.

[0458] Example 59 is a method for determining one or more optical parameters of a lens, comprising the steps of processing at least one depth map containing depth information acquired through the lens, and determining the one or more parameters of the lens based on at least the depth map.

[0459] Example 60 includes the subject matter of Example 59 and optionally includes the steps of: identifying a depth value corresponding to an object in the depth map; and determining one or more parameters of the lens based on the depth value corresponding to the object, a first distance, and a second distance, wherein the first distance is between the object and the depth sensor, and the second distance is between the depth sensor and the lens.

[0460] Example 61 includes the subject of Example 60 and optionally includes the steps of identifying depth information acquired without the lens in the depth map and determining at least one of the first distance or the second distance based on the depth information acquired without the lens.

[0461] Example 62 includes the subject matter of Example 60 or Example 61 and optionally includes the steps of identifying an area in the depth map corresponding to an element on the surface of the lens, and determining the second distance based on depth information in the area corresponding to the element.

[0462] Example 63 includes the subject matter of Example 62, and optionally, the elements include an opaque rim for the lens or a frame for holding the lens.

[0463] Example 64 includes any one of the themes from Examples 60 to 63 and optionally includes the steps of identifying an area in the depth map corresponding to a plane containing the object, and determining the second distance based on depth information in the area corresponding to the plane containing the element.

[0464] Example 65 includes the subject of any one of Examples 60 through 64, and optionally, the object includes a wall.

[0465] Example 66 includes the subject of any one of Examples 60 to 65 and optionally includes the step of instructing the user to move at least one of the depth sensor or the lens until it reaches a specific setting of at least one of the first distance or the second distance.

[0466] Example 67 includes the subject of any one of Examples 60 to 66 and optionally includes the step of instructing the user to position the lens on the mirror such that the first distance includes an optical distance where the first distance is twice the distance between the depth sensor and the mirror.

[0467] Example 68 includes the subject of any one of Examples 60 to 67 and optionally includes the step of instructing the user to position the lens relative to the depth sensor such that the second distance is half the first distance.

[0468] Example 69 includes the subject of any one of Examples 59 to 68 and optionally includes the step of instructing the user to position the lens between the depth sensor and the object such that the depth information includes depth information of the object acquired by the depth sensor through the lens.

[0469] Example 70 includes any one subject from Examples 59 to 69 and optionally includes the steps of identifying an area in the depth map corresponding to the lens and determining one or more parameters of the lens based on the dimensions of the area corresponding to the lens.

[0470] Example 71 includes any one subject from Examples 59 to 70 and optionally includes the step of determining one or more of the above parameters of the lens based on a plurality of different depth maps obtained through the above lens.

[0471] Example 72 includes the subject matter of Example 71, and optionally, the plurality of different depth maps include at least a first depth map and a second depth map, wherein the first depth map is acquired through the lens when the lens is in a first position relative to the depth sensor, and the second depth map is acquired through the lens when the lens is in a second position different from the first position relative to the depth sensor.

[0472] Example 73 includes the subject matter of Example 71 or Example 72, and optionally the plurality of different depth maps include at least a first depth map and a second depth map, wherein the first depth map includes a depth map acquired through the lens when the lens is at a first rotation angle in the plane of the lens, and the second depth map includes a depth map acquired through the lens when the lens is at a second rotation angle in the plane of the lens.

[0473] Example 74 includes the subject matter of Example 73 and optionally includes the step of determining at least one of the cylindrical axis of the lens or the cylindrical power of the lens based on the first depth map and the second depth map.

[0474] Example 75 includes any one subject from Examples 59 to 70 and optionally includes the step of determining one or more of the above parameters of the lens based on a single depth map obtained through the above lens.

[0475] Example 76 includes any one subject from Examples 59 to 75 and optionally includes the steps of identifying one or more depth values ​​obtained through the lens in the depth map, and determining one or more parameters of the lens based on the one or more depth values ​​obtained through the lens.

[0476] Example 77 includes any one subject from Examples 59 to 76 and optionally includes the steps of identifying one or more first depth values ​​obtained through the lens and one or more second depth values ​​obtained without the lens in the depth map, and determining one or more parameters of the lens based on the first and second depth values.

[0477] Example 78 includes any one subject from Examples 59 to 77 and optionally includes the steps of: processing image information of an image of an object acquired by the camera through the lens when the lens is between the camera and the object; determining a magnification value based on the magnification between the imaged dimensions of the object and the actual dimensions of the object; and determining one or more parameters of the lens based on the depth information and the magnification value.

[0478] Example 79 includes the subject of any one of Examples 59 to 78 and optionally includes the step of determining one or more parameters of the lens based on one or more configuration parameters of a depth sensor that provides the depth map.

[0479] Example 80 includes the subject matter of Example 79, and optionally, one or more of the above configuration parameters include the type of depth sensor.

[0480] Example 81 includes the subject matter of Example 79 or Example 80, wherein one or more of the above configuration parameters include the wavelength of electromagnetic radiation used by the depth sensor to generate the above depth map.

[0481] Example 82 includes the subject of any one of Examples 59 to 81 and optionally includes the step of determining one or more of the above parameters of the lens by processing the above depth information as depth information for structured optical depth measurement.

[0482] Example 83 includes the subject of any one of Examples 59 to 81 and optionally includes the step of determining one or more of the above parameters of the lens by processing the above depth information as depth information for time-of-flight (ToF) depth measurement.

[0483] Example 84 includes a subject from any one of Examples 59 to 83 and optionally includes the step of determining one or more of the above parameters of the lens based on predefined mapping information for mapping between a plurality of depth map measurements and a plurality of estimated optical parameters.

[0484] Example 85 includes one subject from any one of Examples 59 to 84 and optionally includes the step of determining one or more of the above optical parameters for a spherical cylindrical lens.

[0485] Example 86 includes one subject from any one of Examples 59 to 84 and optionally includes the step of determining one or more of the above optical parameters for a bifocal or multifocal lens.

[0486] Example 87 includes the subject of any one of Examples 59 to 86, and optionally, one or more of the above parameters of the lens include at least one of the following: the spherical power of the lens, the cylindrical power of the lens, the cylindrical axis of the lens, the sign of the lens, or the center of the lens.

[0487] Example 88 is an apparatus for determining one or more optical parameters of a lens, comprising means for processing at least one depth map containing depth information acquired through the lens, and means for determining at least one or more parameters of the lens based on the depth map.

[0488] Example 89 includes the subject matter of Example 88 and optionally includes, in the depth map, means for identifying a depth value corresponding to an object, and means for determining one or more parameters of the lens based on the depth value corresponding to the object, a first distance, and a second distance, wherein the first distance is between the object and the depth sensor, and the second distance is between the depth sensor and the lens.

[0489] Example 90 includes the subject matter of Example 89 and optionally includes, in the depth map, means for identifying depth information acquired without the lens, and means for determining at least one of the first distance or the second distance based on the depth information acquired without the lens.

[0490] Example 91 includes the subject matter of Example 89 or Example 90 and optionally includes, in the depth map, means for identifying areas corresponding to elements on the surface of the lens, and means for determining the second distance based on depth information in the areas corresponding to the elements.

[0491] Example 92 includes the subject matter of Example 91, and optionally, the elements include an opaque rim for the lens or a frame for holding the lens.

[0492] Example 93 includes any one subject from Examples 89 to 92 and optionally includes means for identifying an area in the depth map corresponding to a plane containing the object, and means for determining the second distance based on depth information in the area corresponding to the plane containing the element.

[0493] Example 94 includes the subject of any one of Examples 89 through 93, and optionally, the object includes a wall.

[0494] Example 95 includes the subject of any one of Examples 89 to 94 and optionally includes means for instructing the user to move at least one of the depth sensor or lens until it reaches a specific setting of at least one of the first distance or the second distance.

[0495] Example 96 includes the subject matter of any one of Examples 89 to 95 and optionally includes means for instructing the user to position the lens on the mirror such that the first distance includes an optical distance where the first distance is twice the distance between the depth sensor and the mirror.

[0496] Example 97 includes the subject of any one of Examples 89 to 96 and optionally includes means for instructing the user to position the lens relative to the depth sensor such that the second distance is half the first distance.

[0497] Example 98 includes the subject matter of any one of Examples 88 to 97 and optionally includes means for instructing the user to position the lens between the depth sensor and the object such that the depth information includes depth information of the object acquired by the depth sensor through the lens.

[0498] Example 99 includes the subject of any one of Examples 88 to 98 and optionally includes means for identifying an area in the depth map corresponding to the lens, and means for determining one or more parameters of the lens based on the dimensions of the area corresponding to the lens.

[0499] Example 100 includes the subject of any one of Examples 88 to 99 and optionally includes means for determining one or more of the above parameters of the lens based on a plurality of different depth maps obtained through the above lens.

[0500] Example 101 includes the subject matter of Example 100, and optionally, the plurality of different depth maps include at least a first depth map and a second depth map, wherein the first depth map is acquired through the lens when the lens is in a first position relative to the depth sensor, and the second depth map is acquired through the lens when the lens is in a second position different from the first position relative to the depth sensor.

[0501] Example 102 includes the subject matter of Example 100 or Example 101, and optionally the plurality of different depth maps include at least a first depth map and a second depth map, wherein the first depth map includes a depth map acquired through the lens when the lens is at a first rotation angle in the plane of the lens, and the second depth map includes a depth map acquired through the lens when the lens is at a second rotation angle in the plane of the lens.

[0502] Example 103 includes the subject matter of Example 102 and optionally includes means for determining at least one of the cylindrical axis of the lens or the cylindrical power of the lens based on the first depth map and the second depth map.

[0503] Example 104 includes the subject of any one of Examples 88 to 99 and optionally includes means for determining one or more of the above parameters of the lens based on a single depth map obtained through the above lens.

[0504] Example 105 includes any one subject from Examples 88 to 104 and optionally includes means for identifying one or more depth values ​​acquired through the lens in the depth map, and means for determining one or more parameters of the lens based on the one or more depth values ​​acquired through the lens.

[0505] Example 106 includes any one subject from Examples 88 to 105 and optionally includes means for identifying one or more first depth values ​​obtained through the lens and one or more second depth values ​​obtained without the lens in the depth map, and means for determining one or more parameters of the lens based on the first and second depth values.

[0506] Example 107 includes any one subject from Examples 88 to 106 and optionally includes means for processing image information of an image of an object acquired by the camera through the lens when the lens is between the camera and the object; means for determining a magnification value based on the magnification between the imaged dimensions of the object and the actual dimensions of the object; and means for determining one or more parameters of the lens based on the depth information and the magnification value.

[0507] Example 108 includes the subject of any one of Examples 88 to 107 and optionally includes means for determining the one or more parameters of the lens based on one or more configuration parameters of a depth sensor that provides the depth map.

[0508] Example 109 includes the subject matter of Example 108, and optionally, one or more of the above configuration parameters include the type of depth sensor.

[0509] Example 110 includes the subject matter of Example 108 or Example 109, wherein one or more of the above configuration parameters include the wavelength of electromagnetic radiation used by the depth sensor to generate the above depth map.

[0510] Example 111 includes the subject of any one of Examples 88 to 110 and optionally includes means for determining one or more of the above parameters of the lens by processing the above depth information as depth information for structured optical depth measurement.

[0511] Example 112 includes the subject of any one of Examples 88 to 110 and optionally includes means for determining one or more of the above parameters of the lens by processing the above depth information as depth information for time-of-flight (ToF) depth measurement.

[0512] Example 113 includes a subject from any one of Examples 88 to 112 and optionally includes means for determining one or more of the above parameters of the lens based on predefined mapping information for mapping between a plurality of depth map measurements and a plurality of estimated optical parameters.

[0513] Example 114 includes a subject from any one of Examples 88 to 113 and optionally includes means for determining one or more of the above optical parameters for a spherical cylindrical lens.

[0514] Example 115 includes the subject of any one of Examples 88 to 113 and optionally includes means for determining one or more of the above optical parameters for a bifocal or multifocal lens.

[0515] Example 116 includes the subject of any one of Examples 88 to 115, and optionally, one or more of the above parameters of the lens include at least one of the following: the spherical power of the lens, the cylindrical power of the lens, the cylindrical axis of the lens, the sign of the lens, or the center of the lens.

[0516] Functions, operations, components and / or features described herein with reference to one or more embodiments may be combined with one or more other functions, operations, components and / or features described herein with reference to one or more other embodiments, or used in combination with such other functions, operations, components and / or features, and vice versa.

[0517] While certain features have been illustrated and described herein, many modifications, substitutions, alterations, and equivalents may come to mind for those skilled in the art. Therefore, it should be understood that the appended claims are intended to encompass all such modifications and alterations that fall within the true spirit of this disclosure.

Claims

1. A device comprising a depth sensor for generating a depth map containing depth information of a reference object sensed through a lens, wherein the depth map is The reference object is detected without the lens, and the first sensing depth value of the reference object is The reference object is detected through the lens, and the second sensing depth value of the reference object is A third sensing depth value of an opaque object whose distance from the depth sensor is the same as that of the lens, A lens measuring module that determines one or more parameters of the lens based on at least the first sensing depth value, the second sensing depth value, and the third sensing depth value of the depth map, A device that includes this.

2. The structured light projector further comprises a lens that projects light onto a reference object, The device according to claim 1, wherein the depth sensor generates the depth map from the light projected from the structured light projector.

3. The lens measuring module processes the depth map, and at least one of the depth maps includes at least one feature on the reference object. The device according to claim 1, which determines the second sensing depth value based on the change in the detection position of at least one feature in the depth map.

4. The device according to claim 3, wherein at least one of the features is on the plane of the reference object.

5. The device according to claim 3, wherein determining the second sensing depth value of the at least one feature includes comparing the first size of the at least one feature as represented on the reference object without the lens with the second size of the at least one feature as represented on the reference object through the lens.

6. The device according to claim 3, wherein the lens scales the at least one feature of the entire reference object.

7. The device according to claim 3, wherein the processing of the depth map includes processing of a plurality of depth maps corresponding to a plurality of lens angles.

8. The device according to claim 3, wherein the depth map is acquired by the depth sensor while the lens is positioned on the depth sensor.

9. The device according to claim 3, wherein the depth sensor includes a stereo camera.

10. The aforementioned lens measuring meter module is The first sensor signal to the depth sensor is processed along a first path from the first light ray of the illumination source through the lens, The second sensor signal to the depth sensor is processed along a second path that does not pass through the lens, from the second light ray of the illumination source. Determine the path difference between the first path and the second path. The device according to claim 1, configured to determine the second sensing depth value based on the path difference.

11. The device according to claim 10, wherein each of the first sensor signal and the second sensor signal includes time-of-flight (ToF) measurement.

12. The device according to claim 10, wherein the lens comprises two intersecting cylindrical lenses.

13. The device according to claim 10, wherein the first ray and the second ray are reflected from a planar object on the first path to the depth sensor and the second path to the depth sensor, respectively.

14. The device according to claim 10, wherein the determination of the parameters of the lens includes measuring a depth value directly related to the path difference via the depth sensor.

Images