Interactive eye imitation

Abstract

Interactive eye imitation, characterized by improved resolution, anatomical assembly, skillful heat dissipation, conjugate eye movement and imitation of eye contact.

Description

[0001] The state of the art includes a system for displaying realistic eyes in the sense of eye imitations for dolls, animatronics and the like, based on a computer, a screen, an image guide and a meniscus lens, as described in patent number US 8,651,916 B2 (February 18, 2014).

[0002] The following further developments of the system are presented: - Improved resolution - Anatomical montage - Effective heat dissipation - Conjugate eye movement - Imitation of eye contact Improved resolution

[0003] It is known that a circular fiber optic image guide can transform a flat screen display into a hemispherical display to simulate an eyeball. The flat input side is connected to a conventional screen. The output side is modified to have a convex surface. This surface can optionally be covered by a meniscus lens.

[0004] As an improvement, this image guide can be designed in the form of a round fiber optic taper. The image guide has a larger diameter at the flat input side than at the convex output side. For example, a screen like those commonly used in smartwatches (e.g., 32 mm diameter) can be used to reduce the image size to that of a human eyeball (24 mm diameter). The advantage lies in the increased image resolution at the output side.

[0005] To illustrate, we showFig. 1a (top view) and Fig. 1b (cross-sectional view) the scheme of an interactive eye imitation using a fiber optic taper (2) to improve resolution. Anatomical montage

[0006] The method of attaching the artificial eye to a doll is not further specified in patent number US 8,651,916 B2. We would like to present a particularly advantageous method of attachment for large dolls made of plastics such as silicone, TPE, or others. These dolls typically have an eye socket that is anatomically modeled after a human eye socket. The diameter of such sockets for painted artificial eyes ranges from 15 to 35 mm, depending on the scale of the large dolls. The artificial eye can be dimensioned to fit precisely into this eye socket.

[0007] The advantages are that doll manufacturers have little to adapt to, that the eye is mechanically secured against falling out, and that a realistic overall impression is created.

[0008] With anatomical montage, only a portion of the artificial eye is visible when viewed from the outside. To prevent the artificial eye from showing through the limiting plastic layers of the upper and lower eyelids, these layers can be coated with a light-absorbing layer on the orbital side. Additionally, the screen or software can be configured to display these image areas less brightly or not at all. This can save processing power and lead to a better refresh rate (frame rate).

[0009] The principle is in Fig. 2 shown. The interactive eye imitation (3) and its limiting plastic layers (4). Clever heat dissipation

[0010] Electronic systems produce heat. With the mounting configuration described here, in an enclosed space, heat buildup is to be expected. Therefore, adequate heat dissipation is essential. This can be achieved through generously sized heat sinks that transfer the heat evenly to the surrounding environment.

[0011] Preferably, the heat can be dissipated through anatomical openings of the doll's head, such as the nostrils, mouth, or ears. This can be used to passively simulate natural body heat or "warm breath."

[0012] Alternatively, the heat can be distributed over a larger area via thermally conductive connections such as metal tubes, metal springs or heat pipes, or – in the case of larger dolls – dissipated to the metal skeleton. Conjugate eye movement

[0013] The artificial eyes simulate eye movements by moving them on the screen, while the devices themselves remain motionless in the eye socket. The movements of the screen eyes must be synchronized, just like real eyes, in the sense of conjugate eye movements.

[0014] A solution that eliminates the need for information exchange between the eye imitations is preferable. This can be achieved by having the eye imitations relate each movement to a synchronization event. Such a synchronization event could be, for example, the switching on of the eye imitations, provided both were switched on simultaneously. Alternatively, a specific Bluetooth signal sent by the user via a control app could serve as the synchronization event.

[0015] The eye imitations move according to a cyclical sequence. The current eye position is determined by the time interval since the synchronization event. The calculation is performed by dividing the time interval by the duration of the movement sequence, using the modulo operator: Position = (t - t0) mod cycle duration.

[0016] Using this method, conjugate eye movement can be achieved with commercially available microcontrollers (e.g. ESP32-S3) for at least 60 minutes (experimentally confirmed) without information exchange between the eye imitations. Imitation of eye contact

[0017] The eye simulation is designed to maintain eye contact with the viewer. This requires a camera and facial recognition. In an eye simulation, the camera can be integrated into the screen as an under-display camera (UDC). Alternatively, a transparent screen combined with a conventional camera is also possible. While prototypes of such technical solutions exist, they are currently not widely available.

[0018] As a bridging technology, a conventional camera can be mounted in a separate system along the midline between the eye imitations. The camera does not need to be positioned exactly at eye level; it can also be positioned above or below it. For better understanding, the suitable area (5) is shown in Fig. 2 marked.

[0019] Ideally, the camera is combined with a microcontroller that handles face detection. This is possible in real time, for example, with a modified version of the Viola-Jones method (hair-like features). The microcontroller sends the viewer's calculated eye position to neighboring eye simulations many times per second, preferably via radio / Bluetooth.

[0020] For aesthetic reasons, it's desirable to conceal the camera. Due to the small size of the separate system, this can be achieved by embedding it in an accessory such as a necklace, diadem, tiara, headband, or headphones. Consideration should be given to heat dissipation and power supply (cable or battery / rechargeable battery). Heat dissipation is facilitated if the accessory is made at least partially of a heat-conducting material. Reference symbol list 1 integrated unit consisting of screen, computer / microcontroller, Bluetooth radio transmitter and optional battery / rechargeable battery 2 fiber optic tapers 3 Interactive eye imitation consisting of (1) and optional (2) 4 facial structures that thinly cover the eye 5 center line areas where a separate camera can be hidden in the form of an accessory. QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] US 8,651,916 B2 [0001, 0006]

Claims

[1] Interactive eye simulation, characterized by , improved resolution, anatomical montage, clever heat dissipation, conjugate eye movement and imitation of eye contact. [2] Improved resolution according to claim 1, characterized by , that a round fiber optic image guide in the form of a taper with a convex image side to simulate the surface of an eyeball improves the resolution of the eye imitation [3] Anatomical assembly according to claim 1, characterized by that it fits into an eye socket typical of conventional doll heads made of soft plastic such as TPE or silicone. This is achieved either by adjusting the size of the eye socket or the eye imitation. [4] Fitting into eye socket according to claim 3, characterized by The facial structures molded from the doll's plastic partially cover the imitation eyes (upper and lower eyelids). This provides mechanical security against falling out while maintaining a realistic appearance. [5] Overlapping facial structures according to claim 4, characterized by that these are protected against light transmission on the side facing the eye socket by a light-absorbing layer. [6] Overlapping facial structures according to claim 4, characterized by , that the eye simulation does not display an image at the relevant points, thereby reducing light transmission and enabling a higher refresh rate by saving computing power. [7] Clever heat dissipation according to claim 1, characterized by , that the heat generated during operation is dissipated via anatomical openings of the doll's head such as the nose, mouth and ears in order to simulate body heat. [8] Clever heat dissipation according to claim 1, characterized by , so that the heat is dissipated to the metal skeleton of the doll - if present - to avoid overheating. [9] Conjugate eye movement according to claim 1, characterized byThe left and right eyes undergo coordinated cyclical movement sequences, synchronized by a signal assumed to be simultaneous (simultaneous power-on, defined radio signal). At any given moment, a deterministically calculable eye position exists. Communication between the eyes is not required. [10] Imitation of eye contact according to claim 1, characterized by , that in the design of the eye imitation an under-display camera is combined with a screen to enable perception of the environment while simultaneously imitating the eye, in the sense of a bidirectional fiber eye. [11] Imitation of eye contact according to claim 1, characterized by , that in the construction of the eye imitation a transparent screen is combined with a conventional camera to enable perception of the environment while simultaneously imitating the eye, in the sense of a bidirectional fiber eye. [12] Imitation of eye contact according to claim 1, characterized by , that in a separate module a camera in combination with a microcontroller performs face detection and sends the results to neighboring eye imitations, with the aim of imitating an eye movement related to the face of a viewer. [13] System as in claim 12, characterized by , that results are wirelessly sent to neighboring eye simulators. [14] System as in claim 12, characterized by The system is concealed in an accessory located in the midline between the eyes, such as a necklace, a diadem, a tiara, a headband, or headphones. This allows for a pleasing appearance.

Images