Intelligent display device based on human eye simulation

Abstract

The invention provides an intelligent display device based on human eye simulation, and relates to the technical field of visual imaging, and the intelligent display device comprises a left view lens module and a right view lens module which are arranged on a non-imaging surface of a display lens module; the lens orientation of the left view lens module and the lens orientation of the right view lens module are the same as the imaging surface orientation of the display mirror module; the optical axis of the left-view lens module and the optical axis of the right-view lens module are on the same horizontal plane and the included angle between the optical axes is a body view angle; the left-view lens module and the right-view lens module are used for carrying out image acquisition on a shot object in front of an imaging surface of the display mirror module to obtain a left-view image and a right-view image; the image processing module is used for generating a three-dimensional image of the shot object based on the left view image and the right view image; and the display mirror module is used for displaying the three-dimensional image. The device provided by the invention has a small difference with an image observed by real human eyes, and can restore the visual effect of a shot object in the brain of a user to the greatest extent.

Description

Technical Field

[0001] The present application relates to the field of visual imaging technology, and in particular to an intelligent display device based on human eye simulation. Background Art

[0002] Current visual imaging technology is usually based on shooting with a single image sensor, which captures light and generates a two-dimensional image of the object. It has a simple structure and low cost, and is widely used in scenarios such as positioning, object recognition and measurement in a two-dimensional plane.

[0003] When visual imaging technology is applied to simulated mirror imaging, since a single image sensor obtains less image information of the object, the generated two-dimensional image cannot effectively reflect the spatial position information of the object, the imaging effect is poor, and there is a large gap between the image observed by the real human eye. Summary of the invention

[0004] The present application provides an intelligent display device based on human eye simulation, which is used to improve the imaging effect of photographed objects.

[0005] The present application provides an intelligent display device based on human eye simulation, comprising a display mirror module, a left-view lens module, a right-view lens module and an image processing module; The left-view lens module and the right-view lens module are arranged on the non-imaging surface of the display mirror module; the lens orientation of the left-view lens module and the lens orientation of the right-view lens module are the same as the imaging surface orientation of the display mirror module; the optical axis of the left-view lens module and the optical axis of the right-view lens module are in the same horizontal plane and the angle between the optical axes is the stereoscopic angle; The left-view lens module and the right-view lens module collect images of the object in front of the imaging surface of the display mirror module to obtain a left-view image and a right-view image; The image processing module is connected to the left-view lens module and the right-view lens module respectively, and is used to generate a three-dimensional stereoscopic image of the photographed object based on the left-view image and the right-view image; The display mirror module is connected to the image processing module and is used to display the three-dimensional image.

[0006] In some embodiments, the left-view lens module includes a left lens mount, a left focal length adjustment component, a left aperture adjustment component, a left-view lens, and a left image sensor that are sequentially connected along the optical axis.

[0007] In some embodiments, the right-view lens module includes a right lens mount, a right focal length adjustment component, a right aperture adjustment component, a right-view lens, and a right image sensor that are sequentially connected along the optical axis.

[0008] In some embodiments, the device further comprises a focus adjustment curve axis, a left focus adjustment lever, and a right focus adjustment lever; The first end of the left focal length adjustment control rod is connected to the left focal length adjustment component; The first end of the right focal length adjustment control rod is connected to the right focal length adjustment component; A symmetrical double-circumferential first curved groove is arranged on the focus adjustment curve axis; the second end of the left focus adjustment control rod and the second end of the right focus adjustment control rod are respectively connected to the first curved groove.

[0009] In some embodiments, the focus adjustment curve axis is connected to a focus adjustment motor; The focus adjustment motor is used to drive the focus adjustment curve axis to rotate, driving the left focus adjustment control lever and the right focus adjustment control lever to move, so that the left focus adjustment component adjusts the focus of the left view lens and the right focus adjustment component adjusts the focus of the right view lens.

[0010] In some embodiments, the device further comprises an aperture adjustment curve axis, a left aperture adjustment lever, and a right aperture adjustment lever; The first end of the left aperture adjustment control rod is connected to the left aperture adjustment component; The first end of the right aperture adjustment control rod is connected to the right aperture adjustment component; A symmetrical double-circumferential second curved groove is arranged on the aperture adjustment curve axis; the second end of the left aperture adjustment control rod and the second end of the right aperture adjustment control rod are respectively connected to the second curved groove.

[0011] In some embodiments, the aperture adjustment curve shaft is connected to an aperture adjustment motor; The aperture adjustment motor is used to drive the aperture adjustment curve shaft to rotate, driving the left aperture adjustment control lever and the right aperture adjustment control lever to move, so that the left aperture adjustment component adjusts the aperture of the left view lens and the right aperture adjustment component adjusts the aperture of the right view lens.

[0012] In some embodiments, the image processing module is used to: Controlling the left-view lens module and the right-view lens module to collect images of the calibration plate to obtain a left calibration image and a right calibration image; Based on the left calibration image, determining lens parameters of the left view lens module; Determining lens parameters of the right view lens module based on the right calibration image; Based on the lens parameters of the left-view lens module, relative position information of the left-view lens module is obtained, and the left-view lens module is adjusted to establish coordinates to complete the correction; Based on the lens parameters of the right-view lens module, the relative position information of the right-view lens module is obtained, and the right-view lens module is adjusted to establish coordinates to complete the correction.

[0013] In some embodiments, the image processing module is used to: Preprocessing and feature extraction are performed on the left-view image and the right-view image to determine feature points in the left-view image and the right-view image; Performing stereo matching on the left-view image and the right-view image based on the feature points, and determining disparity values ​​of matching points in the left-view image and the right-view image; The three-dimensional coordinates of the matching points are determined based on the disparity values, and a three-dimensional stereoscopic image of the photographed object is generated based on the three-dimensional coordinates of the matching points.

[0014] In some embodiments, the image processing module is used to: When the photographed subject is a user, acquiring an accessory image, a scene image, and a makeup image; A simulated wearing image of the user is generated based on the accessory image, at least one of the scene image and the makeup image, and the three-dimensional stereoscopic image.

[0015] The intelligent display device based on human eye simulation provided by the present application comprises a display mirror module, a left-view lens module, a right-view lens module and an image processing module; the lens orientation of the left-view lens module and the lens orientation of the right-view lens module are the same as the imaging surface orientation of the display mirror module; the left-view lens module and the right-view lens module collect images of the photographed object in front of the imaging surface of the display mirror module to obtain a left-view image and a right-view image; the image processing module is used to generate a three-dimensional stereoscopic image of the photographed object based on the left-view image and the right-view image; the display mirror module is used to display the three-dimensional stereoscopic image; since the left-view lens module and the right-view lens module are connected to each other, the left-view lens module and the right-view lens module can generate a three-dimensional stereoscopic image of the photographed object; the display mirror module is used to display the three-dimensional stereoscopic image; The module is arranged on the non-imaging surface of the display mirror module, the optical axis of the left-view lens module and the optical axis of the right-view lens module are in the same horizontal plane and the angle between the optical axes is the stereoscopic angle, so that the left-view lens module and the right-view lens module can respectively simulate the human left and right eyes to observe the photographed object from different angles, and a three-dimensional stereo image with human eye visual effects can be generated according to the collected left-view image and right-view image, which can effectively reflect the spatial position information of the photographed object, is more realistic and three-dimensional than a two-dimensional image, and has a small difference from the image observed by the real human eye, and can restore the visual effect of the photographed object in the user's mind to the greatest extent. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0017] In order to more clearly illustrate the technical solutions in the present application or the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0018] Figure 1 This is one of the structural schematic diagrams of the intelligent display device based on human eye simulation provided in this application.

[0019] Figure 2 This is the second structural schematic diagram of the intelligent display device based on human eye simulation provided by this application.

[0020] Figure 3 It is a structural schematic diagram of the lens module provided in this application. DETAILED DESCRIPTION

[0021] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.

[0022] It should be noted that the terms "first", "second" etc. in the present application are used to distinguish similar objects, and need not be used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchangeable in appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, the process, method, system, product or equipment comprising a series of steps or units or modules need not be limited to those steps or units or modules clearly listed, but may include other steps or units or modules that are not clearly listed or inherent to these processes, methods, products or equipment.

[0023] In the technical solution of this application, the collection, storage, use, processing, transmission, provision and disclosure of personal information involved comply with the provisions of relevant laws and regulations, take necessary confidentiality measures, and do not violate public order and good morals.

[0024] Figure 1 is one of the structural schematic diagrams of the intelligent display device based on human eye simulation provided by this application, such as Figure 1 As shown, the intelligent display device 100 includes a display mirror module 110, a left-view lens module 120, a right-view lens module 130 and an image processing module 140. In the figure, the dotted lines represent mechanical connections, and the solid lines represent electrical connections.

[0025] The left-view lens module and the right-view lens module are arranged on the non-imaging surface of the display mirror module; the lens orientation of the left-view lens module and the lens orientation of the right-view lens module are the same as the imaging surface orientation of the display mirror module; the optical axis of the left-view lens module and the optical axis of the right-view lens module are in the same horizontal plane and the angle between the optical axes is the stereoscopic angle; The left-view lens module and the right-view lens module collect images of the object in front of the imaging surface of the display mirror module to obtain a left-view image and a right-view image; An image processing module, connected to the left-view lens module and the right-view lens module respectively, for generating a three-dimensional stereoscopic image of the photographed object based on the left-view image and the right-view image; The display mirror module is connected to the image processing module and is used to display three-dimensional images.

[0026] Specifically, the intelligent display device provided by the present application can be applied to scenarios such as virtual wear and object display. The following embodiments take the virtual wear scenario as an example to illustrate the intelligent display device based on human eye simulation provided by the present application.

[0027] Taking the virtual wearable scene as an example, the user can be in front of the smart display device, which captures images from multiple angles simultaneously through left and right lenses. The two lenses are arranged according to the stereoscopic perspective, so that each lens captures the corresponding perspective image with the corresponding human eye, simulating the binocular visual light path of the human eye viewing actual objects, thereby producing a three-dimensional visual effect.

[0028] From a structural point of view, the intelligent display device may include a display mirror module, a left-view lens module, a right-view lens module and an image processing module.

[0029] The display mirror module may include an imaging surface and a non-imaging surface. The imaging surface, which may also be referred to as the front surface, is used to face the user. In the case where the display mirror module only displays three-dimensional stereoscopic imaging, the imaging surface may include a screen display area; in the case where the display mirror module simultaneously displays mirror reflection imaging and three-dimensional stereoscopic imaging, the imaging surface may include a mirror imaging area and a screen display area. The mirror imaging area generates an image of the user through mirror reflection for the user to observe through the human eye. The non-imaging surface, which may also be referred to as the back surface, is used to face away from the user.

[0030] The left-view lens module and the right-view lens module are a pair of associated lens modules, which are used to simulate the left eye and right eye of humans to obtain a two-dimensional image of the photographed object. The photographed object may include a user (human body) and an object, which changes according to different application scenarios. The left-view lens module and the right-view lens module are set on the non-imaging surface of the display mirror module. The lens orientation of the two lens modules is the same as the imaging surface orientation of the display mirror module, and both point to the photographed object.

[0031] When the left-view lens module and the right-view lens module are arranged on the non-imaging surface of the display mirror module, it is necessary to make the optical axis of the left-view lens module and the optical axis of the right-view lens module in the same horizontal plane, and the angle between the optical axes of the two lens modules is the stereoscopic angle. The stereoscopic angle refers to the angle between the two eyes of a human when looking at an object, for example, the angle can be 14 degrees. Through the above arrangement, the left-view lens module and the right-view lens module can simulate the human eye to observe the photographed object.

[0032] The vertical distance between the left-view lens module and the right-view lens module in the display mirror module is adjustable, which can simulate the viewing angles of different users.

[0033] When the object is located in front of the imaging surface of the display mirror module, the left-view lens module simulates the human left eye to capture the image of the object to obtain a left-view image, and the right-view lens module simulates the human right eye to capture the image of the object to obtain a right-view image.

[0034] The image processing module may be a processor that runs an image processing algorithm, as well as a mobile terminal, computer or server containing these processors. The image processing module is connected to the left-view lens module and the right-view lens module respectively, and runs relevant image processing algorithms, such as a binocular stereo matching algorithm, a three-dimensional imaging algorithm, etc., to generate a three-dimensional image of the photographed object based on the left-view image and the right-view image.

[0035] For example, the image processing module uses the parallax between the two lenses to obtain the depth information of the photographed object through the images collected by each lens, and calculates the three-dimensional spatial coordinates of the target object through computer vision technology to achieve three-dimensional reconstruction and deep stereo vision. It can capture images from different angles and different visuals, simulate the visual effects of the human eye, and realize depth perception, three-dimensional reconstruction and other functions, making the captured pictures or videos more realistic and three-dimensional, and restoring the visual effect of the photographed object in the user's mind to the greatest extent.

[0036] It is understandable that the left view image and the right view image may be single-frame static images or a video composed of multiple static images. Correspondingly, the three-dimensional image may also be a static image or a video.

[0037] The display mirror module is connected to the image processing module. The image processing module sends the generated three-dimensional stereoscopic image to the display mirror module, so that the display mirror module can display the three-dimensional stereoscopic image to the user.

[0038] The connection between the display mirror module, the left-view lens module, the right-view lens module and the image processing module can be a wired connection, such as connection through a communication cable; or a wireless connection, such as connection through a wireless network such as a local area network, Bluetooth communication or near-field communication.

[0039] Figure 2 This is the second structural schematic diagram of the intelligent display device based on human eye simulation provided by the present application, such as Figure 2 As shown, the left-view lens module 120 and the right-view lens module 130 form a pair of associated lens modules, which are connected to the image processing module 140 via a communication cable for transmitting the left-view image and the right-view image. The display mirror module 110 and the image processing module 140 are connected via a communication cable for displaying the three-dimensional stereoscopic image sent by the image processing module 140.

[0040] The intelligent display device based on human eye simulation provided by the embodiment of the present application comprises a display mirror module, a left-view lens module, a right-view lens module and an image processing module; the lens orientation of the left-view lens module and the lens orientation of the right-view lens module are the same as the imaging surface orientation of the display mirror module; the left-view lens module and the right-view lens module collect images of the photographed object in front of the imaging surface of the display mirror module to obtain a left-view image and a right-view image; the image processing module is used to generate a three-dimensional stereoscopic image of the photographed object based on the left-view image and the right-view image; the display mirror module is used to display the three-dimensional stereoscopic image; since the left-view lens module and the right-view lens module are connected to each other, the three-dimensional stereoscopic image is generated; the left-view lens module and the right-view lens module are connected to each other, and ... The lens module is arranged on the non-imaging surface of the display mirror module, the optical axis of the left-view lens module and the optical axis of the right-view lens module are in the same horizontal plane and the angle between the optical axes is the stereoscopic angle, so that the left-view lens module and the right-view lens module can respectively simulate the human left and right eyes to observe the photographed object from different angles, and a three-dimensional stereo image with human eye visual effects can be generated according to the collected left-view image and right-view image, which can effectively reflect the spatial position information of the photographed object. Compared with the two-dimensional image, it is more realistic and three-dimensional, and the difference with the image observed by the real human eye is small, and the visual effect of the photographed object in the user's mind can be restored to the greatest extent.

[0041] In some embodiments, Figure 3 is a schematic diagram of the structure of the lens module provided by this application, such as Figure 3As shown, the left-view lens module includes a left lens mount 121, a left focal length adjustment component 122, a left aperture adjustment component 123, a left-view lens 124, and a left image sensor 125, which are sequentially connected along the optical axis. The right-view lens module includes a right lens mount 131, a right focal length adjustment component 132, a right aperture adjustment component 133, a right-view lens 134, and a right image sensor 135, which are sequentially connected along the optical axis.

[0042] Specifically, taking the left-view lens module as an example, it includes a left lens mount, a left focal length adjustment component, a left aperture adjustment component, a left-view lens and a left image sensor in sequence along the optical axis direction.

[0043] The left lens mount is used to support and fix the left view lens module on the non-imaging surface of the display mirror module.

[0044] The left focal length adjustment component is used to adjust the distance between the lens and the image sensor so that the focal length of the lens can fall on the image sensor and the image sensor can form a clear image.

[0045] The left aperture adjustment component is used to adjust the aperture size of the lens and control the amount of light entering the lens so that the image captured by the image sensor has a suitable exposure and depth of field.

[0046] The left-view lens is used to focus light and project it onto the image sensor, determining the clarity and detail of the image.

[0047] The left image sensor is used to receive the light transmitted through the lens and convert it into an electronic signal to generate an image. For example, the light of the subject is imaged through the lens, and the color filter adjusts the wavelength of the light to enter the left image sensor corresponding to the left view lens to form a left view image. The image sensor can be a charge coupled device image sensor (CCD) or a complementary metal-oxide semiconductor image sensor (CMOS).

[0048] The specific structure of the right-view lens module is the same as that of the left-view lens module, and will not be repeated here.

[0049] The intelligent display device based on human eye simulation provided by the embodiment of the present application, the viewing lens module includes a lens mount, a focal length adjustment component, an aperture adjustment component, a viewing lens and an image sensor connected in sequence along the optical axis direction, and can adjust the focal length and aperture to capture a two-dimensional image of the photographed object to achieve the highest imaging effect.

[0050] In some embodiments, Figure 3 The device further comprises a focus adjustment curve axis 150 , a left focus adjustment control lever 151 and a right focus adjustment control lever 152 .

[0051] The first end of the left focal length adjustment lever is connected to the left focal length adjustment component; The first end of the right focal length adjustment lever is connected to the right focal length adjustment component; A symmetrical double-circumferential first curve groove is arranged on the focus adjustment curve axis; the second end of the left focus adjustment control rod and the second end of the right focus adjustment control rod are respectively connected to the first curve groove.

[0052] Specifically, the intelligent display device further includes a focus adjustment curve axis, a left focus adjustment lever, and a right focus adjustment lever. The left / right focus adjustment lever is used to adjust the focus of the left / right lens module, and specifically acts on the left / right focus adjustment component. The focus adjustment curve axis is used to synchronously adjust the focus of the left lens module and the right lens module.

[0053] Taking the left focal length adjustment lever as an example, the left focal length adjustment lever is a rod-shaped structure, including a first end and a second end. The first end is connected to the left focal length adjustment component, and the second end is connected to the first curved groove on the focal length adjustment curved axis.

[0054] A curved groove is a groove of a specific shape opened on a mechanical part to guide the movement of another part. It usually has a certain curved shape, which can be a straight line, arc or other geometric shape. The design of the curved groove can achieve smooth and precise movement, ensuring that the connected parts move according to the predetermined trajectory, thereby improving the stability and accuracy of the system.

[0055] The first curved groove is arranged on the focus adjustment curve axis and is in the shape of a symmetrical double-circular curve. The first curved groove provides a precise motion trajectory. By connecting the second end of the left focus adjustment lever to the first curved groove, it can be ensured that when the focus adjustment curve axis moves, the left focus adjustment lever and the right focus adjustment lever move in a synchronous and precise manner, thereby driving the left focus adjustment component and the right focus adjustment component to adjust the focus. This helps to ensure the symmetry and consistency of the focus adjustment, especially in a dual-lens system, where precise adjustment of the focus is crucial to the overall quality of the image.

[0056] The working principle of the right focus adjustment lever is the same as that of the left focus adjustment lever, which will not be described again here.

[0057] The intelligent display device based on human eye simulation provided by the embodiment of the present application controls the left focus adjustment control lever and the right focus adjustment control lever to move in a synchronous and precise manner through the focus adjustment curve axis, thereby driving the left focus adjustment component and the right focus adjustment component to adjust the focus, thereby achieving symmetry and consistency of the focus adjustment and improving the imaging effect of the image.

[0058] In some embodiments, the focus adjustment curve axis is connected to the focus adjustment motor; The focus adjustment motor is used to drive the focus adjustment curve axis to rotate, driving the left focus adjustment lever and the right focus adjustment lever to move, so that the left focus adjustment component adjusts the focus of the left view lens and the right focus adjustment component adjusts the focus of the right view lens.

[0059] Specifically, the intelligent display device may further include a focus adjustment motor, and a driving end of the focus adjustment motor is connected to the focus adjustment curve shaft.

[0060] The focus adjustment motor can drive the focus adjustment curve shaft to rotate. When the focus adjustment curve shaft rotates, the first curve groove drives the left focus adjustment lever and the right focus adjustment lever to move. Since the first curve groove is a symmetrical double-surround structure, the left focus adjustment component can adjust the focus of the left lens and the right focus adjustment component can adjust the focus of the right lens synchronously.

[0061] The focus adjustment motor can be connected to the image processing module. The image processing module can collect the left view image and the right view image through the left view lens module and the right view lens module, and determine the target focal length according to the image parameters of the left view image and the right view image, compare the target focal length with the current focal length in the left view lens module and the right view lens module, and determine the focal length adjustment value; according to the relationship between the focal length adjustment value and the number of motor rotations, the focus adjustment motor is controlled to rotate, and the focus adjustment curve axis is driven to rotate to achieve synchronous adjustment of the focal length.

[0062] The intelligent display device based on human eye simulation provided by the embodiment of the present application realizes automatic synchronous adjustment by driving the focus adjustment curve axis to rotate through the focus adjustment motor, thereby improving the automation level of the intelligent display device, making the focus adjustment faster and more convenient, and adaptively adjusting the focus according to image parameters, which can follow and adapt to the position changes of the photographed object, thereby improving the imaging effect of the image.

[0063] In some embodiments, Figure 3 The device further includes an aperture adjustment curve axis 160 , a left aperture adjustment control rod 161 and a right aperture adjustment control rod 162 .

[0064] The first end of the left aperture adjustment control rod is connected to the left aperture adjustment component; The first end of the right aperture adjustment control rod is connected to the right aperture adjustment component; A symmetrical double-circumferential second curved groove is arranged on the aperture adjustment curve axis; the second end of the left aperture adjustment control rod and the second end of the right aperture adjustment control rod are respectively connected to the second curved groove.

[0065] Specifically, the intelligent display device further includes an aperture adjustment curve axis, a left aperture adjustment lever, and a right aperture adjustment lever. The left / right aperture adjustment lever is used to adjust the aperture of the left / right lens module, specifically acting on the left / right aperture adjustment component. The aperture adjustment curve axis is used to synchronously adjust the aperture of the left lens module and the right lens module.

[0066] Taking the left aperture adjustment lever as an example, the left aperture adjustment lever is a rod-shaped structure, including a first end and a second end. The first end is connected to the left aperture adjustment component, and the second end is connected to the second curved groove on the aperture adjustment curved axis.

[0067] The second curved groove is arranged on the aperture adjustment curve axis and is in the shape of a symmetrical double-circling curve. The second curved groove provides a precise motion trajectory. By connecting the second end of the left aperture adjustment lever to the second curved groove, it can be ensured that when the aperture adjustment curve axis moves, the left aperture adjustment lever and the right aperture adjustment lever move in a synchronous and precise manner, thereby driving the left aperture adjustment component and the right aperture adjustment component to adjust the aperture. This helps to ensure the symmetry and consistency of the aperture adjustment, especially in a dual-lens system, where precise adjustment of the aperture is critical to the overall quality of the image.

[0068] The working principle of the right aperture adjustment lever is the same as that of the left aperture adjustment lever, which will not be repeated here.

[0069] The intelligent display device based on human eye simulation provided in the embodiment of the present application controls the left aperture adjustment control lever and the right aperture adjustment control lever to move in a synchronous and precise manner through the aperture adjustment curve axis, thereby driving the left aperture adjustment component and the right aperture adjustment component to adjust the aperture, thereby achieving symmetry and consistency of the aperture adjustment and improving the imaging effect of the image.

[0070] In some embodiments, the aperture adjustment curve shaft is connected to the aperture adjustment motor; The aperture adjustment motor is used to drive the aperture adjustment curve shaft to rotate, driving the left aperture adjustment control lever and the right aperture adjustment control lever to move, so that the left aperture adjustment component adjusts the aperture of the left view lens and the right aperture adjustment component adjusts the aperture of the right view lens.

[0071] Specifically, the intelligent display device may further include an aperture adjustment motor, and a driving end of the aperture adjustment motor is connected to the aperture adjustment curve shaft.

[0072] The aperture adjustment motor can drive the aperture adjustment curve shaft to rotate. When the aperture adjustment curve shaft rotates, the second curve groove drives the left aperture adjustment lever and the right aperture adjustment lever to move. Since the second curve groove is a symmetrical double-surround structure, the left aperture adjustment component can adjust the aperture of the left lens and the right aperture adjustment component can adjust the aperture of the right lens synchronously.

[0073] The aperture adjustment motor can be connected to the image processing module. The image processing module can collect the left view image and the right view image through the left view lens module and the right view lens module, and determine the target aperture according to the image parameters of the left view image and the right view image, and compare the target aperture with the current aperture in the left view lens module and the right view lens module to determine the aperture adjustment value; according to the relationship between the aperture adjustment value and the number of motor rotations, the aperture adjustment motor is controlled to rotate, and the aperture adjustment curve axis is driven to rotate to achieve synchronous adjustment of the aperture.

[0074] The intelligent display device based on human eye simulation provided by the embodiment of the present application realizes automatic synchronous adjustment by driving the aperture adjustment curve axis to rotate through the aperture adjustment motor, thereby improving the automation level of the intelligent display device, making the aperture adjustment faster and more convenient, and adaptively adjusting the aperture according to image parameters, which can follow and adapt to the position changes of the photographed object, thereby improving the imaging effect of the image.

[0075] In some embodiments, the image processing module is used to: Control the left-view lens module and the right-view lens module to collect images of the calibration plate to obtain a left calibration image and a right calibration image; Based on the left calibration image, determining lens parameters of the left view lens module; Based on the right calibration image, determining lens parameters of the right view lens module; Adjusting the left-view lens module based on the lens parameters of the left-view lens module; The right view lens module is adjusted based on the lens parameters of the right view lens module.

[0076] Specifically, before the intelligent display device is used, the position of the lens module can be adjusted by calibration.

[0077] Calibration plates can be used to help determine and adjust the internal and external parameters of the device to improve the accuracy and consistency of image capture. Feature points or geometric shapes can be set on the calibration plate to determine the characteristic parameters of the lens such as distortion, chromatic aberration, brightness uniformity, etc.

[0078] The image processing module can be used to control the left-view lens module and the right-view lens module to collect images of the calibration plate to obtain a left calibration image and a right calibration image.

[0079] According to the relevant image correction algorithm, the lens parameters of the left-view lens module can be determined according to the left calibration image, and the lens parameters of the right-view lens module can be determined according to the right calibration image. The lens parameters may include internal parameters and external parameters.

[0080] Internal parameters are used to describe the internal characteristics of the lens, such as focal length, principal point position, distortion coefficient, etc. Internal parameters are used to map points in three-dimensional space to the two-dimensional image plane of the lens. External parameters are used to describe the relative position information and direction relationship between the lens and the world coordinate system, including the rotation matrix and displacement vector of the lens. External parameters are used to transform points in the lens coordinate system into the world coordinate system, thereby locating the position and orientation of the lens in three-dimensional space.

[0081] Finally, the corresponding lens module is adjusted according to the lens parameters of the lens module.

[0082] The intelligent display device based on human eye simulation provided in the embodiment of the present application can adjust parameters according to the calibration plate, thereby improving the imaging effect of the image.

[0083] In some embodiments, the image processing module is used to: Preprocessing and feature extraction are performed on the left-view image and the right-view image to determine feature points in the left-view image and the right-view image; Perform stereo matching on the left-view image and the right-view image based on the feature points, and determine the disparity values ​​of the matching points in the left-view image and the right-view image; The three-dimensional coordinates of the matching points are determined based on the disparity values, and a three-dimensional stereoscopic image of the photographed object is generated based on the three-dimensional coordinates of the matching points.

[0084] Specifically, preprocessing aims to improve image quality, reduce noise and interference, and provide more favorable conditions for subsequent feature extraction. Preprocessing can include denoising and scale normalization. Feature extraction aims to extract feature points that can reflect image characteristics from the preprocessed image. The image processing module can preprocess and extract features for the left view image and the right view image to determine the feature points in the left view image and the right view image. Feature extraction algorithms can include ORB (Oriented FAST and Rotated BRIEF) algorithm and SIFT (Scale-Invariant Feature Transform) algorithm.

[0085] After extracting the feature points in the left and right images, feature point matching is required to determine the corresponding feature point pairs (i.e. matching points) in the left and right images. Common feature point matching algorithms include methods based on brute force matching and methods based on approximate nearest neighbor search (such as FLANN). In addition, the RANSAC (Random Sample Consensus) algorithm can be used to eliminate mismatched feature points to improve matching accuracy. The specific steps of stereo matching can include matching cost calculation, cost aggregation, disparity calculation, and disparity optimization, and finally the disparity values ​​of the matching points in the left and right images are obtained.

[0086] The disparity value describes the horizontal position difference between the corresponding points of the same point in the left and right views, and is related to the depth information of the object. For example, an object closer to the camera has a larger disparity value in the left and right images, while an object farther from the camera has a smaller disparity value.

[0087] By calculating the disparity value and combining the intrinsic and extrinsic parameters of the lens (such as focal length, baseline distance, etc.), the three-dimensional coordinates of the photographed object in the scene can be restored using the principle of triangulation, thereby constructing a three-dimensional stereo image.

[0088] The intelligent display device based on human eye simulation provided by the embodiment of the present application generates a three-dimensional stereoscopic image of the photographed object according to the left-view image and the right-view image, so that the photographed pictures or videos are more realistic and three-dimensional, and the visual effect of the photographed object in the user's mind is restored to the greatest extent.

[0089] In some embodiments, in order to improve the three-dimensional imaging effect, a unified background, such as a white background, a black background, a green background, etc., may be used when capturing images of the photographed object.

[0090] In some embodiments, the image processing module is used to: When the photographed subject is a user, acquiring an accessory image, a scene image, and a makeup image; A simulated wearing image of the user is generated based on at least one of the accessory image, the scene image, and the makeup image, and the three-dimensional stereoscopic image.

[0091] Specifically, when the photographed subject is a user, the accessory image, the scene image and the makeup image can be acquired in the image processing module by pre-storing or communicating with an external system.

[0092] Accessory images are decorative images that match clothing or other wearable items, including clothing images, headwear images, handwear images, and earring images. Situational images refer to images that present a specific life situation, scene, or theme through images. Makeup images refer to images that show makeup effects or makeup styles.

[0093] At least one of the accessory image, the scene image and the makeup image may be superimposed and rendered with the three-dimensional image of the user to generate a simulated wearing image of the user.

[0094] The intelligent display device based on human eye simulation provided in the embodiment of the present application uses an image processor to match and superimpose makeup, accessories, and scene backgrounds to form a binocular stereoscopic imaging simulation effect of different scenes, different makeup, and different accessories of the characters.

[0095] In some embodiments, the display mirror module can be used as a mirror and a display screen, which can be switched with one button. The size can be configured according to the size of a dressing mirror. The subject can be placed in front of the display mirror, and the ordinary mirror and the display screen can be switched to display the three-dimensional effect of the shot and observe the overall effect.

[0096] In some embodiments, the screen display area of ​​the display mirror module may adopt a touch screen display. The user may input relevant information or instructions to the image processor through the touch screen display, such as switching instructions related to accessory images, scene images, and makeup images, etc., to achieve human-computer interaction.

[0097] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0098] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0099] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. An intelligent display device based on human eye simulation, characterized in that: It includes a display mirror module, a left-view lens module, a right-view lens module and an image processing module; The left-view lens module and the right-view lens module are arranged on the non-imaging surface of the display mirror module; the lens orientation of the left-view lens module and the lens orientation of the right-view lens module are the same as the imaging surface orientation of the display mirror module; the optical axis of the left-view lens module and the optical axis of the right-view lens module are in the same horizontal plane and the angle between the optical axes is the stereoscopic angle; The left-view lens module and the right-view lens module collect images of the object in front of the imaging surface of the display mirror module to obtain a left-view image and a right-view image; The image processing module is connected to the left-view lens module and the right-view lens module respectively, and is used to generate a three-dimensional stereoscopic image of the photographed object based on the left-view image and the right-view image; The display mirror module is connected to the image processing module and is used to display the three-dimensional image.

2. The intelligent display device based on human eye simulation according to claim 1, characterized in that: The left-view lens module comprises a left lens mount, a left focal length adjustment component, a left aperture adjustment component, a left-view lens and a left image sensor which are sequentially connected along the optical axis direction.

3. The intelligent display device based on human eye simulation according to claim 2, characterized in that: The right-view lens module comprises a right lens mount, a right focal length adjustment component, a right aperture adjustment component, a right-view lens and a right image sensor which are sequentially connected along the optical axis direction.

4. The intelligent display device based on human eye simulation according to claim 3, characterized in that: The device also includes a focus adjustment curve axis, a left focus adjustment control lever and a right focus adjustment control lever; The first end of the left focal length adjustment control rod is connected to the left focal length adjustment component; The first end of the right focal length adjustment control rod is connected to the right focal length adjustment component; A symmetrical double-circumferential first curved groove is arranged on the focus adjustment curve axis; the second end of the left focus adjustment control rod and the second end of the right focus adjustment control rod are respectively connected to the first curved groove.

5. The intelligent display device based on human eye simulation according to claim 4, characterized in that: The focus adjustment curve axis is connected to the focus adjustment motor; The focus adjustment motor is used to drive the focus adjustment curve axis to rotate, driving the left focus adjustment control lever and the right focus adjustment control lever to move, so that the left focus adjustment component adjusts the focus of the left view lens and the right focus adjustment component adjusts the focus of the right view lens.

6. The intelligent display device based on human eye simulation according to claim 3, characterized in that: The device also includes an aperture adjustment curve axis, a left aperture adjustment control lever and a right aperture adjustment control lever; The first end of the left aperture adjustment control rod is connected to the left aperture adjustment component; The first end of the right aperture adjustment control rod is connected to the right aperture adjustment component; A symmetrical double-circumferential second curved groove is arranged on the aperture adjustment curve axis; the second end of the left aperture adjustment control rod and the second end of the right aperture adjustment control rod are respectively connected to the second curved groove.

7. The intelligent display device based on human eye simulation according to claim 6, characterized in that: The aperture adjustment curve shaft is connected to the aperture adjustment motor; The aperture adjustment motor is used to drive the aperture adjustment curve shaft to rotate, driving the left aperture adjustment control lever and the right aperture adjustment control lever to move, so that the left aperture adjustment component adjusts the aperture of the left view lens and the right aperture adjustment component adjusts the aperture of the right view lens.

8. The intelligent display device based on human eye simulation according to any one of claims 1 to 7, characterized in that: The image processing module needs to: Controlling the left-view lens module and the right-view lens module to collect images of the calibration plate to obtain a left calibration image and a right calibration image; Based on the left calibration image, determining lens parameters of the left view lens module; Determining lens parameters of the right view lens module based on the right calibration image; Based on the lens parameters of the left-view lens module, relative position information of the left-view lens module is obtained, and the left-view lens module is adjusted to establish coordinates to complete the correction; Based on the lens parameters of the right-view lens module, the relative position information of the right-view lens module is obtained, and the right-view lens module is adjusted to establish coordinates to complete the correction.

9. The intelligent display device based on human eye simulation according to any one of claims 1 to 7, characterized in that: The image processing module is used for: Preprocessing and feature extraction are performed on the left-view image and the right-view image to determine feature points in the left-view image and the right-view image; Performing stereo matching on the left-view image and the right-view image based on the feature points, and determining disparity values ​​of matching points in the left-view image and the right-view image; The three-dimensional coordinates of the matching points are determined based on the disparity values, and a three-dimensional stereoscopic image of the photographed object is generated based on the three-dimensional coordinates of the matching points.

10. The intelligent display device based on human eye simulation according to any one of claims 1 to 7, characterized in that: The image processing module is used for: When the photographed subject is a user, acquiring an accessory image, a scene image, and a makeup image; A simulated wearing image of the user is generated based on the accessory image, at least one of the scene image and the makeup image, and the three-dimensional stereoscopic image.

Images