Image processing method and related device based on working mode

Abstract

The present application discloses an image processing method based on a working mode and a related device. The image processing method based on a working mode is applied to a naked-eye 3D display device. The image processing method based on a working mode comprises: obtaining the working mode of the naked-eye 3D display device; when the working mode is a child mode, controlling the image acquisition device to acquire user images, the number of users and the position information of each user; determining the facial feature information of each user according to the user image; matching the facial features with preset facial feature information; when the matching is unsuccessful, determining the pupil distance information of the user according to the user image that failed to match; when the pupil distance information is less than a preset distance, or when the user category determined after the matching is successful is a child category, determining the viewing parameters of the user; and controlling the display device to process the displayed image according to the position information and the viewing parameters.

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to an image processing method and related devices based on a working mode. Background Art

[0002] Naked-eye 3D display devices use the left and right eyes of a person to receive images at different positions respectively, allowing users to observe images with 3D effects. In order to achieve the 3D display effect, naked-eye 3D display devices usually need to use cylindrical lens gratings to adjust the transmission direction of light, thereby achieving the effect of the human eye observing different images.

[0003] Since children cannot accurately judge the extent of their eye use, their eye fatigue will increase seriously when they watch naked-eye 3D display devices for a long time. Summary of the invention

[0004] The main technical problem solved by this application is: how to prevent children from experiencing eye fatigue when watching naked-eye 3D display devices.

[0005] According to a first aspect, an embodiment provides an image processing method based on a working mode, wherein the image processing method based on a working mode is applied to a naked-eye 3D display device, wherein the naked-eye 3D display device comprises a display device and an image acquisition device, wherein the image acquisition device is connected to the display device, wherein the working mode of the naked-eye 3D display device comprises a child mode, wherein the display mode of the naked-eye 3D display device comprises a 3D display mode and a 2D display mode, wherein the display device comprises a display unit, a grating component and a display panel, wherein the display panel is arranged at a light-emitting side of the display unit, and the grating component is arranged between the display unit and the display panel; wherein the display device further comprises a dielectric layer, wherein the dielectric layer is arranged between the grating component and the display panel, and wherein the image processing method based on the working mode comprises:

[0006] Obtaining the working mode of the naked-eye 3D display device;

[0007] When the working mode is the child mode, controlling the image acquisition device to acquire user images, the number of users and the location information of each user;

[0008] Determine facial feature information of each user based on the user image;

[0009] Matching the facial features with preset facial feature information;

[0010] When the matching fails, determining the pupil distance information of the user according to the user image that fails to match;

[0011] When the pupil distance information is less than a preset distance, or when the user category determined after successful matching is a child category, determining the viewing parameter of the user;

[0012] The display device is controlled to process the display image according to the position information and the viewing parameter.

[0013] Optionally, the naked eye 3D display device further includes a timer, the viewing parameters include viewing time, viewing distance and screen size, and determining the viewing parameters of the user includes:

[0014] Controlling the timer to record the viewing time of the user;

[0015] When the viewing time is greater than or equal to a first preset time, determining a viewing distance of the user;

[0016] When the viewing distance is less than a preset distance, the picture size is determined according to the position information, the viewing time and the viewing distance.

[0017] Optionally, the position information includes a first angle, and when the viewing distance is less than a preset distance, determining the picture size according to the viewing time and the viewing distance includes:

[0018] When the viewing distance is less than the preset distance, the screen size is determined by the viewing time and the viewing distance according to the first formula Z=Z1*(1800 / E)*[(2.5*cosθ) / Q], wherein E is the viewing time, Q is the viewing distance, Z is the screen size, Z1 is the original screen size, and θ is the first angle.

[0019] Optionally, the adjustment parameters include the image display position and the grating period of the grating component, and the picture size is determined according to the viewing time and the viewing distance, and then further includes:

[0020] The grating period of the grating component is determined according to the position information and the picture size.

[0021] Optionally, determining the grating period of the grating component according to the position information and the picture size includes:

[0022] The grating period of the grating component is determined according to the second formula W=Z / Z1*[(B*Y*U) / L], wherein W is the grating period of the grating component, B is the thickness of the dielectric layer, Y is the number of users, U is the pupil distance information of the users, and L is the viewing distance.

[0023] Optionally, the viewing parameters include viewing time and viewing distance; and controlling the display device to process the display image according to the position information and the viewing parameters includes:

[0024] Determining a viewing evaluation value according to the viewing time and the viewing distance;

[0025] When the viewing evaluation value is greater than a preset threshold, the grating component is controlled to perform blurring processing on the display image of the naked-eye 3D display device.

[0026] Optionally, determining the viewing evaluation value according to the viewing time and the viewing distance includes:

[0027] According to the third formula H=(E / 1800)^2*(2.5 / Q), the viewing time and the viewing distance determine the viewing evaluation value, wherein H is the viewing evaluation value, E is the viewing time, and Q is the viewing distance.

[0028] According to a second aspect, an embodiment provides an image processing device based on a working mode, wherein the image processing device based on the working mode is applied to a naked-eye 3D display device, wherein the naked-eye 3D display device comprises a display device and an image acquisition device, wherein the image acquisition device is connected to the display device, wherein the working mode of the naked-eye 3D display device comprises a child mode, wherein the display mode of the naked-eye 3D display device comprises a 3D display mode and a 2D display mode, wherein the display device comprises a display unit, a grating component and a display panel, wherein the display panel is arranged at a light-emitting side of the display unit, wherein the grating component is arranged between the display unit and the display panel; wherein the display device further comprises a dielectric layer, wherein the dielectric layer is arranged between the grating component and the display panel, wherein the image processing device based on the working mode comprises:

[0029] An acquisition unit, used for acquiring the working mode of the naked-eye 3D display device;

[0030] The acquisition unit is further used to control the image acquisition device to acquire user images, the number of users and the location information of each user when the working mode is the child mode;

[0031] A determination unit, used to determine facial feature information of each user based on the user image;

[0032] A matching unit, used for matching the facial feature with preset facial feature information;

[0033] The determining unit is further configured to determine the pupil distance information of the user according to the user image that failed to match when the matching fails;

[0034] The determination unit is further configured to determine the viewing parameters of the user when the pupil distance information is less than a preset distance or when the user category determined after successful matching is a child category;

[0035] A control unit is used to control the display device to process the display image according to the position information and the viewing parameters.

[0036] According to the third aspect, an embodiment provides a naked-eye 3D display device, characterized in that it includes a processor, a memory, a transceiver, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing the steps in the method described in the first aspect above.

[0037] According to a fourth aspect, an embodiment provides a computer-readable storage medium, on which a program is stored, and the program can be executed by a processor to perform the device control method described in the first aspect above.

[0038] The beneficial effects of the present application are: the user's category is determined by the user's facial feature information and the pupil distance information used. When the user category is a child category, the display image is processed according to the user's viewing parameters, thereby preventing child users from watching the naked-eye 3D display device for too long, thereby preventing children from experiencing eye fatigue when watching the naked-eye 3D display device. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 This is a flow chart of an embodiment of an image processing method based on a working mode of the present application;

[0040] Figure 2 This is a flowchart of another embodiment of the image processing method based on the working mode of the present application;

[0041] Figure 3 This is a flowchart of another embodiment of the image processing method based on the working mode of the present application;

[0042] Figure 4 A schematic diagram of the structure of a 3D display device using an optical cylindrical lens grating in the present application;

[0043] Figure 5 This is a schematic diagram of the structure of a grating component in the present application when no electric field is applied;

[0044] Figure 6 This is a schematic diagram of the structure of a grating component in the present application when an electric field is applied;

[0045] Figure 7This is a schematic diagram of the light and structure of the naked-eye 3D display device in the 2D display mode in this application;

[0046] Figure 8 This is a schematic diagram of the light and structure of the naked-eye 3D display device in the 3D display mode in this application;

[0047] Fig. 9 A schematic structural diagram of an embodiment of a display device of the present application;

[0048] Fig.10 A schematic diagram showing the distribution of pixels of different colors in the display unit of the present application;

[0049] Fig.11 A schematic structural diagram of an embodiment of a display unit of the present application;

[0050] Fig.12 This is a schematic diagram of the mechanical structure of the naked-eye 3D display device of the present application;

[0051] Fig.13 This is a schematic diagram of the control structure of the naked-eye 3D display device of the present application;

[0052] Fig.14 This is a schematic diagram of the structure of the image processing device based on the working mode of the present application.

[0053] Description of Figure Numbers:

[0054] Label name Label name 10 Display unit 2142 Second alignment film 11 The first light emitting unit 2143 The first ITO electrode 12 The second light emitting unit 221 Third glass substrate 13 Beam splitter 222 Second liquid crystal layer 14 Light blocking part 223 Fourth glass substrate 20 Grating components 224 Second alignment component 21 First liquid crystal lens 2241 The third alignment film 22 Second liquid crystal lens 2242 Fourth alignment film 211 First glass substrate 2243 Second ITO electrode 212 First liquid crystal layer 30 Display Panel 213 Second glass substrate 100 Display device 214 First alignment component 200 Image acquisition device 2141 first alignment film DETAILED DESCRIPTION

[0055] The present application is further described in detail below by specific embodiments in conjunction with the accompanying drawings. Wherein similar elements in different embodiments adopt associated similar element numbers. In the following embodiments, many detailed descriptions are intended to enable the present application to be better understood. However, those skilled in the art can easily recognize that some of the features can be omitted in different situations, or can be replaced by other elements, materials, and methods. In some cases, some operations related to the present application are not shown or described in the specification, in order to avoid the core part of the present application being overwhelmed by too much description, and for those skilled in the art, it is not necessary to describe these related operations in detail, and they can fully understand the related operations based on the description in the specification and the general technical knowledge in the art.

[0056] In addition, the features, operations or characteristics described in the specification can be combined in any appropriate manner to form various implementations. At the same time, the steps or actions in the method description can also be interchanged or adjusted in a manner that is obvious to those skilled in the art. Therefore, the various sequences in the specification and the drawings are only for the purpose of clearly describing a certain embodiment and are not meant to be a required sequence, unless otherwise specified that a certain sequence must be followed.

[0057] The serial numbers of the components in this document, such as "first", "second", etc., are only used to distinguish the objects described and do not have any order or technical meaning. The "connection" and "coupling" mentioned in this application, unless otherwise specified, include direct and indirect connections (couplings).

[0058] like Figure 1-14 As shown, in the present application, the working mode-based image processing method is applied to a naked-eye 3D display device, and the naked-eye 3D display device includes a display device 100 and an image acquisition device 200 , and the image acquisition device 200 is connected to the display device 100 .

[0059] Among them, the naked-eye 3D display device includes two display modes, specifically, the two display modes are 3D display mode and 2D display mode. When the display mode is the 3D display mode, the naked-eye 3D display device transmits different image information to the user's left eye and right eye respectively, so that the user can watch an image with a three-dimensional effect; when the display mode is the 2D display mode, the naked-eye 3D display device transmits the same image information to the user's left eye and right eye.

[0060] The display device 100 includes a display unit 10, a grating component 20 and a display panel 30, wherein the display panel 30 is arranged at the light-emitting side of the display unit 10, and the grating component 20 is arranged between the display unit 10 and the display panel 30; the display device 100 also includes a dielectric layer, and the dielectric layer is arranged between the grating component 20 and the display panel 30. The display panel 30 is arranged at a side of the grating component 20 away from the display unit 10, and the display panel 30 is spaced apart from the grating component 20. The display panel 30 is used to protect the grating component 20, prevent the grating component 20 from being damaged by the external environment, and improve the service life of the naked-eye 3D display device.

[0061] The image processing method based on the working mode includes:

[0062] S10, obtaining the working mode of the naked-eye 3D display device.

[0063] Among them, in order to make the naked-eye 3D display device convenient for users of different ages to watch, the naked-eye 3D display device includes multiple working modes. In different working modes, the naked-eye 3D display device displays different content or does not display part of the specified content. Among them, the naked-eye 3D display device at least includes a children's mode.

[0064] In a specific embodiment, in order to facilitate viewing by users of different ages, the naked-eye 3D display device includes multiple operating modes. In different operating modes, the naked-eye 3D display device displays different content or does not display part of the specified content, wherein the naked-eye 3D display device includes at least a children's mode.

[0065] S20, when the working mode is the child mode, controlling the image acquisition device 200 to acquire user images, the number of users and the location information of each user.

[0066] In order to determine whether the users watching the naked-eye 3D display device include children, the naked-eye 3D display device controls the image acquisition device 200 to take pictures of the watching users, obtain user images, and determine the number of users and the location information of each user based on the user images.

[0067] The position information includes a first distance and a first angle, wherein the first distance is used to represent the distance between the user and the naked-eye 3D display device along the display direction, and the first angle is used to represent the angle between the user and the normal of the center position of the naked-eye 3D display device.

[0068] S30, determining facial feature information of each user according to the user image.

[0069] S40, matching the facial feature with preset facial feature information;

[0070] The facial feature information is used to characterize feature information of different parts of the user's face. In a specific embodiment, the facial feature information includes the distance between the eyes and the nose, the distance between the nose and the mouth, and the relative position of the eyes on the user's face.

[0071] Among them, the naked-eye 3D display device pre-stores preset facial feature information of multiple pre-registered users, wherein the user categories of different pre-registered users include general categories and children categories. After the image acquisition device 200 acquires the user image, the facial feature information of the user in the image is determined through the user image, and the facial feature information is matched with the preset facial feature information pre-stored in the naked-eye 3D display device. When the facial feature information successfully matches the preset facial feature information, the corresponding pre-registered user is determined according to the preset facial feature information, and then the user category of the pre-registered user is determined, thereby facilitating the naked-eye 3D display device to adjust the image display.

[0072] When the user category of the matched pre-registered user is a common category, the naked-eye 3D display device displays according to the current display image, and there is no need to adjust the display image.

[0073] When the user category of the matched pre-registered user is a child category, the naked-eye 3D display device adjusts the display image.

[0074] S50: When the matching fails, determine the pupil distance information of the user according to the user image that fails to match.

[0075] Among them, when the matching is unsuccessful, it means that the user in the user image who is watching the naked-eye 3D display device is not a user pre-stored in the naked-eye 3D display device. Therefore, in order to determine whether the user is an adult or a child, it is necessary to determine the user's pupil distance. Specifically, the normal range of the pupil distance of a child is 48-56mm, and the normal range of the pupil distance of an adult is 58-64mm. Therefore, it is possible to determine whether the user is an adult or a child by the size of the pupil distance.

[0076] The preset distance is 57 mm, 58 mm or other lengths.

[0077] In an optional embodiment, in order to improve the recognition accuracy of user categories, the naked-eye 3D display device matches the user's facial features with preset facial feature information through a neural network model, and the neural network model includes but is not limited to a convolutional neural network (CNN) or a feedforward neural network (FNN). It can be understood that the method for facial feature matching can also be carried out by matching the user image with an algorithm, and the matching algorithm includes but is not limited to a scale invariant feature transform algorithm (SIFT) or a KMP algorithm.

[0078] Preferably, in order to improve the efficiency of identifying user categories and reduce the number of matches for users who are watching the naked-eye 3D display device, when the facial features of the user are not matched with the preset facial feature information, after determining the pupil distance information of the user whose match is not successful, the user category of the user whose match is not successful is first determined, and then the facial features of the user are recorded and cached. When the user image is captured by the image acquisition device 200 next time, the facial features of the user image are first matched with the preset facial features, and after the match is unsuccessful, they are matched with the facial feature information in the cache. If the non-preset user watches more frequently or for a long time, the user category of the corresponding user that has been determined by the naked-eye 3D display device can be directly called, thereby eliminating the step of re-determining the pupil distance information of the user, and improving the efficiency of the naked-eye 3D display device in identifying users in different situations.

[0079] It can be understood that after the naked-eye 3D display device caches a certain amount of facial feature information, the naked-eye 3D display device can send a prompt message to the user corresponding to the preset facial feature information through an interface display, and determine whether to save the cached facial feature information and convert it into preset facial feature information according to the user's operation instructions, so that the naked-eye 3D display device can directly save the new user information when in use, avoiding the tedious operation of multiple identification processes when adding new users, thereby improving the working efficiency of the naked-eye 3D display device.

[0080] S60, when the pupil distance information is less than a preset distance, or when the user category determined after successful matching is a child category, determining the viewing parameter of the user.

[0081] The viewing parameters include viewing time, viewing distance and screen size.

[0082] In an optional implementation manner, determining the viewing parameters of the user includes:

[0083] S61, controlling a timer to record the viewing time of the user.

[0084] Among them, the naked-eye 3D display device also includes a timer. When it is detected that the pupil distance information is less than a preset distance, or when the user category determined after successful matching is a child category, it means that the user currently watching the naked-eye 3D display device is a child, so the timer is controlled to start timing.

[0085] S62: When the viewing time is greater than or equal to a preset time, determining the viewing distance of the user.

[0086] S63: When the viewing distance is less than a preset distance, determine the picture size according to the viewing time and the viewing distance.

[0087] The preset duration is 600 seconds, 1000 seconds or other durations.

[0088] When it is determined that the viewing users include children, the timer continues to record the viewing time of the children. When the viewing time of the children is less than the preset time, there is no need to adjust the displayed image.

[0089] When the viewing time of children is greater than or equal to the preset time, in order to prevent children from watching the images displayed by the naked-eye 3D display device for a long time, increasing the degree of eye fatigue of children and reducing children's vision, the user's viewing distance is determined after the viewing time of children is greater than the preset time.

[0090] When a child is close to the TV and watches the naked-eye 3D display device for a long time, in order to prevent the child from continuing to watch the TV, the screen size is determined according to the viewing time and the viewing distance, and the size of the displayed image of the naked-eye 3D display device is adjusted according to the screen size.

[0091] In an optional implementation manner, when the viewing distance is less than a preset distance, determining the picture size according to the position information, the viewing time, and the viewing distance includes:

[0092] When the viewing distance is less than the preset distance, the screen size is determined by the viewing time and the viewing distance according to the first formula Z=Z1*(1800 / E)*[(2.5*cosθ) / Q], wherein E is the viewing time, Q is the viewing distance, Z is the screen size, Z1 is the original screen size, and θ is the first angle.

[0093] In a specific embodiment, when the viewing time is 2700 seconds, the viewing distance is 1.8 meters, the first angle is 30 degrees, and the original screen size is 45 inches, then according to the first formula, the screen size Z=45*(1800 / 2700)*[(2.5*0.867) / 1.8]=36.3 inches.

[0094] In an optional embodiment, the adjustment parameters include the image display position and the grating period of the grating component 20, and the picture size is determined according to the viewing time and the viewing distance, and then further includes:

[0095] The grating period of the grating component 20 is determined according to the image display position and the screen size.

[0096] After determining the image display position and the screen size, in order to enable the display image to be displayed through the naked-eye 3D display device, it is also necessary to adjust the grating period of the grating component 20 .

[0097] In an optional implementation, determining the grating period of the grating component 20 according to the position information and the picture size includes:

[0098] The grating period of the grating component 20 is determined according to the second formula W=Z / Z1*[(B*Y*U) / L], where W is the grating period of the grating component 20, B is the distance between the grating component 20 and the display panel 30, Y is the number of users, U is the pupil distance of the users, and L is the average distance.

[0099] In a specific embodiment, the viewpoint number Y of the naked-eye 3D display device is 4, the user's pupil distance U is 65 mm, the distance B between the grating component 20 and the display panel 30 is 0.2 mm, and the average distance L is 3500. Then, the grating period W of the grating component 20 is 36.3 / 45*(0.2*65*4) / 3500=0.012 mm.

[0100] As described above, before determining the grating period, it is also necessary to determine the pupil distance between the first user and the second user. In a specific embodiment, the pupil distance of the first user and the pupil distance of the second user are preset values. For example, the preset user pupil distance of the naked-eye 3D display device is 65mm, then the average pupil distance U is 65mm. In another specific embodiment, the naked-eye 3D display device obtains the user image through the image acquisition device 200, and then determines the pupil distance between the first user and the second user based on the user image. For example, the naked-eye 3D display device determines that the pupil distance of the first user is 63mm based on the user image, and determines that the pupil distance of the second user is 66mm.

[0101] In an optional embodiment, in order to protect children's eyesight and prevent children from watching the naked-eye 3D display device for a long time, when the viewing time is greater than or equal to a second preset time, the display device of the naked-eye 3D display device is adjusted to a 2D display mode, wherein the second preset time is greater than the first preset time.

[0102] like Figure 4As shown in the figure, cylindrical lens technology is one of the most commonly used solutions for naked-eye 3D display, which can provide multi-viewpoint display without affecting brightness. The key to the human visual system to obtain stereoscopic perception lies in the principle of parallax, that is, images with parallax are projected onto the retinas of both eyes respectively, and the brain fuses the parallax images to form stereoscopic vision. The principle of cylindrical lens technology is to add a cylindrical lens array in front of the LCD panel. The cylindrical lens can refract the light emitted from the sub-pixels of different views it covers into different directions. When both eyes watch the display screen from different angles, they can receive image information from different perspectives, thereby obtaining a stereoscopic effect.

[0103] When human eyes observe 3D images of naked-eye 3D display devices for a long time, visual fatigue is easy to occur. Therefore, users need to switch between 3D display mode and 2D display mode to enhance the user's viewing experience. In the prior art, a cylindrical lens grating composed of optical lenses can enable users to observe three-dimensional images under multiple viewpoints, but it is not possible to simply switch between 3D display mode and 2D display mode. Therefore, a grating component 20 that can replace the optical lens and realize the function of the cylindrical lens grating is needed to realize the display function of the naked-eye 3D display device.

[0104] like Figure 5-8 As shown, in order to enable the naked-eye 3D display device to switch between the 3D display mode and the 2D display mode, the grating component 20 of the present application is composed of two layers of liquid crystal lenses. Specifically, in the present application, the naked-eye 3D display device includes a display device 100 and an image acquisition device 200, the image acquisition device 200 is connected to the display device 100, the display device 100 includes a display unit 10 and a grating component 20, wherein the grating component 20 includes a first liquid crystal lens 21 and a second liquid crystal lens 22, the first liquid crystal lens 21 includes a first glass substrate 211, a first liquid crystal layer 212, a second glass substrate 213 and a first alignment component 214, the second liquid crystal lens 22 includes a third glass substrate 221, a second liquid crystal layer 222, a fourth glass substrate 223 and a second alignment component 224, and the second liquid crystal lens 22 is arranged on a side of the first liquid crystal lens 21 away from the display unit 10.

[0105] In a specific embodiment, the first liquid crystal layer 212 and the second liquid crystal layer 222 are both composed of twisted nematic (TN) liquid crystals, the first alignment component 214 and the second alignment component 224 both include alignment films and indium tin oxide (ITO) electrodes, the first alignment component 214 includes a first alignment film 2141, a second alignment film 2142 and a first ITO electrode 2143, the second alignment component 224 includes a third alignment film 2241, a fourth alignment film 2242 and a second ITO electrode 2243, the first alignment film 2141 is perpendicular to the second alignment film 2142, the third alignment film 2241 is perpendicular to the fourth alignment film 2242, when the first liquid crystal layer 212 and the second liquid crystal layer 222 are working, the ITO electrodes of each layer of liquid crystal lens respectively supply power to the corresponding TN type liquid crystals, so that the liquid crystal molecules rotate, so as to control the light passing through the liquid crystal layer to change the transmission direction.

[0106] like Figure 7 As shown, when the naked-eye 3D display device is required to display a 2D image, no electric field is applied to the first liquid crystal layer 212 and the second liquid crystal layer 222, so that the light emitted by the display unit 10 can pass vertically through the first liquid crystal lens 21 and the second liquid crystal lens 22 and form a 2D image for the user to observe.

[0107] like Figure 8 As shown, when the naked-eye 3D display device is required to display a 3D image, an electric field is applied to the first liquid crystal layer 212 through the first alignment component 214, and an electric field is applied to the second liquid crystal layer 222 through the second alignment component 224, and the electric field strength applied by the first alignment component 214 is different from the electric field strength applied by the second alignment component 224, so that the light emitted by the display unit 10 forms a phase distribution similar to that of a cylindrical lens after passing through the first liquid crystal lens 21 and the second liquid crystal lens 22, so that the user can observe a 3D image with parallax.

[0108] Specifically, while ensuring that the naked-eye 3D display device can switch between the 3D display mode and the 2D display mode, the grating component 20 of the naked-eye 3D display device can ensure that the light emitted by the display unit 10 can be transmitted to the eyes of each user according to the different positions of the user after passing through the above-mentioned grating component 20, thereby realizing multi-viewpoint display of the naked-eye 3D display device.

[0109] In an optional embodiment, the grating assembly 20 further includes a driver, the driver is connected to the first liquid crystal lens 21 and the second liquid crystal lens 22, and the driver is used to drive the first liquid crystal lens 21 and the second liquid crystal lens 22 to move along the light emitting direction of the display unit 10. In a preferred embodiment, the driver includes a first sub-driver and a second sub-driver, the first sub-driver is connected to the first liquid crystal lens 21, and is used to drive the first liquid crystal lens 21 to move along the light emitting direction of the display unit 10. The second sub-driver is connected to the second liquid crystal lens 22, and is used to drive the second liquid crystal lens 22 to move along the light emitting direction of the display unit 10. The first sub-driver and the second sub-driver are independently arranged. By driving the first liquid crystal lens 21 to move by the first sub-driver, and by driving the second liquid crystal lens 22 to move by the second sub-driver, the transmission direction of the light emitted by the display unit 10 and passing through the first liquid crystal lens and the second liquid crystal lens can be changed.

[0110] Specifically, Figure 9-10 As shown, in order to achieve 3D display, when displaying an image, the display unit 10 arranges and displays pixels of three different colors of RGB in sequence, so that the arrangement direction of the pixels can be adapted to the light refraction of the grating component 20, so that the user can observe the 3D display image.

[0111] It is understandable that if Fig.11 As shown, in a specific embodiment, when the display unit 10 displays the images for the left eye and the right eye at the same time, the light emitting unit corresponding to the left eye and the light emitting unit corresponding to the right eye work at the same time, which may cause light crosstalk. Therefore, in order to avoid this problem, the display unit 10 can also include a first light emitting unit 11, a second light emitting unit 12, and a spectrometer 13. The spectrometer 13 includes a first reflecting surface and a second reflecting surface. The light emitted by the first light emitting unit 11 is reflected by the first reflecting surface of the spectrometer 13 and then emitted to the grating component 20. The light emitted by the second light emitting unit 12 is reflected by the second reflecting surface of the spectrometer 13 and then emitted to the grating component 20. The first light emitting unit 11 and the second light emitting unit 12 emit light alternately at the same frequency, thereby avoiding the problem of light crosstalk between the light emitting unit corresponding to the left eye and the light emitting unit corresponding to the right eye of the display unit 10.

[0112] In a preferred embodiment, the display unit 10 further includes a light blocking portion 14, which is disposed on an area of ​​the first reflective surface that does not reflect the light emitted by the first light emitting unit 11, and is also disposed on an area of ​​the second reflective surface that does not reflect the light emitted by the second light emitting unit 12. The light blocking portion 14 can prevent light from being reflected back to the first light emitting unit 11 and the second light emitting unit 12, thereby preventing light from crosstalk or causing the first light emitting unit 11 and the second light emitting unit 12 to heat up.

[0113] S70, controlling the display device 100 to process the display image according to the position information and the viewing parameter.

[0114] After determining the position information and the viewing parameters, in order to limit the user's viewing of the displayed image, it is necessary to control the display device 100 to process the displayed image to reduce the user's viewing effect and viewing desire.

[0115] In an optional implementation, controlling the display device 100 to process the display image according to the position information and the viewing parameter includes:

[0116] S71, determining a viewing evaluation value according to the viewing time and the viewing distance;

[0117] S72, when the viewing evaluation value is greater than a preset threshold, controlling the grating component 20 to perform blurring processing on the display image of the naked-eye 3D display device.

[0118] Among them, when children watch the naked-eye 3D display device, if the children watch for too long or watch from too close a distance, it will affect the children's vision. The children can also be controlled to watch the display image of the naked-eye 3D display device by determining the viewing evaluation value.

[0119] In an optional implementation manner, determining the viewing evaluation value according to the viewing time and the viewing distance includes:

[0120] According to the third formula H=(E / 1800)^2*(2.5 / Q), the viewing time and the viewing distance determine the viewing evaluation value, wherein H is the viewing evaluation value, E is the viewing time, and Q is the viewing distance.

[0121] In a specific implementation, when the viewing time is 3500 seconds and the viewing distance is 1.2 meters, according to the third formula, the viewing evaluation value is 7.86.

[0122] The preset threshold is 5 or 6 or other values.

[0123] In a specific implementation, when the preset threshold is 5 and the viewing evaluation value is 7.86, it is determined that the viewing evaluation value is greater than the preset threshold, and the grating component 20 is controlled to blur the display image of the naked-eye 3D display device.

[0124] Specifically, the display image is blurred by the grating component 20. Specifically, the deflection direction of the twisted nematic liquid crystals in the first liquid crystal layer 212 and the second liquid crystal layer 222 of the grating component 20 can be changed so that the light emitted by the display unit 10 no longer enters the user's eyes.

[0125] In the present application, the image processing method based on the working mode is applied to a naked-eye 3D display device, the naked-eye 3D display device includes a display device 100, an image acquisition device 200, the image acquisition device 200 is connected to the display device 100, the working mode of the naked-eye 3D display device includes a child mode, the display mode of the naked-eye 3D display device includes a 3D display mode and a 2D display mode, the display device 100 includes a display unit 10, a grating component 20 and a display panel 30, the display panel 30 is arranged on the light emitting side of the display unit 10, the grating component 20 is arranged between the display unit 10 and the display panel 30; the display device 100 also includes a dielectric layer, the dielectric layer is arranged on the grating component 20 Between the display panel 30, the image processing method based on the working mode includes: obtaining the working mode of the naked-eye 3D display device; when the working mode is the child mode, controlling the image acquisition device 200 to acquire user images, the number of users and the position information of each user; determining the facial feature information of each user according to the user image; matching the facial features with the preset facial feature information; when the matching is unsuccessful, determining the pupil distance information of the user according to the user image that failed to match; when the pupil distance information is less than the preset distance, or when the user category determined after the matching is successful is the child category, determining the viewing parameters of the user; and controlling the display device 100 to process the display image according to the position information and the viewing parameters. The category of the user is determined by the user's facial feature information and the pupil distance information used. When the user category is the child category, the display image is processed according to the user's viewing parameters, so as to prevent the child user from watching the naked-eye 3D display device for too long, thereby preventing the child from suffering from eye fatigue when watching the naked-eye 3D display device.

[0126] See also Fig.14 , Fig.14An image processing device 100 based on a working mode is provided in an embodiment of the present application. The image processing device 100 based on a working mode is applied to a naked-eye 3D display device. The naked-eye 3D display device includes a display device 100 and an image acquisition device 200. The image acquisition device 200 is connected to the display device 100. The working mode of the naked-eye 3D display device includes a child mode. The display mode of the naked-eye 3D display device includes a 3D display mode and a 2D display mode. The display device 100 includes a display unit 10, a grating component 20 and a display panel 30. The display panel 30 is arranged on a light-emitting side of the display unit 10. The grating component 20 is arranged between the display unit 10 and the display panel 30. The display device 100 also includes a dielectric layer. The dielectric layer is arranged between the grating component 20 and the display panel 30. The image processing device 100 based on a working mode includes:

[0127] An acquisition unit 410 is used to acquire the working mode of the naked-eye 3D display device;

[0128] The acquisition unit 410 is further used to control the image acquisition device 200 to acquire user images, the number of users and the location information of each user when the working mode is the child mode;

[0129] A determination unit 420, configured to determine facial feature information of each user based on the user image;

[0130] A matching unit 430, configured to match the facial feature with preset facial feature information;

[0131] The determining unit 420 is further configured to determine the pupil distance information of the user according to the user image that failed to match when the matching fails;

[0132] The determination unit 420 is further configured to determine the viewing parameters of the user when the pupil distance information is less than a preset distance or when the user category determined after successful matching is a child category;

[0133] The control unit 440 is used to control the display device 100 to process the display image according to the position information and the viewing parameter.

[0134] In an implementation of the present application, the naked-eye 3D display device further includes a timer, the viewing parameters include viewing time, viewing distance, and screen size, and in terms of determining the viewing parameters of the user, the determining unit 420 is specifically configured to:

[0135] Controlling the timer to record the viewing time of the user;

[0136] When the viewing time is greater than or equal to a first preset time, determining a viewing distance of the user;

[0137] When the viewing distance is less than a preset distance, the picture size is determined according to the position information, the viewing time and the viewing distance.

[0138] In an implementation of the present application, when the position information includes a first angle, and when the viewing distance is less than a preset distance, determining the picture size according to the viewing time and the viewing distance, the determining unit 420 is specifically configured to:

[0139] When the viewing distance is less than the preset distance, the screen size is determined by the viewing time and the viewing distance according to the first formula Z=Z1*(1800 / E)*[(2.5*cosθ) / Q], wherein E is the viewing time, Q is the viewing distance, Z is the screen size, Z1 is the original screen size, and θ is the first angle.

[0140] In an implementation of the present application, the adjustment parameters include the image display position and the grating period of the grating component 20, and in determining the picture size according to the viewing time and the viewing distance, the determining unit 420 is further used to:

[0141] The grating period of the grating component 20 is determined according to the position information and the picture size.

[0142] In an implementation of the present application, in determining the grating period of the grating component 20 according to the position information and the picture size, the determining unit 420 is specifically used to:

[0143] The grating period of the grating component 20 is determined according to the second formula W=Z / Z1*[(B*Y*U) / L], wherein W is the grating period of the grating component 20, B is the thickness of the dielectric layer, Y is the number of users, U is the pupil distance information of the users, and L is the viewing distance.

[0144] In an implementation of the present application, the viewing parameters include viewing time and viewing distance; in controlling the display device 100 to process the displayed image according to the position information and the viewing parameters, the control unit 440 is specifically used to:

[0145] Determining a viewing evaluation value according to the viewing time and the viewing distance;

[0146] When the viewing evaluation value is greater than a preset threshold, the grating component 20 is controlled to perform blurring processing on the display image of the naked-eye 3D display device.

[0147] In an implementation of the present application, in determining the viewing evaluation value according to the viewing time and the viewing distance, the control unit 440 is specifically configured to:

[0148] According to the third formula H=(E / 1800)^2*(2.5 / Q), the viewing time and the viewing distance determine the viewing evaluation value, wherein H is the viewing evaluation value, E is the viewing time, and Q is the viewing distance.

[0149] It should be noted that the determination unit 420, the matching unit 430 and the control unit 440 may be implemented by a processor, and the acquisition unit 410 may be implemented by a camera.

[0150] See also Fig.13 , Fig.13 A naked-eye 3D display device is provided in an embodiment of the present application, comprising a processor, a memory, a transceiver, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing the steps in the method described in any one of the above embodiments.

[0151] An embodiment of the present application also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange, wherein the computer program enables a computer to execute part or all of the steps described by the service device in the above method embodiment.

[0152] The embodiment of the present application also provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute some or all of the steps described by the service device in the above method. The computer program product can be a software installation package.

[0153] The steps of the method or algorithm described in the embodiment of the present application can be implemented in a hardware manner, or can be implemented by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in a random access memory (Random Access Memory, RAM), a flash memory, a read-only memory (Read Only Memory, ROM), an erasable programmable read-only memory (Erasable Programmable ROM, EPROM), an electrically erasable programmable read-only memory (Electrically EPROM, EEPROM), a register, a hard disk, a mobile hard disk, a read-only compact disk (CD-ROM) or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC. In addition, the ASIC can be located in an access network device, a target network device, or a core network device. Of course, the processor and the storage medium can also be present in an access network device, a target network device, or a core network device as discrete components.

[0154] Those skilled in the art should be aware that in one or more of the above examples, the functions described in the embodiments of the present application can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiments of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (Digital Subscriber Line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that contains one or more available media integrations. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a digital video disc (DVD)), or a semiconductor medium (eg, a solid state drive (SSD)).

[0155] The specific implementation methods described above further illustrate the purpose, technical solutions and beneficial effects of the embodiments of the present application. It should be understood that the above description is only the specific implementation method of the embodiments of the present application and is not intended to limit the protection scope of the embodiments of the present application. Any modifications, equivalent substitutions, improvements, etc. made on the basis of the technical solutions of the embodiments of the present application should be included in the protection scope of the embodiments of the present application.

Claims

1. An image processing method based on working mode, characterized in that: The image processing method based on the working mode is applied to a naked-eye 3D display device, the naked-eye 3D display device includes a display device and an image acquisition device, the image acquisition device is connected to the display device, the working mode of the naked-eye 3D display device includes a child mode, the display mode of the naked-eye 3D display device includes a 3D display mode and a 2D display mode, the display device includes a display unit, a grating component and a display panel, the display panel is arranged on the light-emitting side of the display unit, and the grating component is arranged between the display unit and the display panel; the display device also includes a dielectric layer, and the dielectric layer is arranged between the grating component and the display panel. The image processing method based on the working mode includes: Obtaining the working mode of the naked-eye 3D display device; When the working mode is the child mode, controlling the image acquisition device to acquire user images, the number of users and the location information of each user; Determine facial feature information of each user based on the user image; Matching the facial features with preset facial feature information; When the matching fails, determining the pupil distance information of the user according to the user image that fails to match; When the pupil distance information is less than a preset distance, or when the user category determined after successful matching is a child category, determining the viewing parameter of the user; Controlling the display device to process the display image according to the position information and the viewing parameter; The naked eye 3D display device further includes a timer, the viewing parameters include viewing time, viewing distance and screen size, and determining the viewing parameters of the user includes: Controlling the timer to record the viewing time of the user; When the viewing time is greater than or equal to a first preset time, determining a viewing distance of the user; When the viewing distance is less than a preset distance, determining the picture size according to the position information, the viewing time and the viewing distance; The position information includes a first angle, and when the viewing distance is less than a preset distance, determining the picture size according to the viewing time and the viewing distance includes: When the viewing distance is less than the preset distance, the screen size is determined by the viewing time and the viewing distance according to the first formula Z=Z1*(1800 / E)*[(2.5*cosθ) / Q], wherein E is the viewing time, Q is the viewing distance, Z is the screen size, Z1 is the original screen size, and θ is the first angle; The viewing parameters include viewing time and viewing distance; and controlling the display device to process the display image according to the position information and the viewing parameters includes: Determining a viewing evaluation value according to the viewing time and the viewing distance; When the viewing evaluation value is greater than a preset threshold, controlling the grating component to perform blurring processing on the display image of the naked-eye 3D display device; The determining of the viewing evaluation value according to the viewing time and the viewing distance includes: According to the third formula H=(E / 1800)^2*(2.5 / Q), the viewing time and the viewing distance determine the viewing evaluation value, wherein H is the viewing evaluation value, E is the viewing time, and Q is the viewing distance.

2. The image processing method based on working mode according to claim 1, characterized in that: The adjustment parameters include the image display position and the grating period of the grating component, and the picture size is determined according to the viewing time and the viewing distance, and then further includes: The grating period of the grating component is determined according to the position information and the picture size.

3. The image processing method based on working mode according to claim 2, characterized in that: The step of determining the grating period of the grating component according to the position information and the picture size includes: The grating period of the grating component is determined according to the second formula W=Z / Z1*[(B*Y*U) / L], wherein W is the grating period of the grating component, B is the thickness of the dielectric layer, Y is the number of users, U is the pupil distance information of the users, and L is the viewing distance.

4. An image processing device based on a working mode, characterized in that: The image processing device is applied to a naked-eye 3D display device, the naked-eye 3D display device includes a display device and an image acquisition device, the image acquisition device is connected to the display device, the working mode of the naked-eye 3D display device includes a child mode, the display mode of the naked-eye 3D display device includes a 3D display mode and a 2D display mode, the display device includes a display unit, a grating component and a display panel, the display panel is arranged on the light-emitting side of the display unit, and the grating component is arranged between the display unit and the display panel; the display device also includes a dielectric layer, and the dielectric layer is arranged between the grating component and the display panel. The image processing device based on the working mode includes: An acquisition unit, used for acquiring the working mode of the naked-eye 3D display device; The acquisition unit is further used to control the image acquisition device to acquire user images, the number of users and the location information of each user when the working mode is the child mode; A determination unit, used to determine facial feature information of each user based on the user image; A matching unit, used for matching the facial feature with preset facial feature information; The determining unit is further configured to determine the pupil distance information of the user according to the user image that failed to match when the matching fails; The determination unit is further configured to determine the viewing parameters of the user when the pupil distance information is less than a preset distance or when the user category determined after successful matching is a child category; A control unit, configured to control the display device to process a display image according to the position information and the viewing parameter; The naked eye 3D display device further includes a timer, the viewing parameters include viewing time, viewing distance and screen size, and determining the viewing parameters of the user includes: Controlling the timer to record the viewing time of the user; When the viewing time is greater than or equal to a first preset time, determining a viewing distance of the user; When the viewing distance is less than a preset distance, determining the picture size according to the position information, the viewing time and the viewing distance; The position information includes a first angle, and when the viewing distance is less than a preset distance, determining the picture size according to the viewing time and the viewing distance includes: When the viewing distance is less than the preset distance, the screen size is determined by the viewing time and the viewing distance according to the first formula Z=Z1*(1800 / E)*[(2.5*cosθ) / Q], wherein E is the viewing time, Q is the viewing distance, Z is the screen size, Z1 is the original screen size, and θ is the first angle; The viewing parameters include viewing time and viewing distance; and controlling the display device to process the display image according to the position information and the viewing parameters includes: Determining a viewing evaluation value according to the viewing time and the viewing distance; When the viewing evaluation value is greater than a preset threshold, controlling the grating component to perform blurring processing on the display image of the naked-eye 3D display device; The determining of the viewing evaluation value according to the viewing time and the viewing distance includes: According to the third formula H=(E / 1800)^2*(2.5 / Q), the viewing time and the viewing distance determine the viewing evaluation value, wherein H is the viewing evaluation value, E is the viewing time, and Q is the viewing distance.

5. A naked-eye 3D display device, characterized in that: The method comprises a processor, a memory, a transceiver, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for executing the steps in the method according to any one of claims 1 to 3.

6. A computer-readable storage medium, characterized in that: A computer program for electronic data exchange is stored, wherein the computer program enables a computer to execute the method according to any one of claims 1 to 3.

Images