Switching control method, medium and system for naked-eye 3D display mode

Abstract

This application discloses a method, medium, and system for switching control modes of naked-eye 3D display. The method includes: acquiring the number of viewers within the viewing range of the naked-eye 3D display device (110); and controlling the display mode of the naked-eye 3D display device to switch between a single-person viewing mode and a multi-person viewing mode based on the number of viewers (120).

Description

Technical Field

[0001] This application relates to the field of image display technology, such as a method, medium, and system for switching control modes of naked-eye 3D display. Background Technology

[0002] Glasses-free 3D display devices refer to display devices that can be viewed directly with the naked eye without the need for 3D glasses to achieve a 3D effect. These devices typically employ technologies such as lenticular prisms and slit gratings, utilizing the parallax characteristics of the left and right eyes to achieve a 3D effect. Without any auxiliary equipment, they can produce stereoscopic images with spatial depth, providing a strong visual impact.

[0003] Currently, there are glasses-free 3D display devices on the market designed for single-person viewing, primarily aiming to achieve a 3D effect for a single viewer; these are called two-viewpoint glasses-free 3D display devices. There are also glasses-free 3D display devices designed for simultaneous viewing by multiple people, allowing multiple people to experience a 3D effect from different positions at the same time; these are called multi-viewpoint glasses-free 3D display devices. These two types of glasses-free 3D display devices have different characteristics, making them suitable for different application scenarios, and they also have their own advantages and disadvantages. While two-viewpoint glasses-free 3D display devices can present a relatively good 3D effect, they can only provide a good 3D viewing experience for one viewer at a time, and cannot allow multiple people to enjoy the 3D effect simultaneously. Multi-viewpoint glasses-free 3D display devices can allow multiple people to view the 3D effect simultaneously in a relatively wide area, but the presented 3D effect is not ideal. Summary of the Invention

[0004] This application provides a method, medium, and system for switching control of naked-eye 3D display modes to achieve naked-eye 3D display effects that can be taken into account in various scenarios.

[0005] In a first aspect, embodiments of this application provide a method for switching control of naked-eye 3D display modes, the method comprising:

[0006] To obtain the number of viewers within the viewing range of the naked-eye 3D display device;

[0007] Based on the number of viewers, the display mode of the naked-eye 3D display device is controlled to switch between single-person viewing mode and multi-person viewing mode.

[0008] Secondly, embodiments of this application also provide a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the method for switching control of naked-eye 3D display modes as described in any embodiment of this application.

[0009] Thirdly, embodiments of this application also provide a glasses-free 3D display system, including a glasses-free 3D display device and a display control device, wherein the display control device is configured to execute the glasses-free 3D display mode switching control method described in any embodiment of this application. Attached Figure Description

[0010] Figure 1 This is a flowchart of a method for switching control of naked-eye 3D display modes according to an embodiment of this application;

[0011] Figure 2 This is a flowchart of a method for switching control of naked-eye 3D display mode according to another embodiment of this application;

[0012] Figure 3A This is a schematic diagram of a naked-eye 3D display system structure according to one embodiment of this application;

[0013] Figure 3B This is a schematic diagram of the EESVR software control system structure in one embodiment of this application;

[0014] Figure 3C This is a schematic diagram of the EESVR software control system structure in another embodiment of this application;

[0015] Figure 4 This is a schematic diagram of the structure of a naked-eye 3D display mode switching control device according to an embodiment of this application;

[0016] Figure 5 This is a schematic diagram of the structure of a computer device according to one embodiment of this application. Detailed Implementation

[0017] The present application will now be described in further detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are for illustrative purposes only and are not intended to limit the scope of the application. Furthermore, it should be noted that, for ease of description, only the parts relevant to the present application are shown in the accompanying drawings, not the entire structure.

[0018] Figure 1 This is a flowchart illustrating a method for switching control of naked-eye 3D display modes according to an embodiment of this application. This embodiment is applicable to situations where a naked-eye 3D display device can be used as a single-viewpoint naked-eye 3D device or a multi-viewpoint naked-eye 3D display device. This method can be executed by the naked-eye 3D display mode switching control device in this embodiment. This device can be implemented in software and / or hardware and can be configured in an electronic device with computing capabilities. Figure 1 As shown, the method includes the following steps:

[0019] Step 110: Obtain the number of viewers within the viewing range of the naked-eye 3D display device.

[0020] The glasses-free 3D display device is a display device that can be viewed directly with the naked eye without wearing 3D glasses to achieve a 3D effect. Based on the imaging principle of glasses-free 3D, generally, at a set position in front of the screen, the viewer's left and right eyes can respectively obtain left-eye and right-eye images with horizontal parallax to present a 3D display effect. The set of these positions is the viewing range, which is the range within which the viewer can see the glasses-free 3D display effect near the glasses-free 3D display device. For example, the viewing range can be within 50-100 centimeters of the viewer's distance from the glasses-free 3D display device. The camera can be one or more, and the camera's installation... The device can be embedded in the display device, placed above or below the naked-eye 3D display device, or placed independently near the naked-eye 3D display device to facilitate capturing the number of viewers. The number of viewers can be obtained automatically or manually, for example, it can be the number of viewers detected by the camera within the viewing range through the face recognition function. The face recognition function is implemented by the face recognition service program in the host system, and the method can be the support vector machine method, the hidden Markov model method, the subspace method, and the neural network method, etc. For example, the neural network face recognition method can be used as the face recognition method in this embodiment.

[0021] For example, the number of viewers can be obtained from calibration images captured by the camera. The shooting pose of the camera is calibrated and corrected based on the calibration images to obtain real-time images captured by the camera within the viewing range of the naked-eye 3D display device. Face recognition is performed on the real-time images, and the number of viewers is determined based on the face recognition results.

[0022] Step 120: Based on the number of viewers, control the display mode of the naked-eye 3D display device to switch between single-person viewing mode and multi-person viewing mode.

[0023] The display mode of the naked-eye 3D display device refers to the visual effect that the 3D screen can achieve, such as a 2D display mode or a 3D display mode. The single-person viewing mode is the display mode for a single viewer, or for multiple viewer-to-viewer-including those with priority. In this mode, the 3D effect is generally presented at the location of the single viewer. The multi-person viewing mode is the display mode for multiple viewer-to-viewer-including those with priority. In this mode, the 3D effect is presented within an area where multiple viewer-to-viewer-area.

[0024] For example, the switching between single-person viewing mode and multi-person viewing mode of the naked-eye 3D display device is controlled by the software system in the host system. The software system can determine whether there is one or multiple viewers based on the real-time images transmitted from the camera, and control the 3D display screen through the naked-eye 3D display device control software in the system, thereby realizing the automatic switching of the display mode of the display device.

[0025] For example, after controlling the display mode of the naked-eye 3D display device to switch between single-person viewing mode and multi-person viewing mode according to the number of viewers, the method further includes: if switching to single-person viewing mode, tracking and obtaining the position and interpupillary distance of the viewers within the viewing range of the naked-eye 3D display device; and controlling the image rendering parameters of the naked-eye 3D display device according to the position and interpupillary distance of the viewers to present a 3D display effect at the position of the viewers.

[0026] For example, after obtaining the number of viewers within the viewing range of the naked-eye 3D display device, the method further includes: if the number of viewers is zero, controlling the display mode of the naked-eye 3D display device to switch to 2D display mode.

[0027] For example, controlling the display mode of the naked-eye 3D display device to switch between single-person viewing mode and multi-person viewing mode according to the number of viewers includes: determining whether the display mode is single-person viewing mode or multi-person viewing mode according to the number of viewers; and transmitting control instructions representing the display mode to the screen control system to control the rendering parameters of the naked-eye 3D display device.

[0028] For example, the rendering parameters of a glasses-free 3D display device are mainly controlled by the K3 screen control system in the host system. After receiving the control command representing the display mode, the system renders the 3D display image according to the command, rearranging and combining the sub-pixels of the left-right format 3D image, thereby realizing the conversion between 2D and 3D modes.

[0029] For example, after obtaining the number of viewers within the viewing range of the glasses-free 3D display device, the method further includes identifying the viewers if there are multiple viewers; correspondingly, controlling the display mode of the glasses-free 3D display device to switch between single-person viewing mode and multi-person viewing mode based on the number of viewers includes: controlling the display mode of the glasses-free 3D display device to switch between single-person viewing mode and multi-person viewing mode based on the number of viewers and the identification result.

[0030] For example, the identity recognition can be completed by the face recognition service program in the host system. In multi-person mode, the identity of the viewers present is first recognized to determine whether there are any viewers with priority. The viewers with priority can be identified by manually inputting their information or by inputting their image into the face recognition service program in advance. The face recognition service program will then identify the facial features in the image to determine the viewers with priority.

[0031] For example, based on the number of viewers and the identity recognition results, the display mode of the naked-eye 3D display device can be switched between a single-viewing mode and a multi-viewing mode, including: if the number of viewers is multiple, determining the identity priority of the viewers based on the identity recognition results; and controlling the display mode of the naked-eye 3D display device to switch to a single-viewing mode or a multi-viewing mode for viewers whose identity priority meets the set conditions as single viewers or multiple viewers.

[0032] For example, when there are multiple viewers, the first step is to identify the viewers. The facial recognition service program can then prioritize viewers based on their status, setting the highest-ranking person as the first priority, the second-highest-ranking person as the second priority, and so on. Viewers who have not pre-entered their information in the facial recognition service program are considered ordinary viewers. In the case of multiple viewers, the naked-eye 3D display device can provide a single-viewing mode with a stronger 3D effect according to the priority of each viewer. If there are no viewers with specific priorities, a multi-viewing mode is provided.

[0033] For example, obtaining the number of viewers within the viewing range of a naked-eye 3D display device also includes obtaining calibration images captured by the camera, and calibrating and correcting the shooting pose of the camera based on the calibration images.

[0034] For example, calibration images captured by cameras can be used in dual-target timing, allowing two cameras to take multiple images of the same calibration board, calibrating their intrinsic parameters and extrinsic parameters relative to the calibration board. The relationship between the positions of the two cameras can then be calculated. After dual-target calibration, when the two cameras capture the same object, epipolar constraints can be used for binocular correction, ensuring that the same feature point lies on the same straight line in the horizontal direction of both images from the left and right cameras, reducing image distortion.

[0035] The technical solution of this embodiment can obtain the number of viewers within the viewing range of the naked-eye 3D display device, and control the display mode of the naked-eye 3D display device to switch between single-person viewing mode and multi-person viewing mode based on the number of viewers. Moreover, when there are multiple viewers, the display mode of the display device can be determined as multi-person viewing mode or single-person viewing mode based on whether the viewers include viewers with priority. This improves the situation that the naked-eye 3D display devices on the market can only display single-person mode or multi-person mode, and achieves the effect that the device can be used as a single-viewpoint naked-eye 3D device or a multi-viewpoint naked-eye 3D display device.

[0036] Figure 2 This is a flowchart of a method for switching control of naked-eye 3D display mode according to another embodiment of this application. This embodiment refines the method for switching control of naked-eye 3D display mode based on the above embodiment.

[0037] In this embodiment, the naked-eye 3D display system mainly includes a naked-eye 3D display device and a display control device. The optical design of the display device takes into account both dual-viewpoint and multi-viewpoint schemes. The optical design here refers to the design of optical parameters for the 3D display screen using prismatic technology. The optical parameters include the thickness, width, and refractive index of the prism. Through the optical design of the 3D display screen, with the cooperation of hardware based on optical refraction and supporting interlacing software, the display device can present a naked-eye 3D effect.

[0038] like Figure 2 As shown, the method in this embodiment includes the following steps:

[0039] Step 210: Acquire real-time images captured by the camera within the viewing range of the naked-eye 3D display device.

[0040] The camera is installed on the 3D display device. The position of the camera can be above or below the 3D display screen, and there can be one or more cameras. The camera can be embedded in the display device, placed above or below the naked-eye 3D display device, or placed nearby independently of the naked-eye 3D display device. The real-time image can be a calibration image captured by the camera. The shooting posture of the camera is calibrated and corrected based on the calibration image.

[0041] For example, the camera and the host system of the naked-eye 3D display device can be connected via a Universal Serial Bus (USB) cable, and the captured real-time images can be transmitted to the face recognition service program in the host system via the USB cable. When the camera is working, the camera will continuously capture the faces of viewers within the viewing range to facilitate the detection of changes in the number of viewers, and send the data to the computer host system for processing by the face recognition service program.

[0042] Step 220: Perform face recognition on the real-time image and determine the number of viewers based on the face recognition results.

[0043] The face recognition method involves processing the facial feature points of the viewer to identify the face. The method can be a support vector machine method, a hidden Markov model method, a subspace method, or a neural network method. For example, a neural network face recognition method can be used as the face recognition method in this embodiment. It is implemented by the face recognition service program in the host system of this embodiment and is used to analyze the viewer information in the real-time images collected. The viewer information specifically includes the number of viewers and the eye tracking information in the single-viewing mode. The pupillary distance and the spatial coordinates of the pupil are used to detect the pupil movement trajectory of the viewer.

[0044] For example, the face recognition service program in the host system compares the feature points of the face in the real-time image with the face feature points in the face recognition service program. The face feature points can be eyes, nose, mouth, eyebrows, etc. Face recognition mainly identifies the key features of the face, which are generally represented by 128 points, but can also be represented by 64 points or other numbers of points to represent the outline of these facial organs. Using these features, it is possible to identify the specific person, thereby identifying whether the viewer is a single person or a group of people. When there is only one viewer, or multiple viewer including those with priority, the face recognition service program tracks the movement trajectory of the eyeballs by calculating the interpupillary distance of the viewer's pupils and recording the spatial coordinates of the pupils. There are various methods for tracking pupil movement trajectories, such as the sclera-iris edge method, pupil tracking method, and pupil-corneal reflection method. For example, the pupil tracking method can be used as the pupil movement trajectory tracking method in this application embodiment. The pupil tracking method mainly performs image processing on the human eye features detected in the face recognition service program. By combining continuous images of the human eye captured by the camera with changes in the shape of the viewer's eyes, it detects pixel changes in human eye feature points, determines the position of both pupils based on the amount of pixel change in the image, takes the point that the pupil is looking at as the pupil center point, records the spatial coordinates of the pupil center point, calculates the interpupillary distance, and analyzes the movement of the eye pupils.

[0045] Step 230: Determine whether the display mode is a single-person viewing mode or a multi-person viewing mode based on the number of viewers.

[0046] The number of viewers is the result detected by the face recognition service program, specifically the number of viewers in the viewer information. The face recognition service program can automatically send the viewer information to the host system for processing to determine whether the display mode is a single-person viewing mode or a multi-person viewing mode.

[0047] For example, if the facial recognition service detects a single viewer, the host system controls the naked-eye 3D display device to display in single-view mode; if there are multiple viewers, including those with priority, the host system tracks the pupil information of the priority viewers and controls the naked-eye 3D display device to provide single-view mode based on their priority; if there are multiple viewers, but no priority viewers, the host system controls the naked-eye 3D display device to display in multi-view mode.

[0048] Step 240: The control command representing the display mode is transmitted to the screen control system to control the rendering parameters of the naked-eye 3D display device.

[0049] The display mode is the display mode of the glasses-free 3D display device, such as a 2D display mode or a 3D display mode; the control commands are sent by the EESVR software control system in the host system; the rendering parameters of the glasses-free 3D display device are controlled by the K3 screen control system. The Eye Tracking Service (EESVR) software control system mainly includes an eye tracking module, a server-side monitoring and data processing module, a tray menu module, a communication protocol parsing and data transmission module, etc., and is configured to receive viewer information detected by the face recognition service program, and send commands to the K3 screen control system to switch the viewing mode of the glasses-free 3D display device based on the number of viewers.

[0050] For example, if the EESVR software control system detects zero viewers, it sends a command to the K3 screen control system via USB to turn off 3D display mode and switch to 2D display mode. If the EESVR software control module detects a single viewer, it sends a command to the K3 screen control system via USB to switch to single-viewer mode. If the EESVR software control system detects multiple viewers, it sends a command to the K3 screen control system via USB to switch to multi-viewer mode.

[0051] Based on the number of viewers, after controlling the display mode of the naked-eye 3D display device to switch between single-person viewing mode and multi-person viewing mode, the method further includes:

[0052] In single-viewer mode, the eye-tracking module in the EESVR software control module continuously tracks the position of the viewer's pupils. First, image processing is performed on the eye images obtained by the face recognition service program. By combining continuous images of the eyes captured by the camera with changes in the viewer's eye shape, pixel changes in eye feature points are detected to obtain the center point of the pupil, thus determining its center position. Finally, the real-time position information is converted into rendering parameters, which are then transmitted to the K3 screen control system via USB.

[0053] Step 250: Based on the number of viewers, control the display mode of the naked-eye 3D display device to switch between single-person viewing mode and multi-person viewing mode.

[0054] The display mode of the naked-eye 3D display device is mainly controlled by the K3 image control system. The core of the K3 image control system is the K3 image control chip, which is mainly set to control the image rendering parameters of the naked-eye 3D display device to present a 3D display effect at the viewer's position. The naked-eye 3D display screen adopts prismatic technology, which can divide the space of the display screen into different viewing areas. The viewing mode can be 2D viewing mode, 3D single-person viewing mode, and 3D multi-person viewing mode.

[0055] For example, in the 2D viewing mode, the screen displays an image without 3D effects. The K3 screen control system can crop the left and right sides of the display screen into a single image for output. In the 3D viewing mode, which is a single-person viewing mode, the mode can be activated with a single viewer or with multiple viewers including those with priority. The display screen space is divided into a left and right viewing area. During viewing, the K3 screen control system ensures that the image from the left viewing area enters the viewer's left eye, and the image from the right viewing area enters the viewer's right eye. The K3 screen control system rearranges and combines sub-pixels based on the rendering parameters transmitted from the EESVR software. Because the rendering parameters in this module are related to the pupil position, the rendering parameters change each time the pupil position moves, and the arrangement of sub-pixels changes accordingly. Because the center point of the viewing area always falls at the center of the pupil, the K3 image control system, based on changes in the viewer's pupil position, ensures that the EESVR software control system can always determine the spatial position of the pupil through eye tracking, regardless of the viewer's movement. This information is then converted into rendering parameters, and the K3 image system is instructed to rearrange and combine sub-pixels according to the latest parameters. This ensures that the left viewing area image enters the viewer's left eye, and the right viewing area image enters the viewer's right eye, allowing the viewer to enjoy a naked-eye 3D stereoscopic effect. In the multi-view mode, the display screen is divided into multiple different viewing areas, such as 28 or 54. The distance between adjacent viewing areas is controlled to be N times the distance between the viewer's pupils. By arranging and combining sub-pixels in the image using a fixed algorithm, a fixed parallax exists between adjacent viewing areas, ensuring a naked-eye 3D stereoscopic effect regardless of the viewer's location. Because there is a crosstalk zone between adjacent viewing areas, viewers may experience discomfort when in the crosstalk zone. Simply moving to avoid this zone will resolve the issue. In multi-view mode, the K3 screen control system uses a fixed method to rearrange and combine the sub-pixels of the input 3D content in a fixed way, so that multiple people can see the naked-eye 3D stereoscopic effect from different spatial positions.

[0056] The technical solution of this embodiment, through the optical design of the naked-eye 3D display device in this application embodiment, takes into account both dual-viewpoint and multi-viewpoint schemes. It uses a camera to capture real-time images within the viewing range and transmits them to the face recognition service program in the host system via USB. The face recognition service program measures facial features, analyzes and determines the viewer information, and provides a single-view mode based on the priority of the viewer when there is only one viewer, or when there are multiple viewers including those with priority. By acquiring the viewer's pupil information, the viewer information is sent to EESV. The R software control system sends commands to the K3 screen control system to switch viewing modes. The K3 screen control system rearranges the pixels of the naked-eye 3D display device's screen, dividing the screen into left and right viewing areas in single-person viewing mode and multiple different viewing areas in multi-person viewing mode. For example, it can be 28 viewing areas or 54 viewing areas, improving the switching between single-person and multi-person viewing modes of the naked-eye 3D display device. This achieves the effect of using the device as both a single-viewpoint naked-eye 3D device and a multi-viewpoint naked-eye 3D display device.

[0057] Figure 3A This is a schematic diagram of a naked-eye 3D display system provided in an embodiment of this application; Figure 3B and Figure 3C This is a schematic diagram of the EESVR software control system. This embodiment is based on the above-mentioned embodiments, such as... Figure 3A As shown, the glasses-free 3D display system includes a glasses-free 3D display device 310 and a display control device 320. The optical design of the glasses-free 3D display device considers both dual-viewpoint and multi-viewpoint schemes. This optical design refers to the parameter design of the prism for the selected 3D display screen. The glasses-free 3D visual effect is achieved based on the optical refraction of the prism and the accompanying interlacing software. For example, the optical parameters include the prism's thickness, width, and refractive index. Furthermore, the glasses-free 3D display device 310 includes a camera and a K3 image control system, such as... Figure 3B and Figure 3C As shown, the display control device is a host system, mainly comprising a face recognition service program and an EESVR software control system. The EESVR software control system primarily includes: an eye-tracking module, a server-side monitoring and data processing module, a tray menu module, and a communication protocol parsing and data transmission module. The eye-tracking module includes functions such as eye-tracking status query, eye-tracking switch, and eye-tracking parameter adjustment, while the data processing module includes functions such as authentication, K3 control, and 3D diaphragm switch.

[0058] When the EESVR software control system program starts, the eye-tracking mode is activated, and corresponding settings are made for the EESVR. Modules can establish connections through image data cables, command data cables, and multiple application interfaces. The server-side monitoring module listens for communication between 3D applications (3D renderers and players, etc.) and the EESVR software control system. Once a new connection is detected, a new process is created to facilitate information exchange and processing between the server and the 3D applications. The eye-tracking module connects to the server-side monitoring module, the client-side data receiving process, and the data sending process through the eye-tracking interface program, and is configured to transmit eye-tracking information. After receiving relevant data, the client-side data receiving process parses the data (e.g., the data can be in JSON string format). The data processing module then sends the data to be sent to the client to the data sending process and the K3 control process. The K3 control process then performs 3D image rendering through the K3 control chip, enabling the naked-eye 3D display device to switch viewing modes. In addition, the watchdog process is used to monitor whether the eye tracking process, the EESVR extension service process, and the tray program are running normally. If the program runs abnormally, the process can be restarted.

[0059] In one example, the 3D display device uses prismatic technology. In single-view mode, which can be activated with a single viewer or multiple viewer with priority settings, the screen space is divided into left and right viewing areas. The image from the left viewing area is transmitted to the left eye, and the image from the right viewing area is transmitted to the right eye. In multi-view mode, the screen is divided into multiple different viewing areas, such as 28 or 54, to transmit images to viewers at different angles, presenting a 3D image to the viewers.

[0060] The system comprises several modules: an eye-tracking module for calculating interpupillary distance and recording the spatial coordinates of the pupil center point to track eye movement; a server-side monitoring module for detecting new application clients connecting to the EESVR software control system, creating a new thread to handle communication between the application and the system; a player module connected to the server via an application interface for playing 3D content, sending control commands to the EESVR software control system via a connection protocol to activate eye-tracking and switch the naked-eye 3D display device to 3D stereoscopic display mode; a K3 image control module using the K3 image control chip to control 3D rendering parameters, enabling the naked-eye 3D display device to switch between 2D and 3D single-person and multi-person modes; and a data transmission module for transferring different data to their respective modules.

[0061] When the glasses-free 3D display device is working, it is connected to the computer host via a wired High Definition Multimedia Interface (HDMI) to serve as the computer's glasses-free 3D display device. Related 3D content data can be transmitted via this wired HDMI. The camera is connected to the computer host via a USB cable or network cable. The calibration image captured by the camera is calibrated and corrected based on the camera's shooting posture in the calibration image, and then sent to the computer host system via the same USB or network cable. The face recognition service program performs image recognition and other related processing on the real-time image. The image recognition mainly targets facial features, including eyes, nose, mouth, and eyebrows, which can generally be represented by 128 points, or by 64 points or other point values. These features can effectively identify specific people, thereby determining whether the viewer is single or multiple. When the viewer is single, the face recognition service program calculates the interpupillary distance and records the spatial coordinates of the pupils.

[0062] When the number of viewers is zero, the EESVR software control system sends a message to the K3 screen control system to turn off the naked-eye 3D display mode and switch to 2D display mode.

[0063] When the number of viewers is a single person or multiple viewers including those with priority, the display mode is single-person viewing mode. After receiving the viewer information from the face recognition service program, the EESVR software control system can automatically send a command to the K3 screen control module to switch to naked-eye 3D single-person viewing mode. Then, using the eye tracking module in the EESVR software control system, the interpupillary distance and pupil spatial coordinates of the viewer in single-person mode are transmitted as real-time position information to the K3 screen control system via USB cable and converted into rendering parameters. The K3 screen control system rearranges and combines the sub-pixels of the 3D image, dividing the screen of the naked-eye 3D display device into left and right viewing areas. This ensures that when the images from the left and right viewing areas are refracted by the prism and enter the viewer's eyes, the left viewing area image is transmitted to the left eye and the right viewing area image is transmitted to the right eye, keeping the gaze point on the screen always at the center of the pupil, so that the viewer can always enjoy the naked-eye 3D effect within the viewing range.

[0064] When there are multiple viewers, excluding those with priority, the display mode is multi-view mode. The EESVR software control system sends a command to the K3 screen control module to switch to naked-eye 3D multi-view mode. The K3 screen control system then rearranges and combines the sub-pixels of the 3D image, dividing the screen of the naked-eye 3D display device into multiple different viewing zones, such as 28 or 54 zones. The distance between two adjacent viewing zones is controlled to be N times the distance between the viewer's pupils. By arranging and combining the sub-pixels in the image using a fixed algorithm, a fixed parallax exists between adjacent viewing zones. This ensures that the viewer can see the naked-eye 3D stereoscopic effect regardless of which viewing zone they are in. Because there is a crosstalk zone between two adjacent viewing zones, viewers may feel uncomfortable when they are in the crosstalk zone. In this case, they can simply move their position to avoid the crosstalk zone.

[0065] The technical solution of this embodiment, through the optical design of the naked-eye 3D display device in this application embodiment, takes into account both dual-viewpoint and multi-viewpoint schemes. It uses a camera to capture real-time images within the viewing range and transmits them to the face recognition service program in the host system via USB cable. The face recognition service program can analyze and determine the number of viewers by detecting facial features. When the number of viewers is single, or when there are multiple viewers including those with priority, it provides a single-view mode for the higher-priority viewer. It obtains the viewer's pupil information, such as interpupillary distance and spatial coordinates, and sends the viewer information to the EESVR software control system. This system then sends a command to the K3 screen control system to switch the viewing mode. Finally, the K3 screen control system can switch the viewing mode of the naked-eye 3D display screen to single-view mode or multi-view mode according to the command. This improves the switching between single-view and multi-view modes of the naked-eye 3D display device, achieving the effect that the device can be used as a single-viewpoint naked-eye 3D device or a multi-viewpoint naked-eye 3D display device.

[0066] Figure 4 This diagram illustrates a glasses-free 3D display mode switching control device provided in an embodiment of this application. The device can be implemented using software and / or hardware, and can be configured in an electronic device with computing capabilities, such as… Figure 4 As shown, the device includes: a viewer count acquisition module 410 and a viewing mode switching control module 420.

[0067] Among them, the viewer number acquisition module 410 is set to acquire the number of viewers within the viewing range of the naked-eye 3D display device;

[0068] The viewer count acquisition module includes:

[0069] The real-time image acquisition unit is configured to acquire real-time images captured by a camera within the viewing range of a naked-eye 3D display device;

[0070] The face recognition unit is configured to perform face recognition on the real-time image and determine the number of viewers based on the face recognition results.

[0071] The viewing mode switching control module 420 is configured to control the display mode of the naked-eye 3D display device to switch between single-person viewing mode and multi-person viewing mode according to the number of viewers.

[0072] The viewing mode switching control module includes:

[0073] The 2D viewing mode switching unit is configured to control the display mode of the naked-eye 3D display device to switch to 2D display mode if the number of viewers is zero.

[0074] The 3D viewing mode switching unit is configured to, if switched to single-person viewing mode, track and acquire the position and interpupillary distance of the viewer within the viewing range of the naked-eye 3D display device; and, based on the viewer's position and interpupillary distance, control the image rendering parameters of the naked-eye 3D display device to present a 3D display effect at the viewer's position.

[0075] For example, the display mode is determined to be either a single-view mode or a multi-view mode based on the number of viewers.

[0076] For example, control commands representing the display mode are transmitted to the screen control system and set to control the rendering parameters of the naked-eye 3D display device.

[0077] For example, after obtaining the number of viewers within the viewing range of the glasses-free 3D display device, the method further includes: if there are multiple viewers, then identifying the viewers; correspondingly, controlling the display mode of the glasses-free 3D display device to switch between single-person viewing mode and multi-person viewing mode based on the number of viewers includes: controlling the display mode of the glasses-free 3D display device to switch between single-person viewing mode and multi-person viewing mode based on the number of viewers and the identification result.

[0078] For example, controlling the display mode of the naked-eye 3D display device to switch between single-view mode and multi-view mode based on the number of viewers and the identity recognition result includes: if there are multiple viewers, determining the identity priority of the viewers based on the identity recognition result; and controlling the display mode of the naked-eye 3D display device to switch to single-view mode or multi-view mode for viewers whose identity priority meets the set conditions as single viewers or multiple viewers.

[0079] For example, the calibration image captured by the camera is acquired, and the camera's shooting pose is calibrated and corrected based on the calibration image.

[0080] For example, the naked-eye 3D display system has at least one camera configured to capture real-time images within the viewing range of the naked-eye 3D display device; the camera is positioned above or below the screen of the naked-eye 3D display device, and multiple cameras are spaced apart.

[0081] For example, an image data line is provided between the naked-eye 3D display device and the display control device, configured to transmit image data to be displayed and an instruction data line, configured to transmit viewer count data, display mode switching instructions, and rendering parameters.

[0082] The naked-eye 3D display mode switching control device provided in this application embodiment can execute the method provided in any embodiment of this application, and has the corresponding functional modules and beneficial effects of executing the method.

[0083] The technical solution of this embodiment obtains the number of viewers within the viewing range of the naked-eye 3D display device, and controls the display mode of the naked-eye 3D display device to switch between single-person viewing mode and multi-person viewing mode based on the number of viewers. Moreover, when there are multiple viewers, including viewers with priority, the single-person viewing mode can be provided to the higher-priority viewers according to their priority. This improves upon the situation in related technologies where naked-eye 3D display devices can only display single-person or multi-person viewing modes, and realizes that the naked-eye 3D display device can automatically switch between single-person and multi-person viewing modes according to the number of viewers, taking into account the effects of dual-viewpoint and multi-viewpoint schemes.

[0084] Figure 5 This is a schematic diagram of the structure of a computer device according to an embodiment of this application. Figure 5 A block diagram of an exemplary computer device 12 suitable for implementing embodiments of the present application is shown. Figure 5 The computer device 12 shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of this application.

[0085] like Figure 5 As shown, the computer device 12 is represented in the form of a general-purpose computing device. The components of the computer device 12 may include, but are not limited to: one or more processors or processing units 16, system memory 28, and a bus 18 connecting different system components (including system memory 28 and processing unit 16).

[0086] Bus 18 represents one or more of several bus architectures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of the various bus architectures. For example, these architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnect (PCI) bus.

[0087] Computer device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by computer device 12, including volatile and non-volatile media, removable and non-removable media.

[0088] System memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. Computer device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 34 may be configured to read and write non-removable, non-volatile magnetic media (…). Figure 5 Not shown; usually referred to as a "hard drive"). Although Figure 5 Not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk") and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 via one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of various embodiments of this application.

[0089] A program / utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28. Such program modules 42 include—but are not limited to—an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. Program modules 42 typically perform the functions and / or methods described in the embodiments of this application.

[0090] The computer device 12 can also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), and with one or more devices that enable a user to interact with the computer device 12, and / or with any device that enables the computer device 12 to communicate with one or more other computing devices (e.g., network card, modem, etc.). This communication can be performed via the input / output (I / O) interface 22. Furthermore, in this embodiment, the display 24 of the computer device 12 is not an independent entity, but is embedded in a mirror, so that when the display surface of the display 24 is not displayed, the display surface of the display 24 and the mirror surface visually blend together. Moreover, the computer device 12 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via the network adapter 20. As shown, the network adapter 20 communicates with other modules of the computer device 12 via the bus 18. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with computer device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0091] The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, such as implementing the glasses-free 3D display mode switching control method provided in the embodiments of this application: obtaining the number of viewers within the viewing range of the glasses-free 3D display device; and controlling the display mode of the glasses-free 3D display device to switch between single-person viewing mode and multi-person viewing mode according to the number of viewers.

[0092] This application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements a method for switching and controlling the naked-eye 3D display mode as provided in all embodiments of this application: acquiring the number of viewers within the viewing range of the naked-eye 3D display device; and controlling the display mode of the naked-eye 3D display device to switch between a single-viewer mode and a multi-viewer mode based on the number of viewers. Any combination of one or more computer-readable media can be used. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. For example, a computer-readable storage medium can be—but is not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in connection with an instruction execution system, apparatus, or device. A computer-readable storage medium can be a non-transitory computer-readable storage medium.

[0093] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including—but not limited to—electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, capable of transmitting, propagating, or transmitting programs for use by or in connection with an instruction execution system, apparatus, or device.

[0094] The program code contained on a computer-readable medium may be transmitted using any suitable medium, including—but not limited to—wireless, wire, optical fiber, radio frequency (RF), etc., or any suitable combination thereof.

[0095] Computer program code for performing the operations of this application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

Claims

1. A method for switching control modes of naked-eye 3D display, characterized in that, include: To obtain the number of viewers within the viewing range of the naked-eye 3D display device; Based on the number of viewers, the display mode of the naked-eye 3D display device is controlled to switch between single-person viewing mode and multi-person viewing mode; The process of obtaining the number of viewers within the viewing range of the naked-eye 3D display device further includes: In response to determining that there are multiple viewers, the viewers are identified. The step of controlling the display mode of the naked-eye 3D display device to switch between single-person viewing mode and multi-person viewing mode based on the number of viewers includes: Based on the number of viewers and the identity recognition results, the display mode of the naked-eye 3D display device is controlled to switch between single-person viewing mode and multi-person viewing mode; The step of controlling the display mode of the naked-eye 3D display device to switch between single-person viewing mode and multi-person viewing mode based on the number of viewers and the identity recognition results includes: In response to determining that there are multiple viewers, the viewer's identity priority is determined based on the identity recognition result; Viewers whose identity priority meets the set conditions are treated as single viewers, and the display mode of the naked-eye 3D display device is switched to single-viewer mode; or viewers whose identity priority meets the set conditions are treated as multiple viewers, and the display mode of the naked-eye 3D display device is switched to multi-viewer mode.

2. The method according to claim 1, characterized in that, The number of viewers within the viewing range of the naked-eye 3D display device includes: Acquire real-time images captured by a camera within the viewing range of a glasses-free 3D display device; Face recognition is performed on the real-time image, and the number of viewers is determined based on the face recognition results.

3. The method according to claim 1, characterized in that, After controlling the display mode of the naked-eye 3D display device to switch between single-person viewing mode and multi-person viewing mode according to the number of viewers, the method further includes: In response to determining that the mode is switched to single-person viewing mode, the position and interpupillary distance of the viewer within the viewing range of the naked-eye 3D display device are tracked and acquired; Based on the viewer's position and interpupillary distance, the image rendering parameters of the naked-eye 3D display device are controlled to present a 3D display effect at the viewer's position.

4. The method according to claim 1, characterized in that, After obtaining the number of viewers within the viewing range of the naked-eye 3D display device, the method further includes: In response to determining that the number of viewers is zero, the display mode of the naked-eye 3D display device is switched to 2D display mode.

5. The method according to claim 1, characterized in that, The step of controlling the display mode of the naked-eye 3D display device to switch between single-person viewing mode and multi-person viewing mode based on the number of viewers includes: Based on the number of viewers, determine whether the display mode is a single-person viewing mode or a multi-person viewing mode; Control commands representing the display mode are transmitted to the screen control system to control the rendering parameters of the naked-eye 3D display device.

6. The method according to claim 2, characterized in that, Also includes: Acquire the calibration image captured by the camera, and calibrate and correct the shooting pose of the camera based on the calibration image.

7. A computer storage medium, characterized in that, It stores a computer program, which, when executed by a processor, implements the method for switching control of naked-eye 3D display modes as described in any one of claims 1-6.

8. A glasses-free 3D display system, characterized in that, It includes a glasses-free 3D display device and a display control device, wherein the display control device is configured to execute the glasses-free 3D display mode switching control method according to any one of claims 1-6.

9. The system according to claim 8, characterized in that, Also includes: At least one camera is configured to capture real-time images within the viewing range of the glasses-free 3D display device; the camera is positioned above or below the screen of the glasses-free 3D display device, and multiple cameras are spaced apart.

10. The system according to claim 8, characterized in that, The naked-eye 3D display device and the display control device are provided with: Image data cable, configured to transmit image data to be displayed; The command data line is configured to transmit viewer count data, display mode switching commands, and rendering parameters.

Images