Display device and method, driving chip and storage medium

Abstract

The invention provides a display device and method, a driving chip and a storage medium, and belongs to the technical field of display. In the device, a driving chip receives a picture set of a real scene shot by a first camera group, and generates display mode data corresponding to the picture set according to first fixation point information sent by a processor, so that a display panel can display the real scene according to the picture set and the display mode data. In the display device, the first camera group directly sends the picture set of the real scene to the driving chip, and the processor directly sends the first fixation point information to the driving chip, so that the picture set does not need to be transmitted through the processor, the time consumed for transmitting the picture set is greatly shortened, and the transmission efficiency of the picture set is improved. The processor does not need to synthesize and render the picture set, and the driving chip does not need to analyze the picture set to obtain the first fixation point information, so that the calculated amount consumed in the display process of the pictures in the picture set is reduced, the time delay of displaying the pictures is shortened, and a low-delay perspective function is realized.

Description

Technical Field

[0001] This application relates to the field of display technology, and in particular to a display device, method, driver chip, and storage medium. Background Technology

[0002] VR (Virtual Reality) technology is a technology that uses computers to generate virtual environments to create virtual worlds, thereby providing users with an immersive experience. VR devices are devices that use VR technology to present this virtual environment to users. While using VR devices, the human eye cannot see the outside world, leading to a lower sense of security. Therefore, VR devices are generally equipped with see-through functionality, allowing users to see the real-world environment through a camera on the VR device.

[0003] Currently, one way to implement the see-through function on VR devices is as follows: a camera is installed on the VR device, which sends the captured images to the processor in the VR device. The processor performs processing such as compositing and rendering on the received images, and then sends the processed images to the display module on the VR device for display.

[0004] In the above implementation, the processor in the VR device consumes a considerable amount of time for image synthesis and rendering. Furthermore, during this process, since the human eye focuses on one area while viewing other areas with peripheral vision, and these peripherally viewed areas do not require high-definition display, high-definition display can be achieved in the user's gaze area, while low-definition display is used in the non-gaze area. Correspondingly, the processor renders the gaze point information into the image. Thus, after receiving the image, the display module must also parse the image to obtain the gaze point information and then display the image based on that information, resulting in a long latency for the VR device's display module to display the image. Summary of the Invention

[0005] This application provides a display device, method, driver chip, and storage medium to shorten the latency of displaying images. The technical solution is as follows:

[0006] In a first aspect, a display device is provided, the device including a first camera group, a processor, a driver chip and a display panel, wherein the first camera group and the processor are respectively connected to the driver chip, and the driver chip is connected to the display panel.

[0007] The first camera group includes at least one first camera, which is used to send a set of captured images to the driver chip. The set of images includes at least one image, which is a real-world scene captured by the first camera.

[0008] The processor is used to send first gaze point information to the driver chip. The first gaze point information indicates the coordinates of the first gaze point, which is the point on the display panel that is gazed at by the user during the display of the picture set.

[0009] The driver chip is used to generate display mode data corresponding to the image set based on the received first gaze point information, and send the received image set and the display mode data corresponding to the image set to the display panel. The display mode data indicates the display mode of multiple display modules on the display panel during the display of the image set. The display clarity of the display mode of the display module located within the target range around the first gaze point is greater than the display clarity of the display mode of the display module located outside the target range around the first gaze point.

[0010] The display panel is used to display the real-world scene based on the received image set and the corresponding display method data.

[0011] In the display device provided in this application, the driver chip receives a set of images of a real scene captured by a first camera group, and generates display mode data corresponding to the set of images of the real scene based on the first gaze point information sent by the processor. This enables the display panel to display the real scene based on the image set and the display mode data. Since the first camera group directly sends the set of images of the real scene to the driver chip, and the processor directly sends the first gaze point information to the driver chip, the image set does not need to be transmitted through the processor, greatly reducing the time consumed in transmitting the image set. The processor does not need to perform compositing and rendering of the image set, nor does it need to render the first gaze point information into the image set. The driver chip also does not need to parse the image set to obtain the first gaze point information, reducing the computational load consumed in displaying the images in the image set, shortening the display latency, and achieving a low-latency perspective function.

[0012] Optionally, the driver chip is used for:

[0013] Based on the coordinates of the first gaze point indicated by the first gaze point information, the first region information is determined, and the first region information indicates the area on the display panel located within the target range around the first gaze point;

[0014] Based on the information from the first region, generate display data for the corresponding image set.

[0015] Optionally, the driver chip is also used to optimize the images in the received image set to obtain an optimized image set, and then send the optimized image set to the display panel.

[0016] Optionally, when the first camera group includes multiple first cameras, the multiple first cameras include at least one narrow-angle camera and at least one wide-angle camera, the shooting range of the wide-angle camera includes the shooting range of the narrow-angle camera, and the image set includes a first image and a second image, the first image being an image taken by the narrow-angle camera and the second image being an image taken by the wide-angle camera.

[0017] The driver chip is used for:

[0018] Based on the coordinates of the first gaze point indicated by the first gaze point information and the size of the first image, second region information is determined. The second region information indicates the area on the display panel within the size range of the first image around the first gaze point. Based on the second region information, display mode data corresponding to the first image and the second image is generated.

[0019] Send the received first image, second image, and corresponding display mode data of the first and second images to the display panel.

[0020] Optionally, the resolution of the first image is greater than the resolution of the second image;

[0021] The driver chip is also used to optimize the first image and the second image respectively, to obtain optimized first image and second image, and to send the optimized first image and second image to the display panel.

[0022] Optionally, the display panel is used for:

[0023] Based on the received first image, second image, and the corresponding display method data for the first and second images, the real-world scene is displayed.

[0024] Optionally, the processor is also used to send a third image to the driver chip, the third image being an image of the virtual scene;

[0025] The driver chip is also used to parse the third image to obtain the second gaze point information. Based on the second gaze point information, it generates the display mode data corresponding to the third image. The second gaze point information indicates the coordinates of the second gaze point, which is the point on the display panel that the user is looking at during the display of the third image.

[0026] Optionally, the display device also includes a monitoring module, which is used to send a switching control signal to the processor when a switching scene is detected;

[0027] The processor is also used to send first control information to the driver chip in response to the switching control signal;

[0028] The driver chip is also used to switch from a first state to a second state when it detects that the first control information indicates that a real scene is to be displayed. The first state is the state of receiving images sent by the processor, and the second state is the state of receiving a set of images sent by the first camera group.

[0029] Upon detecting a first control information instruction to display a virtual scene, the system transitions from the second state to the first state.

[0030] Optionally, when the first control information indicates that a real-world scene is displayed, the processor is also configured to send second control information to the first camera group, the second control information being used to trigger the first camera group to capture the real-world scene.

[0031] Optionally, during the processing of each frame of image sent by the processor, the processor is also used to send a first synchronization signal to the driver chip, the first synchronization signal being used to control the driver chip to process the image sent by the processor.

[0032] Optionally, during the processing of each set of images sent by the first camera group, the first camera group is also used to send a second synchronization signal to the driver chip, the second synchronization signal being used to control the driver chip to process the set of images sent by the first camera group.

[0033] Optionally, the first camera in the first camera group is fixed to the display device via a hinge structure;

[0034] The display device also includes a second camera group, which includes at least one second camera for sending images of the user's pupils to the processor.

[0035] The processor is also used to obtain the rotation direction and rotation angle of the first camera in the first camera group relative to the display device based on the user's pupil image, and control the first camera to rotate through the rotating shaft structure according to the rotation direction and rotation angle.

[0036] Optionally, the hinge structure is fixed to the display device via a slide rail structure;

[0037] The processor is also used to obtain the translation distance of the first camera in the first camera group relative to the display device based on the user's pupil image, and control the rotating shaft structure on which the first camera is mounted to translate according to the translation distance via the slide rail structure.

[0038] Secondly, a display method is provided, applied to a display device, the device including a first camera group, a processor, a driver chip, and a display panel, wherein the first camera group and the processor are respectively connected to the driver chip, the driver chip is connected to the display panel, and the first camera group includes at least one first camera; the method includes:

[0039] The aforementioned first camera sends a set of captured images to the driver chip. The set of images includes at least one image, which is a real-world scene captured by the first camera.

[0040] The processor sends the first gaze point information to the driver chip. The first gaze point information indicates the coordinates of the first gaze point. The first gaze point is the point on the display panel that is gazed at by the user during the display of the picture set.

[0041] The driver chip generates display mode data corresponding to the image set based on the received first gaze point information, and sends the received image set and the corresponding display mode data to the display panel. The display mode data indicates the display mode of multiple display modules on the display panel during the display of the image set. The display clarity of the display mode of the display module located within the target range around the first gaze point is greater than the display clarity of the display mode of the display module located outside the target range around the first gaze point.

[0042] The display panel shows the real-world scene based on the received image set and the corresponding display method data.

[0043] Thirdly, a driver chip is provided, which includes a display mode data acquisition module;

[0044] The display mode data acquisition module is used to generate display mode data corresponding to the received image set based on the received first gaze point information. The first gaze point information indicates the coordinates of the first gaze point, which is the point on the display panel that is gazed at by the user during the display of the image set. The display mode data indicates the display mode of multiple display modules on the display panel during the display of the image set. The display clarity of the display mode of the display module located within the target range around the first gaze point is greater than the display clarity of the display mode of the display module located outside the target range around the first gaze point.

[0045] Optionally, the display mode data acquisition module includes a region information acquisition unit and a timing control unit;

[0046] The area information acquisition unit is used to determine the first area information based on the coordinates of the first gaze point indicated by the first gaze point information. The first area information indicates the area on the display panel located within the target range around the first gaze point.

[0047] The timing control unit is used to generate display mode data corresponding to the image set based on the information of the first region.

[0048] Optionally, the driver chip may also include an image signal processor;

[0049] An image signal processor is used to optimize the images in a received image set to obtain an optimized image set.

[0050] Optionally, if there are multiple image signal processors, each image signal processor corresponds to one of the first cameras in the first camera group.

[0051] Optionally, the driver chip may also include a switching module;

[0052] The switching module is used to switch the image source of the image received by the driver chip in response to the first control information. The image source includes the first camera group and the processor.

[0053] Fourthly, a computer-readable storage medium is provided, wherein at least one computer program is stored therein, the at least one computer program being loaded and executed by a processor to perform the operations performed by the display method provided in the second aspect or various alternative implementations of the second aspect.

[0054] Fifthly, a computer program product or computer program is provided, the computer program product or computer program including computer program code stored in a computer-readable storage medium, a processor of a display device reading the computer program code from the computer-readable storage medium, the processor executing the computer program code, causing the display device to perform the operations performed by the display method provided in the second aspect or various alternative implementations of the second aspect.

[0055] Based on the implementation methods provided in the above aspects, this application can be further combined to provide more implementation methods. Attached Figure Description

[0056] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0057] Figure 1 This is a schematic diagram of the structure of a display device provided in an embodiment of this application;

[0058] Figure 2 This is a schematic diagram of another display device provided in an embodiment of this application;

[0059] Figure 3 This is an architecture diagram of a switching module provided in an embodiment of this application;

[0060] Figure 4This is a schematic diagram of another display device provided in an embodiment of this application;

[0061] Figure 5 This is a data interaction diagram of a display method provided in an embodiment of this application;

[0062] Figure 6 This is an example diagram of a synchronization signal provided in an embodiment of this application;

[0063] Figure 7 This is a data interaction diagram of another display method provided in the embodiments of this application;

[0064] Figure 8 This is a flowchart illustrating an image display process provided in an embodiment of this application;

[0065] Figure 9 This is a structural diagram of a display device provided in an embodiment of this application. Detailed Implementation

[0066] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0067] In this application, the terms "first," "second," etc., are used to distinguish identical or similar items with essentially the same function. It should be understood that there is no logical or temporal dependency between "first," "second," and "nth," nor are there any restrictions on quantity or execution order.

[0068] In this application, the term "at least one" means one or more, and "multiple" means two or more.

[0069] It should be noted that all information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals involved in this application have been authorized by the user or fully authorized by all parties, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the images and gaze point information involved in this application were obtained with full authorization.

[0070] Figure 1 This is a schematic diagram of the structure of a display device provided in an embodiment of this application, such as... Figure 1 As shown, the display device 100 includes an information acquisition module 101, a processing module 102, and a display module 103. The information acquisition module 101 is connected to the display module 103, and the processing module 102 is connected to both the information acquisition module 101 and the display module 103.

[0071] The information acquisition module 101 includes at least one first camera group, which captures images of the real-world scene to obtain an image set. This image set, containing at least one image, is then sent to the display module 103. The processing module 102 includes a processor, such as an application processor (AP), which sends first gaze point information to the display module 103. This first gaze point information indicates the coordinates of a first gaze point, which is the point on the display panel that the user is looking at during the display of the image set. It should be noted that the gaze point information changes in real time based on the user's gaze point; different images may correspond to different gaze point information. The display module 103 includes a driver IC (driver integrated circuit) and a display panel. The driver IC receives the image set sent by the information acquisition module 101 and the first gaze point information sent by the processing module 102. Based on the received first gaze point information, it generates display mode data corresponding to the image set and sends the received image set and the corresponding display mode data to the display panel. Display mode data indicates the display mode of multiple display modules on the display panel during the display of an image set. The display clarity of display modules located within the target range around the first gaze point is greater than that of display modules located outside the target range around the first gaze point. The target range can be a pre-defined area of ​​a certain shape and size. In other words, multiple display modules on the display panel jointly display the same frame of image, with different modules displaying different areas of that frame. The display mode data indicates that for display modules within the target range around the gaze point on the display panel, a higher-clarity display mode is used, while for display modules outside the target range around the gaze point, a lower-clarity display mode is used. As the gaze point on the display panel changes, the display mode data also changes; that is, the display mode of multiple display modules changes with the gaze point. For example, the display modes include a first display mode and a second display mode, where the first display mode has a higher clarity than the second display mode. When the human eye's gaze point on the display panel is point A, the display mode of the display modules within the target range around point A is the first display mode, and the display mode of the display modules outside the target range around point A is the second display mode.When the human eye's gaze point on the display panel changes from point A to point B, the display mode of the display module within the target range around point A but outside the target range around point B changes from the first display mode to the second display mode. The display mode of the display module within the target range around point A and the target range around point B remains the first display mode. The display mode of the display module outside the target range around point A but within the target range around point B changes from the second display mode to the first display mode. The display mode of the display module outside the target range around point A and the target range around point B remains the second display mode.

[0072] The display panel is used to display the real-world scene based on the received image set and the corresponding display method data.

[0073] In some embodiments, the processing module 102 is used to send a virtual scene image (third image) to the display module 103. Correspondingly, the driver chip in the display module 103 is also used to receive the virtual scene image sent by the processing module 102, parse the image to obtain second gaze point information, and generate display mode data corresponding to the virtual scene image based on the second gaze point information. The second gaze point information indicates the coordinates of the second gaze point, which is the point on the display panel that the user is looking at during the display of the virtual scene image. The driver chip in the display module 103 sends the aforementioned virtual scene image and display mode data to the display panel. The display panel in the display module 103 is also used to display the virtual scene according to the received image and display mode data.

[0074] In some embodiments, the display device further includes a monitoring module, which is configured to send a switching control signal to the processing module 102 when a scene switching is detected. The processing module 102 is further configured to send first control information to the driver chip in the display module 103 in response to the switching control signal. Correspondingly, the driver chip is further configured to switch from a first state to a second state when it detects that the first control information indicates the display of a real scene, and switch from the second state to the first state when it detects that the first control information indicates the display of a virtual scene. The first state is the state of receiving images sent by the processor, and the second state is the state of receiving a set of images sent by the first camera group.

[0075] In some embodiments, when the first control information indicates the display of a real scene, the processing module 102 is further configured to send a second control information to the information acquisition module 101, which triggers the information acquisition module 101 to take pictures of the real scene.

[0076] In some embodiments, the processing module 102 synchronously sends first control information to the display module 103 instructing the display of the real scene, and sends the aforementioned second control information to the information acquisition module 101, so that while the display module 103 switches to the state of receiving the image set sent by the first camera group, the first camera group in the information acquisition module 101 synchronously starts to capture the real scene.

[0077] In some embodiments, during the processing of each frame of image sent by the processing module 102, the processing module 102 is further configured to send a first synchronization signal to the driver chip in the display module 103. The first synchronization signal is used to control the driver chip to process the image sent by the processing module 102.

[0078] In some embodiments, during the processing of each image set sent by the first camera group in the information acquisition module 101, the first camera group is also used to send a second synchronization signal to the driver chip in the display module 103. The second synchronization signal is used to control the driver chip to process the image set sent by the first camera group.

[0079] In some embodiments, during the process of sending a second synchronization signal to the driver chip, the first camera group in the information acquisition module 101 simultaneously sends a second synchronization signal to the processing module 102. The second synchronization signal is used to control the processing module 102 to send the first gaze point information corresponding to the above image set to the driver chip, so that the driver chip can generate display mode data based on the real-time first gaze point information, thereby improving the accuracy of the display mode data.

[0080] The above Figure 1 The display device 100 shown can be installed in either a standalone VR headset or a split VR headset; this application embodiment does not limit this. When the display device 100 is installed in a standalone VR headset, each module of the display device 100 is implemented as a module of that standalone VR headset. For example, the information acquisition module 101 is implemented as the first camera group on the standalone VR headset, the processing module 102 is implemented as the processor on the standalone VR headset, and the display module 103 is implemented as the driver chip and display panel on the standalone VR headset. When the display device 100 is installed in a split VR headset, each module of the display device 100 can be implemented as a module of each separate device of that split VR headset. For example, the information acquisition module 101 is implemented as the first camera group on the head-mounted device in the split VR headset, the processing module 102 is implemented as the processor in the handheld controller of the split VR headset, and the display module 103 is implemented as the driver chip and display panel on the head-mounted device of the split VR headset; this application embodiment does not limit this.

[0081] Figure 2This is a schematic diagram of another display device provided in the embodiments of this application. The following is a description of its structure in conjunction with... Figure 2 The specific embodiments shown are based on the above. Figure 1 Taking the information acquisition module (including a first camera group), the processing module (including a processor), and the display module (including a driver chip and a display panel) as an example, the various components of the above-mentioned display device and their working processes are explained.

[0082] like Figure 2 As shown, the display device includes a processor 201, a first camera group 202, a driver chip 203, and a display panel 204. The first camera group 202 and the driver chip 203 adopt a new direct connection architecture, so that the processor 201 and the first camera group 202 are respectively connected to the driver chip 203, and the driver chip 203 is connected to the display panel 204.

[0083] (1) The processor 201 is used to send first gaze point information to the driver chip 203. The first gaze point information indicates the coordinates of the first gaze point. The first gaze point is the point on the display panel that is gazed at by the user during the display of the picture set.

[0084] In some embodiments, the display device further includes a second camera connected to the processor 201. The second camera captures an image of the user's pupils, obtains the pupil image, and sends the image to the processor 201. The processor 201 analyzes the pupil image sent by the second camera, obtains the position coordinates of the pupil in the image, and performs spatial transformation on these coordinates to obtain the user's gaze point on the display panel 204, i.e., the first gaze point information. Alternatively, the processor 201 analyzes two frames of pupil images sent by the second camera to obtain the pupil's rotation direction and distance. Based on the gaze point corresponding to the first frame of the pupil image, the rotation direction, and the rotation distance, it performs spatial transformation to obtain the user's gaze point on the display panel 204 corresponding to the second frame of the pupil image, i.e., the first gaze point information, and sends the first gaze point information to the driver chip 203. The process by which processor 201 obtains the pupil's rotation direction and distance can be as follows: For the two pupil images mentioned above, processor 201 identifies the pupil's position coordinates in the two images, subtracts the pupil's position coordinates from each image, and obtains the pupil's rotation direction and distance. Alternatively, processor 201 can also use a pre-trained gaze point information acquisition model to process the pupil images sent by the second camera and output the gaze point information corresponding to the pupil images; this embodiment does not limit this specific method.

[0085] In some embodiments, the processor 201 is further configured to receive images of virtual scenes sent by a cloud server or other devices via a network, or to generate images of virtual scenes and send these images (third images) to the driver chip 203. Accordingly, the processor 201 uses the MIPI_DSI (Mobile Industry Processor Interface - DisplaySerial Interface) protocol to encapsulate the images of the virtual scenes, obtaining the corresponding MIPI_DSI messages. The processor 201 then sends the MIPI_DSI messages corresponding to the virtual scene images to the driver chip 203 through the MIPI_DSI interface between the processor 201 and the driver chip 203.

[0086] In some embodiments, during the processing of each frame of image sent by the processor 201, the processor 201 is further configured to send a first synchronization signal to the driver chip 203. This first synchronization signal controls the driver chip 203 to process the images sent by the processor 201. Accordingly, the processor 201 sends a first synchronization signal to the driver chip 203 each time it sends a frame of image. Before receiving the next first synchronization signal, the driver chip 203 processes the image corresponding to the current first synchronization signal. After receiving the next first synchronization signal, it sends the image corresponding to the current first synchronization signal to the display panel 204, so that the display panel 204 displays the image corresponding to the current first synchronization signal.

[0087] In some embodiments, the processor 201 is further configured to send first control information to the driver chip 203 in response to a switching control signal, the first control information indicating the display of a real scene or the display of a virtual scene. Accordingly, in some embodiments, the display device further includes a monitoring module, which is configured to send a switching control signal to the processor 201 when a switching scene is detected. The monitoring module sending the switching control signal to the processor 201 when a switching scene is detected, causing the processor 201 to send the first control information to the driver chip 203, can be done in several ways. One method is that the monitoring module includes an infrared sensor or a temperature sensor, etc., and when an abnormal condition is detected, the monitoring module sends a switching control signal to the processor 201, causing the processor 201 to send the first control information indicating the display of a real scene to the driver chip 203. Alternatively, when the abnormal condition is detected to be canceled, the monitoring module sends a switching control signal to the processor 201, causing the processor 201 to send the first control information indicating the display of a virtual scene to the driver chip 203. One approach is that the display device defaults to displaying a virtual scene. The monitoring module includes a switching button on the display device. In response to the first triggering of the switching button, the monitoring module sends a first switching control signal to the processor 201. In response to the first switching control signal, the processor 201 sends first control information to the driver chip 203, indicating that the real scene should be displayed. In response to a second triggering of the switching button, the monitoring module sends a second switching control signal to the processor 201. In response to the second switching control signal, the processor 201 sends the first control information to the driver chip 203, indicating that the virtual scene should be displayed. Of course, other monitoring modules may also send switching control signals to the processor 201 when a scene switching is detected, causing the processor 201 to send first control information to the driver chip 203. This embodiment does not limit the specific method used in this application.

[0088] The abnormal situation could be that the monitoring module detects someone approaching the user or the user approaching an object; this embodiment does not limit this. The switching process between the virtual and real scenes can be combined with the safety warning function of the display device. For example, during the display of a virtual scene, the content seen by the user is a virtual scene rendered by the processor 201. When the display device has a monitoring module, if the monitoring module detects someone approaching or the user approaching an object, the monitoring module triggers a safety warning and automatically triggers a switch. That is, it actively triggers the processor 201 to send first control information to the driver chip 203, thereby switching the interface in the driver chip 203 used for receiving images to the first camera group. At the same time, the processor 201 sends second control information to the first camera group to trigger the first camera group to start shooting the real scene. At this time, the user can view the surrounding environment through the first camera group to observe whether there is a collision risk or to observe approaching people. Of course, the above switching operation can also be actively triggered by the user through the above switching button, thereby facilitating the user to perform external operations, such as drinking water, looking at a mobile phone, and actively observing the external environment; this embodiment does not limit this.

[0089] During the process of the processor 201 sending the first control information to the driver chip 203, the processor 201 can send the first control information to the driver chip 203 through the GPIO (General-purpose input / output) line between the processor 201 and the driver chip 203. For example, the processor 201 controls the GPIO line to be in a high-level state to indicate the display of a virtual scene, and the processor 201 controls the GPIO line to be in a low-level state to indicate the display of a real scene. The processor 201 can also send the first control information to the driver chip 203 by sending an interrupt signal. For example, the processor 201 sends an interrupt signal to the driver chip 203 once, and this interrupt signal indicates the display of a virtual scene; the next interrupt signal sent by the processor 201 to the driver chip 203 indicates the display of a real scene. The control of the GPIO line and the interrupt signal described above can all be implemented through registers, and this embodiment of the application does not limit this.

[0090] In some embodiments, the processor 201 is connected to the first camera group 202. When the processor 201 sends a first control message to the driver chip 203 indicating that a real-world scene should be displayed, the processor 201 is also used to send a second control message to the first camera group 202. This second control message is used to trigger the first camera group 202 to capture images of the real-world scene. Accordingly, the processor 201 sends the second control message to the first camera group 202 via the I2C (Inter-Integrated Circuit) bus between the processor 201 and the first camera group 202. Accordingly, the processor 201 is provided with an I2C driver to enable information transmission between the processor 201 and the first camera group 202 via I2C.

[0091] (2) The first camera group 202 includes at least one first camera, which is used to send a set of captured images to the driver chip. The set of images includes at least one image, which is captured by the first camera of a real scene.

[0092] The first camera in the first camera group 202 can be a large FOV (Field of View) camera or a small FOV camera, and can be a high-definition camera or a low-definition camera. This application embodiment does not limit this.

[0093] In this embodiment, the first camera in the first camera group 202 scans and reads the real scene to obtain a set of images of the real scene. The captured image set is encapsulated using the MIPI_CSI (Mobile Industry Processor Interface - Camera Serial Interface) protocol to obtain a corresponding MIPI_CSI message. The first camera group 202 sends the MIPI_CSI message corresponding to the image set to the driver chip 203 through the MIPI_CSI interface between the first camera group 202 and the driver chip 203.

[0094] In some embodiments, during the processing of each image set sent by the first camera group 202, the first camera group 202 is further configured to send a second synchronization signal to the driver chip 203. This second synchronization signal controls the driver chip 203 to process the image sets sent by the first camera group 202. Accordingly, each time the first camera group 202 sends an image set to the driver chip 203, it simultaneously sends a second synchronization signal to the driver chip 203. Before receiving the next second synchronization signal, the driver chip 203 processes the image set corresponding to the current second synchronization signal. After receiving the next second synchronization signal, it sends the image set corresponding to the current second synchronization signal to the display panel 204, so that the display panel 204 displays the image set corresponding to the current second synchronization signal.

[0095] In some embodiments, during the processing of each image set sent by the first camera group 202, the first camera group 202 is further configured to send a third synchronization signal to the processor 201 via the I2C (Internet-Integrated Circuit) between the processor 201 and the first camera group 202. This third synchronization signal controls the processor 201 to send the first gaze point information corresponding to the image set to the driver chip 203. Accordingly, each time the first camera group 202 sends an image set to the driver chip 203, it simultaneously sends the third synchronization signal to the processor 201. Each time the processor 201 receives the third synchronization signal, it sends the first gaze point information corresponding to the image set to the driver chip 203, enabling the driver chip 203 to generate display mode data based on the real-time first gaze point information, thereby improving the accuracy of the display mode data. The third synchronization signal and the second synchronization signal can be the same signal or different signals; this embodiment does not limit this.

[0096] (3) The driver chip 203 is used to generate display mode data corresponding to the above-mentioned image set based on the received first gaze point information, and send the received image set and the display mode data corresponding to the image set to the display panel. Among them, the display mode data is the display timing data, which indicates the display mode of multiple display modules on the display panel during the display of the above-mentioned image set. The display clarity of the display mode of the display module located within the target range around the first gaze point is greater than the display clarity of the display mode of the display module located outside the target range around the first gaze point.

[0097] In some embodiments, the driver chip 203 is used to determine first region information based on the coordinates of the first gaze point indicated by the first gaze point information. The first region information indicates a region on the display panel located within a target area surrounding the first gaze point. The size and shape of the target area are preset. Accordingly, the driver chip 203 calculates the coordinates based on the size and shape of the target area, starting from the coordinates of the first gaze point, to obtain the first region information. For example, if the coordinates of the first gaze point are (10, 10), and the target area is a square with a side length of 10, extending outwards from the lower left vertex of the square with the first gaze point as the first vertex, the first region information obtained through coordinate calculation is: lower left vertex coordinates (10, 10), lower right vertex coordinates (20, 10), upper left vertex coordinates (10, 20), and upper right vertex coordinates (20, 20). Of course, the first gaze point can also be any point within the target area; this embodiment does not limit this.

[0098] In some embodiments, the driver chip 203 is used to generate display mode data corresponding to the above-mentioned image set based on the first region information. During the generation of the display mode data, the driver chip 203, based on the first region information, sets the display mode of the display module in the region indicated by the first region information to a first display mode, and sets the display mode of the display module in the region outside the region indicated by the first region information to a second display mode. The display module includes at least one transistor, and the display clarity of the first display mode is greater than that of the second display mode. Accordingly, the driver chip 203 generates gate timing data and source timing data based on the first region information. The display panel 204 includes transistors with a preset number of rows and a preset number of columns. The gate timing data is used to scan the transistors on the display panel 204 column by column, controlling the transistors to turn on and off. The source timing data is used to input data voltage row by row in each column of transistors to control information such as the display clarity of the display module.

[0099] In some embodiments, the driver chip 203 is used to receive the MIPI_CSI message corresponding to the image set sent by the first camera group 202, and parse the message according to the MIPI_CSI protocol to obtain the image set of the real scene captured by the first camera group 202.

[0100] In some embodiments, the driver chip 203 is used to optimize the images in the received image set to obtain an optimized image set. That is, it optimizes the images in the image set obtained by parsing the message to obtain an optimized image set of the real scene. The image optimization process includes at least one of the following: noise reduction, interpolation, color space conversion, and anti-distortion processing.

[0101] In some embodiments, the driver chip 203 is further configured to parse the image (third image) of the virtual scene sent by the processor 201 to obtain second gaze point information, and generate display mode data corresponding to the third image based on the second gaze point information. The second gaze point information indicates the coordinates of the second gaze point, which is the point on the display panel that the user is looking at during the display of the third image. The process of obtaining the second gaze point information is similar to the process of obtaining the first gaze point information described above, and will not be repeated here. After obtaining the second gaze point information, the processor 201 renders the second gaze point information into the third image during the rendering process, and then sends the third image to the driver chip 203. Therefore, after receiving the third image, the driver chip 203 can parse the third image to obtain the second gaze point information. The process by which the driver chip 203 generates display mode data corresponding to the third image based on the second gaze point information is similar to the process by which display mode data is generated based on the first gaze point information described above, and will not be repeated here.

[0102] In some embodiments, the driver chip 203 is further configured to receive first control information sent by the processor 201, and switch from a first state to a second state when the first control information indicates that a real scene is to be displayed, and switch from the second state to the first state when the first control information indicates that a virtual scene is to be displayed. The first state is the state of receiving images sent by the processor 201, and the second state is the state of receiving a set of images sent by the first camera group 202. For example, when the first control information is transmitted using GPIO lines, the driver chip 203 detects the level of the GPIO lines. When the driver chip 203 detects that the GPIO lines change from a high level to a low level, indicating that the first control information indicates that a real scene is to be displayed, the driver chip 203 switches from the first state to the second state; when the driver chip 203 detects that the GPIO lines change from a low level to a high level, indicating that the first control information indicates that a virtual scene is to be displayed, the driver chip 203 switches from the second state to the first state. As another example, when the first control information is transmitted using interrupt signals, the driver chip 203 switches states once each time it receives an interrupt signal. Accordingly, when the driver chip 203 is in the first state, the driver chip 203 receives an interrupt signal indicating that the first control information indicates that the real scene is displayed, and the driver chip 203 switches from the first state to the second state. When the driver chip 203 is in the second state, the driver chip 203 receives an interrupt signal indicating that the first control information indicates that the virtual scene is displayed, and the driver chip 203 switches from the second state to the first state.

[0103] In some embodiments, the first state of receiving images sent by the processor 201 means that the path corresponding to the processor 201 in the driver chip 203 is in the open state, and the path corresponding to the first camera group 202 is in the closed state. When the driver chip 203 is in the first state, after parsing the message sent by the processor 201 and obtaining the image of the virtual scene, since the path corresponding to the processor 201 in the driver chip 203 is in the open state, the driver chip 203 will continue to process the image of the virtual scene. However, if the driver chip 203 also receives a message sent by the first camera group 202 while in the first state, it will parse the message sent by the first camera group 202 to obtain a set of images of the real scene. Since the path corresponding to the first camera group 202 in the driver chip 203 is in the closed state, the driver chip 203 will not perform any further processing on the set of images of the real scene. The second state of receiving the set of images sent by the first camera group 202 is similar to the above-mentioned content, and will not be described again in this embodiment.

[0104] In some embodiments, the driver chip 203 is further configured to receive a first synchronization signal sent by the processor 201, and for each first synchronization signal received, process the image corresponding to the first synchronization signal, and send the previous frame image and the display mode data corresponding to the previous frame image to the display panel 204, so that the display panel 204 displays the virtual scene corresponding to the previous frame image.

[0105] In some embodiments, the driver chip 203 is further configured to receive a second synchronization signal sent by the first camera group 202, and for each second synchronization signal received, process the image set corresponding to the second synchronization signal, and send the previous image set and the display mode data corresponding to the previous image set to the display panel 204, so that the display panel 204 displays the real scene corresponding to the previous image set.

[0106] (4) The display panel 204 is used to display the real scene based on the received image set and the corresponding display mode data. Accordingly, based on the received image set and the corresponding display mode data, the display panel 204 uses a first display mode to display the image of the corresponding area on the designated display module on the display panel 204, and uses a second display mode to display the image of the corresponding area on the other display modules on the display panel 204. That is to say, based on the image set and the corresponding display mode data, the display panel 204 uses a display mode with higher display clarity to display the image of the corresponding area in the area that the human eye is looking at, and uses a display mode with lower display clarity to display the image of the corresponding area in the area that the human eye is not looking at.

[0107] In the display device provided in this application embodiment, the driver chip receives a set of images of the real scene captured by the first camera group, and generates display mode data corresponding to the set of images of the real scene based on the first gaze point information sent by the processor. This enables the display panel to display the real scene based on the image set and the display mode data. Since the first camera group directly sends the set of images of the real scene to the driver chip, and the processor directly sends the first gaze point information to the driver chip, the image set does not need to be transmitted through the processor, greatly shortening the time consumed in transmitting the image set. The processor does not need to perform compositing and rendering of the image set, nor does it need to render the first gaze point information into the image set. The driver chip also does not need to parse the image set to obtain the first gaze point information, reducing the computational load consumed in displaying the images in the image set, shortening the latency of displaying the images, and realizing a low-latency perspective function. In the aforementioned display device, the first camera group is directly connected to the driver chip, and the first camera group directly sends the image set to the driver chip. Compared to the scheme where the first camera group is connected to the processor, and the first camera group sends the image set to the processor, and the processor then sends the image set to the driver chip, this reduces the time consumed by the series of calculations, compositing, and rendering processes that the image set captured by the first camera group undergoes in the processor, as well as the time consumed by the image set transmission, further reducing the latency of displaying the image.

[0108] The foregoing description provides an exemplary description of the display device provided in the embodiments of this application. The following description, in conjunction with the foregoing, further details the following description. Figure 2 The driver chip in the aforementioned display device will be described.

[0109] like Figure 2 As shown, the driver chip 203 includes an image signal processor 2031 and a display mode data acquisition module. The image signal processor 2031 includes an ISP (Image Signal Processor), used to optimize the images in the received image set to obtain an optimized image set. This process is similar to the aforementioned related content and will not be repeated here. The display mode data acquisition module is used to process the received first gaze point information to obtain display mode data corresponding to the image set. This process is similar to the aforementioned process of obtaining display mode data based on the first gaze point information and will not be repeated here.

[0110] Regarding the image signal processor 2031, this application incorporates an image signal processor (ISP) within the driver chip, enabling direct connection between the driver chip and the first camera group. This contrasts with solutions where the ISP is integrated into the first camera or processor to process images captured by the first camera. This avoids the need for the first camera group to transmit the image set to the processor for rendering, thus reducing image display latency. Furthermore, considering that the ISP in this application is solely for the perspective function of the display device, and only needs to accurately display the real-world scene while meeting the safety requirements of the display device, the ISP in the driver chip is a simplified version. It possesses functions such as noise reduction, interpolation, color space conversion, and anti-distortion processing, capable of converting images in the image set into the RGB (Red, Green, Blue) format required by the display panel. Compared to ISPs, which have numerous complex processes and functions, including display enhancement HDR (High Dynamic Range Imaging), dynamic white balance, and ATW (Auto Tracking White Balance) prediction, this reduces the computational load consumed by the ISP in processing images in the image set, thus shortening the latency of image display. Furthermore, the ISP in this application is implemented as a hardware IP circuit within the driver chip. Hardware integration within the driver chip, compared to a software-based ISP, improves the processing speed of images in the image set, further reducing the latency of image display. In addition, in this embodiment, the size of the hardware-based ISP is smaller than a preset size threshold, making the driver chip containing the ISP sufficiently small so that it can be installed on mobile devices, such as VR devices.

[0111] In some embodiments, the display mode data acquisition module includes a region information acquisition unit 2033 and a timing control unit 2034, which are connected together. The region information acquisition unit 2033 is used to convert first gaze point information into first region information; this process is similar to the aforementioned related content and will not be described again in this embodiment. The timing control unit 2034 is used to generate display mode data corresponding to the image set based on the first region information; this process is similar to the aforementioned related content and will not be described again in this embodiment.

[0112] In some embodiments, the driver chip 203 further includes a switching module 2035, which is connected to the image signal processor 2031 and the region information acquisition unit 2033, respectively. The switching module 2035 is used to switch the image source of the image received by the driver chip 203 in response to first control information sent by the processor 201. The image source includes the first camera group 202 and the processor 201. When the driver chip 203 switches the image source to the processor 201 according to the first control information, the switching module 2035 sends the image sent by the processor 201 to subsequent modules for further processing. When the driver chip 203 switches the image source to the first camera group 202 according to the first control information, the switching module 2035 receives the image set sent by the image signal processor 2031 and sends the image set to the region information acquisition unit 2033.

[0113] The architecture and workflow of the aforementioned switching module 2035 are described below.

[0114] Figure 3 This is an architecture diagram of a switching module provided in an embodiment of this application, taking the use of two sets of differential signals to transmit images as an example. Figure 3 As shown, mipi_dsi0_N, mipi_dsi0_P, mipi_dsi1_N, mipi_dsi1_P, mipi_csi0_N, mipi_csi0_P, mipi_csi1_N, and mipi_csi1_P are eight signal lines. Among them, mipi_dsi0_N, mipi_dsi0_P, mipi_csi0_N, and mipi_csi0_P form one group of differential signals, and mipi_dsi1_N, mipi_dsi1_P, mipi_csi1_N, and mipi_csi1_P form another group of differential signals. Different groups of differential signals are used to transmit different images. Within the same group, the signal lines corresponding to mipi_dsi and mipi_csi are used to transmit images from different image sources. The N and P signals corresponding to mipi_dsi or mipi_csi within the same group form a pair of differential signals. Figure 3 In the circuit, there is a MOSFET 301 on each signal line, and there is also a MOSFET (M1) 302 on the end connected to the 5V circuit.

[0115] When the first control information is 0 (indicating the display of the real scene), the M1 transistor is in the off state. At this time, the signal lines mipi_csi0_N, mipi_csi0_P, mipi_csi1_N, and mipi_csi1_P are connected to positive voltage, and the MOSFET 301 on the signal lines is in the on state. That is, the first camera group and the driver chip are in a direct connection state. The first camera group (image signal processor 2031) can send images of the real scene to the driver chip through these signal lines, realizing the transition from the first state to the second state. When the first control information is 1 (indicating the display of a virtual scene), the M1 transistor is in the ON state. At this time, the signal lines mipi_csi0_N, mipi_csi0_P, mipi_csi1_N, and mipi_csi1_P are disconnected from the positive voltage, while the signal lines mipi_dsi0_N, mipi_dsi0_P, mipi_dsi1_N, and mipi_dsi1_P are connected to the positive voltage, causing the signals on the signal lines mipi_csi0_N, mipi_csi0_P, mipi_csi1_N, and mipi_csi1_P to be pulled low to 0. Meanwhile, the MOSFET 301 on the signal lines mipi_dsi0_N, mipi_dsi0_P, mipi_dsi1_N, and mipi_dsi1_P is in the ON state, and the signals are pulled high. That is, the processor and the driver chip are in a direct connection state. The processor can send the image of the virtual scene to the driver chip through these signal lines, realizing the transition from the second state to the first state.

[0116] The driver chip 203 in this application supports not only MIPI_DSI interface access but also MIPI_CSI interface access. As will be explained later, the driver chip 203 also supports multiple MIPI_CSI interface accesses, which will not be elaborated further in this embodiment. Compared with solutions where the driver chip only supports MIPI_DSI interface access, i.e., the driver chip can only receive data sent by the processor, this application, through the aforementioned switching module 2035, allows the driver chip 203 to switch between the MIPI_DSI and MIPI_CSI interfaces. This dynamically controls whether the displayed image is a virtual scene image sent by the processor 201 or a real scene image sent by the first camera group 202, thereby enabling free and dynamic switching of image source selection and improving the flexibility of the display device. Furthermore, through the aforementioned switching function, the display device can avoid being constantly displaying a real scene. Through intelligent modulation, it can adjust and switch in real time according to user needs, ensuring that the display device always operates in a state that conforms to the current application scenario, avoiding resource waste and achieving low-power operation of the display device.

[0117] In some embodiments, the driver chip 203 further includes a switching control module 2036, which is connected to both the processor 201 and the switching module 2035. The switching control module 2036 receives control signals (such as the level of GPIO lines or interrupt signals) sent by the processor 201, parses first control information from the control signals, and sends the first control information to the switching control module 2036.

[0118] In some embodiments, the driver chip 203 further includes an image parsing module 2037, which is connected to both the switching module 2035 and the timing control unit 2034. The image parsing module 2037 processes the image sent from the processor 201 by the switching module 2035 to obtain the second gaze point information of the image, and then sends the second gaze point information to the timing control unit 2034. Correspondingly, the timing control unit 2034 is also used to generate display mode data for the corresponding image based on the second gaze point information.

[0119] In some embodiments, the driver chip 203 further includes a first cache 2038, which is connected to the region information acquisition unit 2033, the image parsing module 2037, and the display panel 204. The first cache 2038 is used to cache images sent by the region information acquisition unit 2033 or the image parsing module 2037 and send the cached images to the display panel 204.

[0120] In some embodiments, the driver chip 203 further includes a first decoding module 2039, which is connected to both the processor 201 and the switching module 2035. The first decoding module is used to receive a mipi_dsi message sent by the processor 201, parse the message to obtain an image of the virtual environment sent by the processor 201, and send the image to the switching module 2035.

[0121] In some embodiments, the driver chip 203 further includes a second decoding module 20310, which is connected to the first camera group 202 and the image signal processor 2031. The second decoding module 20310 is used to receive the mipi_csi message sent by the first camera group 202, parse the message to obtain a set of images of the real scene sent by the first camera group 202, and send the set of images to the image signal processor 2031.

[0122] In some embodiments, the driver chip 203 further includes a clock module 20311. The clock module 20311 is connected to the processor 201, the first camera group 202, the image signal processor 2031, the area information acquisition unit 2033, the image parsing module 2037, the timing control unit 2034, and the first buffer 2038. The clock module 20311 is used to receive a first synchronization signal sent by the processor 201 and send the first synchronization signal to the image signal processor 2031, the area information acquisition unit 2033, the image parsing module 2037, the timing control unit 2034, and the first buffer 2038, so that the image signal processor 2031, the area information acquisition unit 2033, the image parsing module 2037, the timing control unit 2034, and the first buffer 2038 process the image corresponding to the first synchronization signal, and cause the first buffer 2038 to send the previous frame image of the image corresponding to the first synchronization signal to the display panel 204. The clock module 20311 is also used to receive the second synchronization signal sent by the first camera group 202, and send the second synchronization signal to the image signal processor 2031, the area information acquisition unit 2033, the image parsing module 2037, the timing control unit 2034 and the first buffer 2038, so that the image signal processor 2031, the area information acquisition unit 2033, the image parsing module 2037, the timing control unit 2034 and the first buffer 2038 process the image set corresponding to the second synchronization signal, so that the second buffer 2038 sends the previous image set corresponding to the second synchronization signal to the display panel 204.

[0123] The driver chip provided in this application embodiment is connected to the processor and the first camera group respectively. It can directly receive the first gaze point information sent by the processor and the image set of the real scene sent by the first camera group. The first gaze point information can be obtained without parsing the images in the image set. Then, display mode data is generated based on the first gaze point information, which reduces the amount of computation consumed in the image display process and shortens the latency of displaying images.

[0124] The above Figure 2The illustrated display device is described using an example of a display device including a first camera group, where the first camera group includes at least one first camera. Considering that displaying full HD images involves a large amount of data, this would lead to longer processing times for the processor and higher bandwidth consumption for image transmission, resulting in longer transmission times and increased display latency. Conversely, displaying low-resolution images would negatively impact the user experience. Therefore, this application employs a high-low resolution gaze-point display method to display image sets. This allows for high-resolution display of the corresponding area in the user's gaze area and low-resolution display of the corresponding area in the non-gaze area. This reduces the processing and transmission bandwidth for image processing and transmission, shortens display latency, and improves gaze-point clarity with lower power consumption, all without affecting the user experience. The specific implementation is as follows: Figure 4 As shown.

[0125] like Figure 4 As shown, in the case where the first camera group in the display device includes multiple first cameras, the multiple first cameras include at least one narrow-angle camera 401 and at least one wide-angle camera 402. The shooting range of the wide-angle camera 402 includes the shooting range of the narrow-angle camera 401. The image set includes a first image and a second image. The first image is an image taken by the narrow-angle camera 401, and the second image is an image taken by the wide-angle camera 402.

[0126] In some embodiments, the resolution of the first image is greater than the resolution of the second image. For example, the narrow-angle camera 401 is a high-definition camera used to capture a high-definition image corresponding to the human eye's gaze point, while the wide-angle camera 402 is a low-definition camera used to capture an image covering the entire field of view for display. Accordingly, the narrow-angle camera 401 employs a small FOV camera, such as a 30° FOV camera, which can both meet the movement requirements of the human eye's gaze point and effectively reduce processing and transmission bandwidth. The wide-angle camera 402 employs a large FOV camera, enabling it to capture as much of the real-world scene as possible.

[0127] In some embodiments, this application fixes the first camera in the first camera group to the display device via a pivot structure, enabling the first camera, such as a small FOV camera, to move or rotate, thereby overcoming the field-of-view limitation of the small FOV camera and allowing it to capture as much of the real-world scene as possible within the area being viewed by the human eye. Correspondingly, the display device also includes a second camera group, comprising at least one second camera used to capture images of the user's pupils, obtaining an image of the user's pupils, and sending the image to a processor. The processor is further configured to obtain the rotation direction and angle of the first camera in the first camera group relative to the display device based on the user's pupil image, and control the first camera to rotate via the pivot structure based on the rotation direction and angle. Correspondingly, the processor sends a rotation command to a control motor or sensor connected to the first camera in the first camera group, the rotation command carrying the aforementioned rotation direction and angle. The control motor or sensor responds to the rotation command and controls the first camera in the first camera group to rotate. The rotatable first camera can be a narrow-angle camera 401 or a wide-angle camera 402; this embodiment does not limit the type of camera.

[0128] In some embodiments, the aforementioned hinge structure is fixed to the display device via a slide rail structure. The processor is further configured to obtain the translational distance of the first camera in the first camera group relative to the display device based on the user's pupil image, and control the hinge structure on which the first camera is mounted to translate according to the translational distance via the slide rail structure. This process is similar to the process of controlling the rotation of the first camera described above, and will not be repeated here.

[0129] In some embodiments, considering the limited display size of the display panel and the fact that the area the human eye focuses on, i.e., the area requiring high-definition display, generally occupies about one-third of the display panel, the aforementioned small FOV camera does not need to move a large distance or rotate a large angle; it only needs to move or rotate within a small range. Therefore, the aforementioned hinge structure can meet the movement requirements of the human eye's gaze point.

[0130] Still Figure 4As shown, when the first camera group in the display device includes two first cameras, the driver chip is further used to optimize the first image and the second image respectively, obtaining optimized first and second images, and sending the optimized first and second images to the display panel. Correspondingly, the driver chip includes two image signal processors, namely image signal processor 403 and image signal processor 404. Image signal processor 403 corresponds to the narrow-angle camera 401 and is used to optimize the first image captured by the narrow-angle camera 401, sending the optimized first image to the switching module 405. Image signal processor 404 corresponds to the wide-angle camera 402 and is used to optimize the second image captured by the wide-angle camera 402, sending the optimized second image to the switching module 405. This optimization process is similar to the process described above where the driver chip 203 optimizes the images in the received image set to obtain an optimized image set; therefore, this embodiment will not be repeated here. When there are multiple image signal processors, each image signal processor corresponds to one image source. By employing different image signal processors to process images sent from different first cameras, it is possible to ensure simultaneous processing of images from different first cameras. Furthermore, different anti-distortion processing can be applied to images from different first cameras, overcoming the problems of varying distortion levels and significant resolution differences in images from different first cameras, thereby improving the accuracy and efficiency of image optimization processing.

[0131] In some embodiments, when the display device includes two image signal processors, the switching module 405 includes two ports, each corresponding to one image signal processor, for receiving images sent by that image signal processor. When the driver chip is in the second state, the path between the switching module 405 and the area information acquisition unit 406 is open, and the switching module 405 simultaneously sends the first image and the second image to the area information acquisition unit 406.

[0132] In some embodiments, the switching module 405 is further configured to switch the image source of the image received by the driver chip in response to the first control information. The image source includes the first camera group and the processor. The switching process is the same as the above-mentioned related content, and will not be described again in this embodiment.

[0133] In some embodiments, the region information acquisition unit 406 is used to receive first gaze point information sent by the processor, a first image and a second image sent by the switching module 405, determine second region information based on the coordinates of the first gaze point indicated by the first gaze point information and the size of the first image, and send the second region information to the timing control unit 407. The second region information indicates the region on the display panel within the size range of the first image around the first gaze point. During the display of the first image and the second image, the first image is stitched onto the second image on the display panel, and the second region information also indicates the position of the first image on the second image during the display panel display process. The process by which the region information acquisition unit 406 determines the second region information is the same as the process described above for determining the first region information based on the target range, and will not be repeated here. The region information acquisition unit 406 is also used to send the first image and the second image to the first cache 408.

[0134] In some embodiments, the timing control unit 407 is used to generate display mode data corresponding to the first image and the second image based on the second region information. The process of generating this display mode data is similar to the related content described above. It should be noted that in this display mode data, the display module with the display mode set to the first display mode is the area where the first image is displayed, and the display module with the display mode set to the second display mode is the area where the second image is displayed. This ensures that the first image captured by the narrow-angle camera 401, corresponding to the gaze point information, can be displayed in high definition within the area where the human eye is focused, thus meeting the requirement for high-definition display of the human eye's gaze point.

[0135] In some embodiments, when the display device includes two first cameras, the driver chip is further configured to send the received first image, second image, and display mode data corresponding to the first and second images to the display panel. Accordingly, the display panel is further configured to display a real-world scene based on the received first image, second image, and display mode data corresponding to the first and second images. Accordingly, the first buffer 408 receives the second synchronization signal and sends the first image and second image to the display panel, and the timing control unit 407 receives the second synchronization signal and sends the display mode data corresponding to the first image and second image to the display panel.

[0136] In a display device comprising two first cameras, the first cameras typically send a first image and a second image to the processor. The processor then composites and renders the first and second images into a single image, which is then sent to the driver chip. The driver chip further analyzes this image to obtain gaze point information and executes subsequent steps based on this information. The time consumed by the processor in compositing and rendering the first and second images, as well as the time consumed by the driver chip in analyzing the images, is relatively long, resulting in a significant delay in image display.

[0137] In this application, when the display device includes two first cameras, the first cameras directly send a first image and a second image to the driver chip. The driver chip performs simple optimization processing on the first and second images, and then sends the optimized first and second images to the display panel to display the real scene. This eliminates the need for further compositing and rendering of the first and second images, thus reducing the latency of image display. Furthermore, the processor in this application directly transmits the gaze point information to the driver chip, enabling the driver chip to obtain gaze point information without parsing the images, further reducing the latency of image display.

[0138] The foregoing description provides an exemplary account of the display device and driver chip provided in the embodiments of this application. The following description, in conjunction with the foregoing, further details... Figure 4 The display device and driver chip shown are used as examples to illustrate the display method provided in the embodiments of this application, taking the display of a 1-frame virtual scene image as an example. Figure 5 This is a data interaction diagram of a display method provided in an embodiment of this application, such as... Figure 5 As shown, the method includes the following steps.

[0139] 501. In response to the first synchronization signal, the processor sends the first frame image and the first synchronization signal to the driver chip.

[0140] The first synchronization signal is sent by the cloud server or other devices. The process by which the processor sends the first frame image to the driver chip is the same as described above, and will not be repeated here. While sending the first frame image to the driver chip, the processor also... Figure 6 As indicated by the dashed line marked 1, the first synchronization signal is sent to the clock module in the driver chip.

[0141] In some embodiments, the processor has a second buffer. In response to the first first synchronization signal (Vsync-AP-0), the processor buffers the first frame image into the second buffer. In response to the second first synchronization signal (Vsync-AP-1), the processor sends the first frame image from the second buffer to the driver chip through the mipi_dsi interface.

[0142] In some embodiments, the second buffer includes a front buffer and a back buffer. In response to a first synchronization signal (Vsync-AP-0), the processor buffers the first frame image into the front buffer; in response to a second synchronization signal (Vsync-AP-1), it buffers the first frame image into the back buffer; and in response to a third synchronization signal (Vsync-AP-2), it sends the first frame image from the second buffer to the driver chip via the mipi_dsi interface. Simultaneously, it sends the third synchronization signal (Vsync-AP-2) to the clock module in the driver chip. By setting up front and back buffers, it is possible to prevent the processor's GPU (Graphics Processing Unit) rendering time from exceeding one frame time, thus preventing image tearing.

[0143] 502. The driver chip parses the first frame image based on the received first frame image and the first synchronization signal to obtain the display mode data corresponding to the first frame image.

[0144] In some embodiments, the clock module in the driver chip receives a first synchronization signal, generates an internal first synchronization signal based on the first synchronization signal, and sends the internal first synchronization signal to the first decoding module, image parsing module, first buffer, and timing control unit in the driver chip, so that the first decoding module, image parsing module, first buffer, and timing control unit process the first frame image. The internal first synchronization signal may be the same as or different from the aforementioned first synchronization signal; this embodiment does not limit this.

[0145] The process by which the various modules and units in the driver chip process the first frame image is similar to the above-mentioned related content. Specifically, the first decoding module in the driver chip decodes the MIPI_DSI message corresponding to the first frame image to obtain the first frame image, and sends the first frame image to the switching module. The switching module sends the first frame image to the image parsing module, which parses the first frame image to obtain the second gaze point information corresponding to the first frame image, sends the first frame image to the first buffer, and sends the second gaze point information to the timing control unit. The timing control unit generates display mode data for the first frame image based on the second gaze point information. This embodiment will not be described in detail here.

[0146] 503. In response to the next first synchronization signal, the processor sends the second frame image and the next first synchronization signal to the driver chip.

[0147] The process is similar to the relevant content in step 501 above, and will not be repeated here in the embodiments of this application.

[0148] 504. In response to the next first synchronization signal, the driver chip sends the first frame image and the display mode data corresponding to the first frame image to the display panel.

[0149] In some embodiments, the clock module in the driver chip receives the next synchronization signal, generates the next internal first synchronization signal based on the next first synchronization signal, and sends the next internal first synchronization signal to the first decoding module, image parsing module, first buffer, and timing control unit in the driver chip. The first buffer and timing control unit in the driver chip, in response to the next internal first synchronization signal, send the first frame image and the corresponding display mode data to the display panel.

[0150] 505. The display panel displays the real scene based on the received first frame image and display mode data.

[0151] Step 505 above is the same as the related content above, and will not be repeated here in the embodiments of this application.

[0152] The above Figure 5 The content shown is the process of the display device displaying a virtual scene. In the above process, if the second buffer includes a front buffer and a back buffer, the display device takes two frames to move the first frame image from the front buffer to the back buffer, and then sends the first frame image from the back buffer to the driver chip. The driver chip then takes one frame to refresh the display panel. In other words, the virtual scene seen by the user is at least three frames ago.

[0153] The following is in conjunction with the above. Figure 4 The display device and driver chip shown are used as examples to illustrate the display method provided in the embodiments of this application, taking the display of two sets of images of real-world scenes as an example. Figure 7 This is a data interaction diagram of a display method provided in an embodiment of this application, such as... Figure 7 As shown, the method includes the following steps.

[0154] 701. In response to the switching control signal, the processor sends first control information to the driver chip and second control information to the narrow-angle camera in the first camera group.

[0155] In this embodiment, the process by which the processor receives the switching control signal is similar to the aforementioned related content. For example, if the processor actively detects an abnormal situation, or if the user actively triggers the switching button, etc., this embodiment will not be elaborated further. In response to the switching control signal, the processor sends a corresponding control signal to the switching control module in the driver chip and sends second control information to the narrow-angle camera. This process is similar to the aforementioned related content and will not be elaborated further in this embodiment.

[0156] In some embodiments, the processor stops sending the first synchronization signal to the driver chip in response to the switching control signal.

[0157] 702. When the driver chip detects the first control information indicating that the real scene is to be displayed, it switches from the first state to the second state. The first state is the state of receiving the image sent by the processor, and the second state is the state of receiving the image set sent by the first camera group.

[0158] The process is similar to the above-mentioned related content. The switching control module receives the control signal, parses the control signal to obtain the first control information, and sends the first control information to the switching module. When the switching module detects that the first control information indicates the display of the real scene, it switches the channel in the open state to the channel corresponding to the mipi_csi interface, that is, it switches the port receiving data in the switching module to the csi port, realizing the transition from the first state to the second state.

[0159] In some embodiments, such as Figure 6 As indicated by the dashed line with reference number 2, in addition to sending the first control information to the switching module, the switching control module also sends a switching command to the clock module to control the clock module to switch the signal source of the received synchronization signal, that is, to switch from receiving the first synchronization signal to receiving the second synchronization signal, so that when the display device switches to the second state, the image source of the switching module and the signal source of the clock module are both switched to the first camera group end.

[0160] 703. The narrow-angle camera receives the second control information and sends the first second synchronization signal to the wide-angle camera and the driver chip in the first camera group.

[0161] In some embodiments, after the processor triggers the activation of the narrow-angle camera, the narrow-angle camera acts as the source, such as... Figure 6 As indicated by the dashed line numbered 3, the first second synchronization information is sent to the wide-angle camera to trigger its activation, enabling the narrow-angle camera to synchronize exposure scanning with the wide-angle camera, thus simultaneously capturing images of the real-world scene. For example... Figure 6 As indicated by the dashed line numbered 4, the narrow-angle camera also sends a first second synchronization signal to the clock module in the driver chip.

[0162] By sending a second synchronization signal to the wide-angle camera and the driver chip, synchronous control of the wide-angle camera and the driver chip can be achieved. That is, the same image is processed within a certain time (such as the time of one frame), so that the narrow-angle camera, the wide-angle camera and the driver chip keep the frames synchronized in real time, avoiding the problem of image tearing.

[0163] In some embodiments, such as Figure 6As shown by the dashed line with reference numeral 5, the narrow-angle camera also sends a first third synchronization signal to the processor so that the processor synchronously sends the first gaze point information to the driver chip. This first third synchronization signal can be the same signal as the first second synchronization signal mentioned above, or it can be a different signal. This application embodiment does not limit this.

[0164] 704. The driver chip responds to the first and second synchronization signals to maintain frame synchronization with the narrow-angle camera.

[0165] In this embodiment, the clock module in the driver chip receives a first second synchronization signal and generates a first internal second synchronization signal (Sync signal) based on the first second synchronization signal. The first internal second synchronization signal is then sent to the second decoding module, image signal processor, area information acquisition unit, first buffer, and timing control unit in the driver chip, so that the second decoding module, image signal processor, area information acquisition unit, first buffer, and timing control unit can start receiving and processing the first image sent by the narrow-angle camera and the second image sent by the wide-angle camera.

[0166] The internal second synchronization signal can be the same as or different from the aforementioned second synchronization signal; this application embodiment does not limit this.

[0167] 705. The narrow-angle camera sends the first image it has captured to the driver chip. The first image is the real-world scene captured by the narrow-angle camera.

[0168] 706. The wide-angle camera sends the captured second image to the driver chip. The second image is a real-world scene captured by the wide-angle camera.

[0169] Steps 705 to 706 are similar to the above-mentioned related content, and will not be repeated here in the embodiments of this application. It should be noted that steps 705 and 706 can be performed simultaneously, but the embodiments of this application do not limit this.

[0170] 707. The processor sends first gaze point information to the driver chip. The first gaze point information indicates the coordinates of the first gaze point. The first gaze point is the point on the display panel that is gazed at by the user during the display of the first and second images.

[0171] Step 707 is similar to the above-mentioned related content, and will not be repeated here in this embodiment. It should be noted that step 707 can be performed simultaneously with steps 705 and 706, but this embodiment does not limit this.

[0172] It should be noted that when the narrow-angle camera sends a third synchronization signal to the processor, the processor responds to the third synchronization signal by sending the first gaze point information to the driver chip. Even when the narrow-angle camera does not send a third synchronization signal to the processor, the processor can still send the first gaze point information to the driver chip every certain period of time (such as the duration of a frame) after sending the second control information to the narrow-angle camera, so that the processor can achieve frame synchronization with the narrow-angle camera, the wide-angle camera and the driver chip.

[0173] 708. The driver chip optimizes the received first and second images to obtain optimized first and second images.

[0174] Step 708 is similar to the above-mentioned related content, and will not be described again in this embodiment. It should be noted that the optimized first image and second image are stored in the first cache.

[0175] 709. The driver chip generates display mode data corresponding to the first image and the second image based on the received first gaze point information. The display mode data indicates the display mode of multiple display modules on the display panel during the display of the first image and the second image. The display clarity of the display mode of the display module located within the target range around the first gaze point is greater than the display clarity of the display mode of the display module located outside the target range around the first gaze point.

[0176] Step 709 above is similar to the related content described above, and will not be repeated here in this embodiment. It should be noted that the display mode data corresponding to the first and second images are stored in the timing control unit.

[0177] 710. The narrow-angle camera sends a second synchronization signal to the wide-angle camera and the driver chip.

[0178] In some embodiments, the narrow-angle camera sends a second synchronization signal to the wide-angle camera and the driver chip every preset time interval (e.g., one frame).

[0179] 711. In response to the second synchronization signal, the driver chip sends the optimized first image, the optimized second image, and the display mode data corresponding to the first and second images to the display panel.

[0180] Step 711 above is similar to the related content above, and will not be repeated here in this application embodiment. It should be noted that, in response to the second synchronization signal, the driver chip will also process the newly sent first image from the narrow-angle camera, the newly sent second image from the wide-angle camera, and the newly sent first gaze point information from the processor to obtain new first images, second images, and display mode data corresponding to the new first and second images. The new first and second images are stored in the first cache, and the display mode data corresponding to the new first and second images are stored in the timing control unit, thereby realizing the following... Figure 8 The assembly line operation method is shown. Figure 8 Taking a one-frame interval between two adjacent second synchronization signals as an example, after receiving the first second synchronization information (Vsync_0), within one frame, the first camera group scans and reads images. The driver chip then optimizes the images in the image set, acquires region information, and performs buffering, resulting in an optimized image set and display mode data. After receiving the second second synchronization information (Vsync_1), within one frame, the buffer in the driver chip sends the image set and display mode data to the display panel. The timing control unit in the driver chip scans the screen based on the image set and display mode data to display the real scene. Within this frame, the first camera group also scans and reads new images. The driver chip further optimizes the new image set, acquires region information, and performs buffering, resulting in a new image set and display mode data. Through this pipelined operation, end-to-end display is achieved with only a one-frame delay.

[0181] 712. The display panel displays the real scene based on the received first image, second image, and the display mode data corresponding to the first image and second image.

[0182] Step 712 above is similar to the above-mentioned related content, and will not be repeated here in the embodiments of this application.

[0183] By utilizing the low latency of the display device provided in this application and employing an assembly line operation method to display real-world scenes, the latency of image display can be further reduced.

[0184] The above-mentioned display device can be implemented as follows Figure 9 The VR headset shown above, correspondingly, the aforementioned driver chip and display method can be applied to... Figure 9 The VR headset shown is an example. Figure 9As shown, the VR headset is equipped with four first cameras, including two low-resolution wide-angle cameras and two high-resolution narrow-angle cameras. Each first camera is installed on the display device at a position corresponding to the human eyes. It can directly simulate the real scene observed by the human eye based on the captured images, avoiding further processing of the images due to parallax, reducing the amount of computation, and shortening the latency of displaying the images.

[0185] In some embodiments, Figure 9 In the VR headset shown, a set of low-resolution wide-angle cameras and high-resolution narrow-angle cameras on the left corresponds to a display module (a driver chip and a display panel), and a set of low-resolution wide-angle cameras and high-resolution narrow-angle cameras on the right corresponds to a display module. This application embodiment does not limit this.

[0186] It should be noted that the display device provided in the above embodiments is only illustrated by the division of the above functional modules when displaying real-world scenes. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiments belong to the same concept, and their specific implementation process can be found in the method embodiments, which will not be repeated here.

[0187] This application also provides a computer-readable storage medium storing at least one computer program. This computer program is loaded and executed by the processor of a display device to implement the operations performed by the display device in the display method described above. For example, the computer-readable storage medium may be ROM (Read-Only Memory), RAM (Random Access Memory), CD-ROM (Compact Disc Read-Only Memory), magnetic tape, floppy disk, and optical data storage device, etc.

[0188] This application also provides a computer program product or computer program, which includes computer program code stored in a computer-readable storage medium. A processor of the display device reads the computer program code from the computer-readable storage medium and executes the computer program code, causing the display device to perform the display methods provided in the various optional implementations described above.

[0189] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0190] The above description is merely an optional embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A display device, characterized in that, The device includes a first camera group, a processor, a driver chip, and a display panel. The first camera group and the processor are respectively connected to the driver chip, and the driver chip is connected to the display panel. The first camera group includes at least one first camera, which is used to send a set of captured images to the driver chip. The set of images includes at least one image, which is captured by the first camera of a real scene. The processor is used to send first gaze point information to the driver chip. The first gaze point information indicates the coordinates of the first gaze point, which is the point on the display panel that is gazed at by the user during the display of the image set. The driving chip is used to generate display mode data corresponding to the image set according to the received first gaze point information, and send the received image set and the display mode data corresponding to the image set to the display panel. The display mode data indicates the display mode of multiple display modules on the display panel during the display of the image set. The display clarity of the display mode of the display module located within the target range around the first gaze point is greater than the display clarity of the display mode of the display module located outside the target range around the first gaze point. The display panel is used to display a real-world scene based on the received image set and the corresponding display mode data.

2. The apparatus according to claim 1, characterized in that, The driver chip is used for: Based on the coordinates of the first gaze point indicated by the first gaze point information, a first region information is determined, wherein the first region information indicates the region on the display panel located within the target range surrounding the first gaze point; Based on the information of the first region, the display method data corresponding to the image set is generated.

3. The apparatus according to claim 1, characterized in that, The driver chip is also used to optimize the images in the received image set to obtain an optimized image set, and send the optimized image set to the display panel.

4. The apparatus according to claim 1, characterized in that, In the case where the first camera group includes multiple first cameras, the multiple first cameras include at least one narrow-angle camera and at least one wide-angle camera, the shooting range of the wide-angle camera includes the shooting range of the narrow-angle camera, the image set includes a first image and a second image, the first image is an image taken by the narrow-angle camera, and the second image is an image taken by the wide-angle camera; The driver chip is used for: Based on the coordinates of the first gaze point indicated by the first gaze point information and the size of the first image, second region information is determined, the second region information indicating the region on the display panel within the size range of the first image around the first gaze point; based on the second region information, display mode data corresponding to the first image and the second image is generated; The received first image, second image, and display mode data corresponding to the first image and second image are sent to the display panel.

5. The apparatus according to claim 4, characterized in that, The resolution of the first image is greater than the resolution of the second image; The driver chip is further configured to optimize the first image and the second image respectively, to obtain optimized first image and second image, and to send the optimized first image and second image to the display panel.

6. The apparatus according to claim 1, characterized in that, The processor is also configured to send a third image to the driver chip, the third image being an image of a virtual scene; The driving chip is also used to parse the third image to obtain second gaze point information, and based on the second gaze point information, generate display mode data corresponding to the third image. The second gaze point information indicates the coordinates of the second gaze point, which is the point on the display panel that is gazed at by the user during the display of the third image.

7. The apparatus according to claim 6, characterized in that, The display device further includes a monitoring module, which is used to send a switching control signal to the processor when a switching scene is detected. The processor is also configured to send first control information to the driver chip in response to the switching control signal; The driver chip is also used to switch from a first state to a second state when the first control information indicates that a real scene is to be displayed. The first state is the state of receiving images sent by the processor, and the second state is the state of receiving a set of images sent by the first camera group. Upon detecting that the first control information indicates the display of a virtual scene, the system transitions from the second state to the first state.

8. The apparatus according to claim 7, characterized in that, When the first control information indicates that a real scene is displayed, the processor is further configured to send second control information to the first camera group, the second control information being used to trigger the first camera group to capture the real scene.

9. The apparatus according to claim 7, characterized in that, During the processing of each frame of image sent by the processor, the processor is also used to send a first synchronization signal to the driver chip, the first synchronization signal being used to control the driver chip to process the images sent by the processor.

10. The apparatus according to claim 1, characterized in that, During the processing of each set of images sent by the first camera group, the first camera group is also used to send a second synchronization signal to the driver chip, the second synchronization signal being used to control the driver chip to process the set of images sent by the first camera group.

11. The apparatus according to claim 1, characterized in that, The first camera in the first camera group is fixed to the display device via a hinge structure; The display device further includes a second camera group, which includes at least one second camera, the second camera being used to send a user's pupil image to the processor; The processor is further configured to obtain the rotation direction and rotation angle of the first camera in the first camera group relative to the display device based on the user's pupil image, and control the first camera to rotate through the rotating shaft structure based on the rotation direction and the rotation angle.

12. The apparatus according to claim 11, characterized in that, The rotating shaft structure is fixed to the display device by a slide rail structure; The processor is further configured to obtain the translation distance of the first camera in the first camera group relative to the display device based on the user's pupil image, and control the rotating shaft structure on which the first camera is mounted to translate according to the translation distance via the slide rail structure.

13. A display method, characterized in that, The method is applied to a display device, the device including a first camera group, a processor, a driver chip, and a display panel, wherein the first camera group and the processor are respectively connected to the driver chip, the driver chip is connected to the display panel, and the first camera group includes at least one first camera. The method includes: The at least one first camera sends a set of captured images to the driver chip, the set of images including at least one image, the image being captured by the first camera of a real scene; The processor sends first gaze point information to the driver chip. The first gaze point information indicates the coordinates of the first gaze point, which is the point on the display panel that is gazed at by the user during the display of the image set. The driver chip generates display mode data corresponding to the image set based on the received first gaze point information, and sends the received image set and the display mode data corresponding to the image set to the display panel. The display mode data indicates the display mode of multiple display modules on the display panel during the display of the image set. The display clarity of the display mode of the display module located within the target range around the first gaze point is greater than the display clarity of the display mode of the display module located outside the target range around the first gaze point. The display panel displays the real-world scene based on the received image set and the corresponding display mode data.

14. A driver chip, characterized in that, The driver chip includes a display mode data acquisition module; The display mode data acquisition module is used to generate display mode data corresponding to the received image set based on the received first gaze point information. The first gaze point information indicates the coordinates of the first gaze point, which is the point on the display panel that is gazed at by the user during the display of the image set. The display mode data indicates the display mode of multiple display modules on the display panel during the display of the image set. The display clarity of the display mode of the display module located within the target range around the first gaze point is greater than the display clarity of the display mode of the display module located outside the target range around the first gaze point.

15. The driver chip according to claim 14, characterized in that, The display mode data acquisition module includes a region information acquisition unit and a timing control unit; The region information acquisition unit is used to determine the first region information based on the coordinates of the first gaze point indicated by the first gaze point information. The first region information indicates the region on the display panel located within the target range around the first gaze point. The timing control unit is used to generate display mode data corresponding to the image set based on the first region information.

16. The driver chip according to claim 14, characterized in that, The driver chip also includes an image signal processor; The image signal processor is used to optimize the images in the received image set to obtain the optimized image set.

17. The driver chip according to claim 14, characterized in that, In the case where there are multiple image signal processors, each image signal processor corresponds to a first camera in the first camera group.

18. The driver chip according to claim 14, characterized in that, The driver chip also includes a switching module; The switching module is used to switch the image source of the image received by the driver chip in response to the first control information. The image source includes the first camera group and the processor.

19. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store at least one computer program for performing the method of claim 13.

20. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the method as described in claim 13.

Images