Intelligent glasses, synchronous display method and medium

Abstract

The application provides a kind of smart glasses, synchronous display method and medium, first processing unit in the smart glasses is connected to first display screen via first MIPI-DSI interface, and second processing unit is connected to second display screen via second MIPI-DSI interface.First processing unit is configured to generate the timing of first reference signal for output refreshed video data, according to first reference signal, the refreshed video data is transmitted to first display screen via first MIPI-DSI interface for display, and first reference signal is transmitted to second processing unit via GPIO interface.Wherein, second processing unit is configured to receive first reference signal, generate the timing of second reference signal for output refreshed video data based on first reference signal, according to second reference signal, the refreshed video data is transmitted to second display screen via second MIPI-DSI interface for display, so that first display screen and second display screen display video data with synchronous frame start time.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of smart glasses, in particular to a smart glass, a synchronous display method and a medium. BACKGROUND

[0002] With the progress of society and the improvement of people's living standards, the market of AR / VR smart glasses gradually rises. The augmented reality (AR) / virtual reality (VR) head-mounted display (HMD) can present images to users through a display screen, giving users an immersive experience. The head-mounted display for presenting images / videos to users is composed of a left-eye display screen and a right-eye display screen. In an existing technology, the left-eye and right-eye display screens are connected to the same master control chip and controlled by the same clock. However, this requires the left and right eyes of the head-mounted display to have a video connection, which restricts the structure of the glasses. The long connection between the master control chip and the display screen may also interfere with the wireless reception of image / video data. In addition, the load of the single master control chip is too large, and the risk of failure may also increase. SUMMARY

[0003] In view of the above technical problems in the prior art, the present application is proposed. The present application aims to provide a smart glass, a synchronous display method and a medium, which can shorten the length of the connection between the master control chip and the display screen, reduce the interference with wireless reception, and enable the first display screen and the second display screen to display synchronously.

[0004] According to a first aspect of the present application, there is provided a smart glasses comprising a first glasses part and a second glasses part, the first glasses part comprising a first processing unit, a first wireless communication unit and a first display screen without frame image buffer, the second glasses part comprising a second processing unit, a second wireless communication unit and a second display screen without frame image buffer, wherein the first display screen comprises a first display driver and the second display screen comprises a second display driver. The first wireless communication unit and the second wireless communication unit are each configured to receive video data from another device. The first processing unit is connected to the first display screen via a first MIPI-DSI interface, and the second processing unit is connected to the second display screen via a second MIPI-DSI interface. The first processing unit is configured to generate a first reference signal for timing of outputting refreshed video data, transmit refreshed video data to the first display screen for display via the first MIPI-DSI interface according to the first reference signal, and transmit the first reference signal to the second processing unit via a GPIO interface. The second processing unit is configured to receive the first reference signal, generate a second reference signal for timing of outputting refreshed video data based on the first reference signal, transmit refreshed video data to the second display screen for display via the second MIPI-DSI interface according to the second reference signal, so that the first display screen and the second display screen display video data with synchronized frame start time.

[0005] According to a second aspect of the present application, a method for synchronously displaying of smart glasses is provided, comprising providing a first glasses part and a second glasses part connected or integrated with each other, so that the first glasses part is used for wearing on the eye part of one side of left and right sides and the second glasses part is used for wearing on the eye part of the other side of left and right sides. A first processing unit, a first wireless communication unit and a first display screen without frame image buffer are equipped in the first glasses part, wherein the first display screen comprises a first display driver. A second processing unit, a second wireless communication unit and a second display screen without frame image buffer are equipped in the second glasses part, wherein the second display screen comprises a second display driver. The first processing unit is connected to the first display screen via a first MIPI-DSI interface, and the second processing unit is connected to the second display screen via a second MIPI-DSI interface. Video data from another device is received by the first wireless communication unit and the second wireless communication unit respectively. The first processing unit is used to generate a first reference signal for timing of output refresh video data. Refresh video data is transmitted to the first display screen for display via the first MIPI-DSI interface according to the first reference signal. The first reference signal is transmitted to the second processing unit via a GPIO interface. The second processing unit is used to receive the first reference signal, generate a second reference signal for timing of output refresh video data based on the first reference signal, and transmit refresh video data to the second display screen for display via the second MIPI-DSI interface according to the second reference signal, so that the first display screen and the second display screen display video data with synchronous frame start time.

[0006] Compared with the prior art, the embodiment of the present application has the following beneficial effects:

[0007] According to the smart glasses of the embodiment of the present application, the processing unit, the display screen without the frame image buffer and the first wireless communication unit are arranged in each of the first and second glasses parts, so that each of the glasses parts can receive the video data of another device via the respective first wireless communication unit, and the video data is processed by the respective processing unit independently, so that the display screen of each of the glasses parts can display the respective video data respectively but synchronously. The smart glasses of the embodiment of the present application are processed by the respective processing unit, which reduces the load of the single processing unit or the master chip, shortens the length of the connection line between the master chip and the display screen, and can reduce the connection line between the first and second glasses parts, so that the smart glasses have a more flexible structure and less interference in wireless reception of the video data. The display screen of each of the glasses parts of the smart glasses of the embodiment of the present application does not contain the frame image buffer, and the timing of transmitting the refreshed video data to the first and second glasses parts by the first and second reference signals respectively, so that the first and second display screens display the video data with the synchronous frame start time, thereby avoiding the adverse experience caused by the out-of-sync of the first and second display screens, and making the presented picture have stronger stereoscopic effect and more natural picture, greatly improving the use experience of the wearer of the smart glasses.

[0008] The above description is only a summary of the technical solutions of the present application. In order to more clearly understand the technical means of the present application, the specific embodiments of the present application can be implemented according to the content of the specification, and in order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the following specific embodiments of the present application are described. BRIEF DESCRIPTION OF DRAWINGS

[0009] In the drawings, which are not necessarily drawn to scale, like numerals can describe similar components in different views. Like numerals having different letter suffixes can represent different instances of similar components. The drawings illustrate generally, by way of example, various embodiments discussed herein, and are not intended to limit the disclosure to the embodiments depicted. Such embodiments are illustrative and exemplary, and not intended to be exhaustive or exclusive, of the disclosure.

[0010] Fig. 1(a) shows a partial composition schematic diagram of the smart glasses according to the embodiment of the present application.

[0011] Fig. 1(b) shows a schematic diagram of the first and second glasses parts of the smart glasses according to the embodiment of the present application displaying the video data synchronously.

[0012] Figure 2A schematic diagram showing the smart glasses according to an embodiment of the present application synchronously displaying video data based on the first reference signal and the second reference signal is shown.

[0013] Figure 3 Another schematic diagram showing the smart glasses according to an embodiment of the present application synchronously displaying video data based on the first reference signal and the second reference signal is shown.

[0014] Figure 4 Still another schematic diagram showing the smart glasses according to an embodiment of the present application synchronously displaying video data based on the first reference signal and the second reference signal is shown.

[0015] Figure 5 A flow chart showing a synchronously displaying method of the smart glasses according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0016] In order to make the skilled in the art better understand the technical solutions of the present application, the present application is described in detail below in combination with the drawings and specific embodiments. The embodiments of the present application are further described in detail below in combination with the drawings and specific embodiments, but not as a limitation to the present application.

[0017] The "first", "second" and similar words used in the present application do not represent any order, quantity or importance, but are only used to distinguish. The "including" or "containing" and similar words used in the present application mean that the elements before the word cover the elements listed after the word, and do not exclude the possibility of also covering other elements. In the present application, the arrows shown in the figure of each step are only an example of the execution order, but not a limitation, and the technical solutions of the present application are not limited to the execution order described in the embodiments. Each step in the execution order can be combined, can be decomposed, can be exchanged in order, as long as the logical relationship of the execution content is not affected.

[0018] All the terms used in the present application (including technical terms or scientific terms) are the same as the meanings understood by the ordinary skilled in the art to which the present application belongs, unless otherwise specifically defined. It should also be understood that the terms defined in the general dictionary should be interpreted as having meanings consistent with their meanings in the context of the relevant art, and should not be interpreted in an idealized or excessively formalized sense, unless specifically defined here. The technology, methods and devices known to the ordinary skilled in the relevant art can not be discussed in detail, but in appropriate cases, the technology, methods and devices should be considered as part of the specification.

[0019] According to the embodiments of the present application, a kind of smart glasses, for example, it can include first glasses and second glasses, wherein each glasses in first glasses and second glasses respectively includes processing unit, display screen without containing frame image buffer and first wireless communication unit etc., and corresponding steps in the synchronous display method of smart glasses according to various embodiments of the present application are respectively executed by each component of each glasses.

[0020] The present application provides a kind of smart glasses. Figure 1 (a) shows the partial component schematic diagram of smart glasses according to the embodiments of the present application. As shown in Figure 1 (a), the smart glasses include first glasses 10 and second glasses 11. Further, the first glasses 10 includes first processing unit 101, first wireless communication unit 102 and first display screen 103 without containing frame image buffer (hereinafter referred to as first display screen). Correspondingly, the second glasses 11 includes second processing unit 111, second wireless communication unit 112 and second display screen 113 without containing frame image buffer (hereinafter referred to as second display screen). Wherein, the first display screen 103 includes first display driver 104 and the second display screen 113 includes second display driver 114.

[0021] Specifically, the first processing unit 101 and second processing unit 111 can be processing components including one and more general-purpose processors, such as microprocessor, central processing unit (CPU), graphics processing unit (GPU) etc. More specifically, the processing component can be complex instruction set computing (CISC) microprocessor, reduced instruction set computing (RISC) microprocessor, very long instruction word (VLIW) microprocessor, processor running other instruction sets or processor running combination of instruction sets. The processing component can also be one or more special-purpose processing devices, such as application specific integrated circuit (ASIC), field programmable gate array (FPGA), digital signal processor (DSP), system on chip (SoC) etc.

[0022] The first wireless communication unit 102 and second wireless communication unit 112 can be Bluetooth module, WiFi module, or other any communication module capable of supporting wireless transmission of video data, which is not limited in the present application.

[0023] For example, the first display screen 103 and the second display screen 113 can be a Liquid Crystal Display (LCD), a Liquid Crystal on Silicon (LCOS), a Digital Light Processing (DLP) display, or other types or forms of micro-displays that cannot emit light by themselves, etc., which can be a flexible screen or a rigid screen (i.e., a non-flexible screen). It can also be a Light Emitting Diode (LED) display, an Organic Light-Emitting Diode (OLED) display, or other types or forms of micro-displays that can emit light by themselves, etc., which can be a flexible screen or a rigid screen (i.e., a non-flexible screen), without limitation.

[0024] Further, the first wireless communication unit and the second wireless communication unit are each configured to receive video data from another device. For example, the first wireless communication unit 102 of the first glasses part 10 and the second wireless communication unit 112 of the second glasses part 11 respectively receive video data from another device 2 shown in FIG. 1(a). The other device 2 can be a smart phone, a pad, a computer, a portable smart assistant, a cloud server, or the like, without limitation.

[0025] In the embodiments of the present application, the first processing unit 101 is connected to the first display screen 103 via a first MIPI-DSI interface (MIPI-DSI is a serial interface applied to display technology), and the second processing unit 111 is connected to the second display screen 113 via a second MIPI-DSI interface. The first display screen 103 and the second display screen 113 do not contain a frame image buffer and belong to a video mode display screen. For a video mode display screen, the MIPI (Mobile Industry Processor Interface) (DSI is one of them) bus controller between each processing unit and the corresponding display screen sends a pixel data stream and a control signal to the display screen in the form of a message. In the video mode, the display screen needs to be refreshed continuously. Whether the data in the frame image buffer in the processing unit is updated or not, the MIPI-DSI master always sends the pixel data stream to the display screen at a certain refresh rate. The display screen in the video mode does not contain a frame image buffer, and as long as the pixel data stream in the processing unit is sent to the display screen, the display screen displays the video data immediately.

[0026] In various embodiments of the present application, the first eyeglass part and the second eyeglass part can be replaced with each other, for example, the first eyeglass part can be the second eyeglass part, and the second eyeglass part can also be the first eyeglass part. The synchronization display mode between the first eyeglass part 10 and the second eyeglass part 11 of the smart eyeglass shown in FIG. 1(b) is taken as an example.

[0027] In particular, the first processing unit is configured to generate a first reference signal for outputting the timing of the refreshed video data, and transmit the refreshed video data to the first display screen via the first MIPI-DSI interface for display according to the first reference signal. As shown in FIG. 1(b), the first processing unit 101 comprises a timing controller 105 and a frame image buffer 107. The video data received from the first wireless communication unit 102 is stored in the frame image buffer 107, so as to constantly update the video data in the frame image buffer 107. Similarly, the second processing unit 111 also comprises a timing controller 115 and a frame image buffer 117. The second wireless communication unit 112 updates and stores the received video data in the frame image buffer 117. Once the video data is stored in the frame image buffer 107 of the first processing unit 101, the timing controller 105 can take out the data from the frame image buffer 107 based on a certain timing signal (clock signal) and refresh to the first display screen 103. That is, the timing controller 105 is used to control the time of refreshing the video data to the first display screen 103. The first processing unit 101 generates a first reference signal for outputting the timing of the refreshed video data based on the timing of the first processing unit 101 to refresh the video data. The first processing unit 101 transmits the refreshed video data to the first display driver 108 in the first display screen 103 via the first MIPI-DSI interface 106 according to the first reference signal, and the first display driver 108 can display the refreshed video data on the first display screen 103.

[0028] Further, the first processing unit 101 transmits the first reference signal to the second processing unit 111 via a GPIO (General-purpose input / output) interface. That is, the first processing unit 101 of the first glasses part 10 can transmit the first reference signal to the second processing unit 111 of the second glasses part 11 by means of wired connection. That is, the first processing unit 101 of the first glasses part 10 can be further configured to transmit the first reference signal to the second processing unit 111 of the second glasses part 11 by means of wired connection. The wired connection for transmitting the first reference signal can be a signal line specially arranged between the first processing unit 101 of the first glasses part 10 and the second processing unit 111 of the second glasses part 11, or can be an existing idle signal line configured to transmit the first reference signal. By transmitting the reference signal required for synchronization between the first glasses part 10 and the second glasses part 11 by means of wired connection, the time delay is smaller, the timing configuration of subsequent signals is more convenient, the consistency and synchronization are easier to achieve, and the overall time delay is smaller.

[0029] The second processing unit 111 in the second glasses part 11 is configured to receive the first reference signal and generate a second reference signal for outputting the timing of the refreshed video data based on the first reference signal. The first reference signal and the second reference signal can be the same or different. Each reference signal such as the first reference signal and the second reference signal can be an applicable rising edge, falling edge or narrow pulse trigger signal. By means of the GPIO interface, the synchronization display of the video data received wirelessly by the first glasses part and the second glasses part is facilitated, the scheme is simplified, the software and hardware overhead for synchronization by wireless reception between the first glasses part and the second glasses part is reduced, the interference of the wireless connection between the left and right eyes on the reception of wireless video by the left and right eyes is reduced, and the occupation of the time slot for the reception of wireless video by the left and right eyes is avoided.

[0030] The second processing unit 111 transmits the refreshed video data to the second display screen 113 via the second MIPI-DSI interface 116 for display according to the second reference signal, so that the first display screen 103 and the second display screen 113 display video data with synchronized frame start times. The timing controller 115 in the second processing unit 111 generates a second reference signal for the timing of outputting the refreshed video data based on the received first reference signal. Based on the second reference signal, the video data is transmitted to the second display driver 118 in the second display screen 113 via the second MIPI-DSI interface 116, and the second display driver 118 can display the video data on the second display screen 113. Through the coordinated setting of the first reference signal and the second reference signal, the first display screen 103 and the second display screen 113 can display video data with synchronized frame start times.

[0031] When the display screens of the first eyeglass part and the second eyeglass part refresh video data based on the coordinated first reference signal and second reference signal respectively, the first eyeglass part and the second eyeglass part can be refreshed synchronously or in the same row due to the coordinated first reference signal and second reference signal, so that the video or image on the display screens of the two eyeglass parts has stronger stereoscopic effect, is more natural and real, and the user has better wearing experience.

[0032] In some embodiments, the first reference signal indicates a frame start time for the first display screen to display video data, so that the first display screen displays video data from the frame start time, which not only ensures the integrity of the video data, but also enables the first processing unit to continuously transmit video data to the first display screen based on the timing, avoiding the display screen from freezing. Further, the first processing unit is configured to transmit the first reference signal to the second processing unit via the GPIO interface in advance of the frame start time by a first time period, and the first time period at least includes the time consumed for transmitting the first reference signal via the GPIO interface, so as to further ensure that the first display screen and the second display screen can display video data synchronously. The first processing unit of the first eyeglass part often needs a period of time to transmit the first reference signal to the second processing unit of the second eyeglass part. Figure 2As shown, assuming that the first processing unit of the first glasses part transmits the first reference signal to the second processing unit at time t1, after a first time period, the video data is refreshed to the first display screen at the frame start time of time t2. The first reference signal is transmitted to the second processing unit via the GPIO interface, and after a time period, the second processing unit receives the video data and displays the video data received by the second processing unit to the second display screen at the frame start time of time t2. In this way, the first processing unit transmits the first reference signal to the second processing unit in advance of the frame start time by the first time period, so as to ensure that the second processing unit receives the first reference signal before the first processing unit reaches the frame start time, thereby ensuring that the first display screen and the second display screen display the video data at the synchronous frame start time.

[0033] In some embodiments, the second processing unit also has a certain time consumption in generating the second reference signal after receiving the first reference signal, and in this case, the first time period includes the time consumption in transmitting the first reference signal via the GPIO interface and the time consumption in generating the second reference signal based on the first reference signal. For example Figure 3 As shown, the first glasses part transmits the first reference signal to the second processing unit at time t1, after a first time period, the video data is refreshed to the first display screen at the frame start time of time t2. The first reference signal is transmitted to the second processing unit via the GPIO interface, and after a time period, the second processing unit receives the video data and displays the video data received by the second processing unit to the second display screen at the frame start time of time t2. In this way, the first processing unit transmits the first reference signal to the second processing unit in advance of the frame start time by the first time period, so as to ensure that the second processing unit receives the first reference signal before the first processing unit reaches the frame start time, thereby ensuring that the first display screen and the second display screen display the video data at the synchronous frame start time. Wherein, T1, T2 can be a fixed value, or can be configured, or can be obtained by testing in a software and hardware implementation. This embodiment is only an example and does not constitute a specific limitation to the protection scope.

[0034] In some embodiments, the SOT (Start of Transmission) signals of the first MIPI-DSI interface and the second MIPI-DSI interface are synchronized, enabling the first processing unit and the second processing unit to synchronously display video data to the first display screen and the second display screen. The first reference signal and the second reference signal are either synchronized or have a delay between them. For example, when the transmission time of the first reference signal to the second processing unit is negligible and no other processing is performed on the first reference signal, the first and second reference signals are synchronized. Simultaneously, the SOT signals of the first and second MIPI-DSI interfaces are synchronized, allowing the first and second display screens to synchronously display video data. Furthermore, a delay is provided between the first and second reference signals to ensure that even if the transmission of the first reference signal is time-consuming or has other time delays, the first processing unit and the second processing unit can synchronously refresh video data to their respective display screens.

[0035] Specifically, a first delay is preset between the first reference signal and the SOT signal of the first MIPI-DSI interface, a second delay is preset between the second reference signal and the SOT signal of the second MIPI-DSI interface, and a third delay is preset between the first reference signal and the second reference signal, such that the third delay is equal to the difference between the first delay and the second delay, thereby ensuring that the first display screen and the second display screen can display video data with synchronized frame start times. Figure 4 As shown, there is a preset delay of T3 between the first reference signal of the first eyeglass unit and the SOT signal of the first MIPI-DSI interface, a preset delay of T5 between the second reference signal generated by the second eyeglass unit and the SOT signal of the second MIPI-DSI interface, and a preset delay of T4 between the first reference signal and the second reference signal. The sum of T4 and T5 is equal to T3, so that the display screens of the first eyeglass unit and the display screens of the second eyeglass unit can display video data separately but synchronously.

[0036] Through the above process, the displays of each eyeglass are synchronized (display synchronization), which makes the videos or images on the displays of the left and right eyeglasses more three-dimensional, the picture more natural and realistic, and greatly improves the user's wearing experience.

[0037] In some embodiments, a second wireless communication unit can be provided in each of the first eyeglass part and the second eyeglass part, wherein the second wireless communication unit is a Bluetooth module or a WiFi module. The second wireless communication unit can be used to transmit audio data, video data, image data or other control commands from another device, etc. In some embodiments, the second wireless communication unit can be the same as the first wireless communication unit, or can be another wireless communication unit. In some embodiments, the clock signal of the second wireless communication unit of the first eyeglass part is synchronized with the clock signal of the second wireless communication unit of the second eyeglass part. Specifically, taking the second wireless communication unit as a Bluetooth module as an example, the two Bluetooth modules can receive Bluetooth data from the same smart device, and can be synchronized with the Bluetooth clock of the smart device through the related processing of the Bluetooth Access Code or part of the Access Code of the physical layer, so that the Bluetooth clocks of the two Bluetooth modules are synchronized with the Bluetooth clock of the smart device, and thus the clocks of the two Bluetooth modules are also synchronized. In the case where the second wireless communication units are both WiFi modules, similarly, the two WiFi modules can receive WiFi data from the same smart device, and through the reception of the periodic WiFi Beacon, the WiFi clocks of the two WiFi modules can be synchronized with the WiFi clock of the smart device, and thus the clocks of the two WiFi modules are also synchronized. In this way, the video data can be synchronized to update the frame image buffer in the first processing unit and the second processing unit.

[0038] In addition, the smart glasses according to the embodiments of the present application can also be provided with a DLNA module in the first eyeglass part and the second eyeglass part, respectively, wherein the DLNA protocol used by the DLNA module is proposed by Sony, Intel, Microsoft, etc. for the first time, and the full name is DIGITAL LIVING NETWORK ALLIANCE, which aims to solve the interconnection and intercommunication of wireless networks and wired networks of personal PCs, consumer electronics and mobile devices. For example, it can be used to solve the interconnection and intercommunication between computers and other electronic products, such as mobile phones and tablets, through wireless or wired networks.

[0039] Further, the first wireless communication unit is further configured to establish a first DLNA connection with the other device, receive a first control instruction from the other device based on the first DLNA connection and execute an instruction of the first control instruction. And the first wireless communication unit establishes a second DLNA connection with the second wireless communication unit, sends a second control instruction to the second wireless communication unit based on the second DLNA connection. The second wireless communication unit is further configured to receive the second control instruction based on the second DLNA connection and execute an instruction of the second control instruction. The first and second glasses parts of the smart glasses respectively acquire video data required for display from the other device by using the DLNA protocol. And, by using the second DLNA connection, the first wireless communication unit transmits the second control instruction to the second wireless communication unit, wherein the second control instruction can be timing-related information related to refreshing the video data, so that the second processing unit generates a second reference signal when receiving a first reference signal, and the display screen of the first glasses part and the display screen of the second glasses part can synchronously display the video data.

[0040] In some embodiments, the first control instruction and the second control instruction include an address of the video data, and when the first wireless communication unit and the second wireless communication unit acquire the address of the video data, each of the first wireless communication unit and the second wireless communication unit is configured to acquire respective video data from the DMS end based on the address of the video data, and store the respective video data in a respective frame image buffer. Wherein the video data acquired by the first wireless communication unit and the second wireless communication unit can be the same or different. The first DLNA connection and the second DLNA connection can be established based on a WIFI channel, or can be established based on other standard or private wireless transmission protocols, which are not limited in the present application. The DMS (Digital Media Server) can provide the ability of acquiring, recording, storing and serving as a source of media files. The DMS end can be located locally in the other device, or can be located in a cloud server outside the other device, which is not limited in the present application.

[0041] Figure 5 A flow chart of a synchronous display method of smart glasses according to an embodiment of the present application is shown. In step 501, a first glasses part and a second glasses part connected or integrated with each other are provided, so that the first glasses part is used for wearing on the eye part of one side of left and right sides, and the second glasses part is used for wearing on the eye part of the other side of left and right sides. The first glasses part and the second glasses part can be replaced with each other in various embodiments.

[0042] In step 502, a first processing unit, a first wireless communication unit and a first display screen without a frame image buffer are equipped in the first glasses part, wherein the first display screen comprises a first display driver. Similarly, in step 503, a second processing unit, a second wireless communication unit and a second display screen without a frame image buffer are equipped in the second glasses part, wherein the second display screen comprises a second display driver. The first display screen and the second display screen do not contain a frame image buffer, and the video data is refreshed to the respective display screen as soon as it is received.

[0043] In step 504, the first processing unit is connected to the first display screen via a first MIPI-DSI interface, and the second processing unit is connected to the second display screen via a second MIPI-DSI interface. In step 505, video data from another device is received by the first wireless communication unit and the second wireless communication unit respectively, and the received video data is written into the frame image buffer of the first processing unit and the second processing unit respectively, so that the timing controller can conveniently obtain the corresponding video data from the frame image buffer when it is necessary to refresh the video data to the display.

[0044] In step 506, the first processing unit is used to generate a first reference signal for the timing of outputting the refreshed video data, the refreshed video data is transmitted to the first display screen for display via the first MIPI-DSI interface according to the first reference signal, and the first reference signal is transmitted to the second processing unit via a GPIO interface.

[0045] In step 507, the second processing unit is used to receive the first reference signal, generate a second reference signal for the timing of outputting the refreshed video data based on the first reference signal, and transmit the refreshed video data to the second display screen for display via the second MIPI-DSI interface according to the second reference signal, so that the first display screen and the second display screen display the video data with synchronized frame start times. The timing of transmitting the refreshed video data to the first glasses part and the second glasses part by the first reference signal and the second reference signal respectively can make the first display screen and the second display screen display the video data with synchronized frame start times, thereby avoiding the adverse experience caused by the picture asynchronization of the first display screen and the second display screen, and also enabling the presented picture to have stronger stereoscopic effect, more natural picture and greatly improved use experience of the smart glasses wearer.

[0046] In some embodiments, the first reference signal indicates a frame start time for the first display panel to display the video data, and the first processing unit transmits the first reference signal to the second processing unit via the GPIO interface in advance of the frame start time by a first time period, the first time period including at least a time consumption for transmitting the first reference signal via the GPIO interface to ensure that the first display panel and the second display panel can display the video data synchronously.

[0047] In some embodiments, the first time period includes a time consumption for transmitting the first reference signal via the GPIO interface as well as a time consumption for generating the second reference signal based on the first reference signal, by comprehensively considering the time consumption for transmitting the first reference signal and the time consumption for generating the second reference signal based on the first reference signal, the accuracy for the first display panel and the second display panel to display the video data synchronously is improved.

[0048] In some embodiments, the SOT signals of the first MIPI-DSI interface and the second MIPI-DSI interface are synchronous, the first reference signal and the second reference signal are synchronous, or are provided with a delay from each other. The SOT signals of the two MIPI-DSI interfaces are synchronous, so that the first processing unit and the second processing unit can refresh the video data to the respective display panels synchronously.

[0049] In some embodiments, a first delay is provided between the first reference signal and the SOT signal of the first MIPI-DSI interface, a second delay is provided between the second reference signal and the SOT signal of the second MIPI-DSI interface, and a third delay is provided between the first reference signal and the second reference signal, the third delay being equal to the difference between the first delay and the second delay, so that the first display panel and the second display panel can display the video data with synchronous frame start times.

[0050] Furthermore, although example embodiments have been described herein, the scope includes any and all embodiments having equivalent elements, modifications, omissions, combinations (e.g., of

[0051] The above description is intended to be illustrative, and not restrictive. For example, the above-described examples (or one or more aspects thereof) can be used in combination with each other. Other embodiments can be used, which will be apparent to those of ordinary skill in the art upon reviewing the above description. Additionally, the various features described above can be grouped together or divided into separate features for the purpose of simplifying the present disclosure. This should not be interpreted as a requirement to practice any claim in its full scope unless the claim does not inherently share in common a characteristic with at least one other claim. To the contrary, claims can be practiced in a variety of combinations with each other, even if not expressly disclosed in a specific embodiment. The scope of the application should be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled. The disclosures of the publications discussed above and throughout the text are hereby incorporated by reference in their entireties.

[0052] The above embodiments are only exemplary embodiments of the present application, not intended to limit the present application, and the protection scope of the present application is defined by the claims. Those skilled in the art can make various modifications or equivalent replacements to the present application within the spirit and protection scope of the present application, and such modifications or equivalent replacements should also be considered to fall within the protection scope of the present application.

Claims

1. A smart glasses, the smart glasses comprising a first eyeglass portion and a second eyeglass portion, characterized in that, The first eyeglass unit includes a first processing unit, a first wireless communication unit, and a first display screen without a frame image buffer; the second eyeglass unit includes a second processing unit, a second wireless communication unit, and a second display screen without a frame image buffer; wherein the first display screen includes a first display driver and the second display screen includes a second display driver; and the first and second display screens are display screens in video mode. The first wireless communication unit and the second wireless communication unit are each configured to receive video data from another device; The first processing unit is connected to the first display screen via the first MIPI-DSI interface, and the second processing unit is connected to the second display screen via the second MIPI-DSI interface. Each MIPI-DSI interface continuously sends pixel data streams to the corresponding display screen at a certain refresh rate. As soon as the pixel data stream in the processing unit is sent to the display screen, the display screen immediately displays video data. The first processing unit is configured to: generate a first reference signal for timing the output of refreshed video data; transmit the refreshed video data to the first display screen via the first MIPI-DSI interface according to the first reference signal for display; and transmit the first reference signal to the second processing unit via a GPIO interface. The second processing unit is configured to: receive the first reference signal; generate a second reference signal based on the first reference signal for timing the output of refreshed video data; and transmit the refreshed video data to the second display screen via the second MIPI-DSI interface according to the second reference signal for display, so that the first display screen and the second display screen display the video data with synchronized frame start times.

2. The smart glasses according to claim 1, characterized in that, The first reference signal indicates the frame start time for the first display screen to display video data, and the first processing unit is configured to transmit the first reference signal to the second processing unit via a GPIO interface a first time period earlier than the frame start time, wherein the first time period includes at least the time consumed by transmitting the first reference signal via the GPIO interface.

3. The smart glasses according to claim 2, characterized in that, The first time period includes the time taken to transmit the first reference signal via the GPIO interface, together with the time taken to generate the second reference signal based on the first reference signal.

4. The smart glasses according to claim 1, characterized in that, The SOT signals of the first MIPI-DSI interface and the second MIPI-DSI interface are synchronized, and the first reference signal and the second reference signal are synchronized, or there is a delay between them.

5. The smart glasses according to claim 4, characterized in that, A first delay is preset between the first reference signal and the SOT signal of the first MIPI-DSI interface, a second delay is preset between the second reference signal and the SOT signal of the second MIPI-DSI interface, and a third delay is preset between the first reference signal and the second reference signal, such that the third delay is equal to the difference between the first delay and the second delay.

6. The smart glasses according to claim 1, characterized in that, The first wireless communication unit is further configured as follows: Establish a first DLNA connection with the other device, receive a first control command from the other device based on the first DLNA connection, and execute the instructions of the first control command; and The first wireless communication unit establishes a second DLNA connection with the second wireless communication unit, and sends a second control command to the second wireless communication unit based on the second DLNA connection; The second wireless communication unit is further configured to receive the second control command and execute the instruction of the second control command based on the second DLNA connection.

7. The smart glasses according to claim 6, characterized in that, The first control command and the second control command include the address of the video data; and When the first wireless communication unit and the second wireless communication unit acquire the address of the video data, each of the first wireless communication unit and the second wireless communication unit is configured to: acquire their respective video data from the DMS terminal based on the address of the video data, and store their respective video data in their respective frame image buffers.

8. A method for synchronous display in smart glasses, characterized in that, include: A first eyeglass part and a second eyeglass part are provided to be connected or integrated with each other, such that the first eyeglass part is used to be worn on one eye of the left and right sides and the second eyeglass part is used to be worn on the other eye of the left and right sides. The first eyeglass unit is equipped with a first processing unit, a first wireless communication unit, and a first display screen that does not include a frame image buffer, wherein the first display screen includes a first display driver; The second glasses unit is equipped with a second processing unit, a second wireless communication unit, and a second display screen that does not include a frame image buffer, wherein the second display screen includes a second display driver, and the first display screen and the second display screen are display screens in video mode; The first processing unit is connected to the first display screen via the first MIPI-DSI interface, and the second processing unit is connected to the second display screen via the second MIPI-DSI interface. Each MIPI-DSI interface continuously sends pixel data streams to the corresponding display screen at a certain refresh rate. As soon as the pixel data stream in the processing unit is sent to the display screen, the display screen immediately displays video data. The first wireless communication unit and the second wireless communication unit respectively receive video data from another device; Using the first processing unit, a first reference signal for timing the output refreshed video data is generated. Based on the first reference signal, the refreshed video data is transmitted to the first display screen via the first MIPI-DSI interface for display. The first reference signal is transmitted to the second processing unit via the GPIO interface. Using the second processing unit, the first reference signal is received, and a second reference signal for timing the output of refreshed video data is generated based on the first reference signal. The refreshed video data is transmitted to the second display screen via the second MIPI-DSI interface according to the second reference signal for display, so that the first display screen and the second display screen display the video data with synchronized frame start times.

9. The synchronous display method according to claim 8, characterized in that, The first reference signal indicates the frame start time for the first display screen to display video data, and the first processing unit transmits the first reference signal to the second processing unit via the GPIO interface a first time period earlier than the frame start time. The first time period includes at least the time consumed by transmitting the first reference signal via the GPIO interface.

10. The synchronous display method according to claim 9, characterized in that, The first time period includes the time taken to transmit the first reference signal via the GPIO interface, together with the time taken to generate the second reference signal based on the first reference signal.

11. The synchronous display method according to claim 8, characterized in that, The SOT signals of the first MIPI-DSI interface and the second MIPI-DSI interface are synchronized, and the first reference signal and the second reference signal are synchronized, or there is a delay between them.

12. The synchronous display method according to claim 11, characterized in that, A first delay is preset between the first reference signal and the SOT signal of the first MIPI-DSI interface, a second delay is preset between the second reference signal and the SOT signal of the second MIPI-DSI interface, and a third delay is preset between the first reference signal and the second reference signal, such that the third delay is equal to the difference between the first delay and the second delay.

Images