Multimedia output device and multimedia system

By introducing an image acquisition unit and a decoding unit into the multimedia output device, using an image signal processor to process and send image signals, the problem of slow processing speed caused by large resource occupation is solved, and flexible processing and playback of multimedia signals is realized, which is improved. User experience.

CN222073249UActive Publication Date: 2024-11-26BEIJING UNICORN TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202420343901.X
Authority / Receiving Office
CN · China
Patent Type
Utility models(China)
Current Assignee / Owner
Filing Date
2024-02-23
Publication Date
2024-11-26
Estimated Expiration
2034-02-23

AI Technical Summary

Technical Problem

When existing multimedia output devices process multimedia signals, they consume a large resource, resulting in slower processing speed and affect user experience.

Method used

A multimedia output device is designed, including an image acquisition unit, a main control unit and a decoding unit. The image signal processor processes the acquired image signals in the main control unit and sends them to the multimedia signal source device through an interface. The decoding unit is from the multimedia The signal source device acquires the multimedia signal and decodes it. The multimedia playback unit plays the decoded signal, avoiding resource occupation and improving processing speed.

Benefits of technology

It realizes flexible processing and playback of multimedia signals, improves user experience, and reduces the use of processing resources for other functions, and improves the overall performance of the device.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN222073249U_ABST
    Figure CN222073249U_ABST
Patent Text Reader

Abstract

The embodiment of the utility model provides multimedia output equipment and a multimedia system. The multimedia output equipment comprises a connecting interface, an image acquisition unit, a main control unit, a decoding unit and a multimedia playing unit; the connection interface is used for being connected with multimedia signal source equipment; the image acquisition unit is used for acquiring a first image signal; the main control unit is connected with the image acquisition unit and is used for obtaining a first image signal from the image acquisition unit, the main control unit comprises an image signal processor, and the image signal processor is used for processing the first image signal to obtain a second image signal; the main control unit is also used for sending the second image signal to the multimedia signal source equipment through the connection interface; the decoding unit is connected with the connection interface and is used for obtaining the multimedia signal from the multimedia signal source equipment through the connection interface and decoding the multimedia signal; and the multimedia playing unit is connected with the decoding unit and is used for playing the decoded multimedia signals.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of multimedia technology, and in particular to a multimedia output device and a multimedia system. Background Art

[0002] Nowadays, multimedia output devices (including but not limited to head-mounted display devices) are increasingly used. Users can play multimedia signals through multimedia output devices, which brings convenience to people's life and entertainment. Therefore, it is necessary to improve the performance of multimedia output devices in order to improve the user experience. Utility Model Content

[0003] In view of this, embodiments of the present application provide a multimedia output device and a multimedia system to at least partially solve the above problems.

[0004] According to a first aspect of an embodiment of the present application, a multimedia output device is provided, comprising: a connection interface, an image acquisition unit, a main control unit, a decoding unit, and a multimedia playback unit; the connection interface is used to connect to a multimedia signal source device; the image acquisition unit is used to acquire a first image signal; the main control unit is connected to the image acquisition unit, and is used to obtain the first image signal from the image acquisition unit, the main control unit comprises an image signal processor, the image signal processor is used to perform signal processing on the first image signal to obtain a second image signal, and the main control unit is further used to send the second image signal to the multimedia signal source device through the connection interface; the decoding unit is connected to the connection interface, and is used to obtain a multimedia signal from the multimedia signal source device through the connection interface and decode the multimedia signal; the multimedia playback unit is connected to the decoding unit, and is used to play the decoded multimedia signal.

[0005] According to a second aspect of an embodiment of the present application, a multimedia system is provided, comprising: a multimedia signal source device, and a multimedia output device as described in any one of the first aspects.

[0006] The multimedia output device provided in the embodiment of the present application can obtain multimedia signals from the multimedia signal source device through the connection interface and decode the multimedia signals, and the multimedia playback unit can play the decoded multimedia signals, so the multimedia signal playback function of the multimedia output device can be realized to meet the user's life and entertainment needs; in addition, since the multimedia output device in the embodiment of the present application also includes an image acquisition unit that can acquire the first image signal, the image signal processor included in the main control unit can perform signal processing on the first image signal to obtain a second image signal, and can send it to the multimedia signal source device through the connection interface, so that the multimedia signal source device can have more diverse data to flexibly generate multimedia signals, thereby more flexibly improving the user's experience. Furthermore, since the first image signal is a signal obtained by special processing by the image signal processor, it can avoid excessive occupation of processing resources for other functions of the multimedia output device, and the processing speed is also faster, which is conducive to further improving the user's experience of the multimedia output device. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the embodiments of the present application. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0008] Figure 1 Schematic diagram of an exemplary multimedia output device in an embodiment of the present application.

[0009] Figure 2 It is a schematic diagram of another exemplary multimedia output device in an embodiment of the present application.

[0010] Figure 3 This is a schematic diagram of another exemplary multimedia output device in an embodiment of the present application.

[0011] Figure 4 This is a schematic diagram of another exemplary multimedia system in an embodiment of the present application.

[0012] Description of reference numerals:

[0013] 100. Multimedia output device; 1. Connection interface; 2. Image acquisition unit; 21. Camera; 3. Main control unit; 31. Image signal processor; 4. Decoding unit; 5. Multimedia playback unit; 50. Display unit; 51. Display screen; 6. Audio unit; 60. Microphone; 61. Audio signal processing module; 611. First processing submodule; 612. Second processing submodule; 62. Speaker; 7. Electrochromic lens assembly; 70. Control unit; 71. Electrochromic drive module; 72. Electrochromic lens; 81. Inertial measurement unit; 82. Geomagnetic sensor; 83. Proximity sensor; 91. Indicator light assembly; 92. Indicator light drive unit; 200. Multimedia signal source device; 300. Multimedia system. DETAILED DESCRIPTION

[0014] In order to make those skilled in the art better understand the technical solutions in the embodiments of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the embodiments of the present application, all other embodiments obtained by ordinary technicians in this field should belong to the scope of protection of the embodiments of the present application. It should be understood that the various steps recorded in the method implementation mode of the present disclosure can be performed in different orders and / or performed in parallel. In addition, the method implementation mode may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0015] The specific implementation of the embodiment of the present application is further explained below in conjunction with the accompanying drawings of the embodiment of the present application.

[0016] Figure 1 FIG. 1 is a schematic diagram of an exemplary multimedia output device in an embodiment of the present application. Figure 1As shown, the multimedia output device 100 may include: a connection interface 1, an image acquisition unit 2, a main control unit 3, a decoding unit 4, and a multimedia playback unit 5. The connection interface 1 may be used to connect to a multimedia signal source device 200. The image acquisition unit 2 may be used to acquire a first image signal. The main control unit 3 may be connected to the image acquisition unit 2 to obtain the first image signal from the image acquisition unit 2. The main control unit 3 may include an image signal processor 31, which may be used to obtain the first image signal from the image acquisition unit 2 and perform signal processing on the first image signal in various ways, thereby obtaining a second image signal. The main control unit 3 may also be used to send the second image signal to the multimedia signal source device 200 through the connection interface 1. The decoding unit 4 may be connected to the connection interface 1 to obtain a multimedia signal from the multimedia signal source device 200 through the connection interface 1 and decode the multimedia signal. The multimedia playback unit 5 may be connected to the decoding unit 4 to play the decoded multimedia signal. The multimedia output device 100 in the embodiment of the present application, because the decoding unit 4 included therein can obtain the multimedia signal from the multimedia signal source device 200 through the connection interface 1 and decode the multimedia signal, and the multimedia playback unit 5 can play the decoded multimedia signal, the multimedia signal playback function of the multimedia output device 100 can be realized to meet the user's life and entertainment needs. In addition, since the multimedia output device 100 in the embodiment of the present application also includes an image acquisition unit 2 that can acquire a first image signal, the image signal processor 31 included in the main control unit 3 can perform signal processing on the first image signal to obtain a second image signal, and can send it to the multimedia signal source device 200 through the connection interface 1, so that the multimedia signal source device 200 can have more diverse data to flexibly generate multimedia signals, thereby more flexibly improving the user's experience. Further, since the first image signal is a signal obtained by special processing by the image signal processor 31, it can avoid excessive occupation of processing resources for other functions of the multimedia output device 100, and the processing speed is also faster. This is conducive to further improving the user's experience of the multimedia output device 100.

[0017] The multimedia output device 100 in the embodiment of the present application is further described below. It should be understood that the following content does not limit the embodiment of the present application in any way.

[0018] In some optional embodiments of the present application, the multimedia output device 100 may be any type of electronic device that can play multimedia signals. The multimedia signal may include at least one of a video signal and an audio signal. For example, the multimedia output device 100 may be a terminal device such as a mobile phone or a tablet computer. For another example, in some optional embodiments, the multimedia output device 100 may be a head-mounted display device. The head-mounted display device using the scheme of this embodiment can better improve the user's experience of using the head-mounted display device. For example, in some application scenarios, the head-mounted display device may include but is not limited to AR (Augmented Reality) glasses, VR (Virtual Reality) glasses, and the like.

[0019] In some optional embodiments of the present application, the connection interface 1 of the multimedia output device 100 can be connected to the multimedia signal source device 200 in various ways. The multimedia signal source device 200 can be an external electronic device that can send multimedia signals to the multimedia output device 100, and can be of any type. For example, the multimedia signal source device 200 includes but is not limited to: mobile phones, tablet computers, laptops, personal computers, car computers, servers and other electronic devices.

[0020] The connection interface 1 may be any type of connection interface, for example, a USB Type-C interface. It is understandable that the connection interface 1 may be a physical interface, through which the multimedia signal source device 200 may be wiredly connected to the multimedia output device 100. Alternatively, the connection interface 1 may also be a virtual interface, through which the multimedia signal source device 200 may be wirelessly connected to the multimedia output device. In some optional embodiments, the multimedia output device 100 may be provided with a connection interface 1 of the USB Type-C interface type, so that the multimedia output device 100 may be connected to the multimedia signal source device 200, thereby ensuring the reliability of signal transmission, and the USB Type-C interface has better versatility and better compatibility with different multimedia signal source devices 200.

[0021] In the embodiment of the present application, the main control unit 3 can be used for signal processing and control of the multimedia output device 100. For example, the main control unit 3 may include at least one processing chip, and the processing chip can implement signal processing and control. For example, the type of the processing chip may include but is not limited to CPU (Central Processing Unit), MCU (Micro Controller Unit), DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), etc.

[0022] Reference Figure 1 As shown, the main control unit 3 may include an image signal processor 31. The image signal processor (ISP) 31 may perform special signal processing on the obtained first image signal to obtain a second image signal, so as to avoid the processing of the first image signal occupying other processing resources of the main control unit 3. The image signal processor 31 may be an independent hardware in the main control unit 3, and it may be any type of image signal processor. The signal processing performed by the image signal processor 31 on the first image signal may include, for example, at least one of: auto focus (AF, Auto Focus) processing, auto exposure (AE, Auto Exposure) processing, auto white balance (AWB, Auto White Balance) processing, strong light suppression processing, backlight compensation processing, 2D / 3D denoising processing, 6-Dof (Degree of freedom, degrees of freedom) digital anti-shake processing, etc.

[0023] In an exemplary embodiment, referring to Figure 3 As shown, the main control unit 3 may include an AR9311 chip, and an independent ISP module is integrated inside the AR9311 chip. The ISP module can implement the function of the image signal processor 31 and process the first image signal into the second image signal.

[0024] In the embodiment of the present application, the image acquisition unit 2 can be used to acquire the first image signal. Figure 2 or Figure 3 As shown, the image acquisition unit 2 may include at least one camera 21 (the number of cameras is not limited herein, for example, see Figure 2 or Figure 3As shown, in an optional example, 2 cameras may be included). The setting position of at least one camera can be set at any position of the multimedia output device 100. The first image signal can be an image captured in any environment. For example, taking the multimedia output device 100 as a head-mounted display device, the camera included in the image acquisition unit 2 can be set on the main body of the head-mounted display device, and the user can use the head-mounted display device indoors or outdoors. The camera can capture the first image signal in different states as the user's head moves, and transmit it to the image acquisition unit 2 for signal processing.

[0025] The type of the camera 21 is not limited in the embodiment of the present application. For example, it includes but is not limited to a grayscale camera, a color camera, a SLAM (Simultaneous Localization and Mapping) camera, etc. The model of the camera 21 is not limited here. Optionally, the model of the camera 21 can be OAF2899. The connection method between the camera 21 of the image acquisition unit 2 and the main control unit 3 is not limited in the embodiment of the present application. For example, refer to Figure 3 As shown, in some optional embodiments, the camera 21 can be connected to the main control unit 3 (for example, including an AR9311 chip) through a MIPI (Mobile Industry Processor Interface) interface, and the camera 21 of the image acquisition unit 2 sends the first image signal to the image signal processor 31 of the main control unit 3 through the MIPI interface. Figure 3 As shown, the camera 21 of the image acquisition unit 2 also exchanges signals with the main control unit 3 through an I2C (Inter-Integrated Circuit) bus, and the main control unit 3 can at least configure the camera 21 through the I2C bus. Figure 3 As shown, when connected, the camera 21 can be connected to the GPIO (General-purpose input / output) port of the main control unit 3 to achieve the above communication. For example, each camera 21 can be connected to four GPIO ports of the main control unit 3, of course, this is only an example, and it can be more or less.

[0026] The embodiment of the present application does not limit the manner in which the main control unit 3 transmits the second image signal to the multimedia signal source device 200. In some optional embodiments, the main control unit 3 is connected to the connection interface 1 via a USB video class protocol (USB VideoClass, UVC protocol). The main control unit 3 can be used to send the second image signal to the multimedia signal source device 200 via the connection interface 1 using the USB video class protocol. The UVC protocol is a universal video transmission protocol that allows cameras of different brands to be directly recognized and used by the operating system without installing any drivers. Based on this, the above-mentioned embodiments of the embodiments of the present application can make it more convenient to transmit the second image signal, with better compatibility, and can meet the needs of high-definition transmission.

[0027] In some optional embodiments of the present application, the UVC protocol can be implemented based on any type of USB transmission mode, such as USB2.0 or USB3.0. Figure 3 As shown, the UVC protocol can be transmitted based on USB2.0.

[0028] In some optional embodiments of the present application, refer to Figure 2 or Figure 3 As shown, the decoding unit 4 is connected to the connection interface 1, and can be used to obtain a multimedia signal from the multimedia signal source device 200 through the connection interface 1. It should be noted that the multimedia signal here may include at least one of an audio signal and a video signal. In addition, the multimedia signal here may be a multimedia signal stored in advance in the multimedia signal source device 200, or a multimedia signal obtained from the network in real time, and there is no unique limitation here. It can be seen that the multimedia output device 100 of the embodiment of the present application can provide more diverse data for the multimedia signal source device 200 to generate multimedia signals, thereby more flexibly improving the user experience.

[0029] In some optional embodiments of the present application, the decoding unit 4 can be connected to the connection interface 1 in any manner. Figure 3 As shown, in an optional embodiment, the two can at least be connected by DP (DisplayPort) protocol communication. That is, the connection interface 1 (such as a USB Type-C interface) may include a DP transmission interface, so that the decoding unit 4 can realize multimedia signal transmission based on the DP protocol through the connection interface 1. The specific structure of the decoding unit 4 is not specifically limited in the embodiment of the present application. For example, the decoding unit 4 can be a decoding chip capable of decoding audio and video data, and its specific model can be any suitable model. For example, referring to Figure 3 As shown, in one example, the decoding unit 4 can use the LT7911 chip. Specifically, refer to Figure 3As shown, the LT7911 chip may include a DP1.4a / Edp1.4b receiving module, which can decode the multimedia signal obtained from the multimedia signal source device 200. The LT7911 chip may also include a video processing module and an audio processing module for further processing the decoded multimedia signal. The decoded multimedia signal (video signal or audio signal) can be processed by the video processing module and / or the audio processing module and then output to the multimedia playback unit 5 for playback.

[0030] Optionally, refer to Figure 3 As shown, the decoding unit 4 (such as the LT7911 chip) can support the display port alternate mode (Display Port Alternate Mode), and the multimedia output device 100 can communicate through the information channel communication (CC (Configuration Channel, Configuration Channel) pin communication) of the frequency modulation incremental modulation system (Video Delta Modulation System, referred to as VDMS) in the USB PD (USB Power Delivery, power transmission protocol) protocol to notify the multimedia signal source device 200 that the multimedia output device 100 supports the display port (DisplayPort, referred to as DP) mode. In this DP mode, the multimedia signal source device 200 can transmit the multimedia signal to the multimedia output device 100 through the DP interface in the connection interface 1.

[0031] Optionally, the decoding unit 4 can be connected to the multimedia signal source device 200 through the connection interface 1, and can obtain power for supporting the multimedia output device 100 from the multimedia signal source device 200 through the connection interface 1. It can be understood that, for example, referring to Figure 3 As shown, the above decoding unit 4 (such as AR9311 chip) can also include a CC channel logic module and a PD (Power Delivery) controller, and the multimedia output device 100 can communicate with the multimedia signal source device 200 through the connection interface 1 (such as USB Type-C interface) through these modules, and obtain power. After obtaining power, the main control unit 3 can use the power supply to start powering on normally, and other components of the multimedia output device 100 can work.

[0032] In some optional embodiments of the present application, the multimedia playback unit 5 can be connected to the decoding unit 4. After obtaining the multimedia signal decoded by the decoding unit 4, the multimedia signal can be played to realize the multimedia signal playback function of the multimedia output device 100. Optionally, the decoding unit 4 is used to decode the multimedia signal into at least one of a first audio signal and a video signal. Correspondingly, the multimedia playback unit 5 may include at least one of a display unit 50 and an audio unit 6. The audio unit 6 can be connected to the decoding unit 4 to obtain the first audio signal from the decoding unit 4 for playback. The display unit 50 can be connected to the decoding unit 4 to obtain the video signal from the decoding unit 4 for playback. Based on this, such a multimedia playback unit 5 in the embodiment of the present application can effectively meet the playback requirements of different multiple multimedia signals.

[0033] In some optional embodiments of the present application, the video signal decoded by the decoding unit 4 may be a video signal obtained by the multimedia signal source device processing the original video based on the second image signal. It is understandable that after acquiring the second image signal, the multimedia signal source device 200 may process the second image signal in various ways so as to obtain the position information (including 6-degree-of-freedom signals) or posture information (including 3-degree-of-freedom signals) used to characterize the spatial distribution of the multimedia output device 100. The video signal sent by the multimedia signal source device 200 to the decoding unit 4 may be a video signal obtained by processing based on the position information or posture of the multimedia output device 100, so that the display of the multimedia output device 100 can track its movement in 6-dimensional degrees of freedom or 3-dimensional degrees of freedom. Of course, the video signal decoded by the decoding unit 4 may also be unrelated to the second image signal, and there is no unique limitation here.

[0034] The specific structure of the display unit 50 is not limited in the present application embodiment. Figure 2 or Figure 3 As shown, for example, at least one display screen 51 may be included. In some optional embodiments, referring to Figure 2 or Figure 3As shown, the display unit 50 may include two display screens 51. Taking the multimedia output device 100 as an embodiment of a head-mounted display device, the two display screens may be the left eye screen and the right eye screen of the head-mounted display device, respectively, for the left and right eyes of the user to watch the played images. The display screen may be of any type, for example, an OLED (Organic Light-Emitting Diode) screen, or an LED (Light-Emitting Diode) screen, an LCD (Liquid Crystal Display) screen, and the like. For example, in an optional embodiment, the display screen 51 may be an ECX343E model OLED screen.

[0035] Optionally, the decoding unit 4 can send the decoded video signal to the display unit 50 for playback in any manner. Figure 3 As shown, the decoding unit 4 (for example, it can be an LT7911 chip) can include a dual-interface 4-lane LVDS (Low-Voltage Differential Signaling) transmission module to send the decoded video signal to the two display screens of the display unit 50 for playback.

[0036] Optionally, refer to Figure 1 , Figure 2 or Figure 3 As shown, the decoding unit 4 can also be connected to the main control unit 3, and the main control unit 3 can burn and configure the resolution of the video signal output of the decoding unit 4, and control the power enable and reset of the decoding unit 4. Figure 3 As shown, taking the main control unit 3 as an AR9311 chip and the decoding unit 4 as an LT7911 chip as an example, the LT7911 chip can be connected to the AR9311 chip through a GPIO (General-purpose input / output) port, and perform signal interaction through the I2C bus. The AR7911 chip can burn the LT7911 chip and configure the resolution of the video output through the I2C bus, and control the power enable and reset of the LT7911 chip through the GPIO port (for example, 4 GPIO ports can be used. It should be understood that this is only an example, and the GPIO port can be more or less).

[0037] It should be understood that in some optional embodiments, the multimedia playing unit 5 may also play the multimedia signal that has not been decoded by the decoding unit 4 .

[0038] In some optional embodiments of the present application, the audio unit 6 can be used to play audio signals, and it may include one or more speakers 62.

[0039] In some optional embodiments, the main control unit 3 can be connected to the connection interface 1 through the USB audio class protocol, and the main control unit 3 is connected to the audio unit 6. The main control unit 3 obtains the second audio signal from the multimedia signal source device 200 through the connection interface 1 using the USB audio class protocol (UAC protocol, USB Audio Class), and sends the second audio signal to the audio unit 6.

[0040] It should be understood that the difference between the second audio signal and the first audio signal here is whether the decoding is performed by the decoding unit 4. The first audio signal may be an audio signal decoded by the decoding unit 4, and the second audio signal may be an audio signal sent directly to the audio unit 6 through the UAC path by the multimedia signal source device 200 without passing through the decoding unit 4, and the routes of the two to reach the audio unit 6 are different.

[0041] Based on this, the above-mentioned embodiment of the present application can effectively send the second audio signal to the audio unit 6 for playback through the UAC protocol, so as to further meet the audio signal playback requirements of the multimedia output device 100.

[0042] In some optional embodiments of the present application, the UAC protocol can be implemented based on any type of USB transmission mode, such as USB2.0 or USB3.0. Figure 3 As shown, the UAC protocol is based on USB 2.0 transmission.

[0043] The specific composition of the audio unit 6 is not specifically limited in the present application embodiment. Figure 2 or Figure 3 As shown, the audio unit 6 may include an audio signal processing module 61 and a speaker 62, and the speaker 62 is connected to the audio signal processing module 61; the audio signal processing module 61 is used to obtain the audio signal and perform audio signal processing, and the speaker 62 obtains the processed audio signal from the audio signal processing module 61 for playing.

[0044] Based on this, in the embodiment of the present application, through the structure of such an audio unit 6, the audio signal can be effectively played through the speaker 62. In addition, since the audio signal processing module 61 can process the audio signal before the speaker 62 plays it, the processed audio signal played by the speaker 62 has a better effect and is more conducive to satisfying the user experience.

[0045] It should be understood that the audio signal here may be the first audio signal or the second audio signal. Or it may be an audio signal obtained in other ways. Figure 3 As shown, in an optional example, the decoding unit 4 is connected to the audio signal processing module 61, and the first audio signal can be transmitted to the audio signal processing module 61 through the I2S bus (Inter-IC Sound, integrated circuit built-in audio bus). The audio signal processing module 61 obtains the first audio signal, further processes the audio signal, and sends it to the speaker 62 for playing. Figure 2 or Figure 3 As shown, after the multimedia signal source device 200 sends the second audio signal to the main control unit 3 through the connection interface 1, the main control unit 3 can send the second audio signal to the audio signal processing module 61. The audio signal processing module 61 obtains the second audio signal, further processes the audio signal, and sends it to the speaker 62 for playback.

[0046] Optionally, refer to Figure 2 or Figure 3 As shown, the multimedia output device 100 may further include a first bus switch SW1 and a second bus switch SW2, both of which are connected to the main control unit 3, and the main control unit 3 may control the conduction and disconnection of the two. The decoding unit 4 may be connected to the audio signal processing module 61 through the first bus switch SW1. The main control unit 3 may be connected to the audio signal processing module 61 through the second bus switch SW2. Optionally, referring to Figure 3 As shown, the first bus switch SW1 can be connected to the GPIO port of the main control unit 3 (for example, one GPIO port can be used). Optionally, the second bus switch SW2 can be connected to the GPIO port of the main control unit 3 through an I2S bus (for example, one GPIO port can be used). Optionally, the first bus switch SW1 and the second bus switch SW2 are connected to the audio signal processing module 61 through an I2S bus to facilitate audio signal transmission. The first bus switch SW1 and the second bus switch SW2 can be any model. For example, in one embodiment, the first bus switch SW1 and the second bus switch SW2 can be AW39104FOR chips.

[0047] The above-mentioned speaker 62 may include one or more speakers. For example, when the multimedia output device 100 is a head mounted display device, two speakers 62 may be included (see Figure 2 or Figure 3 ), wherein the two speakers 62 can play audio signals corresponding to the left and right ears of the user respectively.

[0048] The specific composition of the audio signal processing module 61 is not limited in the present embodiment. Figure 2 or Figure 3As shown, the audio signal processing module 61 may include a first processing submodule 611 and a second processing submodule 612, the second processing submodule 612 is connected between the first processing submodule 611 and the speaker 62, and the first processing submodule 611 is connected to the main control unit 3 and the decoding unit 4; the first processing submodule 611 can receive an audio signal (a first audio signal or a second audio signal) to perform first audio signal processing, and the second processing submodule 612 can receive the audio signal processed by the first processing submodule 611 (for example, it can be connected and receive data via an I2S bus), perform second audio signal processing, and send the processed audio signal to the speaker 62 for playback.

[0049] In some optional embodiments, referring to Figure 3 As shown, the first processing submodule 611 may include a digital signal processor (DSP, Digital Signal Processing), and the first audio signal processing performed by it may include at least one of noise reduction processing, heavy bass processing, etc., and may also include other audio signal processing operations, which are not limited here. In some optional embodiments, the second processing submodule 612 may include a SmartPA (intelligent power amplifier) ​​chip, and the second audio signal processing performed on the obtained audio signal may include at least one of DA (Digital to Analog, digital to analog conversion) conversion processing and amplification processing, and may also include other audio signal processing operations, which are not limited here. The second processing submodule 612 may be one or more, for example, the second processing submodule 612 may be set according to the number of speakers 62, and each second processing submodule 612 corresponds to a speaker 62. For example, the multimedia output device 100 (understood as a head-mounted display device) is provided with two left and right speakers 62, and then there may be two second processing submodules 612, and the processed audio signals are respectively input to the corresponding speakers 62 and the speakers 62 are driven to play the audio signals.

[0050] For example, in an optional example, the SmartPA chip may be an AW88266AFCR chip.

[0051] Optionally, the first processing submodule 611 may also be connected to a GPIO port of the main control unit 3 via a UART (Universal Asynchronous Receiver Transmitter) bus, and the main control unit 3 may communicate with the first processing submodule 611, for example, may configure it.

[0052] In some optional embodiments, referring to Figure 2 or Figure 3As shown, the multimedia output device 100 in the embodiment of the present application may further include: a microphone 60. The microphone 60 may be connected to the main control unit 3 via an audio signal processing module 61. The microphone 60 is used to receive an external sound signal, and perform audio signal processing on the external sound signal through the audio signal processing module 61, and send the processing result to the main control unit 3.

[0053] Based on this, the multimedia output device 100 in the embodiment of the present application can collect sound signals through the microphone 60, and can process the audio signals and send them to the main control unit 3, so as to facilitate the use of the sound signals by the multimedia output device 100, so as to better meet the user's usage needs.

[0054] Optionally, the audio signal processing module 61 may include the first processing submodule 611 and the second processing submodule 612. The microphone 60 may be connected to the first processing submodule 611 and send a sound signal to the first processing submodule 611. The sound signal may be sent to the main control unit 3 after being processed by the first processing submodule 611. Optionally, the main control unit 3 may send the processed sound signal to the multimedia signal source device 200 through the connection interface 1 using the UAC protocol (which may be transmitted based on USB2.0) for storage and other processing.

[0055] The microphone 60 can be of any type that can meet the requirements, and can be one or more. For example, the microphone 60 can adopt a dual stereo digital microphone. Optionally, the ADC (Analog-to-Digital Converter) module can be integrated inside the stereo digital microphone, which can convert the analog sound signal into a digital signal in the PDM (Pulse Density Modulation) coding format. The microphone 60 can be connected to the DSP of the first processing submodule 611 through the PDM interface, and send the sound signal in the PDM coding format to the DSP through the PDM interface. The DSP can convert the sound signal in the PDM coding format into a sound signal in the PCM (Pulse Code Modulation) coding format and perform algorithm processing (for example, it can include noise reduction, microphone directional acquisition, etc.). Then the DSP transmits the processed sound signal to the RX FIFO register (i.e., receiving register) of the main control unit 3 through an interface of the I2S bus of the main control unit 3 (such as the AR9311 chip) through its own I2S interface. Optionally, the main control unit 3 can transmit the data in PCM format to its internal CPU via a DMA (Direct Memory Access) bus, and the CPU packages the data in PCM format according to the UAC protocol, and then sends the packaged audio data to the TX FIFO register (i.e., the sending register) of its USB module via the DMA bus, and finally transmits the sound signal to the multimedia signal source device 200 through the connection interface 1 for storage and other processing using the UAC protocol (which can be transmitted based on USB2.0) through the USB interface. It should be understood that this is only an example for ease of understanding and is not intended to be any limitation to the embodiments of the present application.

[0056] In some optional embodiments, referring to Figure 2 or Figure 3 As shown, the multimedia output device 100 may further include: an indicator light component 91 and an indicator light driving unit 92 connected to the indicator light component 91. The indicator light driving unit 92 may be connected to the main control unit 3, and is used to receive an indicator light driving signal from the main control unit 3 to drive the indicator light component 91 to achieve different lighting effects.

[0057] Based on this, in the embodiment of the present application, the indicator light assembly 91 and the indicator light driving unit 92 can be used to make the multimedia output device 100 present different lighting effects, so as to indicate different states of the multimedia output device, and also to provide users with more good visual experience, thereby improving the user's usage experience.

[0058] The specific composition of the indicator light assembly 91 is not limited in the embodiments of the present application. For example, in some embodiments, the indicator light assembly 91 may include two groups of indicator lights, and the indicator lights may be, for example, RGB three-color indicator lights (Red, Green, Blue, i.e., red, green, and blue three-color indicator lights), or LED lights. Optionally, the indicator light drive unit 92 may be an indicator light drive chip, such as an AW21009NQR chip, which is an LED drive chip. Optionally, refer to Figure 3 As shown, the main control unit 3 can be connected to the indicator light driving unit 92 through the I2C bus. For example, the main control unit can set the indicator light driving chip (such as AW21009NQR) through the I2C bus. Optionally, the indicator light driving chip can include 9 LED driving channels, each of which can output 256 levels of direct current to adjust the brightness of the LED indicator light.

[0059] Optionally, the indicator light driving unit 92 can drive the indicator light assembly 91 (for example, 2 groups of RGB three-color indicator lights) to realize various lighting effects including but not limited to flashing, breathing lights, flowing lights, etc.

[0060] In some cases where the multimedia output device 100 is a head mounted display device, it may also include lenses. Figure 2 or Figure 3 As shown, the multimedia output device 100 may further include an electrochromic lens assembly 7. The electrochromic lens assembly 7 may be connected to the main control unit 3 and may change transparency under the adjustment of the main control unit 3.

[0061] Based on this, since the electrochromic lens assembly 7 in the embodiment of the present application can effectively change the transparency under the adjustment of the main control unit 3, the ambient light entering the electrochromic lens assembly 7 can be adjusted, so that it can flexibly adapt to the display requirements of the multimedia output device 100, and the appearance of the multimedia output device 100 can be flexibly adjusted, which is conducive to improving the user experience of the multimedia output device 100.

[0062] Optionally, refer to Figure 2 or Figure 3 As shown, the electrochromic lens assembly 7 includes an electrochromic drive module 71 and two electrochromic lenses 72. The electrochromic drive module 71 can accept the configuration of the main control unit 3 to drive the two electrochromic lenses 72 to change transparency. Figure 3 As shown, the main control unit 3 can be connected to the electrochromic drive module 71 via the I2C bus to achieve communication, and the main control unit 3 configures the electrochromic drive module 71 via the I2C bus. Optionally, the electrochromic drive module 71 may include a LS98102 chip. Figure 3As shown, the two electrochromic lenses 72 can be electrically connected to the IO port of the electrochromic driving module 71 to receive the drive of the electrochromic driving module 71.

[0063] In some optional embodiments, referring to Figure 2 or Figure 3 As shown, the multimedia output device 100 may further include: a control unit 70, which is connected to the main control unit 3. The control unit 70 may be used to receive user input operations and enable the main control unit 3 to adjust the transparency of the electrochromic lens assembly 7 according to the input operations.

[0064] Based on this, the embodiment of the present application allows the user to adjust the transparency of the electrochromic lens assembly 7 by himself through the control unit 70, so that the user can flexibly adjust the ambient light entering the electrochromic lens assembly 7, thereby flexibly meeting the display requirements of different users for the multimedia output device 100 and flexibly meeting the user's preferences for the appearance of the multimedia output device 100, which is conducive to improving the user experience of different users with the multimedia output device 100.

[0065] Optionally, the control unit 70 may include any module capable of inputting control instructions, such as a key control unit, a remote control unit, a touch control unit, a gesture control unit, etc. For example, in an optional example, the control unit 70 may include multiple control buttons, and the user inputs operations through the multiple control buttons. The specific number of control buttons is not limited here, for example, it can be 1, 2, 3 or more (3 can be taken as an example). For example, referring to Figure 3 As shown, the control button can be connected to the GPIO port of the main control unit 3 to achieve connection with the main control unit 3. Taking three control buttons as an example, they can be connected to three different GPIO ports of the main control unit 3 respectively.

[0066] In some optional embodiments, referring to Figure 2 or Figure 3 As shown, the multimedia output device 100 may further include: a posture information detection unit, including at least one of an inertial measurement unit 81 and a geomagnetic sensor 82, and the posture information detection unit is connected to the main control unit 3. The inertial measurement unit 81 can be used to detect the angular velocity data and / or acceleration data of the multimedia output device 100, so that the main control unit 3 can obtain the angular velocity data and / or acceleration data. The geomagnetic sensor 82 can be used to detect the magnetic data of the multimedia output device 100, so that the main control unit 3 can obtain the magnetic data. It can be understood that the signal detected by the above-mentioned posture information detection unit is combined with the second image signal to determine the six-degree-of-freedom posture information of the multimedia output device 100.

[0067] Based on this, the multimedia output device 100 in the above-mentioned embodiment of the present application can detect the angular velocity data and / or acceleration data of the multimedia output device 100 through the inertial measurement unit 81, so that the main control unit 3 can determine the posture detection of the multimedia output device 100 through the angular velocity data and / or acceleration data. The multimedia output device 100 in the embodiment of the present application can detect the magnetic data of the multimedia output device 100 through the geomagnetic sensor 82, so that the main control unit 3 can improve the accuracy of the determined posture of the multimedia output device 100 through the obtained magnetic data. Through posture detection, it is convenient for users to use the multimedia output device 100 in the multi-degree-of-freedom display mode.

[0068] In some optional embodiments, the inertial measurement unit 81 may be an IMU (Inertial Measurement Unit) sensor. The specific model is not limited in the embodiments of the present application. For example, an ICM-42688 IMU sensor may be used. Figure 3 As shown, the inertial measurement unit 81 can be connected to the main control unit 3 via a four-wire interface of SPI (Serial Peripheral Interface, synchronous serial bus), and the main control unit 3 can configure the inertial measurement unit 81 via the SPI bus, and obtain the angular velocity data and / or acceleration data of the multimedia output device 100. Optionally, the main control unit 3 can use a USB protocol (such as USB2.0, USB3.0, etc.) to package the data and send it to the multimedia signal source device 200 through the connection interface 1.

[0069] In some optional embodiments, the specific model of the geomagnetic sensor 82 is not limited in the present application. For example, a geomagnetic sensor of model MMC5603NJ is used. Figure 3 As shown, the geomagnetic sensor 82 can be connected to the main control unit 3 via the I2C bus, and the main control unit 3 can configure the geomagnetic sensor 82 via the I2C bus, and obtain the magnetic data of the multimedia output device 100. Optionally, the main control unit 3 can use the USB protocol (such as USB2.0, USB3.0, etc.) to package the data and send it to the multimedia signal source device 200 through the connection interface 1.

[0070] Optionally, in an optional embodiment using both the inertial measurement unit 81 and the geomagnetic sensor 82 (which can be combined with Figure 2 or Figure 3As shown in FIG. 1 , the inertial measurement unit 81 and the geomagnetic sensor 82 can realize a strapdown inertial navigation system based on magnetism, angular velocity and acceleration. The strapdown inertial navigation system does not rely on external information during operation, nor does it radiate energy to the outside world, is not easily disturbed or damaged, can realize autonomous navigation, and omits a complex physical entity platform, has a simple structure, a small size, a light weight, a low cost, is easy to maintain, has high reliability, and has a high fault tolerance capability.

[0071] In some optional embodiments, referring to Figure 2 or Figure 3 As shown, the multimedia output device 100 in the embodiment of the present application also includes: a proximity sensor 83, which is connected to the main control unit 3; the proximity sensor 83 is used to detect the user's wearing status data of the multimedia output device 100, and send the wearing status data to the main control unit 3, so that the main control unit 3 controls the working state of the multimedia output device 100 in response to the wearing status data.

[0072] Based on this, the multimedia output device 100 in the embodiment of the present application can effectively detect the user's wearing status data of the multimedia output device 100 through the proximity sensor 83, so that the main control unit 3 can control the working status of the multimedia output device 100 based on the user's wearing status of the multimedia output device 100 to improve the use effect of the multimedia output device 100.

[0073] Optionally, the main control unit 3 controls the working state of the multimedia output device 100 in response to the wearing state data, which may be to control the turning on and off of the multimedia output device 100, or to control the working state (which may include turning on and off) of one or more components on the multimedia output device 100, thereby improving the use effect of the multimedia output device 100.

[0074] Optionally, refer to Figure 3 As shown, the main control unit 3 can be connected to the proximity sensor 83 via the I2C bus and the interrupt pin. Optionally, the model of the proximity sensor 83 can be VCNL3682WN.

[0075] Taking the multimedia output device 100 as a head mounted display device as an example, in some optional embodiments, when the proximity sensor 83 detects that the user is wearing the multimedia output device 100, the main control unit 3 can obtain the wearing status data indicating that the user is wearing the multimedia output device 100 from the proximity sensor 83, and then the main control unit 3 can control the multimedia output device 100 to turn on, and turn on the display unit 50 of its multimedia playback unit 5 for the user to watch. When the proximity sensor 83 does not detect that the user is wearing the multimedia output device 100, the main control unit 3 can obtain the wearing status data indicating that no user is wearing the multimedia output device 100 from the proximity sensor 83, and then the main control unit 3 can control the multimedia output device 100 to turn off, and turn off the display unit 50 of its multimedia playback unit 5 to reduce the power consumption of the multimedia output device 100. It should be understood that this indicates an optional example and does not serve as any limitation to the embodiments of the present application.

[0076] In some optional embodiments, the main control unit 3 can be used to determine the duration of the multimedia output device 100 detected by the proximity sensor 83 being in the unworn state, and control the multimedia output device 100 to enter the standby state when the duration is determined to be greater than a predetermined time.

[0077] When the duration of the multimedia output device 100 not being worn detected by the proximity sensor 83 is longer than a predetermined time, it can be considered that the multimedia output device 100 is not in use. At this time, the main control unit 3 controls the multimedia output device 100 to enter a standby state, so that all functions of the multimedia output device 100 except the proximity sensor 83 are turned off, thereby reducing the power consumption of the multimedia output device 100 and avoiding misjudgment.

[0078] It should be understood that the predetermined time can be set as needed, for example, 5 minutes, 10 minutes, 15 minutes, etc., and is not specifically limited here.

[0079] Optionally, the proximity sensor 83 continuously detects whether there is data of the user wearing the device when the multimedia output device 100 is in standby mode. If detected, an interrupt signal can be sent to the main control unit 3 (such as the AR9311 chip) through the interrupt pin (it can be understood that the interrupt signal can indicate whether the user continues to wear it), and the main control unit 3 can start to wake up and run, and control the multimedia output device 100 to enter the working state.

[0080] It can be seen from any of the above optional embodiments of the multimedia output device 100 of the present application that the multimedia output device 100 of the present application has good performance and can effectively improve the user experience.

[0081] It can be understood that the embodiments described above in the embodiments of the present application are all optional implementation methods and are not sufficient to limit the embodiments of the present application.

[0082] In summary, the multimedia output device 100 in the embodiment of the present application can obtain a multimedia signal from the multimedia signal source device 200 through the connection interface 1, and decode the multimedia signal, and the multimedia playback unit 5 can play the decoded multimedia signal, so the multimedia signal playback function of the multimedia output device 100 can be realized to meet the user's life and entertainment needs. In addition, since the multimedia output device 100 in the embodiment of the present application also includes an image acquisition unit 2 that can acquire a first image signal, the image signal processor 31 included in the main control unit 3 can perform signal processing on the first image signal to obtain a second image signal, and can send it to the multimedia signal source device 200 through the connection interface 1, so that the multimedia signal source device 200 can have more diverse data to flexibly generate multimedia signals, thereby more flexibly improving the user's experience. Further, since the first image signal is a signal obtained by special processing by the image signal processor 31, it can avoid excessive occupation of processing resources for other functions of the multimedia output device 100, and the processing speed is also faster, which is conducive to further improving the user's experience of the multimedia output device 100.

[0083] According to the second aspect of the embodiment of the present application, referring to Figure 4 As shown, a multimedia system 300 is provided, comprising: a multimedia signal source device 200, and a multimedia output device 100 as described in any one of the first aspects.

[0084] Since the multimedia system 300 in the embodiment of the present application includes the multimedia output device 100 of the first aspect, the user experience can be effectively improved.

[0085] The multimedia signal source device 200 and the multimedia output device 100 of the multimedia system 300 in the embodiment of the present application have been described in the foregoing text and will not be repeated here.

[0086] The term "including" and its variations used in this article are open inclusions, that is, "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one other embodiment"; the term "some embodiments" means "at least some embodiments". It should be noted that the concepts of "first", "second", etc. mentioned in the embodiments of the present application are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units. It should be noted that the modifications of "one" and "multiple" mentioned in the embodiments of the present application are illustrative and not restrictive. Those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more". It should be understood that the various features in the embodiments of the present application can be combined in any suitable manner.

[0087] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the embodiments of the present application, rather than to limit them. Although the embodiments of the present application have been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions recorded in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the embodiments of the present application.

Claims

1. A multimedia output device, characterized in that: include: A connection interface, used for connecting to a multimedia signal source device; An image acquisition unit, configured to acquire a first image signal; a main control unit connected to the image acquisition unit and configured to obtain the first image signal from the image acquisition unit, the main control unit comprising an image signal processor, the image signal processor being configured to perform signal processing on the first image signal to obtain a second image signal, and the main control unit being further configured to send the second image signal to the multimedia signal source device through a connection interface; A decoding unit connected to the connection interface, configured to obtain a multimedia signal from the multimedia signal source device through the connection interface, and decode the multimedia signal; The multimedia playing unit is connected to the decoding unit and is used for playing the decoded multimedia signal.

2. The multimedia output device according to claim 1, wherein: The decoding unit is used to decode the multimedia signal into at least one of a first audio signal and a video signal; the multimedia playback unit includes at least one of a display unit and an audio unit; The audio unit is connected to the decoding unit and is used to obtain a first audio signal from the decoding unit for playback; The display unit is connected to the decoding unit and is used to obtain the video signal from the decoding unit for playback.

3. The multimedia output device according to claim 2, wherein: The main control unit is connected to the connection interface through a USB audio class protocol, and the main control unit is connected to the audio unit through communication; The main control unit obtains a second audio signal from the multimedia signal source device through the connection interface using the USB audio class protocol, and sends the second audio signal to the audio unit.

4. The multimedia output device according to claim 1, wherein: The main control unit is connected to the connection interface via a USB video class protocol communication; The main control unit is used to send the second image signal to the multimedia signal source device through the connection interface using the USB video class protocol.

5. The multimedia output device according to any one of claims 1 to 4, wherein: The multimedia output device further comprises: an electrochromic lens assembly, which is connected to the main control unit and can change transparency under the adjustment of the main control unit.

6. The multimedia output device according to claim 5, wherein: The multimedia output device further includes: a control unit, the control unit being connected to the main control unit; The control unit is used to receive input operations from a user and enable the main control unit to adjust the transparency of the electrochromic lens assembly according to the input operations.

7. The multimedia output device according to any one of claims 1 to 4, wherein: The multimedia output device further includes: a posture information detection unit, including at least one of an inertial measurement unit and a geomagnetic sensor, the posture information detection unit being connected to the main control unit; The inertial measurement unit is used to detect at least one of the angular velocity data and the acceleration data of the multimedia output device, so that the main control unit obtains the data detected by the inertial measurement unit; The geomagnetic sensor is used to detect magnetic data of the multimedia output device, so that the main control unit obtains the magnetic data.

8. The multimedia output device according to any one of claims 1 to 4, wherein: The multimedia output device further includes: a proximity sensor connected to the main control unit; The proximity sensor is used to detect the wearing status data of the multimedia output device by the user, and send the wearing status data to the main control unit, so that the main control unit controls the working status of the multimedia output device in response to the wearing status data.

9. The multimedia output device according to claim 8, wherein: The main control unit is further used to determine the duration of time that the multimedia output device detected by the proximity sensor is in the unworn state, and control the multimedia output device to enter a standby state when it is determined that the duration is greater than a predetermined time.

10. The multimedia output device according to claim 2 or 3, wherein: The audio unit comprises an audio signal processing module and a speaker, wherein the speaker is connected to the audio signal processing module; The audio signal processing module is used to obtain an audio signal and process the audio signal, and the speaker obtains the processed audio signal from the audio signal processing module for playback.

11. The multimedia output device according to claim 10, wherein: The multimedia output device further includes: a microphone, the microphone being connected to the main control unit via the audio signal processing module; The microphone is used to receive external sound signals, and the audio signals are processed by the audio signal processing module and then sent to the main control unit.

12. The multimedia output device according to any one of claims 1 to 4, wherein: The multimedia output device further comprises: an indicator light component and an indicator light driving unit connected to the indicator light component; The indicator light driving unit is connected to the main control unit and is used to receive the indicator light driving signal of the main control unit to drive the indicator light component to achieve different lighting effects.

13. The multimedia output device according to any one of claims 1 to 4, wherein: The multimedia output device is a head mounted display device.

14. A multimedia system, characterized in that: include: A multimedia signal source device, and a multimedia output device as claimed in any one of claims 1 to 13.