Extended reality (XR) device and data transmission method

Abstract

The present disclosure provides an extended reality (XR) device and a data transmission method. The device includes a physically separated wearable display device and a computing device, the wearable display device is configured to present first multimedia data and collect second multimedia data, the computing device is configured to generate the first multimedia data, process the second multimedia data, and generate control information for the wearable display device; and a wire bundle coupled to the wearable display device and the computing device respectively, configured to transmit an information flow between the wearable display device and the computing device, the information flow at least includes the first multimedia data, the second multimedia data, and the control information. In this way, the weight of the wearable display device can be reduced, thereby improving the comfort and convenience of the user when using.

Description

Technical Field

[0001] The exemplary embodiments disclosed herein generally relate to the field of computers, and more particularly to extended reality XR devices and data transmission methods. Background Technology

[0002] With the development of display, sensing, and computing technologies, Extended Reality (XR) has shown enormous potential in various fields, such as gaming, education, healthcare, and industry. XR includes Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). XR integrates virtual information with the real world by combining hardware devices and various technologies.

[0003] Therefore, users can achieve an immersive experience in a virtual environment by wearing XR devices. Summary of the Invention

[0004] In a first aspect of this disclosure, an extended reality (XR) device is provided. The device includes: a physically separated wearable display device and a computing device, the wearable display device being configured to present first multimedia data and acquire second multimedia data, the computing device being configured to generate the first multimedia data, process the second multimedia data, and generate control information for the wearable display device; and a wiring harness coupled to the wearable display device and the computing device, respectively, configured to transmit an information stream between the wearable display device and the computing device, the information stream including at least the first multimedia data, the second multimedia data, and the control information.

[0005] In a second aspect of this disclosure, a method for data transmission is provided. The method includes: generating first multimedia data by a computing device in an extended reality (XR) device; converting the first multimedia data into a first analog signal by the computing device; and transmitting the first analog signal to a wearable display device in the XR device via a wiring harness, wherein the wearable display device and the computing device are physically separated and coupled via the wiring harness.

[0006] In a third aspect of this disclosure, a method for data transmission is provided. The method includes: acquiring second multimedia data by a wearable display device in an extended reality (XR) device; converting the second multimedia data into a second analog signal by the wearable display device; and transmitting the second analog signal to a computing device in the XR device via a wiring harness, wherein the wearable display device and the computing device are physically separated and coupled via the wiring harness.

[0007] It should be understood that the content described in this content section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0008] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0009] Figure 1 A schematic diagram is shown of an example environment in which embodiments of the present disclosure may be implemented;

[0010] Figure 2 A schematic structural block diagram of an extended reality XR device according to some embodiments of the present disclosure is shown;

[0011] Figure 3A A schematic structural block diagram of an example structure of an XR device according to some embodiments of the present disclosure is shown;

[0012] Figure 3B A schematic structural block diagram showing another example structure of an XR device according to some embodiments of the present disclosure;

[0013] Figure 4 A flowchart illustrating a data transmission process according to some embodiments of the present disclosure is shown; and

[0014] Figure 5 A flowchart of another process for data transmission according to some embodiments of this disclosure is shown. Detailed Implementation

[0015] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0016] It should be noted that the headings of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and embodiments of any type may be included under any section / subsection. Furthermore, embodiments described in any section / subsection may be combined in any way with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0017] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0018] The embodiments of this disclosure may involve user data, data acquisition, and / or use. All of these aspects comply with applicable laws, regulations, and relevant provisions. In the embodiments of this disclosure, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, in implementing the embodiments of this disclosure, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained in accordance with relevant laws and regulations through appropriate means. The specific methods of notification and / or authorization may vary depending on the actual situation and application scenario, and the scope of this disclosure is not limited in this respect.

[0019] In this specification and the embodiments, any processing of personal information will be carried out only under the premise of legality (such as obtaining the consent of the personal information subject, or being necessary for the performance of a contract), and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information other than that necessary for basic functions will not affect the user's use of basic functions.

[0020] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. Environment 100 can be a physical scene, that is, environment 100 can be an example of a real-world scene. In environment 100, user 110 can perform interactive operations by wearing at least one XR device 120. Figure 1 In the example, at least one XR device 120 is shown as including a head-mounted XR device.

[0021] In environment 100, user 110 can utilize an XR device to access virtual environment 130. Virtual environment 130 can be, exemplarily, a space. In some embodiments, virtual objects 140 for user 110 can be generated in virtual environment 130, allowing user 110 to have an immersive interactive experience through virtual objects 140 within virtual environment 130, such as adjusting the actions of virtual objects 140. In some embodiments, virtual tools and / or virtual objects of other users can be provided in virtual environment 130, allowing user 110 to interact with virtual tools in virtual environment 130 through virtual objects 140, and also to interact with virtual objects of other users through virtual objects 140.

[0022] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure.

[0023] As mentioned above, users can achieve an immersive experience in a virtual environment by wearing XR devices. However, XR devices need to process massive amounts of image rendering, sensor data, and complex algorithm calculations in real time. For example, in VR scenes, the device needs to generate a highly realistic 3D virtual environment, which involves real-time rendering of massive amounts of geometry, textures, and lighting effects. Similarly, AR and MR devices need to accurately overlay virtual information onto the real-world scene based on the recognition of the real environment. This not only relies on powerful visual recognition algorithms but also requires real-time fusion calculations of the real-world scene and virtual information.

[0024] To meet these powerful computing demands, XR devices must be equipped with high-performance processors, graphics processing units (GPUs), and large amounts of memory. However, these high-performance hardware components are often bulky and power-hungry, requiring corresponding cooling systems and batteries to ensure proper operation. These additional hardware components undoubtedly increase the weight of XR devices, making it difficult to achieve powerful computing capabilities at the expense of significant weight. This, to some extent, affects user comfort and convenience during extended use.

[0025] Embodiments of this disclosure propose an extended reality (XR) device. The XR device includes: a physically separated wearable display device and a computing device, the wearable display device being configured to present first multimedia data and acquire second multimedia data, the computing device being configured to generate the first multimedia data, process the second multimedia data, and generate control information for the wearable display device; and a wiring harness coupled to the wearable display device and the computing device, respectively, configured to transmit an information stream between the wearable display device and the computing device, the information stream including at least the first multimedia data, the second multimedia data, and the control information.

[0026] In this way, embodiments of the present disclosure can physically separate the wearable display device and the computing device, thereby reducing the weight of the wearable display device and improving user comfort and convenience.

[0027] The following section provides a detailed description of various example implementations of this scheme, with reference to the accompanying drawings.

[0028] Figure 2 A schematic structural block diagram of an extended reality XR device 200 according to some embodiments of the present disclosure is shown. The XR device 200 includes a wearable display device 121, a computing device 122, and a wiring harness 123. The wearable display device 121 and the computing device 122 are physically separate and are coupled via the wiring harness 123.

[0029] The wearable display device 121 is configured to present at least first multimedia data and acquire second multimedia data. The computing device 122 is configured to generate the first multimedia data, process the second multimedia data, and generate control information for the wearable display device 121. The wiring harness 123 is configured to transmit an information stream between the wearable display device 121 and the computing device 123, the information stream including at least the first multimedia data, the second multimedia data, and the control information.

[0030] The wearable display device 121 can be worn on a suitable part of the user's body (e.g., the head), while the computing device 122 can be placed separately on other parts of the body or independently of the user. Compared with conventional XR devices, the XR device provided in the embodiments of this disclosure separates the computing device 122, which generates first multimedia data, processes second multimedia data, and generates control information for the wearable display device 121, from the wearable display device 121. This physically separates the wearable display device 121 and the computing device 122, thereby reducing the weight of the wearable display device 121 and improving user comfort and convenience.

[0031] Figure 3AA schematic structural block diagram of an example structure of an XR device 200 according to some embodiments of the present disclosure is shown. Reference is made below. Figure 2 To describe the XR device 200.

[0032] In some embodiments, the wearable display device 121 includes a first digital-to-analog converter module 316. In embodiments of this disclosure, the first digital-to-analog converter module 316 is configured to convert a first analog signal received via the wiring harness 123 to obtain a first digital signal indicating first multimedia data, so that the wearable display device 121 presents the first multimedia data based on the first digital signal; and to convert second multimedia data into a second analog signal, so as to transmit the second analog signal to the computing device 122 via the wiring harness 123.

[0033] Furthermore, the computing device 122 includes a second digital-to-analog converter module 325. The first digital-to-analog converter module 316 and the second digital-to-analog converter module 325 can be coupled via a wiring harness 123. In embodiments of this disclosure, the second digital-to-analog converter module 325 is configured to convert first multimedia data into a first analog signal for transmission to the wearable display device 121 via the wiring harness 123; and to convert the second analog signal received via the wiring harness 123 to obtain a second digital signal indicating the second multimedia data, so that the computing device 122 can process the second digital signal.

[0034] During the presentation of first multimedia data by the wearable display device 121, the computing device 122 generates a first digital signal indicating the first multimedia data and converts the first digital signal into a first analog signal via a second digital-to-analog converter module 325. The first analog signal is then transmitted to the first digital-to-analog converter module 316 via a wiring harness 123. Upon receiving the first analog signal, the first digital-to-analog converter module 316 converts the first analog signal back into a first digital signal, enabling the wearable display device 121 to present the first multimedia data based on the first digital signal. As an example, the first multimedia data may include text data, image data, video data, VR data, AR data, and MR data. Alternatively or additionally, if the first digital signal indicating the first multimedia data is multiplexed, the second digital-to-analog converter module 325 may aggregate the multiple first digital signals into a single first analog signal to facilitate the transmission of the multiple first digital signals.

[0035] During the processing of the second multimedia data by the computing device 122, the wearable display device 121 acquires the second multimedia data and converts the acquired second multimedia data into a second digital signal. The second digital signal is converted into a second analog signal via the first digital-to-analog converter 316, and then transmitted to the second digital-to-analog converter 325 via the wiring harness 123. Upon receiving the second analog signal, the second digital-to-analog converter 325 converts the second analog signal back into a second digital signal so that the computing device 122 can process the second digital signal. As an example, the second multimedia data may include, for example, image data, video data, gesture and motion capture data, environmental perception data, eye-tracking data, and haptic feedback data. It should be understood that the first and second multimedia data described above are merely exemplary, and the embodiments disclosed herein are not intended to limit them. Alternatively or additionally, when the second digital signal indicating the second multimedia data is multiplexed, the first digital-to-analog converter 316 may aggregate the multiple second digital signals into a single second analog signal to facilitate the transmission of the multiple second digital signals.

[0036] In the above process, since the wearable display device 121 and the computing device 122 are physically separate, the transmission of the first multimedia data and the second multimedia data can be realized through the first conversion module 316 and the second conversion module 325, so that data transmission can be realized between the physically separated wearable display device 121 and computing device 122.

[0037] In some embodiments, the first digital-to-analog converter module 316 and the second digital-to-analog converter module 325 may be the same type of chip or module. For example, both the first digital-to-analog converter module 316 and the second digital-to-analog converter module 325 may be field-programmable gate array (FPGA) chips or modules. In other embodiments, the first digital-to-analog converter module 316 and the second digital-to-analog converter module 325 may be chips or modules of different types. For example, the first digital-to-analog converter module 316 may be an FPGA chip or module, and the second digital-to-analog converter module 325 may be other chips or modules capable of converting between digital and analog signals; or, the second digital-to-analog converter module 325 may be an FPGA chip or module, and the first digital-to-analog converter module 316 may be other chips or modules capable of converting between digital and analog signals. For example, other chips or modules capable of converting between digital and analog signals may include digital-to-analog converter chips (DACs), DAC modules integrated within microcontroller units (MCUs), etc.

[0038] In some embodiments, the wearable display device 121 further includes a display module 311 and a data acquisition module 312. The display module 311 serves as an XR display (e.g., a virtual reality display (VR display) or other XR display). As an example, the display module 311 may include one or more of the following: an OLED display, an LED display, a liquid crystal display, a waveguide display, etc. As another example, the data acquisition module 312 may include one or more of the following: a camera, a webcam, an eye-tracking sensor, a gesture tracking sensor, an inertial measurement unit (IMU), etc.

[0039] Both the display module 311 and the acquisition module 312 can be coupled to the first digital-to-analog converter module 316. The display module 311 is configured to present first multimedia data based on the received first digital signal. The acquisition module 312 is configured to acquire second multimedia data and transmit the acquired second multimedia data to the first digital-to-analog converter module 316. As an example, if the display module 311 is a virtual reality display (VR display), the multiple second digital signals are multiple Mobile Industry Processor Interface (MIPI) signals generated by the virtual reality display. As an example, if the acquisition module is a camera module, the aforementioned multiple second digital signals can also be multiple MIPI signals.

[0040] Furthermore, the computing device 122 also includes a computing module 321. As an example, the computing module 321 may include a system-on-a-chip (SOC), which may include processing resources such as an application processor (AP). In embodiments of this disclosure, the computing module 321 may include or integrate a display module control unit 322 and a data acquisition module control unit 323. Both the display module control unit 322 and the data acquisition module control unit 323 are coupled to the second digital-to-analog converter module 325.

[0041] During the presentation of first multimedia data by the wearable display device 121, a first digital signal indicative of the first multimedia data is generated by the computing module 321 and / or the television module control unit 322, and transmitted to the second digital-to-analog converter module 316 via the display module control unit 322. Upon receiving the first digital signal, the second digital-to-analog converter module 316 converts the first digital signal into a first analog signal and transmits the first analog signal to the first digital-to-analog converter module 316 via the wiring harness 123. Upon receiving the first analog signal, the first digital-to-analog converter module 316 converts the first analog signal into a first digital signal and transmits the first digital signal to the display module 311, so that the display module 311 presents the first multimedia data based on the first digital signal.

[0042] During the processing of the second multimedia data by the computing device 122, the acquisition module 312 converts the acquired second multimedia data into a second digital signal and transmits the second digital signal to the first digital-to-analog converter 316. The first digital-to-analog converter 316 then converts the second digital signal into a second analog signal and transmits the second analog signal to the second digital-to-analog converter 325 via the wiring harness 123. Upon receiving the second analog signal, the second digital-to-analog converter 325 converts the second analog signal into a second digital signal and transmits the second digital signal to the acquisition module control unit 323. This allows the acquisition module control unit 323 and / or the computing module 321 to process the second digital signal, thereby realizing the processing of the second multimedia content.

[0043] Therefore, by setting a display module 311 and a data acquisition module 312 in the wearable display device 121, and setting a display module control unit 322 and a data acquisition module control unit 323 in the computing device 122, the weight of the wearable display device 121 can be reduced while ensuring the basic functions of the wearable display device 121, thereby improving the comfort and convenience for users when wearing the wearable display device 121.

[0044] In some embodiments, the wearable display device 121 further includes a control module 317 coupled to the wiring harness 123. As an example, the control module 317 may be a central processing unit (CPU). In embodiments of this disclosure, the control module 317 is configured to receive control information via the wiring harness 123; and to control at least the display module 311 and / or the acquisition module 312 in the wearable display device 121 based on the control information.

[0045] In embodiments of this disclosure, the control information may at least include signals for controlling (including configuring) the display module 311 and / or the acquisition module 312 in the wearable display device 121. Further, when the wearable display device 121 also includes a speaker 313 and various sensors (e.g., sensors 314, 315, ... etc.), the control information may also include control signals for controlling the speaker 313 and the various sensors. In this case, the speaker 313 and the various sensors may be coupled to the control module 317.

[0046] As an example, control information may include signals such as shooting control signals, parameter adjustment signals, angle and position control signals, mode switching signals, data transmission and storage control signals, and signals for coordination with other components. As an example, the wearable display device 121 may include various sensors such as an IMU sensor, a gravity sensor, a gyroscope, and a temperature sensor.

[0047] During the control of the wearable display device 121 by the computing device 122, the computing module 321 can generate control information for controlling the corresponding components in the wearable display device 121, and transmit the control information to the control module 317 via the wiring harness 123 (which can be coupled to the computing module 321), so that the control module 317 can control the corresponding components in the wearable display device 121 based on the control information. For example, controlling the on / off state of the display device 311 and / or the acquisition device 312, controlling the exposure rate of the acquisition device 312, controlling the on / off state of the speaker 313, and controlling the output audio content, etc.

[0048] In some embodiments, the wiring harness 123 may include a first line 331 and a second line 332. The first line 331 may be coupled to a first digital-to-analog converter module 316 and a second digital-to-analog converter module 325, respectively, and the second line 332 may be coupled to a computing module 321 and a control module 317, respectively. In embodiments of this disclosure, the first line 331 is configured to transmit at least a portion of first multimedia data and second multimedia data between the wearable display device 121 and the computing device 122. The second line 332 is configured to transmit control information between the wearable display device 121 and the computing device 122. The transmission rate of the first line 331 is higher than that of the second line 332. Therefore, the first line is also referred to as a high-speed line, while the second line is referred to as a low-speed line. Signals transmitted via the first line can be high-speed signals, while signals transmitted via the second line can be low-speed signals.

[0049] In some embodiments, the first multimedia data may include visual data and audio data. In some embodiments, the visual data may be transmitted to the wearable display device 121 via a first line 331 (i.e., a high-speed line), and the audio data may be transmitted to the wearable display device 121 via a second line 332 (i.e., a low-speed line). Due to the characteristics of the first and second multimedia data (e.g., continuity, high bandwidth, large data volume, etc.), transmission via a high-speed line can ensure the real-time performance and integrity of the data. Due to the characteristics of the control signal (e.g., intermittent, small data volume, etc.) and / or the characteristics of the audio data (e.g., small data volume, etc.), transmission via a low-speed line is possible.

[0050] In some embodiments, the first line 331 includes an optical fiber, and the second line 332 includes a Universal Serial Bus (USB). Figure 3A An example of the second line 332 being USB is shown. With the second line 332 including USB, the computing device 122 may further include an information encapsulation module 324, which is configured to encapsulate control information and / or audio data into USB signals based on the USB protocol for transmission to the wearable display device 121 via USB. In this way, the compatibility of the signals transmitted by the second line 332 can be improved; for example, not only control signals but also audio data can be transmitted via the second line 332.

[0051] Due to the characteristics of the first and second multimedia data (e.g., continuity, high bandwidth, large data volume), transmitting the first and second multimedia data via optical fiber ensures the real-time nature and integrity of the data. Due to the characteristics of control signals (e.g., intermittent nature, small data volume) and / or audio data (e.g., small data volume), control signals and audio data can be transmitted via USB. Of course, audio data can also be transmitted via optical fiber, as will be described below.

[0052] Figure 3B A schematic structural block diagram of another example structure of an XR device 200 according to some embodiments of the present disclosure is shown below. Figure 2 To describe the XR device 200.

[0053] It should be understood that Figure 3A The example structure shown and Figure 3B The examples shown have the same structure, and the identical parts will not be repeated. The following will introduce... Figure 3A The example structure shown and Figure 3B The examples shown have different structural parts.

[0054] In some embodiments, the wearable display device 121 further includes a third digital-to-analog converter module 318, which is configured to convert a third analog signal received through the wiring harness 123 to obtain control information. Further, the computing device 122 also includes a fourth digital-to-analog converter module 327, which is configured to convert the control information into a third analog signal, so that the wiring harness 123 transmits the third analog signal to the third digital-to-analog converter module 318.

[0055] In some embodiments, the type of the third analog-to-digital converter module 318 may be the same as or different from the type of the first analog-to-digital converter module 316 or the second analog-to-digital converter module 325 described above. Similarly, the type of the fourth analog-to-digital converter module 327 may be the same as or different from the type of the first analog-to-digital converter module 316 or the second analog-to-digital converter module 325 described above. For example, the third analog-to-digital converter module 318 and the fourth analog-to-digital converter module 327 may also include FPGA modules. For a description of the third analog-to-digital converter module 318 and the fourth analog-to-digital converter module 327, please refer to the relevant content of the first analog-to-digital converter module 316 and / or the second analog-to-digital converter module 325 described above, and will not be repeated here.

[0056] In embodiments of this disclosure, the display module 311, acquisition module 312, speaker, and various sensors in the wearable display device 121 can all be coupled to the third digital-to-analog converter module 318. The computing module 321 in the computing power device 122 can be coupled to the fourth digital-to-analog converter module 327 via interface 326.

[0057] During the control of relevant components in the wearable display device 121 by the computing device 122, the computing module 321 in the computing device 122 generates a control signal (a digital signal) for the component to be controlled in the wearable display device 121. This control signal is transmitted to the fourth analog-to-digital converter module 327 via interface 326, so that the fourth analog-to-digital converter module 327 converts the control signal into a third analog signal. The third analog signal is then transmitted to the third analog-to-digital converter module 318 via wiring harness 123. After receiving the third analog signal, the third analog-to-digital converter module 318 converts the third analog signal into a digital signal indicating the control signal, and directly transmits the digital signal indicating the control signal to the corresponding component to be controlled, thereby enabling control of the component to be controlled in the wearable display device 121. As an example, control signals for the controlled components in the wearable display device 121 may include multi-master, multi-slave serial communication protocol (Inter-Integrated Circuit, IIC) signals, high-speed, full-duplex, synchronous serial communication interface (Serial Peripheral Interface, SPI), integrated circuit built-in audio bus (Inter-IC Sound, I2S) signals, etc.

[0058] In the above process, since the wearable display device 121 and the computing device 122 are physically separate, the control signal can be transmitted through the third conversion module 318 and the fourth conversion module 327, so that the physically separated computing device 122 can control the wearable display device 121.

[0059] exist Figure 3B In the example, the wiring harness 123 may also include a first line 331 and a second line 332, and the first line 331 is configured to transmit at least a portion of first multimedia data and second multimedia data between the wearable display device 121 and the computing device 122. The second line 332 is configured to transmit control information between the wearable display device 121 and the computing device 122. Furthermore, the transmission rate of the first line 331 is higher than the transmission rate of the second line 332. Figure 3B In one embodiment, the first line 331 may include an optical fiber, and the second line 332 may include a differential signal line (e.g., a high-speed serial computer expansion bus PCIe signal line) coupled to the third digital-to-analog converter module 318 and the fourth digital-to-analog converter module 326, respectively.

[0060] As an example, the first multimedia data may include visual data and audio data. Since the audio data has been converted into an analog signal during transmission, both the visual data and / or the audio data may be transmitted via the first line 331; or the visual data may be transmitted via the first line 331 and the audio data via the second line 332.

[0061] In some embodiments, Figure 3A or Figure 3B Based on the example structure shown, the wearable display device 121 further includes a first heat dissipation module, and the computing device 122 further includes a second heat dissipation module, wherein the power of the first heat dissipation module is less than the power of the second heat dissipation module. As an example, the first heat dissipation module can be a low-power heat dissipation module or a passive heat dissipation module, and the second heat dissipation module can be a high-power heat dissipation module or an active heat dissipation module. It should be understood that low-power and high-power heat dissipation modules are relative; that is, the power of the first heat dissipation module is less than that of the second heat dissipation module. Since the greater the power of the heat dissipation module, the greater its weight, incorporating a lower-power heat dissipation module in the wearable display device 121 can dissipate heat from the display module 311 and / or the acquisition module 312 while ensuring a reduction in the weight of the wearable display device 121, further improving user comfort.

[0062] Furthermore, the computing device 122 also includes a power module configured to supply power to both the wearable display device 121 and the computing device 122. By incorporating the power module into the computing device 122, the weight of the wearable display device 121 can be further reduced. In this case, the wiring harness 123 may also include a power cable coupled to both the power module and the wearable display device 121.

[0063] In some embodiments, the wearable display device 121 may include a head-mounted display (HMD). Besides a HMD, the wearable display device 121 may also be configured as other wearable structures. It should be understood that the wearing structure of the wearable display device 121 may have different configurations depending on the part of the body it is worn on. For example, when the wearable display device 121 is worn on the head, the wearing structure may be a headband, a glasses frame, etc. For example, when the wearable display device 121 is worn on the wrist, the wearing structure may be a wristband.

[0064] In some embodiments, both the wearable display device 121 and the computing device 122 may include a housing (not shown) and a wearing structure (not shown). It should be understood that the housing of the wearable display device 121 may be configured to accommodate various devices included in the wearable display device 121, and the housing of the computing device 122 may also be configured to accommodate various devices included in the computing device 122. Similarly, the wearing structure or placement position of the computing device 122 may be configured differently based on different wearing locations or intended placement positions, which will not be elaborated here. The embodiments disclosed herein are not intended to limit the housing and wearing structure.

[0065] Embodiments of this disclosure also provide a process for data transmission using the aforementioned devices. Figure 4 A flowchart of a data transmission process 400 according to some embodiments of the present disclosure is shown. Process 400 can be implemented in computing device 122, for example, by corresponding modules / components in computing device 122. The following is in conjunction with... Figure 3A and Figure 3B To describe process 400.

[0066] In frame 410, the computing device 122 in the extended reality XR device 120 generates the first multimedia data.

[0067] In frame 420, the computing device 122 converts the first multimedia data into a first analog signal.

[0068] In frame 430, a first analog signal is transmitted to the wearable display device 121 in the XR device 120 via a wiring harness 123 in the XR device 120. The wearable display device 121 and the computing device 122 are physically separated and coupled via the wiring harness 123.

[0069] In some embodiments, process 400 further includes: generating control information for controlling wearable display device 121 by computing device 122; and transmitting the control information to wearable display device 121 via wiring harness 123.

[0070] In some embodiments, the wiring harness 123 includes a first line 331 and a second line 332, wherein a first analog signal is transmitted to the wearable display device 121 via the first line 331, and control information is transmitted to the wearable display device 121 via the second line 332.

[0071] In some embodiments, transmitting control information to the wearable display device 121 via the wiring harness 123 includes: encapsulating the control information into a USB signal by the information encapsulation module 324 in the XR device 120 based on the Universal Serial Bus (USB) protocol, or converting the control information into a third analog signal by the digital-to-analog converter module 327 in the XR device 120; and transmitting the USB signal or the third analog signal to the wearable display device 121 via the second line 332.

[0072] Figure 5 A flowchart of another process 500 for data transmission according to some embodiments of the present disclosure is shown. Process 500 can be implemented in the wearable display device 121, for example, by a corresponding module / component in the wearable display device 121. The following is in conjunction with... Figure 3A and Figure 3B To describe process 500.

[0073] In frame 510, second multimedia data is acquired by the wearable display device 121 in the extended reality XR device 120.

[0074] In frame 520, the wearable display device 121 converts the second multimedia data into a second analog signal.

[0075] In frame 530, a second analog signal is transmitted to the computing device 122 in the XR device 120 via a wiring harness 123. The wearable display device 121 and the computing device 122 are physically separated and coupled via the wiring harness 123.

[0076] In some embodiments, process 500 further includes: receiving control information from computing device 122 via wiring harness 123 by wearable display device 121; and controlling wearable display device 121 based on the control information.

[0077] In some embodiments, the wiring harness 123 includes a first line 331 and a second line 332, wherein a second analog signal is transmitted to the computing device 122 via the first line 331, and control information is transmitted to the wearable display device 121 via the second line.

[0078] In some embodiments, receiving control information from computing device 122 via wiring harness 123 includes: receiving a Universal Serial Bus (USB) signal or a third analog signal via a second line 332, wherein the USB signal is obtained by the information encapsulation module 324 in computing device 122 encapsulating the control information based on the Universal Serial Bus (USB) protocol, and the third analog signal is obtained by the digital-to-analog converter module 327 in XR device 120 converting the control information; and the USB signal or the third analog signal determines the control information.

[0079] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0080] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0081] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0082] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0083] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some, as newer, implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0084] Various implementations of this disclosure have been described above. The foregoing description is exemplary and not exhaustive, nor is it limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. An extended reality (XR) device, comprising: A physically separated wearable display device and computing device, wherein the wearable display device is configured to present first multimedia data and collect second multimedia data, and the computing device is configured to generate the first multimedia data, process the second multimedia data, and generate control information for the wearable display device; as well as The wiring harness, coupled to the wearable display device and the computing device respectively, is configured to transmit an information stream between the wearable display device and the computing device, the information stream including at least the first multimedia data, the second multimedia data and the control information.

2. The XR device according to claim 1, wherein the wearable display device comprises: The first digital-to-analog converter module, coupled to the wiring harness, is configured as follows: The first analog signal received through the wiring harness is converted to obtain a first digital signal indicating the first multimedia data, so that the wearable display device presents the first multimedia data based on the first digital signal; as well as The second multimedia data is converted into a second analog signal, which is then transmitted to the computing device via the wiring harness.

3. The XR device according to claim 2, wherein the computing power device comprises: The second digital-to-analog converter module, coupled to the wiring harness, is configured as follows: The first multimedia data is converted into the first analog signal, and the first analog signal is transmitted to the wearable display device through the wiring harness; as well as The second analog signal received through the wiring harness is converted to obtain a second digital signal indicating the second multimedia data, so that the computing device can process the second digital signal.

4. The XR device according to claim 2, wherein the wearable display device further comprises: The display module, coupled to the first digital-to-analog converter module, is configured to present the first multimedia data based on the first digital signal; as well as The acquisition module, coupled to the first digital-to-analog conversion module, is configured to acquire the second multimedia data.

5. The XR device according to claim 1, wherein the wearable display device comprises: The control module, coupled to the wiring harness, is configured to: The control information is received via the wiring harness; as well as The control information is used to control at least the display module and / or acquisition module in the wearable display device.

6. The XR device according to claim 1, wherein the wearable display device further comprises: A third analog-to-digital converter module, coupled to the wiring harness, is configured to convert the third analog signal received through the wiring harness to obtain the control information; and The computing device further includes: A fourth digital-to-analog converter module, coupled to the wiring harness, is configured to convert the control information into the third analog signal, so that the wiring harness transmits the third analog signal to the third digital-to-analog converter module.

7. The XR device according to claim 1, wherein the wearable display device further comprises a first heat dissipation module, the computing power device further comprises a second heat dissipation module, and the power of the first heat dissipation module is less than the power of the second heat dissipation module, and / or The computing device further includes a power module configured to supply power to the wearable display device and the computing device.

8. The XR device according to claim 1, wherein the wiring harness comprises: A first line is configured to transmit at least a portion of the first multimedia data and the second multimedia data between the wearable display device and the computing device; as well as The second line is configured to transmit the control information between the wearable display device and the computing device; The transmission rate of the first line is higher than that of the second line.

9. The XR device of claim 8, wherein the first multimedia data includes visual data and audio data, and wherein the visual data is transmitted via the first line and the audio data is transmitted via the second line.

10. The XR device of claim 8, wherein the first line comprises an optical fiber, and the second line comprises a Universal Serial Bus (USB), wherein the computing power device further comprises: The information encapsulation module is configured to encapsulate the control information into a USB signal based on the USB protocol for transmission to the wearable display device via the USB.

11. The XR device of claim 8, wherein the first line comprises an optical fiber and the second line comprises a differential signal line.

12. The XR device of claim 1, wherein the wearable display device includes a head-mounted display device.

13. A method for data transmission, comprising: The first multimedia data is generated by the computing power in the extended reality (XR) device; The computing device converts the first multimedia data into a first analog signal; as well as The first analog signal is transmitted to the wearable display device in the XR device via a wiring harness, wherein the wearable display device and the computing device are physically separated and coupled via the wiring harness.

14. The method of claim 13, further comprising: The computing power device generates control information for controlling the wearable display device; as well as The control information is transmitted to the wearable display device via the wiring harness.

15. The method of claim 14, wherein the wiring harness includes a first line and a second line, and wherein the first analog signal is transmitted to the wearable display device via the first line, and the control information is transmitted to the wearable display device via the second line.

16. The method of claim 15, wherein transmitting the control information to the wearable display device via the wiring harness comprises: The control information is encapsulated into a USB signal by the information encapsulation module in the XR device based on the Universal Serial Bus (USB) protocol, or the control information is converted into a third analog signal by the digital-to-analog converter module in the XR device. as well as The USB signal or the third analog signal is transmitted to the wearable display device via the second line.

17. A method for data transmission, comprising: Second multimedia data is acquired by a wearable display device in an extended reality (XR) device; The wearable display device converts the second multimedia data into a second analog signal; as well as The second analog signal is transmitted to the computing device in the XR device via a wiring harness, wherein the wearable display device and the computing device are physically separated and coupled via the wiring harness.

18. The method of claim 17, further comprising: The wearable display device receives control information from the computing device via the wiring harness; as well as The wearable display device is controlled based on the control information.

19. The method of claim 18, wherein the wiring harness includes a first line and a second line, and wherein the second analog signal is transmitted to the computing device via the first line, and the control information is transmitted to the wearable display device via the second line.

20. The method of claim 19, wherein receiving control information from the computing device via the wiring harness comprises: The system receives a Universal Serial Bus (USB) signal or a third analog signal via the second line, wherein the USB signal is obtained by the information encapsulation module in the computing device based on the USB protocol to encapsulate the control information, and the third analog signal is obtained by the digital-to-analog converter in the XR device based on the control information; and The control information is determined from the USB signal or the third analog signal.

Images