Extended reality projection system, notebook computer using same and projection method

Abstract

The invention discloses an extended reality projection system, a notebook computer using the same and a projection method. The projection method includes the following steps. A pair of extended reality glasses is used to shoot an anterior image. The extended reality glasses search an identification pattern of a screen from the image in front of the eyes. The extended reality glasses transmit the identification pattern to a notebook computer. The notebook computer identifies a screen identification code of the screen according to the identification pattern; the notebook computer transmits a picture corresponding to the screen identification code to the extended reality glasses. The extended reality glasses track the recognition pattern to project a picture to the screen.

Description

Technical Field

[0001] The present disclosure relates to an image system and an electronic device and a display method using the same, and more particularly to an extended reality projection system and a notebook computer and a projection method using the same. Background Art

[0002] Laptops have the advantages of being easy to carry, powerful, and convenient for typing, and have become the main computers used by people. In order to be easy to carry, the screen size of laptops is usually less than 16 inches. Users often need to connect an external desktop monitor to expand the display area.

[0003] However, people cannot carry these desktop screens with them, thus still limiting the user experience. Summary of the invention

[0004] The present disclosure relates to an extended reality (XR) projection system and a laptop computer and projection method using the same, which utilizes XR glasses to capture and track the identification pattern of a screen to confirm the screen that the user is currently viewing. The XR glasses can obtain the corresponding image from the laptop computer and project it onto the screen for the user to view. Thus, the user can easily carry the screen to expand the display area of ​​the laptop computer in various places.

[0005] According to one aspect of the present disclosure, a projection method is provided. The projection method includes shooting an image in front of the eyes with an extended reality glasses. The extended reality glasses search for an identification pattern of a curtain in the image in front of the eyes. The extended reality glasses transmit the identification pattern to a laptop computer. The laptop computer identifies a screen identification code of the curtain based on the identification pattern. The laptop computer transmits a picture corresponding to the screen identification code to the extended reality glasses. The extended reality glasses track the identification pattern to project the picture onto the curtain.

[0006] According to another aspect of the present disclosure, a laptop computer is provided. The laptop computer includes a communication unit, an identification unit, and a pairing unit. The communication unit is used to receive an identification pattern of a screen. The identification pattern is searched from an image in front of a pair of extended reality glasses. The identification unit is used to identify a screen identification code of the screen based on the identification pattern. The pairing unit is used to pair a picture corresponding to the screen identification code based on the screen identification code. The communication unit further transmits the picture to the extended reality glasses. The extended reality glasses track the identification pattern to project the picture onto the screen.

[0007] According to another aspect of the present disclosure, an extended reality projection system is provided. The extended reality projection system includes an extended reality glasses and a laptop computer. The extended reality glasses include an image capture unit, a tracking unit, a transmission unit and a projection unit. The image capture unit is used to capture an image in front of the eyes. The tracking unit is used to search for an identification pattern of a curtain in the image in front of the eyes. The transmission unit is used to transmit the identification pattern. The laptop computer includes a communication unit, an identification unit and a pairing unit. The communication unit is used to receive the identification pattern. The identification unit is used to identify a screen identification code of the curtain based on the identification pattern. The pairing unit is used to pair a picture corresponding to the screen identification code based on the screen identification code. The communication unit of the laptop computer further transmits the picture to the transmission unit of the extended reality glasses. The tracking unit of the extended reality glasses tracks the identification pattern so that the projection unit of the extended reality glasses projects the picture onto the curtain.

[0008] In order to better understand the above and other aspects of the present disclosure, embodiments are given below and described in detail with reference to the accompanying drawings: BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 A schematic diagram of an extended reality projection system according to an embodiment is shown.

[0010] Figure 2 A block diagram of an extended reality projection system according to an embodiment is shown.

[0011] Figure 3 A flow chart of a projection method according to an embodiment is shown.

[0012] Figure 4 Examples of images in front of your eyes.

[0013] Figure 5 Example illustrating recognition pattern.

[0014] Figure 6 Another example of identifying a pattern is described below.

[0015] Figure 7 Another example of identifying a pattern is described below.

[0016] Figure 8 Another example of identifying a pattern is described below.

[0017] Fig. 9 Here is another example of an image in front of your eyes.

[0018] Fig.10 This example explains the adjustment of the screen.

[0019] Description of Reference Numerals

[0020] 100: Extended Reality Glasses

[0021] 110: Image capture unit

[0022] 120:Tracking unit

[0023] 130: Transmission unit

[0024] 140: Projection unit

[0025] 200: Laptop

[0026] 210: Communication unit

[0027] 220: Identification unit

[0028] 230: Pairing unit

[0029] 240: Processing unit

[0030] 250: Storage unit

[0031] 310,320,330: curtain

[0032] 1000: Extended Reality Projection System

[0033] FM1, FM9: screen

[0034] FV: Viewing angle

[0035] ID 1: Screen identification code

[0036] IM1,IM9: Images in front of your eyes

[0037] IN: In-line area

[0038] L: Large spacing

[0039] LC1: Location

[0040] LN: Predetermined straight line

[0041] MK1,MK2,MK3,MK4: Identification pattern

[0042] OT: Outside the Line

[0043] P1i, P2i, P3i: White Point

[0044] P4i: Spot

[0045] S: Small pitch

[0046] S110, S120, S130, S140, S150, S160: Steps

[0047] TB1: Pairing table DETAILED DESCRIPTION

[0048] Please refer to Figure 1 , which depicts a schematic diagram of an extended reality (XR) projection system 1000 according to an embodiment. The extended reality projection system 1000 includes an extended reality glasses 100 and a laptop computer 200. In this embodiment, in addition to the screen of the laptop computer 200, the user can add multiple screens 310, 320, 330. These screens 310, 320, 330 can be placed at will. For example, the screen 310 is arranged on the right side of the laptop computer 200, the screen 320 is arranged on the left side of the laptop computer 200, and the screen 330 is arranged diagonally behind the laptop computer 200. When the user wears the extended reality glasses 100, he can watch the screen of the laptop computer 200, or any of the screens 310, 320, 330. When the screen 310 falls into the viewing angle FV of the extended reality glasses 100, the extended reality glasses 100 will capture at least one identification pattern MK1 of the screen 310 to confirm that the user is currently viewing the screen 310, and the extended reality glasses 100 will project the corresponding image FM1 onto the screen 310 for the user to view. Through the technology of this embodiment, the user can easily carry the screens 310, 320, 330 to expand the display area of ​​the notebook computer 200 in various places.

[0049] Please refer to Figure 2 , which illustrates a block diagram of an extended reality projection system 1000 according to an embodiment. In the extended reality projection system 1000, the extended reality glasses 100 include an image capture unit 110, a tracking unit 120, a transmission unit 130 and a projection unit 140. The image capture unit 110 is used to capture static images or record dynamic images, such as a camera, a lens or a charge-coupled device (CCD). The tracking unit 120 is used to identify and track a specific object or symbol, such as a circuit, a chip, a circuit board or a storage device storing program code. The transmission unit 130 is used to transmit data, such as a wired transmission module, a wireless transmission module or a Bluetooth communication module. The projection unit 140 is used to project images, such as an LED micro-projector or a laser micro-projector.

[0050] The notebook computer 200 includes a communication unit 210, an identification unit 220, a pairing unit 230, a processing unit 240 and a storage unit 250. The communication unit 210 is used to transmit data, such as a wired transmission module, a wireless transmission module or a Bluetooth communication module. The identification unit 220 is used to identify the digital code, and the pairing unit 230 is used to perform information pairing. The identification unit 220 and / or the pairing unit 230 are, for example, a circuit, a chip, a circuit board or a storage device storing program codes.

[0051] The processing unit 240 is used to execute various processing programs and control programs, such as a central processing unit (CPU), or other programmable general-purpose or special-purpose microcontrol unit (MCU), microprocessor, digital signal processor (DSP), programmable controller, application specific integrated circuit (ASIC), graphics processing unit (GPU), image signal processor (ISP), image processing unit (IPU), arithmetic logic unit (ALU), complex programmable logic device (CPLD), field programmable gate array (FPGA) or other similar components or combinations of the above components.

[0052] The storage unit 250 is used to store various data, such as any type of fixed or removable random access memory (RAM), read-only memory (ROM), flash memory, hard disk drive (HDD), solid state drive (SSD) or similar elements or a combination of the above elements, and is used to store multiple modules or various application programs that can be executed by the processor 150.

[0053] In this embodiment, the extended reality glasses 100 can capture and track the identification pattern MK1 of the screen 310 through the image capture unit 110 and the tracking unit 120 to confirm the screen 310 that the user is currently viewing. After communicating and processing with the laptop computer 200, the extended reality glasses 100 can obtain the corresponding projection image FM1 from the laptop computer 200, and use the projection unit 140 to project it on the screen 310 for the user to view. Through the technology of this embodiment, the user can easily carry the above-mentioned screens 310, 320, 330 to expand the display area of ​​the laptop computer 200 in various places. The following is a detailed description of the operation of the above-mentioned components with the help of a flow chart.

[0054] Please refer to Figure 3 , which illustrates a flow chart of a projection method according to an embodiment. Figure 4 , which illustrates an image IM1 in front of the eyes. Figure 3 In step S110, Figure 4 As shown, the image IM1 in front of the eyes is captured by the image capture unit 110 of the extended reality glasses 100. The viewing angle FV of the image capture unit 110 (shown in Figure 1 ) is, for example, 80 degrees, 90 degrees or 120 degrees. The viewing angle FV of the image capture unit 110 mostly overlaps with the viewing angle of the user, so the image IM1 in front of the eye can be used to represent the image seen by the user. In one embodiment, step S110 can be repeated and continuously executed to continuously capture the image IM1 in front of the eye as the user's head rotates.

[0055] Next, please refer to Figure 5 , which illustrates the identification pattern MK1. Figure 3 In step S120, Figure 5 As shown, the tracking unit 120 of the extended reality glasses 100 searches for the identification pattern MK1 of the curtain 310 in the image IM1 in front of the eyes. The identification pattern MK1, for example, includes a plurality of white dots P1i. These white dots P1i are disposed on four sides of the curtain 310. In one embodiment, the sizes of these white dots P1i are substantially the same, and the colors are substantially the same. These white dots P1i are fixedly disposed on the curtain 310 or fixedly disposed on the frame of the curtain 310. Different curtains 310, 320, 330 (such as Figure 1 These white dots P1i can be arranged in different ways to form different identification patterns. Figure 5 For example, the white dots P1i are arranged at four sides of the curtain 310 in different numbers, and the white dots P1i can be arranged at four sides of the curtain 310 at different intervals to form a unique identification pattern MK1.

[0056] Then, in Figure 3 In step S130, Figure 2 As shown, the extended reality glasses 100 transmit the identification pattern MK1 to the communication unit 210 of the notebook computer 200 through the transmission unit 130. The transmission unit 130 and the communication unit 210 are connected, for example, through a magnetic transmission line, Bluetooth communication or WiFi communication.

[0057] Then, in Figure 3 In step S140, Figure 2 As shown, the identification unit 220 of the notebook computer 200 identifies a screen identification code ID1 corresponding to the screen 310 according to the identification pattern MK1. Figure 5As shown, starting from the white dot P1i in the upper right corner and counting clockwise, the numbers of the white dots P1i on the four sides are 4, 4, 5, 5, respectively. Therefore, the corresponding screen identification code ID1 can be identified based on the code [4, 4, 5, 5].

[0058] Or, if Figure 5 As shown, starting from the white dot P1i in the upper right corner in a clockwise direction, the spacing of the white dots P1i is small spacing S, large spacing L, small spacing S, small spacing S, small spacing S, large spacing L, small spacing S, small spacing S, small spacing S, large spacing L, small spacing S, large spacing L, small spacing S, small spacing S, and small spacing S. Therefore, the corresponding screen identification code ID1 can be identified based on the encoding [S, L, S, S, S, L, S, S, L, S, S, S].

[0059] Then, in Figure 3 In step S150, Figure 2 As shown, the communication unit 210 of the notebook computer 200 transmits the screen FM1 corresponding to the screen identification code ID1 to the extended reality glasses 100. In this step, the identification unit 220 transmits the screen identification code ID1 to the pairing unit 230. The pairing unit 230 obtains the screen FM1 from the storage unit 250 according to the pre-set pairing table TB1, and sends the screen FM1 to the processing unit 240 for processing. The processed screen FM1 is then transmitted to the extended reality glasses 100 via the communication unit 210.

[0060] Then, in Figure 3 In step S160, Figure 2 As shown, the tracking unit 120 of the extended reality glasses 100 tracks the identification pattern MK1 to project the picture FM1 to the screen 310 through the projection unit 140. In this step, the tracking unit 120, for example, tracks the position LC1 of the identification pattern MK1 in real time, and notifies the projection unit 140 of the position LC1, so that the projection unit 140 correctly projects the picture FM1 on the screen 310.

[0061] In one embodiment, the image FM1 is, for example, a stereoscopic image. The image FM1 can generate stereoscopic vision using left / right eye parallax. Although the image FM1 is projected onto the screen 310, people who do not wear extended reality glasses can also see the image FM1, but only the position of the extended reality glasses 100 can form the correct left / right eye parallax, so only the user wearing the extended reality glasses 100 can correctly feel the stereoscopic vision of the image FM1.

[0062] Through the above-mentioned projection method, the extended reality glasses 100 can confirm the screen 310 that the user is currently viewing through the identification pattern MK1, and obtain the corresponding projection image FM1 from the notebook computer 200 to project it on the screen 310 for the user to view.

[0063] The identification pattern MK1 of the above embodiment uses the number or spacing to identify the screen identification code ID1. In another embodiment, the identification pattern can also use other design methods to identify the screen identification code, please refer to the following description.

[0064] Please refer to Figure 6 , which illustrates another example of the identification pattern MK2. In this embodiment, white dots P2i of different shapes can be arranged on the four sides of the curtain 310 to form the identification pattern MK2. The shapes of these white dots P2i are, for example, circular, rectangular, or triangular. For example, Figure 6 As shown, starting from the white dot P2i in the upper right corner in a clockwise direction, the shapes of the white dot P2i on the four sides are triangle, triangle, rectangle, rectangle, triangle, triangle, circle, circle, triangle, circle, triangle, triangle, circle, rectangle. If circle, triangle, and rectangle are defined as 0, 1, and 2 respectively, the identification unit 220 of the notebook computer 200 can identify the screen identification code according to [1, 1, 2, 2, 1, 1, 0, 0, 1, 0, 1, 1, 0, 2].

[0065] Please refer to Figure 7 , which illustrates another example of the identification pattern MK3. In this embodiment, the white dots P3i can be arranged on the predetermined straight line LN with different offset conditions to form the identification pattern MK3. For example, Figure 7 As shown, starting from the white point P3i in the upper right corner in a clockwise direction, the offsets of these white points P3i are in order: the outer area OT, the outer area OT, the inner area IN, the outer area OT, the outer area OT, the inner area IN, on the predetermined straight line LN, the outer area OT, the inner area IN, the inner area IN, the outer area OT, on the predetermined straight line LN, the outer area OT, the outer area OT, and on the predetermined straight line LN. If the inner area IN, the predetermined straight line LN, and the outer area OT are defined as 0, 1, and 2 respectively, the identification unit 220 of the notebook computer 200 can identify the screen identification code according to [2, 2, 0, 2, 2, 0, 1, 2, 0, 0, 2, 1, 1, 2, 2, 1].

[0066] Please refer to Figure 8 , which illustrates another example of identifying pattern MK4. Figure 8In the embodiment of the present invention, the identification pattern MK4 is composed of light spots P4i disposed on the physical screen of the notebook computer 200. The light spots P4i are, for example, LED lights or infrared lights. These light spots P4i are, for example, disposed on the right side frame, the upper side frame, and the left side frame of the physical screen of the notebook computer 200. In the image in front of the eyes (not shown), usually only one of the right side frame, the upper side frame, and the left side frame of the physical screen is captured. For example, if Figure 8 As shown, the captured light spots P4i are arranged in a straight line. From top to bottom, the brightness of the light spots P1i is dark, bright, dark, dark, bright, bright. If "dark" and "bright" are defined as 0 and 1 respectively, the identification unit 220 of the notebook computer 200 can identify the screen identification code according to [0,1,0,0,1,1].

[0067] The above examples illustrate various identification patterns MK1, MK2, MK3, and MK4, but the present invention is not limited to the above examples. For example, the above light spots can also form dynamic identification patterns with different flashing frequencies, and the identification unit 220 of the notebook computer 200 can also identify the screen identification code based on the different flashing frequencies of these light spots.

[0068] In addition, please refer to Fig. 9 , which illustrates another example of the image IM9 in front of the eyes. Since the extended reality glasses 100 are worn on the face of the user, the user may not be facing the curtain 310, which may cause the curtain 310 to be deformed.

[0069] Please refer to Fig.10 , which illustrates the adjustment of the picture FM9. When the recognition unit 220 of the notebook computer 200 detects the recognition pattern MK1 and learns that the screen 310 is deformed, it can notify the processing unit 240 of the notebook computer 200 to perform an appropriate picture deformation procedure to obtain the picture FM9 corresponding to the current deformation of the screen 310.

[0070] According to the above embodiment, the extended reality glasses 100 can capture and track the identification patterns MK1, MK2, MK3, MK4 of the screen 310 through the image capture unit 110 and the tracking unit 120 to confirm the screen 310, 320, 330 that the user is currently viewing. After the extended reality glasses 100 communicate and process with the laptop computer 200, they can obtain the corresponding images FM1, FM9 from the laptop computer 200 and use the projection unit 140 to project them on the screens 310, 320, 330 for the user to view. Through the technology of this embodiment, the user can easily carry the above-mentioned screens 310, 320, 330 to expand the display area of ​​the laptop computer 200 in various places.

[0071] In summary, although the present disclosure has been disclosed as above by way of embodiments, it is not intended to limit the present disclosure. A person with ordinary knowledge in the technical field to which the present disclosure belongs may make various changes and modifications without departing from the spirit and scope of the present disclosure. Therefore, the protection scope of the present disclosure shall be determined by the definition of the appended claims.

Claims

1. A projection method, characterized in that: include: Using an extended reality glasses to capture an image in front of the eyes; The extended reality glasses search for an identification pattern of a curtain in the image in front of the eye; The extended reality glasses transmit the identification pattern to a laptop computer; The notebook computer identifies a screen identification code of the screen according to the identification pattern; The laptop transmits a picture corresponding to the screen identification code to the extended reality glasses; and The extended reality glasses track the identification pattern to project the image onto the screen.

2. The projection method according to claim 1, characterized in that: The identification pattern includes a plurality of white dots.

3. The projection method according to claim 2, characterized in that: The sizes of the plurality of white dots are substantially the same.

4. The projection method according to claim 2, characterized in that: The notebook computer identifies the screen identification code according to the number of the plurality of white dots on the four sides of the screen.

5. The projection method according to claim 2, characterized in that: The notebook computer identifies the screen identification code according to the multiple intervals between the multiple white dots.

6. The projection method according to claim 2, characterized in that: The notebook computer identifies the screen identification code according to the multiple shapes of the multiple white dots.

7. The projection method according to claim 2, characterized in that: The notebook computer identifies the screen identification code according to a plurality of offset conditions of the plurality of white points along at least one predetermined straight line.

8. The projection method according to claim 1, characterized in that: The identification pattern includes a plurality of light spots.

9. The projection method according to claim 8, characterized in that: The plurality of light spots are arranged on a physical screen of the notebook computer.

10. The projection method according to claim 8, characterized in that: The notebook computer identifies the screen identification code according to the brightness of the plurality of light spots.

11. The projection method according to claim 8, characterized in that: The notebook computer identifies the screen identification code according to the flashing frequency of the plurality of light spots.

12. The projection method according to claim 1, characterized in that: The notebook computer identifies a deformation of the screen according to the identification pattern, and adjusts the screen according to the deformation.

13. The projection method according to claim 1, characterized in that: The picture is a three-dimensional picture.

14. A notebook computer, characterized in that: include: A communication unit for receiving an identification pattern of a curtain, wherein the identification pattern is searched from an image in front of an extended reality glasses; an identification unit for identifying a screen identification code of the screen according to the identification pattern; and a pairing unit, for pairing a picture corresponding to the screen identification code according to the screen identification code; The communication unit further transmits the image to the extended reality glasses, and the extended reality glasses track the identification pattern to project the image onto the screen.

15. An extended reality projection system, characterized in that: include: An extended reality glasses, comprising: An image capture unit for capturing an image in front of the eyes; A tracking unit, used for searching for an identification pattern of a curtain in the image in front of the eye; a transmission unit for transmitting the identification pattern; and a projection unit; and A laptop computer, including: a communication unit for receiving the identification pattern; an identification unit for identifying a screen identification code of the screen according to the identification pattern; and A pairing unit is used to pair a picture corresponding to the screen identification code according to the screen identification code; wherein the communication unit of the laptop computer further transmits the picture to the transmission unit of the extended reality glasses, and the tracking unit of the extended reality glasses tracks the identification pattern so that the projection unit of the extended reality glasses projects the picture onto the screen.

Images