Transparent display system and control method and control device thereof
By introducing the information extraction component and the detection, resource allocation and identification unit of the control device into the transparent display system, the problem of difficulty in accurately displaying information in large-size transparent displays is solved, and resource consumption is reduced and information is accurately displayed.
Patent Information
- Application Number
- CN202111392198.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-11-20
- Filing Date
- 2021-11-19
- Publication Date
- 2025-01-21
- Estimated Expiration
- 2041-11-19
AI Technical Summary
In large-size transparent displays, it is difficult to accurately display the display information in the user's line of sight, resulting in a large cost of processing resources.
Design a transparent display system, including information extraction components, transparent displays and control devices. The control device obtains resource configuration according to the detection information through the detection unit, resource allocation unit and identification unit, and identifies the user's internal position information and the target object's external position information, thereby accurately displaying the information.
Through resource allocation technology and position recognition technology, the processing resource consumption of the transparent display system in large-size transparent displays is reduced, and information is accurately displayed at the user's line of sight.
Smart Images

Figure CN114518921B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a transparent display system and a control method and a control device thereof. Background Art
[0002] With the rapid development of display technology, various types of displays are constantly being innovated. For example, a transparent display can display information on a transparent material so that a user can see the target object and the displayed information behind the transparent display.
[0003] The display information can be used to introduce and explain the target object. When the position of the user or the target object relative to the transparent display changes, the user's line of sight on the transparent display will not be the same. The display information must be accurately displayed at the line of sight. Especially in large-sized transparent displays, it takes a lot of processing resources to accurately display the display information at the line of sight. Summary of the invention
[0004] The present disclosure relates to a transparent display system and a control method and a control device thereof.
[0005] According to another aspect of the present disclosure, a transparent display system is proposed. The transparent display system includes an information extraction component, a transparent display, and a control device. The information extraction component is used to obtain at least one detection information. The control device includes a detection unit, a resource configuration unit, and an identification unit. The detection unit is used to detect at least one user in front of the transparent display and at least one target object behind the transparent display based on at least one detection information. The resource configuration unit is used to obtain resource configuration based on the detection result of at least one detection information. The information extraction component obtains at least one identification information based on the resource configuration. The identification unit also identifies at least one pair of internal position information of at least one user and at least one pair of external position information of at least one target object based on the resource configuration.
[0006] According to one aspect of the present disclosure, a control method for a transparent display system is provided. The control method for a transparent display system includes the following steps: Detecting at least one user in front of a transparent display and at least one target object behind the transparent display to obtain at least one detection information. Obtaining resource configuration based on the at least one detection information. Obtaining at least one pair of internal position information of at least one user and at least one pair of external position information of at least one target object based on the resource configuration.
[0007] According to another aspect of the present disclosure, a control device is provided. The control device includes a detection unit, a resource configuration unit, and an identification unit. The detection unit is used to detect at least one user in front of the transparent display and at least one target object behind the transparent display according to at least one detection information. The resource configuration unit is used to obtain resource configuration according to the detection result of at least one detection information. The information extraction component obtains at least one identification information according to the resource configuration. The identification unit also identifies at least one pair of internal position information of at least one user and at least one pair of external position information of at least one target object according to the resource configuration.
[0008] In order to better understand the above and other aspects of the present disclosure, embodiments are given below and described in detail with reference to the accompanying drawings as follows: BRIEF DESCRIPTION OF THE DRAWINGS
[0009] Figure 1 A schematic diagram of a transparent display system according to an embodiment is shown.
[0010] Figure 2 A flow chart of a control method of a transparent display system according to an embodiment is shown.
[0011] Figure 3 A schematic diagram of a transparent display system according to an embodiment is shown.
[0012] Figure 4 A flow chart of a control method of a transparent display system according to an embodiment is shown.
[0013] Figure 5 A schematic diagram of a transparent display system according to an embodiment is shown.
[0014] Figure 6 A flow chart of a control method of a transparent display system according to an embodiment is shown.
[0015] Figure 7 A schematic diagram of a transparent display system according to an embodiment is shown.
[0016] Figure 8 A flow chart of a control method of a transparent display system according to an embodiment is shown.
[0017] Fig. 9 Intranet identification information according to an embodiment is shown.
[0018] Fig.10 A schematic diagram of a transparent display system according to an embodiment is shown.
[0019] Fig.11 A schematic diagram of a transparent display system according to an embodiment is shown.
[0020] Fig.12A flow chart of a control method of a transparent display system according to an embodiment is shown.
[0021] Fig.13 A schematic diagram of a transparent display system according to an embodiment is shown.
[0022] Fig.14 A flow chart of a control method of a transparent display system according to an embodiment is shown.
[0023]
Explanation of symbols
[0024] 100, 200, 300, 400, 500, 600, 700: Transparent display system
[0025] 110, 210, 310, 410, 510, 610, 710: Information extraction components
[0026] 120, 620, 720: Transparent display
[0027] 130, 230, 330, 430, 630: Control device
[0028] 131, 231, 331, 431, 631, 731: Detection unit
[0029] 132, 232, 332, 432, 632, 732: resource configuration unit
[0030] 133, 233, 333, 433, 633, 733: Identification unit
[0031] 134:Merge Unit
[0032] 135: Fusion Unit
[0033] 136: Output unit
[0034] 137: Storage unit
[0035] 210b, 610b: external image extraction unit
[0036] 210f, 610f: internal image extraction unit
[0037] 310w: Wide-angle image acquisition unit
[0038] 410db, 510db, 710db: external detection information extraction unit
[0039] 410df, 510df, 710df: Internal detection information extraction unit
[0040] 410rb, 510rb, 710rb: external identification information extraction unit
[0041] 410rf, 510rf, 710rf: Internal identification information extraction unit
[0042] 6331, 6332, 6333, 6334: Processor
[0043] DI1: Display information
[0044] DR, DR2, DR3, DR4, DR6, DR7: test results
[0045] Lb1: External location information
[0046] Lb1': External relative position information
[0047] Lf1: Internal position information
[0048] Lf1': internal relative position information
[0049] LS1: Line of sight
[0050] Md: Detection information
[0051] Mdb: External testing information
[0052] Mdf: Internal detection information
[0053] Mdw: wide angle detection information
[0054] Mr: Identification information
[0055] Mrb: External identification information
[0056] Mrf: Internal identification information
[0057] Mrw: Wide-angle recognition information
[0058] O1: target object
[0059] P1: User
[0060] RA, RA2, RA3, RA4, RA6, RA7: Resource allocation DETAILED DESCRIPTION
[0061] Please refer to Figure 1, which depicts a schematic diagram of a transparent display system 100 according to an embodiment. The transparent display system 100 includes an information extraction component 110, a transparent display 120, and a control device 130. The information extraction component 110 is composed of at least one image extraction unit, an infrared sensor, and a radar sensor of the same / different resolution and the same / different type. The image extraction unit may include, for example, a camera, a video camera, an infrared sensor, or a radar sensor. The transparent display 120 is a transparent or light-transmissive display panel. The transparent display 120 is, for example, a landscape glass disposed on an observation deck or a glass of a tank in an aquarium. The information extraction component 110 is, for example, disposed above or adjacent to the transparent display 120 to obtain at least one user P1 in front of the transparent display 120 and at least one target object O1 behind the transparent display 120. The control device 130 may include, for example, a computer, a server, a cloud computing center, a circuit board, a circuit, a computer program product, a computer-readable recording medium or a chip, etc. The control device 130 may analyze the sight line position LS1 of the user P1 on the transparent display 120 , and display the display information DI1 on the transparent display 120 .
[0062] In this embodiment, the transparent display 120 can be a large-size panel or a plurality of small-size panels spliced together. The control device 130 uses resource configuration technology to allocate the processing resources of the information extraction component 110, or uses resource allocation technology to allocate the internal processing resources of the control device 130 to reduce the overall processing resource consumption.
[0063] The control device 130 includes a detection unit 131, a resource configuration unit 132, an identification unit 133, a merging unit 134, a fusion unit 135 and an output unit 136. The functions of each component are summarized as follows. The detection unit 131 is used to detect whether there are humans or objects. The resource configuration unit 132 is used to perform resource configuration. The identification unit 133 is used to accurately identify the position of humans or objects. The merging unit 134 is used to merge the identified positions. The fusion unit 135 is used to fuse coordinate systems. The output unit 136 is used to output various information. In this embodiment, the processing resources of the information extraction component 110 or the internal processing resources of the control device 130 are allocated through resource configuration technology to reduce the overall processing resource consumption. The operation of each component is described in detail below through a flowchart.
[0064] Please refer to Figure 2, which depicts a flow chart of a control method of a transparent display system 100 according to an embodiment. The computer program product can execute the control method of the transparent display system 100 after the computer loads the computer program. In step S100, the detection unit 131 obtains at least one detection information Md from the information extraction component 110. The at least one detection information Md is, for example, at least one internal detection information obtained toward the front of the transparent display 120 or at least one external detection information obtained toward the rear of the transparent display 120. The internal detection information and the external detection information are, for example, two different images. Alternatively, the at least one detection information Md is, for example, a plurality of wide-angle detection information obtained simultaneously toward the front and rear of the transparent display 120. The wide-angle detection information is, for example, a wide-angle image. Various different implementation situations will be described in diagrams later.
[0065] Next, in step S110, the detection unit 131 detects at least one user P1 in front of the transparent display 120 and at least one target object O1 behind the transparent display 120 according to the detection information Md. The detection unit 131 mainly detects whether there is a user P1 and / or a target object O1.
[0066] Then, in step S120, the resource configuration unit 132 obtains the resource configuration RA according to the detection result DR of the detection information Md. The resource configuration RA is, for example, setting the frame rate of image recognition / frequency of information recognition, setting the area of image / information recognition, setting the activation status of the information extraction component 110, etc. Various different implementations will be described in the following diagrams.
[0067] Next, in step S130, the information extraction component 110 obtains at least one piece of identification information Mr according to the resource configuration RA, and the identification unit 133 identifies at least one pair of internal position information Lf1 of at least one user P1 and at least one piece of external position information Lb1 of at least one target object O1 according to the resource configuration RA. The at least one piece of identification information Mr is, for example, at least one piece of internal identification information obtained toward the front of the transparent display 120 or at least one piece of external identification information obtained toward the rear of the transparent display 120. Alternatively, the at least one piece of identification information Mr may be, for example, a plurality of wide-angle identification information obtained from the front and rear of the transparent display 120. The identification information Mr and the detection information Md are, for example, extracted by the same image extraction unit; or the identification information Mr and the detection information Md are, for example, extracted by different image extraction units or different types of devices. Various different implementations will be described in the following diagrams. The internal position information Lf1 is the position in the identification information Mr, which does not correspond to the position of the entire transparent display 120 ; the external position information Lb1 is the position in the identification information Mr, which does not correspond to the position of the entire transparent display 120 .
[0068] Then, in step S140, the merging unit 134 integrates the plurality of internal position information Lf1 and the plurality of external position information Lb1 to obtain a plurality of internal relative position information Lf1' and a plurality of external relative position information Lb1'. The internal relative position information Lf1' corresponds to the position of the entire transparent display 120; the external relative position information Lb1' corresponds to the position of the entire transparent display 120.
[0069] In one embodiment, if the user P1 and / or the target object O1 is located within the processing range of the information extraction component 110 such as a single image extraction unit, infrared sensor or radar sensor, step S140 can be omitted. In other words, no integration is required, and the internal position information Lf1 and / or the external position information Lb1 at this time already correspond to the position of the entire transparent display 120.
[0070] Next, in step S150, the fusion unit 135 fuses at least one pair of internal relative position information Lf1' and at least one pair of external relative position information Lb1' to obtain at least one sight line position LS1. The fusion unit 135 fuses the coordinate systems of the two to analyze the sight line position LS1 on the transparent display 120 based on the line connecting the internal relative position information Lf1' and the external relative position information Lb1'.
[0071] Then, in step S160, the output unit 136 outputs at least one display information DI1 to the transparent display 120 according to at least one sight line position LS1. In one embodiment, a storage unit 137 may be further included to store various information, for example, the display information DI1 may be stored in the storage unit 137.
[0072] In the above step S120, the resource configuration RA is, for example, setting the frame rate of image recognition / frequency of information recognition, setting the area of image / information recognition, setting the activation status of the information extraction component 110, etc. Various implementations will be described in the following diagrams.
[0073] Please refer to Figure 3 , which is a schematic diagram of a transparent display system 200 according to an embodiment. Figure 3 In the embodiment of the transparent display system 200, the information extraction component 210 includes a plurality of internal image extraction units 210f and a plurality of external image extraction units 210b. The internal image extraction units 210f can be used to extract internal detection information Mdf and internal recognition information Mrf. The external image extraction units 210b are used to extract external detection information Mdb and external recognition information Mrb.
[0074] Please refer to Figure 4, which illustrates a flow chart of a control method of a transparent display system 200 according to an embodiment. In step S200 , the detection unit 231 of the control device 230 obtains the internal detection information Mdf and the external detection information Mdb from the information extraction component 210 .
[0075] Next, in step S210 , the detection unit 231 detects at least one user P1 in front of the transparent display 120 and at least one target object O1 behind the transparent display 120 according to the internal detection information Mdf and the external detection information Mdb.
[0076] Then, in step S220, the resource allocation unit 232 obtains a resource allocation RA2 according to a detection result DR2 of the internal detection information Mdf and the external detection information Mdb. The resource allocation RA2 includes controlling the internal image extraction unit 210f to obtain the internal recognition information Mrf at different frame rates and controlling the external image extraction unit 210b to obtain the external recognition information Mrb at different frame rates.
[0077] Next, in step S230, the information extraction component 210 obtains the internal recognition information Mrf at different frame rates according to the resource configuration RA2, and obtains the external recognition information Mrb at different frame rates, and the recognition unit 233 recognizes at least one internal position information Lf1 of at least one user P1 and at least one external position information Lb1 of at least one target object O1. For example, Figure 3 As shown, the user P1 is detected in the first internal detection information Mdf from the left, so the first internal image extraction unit 210f from the left obtains the internal recognition information Mrf at a higher frame rate, and the remaining internal image extraction units 210f obtain the internal recognition information Mrf at a lower frame rate. Figure 3 As shown, the target object O1 is detected in the third external detection information Mdb from the left, so the third external image extraction unit 210b from the left obtains the external recognition information Mrb at a higher frame rate, and the remaining external image extraction units 210b obtain the external recognition information Mrb at a lower frame rate.
[0078] Then, the process proceeds to step S140. The subsequent steps S140 to S160 are the same as those described above. Figure 2 The content will not be repeated here.
[0079] Please refer to Figure 5 , which is a schematic diagram of a transparent display system 300 according to an embodiment. Figure 5In the embodiment of the transparent display system 300, the information extraction component 310 includes at least one wide-angle image extraction unit 310w. The wide-angle image extraction unit 310w is used to extract wide-angle detection information Mdw and wide-angle recognition information Mrw. The detection range of the wide-angle detection information Mdw covers the front of the transparent display 120 and the rear of the transparent display 120. The imaging range of the wide-angle recognition information Mrw covers the front of the transparent display 120 and the rear of the transparent display 120.
[0080] Please refer to Figure 6 , which is a flow chart of a control method of a transparent display system 300 according to an embodiment. In step S300 , the detection unit 331 of the control device 330 obtains wide-angle detection information Mdw from the information extraction component 310 .
[0081] Next, in step S310 , the detection unit 331 detects at least one user P1 in front of the transparent display 120 and at least one target object O1 behind the transparent display 120 according to the wide-angle detection information Mdw.
[0082] Then, in step S320, the resource configuration unit 332 obtains the resource configuration RA3 according to the detection result DR3 of the wide-angle detection information Mdw. The resource configuration RA3 includes controlling the wide-angle image extraction unit 310w to obtain the wide-angle recognition information Mrw at different frame rates.
[0083] Next, in step S330, the information extraction component 310 obtains the wide-angle recognition information Mrw at different frame rates according to the resource configuration RA3, and the recognition unit 333 recognizes at least one pair of inner position information Lf1 of at least one user P1 and at least one pair of outer position information Lb1 of at least one target object O1. Figure 5 As shown, the user P1 is detected in the first wide-angle detection information Mdw from the left, and the target object O1 is detected in the third wide-angle detection information Mdw from the left. Therefore, the first wide-angle image extraction unit 310w and the third wide-angle image extraction unit 310w from the left obtain the wide-angle recognition information Mrw at a higher frame rate, and the remaining wide-angle image extraction units 310w obtain the wide-angle recognition information Mrw at a lower frame rate.
[0084] Then, the process proceeds to step S140. The subsequent steps S140 to S160 are the same as those described above. Figure 2 The content will not be repeated here.
[0085] Please refer to Figure 7 , which is a schematic diagram of a transparent display system 400 according to an embodiment. Figure 7In the embodiment of the transparent display system 400, the information extraction component 410 includes an internal detection information extraction unit 410df, an external detection information extraction unit 410db, an internal identification information extraction unit 410rf, and an external identification information extraction unit 410rb. The internal detection information extraction unit 410df is used to extract internal detection information Mdf. The external detection information extraction unit 410db is used to extract external detection information Mdb. The internal identification information extraction unit 410rf is used to extract internal identification information Mrf. The external identification information extraction unit 410rb is used to extract external identification information Mrb. The internal detection information extraction unit 410df, the external detection information extraction unit 410db, the internal identification information extraction unit 410rf, and the external identification information extraction unit 410rb are, for example, image capture devices. The resolution of the internal detection information extraction unit 410df is lower than the resolution of the internal identification information extraction unit 410rf. The resolution of the external detection information extraction unit 410db is lower than the resolution of the external identification information extraction unit 410rb.
[0086] That is, the low-resolution internal detection information extraction unit 410df and the external detection information extraction unit 410db are used to detect the presence of the user P1 or the target object O1, while the high-resolution internal identification information extraction unit 410rf and the external identification information extraction unit 410rb are used to identify the position of the user P1 or the target object O1.
[0087] In one embodiment, a wide-angle detection information extraction unit and / or a wide-angle recognition information extraction unit may be used, and the detection range and / or imaging range of the wide-angle detection information and / or the wide-angle recognition information may cover the front and rear of the transparent display 120 .
[0088] Please refer to Figure 8 , which illustrates a flow chart of a control method of a transparent display system 200 according to an embodiment. In step S400 , the detection unit 431 of the control device 430 obtains the internal detection information Mdf and the external detection information Mdb from the information extraction component 410 .
[0089] Next, in step S410 , the detection unit 431 detects at least one user P1 in front of the transparent display 120 and at least one target object O1 behind the transparent display 120 according to the internal detection information Mdf and the external detection information Mdb.
[0090] Then, in step S420, the resource allocation unit 432 obtains a resource allocation RA4 according to a detection result DR4 of the internal detection information Mdf and the external detection information Mdb. Figure 7 In the embodiment of FIG. 4 , the resource configuration RA4 is transmitted to the identification unit 433 .
[0091] Next, in step S430, the information extraction component 410 obtains the internal identification information Mrf and the external identification information Mrb, and the identification unit 433 identifies only a partial area of the internal identification information Mrf and only a partial area of the external identification information Mrb according to the resource configuration RA4, so as to identify at least one pair of internal position information Lf1 of at least one user P1 and at least one pair of external position information Lb1 of at least one target object O1.
[0092] For example, see Fig. 9 , which illustrates the internal identification information Mrf according to an embodiment. Under the resource configuration RA4, only the oblique line area of the internal identification information Mrf may be identified to improve the identification efficiency.
[0093] Then, the process proceeds to step S140. The subsequent steps S140 to S160 are the same as those described above. Figure 2 The content will not be repeated here.
[0094] Please refer to Fig.10 , which is a schematic diagram of a transparent display system 500 according to an embodiment. Fig.10 In the embodiment of the transparent display system 500, the information extraction component 510 includes an internal detection information extraction unit 510df, an external detection information extraction unit 510db, an internal identification information extraction unit 510rf, and an external identification information extraction unit 510rb. The internal detection information extraction unit 510df, the external detection information extraction unit 510db, the internal identification information extraction unit 510rf, and the external identification information extraction unit 510rb are, for example, image extraction devices. The resolution of the internal detection information extraction unit 510df is lower than that of the internal identification information extraction unit 510rf, and the detection image range of the internal detection information extraction unit 510df may be different from the imaging range of the internal identification information extraction unit 510rf. The resolution of the external detection information extraction unit 510db is lower than that of the external identification information extraction unit 510rb, and the detection range of the external detection information extraction unit 510db may be different from the imaging range of the external identification information extraction unit 510rb.
[0095] That is, the low-resolution internal detection information extraction unit 510df and the external detection information extraction unit 510db are used to detect whether there is a user P1 or a target object O1. The high-resolution internal identification information extraction unit 510rf and the external identification information extraction unit 510rb can be used to identify the position of the user P1 or the target object O1. The internal detection information extraction unit 510df and the internal identification information extraction unit 510rf can be set at different locations, and the external detection information extraction unit 510db and the external identification information extraction unit 510rb can be set at different locations, and the information alignment is performed later.
[0096] In one embodiment, a low-resolution wide-angle detection information extraction unit and a high-resolution wide-angle recognition information extraction unit may be used, and the low-resolution wide-angle detection information extraction unit and the high-resolution wide-angle recognition information extraction unit may be disposed at different locations.
[0097] Please refer to Fig.11 , which is a schematic diagram of a transparent display system 600 according to an embodiment. Fig.11 In the embodiment of the transparent display system 600, the information extraction component 610 includes a plurality of internal image extraction units 610f and a plurality of external image extraction units 610b. The internal image extraction units 610f are used to extract internal detection information Mdf and internal recognition information Mrf. The external image extraction units 610b are used to extract external detection information Mdb and external recognition information Mrb.
[0098] Please refer to Fig.12 , which illustrates a flow chart of a control method of a transparent display system 600 according to an embodiment. In step S600 , the detection unit 631 of the control device 630 obtains the internal detection information Mdf and the external detection information Mdb from the information extraction component 610 .
[0099] Next, in step S610, the detection unit 631 detects at least one user P1 in front of the transparent display 620 and at least one target object O1 behind the transparent display 620 according to the internal detection information Mdf and the external detection information Mdb. The transparent display 620 is, for example, composed of a plurality of display panels.
[0100] Then, in step S620 , the resource allocation unit 632 obtains a resource allocation RA6 according to a detection result DR6 of the internal detection information Mdf and the external detection information Mdb.
[0101] Next, in step S630, the information extraction component 610 obtains the internal identification information Mrf and the external identification information Mrb, and the identification unit 633 identifies at least one internal position information Lf1 of at least one user P1 and at least one external position information Lb1 of at least one target object O1 according to the resource configuration RA6. The resource configuration RA6 includes controlling the identification unit 633 to identify only part of the internal identification information Mrf and controlling the identification unit 633 to identify only part of the external identification information Mrb. For example, the identification unit 633 may include a plurality of processors 6331-6334. Fig.11As shown, the user P1 is detected in the first internal detection information Mdf from the left, and the target object O1 is detected in the fourth external detection information Mdb from the left. Therefore, the first processor 6331 identifies the internal identification information Mrf, the fourth processor 6334 identifies the external identification information Mrb, and the remaining processors 6332 and 6333 do not perform any identification.
[0102] Then, the process proceeds to step S140. The subsequent steps S140 to S160 are the same as those described above. Figure 2 The content will not be repeated here.
[0103] Please refer to Fig.13 , which is a schematic diagram of a transparent display system 700 according to an embodiment. Fig.13 In the embodiment of the transparent display system 700, the information extraction component 710 includes a plurality of internal detection information extraction units 710df, a plurality of external detection information extraction units 710db, a plurality of internal identification information extraction units 710rf, and a plurality of external identification information extraction units 710rb. The internal detection information extraction unit 710df is used to extract internal detection information Mdf. The external detection information extraction unit 710db is used to extract external detection information Mdb. The internal identification information extraction unit 710rf is used to extract internal identification information Mrf. The external identification information extraction unit 710rb is used to extract external identification information Mrb. The internal detection information extraction unit 710df, the external detection information extraction unit 710db, the internal identification information extraction unit 710rf, and the external identification information extraction unit 710rb are, for example, image capture devices. The resolution of the internal detection information extraction unit 710df is lower than that of the internal identification information extraction unit 710rf. The resolution of the external detection information extraction unit 710db is lower than the resolution of the external identification information extraction unit 710rb.
[0104] That is, the low-resolution internal detection information extraction unit 710df and the external detection information extraction unit 710db are used to detect the presence of the user P1 or the target object O1, while the high-resolution internal identification information extraction unit 710rf and the external identification information extraction unit 710rb are used to identify the position of the user P1 or the target object O1.
[0105] Please refer to Fig.14 , which illustrates a flow chart of a control method of a transparent display system 700 according to an embodiment. In step S700 , the detection unit 731 obtains the internal detection information Mdf and the external detection information Mdb from the information extraction component 710 .
[0106] Next, in step S710, the detection unit 731 detects at least one user P1 in front of the transparent display 720 and at least one target object O1 behind the transparent display 720 according to the internal detection information Mdf and the external detection information Mdb. The transparent display 720 is, for example, composed of a plurality of display panels.
[0107] Then, in step S720, the resource configuration unit 732 obtains the resource configuration RA7 according to the detection result DR7 of the internal detection information Mdf and the external detection information Mdb. In one embodiment, the resource configuration RA4 can be transmitted to the information extraction component 710 and the identification unit 733 at the same time.
[0108] Next, in step S730, the information extraction component 410 obtains the internal identification information Mrf at different frame rates according to the resource configuration RA7, and obtains the external identification information Mrb at different frame rates. The identification unit 733 identifies only a partial area of the internal identification information Mrf and only a partial area of the external identification information Mrb according to the resource configuration RA7, so as to identify at least one pair of internal position information Lf1 of at least one user P1 and at least one pair of external position information Lb1 of at least one target object O1.
[0109] For example, if Fig.13 As shown, the user P1 is detected in the first internal detection information Mdf from the left, and the target object O1 is detected in the third external detection information Mdb from the left. Therefore, the first internal identification information extraction unit 710rf and the third external identification information extraction unit 710rb from the left obtain the internal identification information Mrf and the external identification information Mrb at a higher frame rate, and the remaining internal identification information extraction units 710rf and external identification information extraction units 710rb obtain the internal identification information Mrf and the external identification information Mrb at a lower frame rate.
[0110] In addition, under the resource configuration RA7, only partial areas of the internal identification information Mrf and the external identification information Mrb may be identified to improve the identification efficiency.
[0111] Then, the process proceeds to step S140. The subsequent steps S140 to S160 are the same as those described above. Figure 2 The content will not be repeated here.
[0112] According to the various embodiments described above, the transparent display system may utilize resource configuration technology to allocate processing resources of the information extraction component, or utilize resource allocation technology to allocate processing resources within the control device, so as to reduce the overall consumption of processing resources.
[0113] In summary, although the present disclosure has been disclosed as above by way of embodiments, it is not intended to limit the present disclosure. A person skilled in the art of the present disclosure may make various changes and modifications without departing from the spirit and scope of the present disclosure. Therefore, the protection scope of the present disclosure shall be determined by the attached claims and their equivalents.
Claims
1. A transparent display system, comprising: An information extraction component, used to obtain at least one detection information; Transparent displays; as well as Control device, including: A detection unit, configured to detect at least one user in front of the transparent display and at least one target object behind the transparent display according to the at least one detection information; a resource configuration unit, configured to obtain resource configuration according to the detection result of the at least one detection information, wherein the resource configuration includes setting different frame rates, different frequencies, and different activation conditions for multiple information extraction units, and setting a partial area to be identified for a single information extraction unit; and The identification unit, the information extraction component obtains at least one identification information according to the resource configuration. After the resource configuration unit obtains the resource configuration, the identification unit also identifies at least one pair of internal position information of the at least one user and at least one pair of external position information of the at least one target object according to the resource configuration.
2. The transparent display system as claimed in claim 1, wherein the control device further comprises: a merging unit, respectively integrating the at least one pair of internal position information and the at least one pair of external position information to respectively obtain at least one pair of internal relative position information and at least one pair of external relative position information; a fusion unit, used for fusing the at least one pair of internal relative position information and the at least one pair of external relative position information to obtain at least one sight line position; as well as The output unit is used to output at least one display information to the transparent display according to the at least one sight line position.
3. The transparent display system as claimed in claim 1, wherein the at least one detection information comprises a plurality of internal detection information and a plurality of external detection information, the at least one identification information comprises a plurality of internal identification information and a plurality of external identification information, and the information extraction component comprises: A plurality of internal image extraction units, used for extracting the internal detection information and the internal recognition information; as well as A plurality of external image extraction units are used to extract the external detection information and the external recognition information. 4 . The transparent display system as claimed in claim 3 , wherein the resource configuration comprises controlling the internal image capturing units to obtain the internal recognition information at different frame rates, and controlling the external image capturing units to obtain the external recognition information at different frame rates. 5 . The transparent display system as claimed in claim 3 , wherein the resource configuration comprises controlling the recognition unit to recognize only a portion of the internal recognition information, and controlling the recognition unit to recognize only a portion of the external recognition information.
6. The transparent display system as claimed in claim 1, wherein the at least one detection information comprises a plurality of wide-angle detection information, the at least one identification information comprises a plurality of wide-angle identification information, each of the wide-angle detection information covers the front of the transparent display and the rear of the transparent display, each of the wide-angle identification information covers the front of the transparent display and the rear of the transparent display, and the information extraction component comprises: A plurality of wide-angle image extraction units are used to extract the wide-angle detection information and the wide-angle recognition information. 7 . The transparent display system as claimed in claim 6 , wherein the resource configuration comprises controlling the wide-angle image capturing units to obtain the wide-angle recognition information at different frame rates.
8. The transparent display system as claimed in claim 1, wherein the at least one detection information comprises internal detection information and external detection information, the at least one identification information comprises internal identification information and external identification information, and the information extraction component comprises: An internal detection information extraction unit, used to extract the internal detection information; An external detection information extraction unit, used to extract the external detection information; An internal identification information extraction unit, used to extract the internal identification information, the resolution of the internal detection information extraction unit is lower than the resolution of the internal identification information extraction unit; as well as The external identification information extraction unit is used to extract the external identification information, and the resolution of the external detection information extraction unit is lower than the resolution of the external identification information extraction unit, wherein the resource configuration includes controlling the identification unit to only identify a partial area of the internal identification information and controlling the identification unit to only identify a partial area of the external identification information.
9. The transparent display system as claimed in claim 1, wherein the at least one detection information comprises internal detection information and external detection information, the at least one identification information comprises internal identification information and external identification information, and the information extraction component comprises: An internal detection information extraction unit, used to extract the internal detection information; An external detection information extraction unit, used to extract the external detection information; An internal identification information extraction unit, used to extract the internal identification information, the resolution of the internal detection information extraction unit is lower than the resolution of the internal identification information extraction unit, and the detection range of the internal detection information extraction unit is different from the imaging range of the internal identification information extraction unit; as well as The external identification information extraction unit is used to extract the external identification information. The resolution of the external detection information extraction unit is lower than the resolution of the external identification information extraction unit. The detection range of the external detection information extraction unit is different from the imaging range of the external identification information extraction unit.
10. A control method for a transparent display system, comprising: Detecting at least one user in front of the transparent display and at least one target object behind the transparent display according to at least one detection information; Obtaining resource configuration according to the detection result of the at least one detection information, wherein the resource configuration includes setting different frame rates, different frequencies, and different startup conditions for multiple information extraction units, and setting a partial area to be identified for a single information extraction unit; as well as After the resource configuration is obtained, at least one piece of identification information is obtained according to the resource configuration, and at least one pair of internal position information of the at least one user and at least one pair of external position information of the at least one target object are identified.
11. The control method of the transparent display system according to claim 10, further comprising: Respectively integrating the at least one pair of internal position information and the at least one pair of external position information to respectively obtain at least one pair of internal relative position information and at least one pair of external relative position information; fusing the at least one pair of internal relative position information with the at least one pair of external relative position information to obtain at least one sight line position; as well as At least one display information is output to the transparent display according to at least one sight line position. 12 . The control method of the transparent display system as claimed in claim 10 , wherein the at least one detection information comprises a plurality of internal detection information and a plurality of external detection information, and the at least one identification information comprises a plurality of internal identification information and a plurality of external identification information. 13 . The control method of the transparent display system as claimed in claim 12 , wherein the resource configuration comprises obtaining the internal identification information at different frame rates and obtaining the external identification information at different frame rates. 14 . The control method of the transparent display system as claimed in claim 12 , wherein the resource configuration includes identifying only part of the internal identification information and identifying only part of the external identification information.
15. A control method for a transparent display system as described in claim 10, wherein the at least one detection information includes multiple wide-angle detection information, and the at least one identification information includes multiple wide-angle identification information, each of the wide-angle detection information covers the front of the transparent display and the rear of the transparent display, and each of the wide-angle identification information covers the front of the transparent display and the rear of the transparent display. 16 . The control method of the transparent display system as claimed in claim 15 , wherein the resource configuration comprises obtaining the wide-angle recognition information at different frame rates.
17. A control method for a transparent display system as described in claim 10, wherein the at least one detection information includes internal detection information and external detection information, the at least one identification information includes internal identification information and external identification information, the resolution of the internal detection information is lower than the resolution of the internal identification information, the resolution of the external detection information is lower than the resolution of the external identification information, and the resource configuration includes identifying only a partial area of the internal identification information and only a partial area of the external identification information.
18. A control method for a transparent display system as described in claim 10, wherein the at least one detection information includes internal detection information and external detection information, the at least one identification information includes internal identification information and external identification information, the resolution of the internal detection information is lower than the resolution of the internal identification information, the resolution of the external detection information is lower than the resolution of the external identification information, the detection range of the internal detection information is different from the imaging range of the internal identification information, and the detection range of the external detection information is different from the imaging range of the external identification information.
19. A control device comprising: A detection unit, used for detecting at least one user in front of the transparent display and at least one target object behind the transparent display according to at least one detection information; A resource configuration unit, configured to obtain resource configuration according to the detection result of the at least one detection information, wherein the resource configuration includes setting different frame rates, different frequencies, and different startup conditions for multiple information extraction units, and setting a partial area to be identified for a single information extraction unit; as well as The identification unit identifies at least one pair of internal position information of the at least one user and at least one pair of external position information of the at least one target object according to the resource configuration after the resource configuration unit obtains the resource configuration.
Citation Information
Patent Citations
Transparent display device and control method using same
CN109388233A
Method and apparatus for preload display of object information
CN110908500A