Display method, device and electronic device of transparent screen device

Abstract

The application provides a display method and device of a transparent screen equipment and an electronic equipment, relates to the technical field of transparent screens, and alleviates the technical problem that the transparent effect of the existing transparent screen equipment is poor. The method comprises the following steps: acquiring a viewer image of a viewer from a second image acquisition unit and acquiring a scene background image from a first image acquisition unit; determining an actual binocular position of the viewer based on the viewer image; cutting the scene background image according to the binocular position to obtain a cut part of the scene background image, and outputting the part of the scene background image to a bar-shaped screen for display.

Description

Technical Field

[0001] This application relates to the field of transparent screen technology, and in particular to a display method, apparatus, and electronic device for a transparent screen device. Background Technology

[0002] Interactive transparent screen displays are a new type of display method based on transparent display screens. Transparent screens can achieve a transparency similar to glass, maintaining transparency while ensuring rich colors and detailed display of dynamic images. Common transparent screens include transparent organic light-emitting diode (OLED) displays, transparent liquid crystal displays (LCD) displays, and transparent light-emitting diode (LED) displays.

[0003] However, transparent screens have a driving circuit board connected to them. Both the circuit board itself and the materials that cover or hide the circuit board will obstruct the viewer's view, making it impossible to achieve the effect of a completely transparent area like a piece of glass. As a result, they cannot achieve a truly transparent effect, leading to poor transparency in existing transparent screen devices. Summary of the Invention

[0004] The purpose of this invention is to provide a display method, apparatus, and electronic device for transparent screen devices, so as to alleviate the technical problem of poor transparency effect of existing transparent screen devices.

[0005] In a first aspect, embodiments of this application provide a display method for a transparent screen device. The transparent screen device includes a transparent screen, a strip screen, a first image acquisition unit, and a second image acquisition unit. The display surfaces of the transparent screen and the strip screen are parallel and both face the viewer of the transparent screen. The acquisition direction of the second image acquisition unit faces the viewer, and the acquisition direction of the first image acquisition unit faces the opposite direction to the second image acquisition unit. The method includes:

[0006] The viewer image of the viewer is acquired from the second image acquisition unit, and the scene background image is acquired from the first image acquisition unit;

[0007] Determine the viewer's actual binocular position based on the viewer's image;

[0008] The scene background image is cropped according to the binocular position to obtain a cropped partial scene background image, and the partial scene background image is output to the bar screen for display.

[0009] In one possible implementation, cropping the scene background image based on the binocular position to obtain a cropped portion of the scene background image includes:

[0010] A transformation formula between the binocular position and key parameters of image cropping is established based on the preset calibration position;

[0011] The transformation formula is used to determine the key parameters for current image cropping at the actual binocular position;

[0012] The scene background image is cropped according to the current image cropping key parameters to obtain a cropped partial scene background image so that the partial scene background image is connected with the transparent part of the transparent screen.

[0013] In one possible implementation, the transformation formula between the binocular position and key image cropping parameters based on the preset calibration position includes:

[0014] Two sets of cropping-related parameters are determined by iterative trial and error to crop the scene background image when the binocular position is at two different preset calibration positions; wherein, the two different preset calibration positions correspond to the two sets of cropping-related parameters.

[0015] The transformation formula between the binocular position and the key parameters of image cropping is determined based on the two sets of cropping-related parameters.

[0016] In one possible implementation, each of the two sets of clipping-related parameters includes: a scaling factor, a horizontal coordinate offset, a vertical coordinate offset, and the spatial coordinates of the preset calibration position;

[0017] The key parameters for image cropping include: scaling factor, horizontal coordinate offset, and vertical coordinate offset.

[0018] In one possible implementation, the transformation formula is:

[0019]

[0020] Where a is the current scaling factor for the actual binocular position, i is the current lateral coordinate offset for the actual binocular position, j is the current longitudinal coordinate offset for the actual binocular position, a1 and a2 are the scaling factors corresponding to the two different preset calibration positions, i1 and i2 are the lateral coordinate offsets corresponding to the two different preset calibration positions, j1 and j2 are the longitudinal coordinate offsets corresponding to the two different preset calibration positions, (x1, y1, z1) and (x2, y2, z2) are the spatial coordinates corresponding to the two different preset calibration positions, and (x, y, z) are the spatial coordinates corresponding to the actual binocular position.

[0021] In one possible implementation, the transparent screen device further includes an external structure disposed below the transparent screen;

[0022] The external structure covers all electronic components except for the transparent screen, the first image acquisition unit, and the second image acquisition unit.

[0023] The strip screen is positioned on the side of the external structure facing the viewer and covers at least a portion of the external structure.

[0024] In one possible implementation, the size of the second image acquisition unit is smaller than a preset size; the second image acquisition unit is located in any of the following locations:

[0025] One side of the external structure, the partial opening of the strip screen, and the backlight area of ​​the transparent screen.

[0026] Secondly, a display device for a transparent screen is provided. The transparent screen includes a transparent screen, a strip screen, a first image acquisition unit, and a second image acquisition unit. The display surfaces of the transparent screen and the strip screen are parallel and both face the viewer of the transparent screen. The acquisition direction of the second image acquisition unit faces the viewer, and the acquisition direction of the first image acquisition unit faces the opposite direction to the second image acquisition unit. The device includes:

[0027] The acquisition module is used to acquire the viewer image of the viewer from the second image acquisition unit and the scene background image from the first image acquisition unit;

[0028] The determination module is used to determine the actual binocular position of the viewer based on the viewer image;

[0029] The cropping module is used to crop the scene background image according to the binocular position to obtain a cropped partial scene background image, and output the partial scene background image to the bar screen for display.

[0030] Thirdly, embodiments of this application provide an electronic device, including a memory and a processor, wherein the memory stores a computer program that can run on the processor, and the processor executes the computer program to implement the method described in the first aspect above.

[0031] Fourthly, embodiments of this application also provide a computer-readable storage medium storing computer-executable instructions, which, when invoked and executed by a processor, cause the processor to perform the method described in the first aspect above.

[0032] The embodiments of this application bring the following beneficial effects:

[0033] This application provides a display method, apparatus, and electronic device for a transparent screen device. The transparent screen device includes a transparent screen, a strip screen, a first image acquisition unit, and a second image acquisition unit. The display surfaces of the transparent screen and the strip screen are parallel and both face the viewer of the transparent screen. The acquisition direction of the second image acquisition unit faces the viewer, and the acquisition direction of the first image acquisition unit faces the opposite direction to the second image acquisition unit. The display method of the transparent screen device can acquire a viewer image of the viewer from the second image acquisition unit, acquire a scene background image from the first image acquisition unit, determine the viewer's actual binocular position based on the viewer image, crop the scene background image according to the binocular position to obtain a cropped partial scene background image, and output the partial scene background image to the strip screen for display. In this solution, not only is a strip screen facing the viewer used to cover the opaque display portion, but in addition to the rear-facing camera (the first image acquisition unit) for capturing the background, a front-facing camera (the second image acquisition unit) for capturing the viewer is added. The cameras facing two directions respectively capture images of the real scene and the viewer. Based on the viewer's binocular position, the background area image presented on the strip screen is automatically adjusted through cropping to compensate for the obstruction of the view by the opaque portion, eliminate border obstruction, and make the connection with the transparent portion more harmonious. In other words, the consistency between the transparent screen and the opaque part of the display is improved to achieve a visual harmony effect and enhance the transparency of the transparent screen device.

[0034] To make the above-mentioned objectives, features and advantages of this application more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description

[0035] To more clearly illustrate the technical solutions in the specific embodiments of this application or the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0036] Figure 1 A schematic flowchart illustrating the display method of the transparent screen device provided in this application embodiment;

[0037] Figure 2 This is a schematic diagram of the structure of the transparent screen device provided in the embodiments of this application;

[0038] Figure 3 This is another structural schematic diagram of the transparent screen device provided in the embodiments of this application;

[0039] Figure 4 This is another structural schematic diagram of the transparent screen device provided in the embodiments of this application;

[0040] Figure 5 This is another schematic flowchart illustrating the display method of the transparent screen device provided in the embodiments of this application;

[0041] Figure 6 This is a schematic diagram illustrating a usage scenario of the transparent screen device provided in the embodiments of this application;

[0042] Figure 7 This is another schematic flowchart illustrating the display method of the transparent screen device provided in the embodiments of this application;

[0043] Figure 8 This is another structural schematic diagram of the transparent screen device provided in the embodiments of this application;

[0044] Figure 9 This is a schematic diagram of the structure of a display device for a transparent screen device provided in an embodiment of this application;

[0045] Figure 10 A schematic diagram of the structure of an electronic device provided in an embodiment of this application is shown. Detailed Implementation

[0046] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0047] The terms "comprising" and "having," and any variations thereof, used in the embodiments of this application, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the steps or units listed, but may optionally include other steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or devices.

[0048] Currently, some existing technologies use another display component, such as a strip LED screen, to block and compensate for the portion of the display that cannot reach the light-transmitting area, thereby reducing the bezel ratio. However, this method cannot directly solve the problem of not being able to achieve a completely transparent effect like a piece of glass. This is because when a viewer looks at the transparent screen from different directions, the background through the transparent screen changes with the viewing angle, while the content displayed on the strip screen remains constant. Therefore, it cannot achieve a truly transparent effect from any angle. For example, if the background image is a single, unprocessed image displayed entirely on the strip area, it will obviously be inconsistent with the background of the transparent area. Especially when viewed from different directions, the background through the transparent screen changes while the strip screen remains unchanged, clearly failing to achieve a truly transparent effect, resulting in the poor transparency of existing transparent screen devices.

[0049] Based on this, embodiments of this application provide a display method, apparatus, and electronic device for a transparent screen device, which can alleviate the technical problem of poor transparency effect in existing transparent screen devices.

[0050] The embodiments of the present invention will be further described below with reference to the accompanying drawings.

[0051] Figure 1 This is a flowchart illustrating a display method for a transparent screen device provided in an embodiment of this application.

[0052] The transparent screen device includes a transparent screen, a strip screen, a first image acquisition unit, and a second image acquisition unit. The display surfaces of the transparent screen and the strip screen are parallel and both face the viewer of the transparent screen. The acquisition direction of the second image acquisition unit faces the viewer, while the acquisition direction of the first image acquisition unit faces the opposite direction to that of the second image acquisition unit. Figure 1 As shown, the method includes:

[0053] Step S110: Obtain the viewer image from the second image acquisition unit and the scene background image from the first image acquisition unit.

[0054] It should be noted that existing transparent screens have a connected driving circuit board. Both the circuit board itself and the materials used to cover or conceal it obstruct the viewer's line of sight, preventing the screen from achieving a completely transparent effect like a piece of glass. In this embodiment, a strip-shaped screen is attached to the side of the obstructed area facing the viewer to reduce the obstruction caused by the bezel. Furthermore, in addition to using the strip-shaped LED screen to cover and compensate for the display portion of the obstructed area, this embodiment also includes a second image acquisition unit with its acquisition direction facing the viewer. This mitigates the situation where, when the viewer views the transparent screen from different directions, the background through the transparent screen changes with the viewing angle, while the content displayed on the strip-shaped screen remains unchanged, thus failing to achieve a truly transparent effect from any angle.

[0055] For example, such as Figure 2 and Figure 3 As shown, a fully transparent display all-in-one machine (i.e., a transparent screen device) may include: a transparent screen 1, a strip screen 2, an external structure 3, a main control board 4 (or processor / controller / computing unit), a second image acquisition unit 5, a first image acquisition unit 6, and other auxiliary electronic components, such as the transparent screen Tcon board, driver board, strip screen driver board, power board, interface board, cables, etc. The connection relationships between the various parts are as follows: Figure 4 As shown.

[0056] In practical applications, such as Figure 2 and Figure 3 As shown, the display surfaces of the transparent screen 1 and the strip screen 2 are parallel and both face the viewer. The second image acquisition unit 5 faces the viewer, and the first image acquisition unit 6 faces the opposite direction.

[0057] Step S120: Determine the viewer's actual binocular position based on the viewer's image.

[0058] In practical applications, the main control board can calculate the viewer's binocular position from the viewer image acquired in real time by the second image acquisition unit. Specifically, the viewer's position is obtained using pattern recognition-related image algorithms. The distance z to the display screen can be obtained by integrating structured light, time-of-flight, radar, and ultrasonic ranging modules into the second image acquisition unit, or by using perspective relationships based on fixed biometric features (such as interpupillary distance) where near objects appear larger than distant objects.

[0059] Step S130: The scene background image is cropped according to the binocular position to obtain a cropped partial scene background image, and the partial scene background image is output to the bar screen for display.

[0060] In this step, the scene background image acquired by the first image acquisition unit can be cropped according to the binocular position and output to the bar screen. That is, a part is cropped from the acquired background image and displayed on the bar screen according to the acquired viewer image.

[0061] It should be noted that the cropped image is output to an additional strip screen located behind the opaque part to compensate for the obstruction of the view by the opaque part and eliminate the obstruction of the border.

[0062] Furthermore, the cropped image can be adjusted in terms of color and brightness to ensure that the brightness and hue of the bar screen display are consistent with the background seen through the transparent screen. In practical applications, the transparent screen itself also has at least 60% light loss and a certain degree of haze, which means that the brightness and sharpness of the captured image need to be further reduced, which is different from the requirement of being consistent with the background in stealth applications.

[0063] In this embodiment, in addition to the rear-facing camera (i.e., the first image acquisition unit) for capturing the background, a front-facing camera (i.e., the second image acquisition unit) for capturing the viewer is added. That is, cameras facing two directions are used to capture images of the real scene and the viewer respectively. Based on the viewer's binocular position, the background area image presented on the bar screen is automatically adjusted by cropping to compensate for the obstruction of the field of view by the opaque part, eliminate the obstruction of the border, and make the connection with the transparent part more coordinated. That is, it improves the consistency between the main optical window (transparent screen) of the display and the opaque part to achieve a visual coordination effect.

[0064] The steps described above will be explained in detail below.

[0065] In some embodiments, step S130 above may include the following steps:

[0066] Step a) Establish a transformation formula between the binocular position and key parameters of image cropping based on the preset calibration position;

[0067] Step b) Determine the key parameters for current image cropping for the actual binocular position using a transformation formula;

[0068] Step c) Crops the scene background image according to the current image cropping key parameters to obtain a cropped partial scene background image so that the partial scene background image can be connected with the transparent part of the transparent screen.

[0069] The process of processing the background based on the captured facial image, such as... Figure 5 and Figure 6As shown, after pre-calibration is completed, the background content is cropped by interpolation based on the real-time detection position during actual use. This can be accomplished through global processing of the GPU graphics pipeline (such as OpenGL's fragment sampling shader), which has high processing efficiency and low hardware configuration requirements.

[0070] Based on step a) above, step a) may include the following steps:

[0071] Step d) involves determining two sets of cropping parameters for the scene background image when the binocular position is at two different preset calibration positions through iterative trial and error; where the two different preset calibration positions correspond to two sets of cropping parameters.

[0072] Step e) Determine the transformation formula between the binocular position and the key parameters of image cropping based on the two sets of cropping-related parameters.

[0073] Each of the two sets of cropping-related parameters includes: scaling factor, horizontal coordinate offset, vertical coordinate offset, and spatial coordinates of the preset calibration position; the key parameters for image cropping include: scaling factor, horizontal coordinate offset, and vertical coordinate offset.

[0074] In practical applications, products need to be calibrated during the manufacturing stage. The process for obtaining parameters through calibration, such as... Figure 7 As shown, using an iterative trial-and-error approach, three cropping-related parameters are determined when the main control board needs to crop the acquired background image when the viewer is in two different viewing positions: the scaling factor a, the horizontal coordinate offset i, and the vertical coordinate offset j. Adding the viewer's spatial coordinates at this time, there are a total of two sets of parameters (x1, y1, z1, a1, i1, j1) and (x2, y2, z2, a2, i2, j2). These parameters are the basis for calculating the cropping method corresponding to the current position in real time during actual product use.

[0075] By calibrating at two different locations, the relationship between the viewer's spatial position and key parameters of image cropping can be established without needing to know external parameters such as the camera's field of view and the distance between the background and the screen for complex analysis and calculation. With relatively little computation, the fusion of the background photo and the background object in the field of view can be obtained, achieving a fully transparent display effect.

[0076] Based on this, the above transformation formula is:

[0077]

[0078] Where a is the current scaling factor for the actual binocular position, i is the current lateral coordinate offset for the actual binocular position, j is the current longitudinal coordinate offset for the actual binocular position, a1 and a2 are the scaling factors corresponding to two different preset calibration positions, i1 and i2 are the lateral coordinate offsets corresponding to two different preset calibration positions, j1 and j2 are the longitudinal coordinate offsets corresponding to two different preset calibration positions, (x1, y1, z1) and (x2, y2, z2) are the spatial coordinates corresponding to two different preset calibration positions, and (x, y, z) are the spatial coordinates corresponding to the actual binocular position.

[0079] like Figure 5 , Figure 6 and Figure 7 As shown, the solution adopted in this application embodiment is to pre-calibrate the most suitable scaling ratio and offset values ​​for two typical extreme positions of the human eye, and then perform interpolation based on the real-time detection position to complete the cropping of the background content, thereby achieving high processing efficiency and low hardware configuration requirements.

[0080] In some embodiments, the transparent screen device further includes an external structure disposed below the transparent screen; the external structure covers all electronic components except the transparent screen, the first image acquisition unit, and the second image acquisition unit; a strip screen is disposed on the side of the external structure facing the viewer and covers at least a portion of the external structure.

[0081] like Figure 2 and Figure 3 As shown, the external structure 3 is located below the transparent screen 1 and covers the main control board 4 and all electronic components except for the screen and image acquisition unit. The strip screen 2 is located on the side of the external structure 3 facing the viewer and covers most or all of the external structure 3.

[0082] Based on this, the size of the second image acquisition unit is smaller than the preset size; the second image acquisition unit is located at any of the following locations: one side of the external structure, a partial opening of the strip screen, or the backlight area of ​​the transparent screen.

[0083] In practical applications, the second image acquisition unit only serves to identify and locate the viewer, so image quality requirements are not high. However, its size can obstruct the display, such as... Figure 8 As shown, a smaller camera, such as a pinhole camera, is preferred. It can be placed on the side of the external structure, or in a partial opening of the strip screen, or placed on a transparent screen so that the backlight can pass through the transparent screen to collect data.

[0084] Figure 9A schematic diagram of a display device for a transparent screen is provided. The transparent screen device includes a transparent screen, a strip screen, a first image acquisition unit, and a second image acquisition unit. The display surfaces of the transparent screen and the strip screen are parallel and both face the viewer. The acquisition direction of the second image acquisition unit faces the viewer, and the acquisition direction of the first image acquisition unit faces the opposite direction to the second image acquisition unit. Figure 9 As shown, the display device 900 of the transparent screen device includes:

[0085] The acquisition module 901 is used to acquire the viewer image of the viewer from the second image acquisition unit and the scene background image from the first image acquisition unit;

[0086] The determining module 902 is used to determine the actual binocular position of the viewer based on the viewer image;

[0087] The cropping module 903 is used to crop the scene background image according to the binocular position to obtain a cropped partial scene background image, and output the partial scene background image to the bar screen for display.

[0088] In some embodiments, the cropping module 903 is specifically used for:

[0089] A transformation formula between the binocular position and key parameters of image cropping is established based on the preset calibration position;

[0090] The transformation formula is used to determine the key parameters for current image cropping at the actual binocular position;

[0091] The scene background image is cropped according to the current image cropping key parameters to obtain a cropped partial scene background image so that the partial scene background image is connected with the transparent part of the transparent screen.

[0092] In some embodiments, the trimming module 903 is further configured to:

[0093] Two sets of cropping-related parameters are determined by iterative trial and error to crop the scene background image when the binocular position is at two different preset calibration positions; wherein, the two different preset calibration positions correspond to the two sets of cropping-related parameters.

[0094] The transformation formula between the binocular position and the key parameters of image cropping is determined based on the two sets of cropping-related parameters.

[0095] In some embodiments, each of the two sets of cropping-related parameters includes: scaling factor, horizontal coordinate offset, vertical coordinate offset, and spatial coordinates of the preset calibration position; the key image cropping parameters include: scaling factor, horizontal coordinate offset, and vertical coordinate offset.

[0096] In some embodiments, the transformation formula is:

[0097]

[0098] Where a is the current scaling factor for the actual binocular position, i is the current lateral coordinate offset for the actual binocular position, j is the current longitudinal coordinate offset for the actual binocular position, a1 and a2 are the scaling factors corresponding to the two different preset calibration positions, i1 and i2 are the lateral coordinate offsets corresponding to the two different preset calibration positions, j1 and j2 are the longitudinal coordinate offsets corresponding to the two different preset calibration positions, (x1, y1, z1) and (x2, y2, z2) are the spatial coordinates corresponding to the two different preset calibration positions, and (x, y, z) are the spatial coordinates corresponding to the actual binocular position.

[0099] In some embodiments, the transparent screen device further includes an external structure disposed below the transparent screen; the external structure covers all electronic components except the transparent screen, the first image acquisition unit, and the second image acquisition unit; the strip screen is disposed on the side of the external structure facing the viewer and covers at least a portion of the external structure.

[0100] In some embodiments, the size of the second image acquisition unit is smaller than a preset size; the second image acquisition unit is disposed at any of the following locations: one side of the external structure, a partial opening of the strip screen, or the backlight area of ​​the transparent screen.

[0101] The display device of the transparent screen device provided in this application embodiment has the same technical features as the display method of the transparent screen device provided in the above embodiment, so it can also solve the same technical problems and achieve the same technical effects.

[0102] An electronic device provided in this application embodiment, such as Figure 10 As shown, the electronic device 1000 includes a processor 1002 and a memory 1001. The memory stores a computer program that can run on the processor. When the processor executes the computer program, it implements the steps of the method provided in the above embodiments.

[0103] See Figure 10The electronic device also includes a bus 1003 and a communication interface 1004. The processor 1002, the communication interface 1004 and the memory 1001 are connected via the bus 1003. The processor 1002 is used to execute executable modules, such as computer programs, stored in the memory 1001.

[0104] The memory 1001 may include high-speed random access memory (RAM) or non-volatile memory, such as at least one disk storage device. Communication between this system network element and at least one other network element is achieved through at least one communication interface 1004 (which can be wired or wireless), such as the Internet, wide area network, local area network, metropolitan area network, etc.

[0105] Bus 1003 can be an ISA bus, PCI bus, or EISA bus, etc. The bus can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 10 The symbol is represented by a single double-headed arrow, but this does not mean that there is only one bus or one type of bus.

[0106] The memory 1001 is used to store programs. After receiving an execution instruction, the processor 1002 executes the program. The method executed by the apparatus defined by the process disclosed in any of the preceding embodiments of this application can be applied to the processor 1002 or implemented by the processor 1002.

[0107] The processor 1002 may be an integrated circuit chip with signal processing capabilities. In implementation, each step of the above method can be completed by the integrated logic circuitry in the hardware of the processor 1002 or by instructions in software form. The processor 1002 may be a general-purpose processor, including a Central Processing Unit (CPU), a Network Processor (NP), etc.; it may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly manifested as execution by a hardware decoding processor, or execution by a combination of hardware and software modules in the decoding processor. The software module can reside in a mature storage medium in the field, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, or registers. This storage medium is located in memory 1001. Processor 1002 reads the information in memory 1001 and, in conjunction with its hardware, completes the steps of the above method.

[0108] Corresponding to the above-described display method for a transparent screen device, this application embodiment also provides a computer-readable storage medium storing computer-executable instructions. When the computer-executable instructions are invoked and executed by a processor, the computer-executable instructions cause the processor to perform the steps of the above-described display method for a transparent screen device.

[0109] The display device of the transparent screen device provided in this application embodiment can be specific hardware on the device or software or firmware installed on the device. The implementation principle and technical effects of the device provided in this application embodiment are the same as those of the foregoing method embodiments. For the sake of brevity, any parts not mentioned in the device embodiment can be referred to the corresponding content in the foregoing method embodiments. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices and units described above can all be referred to the corresponding processes in the above method embodiments, and will not be repeated here.

[0110] In the embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. The apparatus embodiments described above are merely illustrative. For example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. Furthermore, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Additionally, the displayed or discussed mutual couplings, direct couplings, or communication connections may be through some communication interfaces; indirect couplings or communication connections between devices or units may be electrical, mechanical, or other forms.

[0111] For example, the flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram and / or flowchart, and combinations of blocks in block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0112] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0113] In addition, the functional units in the embodiments provided in this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0114] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the display method of the transparent screen device described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0115] It should be noted that similar labels and letters in the following figures indicate similar items. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures. In addition, the terms "first", "second", "third", etc. are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0116] Finally, it should be noted that the above-described embodiments are merely specific implementations of this application, used to illustrate the technical solutions of this application, and not to limit them. The protection scope of this application is not limited thereto. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can still modify or easily conceive of changes to the technical solutions described in the foregoing embodiments, or make equivalent substitutions for some of the technical features, within the scope of the technology disclosed in this application; and these modifications, changes, or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application. All should be covered within the protection scope of this application. Therefore, the protection scope of this application should be determined by the protection scope of the claims.

Claims

1. A display method for a transparent screen device, characterized in that, The transparent screen device includes a transparent screen, a strip screen, a first image acquisition unit, and a second image acquisition unit. The display surfaces of the transparent screen and the strip screen are parallel and both face the viewer of the transparent screen. The acquisition direction of the second image acquisition unit faces the viewer, and the acquisition direction of the first image acquisition unit faces the opposite direction to the second image acquisition unit. The method includes: The viewer image of the viewer is acquired from the second image acquisition unit, and the scene background image is acquired from the first image acquisition unit; Determine the viewer's actual binocular position based on the viewer's image; The scene background image is cropped according to the binocular position to obtain a cropped partial scene background image, and the partial scene background image is output to the bar screen for display. The step of cropping the scene background image based on the binocular position to obtain a cropped partial scene background image includes: establishing a transformation formula between the binocular position and key image cropping parameters based on a preset calibration position; determining the current key image cropping parameters for the actual binocular position using the transformation formula; and cropping the scene background image based on the current key image cropping parameters to obtain a cropped partial scene background image, so that the partial scene background image is connected to the transparent part of the transparent screen. The step of establishing a transformation formula between the binocular position and key image cropping parameters based on a preset calibration position includes: determining two sets of cropping-related parameters for cropping the scene background image when the binocular position is at two different preset calibration positions through an iterative trial and error method; wherein, the two different preset calibration positions correspond to the two sets of cropping-related parameters; and determining the transformation formula between the binocular position and key image cropping parameters based on the two sets of cropping-related parameters. The transformation formula is: Where 'a' is the current scaling factor for the actual binocular position, 'i' is the current lateral coordinate offset for the actual binocular position, and 'j' is the current longitudinal coordinate offset for the actual binocular position. and These are the scaling factors corresponding to the two different preset calibration positions, respectively. and These are the lateral coordinate offsets corresponding to the two different preset calibration positions, respectively. and These are the longitudinal coordinate offsets corresponding to the two different preset calibration positions, ( , , )and( , , ) are the spatial coordinates corresponding to the two different preset calibration positions, respectively. , , ) represents the spatial coordinates corresponding to the actual binocular positions.

2. The method according to claim 1, characterized in that, Each of the two sets of cropping-related parameters includes: scaling factor, horizontal coordinate offset, vertical coordinate offset, and spatial coordinates of the preset calibration position; The key parameters for image cropping include: scaling factor, horizontal coordinate offset, and vertical coordinate offset.

3. The method according to claim 1, characterized in that, The transparent screen device further includes an external structure disposed below the transparent screen; The external structure covers all electronic components except for the transparent screen, the first image acquisition unit, and the second image acquisition unit. The strip screen is positioned on the side of the external structure facing the viewer and covers at least a portion of the external structure.

4. The method according to claim 3, characterized in that, The size of the second image acquisition unit is smaller than the preset size; the second image acquisition unit is located at any of the following locations: One side of the external structure, the partial opening of the strip screen, and the backlight area of ​​the transparent screen.

5. A display device for a transparent screen equipment, characterized in that, The transparent screen device includes a transparent screen, a strip screen, a first image acquisition unit, and a second image acquisition unit. The display surfaces of the transparent screen and the strip screen are parallel and both face the viewer of the transparent screen. The acquisition direction of the second image acquisition unit faces the viewer, and the acquisition direction of the first image acquisition unit faces the opposite direction to the second image acquisition unit. The acquisition module is used to acquire the viewer image of the viewer from the second image acquisition unit and the scene background image from the first image acquisition unit; The determination module is used to determine the actual binocular position of the viewer based on the viewer image; The cropping module is used to crop the scene background image according to the binocular position to obtain a cropped partial scene background image, and output the partial scene background image to the bar screen for display. The cropping module is specifically used for: establishing a transformation formula between the binocular position and key image cropping parameters based on a preset calibration position; determining the current key image cropping parameters for the actual binocular position through the transformation formula; and cropping the scene background image according to the current key image cropping parameters to obtain a cropped partial scene background image so that the partial scene background image is connected to the transparent part of the transparent screen. The cropping module is also used to: determine two sets of cropping-related parameters for cropping the scene background image when the binocular position is at two different preset calibration positions through iterative trial and error; wherein, the two different preset calibration positions correspond to the two sets of cropping-related parameters; and determine the transformation formula between the binocular position and the key image cropping parameters based on the two sets of cropping-related parameters. The transformation formula is: Where 'a' is the current scaling factor for the actual binocular position, 'i' is the current lateral coordinate offset for the actual binocular position, and 'j' is the current longitudinal coordinate offset for the actual binocular position. and These are the scaling factors corresponding to the two different preset calibration positions, respectively. and These are the lateral coordinate offsets corresponding to the two different preset calibration positions, respectively. and These are the longitudinal coordinate offsets corresponding to the two different preset calibration positions, ( , , )and( , , ) are the spatial coordinates corresponding to the two different preset calibration positions, respectively. , , ) represents the spatial coordinates corresponding to the actual binocular positions.

6. An electronic device comprising a memory and a processor, wherein the memory stores a computer program executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the method described in any one of claims 1 to 4.

7. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions that, when invoked and executed by a processor, cause the processor to perform the method according to any one of claims 1 to 4.

Images