Display device and man-machine interaction device

Abstract

The invention provides a display device and a man-machine interaction device, and belongs to the technical field of communication. The display device comprises a display module and an antenna module, and the display module comprises a display area and an edge area; the antenna module comprises a plurality of antenna units, and each antenna unit comprises a radiation structure and a transmission line. The plurality of radiation structures are integrated on the display module; the multiple radiation structures located on the same side of the display area are divided into multiple groups arranged side by side in the second direction, and each group comprises the multiple radiation structures arranged side by side in the first direction; the radiation structures in adjacent groups are arranged in a staggered manner; one radiation structure is connected with one transmission line; wherein the transmission lines meet the condition that the phases of electromagnetic waves fed into the radiation structures are equal.

Description

Display device and human-computer interaction device Technical Field

[0001] The present disclosure belongs to the field of communication technology, and particularly relates to a display device and a human-computer interaction device. Background Art

[0002] Contactless sensing technology is playing an increasingly important role in human-computer interaction. Currently, a variety of methods are available, including machine vision, ultrasound, and millimeter waves. Millimeter-wave-based sensing has become a hot topic in both technology and the market due to its immunity to ambient light, privacy protection, and wide interaction range. However, millimeter-wave resolution is closely related to the operating frequency and the number of antenna elements. To achieve high angular resolution, the most straightforward approach is to increase the number of antenna elements, but this directly results in high system overhead.

[0003] Summary of the Invention

[0004] The present invention aims to solve at least one of the technical problems existing in the prior art and provides a display device and a human-computer interaction device.

[0005] An embodiment of the present disclosure provides a display device, which includes a display module and an antenna module, wherein the display module includes a display area and an edge area; the antenna module includes multiple antenna units, and the antenna units include a radiation structure and a transmission line; multiple radiation structures are integrated on the display module; multiple radiation structures located on the same side of the display area are divided into multiple groups arranged side by side along a second direction, each group includes multiple radiation structures arranged side by side along a first direction; the radiation structures located in adjacent groups are staggered; one radiation structure is connected to one transmission line; wherein,

[0006] Each of the transmission lines ensures that the phases of the electromagnetic waves fed into each of the radiation structures are equal.

[0007] The transmission lines are integrated on the display module, and the lengths of the transmission lines are equal.

[0008] The transmission line is integrated on the display module, and the radiation structure includes two groups, one of which is closer to the display area and is called the first radiation structure group, and the other is called the second radiation structure group;

[0009] The transmission line connected to the radiating structure in the first radiating group is referred to as a first transmission line. The first transmission line includes a first line segment and a second line segment connected to each other, and the first line segment is connected to the radiating structure. The first line segment extends along the second direction.

[0010] The transmission line connected to the radiation structure in the second radiation group is called a second transmission line, and the second transmission line includes at least one third line segment extending along the first direction and at least one fourth line segment extending along the second direction;

[0011] The length of the first line segment in the first transmission line is equal to the sum of the lengths of the third line segments in the second transmission line;

[0012] The length of the second line segment in the first transmission line is equal to the sum of the lengths of the fourth line segments in the second transmission line.

[0013] Wherein, the number of the third line segments in at least part of the second transmission lines is different, and / or the number of the fourth line segments is different.

[0014] Wherein, every two adjacent second transmission lines are arranged in a mirror-symmetrical manner.

[0015] The trace directions of the first transmission lines are the same.

[0016] The second line segment includes a first sub-line segment extending along the first direction and a second sub-line segment extending along the second direction.

[0017] The transmission line is integrated on the display module, and the radiation structure includes two groups, one of which is closer to the display area and is called the first radiation structure group, and the other is called the second radiation structure group;

[0018] The transmission line connected to the radiating structure in the first radiating group is called a first transmission line, and the transmission line connected to the radiating structure in the second radiating group is called a second transmission line. The feeding directions of the first transmission line and the second transmission line are opposite.

[0019] Wherein, the radiation structure and the transmission line connected thereto are an integrally formed structure.

[0020] In which, the antenna module also includes an adapter board and a printed circuit board; the transmission lines include a first part integrated on the display module, a second part integrated on the adapter board, and a third part integrated on the printed circuit board; the first part of the transmission line is bound and connected to the second part, and the second part is bound and connected to the third part.

[0021] The radiation structures include two groups, one closer to the display area is called a first radiation structure group, and the other is called a second radiation structure group; the transmission line connected to the radiation structures in the second radiation group is called a first transmission line, and the transmission line connected to the radiation structures in the first radiation group is called a second transmission line;

[0022] The second portion of the second transmission line includes a plurality of fifth line segments extending along the first direction and a plurality of sixth line segments extending along the second direction; the plurality of fifth line segments and the plurality of sixth line segments are alternately connected in sequence.

[0023] The radiation structures include two groups, one closer to the display area is called a first radiation structure group, and the other is called a second radiation structure group; the transmission line connected to the radiation structures in the second radiation group is called a first transmission line, and the transmission line connected to the radiation structures in the first radiation group is called a second transmission line;

[0024] The third portion of the first transmission line and the third portion of the second transmission line have different lengths.

[0025] The radiation structure includes a plurality of radiation patches connected together, and the radiation patches are arranged side by side along a first direction.

[0026] The radiation structure includes a plurality of radiation patches connected together, and the radiation patches are arranged side by side along the second direction.

[0027] In which, the radiation structure includes a plurality of radiation patches connected together; the radiation patches in each radiation structure are divided into a plurality of groups arranged side by side along the second direction, each including a plurality of radiation patches arranged side by side along the first direction, and the radiation patches in adjacent groups are arranged in an staggered manner.

[0028] The antenna module includes a radiation layer, the radiation layer covers the display module, and the radiation layer includes a grid structure, and the radiation structure is located in the radiation layer.

[0029] An embodiment of the present disclosure provides a human-computer interaction device, which includes any of the above-mentioned display devices.

[0030] Wherein, the display module includes a data processing module and a display module;

[0031] a data processing module, configured to determine human body movements and corresponding control instructions based on the radar signals transmitted by the antenna module and the received echo signals, and output the control instructions;

[0032] A display module is used to display the determined human body motion and / or the control instruction.

[0033] Wherein, the data processing module includes: a first processing core and a second processing core;

[0034] The first processing core is configured to perform an analysis operation based on a signal obtained by mixing the radar signal and the echo signal to generate the reflection object information, wherein the analysis operation includes at least one of a one-dimensional Fourier transform, a two-dimensional Fourier transform, and an arrival angle calculation;

[0035] The second processing core is used to perform chirp control on the radar signal, pre-train and generate a human motion recognition network, and recognize the human motion through the human motion recognition network according to the reflection object information, and determine the corresponding control instruction.

[0036] The data processing module includes: a low noise amplifier, a mixer, an intermediate frequency amplifier, an analog-to-digital converter, a digital front-end component, a buffer, a power amplifier, a power divider and a waveform generator;

[0037] Wherein, the low noise amplifier, the mixer, the intermediate frequency amplifier, the analog-to-digital converter, the digital front-end component and the buffer are connected in sequence;

[0038] The waveform generator, the power distributor and the power amplifier are connected in sequence;

[0039] The input end of the mixer is also connected to the power divider, the input end of the low noise amplifier is connected to the array antenna, and the output end of the power amplifier is connected to the antenna module.

[0040] The human-computer interaction device includes any one of smart home, vehicle-mounted equipment, health monitoring equipment, and consumer electronic equipment. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] FIG1 is a schematic diagram of an exemplary liquid crystal display device.

[0042] FIG. 2 is a schematic diagram of another exemplary liquid crystal display device.

[0043] FIG3 is a schematic diagram of an exemplary pixel arrangement in a liquid crystal display device.

[0044] FIG4 is a schematic diagram of an exemplary first polarizer.

[0045] FIG5 is a schematic diagram of a display device according to an embodiment of the present disclosure.

[0046] FIG6 is a top view of a radiation layer in a display device according to an embodiment of the present disclosure.

[0047] FIG. 7 is a schematic diagram of feeding power to a radiation layer in a display device according to an embodiment of the present disclosure.

[0048] FIG8 is a top view of another radiation layer in the display device according to an embodiment of the present disclosure.

[0049] FIG9 is a top view of another radiation layer in the display device according to an embodiment of the present disclosure.

[0050] FIG10 is a top view of another radiation layer in the display device according to an embodiment of the present disclosure.

[0051] FIG11 is a top view of another radiation layer in the display device according to an embodiment of the present disclosure.

[0052] FIG12 is a schematic diagram showing the connection between the radiation structure and the transmission line in the first example of the embodiment of the present disclosure.

[0053] FIG13 is a schematic diagram showing the connection between another radiation structure and a transmission line in the first example of an embodiment of the present disclosure.

[0054] FIG14 is a schematic diagram showing the connection between the radiation structure and the transmission line in the second example of an embodiment of the present disclosure.

[0055] FIG15 is a schematic diagram of a partial structure of an uncompensated transmission line in a third example of an embodiment of the present disclosure.

[0056] FIG16 is a schematic diagram of a partial structure of a compensated transmission line in the third example of an embodiment of the present disclosure.

[0057] FIG17 is a schematic diagram of a partial structure of an uncompensated transmission line in a fourth example of an embodiment of the present disclosure.

[0058] FIG18 is a schematic diagram of a partial structure of a compensated transmission line in the fourth example of an embodiment of the present disclosure.

[0059] FIG19 is a schematic diagram of a human-computer interaction device according to an embodiment of the present disclosure.

[0060] FIG20 is a schematic structural diagram of a data processing module provided in an embodiment of the present disclosure.

[0061] FIG21 is an equivalent circuit diagram of another data processing module provided in an embodiment of the present disclosure.

[0062] FIG22 is a schematic structural diagram of another data processing module provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0063] In order to enable those skilled in the art to better understand the technical solution of the present invention, the present invention is further described in detail below with reference to the accompanying drawings and specific implementation methods.

[0064] Unless otherwise defined, the technical or scientific terms used in this disclosure should have the usual meanings understood by people with ordinary skills in the field to which this disclosure belongs. The words "first", "second" and similar words used in this disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. Similarly, words such as "one", "an" or "the" do not indicate a quantity limitation, but rather indicate the existence of at least one. Words such as "include" or "comprise" mean that the elements or objects appearing before the word include the elements or objects listed after the word and their equivalents, without excluding other elements or objects. Words such as "connect" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the object being described changes, the relative positional relationship may also change accordingly.

[0065] Figure 1 is a schematic diagram of an exemplary liquid crystal display device; Figure 2 is a schematic diagram of another exemplary liquid crystal display device; as shown in Figures 1 and 2, the display device can specifically be a liquid crystal display device, which includes a display module, a backlight module 6 located on the light incident side of the display module, a first polarizer 4 located on the light incident side of the display module, and a second polarizer 5 located between the display module and the backlight module 6.

[0066] FIG3 is a schematic diagram of a pixel arrangement in an exemplary liquid crystal display device. As shown in FIG3 , the display module is divided into a plurality of pixel units, each pixel unit 10 including a plurality of sub-pixels 100. In the embodiment disclosed herein, the sub-pixels 100 in each pixel unit 10 are respectively a red sub-pixel R, a green sub-pixel G, and a blue sub-pixel B. The sub-pixels 100 in each pixel unit 10 arranged side by side in a first direction X are arranged in the same pattern. For example, the sub-pixels 100 in the pixel units 10 in the first row (from left to right) are arranged in a pattern of red sub-pixels R, green sub-pixels G, and blue sub-pixels B, while the sub-pixels 100 in the pixel units 10 in the second row (from left to right) are arranged in a pattern of green sub-pixels G, blue sub-pixels B, and red sub-pixels R. Continuing with FIG3 , in this pixel structure, the sub-pixels 100 arranged side by side in a second direction Y are of the same color. For example, the sub-pixels 100 arranged side by side in the second direction Y are all red sub-pixels R.

[0067] It should be noted that the color of the sub-pixel 100 depends on the color of the filter in the sub-pixel 100. If the filter in the sub-pixel 100 is red, the sub-pixel 100 is called a red sub-pixel R. Similarly, if the filter in the sub-pixel 100 is green, the sub-pixel 100 is called a green sub-pixel G. If the filter in the sub-pixel 100 is blue, the sub-pixel 100 is called a blue sub-pixel B.

[0068] The display module includes a first substrate and a second substrate arranged opposite to each other, a liquid crystal layer 3 arranged between the first and second substrates, and a first substrate arranged on the side of the first substrate facing away from the liquid crystal layer 3. One of the first and second substrates is an array substrate 1, and the other is a color filter substrate 2. The film layer structures of the first polarizer 4 and the second polarizer 5 can actually be the same. Figure 4 is a schematic diagram of an exemplary first polarizer 4; as shown in Figure 5, the first polarizer 4 includes a laminated release film 51, an adhesive layer 52, a first support layer 53, a polarizing layer 54, a second support layer 55, a low-reflection layer 56, and a protective layer 57. In this case, the release film 51 of the first polarizer 4 can be removed, and the adhesive layer 52 can be bonded to the first substrate. Similarly, when the second polarizer 5 adopts the same structure as the first polarizer 4, the release film 51 of the second polarizer 5 can also be removed, and the adhesive layer 52 can be bonded to the second substrate.

[0069] Figure 5 is a schematic diagram of a display device according to an embodiment of the present disclosure. As shown in Figure 5 , based on antenna radiation theory and in combination with the structure of the display device, a convenient external antenna solution is to dispose an antenna module between the display module and the first polarizer. The antenna unit in the antenna module may include a transmitting antenna and a receiving antenna. The antenna unit in the antenna module may also be a transmitting and receiving antenna. The display module has a display area and a peripheral area surrounding the display area, and the antenna unit is located in the peripheral area.

[0070] FIG6 is a top view of the radiating layer in the display device of the embodiment of the present disclosure; FIG7 is a feeding schematic diagram of the radiating layer in the display device of the embodiment of the present disclosure; As shown in FIG6 and 7, the antenna unit includes not only a radiating structure 201 and a first reference electrode, but also a feeding structure. The feeding structure may include a transmission line 203, for example, the transmission line 203 may be a coplanar waveguide (CPW) transmission line. Specifically, the transmission line 203 includes a signal electrode 203a and a second reference electrode 203b provided on both sides of the extension direction of the signal electrode 203a. The signal electrode 203a can be electrically connected to the radiating structure 201 via the first feeding line. It should be noted that the embodiment of the present disclosure is described only by taking the feeding structure 203 as a CPW transmission line as an example, but it should be understood that the feeding structure 203 is not limited thereto, so the CPW transmission line does not constitute a limitation on the type of the feeding structure 202 in the embodiment of the present disclosure.

[0071] In some examples, the antenna module in the embodiments of the present disclosure includes a radiating layer integrated into a display module, wherein the radiating layer 200 covers the display module, and the radiating layer 200 includes a grid structure, and the radiating structure 201 is located in the radiating layer. For example, the radiating layer 200 has a first conductive line 301 and a second conductive line 302 intersecting each other; the extension directions of the first conductive line 301 and the second conductive line 302 of the conductive grid structure can be perpendicular to each other, in which case a positive direction or a rectangular hollow portion is formed. Of course, the extension directions of the first conductive line 301 and the second conductive line 302 of the conductive grid structure can be non-perpendicular, for example, the angle between the extension directions of the first conductive line 301 and the second conductive line 302 is 63°, in which case a diamond-shaped hollow portion is formed. It should be noted that the portion of the radiating layer 200 located in the display area is a redundant radiating structure 202. The metal grid of the redundant radiating structure 202 is disconnected near each intersection position.

[0072] In some examples, the line width, line thickness, and line spacing of the first conductive lines 301 and the second conductive lines 302 of the conductive mesh structure are preferably the same, but can also be different. For example, referring again to FIG. 9 , the line width W1 of the first conductive lines 301 and the second conductive lines 302 are both approximately 1-30 μm, the line spacing W2 is approximately 50-250 μm, and the line thickness is approximately 0.5-10 μm. In some examples, the conductive mesh structure is made of a metal, such as copper, silver, aluminum, or other metal materials.

[0073] Furthermore, as shown in FIG7 , the display device of this example includes not only the above-mentioned structure, but also a flexible adapter plate 300 and a printed circuit board 400. The flexible adapter plate 300 is configured to realize the transmission of radio frequency signals between the feeding structure 202 and the printed circuit board 400. For example, the feeding structure 202 is connected to the flexible adapter plate 300 by bonding, and the printed circuit board 400 is also connected to the flexible adapter plate 300 by bonding. When the feeding structure 202 is bonded to the flexible circuit board and the printed circuit board 400 is bonded to the flexible adapter plate 300, the diameter of the conductive gold ball in the transparent optical conductive adhesive (ACF adhesive) used is greater than 10 μm, so that lower signal loss can be obtained.

[0074] In some examples, Figure 8 is a top view of another radiating layer in a display device according to an embodiment of the present disclosure. As shown in Figure 8 , the radiating structure 201 includes multiple connected radiating patches 2011, with each radiating patch 2011 arranged side by side along a first direction X. In other words, the radiating structure 201 includes multiple serially fed radiating patches 2011, which can increase the radiation area and improve gain. Similarly, Figure 9 is a top view of another radiating layer in a display device according to an embodiment of the present disclosure. As shown in Figure 9 , the radiating patches 2011 of the radiating structure 201 can also be arranged side by side along a second direction Y.

[0075] In some examples, Figure 10 is a top view of another radiating layer in a display device according to an embodiment of the present disclosure. As shown in Figure 10 , a radiating structure 201 includes a plurality of connected radiating patches 2011. The radiating patches 2011 in each radiating structure 201 are divided into multiple groups arranged side by side along a second direction Y. Each group includes multiple radiating patches 2011 arranged side by side along a first direction X, and the radiating patches 2011 in adjacent groups are staggered. The spacing between adjacent radiating structures 201 in the second direction Y is λ / 2. Simulations have shown that the gain drop of the middle antenna unit due to the influence of adjacent antenna units is alleviated, and the gain is almost consistent, with a difference of less than 0.1 dB.

[0076] Figure 11 is a top view of another radiating layer in a display device according to an embodiment of the present disclosure. Referring to Figure 11 , taking the antenna units as transceiver antennas as an example, each antenna unit includes a transmission line 203 integrated within and electrically connected to a radiating structure 201. The transmission line 203 is used to feed the radiating structure 201. The radiating structures 201 in each antenna unit located on one side of the display area are divided into multiple groups arranged side by side along the second direction Y. Each group includes multiple radiating structures 201 spaced apart along the first direction X and staggered with adjacent groups. Figure 11 uses the example of an antenna module including two groups of radiating structures 201. For ease of description, the group closer to the display area is referred to as the first radiating structure group 21, and the other is referred to as the second radiating structure group 22. The transmission line 203 connected to the radiating structures 201 in the first radiating structure group 211 is referred to as the first transmission line 2031, and the transmission line 203 connected to the radiating structures 201 in the second radiating structure group 22 is referred to as the second transmission line 2032. The spacing between the radiation structures 201 in the first radiation structure group 21 and the second radiation structure group 22 in the second direction Y is λ / 2. Due to the staggered arrangement of the radiation structures 201, the transmission paths of the electromagnetic wave signals are different. The phase difference caused by the different transmission paths will be superimposed on the spatial phase difference, thereby affecting the estimation of the arrival angle. The formula is as follows:

[0077] Where λ is the wavelength of the electromagnetic wave signal, d is the spacing between adjacent radiating structures 201 along the first direction X, and ω is the spatial phase difference expressed in radians. Because the staggered arrangement of the radiating structures 201 introduces an additional half-wavelength transmission phase difference, or 180°, compensation is required for the transmission path. The transmission path is determined by the transmission line 203. Several methods for compensating the transmission paths of some antenna elements are described below to compensate for the phase differences of the electromagnetic waves radiated by each radiating structure 201.

[0078] It should be noted that in the following examples, only the first radiation structure group 21 and the second radiation structure group 22 are taken as examples including two radiation structures 201. However, it should be understood that the number of radiation structures 201 in the first radiation structure group 21 and the second radiation structure group 22 is not limited to two and can be specifically designed according to specific application scenarios.

[0079] First Example: Figure 12 is a schematic diagram illustrating the connection between the radiating structures 201 and the transmission lines 203 in the first example of the present embodiment. As shown in Figure 12, the first transmission lines 2031 electrically connected to the radiating structures 201 in the first radiating structure group 21, and the second transmission lines 2032 electrically connected to the radiating structures 201 in the second radiating structure group 22, are integrated into the display module. Each first transmission line 2031 includes a first segment and a second segment, wherein one end of the first segment is connected to the first radiating structure 201 and the other end is connected to the second segment. The second transmission line 2032 includes a third segment extending along the first direction X and a fourth segment extending along the second direction Y. The number of the third segment and the fourth segment can be one or more, and the third and fourth segments are alternately connected to form the second transmission line 2032.

[0080] Specifically, referring to Figure 12 , one second transmission line 2032 includes two third line segments and three fourth line segments, while the other second transmission line 2032 includes three third line segments and four fourth line segments. The length of the first line segment in the first transmission line 2031 constitutes a λ / 2 transmission path, while the second line segment serves as a compensating transmission path. The total length of the third line segments in the second transmission line 2032 constitutes a λ / 2 transmission path, while the total length of the fourth line segments constitutes a compensating transmission path. In this example, the lengths of the first and second transmission lines 2031 and 2032 are equal, thereby compensating for the phase difference between the electromagnetic waves radiated by each radiating structure 201. The length of the first line segment in the first transmission line 2031 is represented by a, and the length of the second line segment is represented by b; the lengths of the two third line segments in one of the second transmission lines 2032 are represented by a1 and a2, respectively, and the lengths of the three fourth line segments are represented by b1, b2, and b3, respectively; the lengths of the three third line segments in the other second transmission line 2032 are represented by a3, a4, and a5, respectively, and the lengths of the four fourth line segments are represented by b4, b5, b6, and b7, respectively; in this case, a+b=a1+a2+b1+b2+b3=a3+a4+a5+b4+b5+b6+b7. Through this setting, the transmission paths in each antenna unit can be made consistent.

[0081] Figure 12 illustrates only one configuration method for each first transmission line 2031 and each second transmission line 2032. Figure 13 is a schematic diagram illustrating the connection between another radiating structure 201 and transmission line 203 in the first example of an embodiment of the present disclosure. The configuration shown in Figure 13 can also be employed for each first transmission line 2031 and each second transmission line 2032. Specifically, compared to the aforementioned configuration method extending along the second direction Y, the second line segments of the first transmission line 2031 in Figure 13 are configured as a meandering line, specifically comprised of alternating first sub-segments extending along the first direction X and second sub-segments extending along the first direction X. Adjacent first transmission lines 2031 are configured in mirror-symmetric fashion, and each pair of adjacent second transmission lines 2032 are configured in mirror-symmetric fashion.

[0082] The above merely provides two exemplary methods of integrating the transmission line 203 into the display module. Furthermore, by designing the transmission line 203, the transmission paths of the antenna units have the same structure. It should be understood that as long as the sum of the length of the first line segment in the first transmission line 2031 and the length of the third line segment in the second transmission line 2032 is λ / 2, and the sum of the length of the second line segment in the first transmission line 2031 and the length of the third line segment in the second transmission line 2032 are equal, they are sufficient. A detailed description is omitted here.

[0083] Second Example: FIG14 is a schematic diagram illustrating the connection between the radiating structure 201 and the transmission line 203 in the second example of an embodiment of the present disclosure. As shown in FIG14 , this example is substantially the same as the first example, in that both the first transmission line 2031 and the second transmission line 2032 are integrated into the display module. The difference lies in that the connection position between the first transmission line 2031 and the corresponding radiating structure 201 is different from the connection position between the second transmission line 2032 and the corresponding radiating structure 201. Specifically, the radiating structure 201 includes a first side and a second side arranged opposite each other along the second direction Y. The first transmission line 2031 is connected to the first side of the corresponding radiating structure 201, and the second transmission line 2032 is connected to the second side of the corresponding radiating structure 201. Furthermore, the connection node between the first transmission line 2031 and the corresponding radiating structure 201 is a first node, and the first node is connected to the center of the radiating structure 201 as a first connecting line segment. The connection node between the second transmission line 2032 and the corresponding radiating structure 201 is a second node, and the second node is connected to the center of the radiating structure 201 as a second connecting line segment. The first connecting line segment and the second connecting line segment extend in the same direction. In this case, the electromagnetic waves transmitted by the first transmission line 2031 and the second transmission line 2032 are in opposite directions.

[0084] In this example, the first transmission line 2031 includes a first segment and a second segment. One end of the first segment is connected to the radiating structure 201, and the other end is connected to the second segment. The second transmission line 2032 includes a third segment and a fourth segment. One end of the third segment is connected to the radiating structure 201, and the other end is connected to the fourth segment. The second segment of the first transmission line 2031 and the fourth segment of the second transmission line 2032 extend in the same direction (for example, the second segment and the fourth segment both extend in the second direction Y) and have the same length. Because the electromagnetic waves transmitted by the first transmission line 2031 and the second transmission line 2032 are in opposite directions, the length of the first segment of the first transmission line 2031 is twice the length of the third segment of the second transmission line 2032.

[0085] The third example: the antenna module includes not only the above-mentioned radiation structure 201, transmission line 203 and feeding structure, but also an adapter board and a printed circuit board; the feeding structure is integrated on the printed circuit board; the transmission line 203 includes a first part integrated on the display module, a second part integrated on the adapter board, and a third part integrated on the printed circuit board; the first part of the transmission line 203 is bound and connected to the second part, and the second part is bound and connected to the third part. In other words, the first transmission line 2031 and the second transmission line 2032 each include a first part, a second part and a third part. In this example, by designing the second part of the second transmission line 2032, the phase difference caused by the staggered arrangement of the radiation structure 201 is compensated. According to the phase difference to be compensated, the length l of the transmission path to be compensated is determined by the following formula:

[0086] Specifically, FIG15 is a schematic diagram of the partial structure of the uncompensated transmission line 203 in the third example of the embodiment of the present disclosure; FIG16 is a schematic diagram of the partial structure of the compensated transmission line 203 in the third example of the embodiment of the present disclosure. As shown in FIG15 and FIG16 , the second portion 2032b of the second transmission line 2032 includes a plurality of fifth line segments extending along the first direction X and a plurality of sixth line segments extending along the second direction Y. The plurality of fifth line segments and the plurality of sixth line segments are alternately connected in sequence. The sum of the lengths of the sixth line segments of the second transmission line 2032 is equal to the length of the second portion 2032a of the first transmission line 2031. The sum of the lengths of the fifth line segments of the second transmission line 2032 is the length l of the transmission path to be compensated, as calculated above.

[0087] Example 4: This example is similar to the third example, except that in this example, the length of the third portion of the second transmission line 2032 needs to be adjusted to compensate for the phase difference caused by the staggered arrangement of the radiating structures 201. Based on the phase difference to be compensated, the length l of the transmission path to be compensated is determined using the following formula:

[0088] The length of the third portion of the second transmission line 2032 is adjusted based on the calculated length l of the transmission path to be compensated, so that the lengths of the third portion 2031c of the first transmission line 2031 and the third portion 2032c of the second transmission line 2032 are not equal, thereby making the phases of the electromagnetic waves radiated by each radiation structure 201 equal; Figure 17 is a schematic diagram of the partial structure of the uncompensated transmission line in the fourth example of an embodiment of the present disclosure; Figure 18 is a schematic diagram of the partial structure of the compensated transmission line in the fourth example of an embodiment of the present disclosure; as shown in Figures 17 and 18.

[0089] The above merely provides several exemplary structures for compensating for the phase difference of the electromagnetic waves radiated by the radiating structures 201 due to different transmission paths caused by the staggered arrangement of the radiating structures 201. In actual products, more than one of the first part, the second part, and the third part of the transmission line 203 may be designed to compensate for the phase difference, as long as the total amount of the compensation is equal to the corresponding phase difference.

[0090] In some examples, the portion of the transmission line integrated into the display module can be located in the radiation layer, and the portion of the transmission line integrated into the display module can be integrally formed with the radiation portion to which it is connected. This helps to achieve a lightweight and thin design of the display device.

[0091] Secondly, Figure 19 is a schematic diagram of a human-computer interaction device in an embodiment of the present disclosure. As shown in Figure 19 , the present disclosure also provides a human-computer interaction device comprising the aforementioned antenna module, data processing module, and display module. Specifically, the transmitting array element in the antenna module is used to transmit radar signals, and the receiving array element is used to receive reflected echo signals. The data processing module is used to determine human body movements and corresponding control instructions based on the radar signals and echo signals, and output the control instructions. The display module is used to display the determined human body movements and / or control instructions.

[0092] In some examples, the data processing module is specifically configured to mix and analyze the radar signal and the echo signal to obtain reflected object information, identify human motion based on the reflected object information, and determine corresponding control instructions. The reflected object information includes at least one of distance information, velocity information, and angle of arrival information. In some embodiments, the radar signal is a frequency modulated continuous wave (FMCW) signal.

[0093] Specifically, millimeter-wave radars are divided into two categories based on the type of transmitted signal: pulse radar and continuous wave radar. Pulse radars transmit periodic high-frequency pulses, while continuous wave radars transmit continuous wave signals. Continuous wave signals can include single-frequency continuous wave (CW) signals or frequency-modulated continuous wave (FM) signals. FM CW signals can be modulated using triangular waves, sawtooth waves, coded modulation, or noise frequency modulation. In the aforementioned embodiment, when the radar signal is an FM CW signal, the antenna module transmits an FM CW signal with varying frequencies within a frequency sweep period. The echo signal reflected by an object has a certain frequency difference with the transmitted radar signal. By measuring this frequency difference, information such as the distance between the object and the antenna module can be obtained.

[0094] In some embodiments, the data processing module is disposed on a printed circuit board, and the antenna module transmits signals to the data processing module via a flexible cable. To achieve lower signal loss, anisotropic conductive film (ACF) with a larger gold sphere particle diameter (e.g., a diameter greater than 10 μm) can be used for bonding. Alternatively, in some embodiments, the data processing module is disposed on a printed circuit board, and the antenna module is encapsulated within the data processing module. The printed circuit board can be a high-frequency circuit board, and the antenna module can be encapsulated within the data processing module based on Antenna in Package (AiP) technology. In some embodiments, the antenna module is installed within a terminal device. In this case, it is necessary to open a hole at the corresponding installation location of the terminal device for the sensing area corresponding to the antenna module to reserve a transmission path to prevent the metal casing of the terminal device from obstructing the transmission of millimeter waves.

[0095] In some examples, a correspondence between human body motions and control instructions is pre-acquired or configured, wherein a one-to-one correspondence between human body motions and control instructions can be established, or a correspondence between human body motions and control instructions of a single terminal device can be established, or a correspondence between a single human body motion and control instructions of different terminal devices can be established.

[0096] In some examples, the data processing module and the antenna module constitute a millimeter wave radar subsystem, and accordingly, the display module corresponds to the display subsystem.

[0097] In some examples, the display module includes a routing gateway unit; the routing gateway unit is used to receive media data; accordingly, the display module is also used to display according to the media data received by the routing gateway unit.

[0098] In some examples, the display module also includes a display, a display driver unit, a chip timing control unit, a signal adapter unit, etc. The media data received by the routing gateway unit is decoded by the signal adapter unit and handed over to the timing control unit for driving control according to a certain timing logic to form a display effect on the display.

[0099] The human-computer interaction device in the embodiment of the present disclosure forms a millimeter-wave radar based on an antenna module and a data processing module, realizes non-contact control through the millimeter-wave radar, determines the corresponding control instructions by capturing and identifying human body movements, and sends them to the terminal device so that the terminal device executes the corresponding command response to realize interactive operations.

[0100] Figure 20 is a structural diagram of a data processing module provided in an embodiment of the present disclosure; as shown in Figure 20, the data processing module is a specific optional implementation scheme of the data processing module shown in Figure 19, specifically, the data processing module includes: a first processing core and a second processing core.

[0101] The first processing core is used to perform an analysis operation based on the signal obtained by mixing the radar signal and the echo signal to generate information about the reflected object, wherein the analysis operation includes at least one of a one-dimensional Fourier transform (1D FFT), a two-dimensional Fourier transform (2D FFT), and an angle of arrival (AOA) calculation. The one-dimensional Fourier transform and the two-dimensional Fourier transform can be used to obtain distance information and velocity information, and the angle of arrival calculation can be used to obtain angle of arrival information.

[0102] In some embodiments, the first processing core is further configured to determine a valid echo signal based on a Peak Search algorithm and a Constant False-Alarm Rate (CFAR) algorithm before calculating the angle of arrival.

[0103] The second processing core is used to perform chirp control on the radar signal, pre-train and generate a human motion recognition network, and identify human motions through the human motion recognition network based on the reflected object information, and determine the corresponding control instructions; wherein, chirp refers to the characteristic that the instantaneous frequency of the signal changes with time. In some embodiments, the radar signal is a frequency-modulated continuous wave signal, and accordingly, the second processing core is used to configure the chirp parameters of the frequency-modulated continuous wave signal; in some embodiments, the human motion recognition network can be independently configured as a gesture recognition network for accurately identifying gestures; in some embodiments, the human motion recognition network is a convolutional neural network, which can be based on Torch architecture, Pytorch architecture, VGG architecture, etc. The convolutional neural network has few parameters, fast judgment speed, and high judgment accuracy, and is particularly suitable for image recognition. It should be noted that the above-mentioned recognition network can adopt a convolutional neural network model or other neural network models, which are all applicable to the technical solution of the present application and will not be repeated here.

[0104] In some examples, the first processing core may be a DSP processing core, and the second processing core may be an ARM processing core.

[0105] Figure 21 is an equivalent circuit diagram of another data processing module provided in an embodiment of the present disclosure; as shown in Figure 21, the data processing module is a specific optional implementation scheme of the data processing module shown in Figure 19. Specifically, the data processing module includes: a low noise amplifier 301, a mixer 302, an intermediate frequency amplifier 303, an analog-to-digital converter 304, a digital front-end component 305 (sampling filter), a buffer 306, a power amplifier 401, a power divider 402 and a waveform generator 403. The arrows in the figure show the direction of signal transmission.

[0106] Among them, the low noise amplifier 301, the mixer 302, the intermediate frequency amplifier 303, the analog-to-digital converter 304, the digital front-end component 305 and the buffer 306 are connected in sequence; the waveform generator 403, the power divider 402 and the power amplifier 401 are connected in sequence; the input end of the mixer 302 is connected to the low noise amplifier 301 and is also connected to the power divider 402; the input end of the low noise amplifier 301 is connected to the antenna module, and the output end of the power amplifier 401 is connected to the antenna module; wherein the data processing module may include multiple receiving The transmitting chain may include a plurality of groups of low noise amplifiers 301, mixers 302, intermediate frequency amplifiers 303, and analog-to-digital converters 304 on the receiving side (the figure exemplarily shows a case where two groups are included), and may include a plurality of power amplifiers 401 on the transmitting side (the figure exemplarily shows a case where two are included); in some embodiments, a phase shifter is further connected between each power amplifier 401 and the power divider 402; in some embodiments, a filter is further connected between each mixer 302 and its corresponding intermediate frequency amplifier 303.

[0107] Among them, the waveform generator 403 generates a radar signal, sends a part of it to the mixer 302 through the power divider 402, and sends a part of it to the antenna module through the power amplifier 401 through the power divider 402, and is sent outward by the corresponding antenna unit in the antenna module; the corresponding antenna unit in the antenna module receives the echo signal reflected after the radar signal encounters an object. After the received echo signal is amplified by the low-noise amplifier 301, it is mixed with part of the output of the power divider 402 through the mixer 302 to obtain an intermediate frequency signal, which is converted into corresponding data through the intermediate frequency amplifier 303, the analog-to-digital converter 304, and the digital front-end component 305 and stored in the buffer 306.

[0108] Figure 22 is a structural schematic diagram of another data processing module provided in an embodiment of the present disclosure; as shown in Figure 22, the data processing module is a specific optional implementation scheme based on the data processing module shown in Figures 20 and 21. Specifically, the data processing module includes: a low-noise amplifier, a mixer, an intermediate frequency amplifier, an analog-to-digital converter, a digital front-end component, a buffer, a power amplifier, a power divider, a waveform generator, a first processing core and a second processing core.

[0109] Among them, based on the functions of each component, the data processing module can be divided into multiple units, including: a radio frequency / analog circuit (RF / Analog) unit, a transmitting and receiving (TR) unit, a signal processing (DSP) unit and a control (Master) unit; as shown in Figure 13, the radio frequency / analog circuit unit includes a low-noise amplifier, a mixer, an intermediate frequency amplifier, an analog-to-digital converter, a power amplifier, and a power divider; the transmitting and receiving unit includes a digital front-end component and a waveform generator; the signal processing unit includes a buffer and a first processing core; and the master control unit includes a second processing core. Among them, the master control unit and the components in the signal processing unit can communicate and control the process based on the bus matrix (Bus Matrix). The signal transmission direction within the radio frequency / analog circuit unit can be seen in Figure 12.

[0110] In some examples, the RF / analog circuit unit also includes a general-purpose analog-to-digital converter (GPADC), an oscillator (OSC), a temperature controller, etc.; the signal processing unit also includes a cyclic redundancy check (CRC) component, a direct memory access (DMA) component, a low voltage differential signaling (LVDS) interface, a hardware in the loop (HIL) component, a radar data storage device, and a hardware accelerator connected to the cache; the main control unit also includes a direct memory access component, a serial peripheral interface (SPI), a queued serial peripheral interface (QSPI), a bus interface, and a debug serial port; a mailbox module based on a mailbox synchronous communication mechanism is also provided between the main control unit and the signal processing unit.

[0111] In some examples, the data processing module may use an IWR6843 chip or a VYYR7301-A0 chip, etc.

[0112] In some examples, the data processing module may also include only a low-noise amplifier, a mixer, an intermediate frequency amplifier, a power amplifier, and a power divider, such as using a BGT60TR13 chip, and other components such as an analog-to-digital converter, a digital front-end component, a buffer, and a waveform generator need to be provided separately.

[0113] Therefore, based on the data processing modules in the above embodiments, the processing of corresponding signals and data can be realized based on multiple processing cores, wherein the first processing core performs a series of analytical operations on the intermediate frequency signal, and the second processing core realizes human motion recognition through a trainable human motion recognition network, thereby improving the accuracy of human motion recognition.

[0114] In some examples, the display module includes a display, the antenna module is integrated in the display, and the antenna module includes a reference electrode layer, a dielectric layer, and a radiation electrode layer stacked in sequence.

[0115] Among them, in some examples, the reference electrode layer is also called the grounding layer, which is connected to the ground signal (which can be a DC low-level signal). It can conduct static electricity and lightning signals generated during use to prevent the antenna from being damaged by breakdown and affecting the antenna performance; the radiating electrode layer is also called the radiation layer, which can convert the electrical signal input through the transmission line into an electromagnetic wave signal, and radiate the electromagnetic wave signal outward, or, it can convert the external electromagnetic wave signal into an electrical signal, and output it to the terminal device through the transmission line to achieve the effect of wireless signal transmission; the dielectric layer can be a dielectric substrate, located between the reference electrode layer and the radiating electrode layer, and can be a low-loss dielectric material, which plays the role of supporting the reference electrode layer and the radiating electrode layer; in some embodiments, the integration of the antenna module in the display can include integration in the screen and integration outside the screen, and integration in the screen includes integration on the screen and integration under the screen.

[0116] The human-computer interaction device in the embodiments of the present disclosure includes fields such as smart homes, vehicle-mounted equipment, health monitoring equipment, and consumer electronic devices that require remote monitoring and interactive perception.

[0117] The following describes in detail the human-computer interaction device provided by the embodiments of the present disclosure in conjunction with practical applications. Taking the application in a smart home scenario as an example, the human-computer interaction device corresponds to various types of smart homes. The interactive device provided by the embodiments of the present disclosure can be used to achieve contactless control of a single or multiple smart homes. The terminal devices may include: home televisions, air conditioners, lights, electronic curtains, water heaters, range hoods, smart stoves, refrigerators, speakers, electronic doors, etc. Among them, the interactive control device can be set separately or inside the corresponding terminal device, and it can establish a one-to-one control relationship, a one-to-many control relationship, or a many-to-one control relationship with each terminal device.

[0118] Take the range hood as the terminal device, and the interactive control device as an example, which is set inside the range hood to perform one-to-one control.

[0119] Among them, the human-machine device includes an antenna module, a data processing module and a display module; the transmitting array element in the antenna module is used to transmit radar signals and the receiving array element receives the reflected echo signal; specifically, the radar signal is a frequency-modulated continuous wave signal; the data processing module includes a low-noise amplifier, a mixer, an intermediate frequency amplifier, an analog-to-digital converter, a digital front-end component, a buffer, a power amplifier, a power divider, a waveform generator, a first processing core and a second processing core; the display module is used to display the determined human body movements and / or control instructions, and display the range hood interactive interface; wherein, the interactive control device and the range hood share the display module, and the antenna module is integrated in the display of the display module, including integration inside the screen and integration outside the screen, and integration inside the screen includes integration on the screen and integration under the screen.

[0120] First, a waveform generator in the data processing module generates a radar signal and sends it through a power divider to a mixer and a power amplifier. After processing, the power amplifier sends the signal to the antenna module for outward transmission. A low-noise amplifier receives the echo signal received by the antenna module, and a mixer mixes the radar signal with the echo signal. After a series of processing through an intermediate frequency amplifier, an analog-to-digital converter, and a digital front-end component, the corresponding data is stored in a buffer. The first processing core analyzes and calculates this data, including one-dimensional Fourier transform, two-dimensional Fourier transform, and angle of arrival calculation, to generate information about the reflected object. Based on this information, the second processing core uses a pre-trained gesture recognition network to identify gestures, determine the user's desired control command for the range hood, and send this control command to the range hood through the corresponding interface. The range hood then executes the corresponding action. Specifically, for example, if a gesture is detected as staying in the designated sensing area for more than 3 seconds, the range hood is turned on; if a gesture is detected as rotating clockwise or counterclockwise, the range hood's airflow is adjusted; and if a gesture is detected as waving left or right, the display interface is controlled to turn pages.

[0121] It will be understood that the above embodiments are merely exemplary embodiments for illustrating the principles of the present invention, and the present invention is not limited thereto. Those skilled in the art will appreciate that various modifications and improvements can be made without departing from the spirit and substance of the present invention, and such modifications and improvements are also considered to be within the scope of protection of the present invention.

Claims

1. A display device, comprising a display module and an antenna module, wherein the display module comprises a display area and an edge area; the antenna module comprises a plurality of antenna units, wherein the antenna units comprise a radiation structure and a transmission line; a plurality of the radiation structures are integrated on the display module; a plurality of the radiation structures located on the same side of the display area are divided into a plurality of groups arranged side by side along a second direction, each group comprising a plurality of the radiation structures arranged side by side along a first direction; the radiation structures located in adjacent groups are arranged in an alternating manner; one radiation structure is connected to one transmission line; wherein, Each of the transmission lines satisfies that the phases of the electromagnetic waves fed into each of the radiation structures are equal.

2. The display device according to claim 1, wherein: The transmission lines are integrated on the display module, and the lengths of the transmission lines are equal.

3. The display device according to claim 1, wherein: The transmission line is integrated on the display module, and the radiation structure includes two groups, one of which is closer to the display area and is called the first radiation structure group, and the other is called the second radiation structure group; The transmission line connected to the radiation structure in the first radiation group is called a first transmission line, the first transmission line includes a first line segment and a second line segment connected to each other, and the first line segment is connected to the radiation structure; the first line segment extends along the second direction; The transmission line connected to the radiation structure in the second radiation group is called a second transmission line, and the second transmission line includes at least one third line segment extending along the first direction and at least one fourth line segment extending along the second direction; The length of the first line segment in the first transmission line is equal to the sum of the lengths of the third line segments in the second transmission line; The line length of the second line segment in the first transmission line is equal to the sum of the line lengths of the fourth line segments in the second transmission line.

4. The display device according to claim 3, wherein: The number of the third line segments in at least some of the second transmission lines is different, and / or the number of the fourth line segments is different.

5. The display device according to claim 3, wherein: Every two adjacent second transmission lines are arranged in a mirror-symmetrical manner.

6. The display device according to claim 3, wherein: The trace directions of the first transmission lines are the same.

7. The display device according to claim 3, wherein: The second line segment includes a first sub-line segment extending along the first direction and a second sub-line segment extending along the second direction.

8. The display device according to claim 1, wherein: The transmission line is integrated on the display module, and the radiation structure includes two groups, one of which is closer to the display area and is called the first radiation structure group, and the other is called the second radiation structure group; The transmission line connected to the radiating structure in the first radiating group is called a first transmission line, and the transmission line connected to the radiating structure in the second radiating group is called a second transmission line. The feeding directions of the first transmission line and the second transmission line are opposite.

9. The display device according to claim 1, wherein: The radiation structure and the transmission line connected thereto are an integrally formed structure.

10. The display device according to claim 1, wherein: The antenna module also includes an adapter board and a printed circuit board; the transmission lines include a first part integrated on the display module, a second part integrated on the adapter board, and a third part integrated on the printed circuit board; the first part of the transmission line is bound and connected to the second part, and the second part is bound and connected to the third part.

11. The display device according to claim 10, wherein: The radiation structure includes two groups, one of which is closer to the display area is called a first radiation structure group, and the other is called a second radiation structure group; The transmission line connected to the radiation structure in the second radiation group is called a first transmission line, and the transmission line connected to the radiation structure in the first radiation group is called a second transmission line; The second portion of the second transmission line includes a plurality of fifth line segments extending along the first direction and a plurality of sixth line segments extending along the second direction; the plurality of fifth line segments and the plurality of sixth line segments are alternately connected in sequence.

12. The display device according to claim 10, wherein: The radiation structure includes two groups, one of which is closer to the display area is called a first radiation structure group, and the other is called a second radiation structure group; The transmission line connected to the radiation structure in the second radiation group is called a first transmission line, and the transmission line connected to the radiation structure in the first radiation group is called a second transmission line; The third portion of the first transmission line and the third portion of the second transmission line have different lengths.

13. The display device according to any one of claims 1 to 12, wherein: The radiation structure includes a plurality of radiation patches connected together, and the radiation patches are arranged side by side along a first direction.

14. The display device according to any one of claims 1 to 12, wherein: The radiation structure includes a plurality of radiation patches connected together, and the radiation patches are arranged side by side along the second direction.

15. The display device according to any one of claims 1 to 12, wherein: The radiation structure includes a plurality of radiation patches connected together; the radiation patches in each of the radiation structures are divided into a plurality of groups arranged side by side along the second direction, each group includes a plurality of radiation patches arranged side by side along the first direction, and the radiation patches in adjacent groups are arranged in an alternating manner.

16. The display device according to any one of claims 1 to 12, wherein: The antenna module includes a radiation layer, the radiation layer covers the display module, and the radiation layer includes a grid structure, and the radiation structure is located in the radiation layer.

17. A human-computer interaction device, comprising the display device according to any one of claims 1 to 16.

18. The human-computer interaction device according to claim 17, wherein: The display module includes a data processing module and a display module; A data processing module, used to determine human body movements and corresponding control instructions according to the radar signal transmitted by the antenna module and the received echo signal, and output the control instruction; A display module is used to display the determined human body motion and / or the control instruction.

19. The human-computer interaction device according to claim 18, wherein: The data processing module includes: a first processing core and a second processing core; The first processing core is used to perform analysis operations on the signal obtained by mixing the radar signal and the echo signal to generate the reflection object information, wherein the analysis operations include: at least one of a 3D Fourier transform, a 2D Fourier transform, and an angle of arrival calculation; The second processing core is used to perform chirp control on the radar signal, pre-train and generate a human motion recognition network, and recognize the human motion through the human motion recognition network according to the reflection object information, and determine the corresponding control instruction.

20. The human-computer interaction device according to claim 18, wherein: The data processing module includes: a low noise amplifier, a mixer, an intermediate frequency amplifier, an analog-to-digital converter, a digital front-end component, a buffer, a power amplifier, a power divider and a waveform generator; Wherein, the low noise amplifier, the mixer, the intermediate frequency amplifier, the analog-to-digital converter, the digital front-end component and the buffer are connected in sequence; The waveform generator, the power distributor and the power amplifier are connected in sequence; The input end of the mixer is also connected to the power divider, the input end of the low noise amplifier is connected to the array antenna, and the output end of the power amplifier is connected to the antenna module.

21. The human-computer interaction device according to claim 20, wherein: The human-computer interaction device includes any one of a smart home, a vehicle-mounted device, a health monitoring device, and a consumer electronic device.

Images