Display device and human-computer interaction device

Abstract

This disclosure provides a display device and a human-computer interaction device, belonging to the field of communication technology. The display device includes a display module and an antenna module. The display module includes a display area and an edge area. The antenna module has multiple antenna elements, each including a radiating structure and a transmission line. Multiple radiating structures are integrated onto the display module. The multiple radiating structures located on the same side of the display area are divided into multiple groups arranged side-by-side along a second direction, each group including multiple radiating structures arranged side-by-side along a first direction. The radiating structures in adjacent groups are staggered. Each radiating structure is connected to a transmission line. Each transmission line satisfies the condition that the electromagnetic waves fed to each radiating structure have equal phase.

Description

Technical Field

[0001] This disclosure belongs to the field of communication technology, and specifically relates to a display device and a human-computer interaction device. Background Technology

[0002] Non-contact sensing technology is playing an increasingly important role in the field of human-computer interaction. Currently, there are various methods to achieve non-contact sensing, including machine vision, ultrasound, and millimeter waves. Millimeter wave-based sensing has become a technological and market hotspot due to its immunity to ambient light, privacy protection, and wide interaction range. However, the resolution of millimeter waves is closely related to the operating frequency and the number of antenna array elements. The most direct way to obtain high angular resolution is to increase the number of antenna array elements, but this directly results in high system overhead. Summary of the Invention

[0003] The present invention aims to solve at least one of the technical problems existing in the prior art, and to provide a display device and a human-computer interaction device.

[0004] This disclosure provides a display device including a display module and an antenna module. The display module includes a display area and an edge area. The antenna module has multiple antenna elements, each antenna element including a radiating structure and a transmission line. Multiple radiating structures are integrated onto the display module. The multiple radiating structures located on the same side of the display area are divided into multiple groups arranged side-by-side along a second direction, each group including multiple radiating structures arranged side-by-side along a first direction. The radiating structures in adjacent groups are staggered. Each radiating structure is connected to one transmission line.

[0005] Each of the transmission lines satisfies that the electromagnetic waves fed into each of the radiation structures are in phase.

[0006] The transmission lines are integrated on the display module, and all the transmission lines have the same length.

[0007] The transmission line is integrated on the display module, and the radiation structure includes two groups, one of which is closer to the display area and is called the first radiation structure group, and the other is called the second radiation structure group.

[0008] The transmission line connected to the radiating structure in the first radiating group is called the first transmission line. The first transmission line includes a first line segment and a second line segment that are connected to each other, and the first line segment is connected to the radiating structure; the first line segment extends along the second direction.

[0009] The transmission line connected to the radiation structure in the second radiation group is called the second transmission line, and the second transmission line includes at least one third segment extending along the first direction and at least one fourth segment extending along the second direction.

[0010] The length of the first segment in the first transmission line is equal to the sum of the lengths of all the third segments in the second transmission line;

[0011] The length of the second segment in the first transmission line is equal to the sum of the lengths of all the fourth segments in the second transmission line.

[0012] Wherein, at least some of the third segments in the second transmission line are different in number, and / or, the fourth segments are different in number.

[0013] Each pair of adjacent second transmission lines is arranged in a mirror-symmetric configuration.

[0014] The traces of each of the first transmission lines are the same.

[0015] The second line segment includes a first sub-line segment extending along the first direction and a second sub-line segment extending along the second direction.

[0016] The transmission line is integrated on the display module, and the radiation structure includes two groups, one of which is closer to the display area and is called the first radiation structure group, and the other is called the second radiation structure group.

[0017] The transmission line connected to the radiating structure in the first radiating group is called the first transmission line, and the transmission line connected to the radiating structure in the second radiating group is called the second transmission line. The first transmission line and the second transmission line have opposite feeding directions.

[0018] The radiating structure and the transmission line connected to it are integrally formed.

[0019] The antenna module further includes an adapter board and a printed circuit board; each transmission line includes a first part integrated on the display module, a second part integrated on the adapter board, and a third part integrated on the printed circuit board; the first part of the transmission line is bonded to the second part, and the second part is bonded to the third part.

[0020] The radiation structure includes two groups, one of which is closer to the display area and is called the first radiation structure group, and the other is called the second radiation structure group; the transmission line connected to the radiation structure in the second radiation group is called the first transmission line, and the transmission line connected to the radiation structure in the first radiation group is called the second transmission line.

[0021] The second portion of the second transmission line includes a plurality of fifth segments extending along the first direction and a plurality of sixth segments extending along the second direction; the plurality of fifth segments and the plurality of sixth segments are connected alternately and sequentially.

[0022] The radiation structure includes two groups, one of which is closer to the display area and is called the first radiation structure group, and the other is called the second radiation structure group; the transmission line connected to the radiation structure in the second radiation group is called the first transmission line, and the transmission line connected to the radiation structure in the first radiation group is called the second transmission line.

[0023] The third part of the first transmission line and the third part of the second transmission line have different lengths.

[0024] The radiation structure includes multiple radiation patches connected together, and each radiation patch is arranged side by side along a first direction.

[0025] The radiation structure includes multiple radiation patches connected together, and each radiation patch is arranged side by side along a second direction.

[0026] The radiation structure includes multiple radiation patches connected together; the radiation patches in each radiation structure are divided into multiple groups arranged side by side along the second direction, each group including multiple radiation patches arranged side by side along the first direction, and the radiation patches in adjacent groups are arranged alternately.

[0027] The antenna module includes a radiating layer that covers the display module, and the radiating layer includes a mesh structure located within the radiating layer.

[0028] This disclosure provides a human-computer interaction device, which includes any of the display devices described above.

[0029] The display module includes a data processing module and a display module;

[0030] The data processing module is used to determine human body movements and corresponding control commands based on the radar signals emitted by the antenna module and the echo signals received, and to output the control commands.

[0031] The display module is used to display the determined human body movements and / or the control commands.

[0032] The data processing module includes: a first processing core and a second processing core;

[0033] The first processing core is used to perform analysis and calculation on the signal obtained after mixing the radar signal and the echo signal to generate the information of the reflecting object. The analysis and calculation includes at least one of one-dimensional Fourier transform, two-dimensional Fourier transform, and angle of arrival calculation.

[0034] The second processing core is used to perform chirp control on the radar signal, pre-train and generate a human motion recognition network, and identify the human motion through the human motion recognition network based on the information of the reflecting object, and determine the corresponding control command.

[0035] The data processing module includes: a low-noise amplifier, a mixer, an intermediate frequency amplifier, an analog-to-digital converter, a digital front-end component, a buffer, a power amplifier, a power divider, and a waveform generator;

[0036] The low-noise amplifier, the mixer, the intermediate frequency amplifier, the analog-to-digital converter, the digital front-end component, and the buffer are connected in sequence.

[0037] The waveform generator, the power divider, and the power amplifier are connected in sequence;

[0038] The input of the mixer is also connected to the power divider, the input of the low-noise amplifier is connected to the array antenna, and the output of the power amplifier is connected to the antenna module.

[0039] The human-computer interaction device includes any one of smart home devices, in-vehicle devices, health monitoring devices, and consumer electronic devices. Attached Figure Description

[0040] Figure 1 This is a schematic diagram of an exemplary liquid crystal display device.

[0041] Figure 2 This is a schematic diagram of another exemplary liquid crystal display device.

[0042] Figure 3 This is a schematic diagram of the pixel arrangement in an exemplary liquid crystal display device.

[0043] Figure 4 This is a schematic diagram of one of the exemplary first polarizers.

[0044] Figure 5 This is a schematic diagram of a display device according to an embodiment of the present disclosure.

[0045] Figure 6 This is a top view of a radiating layer in a display device according to an embodiment of the present disclosure.

[0046] Figure 7This is a schematic diagram of the power supply to the radiating layer in a display device according to an embodiment of the present disclosure.

[0047] Figure 8 This is a top view of another radiating layer in the display device according to an embodiment of the present disclosure.

[0048] Figure 9 This is a top view of another radiating layer in the display device according to an embodiment of the present disclosure.

[0049] Figure 10 This is a top view of another radiating layer in the display device according to an embodiment of the present disclosure.

[0050] Figure 11 This is a top view of another radiating layer in the display device according to an embodiment of the present disclosure.

[0051] Figure 12 This is a schematic diagram showing the connection between the radiating structure and the transmission line in a first example of an embodiment of this disclosure.

[0052] Figure 13 This is a schematic diagram of another radiating structure and transmission line connection in a first example of an embodiment of this disclosure.

[0053] Figure 14 This is a schematic diagram showing the connection between the radiating structure and the transmission line in a second example of an embodiment of this disclosure.

[0054] Figure 15 This is a partial structural diagram of an uncompensated transmission line in a third example of an embodiment of this disclosure.

[0055] Figure 16 This is a partial structural diagram of the compensated transmission line in a third example of an embodiment of this disclosure.

[0056] Figure 17 This is a partial structural diagram of an uncompensated transmission line in a fourth example of an embodiment of this disclosure.

[0057] Figure 18 This is a partial structural diagram of the compensated transmission line in a fourth example of the embodiments of this disclosure.

[0058] Figure 19 This is a schematic diagram of a human-computer interaction device according to an embodiment of the present disclosure.

[0059] Figure 20 This is a schematic diagram of the structure of a data processing module provided in an embodiment of the present disclosure.

[0060] Figure 21 An equivalent circuit diagram of another data processing module provided in an embodiment of this disclosure.

[0061] Figure 22This is a schematic diagram of the structure of another data processing module provided in an embodiment of the present disclosure. Detailed Implementation

[0062] To enable those skilled in the art to better understand the technical solution of the present invention, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0063] Unless otherwise defined, the technical or scientific terms used in this disclosure shall have the ordinary meaning understood by one of ordinary skill in the art to which this disclosure pertains. The terms “first,” “second,” and similar terms used in this disclosure do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Similarly, the terms “an,” “a,” or “the,” and similar terms do not indicate a quantity limitation, but rather indicate the presence of at least one. The terms “including,” “comprising,” or “containing,” and similar terms mean that the element or object preceding the word encompasses the elements or objects listed following the word and their equivalents, without excluding other elements or objects. The terms “connected,” “linked,” or similar terms are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. The terms “upper,” “lower,” “left,” and “right,” etc., are used only to indicate relative positional relationships, and these relative positional relationships may change accordingly when the absolute position of the described objects changes.

[0064] Figure 1 This is a schematic diagram of an exemplary liquid crystal display device; Figure 2 This is a schematic diagram of another exemplary liquid crystal display device; as shown. Figure 1 and 2 As shown, the display device can specifically be a liquid crystal display device, which includes a display module, a backlight module 6 located on the light-incident surface side of the display module, a first polarizer 4 located on the light-incident surface side of the display module, and a second polarizer 5 located between the display module and the backlight module 6.

[0065] Figure 3 This is a schematic diagram of the pixel arrangement in an exemplary liquid crystal display device; as shown. Figure 3 As shown, the display module is divided into multiple pixel units, and each pixel unit 10 includes multiple sub-pixels 100. In this embodiment, the sub-pixels 100 in each pixel unit 10 are denoted as red sub-pixel R, green sub-pixel G, and blue sub-pixel B, respectively. The sub-pixels 100 arranged side-by-side in the first direction X follow the same arrangement pattern. For example, the sub-pixels 100 in the first row of pixel units 10 (from left to right) are arranged in the pattern of red sub-pixel R, green sub-pixel G, and blue sub-pixel B, while the sub-pixels 100 in the second row of pixel units 10 (from left to right) are arranged in the pattern of green sub-pixel G, blue sub-pixel B, and red sub-pixel R. (Continuing to refer to...) Figure 3 In this pixel structure, the sub-pixels 100 arranged side by side in the second direction Y have the same color. For example, the sub-pixels 100 arranged side by side in the second direction Y are all red sub-pixels R.

[0066] It should be noted that the color of subpixel 100 depends on the color of the filter in subpixel 100. If the filter in subpixel 100 is red, then subpixel 100 is called red subpixel R. Similarly, if the filter in subpixel 100 is green, then subpixel 100 is called green subpixel G. If the filter in subpixel 100 is blue, then subpixel 100 is called blue subpixel B.

[0067] The display module includes a first substrate and a second substrate disposed opposite to each other, a liquid crystal layer 3 disposed between the first substrate and the second substrate, and a layer disposed on the side of the first substrate opposite to the liquid crystal layer 3. One of the first substrate and the second substrate is an array substrate 1, and the other is a color filter substrate 2. The film structure of the first polarizer 4 and the second polarizer 5 can actually be the same. Figure 4 This is a schematic diagram of an exemplary first polarizer 4; as shown. Figure 5 As shown, the first polarizer 4 includes a release film 51, an adhesive layer 52, a first support layer 53, a polarizing layer 54, a second support layer 55, a low-reflection layer 56, and a protective layer 57, all stacked together. In this case, the release film 51 of the first polarizer 4 can be peeled off, allowing the adhesive layer 52 to bond to the first substrate. Similarly, when the second polarizer 5 adopts the same structure as the first polarizer 4, the release film 51 of the second polarizer 5 can also be peeled off, allowing the adhesive layer 52 to bond to the second substrate.

[0068] Figure 5 This is a schematic diagram of a display device according to an embodiment of the present disclosure; as shown Figure 5 As shown, based on antenna radiation theory and the structure of the display device, a readily implementable external antenna solution is to place the antenna module between the display module and the first polarizer. The antenna elements in the antenna module can include transmitting and receiving antennas. Alternatively, the antenna elements in the antenna module can be transceiver antennas. The display module has a display area and a peripheral area surrounding the display area, with the antenna elements located in the peripheral area.

[0069] Figure 6 This is a top view of the radiating layer in the display device according to an embodiment of the present disclosure; Figure 7 This is a schematic diagram of the power supply to the radiating layer in a display device according to an embodiment of the present disclosure; as shown Figure 6 and 7As shown, the antenna element includes not only the radiating structure 201 and the first reference electrode, but also a feeding structure. The feeding structure may include a transmission line 203, for example, a coplanar waveguide (CPW) transmission line. Specifically, the transmission line 203 includes a signal electrode 203a and second reference electrodes 203b disposed on both sides of the signal electrode 203a's extension direction. The signal electrode 203a can be electrically connected to the radiating structure 201 via the first feed line. It should be noted that this embodiment only uses a CPW transmission line as an example of the feeding structure; however, it should be understood that the feeding structure is not limited to this, and therefore, the CPW transmission line does not constitute a limitation on the type of feeding structure in this embodiment.

[0070] In some examples, the antenna module in this disclosure includes a radiating layer 200 integrated into a display module, which covers the display module. The radiating layer 200 includes a mesh structure, and a radiating structure 201 is located within the radiating layer. For example, the radiating layer 200 may have intersecting first and second conductive lines. The extension directions of the first and second conductive lines in the conductive mesh structure can be perpendicular to each other, forming a directional or rectangular cutout. Alternatively, the extension directions of the first and second conductive lines in the conductive mesh structure can be non-perpendicular; for example, the angle between the extension directions of the first and second conductive lines is 63°, forming a rhomboid cutout. It should be noted that the portion of the radiating layer 200 located in the display area is a redundant radiating structure 202. The metal mesh of the redundant radiating structure 202 is discontinuous near each intersection.

[0071] In some examples, the line width, line thickness, and line spacing of the first and second conductive lines in the conductive mesh structure are preferably the same, but they can also be different. For example: continue to refer to Figure 9 The linewidth W1 of both the first and second conductive lines is approximately 1-30 μm, the line spacing W2 is approximately 50-250 μm, and the line thickness is approximately 0.5-10 μm. In some examples, the material of the conductive mesh structure includes metals, such as copper, silver, and aluminum.

[0072] Further, such as Figure 7As shown, the display device in this example includes not only the aforementioned structure but also a flexible adapter board 300 and a printed circuit board 400. The flexible adapter board 300 is configured to transmit radio frequency signals between the power supply structure and the printed circuit board 400. For example, the power supply structure is bonded to the flexible adapter board 300, and the printed circuit board 400 is also bonded to the flexible adapter board 300. Specifically, when the power supply structure is bonded to the flexible circuit board, and the printed circuit board 400 is bonded to the flexible adapter board 300, the conductive gold balls in the transparent optical conductive adhesive (ACF adhesive) used have a diameter greater than 10 μm, thereby achieving lower signal loss.

[0073] In some examples, Figure 8 This is a top view of another radiating layer in the display device according to an embodiment of this disclosure; as shown Figure 8 As shown, the radiating structure 201 includes multiple radiating patches 2011 connected together, and the radiating patches 2011 are arranged side by side along the first direction X. That is, the radiating structure 201 includes multiple series-fed radiating patches 2011, which increases the radiating area and improves the gain. Similarly, Figure 9 This is a top view of another radiating layer in the display device according to an embodiment of this disclosure; as shown Figure 9 As shown, the radiating patches 2011 of the radiating structure 201 can also be arranged side by side along the second direction Y.

[0074] In some examples, Figure 10 This is a top view of another radiating layer in the display device according to an embodiment of this disclosure; as shown Figure 10 As shown, the radiating structure 201 includes multiple radiating patches 2011 connected together. The radiating patches 2011 in each radiating structure 201 are divided into multiple groups arranged side-by-side along the second direction Y. Each group includes multiple radiating patches 2011 arranged side-by-side along the first direction X, and the radiating patches 2011 in adjacent groups are staggered. The spacing between the staggered and adjacent radiating structures 201 in the second direction Y is λ / 2. Simulation verification shows that the phenomenon of the gain of the intermediate antenna element decreasing due to the influence of adjacent antenna elements is alleviated, and the gain is almost consistent, with a difference of less than 0.1 dB.

[0075] Figure 11 This is a top view of another radiating layer in the display device according to an embodiment of the present disclosure; see reference. Figure 11 Taking an antenna unit as a transceiver antenna as an example, each antenna unit includes a transmission line 203 integrated in the radiating structure 201 and electrically connected to the radiating structure 201. The transmission line 203 is used to feed power to the radiating structure 201. The radiating structures 201 in each antenna unit located on one side of the display area are divided into multiple groups arranged side by side along the second direction Y. Each group includes multiple groups arranged at intervals along the first direction X, and the radiating structures 201 in the adjacent groups are staggered. Figure 11 Taking an antenna module comprising two sets of radiating structures 201 as an example, for ease of description, the set closer to the display area is referred to as the first radiating structure set 21, and the other as the second radiating structure set 22. The transmission line 203 connected to the radiating structure 201 in the first radiating structure set 211 is called the first transmission line 2031, and the transmission line 203 connected to the radiating structure 201 in the second radiating structure set 22 is called the second transmission line 2032. The spacing between the radiating structures 201 in the first radiating structure set 21 and the second radiating structure set 22 in the second direction Y is λ / 2. Due to the staggered arrangement of the radiating structures 201, the transmission paths of the electromagnetic wave signals are different. These different transmission paths cause the phase difference to be superimposed on the spatial phase difference, thus affecting the estimation of the angle of arrival, as shown in the following formula:

[0076]

[0077] Where λ is the wavelength of the electromagnetic wave signal, d is the spacing between adjacent radiating structures 201 arranged along the first direction X, and ω is the spatial phase difference expressed in radians. Because the staggered arrangement of the radiating structures 201 introduces an additional half-wavelength transmission phase difference, i.e., 180°, compensation is needed for the transmission path. The transmission path depends on the transmission line 203. Several methods for compensating the transmission path of some antenna elements are given below to compensate for the phase difference of the electromagnetic waves radiated by each radiating structure 201.

[0078] It should be noted that the examples below only illustrate that both the first radiating structure group 21 and the second radiating structure group 22 include two radiating structures 201. However, it should be understood that the number of radiating structures 201 in the first radiating structure group 21 and the second radiating structure group 22 is not limited to two, and can be designed according to specific application scenarios.

[0079] First example: Figure 12 This is a schematic diagram showing the connection between the radiating structure 201 and the transmission line 203 in a first example of an embodiment of this disclosure; as shown Figure 12 As shown, the first transmission line 2031 electrically connected to the radiation structure 201 in the first radiation structure group 21, and the second transmission line 2032 electrically connected to the radiation structure 201 in the second radiation structure group 22 are integrated in the display module. Each first transmission line 2031 includes a first segment and a second segment, wherein one end of the first segment is connected to the first radiation structure 201 and the other end is connected to the second segment. The second transmission line 2032 includes a third segment extending along the first direction X and a fourth segment along the second direction Y. The number of third and fourth segments can be one or more, and the third and fourth segments are alternately connected to form the second transmission line 2032.

[0080] Specifically, refer to Figure 12 One second transmission line 2032 includes two third segments and three fourth segments, while the other second transmission line 2032 includes three third segments and four fourth segments. The length of the first segment in the first transmission line 2031 is λ / 2 of the transmission path, and the second segment serves as a compensation transmission path. The total length of the third segments in the second transmission line 2032 is λ / 2 of the transmission path, and the total length of the fourth segments is the compensation transmission path. In this example, the lengths of the first transmission line 2031 and the second transmission line 2032 are equal, thereby compensating for the phase difference of the electromagnetic waves radiated by each radiating structure 201. The length of the first segment in the first transmission line 2031 is represented by 'a', and the length of the second segment is represented by 'b'. The lengths of the two third segments in one second transmission line 2032 are represented by 'a1' and 'a2', and the lengths of the three fourth segments are represented by 'b1', 'b2', and 'b3', respectively. The lengths of the three third segments in another second transmission line 2032 are represented by 'a3', 'a4', and 'a5', and the lengths of the four fourth segments are represented by 'b4', 'b5', 'b6', and 'b7', respectively. In this case, a + b = a1 + a2 + b1 + b2 + b3 = a3 + a4 + a5 + b4 + b5 + b6 + b7. This configuration ensures that the transmission paths in each antenna element are consistent.

[0081] Figure 12 Only one configuration method for each first transmission line 2031 and each second transmission line 2032 is given. Figure 13 This is a schematic diagram showing the connection between another radiating structure 201 and transmission line 203 in the first example of the embodiments of this disclosure. Alternatively, it can also employ... Figure 13 The first transmission line 2031 and the second transmission line 2032 are configured as shown. Specifically, the second segment of the first transmission line 2031, compared to the configuration described above where it extends along the second direction Y, is... Figure 13 The second segment of the first transmission line 2031 is configured as a meandering line, which can be composed of alternating connections of a first sub-segment extending along the first direction X and a second extended sub-segment. Adjacent first transmission lines 2031 are configured in a mirror-symmetrical manner, and every two adjacent second transmission lines 2032 are configured in a mirror-symmetrical manner.

[0082] The above only provides two exemplary methods for integrating the transmission line 203 into the display module. By designing the transmission line 203, the transmission paths of each antenna element have the same structure. It should be understood that as long as the sum of the length of the first segment in the first transmission line 2031 and the length of the third segment in the second transmission line 2032 is λ / 2, and the sum of the lengths of the second segment in the first transmission line 2031 and the third segment in the second transmission line 2032 is equal, it is acceptable. These will not be listed one by one here.

[0083] Second example: Figure 14 This is a schematic diagram showing the connection between the radiating structure 201 and the transmission line 203 in a second example of an embodiment of this disclosure; as shown Figure 14 As shown, this example is largely the same as the first example, integrating both the first transmission line 2031 and the second transmission line 2032 onto the display module. The difference lies in the connection position between the first transmission line 2031 and its corresponding radiating structure 201, which differs from the connection position between the second transmission line 2032 and its corresponding radiating structure 201. Specifically, the radiating structure 201 includes a first side and a second side arranged opposite to each other along the second direction Y. The first transmission line 2031 connects to the first side of its corresponding radiating structure 201, and the second transmission line 2032 connects to the second side of its corresponding radiating structure 201. Furthermore, the connection node between the first transmission line 2031 and its corresponding radiating structure 201 is a first node, and this first node is connected to the center of the radiating structure 201 as a first connecting line segment. Similarly, the connection node between the second transmission line 2032 and its corresponding radiating structure 201 is a second node, and this second node is connected to the center of the radiating structure 201 as a second connecting line segment. The extension directions of the first and second connecting line segments are the same. In this case, the electromagnetic waves transmitted by the first transmission line 2031 and the second transmission line 2032 are in opposite directions.

[0084] In this example, the first transmission line 2031 includes a first segment and a second segment. One end of the first segment is connected to the radiating structure 201, and the other end is connected to the second segment. The second transmission line 2032 includes a third segment and a fourth segment. One end of the third segment is connected to the radiating structure 201, and the other end is connected to the fourth segment. The second segment of the first transmission line 2031 and the fourth segment of the second transmission line 2032 extend in the same direction (e.g., both the second and fourth segments extend along the second direction Y) and have equal lengths. Since the electromagnetic waves transmitted by the first transmission line 2031 and the second transmission line 2032 are in opposite directions, the length of the first segment of the first transmission line 2031 is twice the length of the third segment of the second transmission line 2032.

[0085] The third example: The antenna module includes not only the aforementioned radiating structure 201, transmission line 203, and feed structure, but also an adapter board and a printed circuit board; the feed structure is integrated on the printed circuit board; each transmission line 203 includes a first part integrated on the display module, a second part integrated on the adapter board, and a third part integrated on the printed circuit board; the first part and the second part of the transmission line 203 are bonded together, and the second part and the third part are bonded together. That is, both the first transmission line 2031 and the second transmission line 2032 include a first part, a second part, and a third part. In this example, by designing the second part of the second transmission line 2032, the phase difference caused by the staggered arrangement of the radiating structure 201 is compensated. Based on the phase difference to be compensated, the length l of the transmission path to be compensated is determined using the following formula:

[0086]

[0087] Specifically, Figure 15 This is a partial structural diagram of the uncompensated transmission line 203 in a third example of an embodiment of this disclosure. Figure 16 This is a partial structural diagram of the compensated transmission line 203 in a third example of the embodiments of this disclosure; as shown... Figure 15 and 16 As shown, the second portion 2032b of the second transmission line 2032 includes multiple fifth segments extending along the first direction X and multiple sixth segments extending along the second direction Y; the multiple fifth segments and multiple sixth segments are connected alternately and sequentially. The total length of each sixth segment of the second transmission line 2032 is equal to the length of the second portion 2032a of the first transmission line 2031, and the total length of each fifth segment of the second transmission line 2032 is the length l of the transmission path to be compensated calculated above.

[0088] The fourth example is largely the same as the third example, except that the length of the third section of the second transmission line 2032 needs to be adjusted to compensate for the phase difference caused by the staggered arrangement of the radiation structure 201. The length l of the transmission path to be compensated is determined using the following formula based on the phase difference to be compensated:

[0089]

[0090] The length of the third part of the second transmission line 2032 is adjusted by calculating the length l of the transmission path to be compensated, so that the lengths of the third part 2031c of the first transmission line 2031 and the third part 2032c of the second transmission line 2032 are not equal, thereby making the phases of the electromagnetic waves radiated by each radiation structure 201 equal. Figure 17 This is a partial structural diagram of an uncompensated transmission line in a fourth example of an embodiment of this disclosure. Figure 18 This is a partial structural diagram of the compensated transmission line in a fourth example of the embodiments of this disclosure; as shown... Figure 17 and 18 As shown.

[0091] The above are just a few exemplary structures for compensating for the phase difference of electromagnetic waves radiated by the radiating structure 201 due to the different transmission paths caused by the staggered arrangement of the radiating structure 201. In actual products, multiple of the first, second and third parts of the transmission line 203 can also be designed to compensate for the phase difference, as long as the total compensation is equal to the corresponding phase difference.

[0092] In some examples, the portion of the transmission line integrated into the display module can be located in the radiating layer, and this portion can be integrally formed with the radiating element to which it is connected. This facilitates the creation of a thinner and lighter display device.

[0093] Secondly, Figure 19 This is a schematic diagram of a human-computer interaction device according to an embodiment of this disclosure; as shown Figure 19 As shown in the illustration, this disclosure also provides a human-computer interaction device, which includes the aforementioned antenna module, data processing module, and display module. Specifically, the transmitting element in the antenna module is used to transmit radar signals, and the receiving element is used to receive reflected echo signals; the data processing module is used to determine human actions and corresponding control commands based on the radar signals and echo signals, and outputs the control commands. The display module is used to display the determined human actions and / or control commands.

[0094] In some examples, the data processing module is specifically used to mix and analyze the radar signal and echo signal to obtain information about the reflecting object, and to identify human movements based on the reflecting object information and determine the corresponding control commands. The reflecting object information includes at least one of distance information, velocity information, and angle of arrival information. In some embodiments, the radar signal is a frequency-modulated continuous wave (FMCW) signal.

[0095] Specifically, millimeter-wave radars are broadly classified into pulse radars and continuous-wave radars based on the type of transmitted signal. Pulse radars transmit periodic high-frequency pulses, while continuous-wave radars transmit continuous-wave signals. Continuous-wave signals can include single-frequency continuous-wave (CW) signals or frequency-modulated (FM) continuous-wave signals. For FM continuous-wave signals, the frequency modulation methods include triangular wave, sawtooth wave, coded modulation, or noise frequency modulation, etc. In the aforementioned embodiment, when the radar signal is an FM continuous-wave signal, the antenna module transmits a frequency-changing FM continuous-wave signal within a frequency sweep period. The echo signal reflected by the object has a certain frequency difference from the transmitted radar signal. Subsequently, by measuring the frequency difference, information such as the distance between the object and the antenna module can be obtained.

[0096] In some embodiments, the data processing module is disposed on a printed circuit board, and the antenna module transmits signals to the data processing module via a flexible cable. To achieve lower signal loss, anisotropic conductive film (ACF) with relatively large gold sphere diameters (e.g., greater than 10 μm) can be used for bonding. Alternatively, in some embodiments, the data processing module is disposed on a printed circuit board, and the antenna module is encapsulated inside the data processing module. This printed circuit board can be a high-frequency circuit board, and the antenna module can be encapsulated inside the data processing module based on antenna-in-package (AiP) technology. In some embodiments, the antenna module is installed inside the terminal device. In this case, an opening needs to be made at the corresponding installation location on the terminal device for the sensing area corresponding to the antenna module to reserve a transmission path, so as to avoid the metal casing of the terminal device obstructing the transmission of millimeter waves.

[0097] In some examples, a correspondence between human body movements and control commands is pre-acquired or configured. This can be done by establishing a one-to-one correspondence between human body movements and control commands, establishing a correspondence between human body movements and control commands of a single terminal device, or establishing a correspondence between a single human body movement and control commands of different terminal devices.

[0098] In some examples, the data processing module and the antenna module together form a millimeter-wave radar subsystem, and correspondingly, the display module corresponds to the display subsystem.

[0099] In some examples, the display module includes a routing gateway unit; the routing gateway unit is used to receive media data; accordingly, the display module is also used to display the media data received by the routing gateway unit.

[0100] In some examples, the display module also includes a display, a display driver unit, a chip timing control unit, a signal adapter unit, etc. The media data received by the routing gateway unit is decoded by the signal adapter unit and then driven and controlled by the timing control unit according to a certain timing logic to form a display effect on the display.

[0101] The human-computer interaction device in this embodiment forms a millimeter-wave radar based on an antenna module and a data processing module. Non-contact control is achieved through the millimeter-wave radar. By capturing and recognizing human movements, corresponding control commands are determined and sent to the terminal device, enabling the terminal device to execute the corresponding command response and realize interactive operation.

[0102] Figure 20 This is a schematic diagram of the structure of a data processing module provided in an embodiment of the present disclosure; as shown below. Figure 20 As shown, this data processing module is Figure 19 One specific alternative implementation of the data processing module shown is as follows: Specifically, the data processing module includes a first processing core and a second processing core.

[0103] The first processing core is used to analyze and calculate the signal obtained after mixing the radar signal and the echo signal to generate information about the reflecting object. The analysis and calculation include at least one of one-dimensional fast fourier transform (1D FFT), two-dimensional fast fourier transform (2D FFT), and angle of arrival (AOA) calculation. The distance information and velocity information can be obtained through one-dimensional and two-dimensional fourier transforms, and the angle of arrival information can be obtained through angle of arrival calculation.

[0104] In some embodiments, the first processing core is further configured to determine the valid echo signal based on the Peak Search algorithm and the Constant False-Alarm Rate (CFAR) algorithm before performing the angle of arrival calculation.

[0105] The second processing core is used to perform chirp control on the radar signal, pre-train and generate a human motion recognition network, and identify human motions through the human motion recognition network based on the information of reflecting objects, and determine the corresponding control commands. Here, chirp refers to the characteristic of a signal's instantaneous frequency changing over time. In some embodiments, the radar signal is a frequency-modulated continuous wave signal, and correspondingly, the second processing core is used to configure the chirp parameters of the frequency-modulated continuous wave signal. In some embodiments, the human motion recognition network can be independently configured as a gesture recognition network for accurate recognition of gestures. In some embodiments, the human motion recognition network is a convolutional neural network, which can be based on Torch, PyTorch, VGG, etc. Convolutional neural networks have fewer parameters, faster discrimination speed, and higher discrimination accuracy, making them particularly suitable for image recognition. It should be noted that the above recognition network can use a convolutional neural network model or other neural network models, all of which are applicable to the technical solutions of this application, and will not be elaborated further here.

[0106] In some examples, the first processing core may be a DSP processing core, and the second processing core may be an ARM processing core.

[0107] Figure 21 An equivalent circuit diagram of another data processing module provided in this disclosure embodiment; such as Figure 21 As shown, this data processing module is Figure 19 The data processing module shown is a specific alternative implementation. Specifically, the data processing module includes: a low-noise amplifier 301, a mixer 302, an intermediate frequency amplifier 303, an analog-to-digital converter 304, a digital front-end component 305 (sampling filter), a buffer 306, a power amplifier 401, a power divider 402, and a waveform generator 403. The arrows in the figure indicate the signal transmission direction.

[0108] The low-noise amplifier 301, mixer 302, intermediate frequency amplifier 303, analog-to-digital converter 304, digital front-end component 305, and buffer 306 are connected in sequence; the waveform generator 403, power divider 402, and power amplifier 401 are connected in sequence; the input terminal of mixer 302 is connected to both the low-noise amplifier 301 and the power divider 402; the input terminal of low-noise amplifier 301 is connected to the antenna module, and the output terminal of power amplifier 401 is connected to the antenna module; the data processing module may include multiple receivers. The transmitting link, corresponding to the receiving side, may include multiple sets of low-noise amplifiers 301, mixers 302, intermediate frequency amplifiers 303, and analog-to-digital converters 304 (two sets are shown in the figure as an example), and corresponding to the transmitting side, may include multiple power amplifiers 401 (two are shown in the figure as an example); in some embodiments, each power amplifier 401 is also connected to a phase shifter between itself and the power divider 402; in some embodiments, each mixer 302 is also connected to a filter between itself and its corresponding intermediate frequency amplifier 303.

[0109] The waveform generator 403 generates radar signals, a portion of which is sent to the mixer 302 via the power divider 402, and another portion is sent to the antenna module via the power amplifier 401 via the power divider 402, and then transmitted outward by the corresponding antenna unit in the antenna module. The corresponding antenna unit in the antenna module receives the echo signal reflected after the radar signal encounters an object. The received echo signal is amplified by the low-noise amplifier 301, and then mixed with a portion of the output of the power divider 402 via the mixer 302 to obtain an intermediate frequency signal. This intermediate frequency signal is then converted into corresponding data via the intermediate frequency amplifier 303, the analog-to-digital converter 304, and the digital front-end component 305, and stored in the buffer 306.

[0110] Figure 22 This is a schematic diagram of the structure of another data processing module provided in an embodiment of this disclosure; as shown below. Figure 22 As shown, this data processing module is based on Figure 20 and Figure 21 One specific alternative implementation of the data processing module shown includes: a low-noise amplifier, a mixer, an intermediate frequency amplifier, an analog-to-digital converter, a digital front-end component, a buffer, a power amplifier, a power divider, a waveform generator, a first processing core, and a second processing core.

[0111] Based on the functions of each component, this data processing module can be divided into multiple units, including: an RF / Analog circuit (RF / Analog) unit, a transmit / receive (TR) unit, a signal processing (DSP) unit, and a control (Master) unit; such as Figure 13As shown, the RF / analog circuit unit includes a low-noise amplifier, mixer, intermediate frequency amplifier, analog-to-digital converter, power amplifier, and power divider. The transmit / receive unit includes digital front-end components and a waveform generator. The signal processing unit includes a buffer and a first processing core. The main control unit includes a second processing core. The main control unit and the components in the signal processing unit can communicate and control processes based on a bus matrix. The signal transmission direction within the RF / analog circuit unit can be seen in [reference needed]. Figure 12 .

[0112] In some examples, the RF / analog circuit unit also includes a general-purpose analog-to-digital converter (GPADC), an oscillator (OSC), a temperature controller, etc.; the signal processing unit also includes a cyclic redundancy check (CRC) component, a direct memory access (DMA) component, a low voltage differential signaling (LVDS) interface, a hardware-in-the-loop (HIL) component, a radar data memory, and a hardware accelerator connected to the buffer; the main control unit also includes a direct memory access component, a serial peripheral interface (SPI), a quad serial peripheral interface (QSPI), a bus interface, and a debug serial port; a mailbox module based on a mailbox synchronous communication mechanism is also provided between the main control unit and the signal processing unit.

[0113] In some examples, the data processing module may use the IWR6843 chip or the VYYR7301-A0 chip, etc.

[0114] In some examples, the data processing module may consist only of a low-noise amplifier, mixer, intermediate frequency amplifier, power amplifier, and power divider, such as using the BGT60TR13 chip, while other components such as analog-to-digital converters, digital front-end components, buffers, and waveform generators need to be provided separately.

[0115] Therefore, based on the data processing modules in the above embodiments, it is possible to process corresponding signals and data based on multiple processing cores. The first processing core performs a series of analysis and calculations on the intermediate frequency signal, and the second processing core realizes human motion recognition through a trainable human motion recognition network, thereby improving the accuracy of human motion recognition.

[0116] In some examples, the display module includes a display, and an antenna module is integrated into the display. The antenna module includes a reference electrode layer, a dielectric layer, and a radiating electrode layer stacked sequentially.

[0117] In some examples, the reference electrode layer, also known as the ground layer, is connected to the ground signal (which can be a low-level DC signal). It can discharge static electricity and lightning signals generated during use, preventing the antenna from being damaged by breakdown and affecting its performance. The radiating electrode layer, also known as the radiating layer, can convert the electrical signal input through the transmission line into an electromagnetic wave signal and radiate the electromagnetic wave signal outward. Alternatively, it can convert external electromagnetic wave signals into electrical signals and output them to the terminal device through the transmission line to achieve wireless signal transmission. The dielectric layer can be a dielectric substrate, located between the reference electrode layer and the radiating electrode layer. It can be a low-loss dielectric material and serves to support the reference electrode layer and the radiating electrode layer. In some embodiments, the antenna module is integrated into the display in ways such as integration inside the screen or integration outside the screen. Integration inside the screen can be further divided into integration on the screen or integration under the screen.

[0118] The human-computer interaction devices in this disclosure include smart homes, in-vehicle devices, health monitoring devices, consumer electronics devices, and other fields that require remote monitoring and interaction.

[0119] The human-computer interaction device provided in the embodiments of this disclosure will be described in detail below with reference to practical applications. Taking a smart home scenario as an example, the human-computer interaction device refers to various smart home devices. Using the interaction device provided in the embodiments of this disclosure, one or more smart home devices can be controlled without contact. Terminal devices may include: home televisions, air conditioners, lights, electronic curtains, water heaters, range hoods, smart stoves, refrigerators, audio equipment, electronic doors, etc. The interaction control device can be set up independently or internally within the corresponding terminal devices. It can establish a one-to-one, one-to-many, or many-to-one control relationship with each terminal device.

[0120] Taking a range hood as the terminal device and an interactive control device set inside the range hood for one-to-one control as an example.

[0121] The human-machine interface includes an antenna module, a data processing module, and a display module. The transmitting element in the antenna module is used to transmit radar signals, and the receiving element receives reflected echo signals. Specifically, the radar signal is a frequency-modulated continuous wave signal. The data processing module includes a low-noise amplifier, a mixer, an intermediate frequency amplifier, an analog-to-digital converter, a digital front-end component, a buffer, a power amplifier, a power divider, a waveform generator, a first processing core, and a second processing core. The display module is used to display determined human actions and / or control commands, as well as the range hood's interactive interface. The interactive control device shares the display module with the range hood, and the antenna module is integrated into the display module's display, including integration within the screen and integration outside the screen. Integration within the screen includes integration on the screen and integration under the screen.

[0122] First, the waveform generator in the data processing module generates radar signals and sends them to the mixer and power amplifier via the power divider. After processing by the power amplifier, the signals are sent to the antenna module for transmission. The low-noise amplifier receives the echo signals received by the antenna module. The mixer mixes the radar signals with the echo signals. After a series of processing steps by the intermediate frequency amplifier, analog-to-digital converter, and digital front-end components, the corresponding data is stored in the buffer. The first processing core analyzes and processes this data, including one-dimensional Fourier transform, two-dimensional Fourier transform, and angle of arrival calculation, to generate information about the reflecting object. The second processing core recognizes hand gestures based on the information about the reflecting object using a pre-trained gesture recognition network, determines the user's desired control command for the range hood, and sends the control command to the range hood through the corresponding interface. The range hood then executes the corresponding action. Specifically, for example, when a hand gesture is detected as staying in the designated sensing area for more than 3 seconds, the range hood is turned on; when a hand gesture is detected as clockwise or counterclockwise rotation, the range hood's fan speed is adjusted; and when a hand gesture is detected as waving left or right, the display interface is turned on.

[0123] It is understood that the above embodiments are merely exemplary implementations used to illustrate the principles of the present invention, and the present invention is not limited thereto. For those skilled in the art, various modifications and improvements can be made without departing from the spirit and essence of the present invention, and these modifications and improvements are also considered to be within the scope of protection of the present invention.

Claims

1. A display device comprising a display module and an antenna module, the display module comprising a display area and an edge area; the antenna module comprising a plurality of antenna elements, each antenna element comprising a radiating structure and a transmission line; Multiple radiating structures are integrated on the display module; the multiple radiating structures located on the same side of the display area are divided into multiple groups arranged side by side along a second direction, each group including multiple radiating structures arranged side by side along a first direction; the radiating structures in adjacent groups are staggered; one radiating structure is connected to one transmission line; the radiating structure includes two groups, the one closer to the display area is called the first radiating structure group, and the other is called the second radiating structure group; The transmission line connected to the radiating structure in the first radiating structure group is called the first transmission line; the transmission line connected to the radiating structure in the second radiating structure group is called the second transmission line; wherein... The transmission lines are integrated on the display module, and each of the transmission lines satisfies that the electromagnetic waves fed into each of the radiating structures are in phase. Furthermore, all of the aforementioned transmission lines have the same length; Alternatively, the first transmission line includes interconnected first and second segments, with the first segment connected to the radiating structure; the first segment extends along the second direction; the second transmission line includes at least one third segment extending along the first direction and at least one fourth segment extending along the second direction; at least some of the second transmission lines have different numbers of third segments, and / or different numbers of fourth segments; the length of the first segment in the first transmission line is equal to the sum of the lengths of all the third segments in the second transmission line; the length of the second segment in the first transmission line is equal to the sum of the lengths of all the fourth segments in the second transmission line.

2. The display device according to claim 1, wherein, The second transmission lines are arranged in a mirror image of each pair of adjacent lines.

3. The display device according to claim 1, wherein, The traces of each of the first transmission lines are the same.

4. The display device according to claim 1, wherein, When the first transmission line includes a first segment and a second segment connected to each other, the second segment includes a first sub-segment extending along the first direction and a second sub-segment extending along the second direction.

5. The display device according to claim 1, wherein, The first transmission line and the second transmission line are fed in opposite directions.

6. The display device according to claim 1, wherein, The radiating structure and the transmission line connected to it are integrally formed.

7. The display device according to claim 1, wherein, The antenna module also includes an adapter board and a printed circuit board; each transmission line includes a first part integrated on the display module, a second part integrated on the adapter board, and a third part integrated on the printed circuit board; the first part of the transmission line is bonded to the second part, and the second part is bonded to the third part.

8. The display device according to claim 7, wherein, The second portion of the second transmission line includes a plurality of fifth segments extending along the first direction and a plurality of sixth segments extending along the second direction; the plurality of fifth segments and the plurality of sixth segments are connected alternately and sequentially.

9. The display device according to claim 7, wherein, The third part of the first transmission line and the third part of the second transmission line have different lengths.

10. The display device according to any one of claims 1-9, wherein, The radiating structure includes a plurality of radiating patches connected together, and the radiating patches are arranged side by side along a first direction.

11. The display device according to any one of claims 1-9, wherein, The radiating structure includes a plurality of radiating patches connected together, and the radiating patches are arranged side by side along a second direction.

12. The display device according to any one of claims 1-9, wherein, The radiation structure includes multiple radiation patches connected together; the radiation patches in each radiation structure are divided into multiple groups arranged side by side along the second direction, each including multiple radiation patches arranged side by side along the first direction, and the radiation patches in adjacent groups are staggered.

13. The display device according to any one of claims 1-9, wherein, The antenna module includes a radiating layer that covers the display module, and the radiating layer includes a mesh structure located within the radiating layer.

14. A human-computer interaction device, comprising the display device according to any one of claims 1-13, wherein the display device comprises an antenna module and a display module.

15. The human-computer interaction device according to claim 14, wherein, The display module includes a data processing module and a display module; The data processing module is used to determine human body movements and corresponding control commands based on the radar signals emitted by the antenna module and the echo signals received, and to output the control commands. The display module is used to display the determined human body movements and / or the control commands.

16. The human-computer interaction device according to claim 15, wherein, The data processing module includes: a first processing core and a second processing core; The first processing core is used to perform analysis and calculation on the signal obtained after mixing the radar signal and the echo signal to generate information about the reflecting object. The analysis and calculation includes at least one of one-dimensional Fourier transform, two-dimensional Fourier transform, and angle of arrival calculation. The second processing core is used to perform chirp control on the radar signal, pre-train and generate a human motion recognition network, and identify the human motion through the human motion recognition network based on the information of the reflecting object, and determine the corresponding control command.

17. The human-computer interaction device according to claim 15, wherein, The data processing module includes: a low-noise amplifier, a mixer, an intermediate frequency amplifier, an analog-to-digital converter, a digital front-end component, a buffer, a power amplifier, a power divider, and a waveform generator; The low-noise amplifier, the mixer, the intermediate frequency amplifier, the analog-to-digital converter, the digital front-end component, and the buffer are connected in sequence. The waveform generator, the power divider, and the power amplifier are connected in sequence; The input of the mixer is also connected to the power divider, the input of the low-noise amplifier is connected to the antenna module, and the output of the power amplifier is connected to the antenna module.

18. The human-computer interaction device according to claim 17, wherein, The human-computer interaction device includes any one of smart home devices, in-vehicle devices, health monitoring devices, and consumer electronic devices.

Images