Display devices and interactive devices

Abstract

This utility model provides a display device and an interactive device, relating to the fields of display technology and artificial intelligence. The display device includes a display panel, an image acquisition unit, a controller, and a connecting part. The display panel includes a first display area and a second display area, the second display area at least partially surrounding the first display area, and the first display area including at least one first display sub-area. The image acquisition unit is disposed on the side of the display panel away from the light emission direction, and its orthographic projection on the display panel at least partially overlaps with at least one first display sub-area. The light receiving direction of the image acquisition unit is parallel to the light emission direction of the display panel. The controller is disposed on the side of the image acquisition unit away from the display panel. The connecting part connects the image acquisition unit and the controller, and also connects the display panel and the controller.

Description

Technical Field

[0001] This utility model relates to the fields of display technology and artificial intelligence, and in particular to a display device and an interactive device. Background Technology

[0002] With the development of artificial intelligence and robotics, interactive robots have been widely used in various scenarios. In human-computer interaction, the visual perception system is the core component that can influence the robot's interaction process. Therefore, it is necessary to improve the robot's functionality and user experience by designing a visual perception system. Utility Model Content

[0003] This utility model provides a display device and an interactive device.

[0004] According to a first aspect, the present invention provides a display device, comprising: a display panel including a first display area and a second display area, the second display area at least partially surrounding the first display area, the first display area including at least one first display sub-area; an image acquisition device disposed on the side of the display panel away from the light emission direction, the orthographic projection of the image acquisition device on the display panel at least partially overlapping with at least one first display sub-area, the light receiving direction of the image acquisition device being parallel to the light emission direction of the display panel; a controller disposed on the side of the image acquisition device away from the display panel; and a connecting part connecting the image acquisition device and the controller, and connecting the display panel and the controller.

[0005] According to a second aspect, the present invention provides a display panel, comprising: a device body and a display device provided in the embodiments of the present invention, wherein the display device is mounted on the device body.

[0006] In the embodiments of this utility model, the display device uses a display panel and an image acquisition device to display the screen and acquire images respectively, thereby realizing human-computer interaction with the user. By setting the positional relationship between the image acquisition device and the first display area in the display panel, the image acquisition device can acquire images through the first display area. This makes the display center of the first display area basically coincide with the visual center of the image acquisition device, achieving a natural interactive effect of "seeing is seeing," thus solving the problem of the separation of screen display and image acquisition positions in the display device, improving the human-computer interaction effect, saving display device space, and reducing hardware costs. Attached Figure Description

[0007] Figure 1 A schematic diagram of the structure of a display device according to an embodiment of the present invention is shown.

[0008] Figure 2A A front view of a display device according to an embodiment of the present invention is shown.

[0009] Figure 2BA front view of a display device according to another embodiment of the present invention is shown.

[0010] Figure 3 A top view of a display device according to another embodiment of the present invention is shown.

[0011] Figure 4 A top view of a display device according to another embodiment of the present invention is shown.

[0012] Figure 5 A top view of a display device according to another embodiment of the present invention is shown.

[0013] Figure 6 A schematic diagram of the structure of a display device according to another embodiment of the present invention is shown.

[0014] Figure 7 A front view of a display device according to another embodiment of the present invention is shown.

[0015] Figure 8 A schematic diagram of the structure of a display panel according to an embodiment of the present invention is shown.

[0016] Figure 9 A schematic diagram of the structure of a display panel according to another embodiment of the present invention is shown.

[0017] Figure 10 A schematic diagram of the structure of a display panel according to another embodiment of the present invention is shown.

[0018] Figure 11 A schematic diagram of the structure of an electronic device according to an embodiment of the present invention is shown. Detailed Implementation

[0019] To make the objectives, technical solutions, and advantages of the embodiments of this utility model clearer, the technical solutions of the embodiments of this utility model will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this utility model. Based on the described embodiments of this utility model, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this utility model. In the following description, some specific embodiments are for descriptive purposes only and should not be construed as limiting the utility model in any way, but are merely examples of embodiments of this utility model. Conventional structures or constructions will be omitted where they may cause confusion in understanding the utility model. It should be noted that the shapes and dimensions of the components in the figures do not reflect actual size and proportion, but are only schematic representations of the contents of the embodiments of this utility model.

[0020] Unless otherwise defined, the technical or scientific terms used in the embodiments of this utility model shall have the ordinary meaning as understood by those skilled in the art. The terms "first," "second," and similar terms used in the embodiments of this utility model do not indicate any order, quantity, or importance, but are merely used to distinguish different components.

[0021] Furthermore, in the description of the embodiments of this utility model, the terms "connected to" or "linked" can refer to two components being directly connected, or to two components being connected via one or more other components, with the connection method being electrical connection or electrical coupling. Additionally, the two components can also be connected or coupled via wired or wireless means.

[0022] Figure 1 A schematic diagram of the structure of a display device according to an embodiment of the present invention is shown.

[0023] like Figure 1 As shown, the display device 100 includes a display panel 110, an image acquisition unit 120, a controller 130, and a connection unit 140.

[0024] In an embodiment of this utility model, the image acquisition unit 120 is disposed on the side of the display panel 110 away from the light emission direction. The controller 130 is disposed on the side of the image acquisition unit 120 away from the display panel 110. The connecting part 140 connects the image acquisition unit 120 and the controller 130, and the connecting part 140 also connects the display panel 110 and the controller 130.

[0025] For example, the light emission direction of the display panel 110 is direction -Y, and the user views the display screen of the display panel 110 from the light emission direction. The direction in which the display panel 110 points to the image acquisition unit 120 is direction Y, and the direction in which the image acquisition unit 120 points to the controller 130 is direction Y. When the display area of ​​the display panel 110 is planar, both the first display area 111 and the second display area 112 are located in the plane formed by directions X and Z, and direction Y intersects with this plane.

[0026] For example, direction X intersects direction Y, direction X intersects direction Z, and direction Y intersects direction Z. The angle between any two of directions X, Z, and Y can be selected and set according to actual needs. For example, the angle between direction X and direction Y can be 85°, 88°, or 90°, etc.

[0027] In embodiments of this invention, the display panel 110 can be an organic light-emitting diode (OLED) display panel. The display panel 110 can serve as the display area for an interactive robot, displaying content required for user interaction. For example, the display panel 110 can be installed in the eye sockets of a humanoid robot's head, serving as an eye-like component. For example, the display panel 110 can display dynamic eye expressions or facial expressions. OLED display panels offer comprehensive advantages such as self-illumination, high contrast, flexibility, fast response, low power consumption, and light-transmitting integration.

[0028] In an embodiment of this utility model, the display panel 110 includes a first display area 111 and a second display area 112. The second display area 112 at least partially surrounds the first display area 111. The first display area 111 may be disposed in the central region of the second display area 112, and the second display area 112 may be disposed around the first display area 111. The first display area 111 may be a high-transmittance display area. For example, light can penetrate from a first side of the first display area 111 to a second side of the first display area 111, and light can also penetrate from the second side of the first display area 111 to a first side of the first display area 111. The direction from the first side to the second side may be direction Y, and the direction from the second side to the first side may be direction -Y.

[0029] In an embodiment of this invention, the orthographic projection of the image acquisition device 120 onto the display panel 110 at least partially overlaps with the first display area 111, and the light receiving direction of the image acquisition device 120 is parallel to the light emitting direction of the display panel 110. For example, the light emitting direction of the display panel 110 can be direction -Y, and the light receiving direction of the image acquisition device 120 can be direction Y. The orthographic projection of the image acquisition device 120 onto the display panel 110 is the projection of the image acquisition device 120 along direction -Y onto the display panel 110. Since the orthographic projection of the image acquisition device 120 onto the display panel 110 at least partially overlaps with the first display area 111, the image acquisition device 120 can receive light through the first display area 111 to perform image acquisition.

[0030] For example, the image acquisition device 120 can be the acquisition terminal of the vision system in the display device 100. With the user's permission or authorization, the image acquisition device 120 can acquire the user's image information or the user's environmental information. The image acquisition device 120 can transmit the acquired information to the controller 130 via the connection unit 140, and the controller 130 analyzes and recognizes the information acquired by the image acquisition device 120. For example, the controller 130, in conjunction with the image acquisition device 120, can perform facial expression recognition, eye tracking, user localization, environmental understanding, etc.

[0031] In an embodiment of this invention, the first display area 111 includes at least one first display sub-area. The orthographic projection of the image acquisition device 120 onto the display panel 110 at least partially overlaps with at least one of the first display sub-areas.

[0032] When the first display area 111 includes a first display sub-area, the orthographic projection of the image acquisition device 120 onto the display panel 110 at least partially overlaps with the first display sub-area. Therefore, the image acquisition device 120 can receive light through the first display sub-area.

[0033] When the first display area 111 includes multiple first display sub-areas, the orthographic projection of the image acquisition device 120 onto the display panel 110 at least partially overlaps with at least one of the multiple first display sub-areas. Therefore, the image acquisition device 120 can receive light through the at least one first display sub-area. The image acquisition device 120 can receive light through one first display sub-area or through multiple first display sub-areas.

[0034] In embodiments of this invention, the connecting portion 140 can be a flexible connecting component, such as a flexible printed circuit (FPC) cable. The connecting portion 140 can be a flexible electrical connection component for integrated circuit circuits, using a flexible substrate as a carrier, and features bendability, thinness, small size, and high reliability. For example, the connecting portion 240 can be an ultra-thin circuit connection component that can be freely bent, folded, and rolled up, made by etching copper foil to form conductive lines and then covering it with a protective layer, using a polyimide / polyester flexible insulating film as a substrate.

[0035] For example, the connection unit 140 is connected to the display panel 110, the image acquisition unit 120, and the controller 130. The connection unit 140 can be connected to an external power source to power the display panel 110, the image acquisition unit 120, and the controller 130. The connection unit 140 can also provide video data to the controller 130. The controller 130 may include a drive circuit that generates scan signals and data signals based on the video data. The connection unit 140 transmits the scan signals and data signals from the controller 130 to the display panel 110 to drive the display panel 110 to display an image. The controller 130 can also generate control signals based on the video data to control the image acquisition unit 120 to acquire information.

[0036] The two ends of the connector 140 can be connected to the controller 130 and the image acquisition unit 120, respectively. The image acquisition unit 120 can send the acquired image information to the controller 130 via the connector 140. The controller 130 generates a control signal based on the received image information to control the display screen of the display panel 110.

[0037] Understandably, the front of the display panel 110 faces the user, who is located on the light-emitting side of the display panel 110, so that content can be displayed to the user. The image acquisition unit 120 and the controller 130 are located on the non-light-emitting side of the display panel 110. The image acquisition unit 120 is positioned on the back of the display panel 110, forming an under-display camera display with the display panel 110. The front of the image acquisition unit 120 faces the display panel 110, used to acquire information through the display panel. The controller 130 is positioned on the back of the image acquisition unit 120, preventing the controller 130 from obstructing the light receiving path of the image acquisition unit 120, thereby improving the image acquisition effect of the image acquisition unit 120.

[0038] In embodiments of this invention, the display device 100 performs screen display and image acquisition based on the display panel 110 and the image acquisition device 120, respectively, thereby enabling human-computer interaction between the display and the user. By setting the positional relationship between the image acquisition device 120 and the first display area 111 in the display panel 110, the image acquisition device 120 can acquire images through the first display area 111. This makes the display center of the first display area 111 essentially coincide with the visual center of the image acquisition device 120, achieving a natural interactive effect of "seeing is seeing," thereby solving the problem of the separation of screen display and image acquisition positions in the display device, improving the human-computer interaction effect, saving display device space, and reducing hardware costs.

[0039] Combination Figure 2A and Figure 2B The positional relationship between the display panel 110 and the image acquisition unit 120 is illustrated.

[0040] Figure 2A A front view of a display device according to an embodiment of the present invention is shown. Figure 2B A front view of a display device according to another embodiment of the present invention is shown.

[0041] like Figure 2A As shown, the display panel 110 includes a first display area 111 and a second display area 112. For example, the display area of ​​the display panel 110 can be divided into a first display area and a second display area, and all display areas of the display panel 110 other than the first display area are the second display area.

[0042] In embodiments of this invention, the first display area 111 includes only one first display sub-area; that is, the first display area 111 can be considered as the first display sub-area. The image acquisition device also includes only one acquisition unit C1.

[0043] The orthographic projection of the acquisition unit C1 onto the display panel 110 at least partially overlaps with the first display area 111. The light receiving direction of the acquisition unit C1 is parallel to the light emitting direction of the first display area 111, allowing the acquisition unit C1 to receive light through the first display area 111, thereby achieving image acquisition. For example, the light emitting direction of the first display area 111 can be perpendicular to the plane formed by directions X and Z, and the light receiving direction of the acquisition unit C1 can also be perpendicular to the plane formed by directions X and Z.

[0044] The orthographic projection of the acquisition unit C1 onto the display panel 110 can fall completely into the first display area 111, so that the first display area 111 can provide the acquisition unit C1 with the maximum light receiving range, allowing the acquisition unit C1 to acquire more image information through the first display area 111.

[0045] like Figure 2B As shown, the first display area includes multiple first display sub-areas 1111 and 1112, and the image acquisition unit includes multiple acquisition units C1 and C2. The orthographic projection of one of the acquisition units C1 and C2 on the display panel partially overlaps with at least one of the multiple first display sub-areas 1111 and 1112. The light receiving direction of the acquisition unit and the light emitting direction of the first display sub-area whose orthographic projection at least partially overlaps with the first display sub-area.

[0046] In an embodiment of this invention, the orthographic projection of acquisition unit C1 on display panel 110 at least partially overlaps with the first display sub-area 1111, and the light receiving direction of acquisition unit C1 is parallel to the light emitting direction of the first display sub-area 1111. This allows acquisition unit C1 to receive light through the first display sub-area 1111, thereby achieving image acquisition. The orthographic projection of acquisition unit C2 on display panel 110 at least partially overlaps with the first display sub-area 1112, and the light receiving direction of acquisition unit C2 is parallel to the light emitting direction of the first display sub-area 1112. This allows acquisition unit C2 to receive light through the first display sub-area 1112, thereby achieving image acquisition. For example, the light emitting directions of the first display sub-areas 1111 and 1112 can be perpendicular to the plane formed by directions X and Z, and the light receiving directions of acquisition units C1 and C2 can also be perpendicular to the plane formed by directions X and Z.

[0047] In embodiments of this invention, the orthographic projections of acquisition unit C1 and acquisition unit C2 on display panel 110 can both overlap with the same first display sub-area. For example, the orthographic projections of acquisition unit C1 and acquisition unit C2 on display panel 110 can both overlap with the first display sub-area 1111, or the orthographic projections of acquisition unit C1 and acquisition unit C2 on display panel 110 can both overlap with the first display sub-area 1112. Since multiple acquisition units receive light through the same first display sub-area, the image acquisition efficiency through a single first display sub-area can be improved.

[0048] In the embodiments of this utility model, Figure 2A The illustrated display device may have a monocular vision recognition system, i.e., it employs a single acquisition unit for image acquisition. When the image acquisition unit comprises only one acquisition unit, the first display area may include one or more first display sub-areas. The orthographic projection of the acquisition unit onto the display panel overlaps with one of the first display sub-areas.

[0049] Figure 2B The illustrated display device can have a binocular vision recognition system, i.e., it uses two acquisition units to acquire images. It should be noted that when the image acquisition unit includes multiple acquisition units, the first display area can include one or more first display sub-areas. The orthographic projections of multiple acquisition units on the display panel overlap with the same display sub-area, or the orthographic projections of multiple acquisition units on the display panel can overlap with different first display sub-areas.

[0050] It should be noted that the number of acquisition units is not necessarily related to the number of first display sub-areas, and there is no need for a one-to-one correspondence between acquisition units and first display sub-areas. Those skilled in the art can set the appropriate number of first display sub-areas and acquisition units according to actual display and image acquisition requirements.

[0051] In embodiments of this invention, two acquisition units can be used to form the left and right eye structures of the interactive robot, respectively. The left and right eye positions can be configured with identical integrated structures, which improves the recognition capabilities of the display device 100, such as obstacle avoidance and gesture recognition, making it suitable for companion robots or home service robots requiring high-precision spatial awareness.

[0052] Figure 3 A top view of a display device according to another embodiment of the present invention is shown.

[0053] like Figure 3 As shown, the image acquisition device 120 can be a camera, and the image acquisition device 120 includes a lens 121.

[0054] In an embodiment of this utility model, the optical axis of the lens 121 is collinear with the geometric center normal of the first display area 111.

[0055] The optical axis of lens 121 is a reference axis that passes through the center of all optical elements of image acquisition unit 120 and coincides with the system's axis of symmetry. The direction of the optical axis is consistent with the direction pointed to by lens 121. For example, the optical axis extends along direction Y, and the direction of the optical axis is direction -Y.

[0056] The geometric center normal of the first display area 111 is a straight line that passes through the geometric center of the first display area 111 and is perpendicular to the first display area 111. For example, the geometric center normal of the first display area 111 extends along the direction Y. The first display area 111 is located in the plane formed by the directions X and Z, and the geometric center normal of the first display area 111 is perpendicular to this plane and passes through the geometric center point of the first display area 111.

[0057] In this embodiment of the invention, the optical axis of the lens 121 can be axis AA', and the geometric center normal of the first display area 111 is also axis AA'. Since the optical axis of the lens 121 and the geometric center normal of the first display area 111 are completely coincident, the visual optical center of the image acquisition unit 120 is completely coincident with the display center of the first display area 111, meaning the image acquisition unit 120 and the first display area 111 are considered to be completely coaxial. In this case, the reference bases for display and image acquisition of the display device are essentially coincident, which can improve the coordination efficiency between display and image acquisition, improve the accuracy of human-computer interaction of the display device, achieve a natural interactive effect of "seeing is seeing," and improve the user experience. Furthermore, this can also improve the problem of the separation between the camera and the core display area (first display area 111), avoiding the visual disjointedness and structural complexity of the robot integrating this display device.

[0058] Figure 4 A top view of a display device according to another embodiment of the present invention is shown.

[0059] like Figure 4 As shown, the surface of the display panel located in the first display area 111 is constructed as a curved structure, so that the first display area 111 includes multiple light emission directions ED1, ED2, ED3, and ED4. The image acquisition unit 120 is configured to rotate following the effective light emission direction among the multiple light emission directions ED1, ED2, ED3, and ED4, so that the light receiving directions RD1 and RD2 of the image acquisition unit are parallel to the light emission directions.

[0060] In embodiments of this invention, the display panel can be a flexible panel, and the first display area 111 can be curved. The first display area 111 has multiple light emission directions ED1, ED2, ED3, and ED4, and can display images in multiple directions.

[0061] In actual display scenarios, the first display area 111 can face different directions to display, so that some of the multiple light-emitting directions ED1, ED2, ED3, and ED4 are effective light-emitting directions.

[0062] like Figure 4 As shown, among the multiple light emission directions ED1, ED2, ED3, and ED4, light emission directions ED1 and ED2 are the effective light emission directions. At this time, the effective display area DIS in the first display area 111 displays the image, while the areas in the first display area 111 other than the effective display area DIS temporarily do not display the image. Understandably, the first display area 111 displays the image towards users located in light emission directions ED1 and ED2, while users located in light emission directions ED3 and ED4 have difficulty viewing the current display image.

[0063] In this configuration, the image acquisition unit 120 can rotate following the effective light emission direction until the light receiving direction is parallel to the effective light emission direction. This ensures that the image acquisition direction of the image acquisition unit 120 is essentially consistent with the display direction of the first display area, thereby improving the consistency and coordination between screen display and image acquisition. When the display panel is displaying a screen to a specific user, the image acquisition unit can also turn towards that specific user to acquire image information about that user, thus enabling intelligent interactive functions such as eye tracking and facial expression responsiveness.

[0064] In embodiments of this invention, the image acquisition unit 120 can be movably connected to any fixed structure, allowing the image acquisition unit 120 to rotate relative to the fixed structure to follow the effective light emission direction of the first display area. For example, the image acquisition unit 120 can be movably connected to a fixed structure within the display device. Alternatively, when the display device is integrated into another main body, the image acquisition unit 120 can be movably connected to a fixed structure within that main body. For example, the image acquisition unit 120 can be movably connected via hinges or bearing connections.

[0065] Figure 5 A top view of a display device according to another embodiment of the present invention is shown.

[0066] like Figure 5 As shown, the image acquisition unit 120 includes a lens 121. The image acquisition unit 120 is configured such that by rotation, the optical axis of the lens 121 is collinear with the normal to the center of the effective display area of ​​the first display area 111.

[0067] In this embodiment of the invention, the effective display area DIS of the first display area 111 displays the image. The surface of the effective display area DIS is constructed as a curved structure, and the effective display area DIS can exhibit a natural curvature towards one or both sides. The display center of the effective display area DIS may or may not coincide with its geometric center. The display center of the effective display area DIS can serve as a reference point for the lens 121 to capture images.

[0068] The optical axis of lens 121 can be AA', and the normal to the display center of the effective display area DIS is also AA'. The normal to the display center of the effective display area DIS passes through the display center of the effective display area DIS. Since the optical axis of lens 121 and the normal to the display center of the effective display area DIS are completely coincident, the visual optical center of image acquisition unit 120 is completely coincident with the display center of the effective display area DIS. Therefore, lens 121 and the effective display area DIS can be considered to be completely coaxial.

[0069] In this embodiment of the invention, the lens 121 rotates within the image acquisition unit 120, such that the optical axis of the lens 121 is collinear with the normal of the center of the effective display area of ​​the first display area 111. In this configuration, the reference points for display and image acquisition of the display device essentially coincide, allowing light to enter the lens along the direction of the center normal of the effective display area. This minimizes refraction, deflection, and imaging distortion caused by the curved glass, thereby ensuring that the image acquired by the image acquisition unit is clear and free from significant vignetting, glare, and geometric distortion.

[0070] Figure 6 A schematic diagram of the structure of a display device according to another embodiment of the present invention is shown.

[0071] like Figure 6 As shown, the display device 200 includes a display panel 210, an image acquisition unit 220, a controller 230, a connection part 240, and a sensor 250.

[0072] In embodiments of this utility model, the display panel 210, image acquisition device 220, controller 230, and connection part 240 can refer to the display panel 110, image acquisition device 120, controller 130, and connection part 140 described above. For the sake of brevity, similar parts will not be described again.

[0073] In an embodiment of this invention, the sensor 250 is disposed on the side of the display panel 110 away from the light emission direction. The orthographic projection of the sensor 250 on the display panel 210 at least partially overlaps with at least one first display sub-area. The sensor 250 collects depth information through the first display sub-area. For example, the sensor 250 can emit modulated infrared light and receive the reflected signal from the object being collected to obtain the depth information of the object.

[0074] In this embodiment of the invention, sensor 250 is electrically connected to controller 230. Based on control signals from controller 230, sensor 250 can acquire depth information. Sensor 250 transmits the acquired depth information to controller 230 via connector 240. Controller 230 integrates image information acquired by image acquisition unit 220 and depth information acquired by sensor 250 to perform operations such as face recognition, gesture recognition, and user posture analysis.

[0075] In embodiments of this invention, both the sensor 250 and the image acquisition device 220 are disposed on a plane perpendicular to the light emission direction. For example, if the light emission direction is direction Y, both the sensor 250 and the image acquisition device 220 are disposed in the plane formed by directions Z and X, and the plane formed by directions Z and X is perpendicular to direction Y.

[0076] For example, the sensor 250 can also be arranged around the image acquisition unit 220 to reduce the error between the depth information acquired by the sensor 250 and the image information acquired by the image acquisition unit 220.

[0077] Sensor 250 and image acquisition device 220 can acquire depth information and image information respectively for the same object. Since sensor 250 and image acquisition device 220 are set in the same plane, the distance of sensor 250 relative to the object being acquired is basically the same as the distance of image acquisition device 220 relative to the object being acquired. This makes the reference reference for depth information and the reference reference for image information basically consistent, which is beneficial for sensor 250 to process image information and depth information in a unified manner.

[0078] Combination Figure 6 and Figure 7 The position of sensor 250 is illustrated schematically. Figure 7 A front view of a display device according to another embodiment of the present invention is shown.

[0079] like Figure 7As shown, the display panel 210 includes a first display area 211, which may consist of only a first display sub-area, i.e., the first display area 111 can be considered as this first display sub-area. The orthographic projection of the sensor 250 on the display panel 210 at least partially overlaps with the first display area 211. The infrared emission direction and receiving direction of the sensor 250 are parallel to the light emission direction of the first display area 111, allowing the sensor 250 to receive and emit infrared light through the first display area 211, thereby achieving depth information acquisition. For example, the infrared receiving direction and infrared emission direction of the sensor 250 may be perpendicular to the plane formed by directions X and Z. The orthographic projection of the sensor 250 on the display panel 210 can fall completely within the first display area 211, allowing the first display area 211 to provide the sensor 250 with the maximum infrared receiving and emission range, enabling the sensor 250 to acquire more image information through the first display area 211.

[0080] When the image acquisition unit 220 includes multiple acquisition units, the display device 200 may include multiple sensors 250. The number of sensors may be the same as or different from the number of acquisition units. For example, each acquisition unit may be independently equipped with a sensor, so that one acquisition unit and one sensor can form an independent information acquisition module, thereby realizing independent image acquisition and depth acquisition. As another example, multiple acquisition units may all be paired with the same sensor to achieve sensor sharing.

[0081] In embodiments of this invention, the connecting portion 240 is a flexible bending structure, allowing the position of the controller 230 relative to the image acquisition unit 220 and the position of the controller 230 relative to the display panel 210 to be adjustable. For example, by bending the connecting portion 240, the controller 230 is positioned on the back of the image acquisition unit 220. By changing the degree of bending of the connecting portion 240, the positional and distance relationships between the two hardware components connected by the connecting portion 240 are adjusted, thereby adjusting the size of the display device 200.

[0082] In embodiments of this invention, the display panel 210, sensor 250, controller 230, and image acquisition unit 220 can all be independently packaged, which facilitates the modular design of the display device 200. Depending on actual functional and economic requirements, cameras, controllers, sensors, or curved panels with different performance levels can be configured to adapt to various human-computer interaction platforms.

[0083] Figure 8 A schematic diagram of the structure of a display panel according to an embodiment of the present invention is shown.

[0084] In embodiments of this utility model, the display panel includes a plurality of first light-emitting devices E, a plurality of second light-emitting devices, a plurality of first pixel circuits D, and a plurality of second pixel circuits.

[0085] Multiple first light-emitting devices E are located in the first display area 111, and multiple first pixel circuits D are located in the second display area 112. The multiple first pixel circuits D are electrically connected to the multiple first light-emitting devices. Multiple second light-emitting devices and multiple second pixel circuits are both located in the second display area 112, and the multiple second pixel circuits are electrically connected to the multiple second light-emitting devices. One first light-emitting device and one connected first pixel circuit form a pixel circuit P. The electrical connection relationships between the second light-emitting devices and the second pixel circuits can be varied and can be selected and set according to actual needs; no limitation is imposed on this.

[0086] The structures of the first pixel circuit D and the second pixel circuit can be selected and configured according to actual needs. The structures of the first pixel circuit D and the second pixel circuit can be the same. The structures of the first light-emitting device E and the second light-emitting device can be the same.

[0087] The number of multiple first light-emitting devices E can be the same as the number of multiple first pixel circuits, and the number of multiple second light-emitting devices can be the same as the number of multiple second pixel circuits. For example, the second light-emitting devices and second pixel circuits can be electrically connected in a one-to-one correspondence. Alternatively, one second pixel circuit can be electrically connected to multiple second light-emitting devices. Or, multiple second pixel circuits can be electrically connected to one second light-emitting device.

[0088] In the embodiments of this utility model, the structure of the display panel is illustrated by taking the example of the first light-emitting device E and the first pixel circuit D being electrically connected in a one-to-one correspondence, and the second light-emitting device and the second pixel circuit being electrically connected in a one-to-one correspondence.

[0089] The first pixel circuit D can provide a driving signal to the corresponding first light-emitting device E to drive the first light-emitting device E to emit light. The second pixel circuit can provide a driving signal to the corresponding second light-emitting device to drive the second light-emitting device to emit light. The light emitted by multiple first light-emitting devices E and multiple second light-emitting devices cooperates with each other, enabling the display panel to display images.

[0090] In embodiments of this invention, multiple first light-emitting devices E are distributed at intervals along a first direction X and a second direction Z, with the first direction X intersecting the second direction Z. The multiple first light-emitting devices E are arranged in an array, wherein the first light-emitting devices E in adjacent rows are staggered.

[0091] Because multiple first light-emitting devices E are staggered and spaced apart, with gaps between adjacent first light-emitting devices E, the light transmittance of the first display area 111 is increased. Light can pass through the gaps between any two adjacent first light-emitting devices E along the direction Y, resulting in a portion of the first display area 111 having high transmittance. Light can pass through a portion of the first display area 111 and be incident on the image acquisition unit, where it is collected and enables the image acquisition unit to function normally.

[0092] Furthermore, since the first pixel circuit D, which provides the driving signal for the first light-emitting device E, is located in the second display area 112, this reduces the structure in the first display area 111 that can block light and increases the area of ​​the light-transmitting part in the first display area 111. This increases the amount of light that can pass through the first display area 111, which is beneficial to increasing the amount of external light collected by the image acquisition device and improving the sensitivity and working efficiency of the image acquisition device.

[0093] In embodiments of this invention, the distribution density of the plurality of first light-emitting devices E can be the same as the distribution density of the plurality of second light-emitting devices. This enables the display panel to achieve full-screen display, which helps ensure that the display panel has good image display quality. The distribution density of the plurality of second light-emitting devices can also be greater than the distribution density of the plurality of first light-emitting devices. This increases the spacing between any two adjacent first light-emitting devices E, reduces the obstruction of external light by the first light-emitting devices E, and increases the area of ​​the light-transmitting portion in the first display area 111.

[0094] In embodiments of this invention, the arrangement of the first pixel circuits D can be the same as the arrangement of the first light-emitting devices E. The pixel circuit P formed by the second pixel circuit and the second light-emitting device is disposed between two adjacent first pixel circuits D. This can improve the display uniformity of the second display area 112.

[0095] In embodiments of this invention, the first display area 111 and the second display area 112 can respectively display the secondary display area and the main display area of ​​the panel. The main display area can serve as a normal display area, used to display more content. The secondary display area can serve as a special display area, used to display specific content. The first display area 111 and the second display area 112 in the display panel can be formed using the same process.

[0096] This embodiment provides a film layer structure for a display substrate. For example, the display substrate in a display panel may include a pixel circuit layer and a light-emitting device layer.

[0097] For example, a display substrate may include, from bottom to top, an active layer Poly, a gate layer Gate1, a gate layer Gate2, an etch buffer layer EBA, an etch buffer layer EBB, an interlayer dielectric layer ILD, a source / drain layer SD, a high planarization layer HPLN1, a transparent electrode layer ITO1, a planarization layer PLN, a transparent electrode layer ITO2, a high planarization layer HPLN2, an anode layer Anode, and a high planarization layer HPLN.

[0098] For example, the active layer Poly, gate layers Gate1 and Gate2, etch buffer layers EBA and EBB, interlayer dielectric layer ILD, and source / drain layer SD form the pixel circuit layer to realize the switching drive of the pixel. Some transistors in the pixel circuit are dual-gate transistors. The anode layer is the anode film structure of the light-emitting device, and the transparent electrode layers ITO1 and ITO2 are the film structures of the connecting lines.

[0099] Figure 9 A schematic diagram of the structure of a display panel according to another embodiment of the present invention is shown.

[0100] like Figure 9 As shown, the second display area 112 includes a second display sub-area 1121 and a third display sub-area 1122. The second display sub-area 1121 is located between the third display sub-area 1122 and the first display area 111, and the first pixel circuit D is located within the third display sub-area 1122.

[0101] The display panel also includes a plurality of connecting lines Line extending along the first direction X. The plurality of connecting lines Line are used to connect a plurality of first pixel circuits D and a plurality of first light-emitting devices E. The plurality of connecting lines Line are disposed in the second display sub-area 1121.

[0102] One end of each connecting line (Line) can be electrically connected to the first pixel circuit (D), and the other end can be electrically connected to the first light-emitting device (E). The first pixel circuit (D) can then transmit driving current to the corresponding first light-emitting device (E) through the connecting line (Line).

[0103] In an embodiment of this invention, the second display sub-area 1121 can serve as a dense wiring area, concentrating the wiring in the display panel within the second display sub-area 1121. Multiple connecting lines are centrally located within the second display sub-area and extend along the first direction X to connect the first pixel circuit D and the first light-emitting device E. For example, the first pixel circuit D is electrically connected to a first light-emitting device E via a connecting line. The first pixel circuit D and the first light-emitting device E connected to the first pixel circuit D are located in the same row.

[0104] The connecting lines can be entirely transparent conductive lines, or only partially transparent conductive lines. For example, the portions of the connecting lines located in the first display area 111 and the second display sub-area 1121 may be at least transparent conductive lines. Light can pass through the connecting lines and be captured by the image acquisition device, thereby increasing the light transmittance of the first display area 111 and the second display sub-area 1121 and improving the sensitivity of the image acquisition device. For example, the connecting lines can be indium tin oxide (ITO) connecting lines. The light transmittance of the connecting lines can be greater than or equal to 85%.

[0105] For example, the spacing between any two first pixel circuits D connected by a connecting line Line and the first light-emitting device E is substantially equal. In this case, the lengths of the multiple connecting lines Line are also substantially the same, which reduces the difference in capacitive and resistive loads between the multiple connecting lines Line, reduces the brightness difference between the multiple first light-emitting devices E, and thus improves the uniformity of the display brightness of the first display area 111.

[0106] In an embodiment of this utility model, the display panel includes multiple data lines Ld, each of which includes a first trace L1, a second trace L2, and a third trace L3. The first trace L1 and the second trace L2 both extend along a second direction Z. The first trace L1 is located in a second display sub-area 1121, and the second trace L2 is located in a third display sub-area 1122. The third trace L3 extends along a first direction X and connects the first trace L1 and the second trace L2.

[0107] The first trace L1 is connected to the data driver and is used to receive data signals. The second trace L2 is electrically connected to multiple first pixel circuits D and multiple second pixel circuits and is used to transmit data signals to the multiple first pixel circuits D and multiple second pixel circuits.

[0108] In embodiments of this invention, a portion of the data lines of data line Ld are centrally located in the second display sub-area 1121, which saves space occupied by data line Ld. For example, data line Ld and connecting line Line can be placed on different wiring layers of the display panel. This reduces the area of ​​non-display areas in the display panel, thereby facilitating the narrow bezel design of the display panel.

[0109] Figure 10 A schematic diagram of the structure of a display panel according to another embodiment of the present invention is shown.

[0110] like Figure 10As shown, the first display area includes two first display sub-areas 1111 and 1112, and the second display area 112 includes two second display sub-areas 1121 and 1123 and two third display sub-areas 1122 and 1124. The two first display sub-areas 1111 and 1112 are mirror-symmetrical about the center line BB', which is located between the two first display sub-areas 1111 and 1112 and extends along the second direction Z.

[0111] The two second display sub-areas 1121 and 1123 are also mirror-symmetrical about the center line BB', and the two third display sub-areas 1122 and 1124 are also mirror-symmetrical about the center line BB'. The two second display sub-areas 1121 and 1123 are respectively located on the side of the two first display sub-areas 1111 and 1112 away from the center line BB', and the two third display sub-areas 1122 and 1124 are located on the side of the two second display sub-areas 1121 and 1123 away from the center line BB'.

[0112] For example, the second display sub-area 1121 is located on the side of the first display sub-area 1111 away from the center line BB', and the third display sub-area 1122 is located on the side of the second display sub-area 1121 away from the center line BB'. The second display sub-area 1123 is located on the side of the first display sub-area 1112 away from the center line BB', and the third display sub-area 1124 is located on the side of the second display sub-area 1123 away from the center line BB'.

[0113] Figure 10 The structure of the display panel shown can be Figure 2B This illustration shows one embodiment of the pixel circuitry, light-emitting devices, and wiring layout in a display panel.

[0114] In an embodiment of this utility model, a second display area is further provided between the first display sub-area 1111 and the first display sub-area 1112. The second display area between the first display sub-area 1111 and the first display sub-area 1112 may include multiple pixel circuits P. The arrangement of the multiple pixel circuits P can refer to the arrangement of the multiple pixel circuits P in the third display sub-areas 1122 and 1124.

[0115] Understandably, the distribution of the first light-emitting device E in the first display sub-region 1111 and the distribution of the first light-emitting device E in the first display sub-region 1112 are also mirror-symmetrical about the center line BB'. Similarly, the distribution of the first pixel circuit D in the third display sub-region 1122 and the distribution of the first pixel circuit D in the third display sub-region 1124 are also mirror-symmetrical about the center line BB'. Furthermore, the distribution of the pixel circuit P in the third display sub-region 1122 and the distribution of the pixel circuit P in the third display sub-region 1124 are also mirror-symmetrical about the center line BB'.

[0116] In the embodiments of this utility model, since the first display sub-area 1111 and the first display sub-area 1112 are mirror-symmetrical about the center line BB', the third display sub-area 1122 and the third display sub-area 1124 are mirror-symmetrical about the center line BB', and the second display sub-area 1121 and the second display sub-area 1123 are mirror-symmetrical about the center line BB', the display difference between the two display areas that are mirror-symmetrical about the center line BB' in the display panel of the binocular system is small, thereby improving the display uniformity of the display panel.

[0117] Figure 11 A schematic diagram of the structure of an electronic device according to an embodiment of the present invention is shown.

[0118] like Figure 11 As shown, the interactive device 300 includes a device body 31 and a display device 32, with the display device 32 mounted on the device body 31.

[0119] In embodiments of this utility model, the display device 32 may be the display device 100 or the display device 200 described above. For the sake of brevity, similar details will not be repeated.

[0120] In an embodiment of this utility model, the interactive device 300 can be an interactive robot, and the display device 32 can be installed in the eye socket position of the interactive device 300, serving as the eye appearance component of the interactive robot to display dynamic eye expressions or facial expressions, etc.

[0121] In an embodiment of this utility model, the display device 32 includes a display panel, an image acquisition device, and a controller that are detachably mounted on the device body 31.

[0122] The display panel, camera, and main control unit can be packaged as independent circuit devices. After packaging, the display panel, camera, and main control unit can be detachably connected to the main body 31 of the device via snap-fit ​​or magnetic structures, realizing the modular design of the interactive device 300. When the interactive device 300 needs to be repaired or upgraded, it is not necessary to disassemble the entire device.

[0123] In this embodiment of the invention, the display device 32 is an under-display camera display device. The display device 32 can ensure image quality, improve aesthetics, save space, reduce hardware costs, and support intelligent interactive functions such as eye tracking and facial expression response. It can be applied to humanoid robots such as companions and home service robots, and has the potential to become a standard vision module.

[0124] The block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagram or flowchart, and combinations of blocks in the block diagram or flowchart, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0125] Those skilled in the art will understand that the features described in the various embodiments of this utility model can be combined and / or combined in various ways, even if such combinations or combinations are not explicitly described in this utility model. In particular, the features described in the various embodiments of this utility model can be combined and / or combined in various ways without departing from the spirit and teachings of this utility model. All such combinations and / or combinations fall within the scope of this utility model.

[0126] The embodiments of this utility model have been described above. However, these embodiments are merely illustrative and not intended to limit the scope of this utility model. Although various embodiments have been described above, this does not mean that the measures in the various embodiments cannot be used advantageously in combination. Without departing from the scope of this utility model, those skilled in the art can make various substitutions and modifications, all of which should fall within the scope of this utility model.

Claims

1. A display device, characterized in that, include: A display panel includes a first display area and a second display area, wherein the second display area at least partially surrounds the first display area, and the first display area includes at least one first display sub-area; An image acquisition device is disposed on the side of the display panel away from the light emission direction. The orthographic projection of the image acquisition device on the display panel at least partially overlaps with the at least one first display sub-area. The light receiving direction of the image acquisition device is parallel to the light emission direction of the display panel. The controller is located on the side of the image acquisition unit furthest from the display panel; and The connection part connects the image acquisition unit and the controller, and also connects the display panel and the controller.

2. The display device according to claim 1, characterized in that, The first display area includes multiple first display sub-areas, and the image acquisition device includes multiple acquisition units; In this configuration, the orthographic projection of one of the plurality of acquisition units on the display panel partially overlaps with at least one of the plurality of first display sub-areas, and the light receiving direction of the acquisition unit is parallel to the light emitting direction of the first display sub-area whose orthographic projection at least partially overlaps with that of the acquisition unit.

3. The display device according to claim 1, characterized in that, The image acquisition device includes a lens, the optical axis of which is collinear with the geometric center normal of the first display area.

4. The display device according to claim 1, characterized in that, The surface of the display panel located in the first display area is constructed as a curved structure so that the first display area includes multiple light emission directions; The image acquisition device is configured to rotate following the effective light emission direction among the plurality of light emission directions, so that the light receiving direction of the image acquisition device is parallel to the light emission direction.

5. The display device according to claim 4, characterized in that, The image acquisition device includes a lens, and the image acquisition device is configured to rotate such that the optical axis of the lens is collinear with the center normal of the effective display area of ​​the first display area.

6. The display device according to claim 1, characterized in that, The display device further includes a sensor disposed on the side of the display panel away from the light emission direction. The sensor is electrically connected to the controller, and the orthographic projection of the sensor on the display panel at least partially overlaps with the at least one first display sub-area.

7. The display device according to claim 6, characterized in that, Both the sensor and the image acquisition device are positioned on a plane perpendicular to the light emission direction.

8. The display device according to claim 1, characterized in that, The connecting part has a flexible bending structure, so that the position of the controller relative to the image acquisition device is adjustable, and the position of the controller relative to the display panel is adjustable.

9. The display device according to claim 1, characterized in that, The display panel includes: Multiple first light-emitting devices are located in the first display area; Multiple second light-emitting devices are located in the second display area; Multiple first pixel circuits, located in the second display area, are electrically connected to the multiple first light-emitting devices, respectively; and Multiple second pixel circuits are located in the second display area and are electrically connected to the multiple second light-emitting devices, respectively. The plurality of first light-emitting devices are distributed at intervals along a first direction and a second direction, wherein the first direction intersects the second direction.

10. The display device according to claim 9, characterized in that, The second display area includes a second display sub-area and a third display sub-area, the second display sub-area being located between the third display sub-area and the first display area, and the first pixel circuit being located within the third display sub-area; The display panel further includes a plurality of connecting lines extending along a first direction, the plurality of connecting lines being used to connect the plurality of first pixel circuits and the plurality of first light-emitting devices, the plurality of connecting lines being disposed in the second display sub-area.

11. The display device according to claim 10, characterized in that, The display panel includes multiple data lines, each of the multiple data lines comprising: A first trace extending along a second direction is disposed in the second display sub-area; A second trace extending along a second direction is electrically connected to the plurality of first pixel circuits and the plurality of second pixel circuits; and A third trace extending along the first direction is used to connect the first trace and the second trace.

12. The display device according to claim 10, characterized in that, The first display area includes two first display sub-areas, and the second display area includes two second display sub-areas and two third display sub-areas; The two first display sub-areas are mirror-symmetrical about the center line, which is located between the two first display sub-areas and extends along the second direction. The two second display sub-areas are mirror-symmetrical about the center line, and the two third display sub-areas are mirror-symmetrical about the center line. The second display sub-area is located on the side of the first display sub-area away from the center line, and the third display sub-area is located on the side of the second display sub-area away from the center line.

13. An interactive device, comprising: Equipment body; as well as The display device according to any one of claims 1-12 is mounted on the main body of the device.

14. The interactive device according to claim 13, characterized in that, The display panel, the image acquisition unit, and the controller are detachably mounted on the main body of the device.

Images