A display device

Abstract

The present application provides a display device, including: a display screen, an outer frame, a data processor, a sensor connection mechanism, a first mechanical arm, a voice recognition sensor, a second mechanical arm and a first sight tracking sensor; the display screen is embedded in the outer frame; the first rotating joint in the first mechanical arm is rotatably connected to the first upper arm and the first lower arm; the first upper arm is connected to the sensor connection mechanism, and the first lower arm is connected to the voice recognition sensor; the second rotating joint in the second mechanical arm is rotatably connected to the second upper arm and the second lower arm; the second upper arm is connected to the outer frame, and the second lower arm is connected to the first sight tracking sensor; the display screen, the voice recognition sensor, and the first sight tracking sensor are all electrically connected to the data processor. In the above display device, the voice recognition sensor and the first sight tracking sensor can freely adjust the angle to improve the accuracy of collecting voice information and gaze point coordinates, thereby improving the accuracy of scaling the displayed content on the display device.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of display terminal technology, and in particular, to a display device. Background Art

[0002] In conference scenarios, a display device is required. The display device is an electronic device including a display screen, which is used to display multimedia content such as slides, videos, and pictures. In the process of using the display device for presentation, in order to make the content displayed on the display device match the content narrated by the presenter, it is necessary to operate the display device, obtain the content area narrated by the current presenter, that is, the area of ​​interest, and enlarge it for display.

[0003] Biometrics can be used to identify the content narrated by the presenter, and then the area of ​​interest can be determined based on the identification results, and the displayed content can be automatically scaled. However, biometrics are easily affected by environmental factors, resulting in the inability to accurately identify the content narrated by the presenter, and thus the inability to accurately control the scaling of the displayed content, affecting the accuracy of the scaling of the displayed content. For example, when the angle of the biometric sensor is not facing the user's face, in addition to collecting the user's biological information, the biometric sensor will also collect other interfering information in the environment, such as noise, light, obstacles, etc., reducing the accuracy of the collected data. Utility Model Content

[0004] The present application provides a display device to solve the problem that the accuracy of collected data is reduced due to interference information such as noise, light, obstacles, etc. collected in the environment caused by inaccurate angles of biometric sensors.

[0005] The present application provides a display device, comprising: a display mechanism, a sensor connection mechanism, a voice recognition mechanism, and a sight tracking mechanism;

[0006] The display mechanism includes a display screen, an outer frame and a data processor;

[0007] The display screen is a rectangular structure, and the outer frame is a rectangular frame structure; the display screen is embedded in the outer frame; the display screen is electrically connected to the data processor;

[0008] The speech recognition mechanism is connected to the outer frame through the sensor connection mechanism; the speech recognition mechanism includes a first mechanical arm and a speech recognition sensor;

[0009] The first mechanical arm comprises a first upper arm, a first rotating joint and a first lower arm, wherein the first rotating joint rotatably connects the first upper arm and the first lower arm;

[0010] The first upper arm is connected to the sensor connection mechanism, and the first lower arm is connected to the voice recognition sensor;

[0011] A hollow structure is provided on the shell of the voice recognition sensor, and the voice recognition sensor is electrically connected to the data processor;

[0012] The sight tracking mechanism includes a second mechanical arm and a first sight tracking sensor;

[0013] The second mechanical arm comprises a second upper arm, a second rotating joint and a second lower arm, and the second rotating joint is rotatably connected to the second upper arm and the second lower arm;

[0014] The second upper arm is connected to the outer frame, and the second lower arm is connected to the first sight tracking sensor;

[0015] The first sight tracking sensor is a nested structure, and the first sight tracking sensor is electrically connected to the data processor.

[0016] In the above-mentioned display device, the voice recognition sensor in the voice recognition mechanism collects and analyzes voice information in real time, and can freely adjust the angle under the action of the first mechanical arm, which can block noise from other directions and improve the accuracy of collecting voice information; the first line of sight tracking sensor in the line of sight tracking mechanism detects and analyzes the number of gaze point coordinates in each area on the display screen, and can freely adjust the angle under the action of the second mechanical arm, which can avoid the influence of light, obstacles, etc., and improve the accuracy of collecting gaze point coordinates; the voice recognition mechanism and the line of sight tracking mechanism work together to obtain an accurate area of ​​interest, thereby improving the accuracy of scaling the display content on the display device.

[0017] In a possible implementation, the sight tracking mechanism further includes a third mechanical arm and a second sight tracking sensor;

[0018] The third mechanical arm comprises a third upper arm, a third rotating joint and a third lower arm, and the third rotating joint is rotatably connected to the third upper arm and the third lower arm;

[0019] The third upper arm is connected to the outer frame, and the third lower arm is connected to the second sight tracking sensor.

[0020] In a possible implementation, the second gaze tracking sensor is a nested structure;

[0021] The second sight tracking sensor and the first sight tracking sensor are symmetrically arranged at two ends of the outer frame, and the second sight tracking sensor is electrically connected to the data processor.

[0022] In the above-mentioned display device, the second gaze tracking sensor works together with the first gaze tracking sensor to increase the field of view angle and improve the coverage of the gaze tracking mechanism. The first gaze tracking sensor and the second gaze tracking sensor can cooperate to obtain depth information, improve the accuracy of the gaze point position measured by the gaze tracking mechanism, and obtain an accurate area of ​​interest.

[0023] In a possible implementation, the data processor includes a first output interface;

[0024] The display screen is electrically connected to the first output interface.

[0025] In the above display device, the display screen is electrically connected to the first output interface of the data processor, and can receive the control instruction output by the data processor, and scale the display content on the display device according to the control instruction.

[0026] In a possible implementation, the display screen includes a touch layer;

[0027] The data processor also includes a first input interface;

[0028] The touch layer is electrically connected to the first input interface.

[0029] In the above display device, the touch layer in the display screen is electrically connected to the first input interface of the data processor, so that the operation content of the user on the touch layer can be input into the data processor for processing.

[0030] In one possible implementation, the speech recognition sensor includes a microphone array;

[0031] The data processor also includes a second input interface;

[0032] The microphone array is electrically connected to the second input interface.

[0033] In the above display device, the microphone array is used to enhance the target speech, suppress background noise and interference, extract and separate signals, thereby improving the accuracy and reliability of speech recognition. The microphone array is electrically connected to the second input interface of the data processor, and the optimized speech information is input into the data processor for processing.

[0034] In a possible implementation, the first gaze tracking sensor includes a first camera module;

[0035] The data processor also includes a third input interface;

[0036] The first camera module is electrically connected to the third input interface.

[0037] In one possible implementation, the second gaze tracking sensor includes a second camera module;

[0038] The data processor also includes a fourth input interface;

[0039] The second camera module is electrically connected to the fourth input interface.

[0040] In the above display device, the first camera module and the second camera module have the functions of capturing real-time video, identifying and locating targets, tracking target movement, performing three-dimensional space mapping, and scene analysis and understanding, so as to provide support for accurate and efficient tracking functions. The first camera module and the second camera module are electrically connected to the third input interface and the fourth input interface of the data processor, respectively, and the acquired sight line information is input into the data processor for processing.

[0041] In a possible implementation, the sensor connection mechanism and the sight tracking mechanism are connected to the same side of the outer frame.

[0042] In the above display device, the sensor connection mechanism and the sight tracking mechanism are both connected to the same side of the outer frame, and the two work together to determine the area of ​​interest through voice recognition and judging the number of gaze points, thereby improving the accuracy of display content scaling.

[0043] It can be seen from the above technical scheme that the present application provides a display device, including: a display mechanism, a sensor connecting mechanism, a voice recognition mechanism and a line of sight tracking mechanism; the display mechanism includes a display screen, an outer frame and a data processor; the display screen is a rectangular structure, and the outer frame is a rectangular frame structure; the display screen is embedded in the outer frame; the display screen is electrically connected to the data processor; the voice recognition mechanism is connected to the outer frame through the sensor connecting mechanism; the voice recognition mechanism includes a first mechanical arm and a voice recognition sensor; the first mechanical arm includes a first upper arm, a first rotating joint and a first lower arm, and the first rotating joint is rotatably connected to the first upper arm and the first lower arm; the first upper arm is connected to the sensor connecting mechanism, and the first lower arm is connected to the voice recognition sensor; a hollow structure is provided on the outer shell of the voice recognition sensor, and the voice recognition sensor is electrically connected to the data processor; the line of sight tracking mechanism includes a second mechanical arm and a first line of sight tracking sensor; the second mechanical arm includes a second upper arm, a second rotating joint and a second lower arm, and the second rotating joint is rotatably connected to the second upper arm and the second lower arm; the second upper arm is connected to the outer frame, and the second lower arm is connected to the first line of sight tracking sensor; the first line of sight tracking sensor is a nested structure, and the first line of sight tracking sensor is electrically connected to the data processor.

[0044] The display device collects and analyzes voice information in real time through the voice recognition sensor in the voice recognition mechanism, and can freely adjust the angle under the action of the first mechanical arm, which can block noise from other directions and improve the accuracy of collecting voice information; the first line of sight tracking sensor in the line of sight tracking mechanism detects and analyzes the number of gaze point coordinates in each area of ​​the display screen, and can freely adjust the angle under the action of the second mechanical arm, which can avoid the influence of light, obstacles, etc. and improve the accuracy of collecting gaze point coordinates; the voice recognition mechanism and the line of sight tracking mechanism work together to obtain an accurate area of ​​interest, thereby improving the accuracy of scaling the display content on the display device. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solution of the present application, the drawings required for use in the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0046] Figure 1 A schematic diagram of the structure of the display device according to an embodiment of the present application;

[0047] Figure 2 Another schematic diagram of the structure of the display device according to the embodiment of the present application;

[0048] Figure 3 A schematic diagram of a display device preparation process according to an embodiment of the present application;

[0049] Figure 4 This is a schematic diagram of a state where the display content is reduced according to an embodiment of the present application;

[0050] Figure 5 This is a schematic diagram of the operation process of the display device according to an embodiment of the present application;

[0051] Figure 6 This is a schematic diagram of the current region of interest in a magnified state as described in an embodiment of the present application.

[0052] Illustration Description:

[0053] Among them: 101-display screen; 201-sensor connecting mechanism; 202-first mechanical arm; 2021-first upper arm; 2022-first rotation joint; 2023-first lower arm; 203-voice recognition sensor; 301-second mechanical arm; 3011-second upper arm; 3012-second rotation joint; 3013-second lower arm; 302-third mechanical arm; 3021-third upper arm; 3022-third rotation joint; 3023-third lower arm; 303-first line of sight tracking sensor; 304-second line of sight tracking sensor; 401-first area of ​​interest; 402-second area of ​​interest; 403-third area of ​​interest; 404-fourth area of ​​interest. DETAILED DESCRIPTION

[0054] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0055] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0056] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0057] In conference scenarios, a display device is required. A display device is an electronic device that includes a display screen and is used to display multimedia content such as slides, videos, and pictures. With its high-definition, large screen, and easy operation, conference display devices provide participants with an intuitive and efficient way to display information, thereby improving meeting efficiency and meeting experience.

[0058] In the process of using a display device for demonstration, in order to make the content displayed on the display device match the content narrated by the presenter, the display device needs to be operated, and the content narrated by the presenter can be recognized by biometric recognition. For example, the presenter's voice data is collected by a voice recognition device, and the voice data is processed to obtain keywords that match pre-set content, and then the area of ​​interest corresponding to the keyword is obtained and enlarged for display.

[0059] However, biometrics are easily affected by environmental factors, which can lead to the inability to accurately identify the content narrated by the presenter, and thus the inability to accurately control the scaling of the displayed content, affecting the accuracy of the scaling of the displayed content. For example, when the angle of the biometric sensor is not facing the user's face, in addition to collecting the user's biological information, the biometric sensor will also collect other interfering information in the environment, such as noise, light, obstacles, etc., reducing the accuracy of the collected data.

[0060] In order to solve the problem that the inaccurate angle of the biometric sensor causes interference information such as noise, light, obstacles, etc. in the environment to be collected, thereby reducing the accuracy of the collected data, an embodiment of the present application provides a display device. Figure 1 is a schematic diagram of a structure of a display device according to an embodiment of the present application, Figure 2 is another schematic diagram of the structure of the display device according to an embodiment of the present application, Figure 3 This is a schematic diagram of the display device preparation process described in an embodiment of the present application. Figure 4 This is a schematic diagram of a state where the display content is reduced according to an embodiment of the present application. Figure 5 This is a schematic diagram of the operation flow of the display device according to an embodiment of the present application. Figure 6 This is a schematic diagram of the current region of interest in the enlarged state according to the embodiment of the present application. Figure 1-Figure 6 The display device provided in the present application is described in detail.

[0061] The display device provided in the present application includes: a display mechanism, a sensor connecting mechanism 201, a voice recognition mechanism and a sight tracking mechanism; the display mechanism includes a display screen 101, an outer frame and a data processor; the display screen 101 is a rectangular structure, and the outer frame is a rectangular frame structure; the display screen 101 is embedded in the outer frame; the display screen 101 is electrically connected to the data processor; the voice recognition mechanism is connected to the outer frame through the sensor connecting mechanism 201; the voice recognition mechanism includes a first mechanical arm 202 and a voice recognition sensor 203; the first mechanical arm 202 includes a first upper arm 2021, a first rotating joint 2022 and a first lower arm 2023, the first rotating joint 2022 is rotatably connected to the first upper arm 2021 and the first lower arm 2023; the first upper arm 2021 and the sensor The sensor connecting mechanism 201 is connected, and the first lower arm 2023 is connected to the voice recognition sensor 203; a hollow structure is provided on the outer shell of the voice recognition sensor 203, and the voice recognition sensor 203 is electrically connected to the data processor; the line of sight tracking mechanism includes a second mechanical arm 301 and a first line of sight tracking sensor 303; the second mechanical arm 301 includes a second upper arm 3011, a second rotating joint 3012 and a second lower arm 3013, and the second rotating joint 3012 is rotatably connected to the second upper arm 3011 and the second lower arm 3013; the second upper arm 3011 is connected to the outer frame, and the second lower arm 3013 is connected to the first line of sight tracking sensor 303; the first line of sight tracking sensor 303 is a nested structure, and the first line of sight tracking sensor 303 is electrically connected to the data processor.

[0062] For example, see Figure 1 A sensor connecting mechanism 201 is set below the display screen 101, and the voice recognition sensor 203 is connected to the sensor connecting mechanism 201 through the first mechanical arm 202. Since the first rotating joint 2022 on the first mechanical arm 202 can drive the first upper arm 2021 and the first lower arm 2023 to rotate, the voice recognition sensor 203 can adjust the receiving position according to the position of the presenter; the first sight tracking sensor 303 is connected to the outer frame of the display mechanism through the second mechanical arm 301. Since the second rotating joint 3012 on the second mechanical arm 301 can drive the second upper arm 3011 and the second lower arm 3013 to rotate, the first sight tracking sensor 303 can adjust the direction according to the position of the participants and obtain the gaze point coordinates of the participants' sight.

[0063] It is understandable that the second robotic arm 301 and the first line of sight tracking sensor 303 can be set at any position on the frame, as long as the coordinates of the gaze point of the participant's line of sight can be obtained, and no specific limitation is made in the embodiments of the present application.

[0064] In some embodiments, the line of sight tracking mechanism also includes a third robotic arm 302 and a second line of sight tracking sensor 304; the third robotic arm 302 includes a third upper arm 3021, a third rotating joint 3022 and a third lower arm 3023, and the third rotating joint 3022 rotationally connects the third upper arm 3021 and the third lower arm 3023; the third upper arm 3021 is connected to the outer frame, and the third lower arm 3023 is connected to the second line of sight tracking sensor 304.

[0065] For example, see Figure 1 The second gaze tracking sensor 304 is connected to the outer frame through the third mechanical arm 302. Since the third rotation joint 3022 on the third mechanical arm 302 can drive the third upper arm 3021 and the third lower arm 3023 to rotate, the second gaze tracking sensor 304 can adjust its direction according to the location of the participant and obtain the gaze point coordinates of the participant's line of sight.

[0066] In some embodiments, the second gaze tracking sensor 304 is a nested structure; the second gaze tracking sensor 304 and the first gaze tracking sensor 303 are symmetrically arranged at two ends of the outer frame, and the second gaze tracking sensor 304 is electrically connected to the data processor.

[0067] For example, see Figure 1 The first gaze tracking sensor 303 and the second gaze tracking sensor 304 are symmetrically arranged at the two ends of the outer frame. The first gaze tracking sensor 303 and the second gaze tracking sensor 304 can adjust their respective directions according to the positions of the participants at the conference site, thereby improving the overall coverage of the gaze tracking mechanism to adapt to various conference venues with different seat arrangements.

[0068] It can be understood that the third robotic arm 302 and the second line of sight tracking sensor 304 can be set at any position on the frame, as long as the gaze point coordinates of the participant's line of sight can be obtained and they are symmetrically arranged with the second robotic arm 301 and the first line of sight tracking sensor 303. No specific limitation is made in the embodiments of the present application.

[0069] In some embodiments, the data processor includes a first output interface; the display screen 101 is electrically connected to the first output interface.

[0070] Exemplarily, the data processor outputs the picture data to the display screen 101, and the display screen 101 displays the picture data.

[0071] In some embodiments, the display screen 101 includes a touch layer; the data processor also includes a first input interface; and the touch layer is electrically connected to the first input interface.

[0072] For example, see Figure 4 , the screen displayed on the display screen 101 includes four parts of content. The user operates the touch layer to divide the above four parts into a first area of ​​interest 401, a second area of ​​interest 402, a third area of ​​interest 403 and a fourth area of ​​interest 404 in a circled manner. The four areas of interest circled can be in various shapes such as squares, circles, irregular polygons, etc. Then the touch layer inputs the screen data divided by the user into the data processor for recording.

[0073] In some embodiments, the speech recognition sensor 203 includes a microphone array; the data processor also includes a second input interface; and the microphone array is electrically connected to the second input interface.

[0074] Exemplarily, the microphone array collects the voice of the presenter and inputs the voice data into a data processor for processing.

[0075] In some embodiments, the first gaze tracking sensor 303 includes a first camera module; the data processor also includes a third input interface; and the first camera module is electrically connected to the third input interface.

[0076] In some embodiments, the second gaze tracking sensor 304 includes a second camera module; the data processor also includes a fourth input interface; and the second camera module is electrically connected to the fourth input interface.

[0077] Exemplarily, the first camera module collects the gaze point coordinates of the participants on one side of the conference site, the number of participants whose gaze point coordinates are collected accounts for half of the total number of participants at the conference site, and the above gaze point coordinates are input into the data processor; the second camera module collects the gaze point coordinates of the participants on the other side of the conference site, the number of participants whose gaze point coordinates are collected accounts for half of the total number of participants at the conference site, and the above gaze point coordinates are input into the data processor; the data processor simultaneously obtains the gaze point coordinates of the participants on both sides of the conference site and processes them. Among them, the method for the first camera module and the second camera module to collect the gaze points of the participants is as follows: capture the eye images of the participants; detect key features such as the pupil, iris and eye corners of the eyes through image processing technology; use eye tracking algorithms to track the movement of the eyes in real time; establish a mapping relationship between eye movement and gaze point coordinates based on the results of eye tracking; calculate the current gaze point coordinates based on the mapping relationship and the eye feature information tracked in real time.

[0078] In some embodiments, the sensor connection mechanism 201 and the gaze tracking mechanism are connected to the same side of the outer frame.

[0079] For example, see Figure 2 The sensor connecting mechanism 201 is connected to the lower end of the outer frame, the first mechanical arm 202 is set on the sensor connecting mechanism 201, the second mechanical arm 301 and the third mechanical arm of the line of sight tracking mechanism are both connected to the lower end of the outer frame, and the voice recognition mechanism and the line of sight tracking mechanism work together at the lower end of the outer frame to respectively collect the voice data of the presenter and the gaze point coordinate data of the participants.

[0080] It is understandable that the sensor connecting mechanism 201 and the line of sight tracking mechanism can also be connected to different sides of the outer frame, as long as the voice recognition mechanism and the line of sight tracking mechanism can both work normally and do not interfere with each other, and no specific limitation is made in the embodiments of the present application.

[0081] The display device provided in the present application is described below with reference to a specific example. Figure 3 Schematic diagram of the display device preparation process described in the embodiment of the present application. Figure 3 The preparation process includes the following steps:

[0082] S301, dividing the conference content into multiple regions of interest.

[0083] For example, see Figure 4 , a first region of interest 401 , a second region of interest 402 , a third region of interest 403 and a fourth region of interest 404 are respectively demarcated on the display screen 101 by using a rectangle, a parallelogram, an ellipse and an octagon.

[0084] S302: Set one or more keywords for each region of interest.

[0085] For example, see Figure 4 , the keywords set for the first area of ​​interest 401 are “introduction”, “definition”, and “background”; the keywords set for the second area of ​​interest 402 are “core”, “autonomous driving”, “artificial intelligence”, “Internet of Vehicles”, and “technology”; the keywords set for the third area of ​​interest 403 are “advantage”, “safety”, “efficiency”, and “user experience”; the keywords set for the fourth area of ​​interest 404 are “prospect”, “regulation”, “technology”, “innovation”, and “application scenarios”.

[0086] It is understandable that the keywords of each area of ​​interest are not fixed and need to be set according to the actual content, and are not specifically limited in the embodiments of the present application.

[0087] S303: Inputting the region of interest and keyword data into a data processor.

[0088] The data of the region of interest and the keywords determined in step S301 and step S302 are input into the data processor via the first input interface for storage, in preparation for the subsequent speech recognition function.

[0089] After the display device preparation process is completed, the meeting can begin and the display device starts running. Figure 5 This is a schematic diagram of the operation flow of the display device described in the embodiment of the present application. Figure 5 The operation process includes the following steps:

[0090] S501, recognizing keywords in the speaker's voice information in real time.

[0091] For example, see Figure 1 The first rotating joint 2022 in the first robotic arm 202 drives the first upper arm 2021 and the first lower arm 2023 to rotate to adjust the angle of the speech recognition sensor 203, so that the speech recognition sensor 203 is aimed at the face of the presenter, so as to more clearly capture the narrative content of the presenter and match the narrative content with the keywords set during the preparation process.

[0092] S502: Match the current area of ​​interest by keywords.

[0093] For example, see Figure 4 If the keywords recognized by the speech recognition mechanism are “introduction” and “definition”, they match the first region of interest 401 .

[0094] For example, see Figure 4 If the keyword recognized by the speech recognition mechanism is “technology”, it matches the second region of interest 402 and the fourth region of interest 404 .

[0095] S503: Whether the matched current region of interest is unique.

[0096] S5031. The matched current region of interest is unique, and the current region of interest is enlarged.

[0097] For example, see Figure 6 When the matching keywords are “introduction” and “definition”, the current region of interest is unique, which is the first region of interest 401, and the first region of interest 401 is enlarged.

[0098] S50321. The matched current region of interest is not unique, and the number of gaze point coordinates of each current region of interest is detected.

[0099] For example, see Figure 1, when the matching keyword is "technology", the second region of interest 402 and the fourth region of interest 404 are both matched with the keyword "technology", the current region of interest is not unique, and the number of gaze point coordinates of the participants in each region of interest is collected through the sight tracking mechanism. The length of the first time window is set to 3 seconds, and the number of gaze point coordinates of the second region of interest 402 and the fourth region of interest 404 in the first time window is detected. Among them, the second rotating joint 3012 in the second mechanical arm 301 drives the second upper arm 3011 and the second lower arm 3013 to rotate to adjust the angle of the first sight tracking sensor 303, and the third rotating joint 3022 in the third mechanical arm 302 drives the third upper arm 3021 and the third lower arm 3023 to rotate to adjust the angle of the second sight tracking sensor 304, that is, the first sight tracking sensor 303 and the second sight tracking sensor 304 can adjust the tracking direction according to the location of the participants, so as to improve the accuracy of obtaining the gaze point coordinates.

[0100] S50322. Enlarge the region of interest with the largest number of gaze point coordinates.

[0101] For example, when the number of participants is 20 and the time window length is 3 seconds, the total number of gaze point coordinates that can be collected by the eye tracking mechanism is 60. If the number of gaze point coordinates of the second area of ​​interest 402 in the first time window is 20 and the number of gaze point coordinates of the fourth area of ​​interest 404 is 40, the screen content of the fourth area of ​​interest 404 will be enlarged and displayed.

[0102] For example, the number of participants is 20. If the number of gaze point coordinates of the second area of ​​interest 402 and the fourth area of ​​interest 404 in the first time window is 30, the length of the second time window is set to 6 seconds. When the time window length is 6 seconds, the total number of gaze point coordinates that can be collected by the eye tracking mechanism is 120. The number of gaze point coordinates of the second area of ​​interest 402 in the second time window is 70, and the number of gaze point coordinates of the fourth area of ​​interest 404 in the second time window is 50. In this way, the screen content of the second area of ​​interest 402 is enlarged and displayed.

[0103] S504: When a specific keyword is triggered, the demonstration content returns to normal display.

[0104] For example, the specific keywords are set as "return" and "next". When the content narrated by the presenter matches "return" and "next", the zooming in of the image content of the current area of ​​interest is stopped and the image is restored. Figure 4 Normal display content shown.

[0105] It is understandable that during the meeting, the operation process of the above-mentioned display device can be repeated until the meeting ends.

[0106] It can be seen from the above technical scheme that the present application provides a display device, including: a display mechanism, a sensor connecting mechanism, a voice recognition mechanism and a line of sight tracking mechanism; the display mechanism includes a display screen, an outer frame and a data processor; the display screen is a rectangular structure, and the outer frame is a rectangular frame structure; the display screen is embedded in the outer frame; the display screen is electrically connected to the data processor; the voice recognition mechanism is connected to the outer frame through the sensor connecting mechanism; the voice recognition mechanism includes a first mechanical arm and a voice recognition sensor; the first mechanical arm includes a first upper arm, a first rotating joint and a first lower arm, and the first rotating joint is rotatably connected to the first upper arm and the first lower arm; the first upper arm is connected to the sensor connecting mechanism, and the first lower arm is connected to the voice recognition sensor; a hollow structure is provided on the outer shell of the voice recognition sensor, and the voice recognition sensor is electrically connected to the data processor; the line of sight tracking mechanism includes a second mechanical arm and a first line of sight tracking sensor; the second mechanical arm includes a second upper arm, a second rotating joint and a second lower arm, and the second rotating joint is rotatably connected to the second upper arm and the second lower arm; the second upper arm is connected to the outer frame, and the second lower arm is connected to the first line of sight tracking sensor; the first line of sight tracking sensor is a nested structure, and the first line of sight tracking sensor is electrically connected to the data processor.

[0107] In the above-mentioned display device, the voice recognition sensor in the voice recognition mechanism collects and analyzes voice information in real time, and can freely adjust the angle under the action of the first mechanical arm, which can block noise from other directions and improve the accuracy of collecting voice information; the first line of sight tracking sensor in the line of sight tracking mechanism detects and analyzes the number of gaze point coordinates in each area on the display screen, and can freely adjust the angle under the action of the second mechanical arm, which can avoid the influence of light, obstacles, etc., and improve the accuracy of collecting gaze point coordinates; the voice recognition mechanism and the line of sight tracking mechanism work together to obtain an accurate area of ​​interest, thereby improving the accuracy of scaling the display content on the display device.

[0108] Similar parts between the embodiments provided in this application can be referenced to each other. The specific implementation methods provided above are only a few examples under the general concept of this application and do not constitute a limitation on the protection scope of this application. For those skilled in the art, any other implementation methods expanded based on the scheme of this application without creative work belong to the protection scope of this application.

Claims

1. A display device, characterized in that: include: A display mechanism, a sensor connection mechanism (201), a voice recognition mechanism and a sight tracking mechanism; The display mechanism comprises a display screen (101), an outer frame and a data processor; The display screen (101) is a rectangular structure, and the outer frame is a rectangular frame structure; the display screen (101) is embedded in the outer frame; the display screen (101) is electrically connected to the data processor; The speech recognition mechanism is connected to the outer frame via the sensor connection mechanism (201); the speech recognition mechanism comprises a first mechanical arm (202) and a speech recognition sensor (203); The first mechanical arm (202) comprises a first upper arm (2021), a first rotating joint (2022) and a first lower arm (2023), wherein the first rotating joint (2022) rotatably connects the first upper arm (2021) and the first lower arm (2023); The first upper arm (2021) is connected to the sensor connection mechanism (201), and the first lower arm (2023) is connected to the voice recognition sensor (203); A hollow structure is provided on the housing of the speech recognition sensor (203), and the speech recognition sensor (203) is electrically connected to the data processor; The sight line tracking mechanism comprises a second mechanical arm (301) and a first sight line tracking sensor (303); The second mechanical arm (301) comprises a second upper arm (3011), a second rotating joint (3012) and a second lower arm (3013), wherein the second rotating joint (3012) rotationally connects the second upper arm (3011) and the second lower arm (3013); The second upper arm (3011) is connected to the outer frame, and the second lower arm (3013) is connected to the first sight tracking sensor (303); The first sight tracking sensor (303) is a nested structure, and the first sight tracking sensor (303) is electrically connected to the data processor.

2. The display device according to claim 1, characterized in that The sight tracking mechanism also includes a third mechanical arm (302) and a second sight tracking sensor (304); The third mechanical arm (302) comprises a third upper arm (3021), a third rotating joint (3022) and a third lower arm (3023), wherein the third rotating joint (3022) rotatably connects the third upper arm (3021) and the third lower arm (3023); The third upper arm (3021) is connected to the outer frame, and the third lower arm (3023) is connected to the second line of sight tracking sensor (304).

3. The display device according to claim 2, characterized in that: The second sight tracking sensor (304) is a nested structure; The second gaze tracking sensor (304) and the first gaze tracking sensor (303) are symmetrically arranged at two ends of the outer frame, and the second gaze tracking sensor (304) is electrically connected to the data processor.

4. The display device according to claim 1, characterized in that The data processor comprises a first output interface; The display screen (101) is electrically connected to the first output interface.

5. The display device according to claim 1, characterized in that The display screen (101) comprises a touch layer; The data processor also includes a first input interface; The touch layer is electrically connected to the first input interface.

6. The display device according to claim 1, characterized in that: The speech recognition sensor (203) comprises a microphone array; The data processor also includes a second input interface; The microphone array is electrically connected to the second input interface.

7. The display device according to claim 6, characterized in that: The first sight tracking sensor (303) comprises a first camera module; The data processor further comprises a third input interface; The first camera module is electrically connected to the third input interface.

8. The display device according to claim 2, characterized in that: The second sight tracking sensor (304) comprises a second camera module; The data processor further includes a fourth input interface; The second camera module is electrically connected to the fourth input interface.

9. The display device according to claim 1, characterized in that: The sensor connection mechanism (201) and the sight tracking mechanism are connected to the same side of the outer frame.

Images