Single-screen multi-display interaction system, method and device based on head orientation recognition

Abstract

The application provides a single-screen multi-display interaction system, method and device based on head orientation recognition, the system comprises: a central control display module, a reflection display module and a vision acquisition module, wherein: the vision acquisition module is used for acquiring target vision data of an operator; the central control display module is used for determining a target head orientation according to the target vision data; the target head orientation comprises any one of the following: a left side direction, a right side direction and a front direction; a target display scheme is determined according to the target head orientation; a visual interface is generated according to the target display scheme, so that the operator views the visual interface through the central control display module; and the reflection display module is used for reflecting the visual interface output by the central control display module, so that the operator views the visual interface through the reflection display module. By adopting the embodiment of the application, the operation convenience of multi-application full-screen viewing can be improved under the premise of low hardware cost.

Description

Technical Field

[0001] This application relates to the field of intelligent display technology, and in particular to a single-screen multi-display interactive system, method and device based on head orientation recognition. Background Technology

[0002] In agricultural machinery operation scenarios, operators often need to simultaneously view information from multiple different applications, such as soil testing, crop growth monitoring, weather forecasting, and farmland moisture monitoring, to support operational decisions. However, existing solutions have significant shortcomings: Firstly, frequently switching between applications on a single screen distracts operators from controlling the machinery, increasing the risk of misoperation and reducing operational efficiency. Secondly, a single screen cannot simultaneously display multiple applications in full screen, leading to untimely information comparison and comprehensive analysis, affecting the accuracy of critical decisions such as irrigation timing and fertilizer application. Adding multiple independent display devices would significantly increase hardware costs and control room space, and may also cause compatibility and data interaction problems between multiple devices.

[0003] Therefore, how to improve the ease of operation for viewing multiple applications in full screen while keeping hardware costs low is an urgent problem to be solved. Summary of the Invention

[0004] This application provides a single-screen multi-display interactive system, method, and device based on head orientation recognition, which can improve the ease of operation for viewing multiple applications in full screen with low hardware costs.

[0005] In a first aspect, embodiments of this application provide a single-screen multi-display interactive system based on head orientation recognition. The system includes: a central control display module, a reflective display module, and a visual acquisition module. The system is installed in a target control room, with the operator's seat located in the center of the target control room. The central control display module is positioned at the front left of the target control room, the reflective display module is positioned at the front right of the target control room opposite to the central control display module, and the visual acquisition module is fixed directly above the reflective display module, with its lens facing the operator's head area.

[0006] The visual acquisition module is used to acquire the target visual data of the operator;

[0007] The central control display module is used to determine the target head orientation based on the target visual data; the target head orientation includes any one of the following: left side, right side, or front; determine the target display scheme based on the target head orientation; and generate a visualization interface based on the target display scheme, so that the operator can view the visualization interface through the central control display module.

[0008] The reflective display module is used to reflect the visual interface output by the central control display module, so that the operator can view the visual interface through the reflective display module.

[0009] Optionally, in acquiring the operator's target visual data, the visual acquisition module is specifically used for:

[0010] Obtain the real-time light intensity corresponding to the target control room;

[0011] The exposure parameters are determined based on the real-time light intensity.

[0012] Obtain the preset image resolution and image acquisition frame rate;

[0013] The visual acquisition parameters are determined based on the image resolution, the image acquisition frame rate, and the exposure parameters.

[0014] Obtain the head position of the operator;

[0015] The visual acquisition area is determined based on the head position;

[0016] Image acquisition is performed on the visual acquisition area according to the visual acquisition parameters to obtain reference visual data;

[0017] The reference visual data is preprocessed to obtain the target visual data.

[0018] Optionally, the central control display module includes a head orientation recognition module, which is specifically used for determining the target head orientation based on the target visual data:

[0019] Facial feature points are extracted from the target visual data according to a preset face recognition algorithm; the facial feature points include: the corner of the left eye, the corner of the right eye, and the tip of the nose;

[0020] A local facial coordinate system is established with the tip of the nose as the origin, and the first and second horizontal coordinates of the left and right corners of the eyes in the local facial coordinate system are obtained respectively.

[0021] Calculate the absolute values ​​of the differences between the first and second abscissas relative to the abscissa of the origin, respectively, to obtain the first deviation value and the second deviation value;

[0022] The average of the first deviation value and the second deviation value is obtained to obtain the benchmark deviation value;

[0023] Calculate the ratios of the first deviation value and the second deviation value to the reference deviation value, respectively, to obtain the first ratio and the second ratio;

[0024] The target head orientation is determined based on the first ratio and the second ratio.

[0025] Optionally, in determining the target head orientation based on the first ratio and the second ratio, the head orientation recognition module is specifically used for:

[0026] Calculate the absolute value of the difference between the first ratio and the second ratio to obtain the third ratio;

[0027] If the third ratio is less than or equal to a preset symmetry threshold, then the target head is determined to be facing the forward direction.

[0028] If the third ratio is greater than the symmetry threshold, then the maximum value between the first ratio and the second ratio is taken as the effective deviation value;

[0029] If the effective deviation value is the first ratio, then the target head orientation is determined to be the right-side direction;

[0030] If the effective deviation value is the second ratio, then the target head orientation is determined to be the left-hand direction.

[0031] Optionally, the central control display module includes an application switching control module. The target display scheme is initialized to the default display scheme. Specifically, in determining the target display scheme based on the target head orientation, the application switching control module is used for:

[0032] If the target head is facing the left direction, then the target display scheme is switched to a forward display scheme;

[0033] If the target head is facing the right direction, then the target display scheme is switched to a mirror display scheme;

[0034] If the target head is facing the forward direction, then obtain the first duration for which the target head continues to face the forward direction;

[0035] If the first duration is less than the preset timeout switching threshold, the target display scheme remains unchanged;

[0036] If the first duration is greater than or equal to the timeout switching threshold, then the target display scheme is switched to the default display scheme.

[0037] Optionally, the central control display module further includes a visualization processing module. The visualization interface includes any one of the following: a default display interface, a forward display interface, or a mirrored display interface. In generating the visualization interface according to the target display scheme, the visualization processing module is specifically used for:

[0038] If the target display scheme is the default display scheme, then the default display interface corresponding to the default display scheme is generated;

[0039] If the target display scheme is the forward display scheme, then the first application interface corresponding to the forward display scheme is obtained, and the forward display interface is generated according to the first application interface; the forward display interface is in a mirror-off state.

[0040] If the target display scheme is the mirrored display scheme, then the second application interface corresponding to the mirrored display scheme is obtained, and the mirrored display interface is generated according to the second application interface; the mirrored display interface is in the mirrored enabled state.

[0041] Optionally, the application switching control module is further specifically used for:

[0042] The operator obtains a first switching instruction and a second switching instruction for the forward display scheme and the mirrored display scheme, respectively; the first switching instruction includes a third application interface and a first duration; the second switching instruction includes a fourth application interface and a second duration.

[0043] The first application interface in the positive display scheme is switched to the third application interface, and the positive display scheme is kept unchanged according to the first maintenance duration;

[0044] The second application interface in the mirror display scheme is switched to the fourth application interface, and the mirror display scheme is kept unchanged according to the second maintenance duration.

[0045] Secondly, embodiments of this application provide a single-screen multi-display interaction method based on head orientation recognition, applied to a single-screen multi-display interaction system based on head orientation recognition. The system includes: a central control display module, a reflective display module, and a visual acquisition module. The system is installed in a target control room, with the operator's seat located in the center of the target control room. The central control display module is deployed at the left front of the target control room, the reflective display module is deployed at the right front of the target control room opposite to the central control display module, and the visual acquisition module is fixed directly above the reflective display module, with its lens facing the operator's head area. The method includes:

[0046] Collect the target visual data of the operator;

[0047] The target head orientation is determined based on the target visual data; the target head orientation includes any one of the following: left-side direction, right-side direction, and front-side direction; a target display scheme is determined based on the target head orientation; a visualization interface is generated based on the target display scheme, allowing the operator to view the visualization interface through the central control display module;

[0048] The visualization interface output by the central control display module is reflected, allowing the operator to view the visualization interface through the reflection display module.

[0049] Thirdly, embodiments of this application provide an electronic device, including: a processor and a memory, the memory being used to store one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, the programs including instructions for performing the steps in the second aspect of this application.

[0050] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program for electronic data interchange, wherein the computer program causes a computer to perform some or all of the steps described in the second aspect of this application.

[0051] Fifthly, embodiments of this application provide a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps described in the second aspect of embodiments of this application. The computer program product may be a software installation package.

[0052] As can be seen, the single-screen multi-display interactive system based on head orientation recognition provided in this application collects target visual data of the operator's head features through a visual acquisition module, thereby accurately identifying the target head orientation; then, the central control display module automatically switches the target display scheme and generates the corresponding visual interface according to the identified target head orientation, and, together with the mirror reflection effect of the reflective display module, enables parallel viewing of full-screen content of multiple applications, thereby improving the ease of operation of full-screen viewing of multiple applications under the premise of low hardware cost. Attached Figure Description

[0053] To more clearly illustrate the technical solutions in the embodiments of this application or the background art, the accompanying drawings used in the embodiments of this application or the background art will be described below.

[0054] Figure 1 This is a block diagram of the modules of a single-screen multi-display interactive system based on head orientation recognition provided in an embodiment of this application;

[0055] Figure 2 This is a schematic diagram of a process for determining the orientation of a target head, provided in an embodiment of this application.

[0056] Figure 3 This is a flowchart illustrating a method for determining a target display scheme, as provided in an embodiment of this application.

[0057] Figure 4 This is a scenario deployment diagram of a single-screen multi-display interactive system based on head orientation recognition provided in an embodiment of this application;

[0058] Figure 5 This is a schematic diagram illustrating the composition of a central control display module provided in an embodiment of this application;

[0059] Figure 6 This is a schematic diagram of the process of generating and restoring a mirrored display interface provided in an embodiment of this application;

[0060] Figure 7 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0061] Figure 8 This is a flowchart illustrating a single-screen multi-display interaction method based on head orientation recognition provided in an embodiment of this application. Detailed Implementation

[0062] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present application.

[0063] The terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.

[0064] It should be understood that the term "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Additionally, the character " / " in this document indicates that the preceding and following related objects are in an "or" relationship. In the embodiments of this application, "multiple" refers to two or more.

[0065] In the embodiments of this application, "at least one item" or its similar expression refers to any combination of these items, including any combination of a single item or a plurality of items. "One or more" means one or more, while "multiple" means two or more. For example, "at least one item" of a, b, or c can represent the following seven cases: a, b, c; a and b; a and c; b and c; a, b, and c. Each of a, b, and c can be an element or a set containing one or more elements.

[0066] In this application, the term "connection" refers to various connection methods, such as direct connection or indirect connection, to achieve communication between devices. This application does not impose any limitations on this.

[0067] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0068] In agricultural machinery operation scenarios, operators often need to simultaneously view information from multiple different applications, such as soil testing, crop growth monitoring, weather forecasting, and farmland moisture monitoring, to support operational decisions. However, existing solutions have significant shortcomings: Firstly, frequently switching between applications on a single screen distracts operators from controlling the machinery, increasing the risk of misoperation and reducing operational efficiency. Secondly, a single screen cannot simultaneously display multiple applications in full screen, leading to untimely information comparison and comprehensive analysis, affecting the accuracy of critical decisions such as irrigation timing and fertilizer application. Adding multiple independent display devices would significantly increase hardware costs and control room space, and may also cause compatibility and data interaction problems between multiple devices.

[0069] Therefore, how to improve the ease of operation for viewing multiple applications in full screen while keeping hardware costs low is an urgent problem to be solved.

[0070] To address the aforementioned issues, this application provides a single-screen multi-display interactive system, method, and device based on head orientation recognition. The system includes a central control display module, a reflective display module, and a visual acquisition module. The system is installed in a target control room, with the operator's seat located in the center of the target control room. The central control display module is positioned at the left front of the target control room, the reflective display module is positioned at the right front of the target control room opposite to the central control display module, and the visual acquisition module is fixed directly above the reflective display module, with its lens facing the operator's head area. Specifically: the visual acquisition module collects the operator's target visual data; the central control display module determines the target head orientation based on the target visual data; the target head orientation includes any one of the following: left-side, right-side, or front-facing; a target display scheme is determined based on the target head orientation; a visual interface is generated based on the target display scheme, allowing the operator to view the visual interface through the central control display module; and the reflective display module reflects the visual interface output by the central control display module, allowing the operator to view the visual interface through the reflective display module. It is evident that by using this system, the ease of viewing multiple applications in full screen can be improved with low hardware costs.

[0071] For easier understanding, please refer to Figure 1 , Figure 1 This application provides a block diagram of the module composition of a single-screen multi-display interactive system based on head orientation recognition. The system includes: a central control display module, a reflective display module, and a visual acquisition module. The system is installed in a target control room, with the operator's seat located in the center of the target control room. The central control display module is positioned at the front left of the target control room, the reflective display module is positioned at the front right of the target control room opposite to the central control display module, and the visual acquisition module is fixed directly above the reflective display module, with its lens facing the operator's head area.

[0072] The visual acquisition module is used to acquire the target visual data of the operator.

[0073] In this embodiment, the visual acquisition module can employ a high-resolution camera (e.g., 1080P or higher) that supports intelligent image recognition algorithms. Deployed directly above the reflective display module in the target control room, with the lens facing the operator's head area, it is the core sensing unit for accurate head orientation recognition. The visual acquisition module can clearly capture detailed information of key facial feature points such as the operator's left and right eye corners and the tip of the nose, and supports a frame rate of 30fps or higher, enabling real-time tracking of dynamic changes in head posture and avoiding recognition delays or misjudgments due to insufficient frame rate. The visual acquisition module can connect to the central control display module via USB or other high-speed data interfaces to transmit the real-time acquired target visual data.

[0074] Optionally, in acquiring the operator's target visual data, the visual acquisition module is specifically used to perform the following steps:

[0075] A1. Obtain the real-time light intensity corresponding to the target control room;

[0076] A2. Determine the exposure parameters based on the real-time light intensity;

[0077] A3. Obtain the preset image resolution and image acquisition frame rate;

[0078] A4. Determine the visual acquisition parameters based on the image resolution, the image acquisition frame rate, and the exposure parameters;

[0079] A5. Obtain the head position of the operator;

[0080] A6. Determine the visual acquisition area based on the head position;

[0081] A7. Perform image acquisition on the visual acquisition area according to the visual acquisition parameters to obtain reference visual data;

[0082] A8. Preprocess the reference visual data to obtain the target visual data.

[0083] In a specific embodiment, the visual acquisition module can have a built-in light sensor or establish a communication connection with an environmental sensor installed in the target control room to collect the light intensity value in the target control room in real time, thereby obtaining the real-time light intensity. Its acquisition frequency can be kept consistent with the image acquisition frame rate to ensure real-time matching between the light parameters and the acquisition process. Among these, the exposure parameters are the core parameters affecting image acquisition quality, mainly including exposure time and aperture size, which are initialized to default exposure parameters. The exposure parameters can be dynamically adjusted using preset mapping rules: if the light intensity is lower than a preset first light intensity threshold (e.g., 50 lux), the exposure time is appropriately extended and the aperture is increased to increase the amount of light entering the image and ensure image clarity; if the light intensity is higher than a preset second light intensity threshold (e.g., 500 lux), the exposure time is shortened and the aperture is decreased to avoid overexposure; if the light intensity is in a moderate range (i.e., between the first and second light intensity thresholds), the default exposure parameters are directly used to balance image clarity and acquisition efficiency.

[0084] Next, the image resolution and image acquisition frame rate are preset. The image resolution can be preset to 1080P to meet the accuracy requirements of facial feature point recognition; the image acquisition frame rate can be preset to 30fps, which ensures real-time capture of head posture changes and avoids recognition delays caused by low frame rates. Then, the image resolution, image acquisition frame rate, and exposure parameters are integrated to obtain the visual acquisition parameters.

[0085] Then, the visual acquisition module can first use a face detection algorithm to perform preliminary recognition of the image within the acquisition range, selecting a rectangular area containing the operator's head, and determining the coordinate position of this rectangular area in the image coordinate system, i.e., the head position. For scenarios where the operator's position is relatively fixed, the approximate range of the head position can also be preset and fine-tuned based on real-time recognition results to obtain an accurate head position. The rectangular area corresponding to the head position is then expanded outward by a preset number of pixels (e.g., 20 pixels) to form the final visual acquisition area. Notably, only the area containing the head position is used as the acquisition range, rather than acquiring the entire image within the lens's field of view. This reduces the amount of image data from invalid areas, lowers the computational burden of subsequent data preprocessing, avoids interference from background areas, and improves the accuracy of facial feature point recognition.

[0086] Finally, images are acquired from the visual acquisition area according to the visual acquisition parameters to obtain reference visual data. The reference visual data is then preprocessed to obtain the target visual data. Preprocessing includes, but is not limited to, noise removal, grayscale conversion, feature enhancement, and normalization; specific limitations are not specified here.

[0087] It is evident that by dynamically adapting the light intensity to determine the exposure parameters, combining the preset resolution and frame rate to lock the acquisition specifications, and accurately delineating the acquisition area based on the head position, and then preprocessing to output the target visual data, the visual acquisition module can ensure that it can obtain clear, stable and focused visual data of the operator's head under different lighting conditions, providing high-precision data support for subsequent head orientation recognition.

[0088] The central control display module is used to determine the target head orientation based on the target visual data; the target head orientation includes any one of the following: left side, right side, or front direction; determine the target display scheme based on the target head orientation; and generate a visualization interface based on the target display scheme, so that the operator can view the visualization interface through the central control display module.

[0089] In this embodiment, the central control display module uses a central control tablet as the core display and control device, equipped with customized software developed based on the Android system. It serves as the core carrier for realizing single-screen multi-display interaction. At the software functionality level, this customized software integrates two core capabilities: first, multi-task management, supporting the stable background operation of multiple agriculture-related applications (such as soil moisture monitoring, weather forecasting, and crop growth management applications), ensuring smooth and lag-free application switching; second, intelligent interactive control, capable of receiving target visual data transmitted from the visual acquisition module (i.e., the camera) in real time, parsing operator interaction commands through a built-in head orientation recognition algorithm, and automatically controlling application switching and mirror display mode startup / shutdown without manual intervention. At the hardware performance level, the central control display module meets the performance requirements of high computing power and large memory to support the parallel operation of multiple applications and rapid command response. Specifically, the central control display module is equipped with a high-performance processor and sufficient RAM to ensure smooth operation of multiple applications running simultaneously; it also needs efficient data processing capabilities to quickly receive and parse signals transmitted from the visual acquisition module, achieving instantaneous response to interface switching commands. For example, the central control display module can be an industrial-grade tablet PC, which is equipped with a high-performance graphics processor that can meet the computing power requirements of multiple agricultural applications running in parallel, and has good anti-interference and stability, adapting to the complex operating environment of the agricultural machinery control room, effectively ensuring the long-term stable operation of the system.

[0090] Optionally, the central control display module includes a head orientation recognition module. In determining the target head orientation based on the target visual data, the head orientation recognition module specifically performs the following steps:

[0091] B1. Extract facial feature points from the target visual data according to a preset face recognition algorithm; the facial feature points include: the corner of the left eye, the corner of the right eye, and the tip of the nose;

[0092] B2. Establish a local facial coordinate system with the tip of the nose as the origin, and obtain the first and second horizontal coordinates of the left and right corners of the eyes in the local facial coordinate system.

[0093] B3. Calculate the absolute values ​​of the differences between the first and second horizontal coordinates relative to the horizontal coordinate of the origin, respectively, to obtain the first deviation value and the second deviation value;

[0094] B4. Obtain the average of the first deviation value and the second deviation value to obtain the benchmark deviation value;

[0095] B5. Calculate the ratios of the first deviation value and the second deviation value to the reference deviation value, respectively, to obtain the first ratio and the second ratio;

[0096] B6. Determine the target head orientation based on the first ratio and the second ratio.

[0097] In a specific embodiment, firstly, based on a preset face recognition algorithm (such as the MTCNN keypoint detection algorithm or the Dlib feature point extraction algorithm), the facial feature points of the operator are accurately extracted from the target visual data. These facial feature points include, but are not limited to, the left corner of the eye, the right corner of the eye, and the tip of the nose, without specific limitations. Then, a local facial coordinate system is established with the pixel coordinates corresponding to the tip of the nose as the origin. In this local facial coordinate system, the horizontal direction to the right is the positive X-axis, and the vertical direction upward is the positive Y-axis. From this local facial coordinate system, the X-axis coordinates corresponding to the left corner of the eye are extracted and recorded as the first abscissa, and the X-axis coordinates corresponding to the right corner of the eye are extracted and recorded as the second abscissa.

[0098] Next, the difference between the first x-coordinate and the x-coordinate of the origin is calculated, and the absolute value of this difference is taken to obtain the first deviation value. Similarly, the difference between the second x-coordinate and the x-coordinate of the origin is calculated, and the absolute value of this difference is taken to obtain the second deviation value. The average of the first and second deviation values ​​is then calculated to obtain the baseline deviation value, which is used to eliminate facial differences (such as different face widths and eye spacing) among different operators. Next, the ratio between the first deviation value and the baseline deviation value is calculated to obtain the first ratio; the ratio between the second deviation value and the baseline deviation value is calculated to obtain the second ratio. Finally, the target head orientation is determined based on the first and second ratios.

[0099] It is evident that by establishing a local coordinate system with the tip of the nose as the origin, and calculating the deviation and ratio of the corners of the eyes relative to the origin to determine the head orientation, accurate and rapid determination of head orientation can be achieved. Moreover, the calculation logic is simple, the computing power consumption is low, and it is compatible with the embedded operating environment of the central control display module.

[0100] Optional, please refer toFigure 2 , Figure 2 This is a flowchart illustrating a process for determining the orientation of a target head according to an embodiment of this application. In determining the orientation of the target head based on the first ratio and the second ratio, the head orientation recognition module specifically performs the following steps:

[0101] C1. Calculate the absolute value of the difference between the first ratio and the second ratio to obtain the third ratio;

[0102] C2. If the third ratio is less than or equal to the preset symmetry threshold, then the target head orientation is determined to be the forward direction.

[0103] C3. If the third ratio is greater than the symmetry threshold, then the maximum value between the first ratio and the second ratio shall be taken as the effective deviation value.

[0104] C4. If the effective deviation value is the first ratio, then the target head orientation is determined to be the right-side direction;

[0105] C5. If the effective deviation value is the second ratio, then the target head orientation is determined to be the left-side direction.

[0106] In a specific embodiment, firstly, the absolute value of the difference between the first ratio and the second ratio is calculated to obtain the third ratio. The first ratio corresponds to the ratio of the deviation value of the left eye corner to the reference deviation value; the second ratio corresponds to the ratio of the deviation value of the right eye corner to the reference deviation value; the magnitude of the third ratio directly reflects the degree of symmetry of the horizontal position of the two eyes relative to the tip of the nose. The smaller the value, the more symmetrical the position of the two eyes and the closer the head is to a forward position.

[0107] If the third ratio is less than or equal to the preset symmetry threshold (e.g., 0.2, which can be adjusted according to actual application scenarios and practical experience), it means that the horizontal position deviation ratio of the left and right eyes relative to the tip of the nose is basically the same, there is no significant unilateral offset, and it can be determined that the target head is facing forward.

[0108] If the third ratio is greater than the symmetry threshold, it indicates that there is a significant unilateral head rotation. The maximum value between the first and second ratios can be taken as the effective deviation value. Specifically, the first ratio corresponds to the deviation ratio of the left eye corner. When the first ratio is a valid deviation value, it means that the horizontal position deviation ratio of the left eye corner relative to the nose tip is significantly greater than that of the right eye, indicating that the head is turning to the right, thus determining that the target head is facing to the right. The second ratio corresponds to the deviation ratio of the right eye corner. When the second ratio is a valid deviation value, it means that the horizontal position deviation ratio of the right eye corner relative to the nose tip is significantly greater than that of the left eye, indicating that the head is turning to the left, thus determining that the target head is facing to the left.

[0109] It is evident that by calculating the absolute value of the difference between the ratios of the deviations of the two eye corners to determine head symmetry, and by combining the magnitude of the ratios to distinguish between left and right orientations, a precise and rapid determination of head orientation can be achieved.

[0110] Optional, please refer to Figure 3 , Figure 3 This is a flowchart illustrating a method for determining a target display scheme according to an embodiment of this application. The central control display module includes an application switching control module. The target display scheme is initialized to a default display scheme. Specifically, in determining the target display scheme based on the target head orientation, the application switching control module performs the following steps:

[0111] D1. If the target head is facing the left direction, then switch the target display scheme to the forward display scheme;

[0112] D2. If the target head is facing the right direction, then switch the target display scheme to a mirror display scheme;

[0113] D3. If the target head is facing the forward direction, then obtain the first duration during which the target head continues to face the forward direction;

[0114] D4. If the first duration is less than the preset timeout switching threshold, then the target display scheme remains unchanged;

[0115] D5. If the first duration is greater than or equal to the timeout switching threshold, then the target display scheme is switched to the default display scheme.

[0116] In a specific embodiment, the target display scheme is initialized to the default display scheme, which includes, but is not limited to: main interface mode, screen saver mode, and black screen mode, and is not specifically limited here. The main interface mode is the basic configuration mode of the default display scheme. The corresponding interface is a summary view of the system's core functions and commonly used applications, and adopts a regional layout design, such as the system status area, quick application area, and real-time data area. The screen saver mode is the low-power energy-saving configuration mode of the default display scheme. The central control display module outputs a static or dynamic low-brightness screen saver interface. The interface content only retains minimal information such as system logo, current time, and remaining battery power. It disables background rendering of complex applications, which can avoid the risk of screen burn-in caused by displaying fixed content on the screen for a long time (especially when adapted to OLED screens). At the same time, it maintains the screen in a low-power wake-up state. When the operator changes the direction of their head (left / right), it can be quickly woken up and switched to the forward display scheme or mirror display scheme. The black screen mode is the ultimate energy-saving configuration mode of the default display scheme. The central control display module directly turns off the screen backlight output and only maintains the background operation of the system's core programs. The device power consumption is reduced to the minimum. This black screen mode is suitable for mobile operation scenarios without external power supply and can significantly extend the battery life of the central control display module. When the operator changes the direction of their head again to trigger an interaction command, the system can quickly wake up the central control display module and load the corresponding display scheme.

[0117] When the head orientation recognition module determines that the operator's head is facing to the left, it means that the operator is looking at the central control display module deployed at the front left. At this time, the application switching control module triggers the scheme switching command to switch the current target display scheme from the existing state to the forward display scheme. The visualization interface corresponding to the forward display scheme is the original application interface without mirroring, which can be directly viewed by the operator without additional mirror restoration processing.

[0118] When the head orientation recognition module determines that the operator's head is facing to the right, it means that the operator is looking at the reflective display module deployed at the right front. At this time, the application switching control module triggers a scheme switching command to switch the current target display scheme from the existing state to the mirror display scheme. The visualization interface corresponding to the mirror display scheme is a horizontally flipped display interface. After being reflected by the reflective display module, this interface will be restored to the forward viewing state, ensuring that the content viewed by the operator through the reflective display module has no directional deviation.

[0119] When the head orientation recognition module determines that the operator's head is facing forward, it means that the operator is not looking at the central control display module or the reflective display module. At this time, the application switching control module starts the timing function to accumulate the duration for which the target head is continuously facing forward, and defines this duration as the first duration. If the first duration does not reach the preset timeout switching threshold, it means that the operator may be in a brief state of eye adjustment. At this time, the application switching control module does not perform the scheme switching operation, maintaining the current target display scheme unchanged, avoiding frequent switching due to brief eye changes that affect the user experience. The timeout switching threshold is a pre-configured duration threshold, which can range from 10 to 30 seconds and can be flexibly adjusted according to the actual application scenario. No specific limitation is made here. When the first duration reaches or exceeds the timeout switching threshold, it means that the operator has not been paying attention to the central control display module and the reflective display module for a relatively long time. At this time, the application switching control module triggers a scheme reset command, switching the current target display scheme to the initial default display scheme.

[0120] It is evident that by controlling the display scheme switching in conjunction with head orientation and duration threshold, seamless and precise switching of the display interface can be achieved, balancing operational continuity and low power consumption requirements, thereby improving the convenience and intelligence of human-computer interaction.

[0121] Optionally, the central control display module further includes a visualization processing module. The visualization interface includes any one of the following: a default display interface, a forward display interface, or a mirrored display interface. In generating the visualization interface according to the target display scheme, the visualization processing module specifically performs the following steps:

[0122] E1. If the target display scheme is the default display scheme, then generate the default display interface corresponding to the default display scheme;

[0123] E2. If the target display scheme is the forward display scheme, then obtain the first application interface corresponding to the forward display scheme, and generate the forward display interface based on the first application interface; the forward display interface is in a mirror-off state.

[0124] E3. If the target display scheme is the mirror display scheme, then obtain the second application interface corresponding to the mirror display scheme, and generate the mirror display interface according to the second application interface; the mirror display interface is in the mirror enabled state.

[0125] In a specific embodiment, when the target display scheme output by the application switching control module is the default display scheme, the visualization processing module generates a corresponding default display interface based on the preset default mode configuration in the default display scheme. This default display interface can match three modes: in main interface mode, it generates a summary view including system status, quick applications, and real-time data; in screensaver mode, it generates a low-power, simplified information interface (such as system identifier, time, and battery level); and in black screen mode, it directly outputs a black screen signal without image and turns off the screen backlight. The default display interface does not require mirroring and can be directly output through the central control display module.

[0126] When the target display scheme is a forward display scheme, the visualization processing module first retrieves the original interface data of the preset first application (such as an agricultural machinery operation parameter monitoring application) to obtain the first application interface; then, it directly generates the forward display interface based on this first application interface, without performing any pixel horizontal flipping or other mirroring operations, meaning the interface is in a mirror-off state. The forward display interface can be directly viewed by the operator through the central control display module on the front left, and the content orientation is consistent with conventional visual habits without deviation.

[0127] When the target display scheme is a mirrored display scheme, the visualization processing module first retrieves the original interface data of a preset second application (such as a crop growth status analysis application) to obtain the second application interface. Then, it executes a pixel horizontal flip algorithm (i.e., enables mirror processing) on ​​this second application interface, symmetrically flipping the interface content along the vertical center line to generate a mirrored display interface. After this mirrored display interface is output to the central control display module, the light path is reversed by the mirror reflection of the front right reflective display module. The interface ultimately presented to the operator is restored to a forward-facing viewing state, ensuring that the content viewed by the operator through the reflective display module is clear and free of directional distortion.

[0128] It is evident that by generating corresponding visualization interfaces based on different display schemes, it is possible to ensure that each display interface is accurately matched with the viewing scenario, guarantee that the front interface is directly visible and the mirrored interface is adapted and reflected, thereby improving the smoothness and accuracy of human-computer interaction.

[0129] Optionally, the application switching control module is further configured to perform the following steps:

[0130] F1. Obtain the first switching instruction and the second switching instruction from the operator for the forward display scheme and the mirror display scheme, respectively; the first switching instruction includes a third application interface and a first duration; the second switching instruction includes a fourth application interface and a second duration.

[0131] F2. Switch the first application interface in the positive display scheme to the third application interface, and maintain the positive display scheme unchanged according to the first maintenance duration;

[0132] F3. Switch the second application interface in the mirror display scheme to the fourth application interface, and maintain the mirror display scheme unchanged according to the second maintenance duration.

[0133] In a specific embodiment, firstly, the central control display module can receive a first switching command from the operator for the forward display scheme and a second switching command for the mirror display scheme. The methods for receiving the commands include touch interface, physical shortcut keys, or voice commands, etc., and are not specifically limited here. The first switching command includes a third application interface and a first maintenance duration. The third application interface is a visual interface that replaces the first application interface in the original forward display scheme, such as replacing "soil moisture monitoring application" with "agricultural machinery operation trajectory application." The first maintenance duration is the duration for which the interface content of the forward display scheme remains the same as the third application interface after switching to the third application interface, such as 3 minutes, 5 minutes, 10 minutes, etc. The second switching command includes a fourth application interface and a second maintenance duration. The fourth application interface is a visual interface that replaces the second application interface in the original mirror display scheme, such as replacing "crop growth analysis application" with "equipment fault diagnosis application." The second maintenance duration is the duration for which the interface content of the mirror display scheme remains the same as the fourth application interface after switching to the fourth application interface.

[0134] Then, the application switching control module performs an interface replacement operation, replacing the first application interface corresponding to the forward display scheme with the third application interface in the first switching instruction. A first maintenance duration timer is started. During the timer period, as long as the operator's head is facing left, the central control display module continuously displays the forward display interface corresponding to the third application interface and will not automatically switch back to the original first application interface. If the operator's head moves away from the left direction (e.g., turning forward or to the right), the forward display scheme will pause triggering, but the timer will not be interrupted; when the head turns back to the left direction, the forward display interface corresponding to the third application interface will still be displayed until the first maintenance duration ends, at which point the interface content of the forward display scheme will automatically revert to the first application interface.

[0135] Simultaneously, the application switching control module replaces the second application interface corresponding to the mirrored display scheme with the fourth application interface in the second switching command. The second maintenance duration is initiated. During the timing period, as long as the operator's head is facing right, the central control display module continuously displays the mirrored display interface corresponding to the fourth application interface (restored to the forward position by the reflective display module), and will not automatically switch back to the original second application interface. If the operator's head leaves the right-hand direction (e.g., turns forward or to the left), the mirrored display scheme will pause triggering, but the timing will not be interrupted; when the head turns back to the right-hand direction, the mirrored display interface corresponding to the fourth application interface will still be displayed until the second maintenance duration ends, at which point the interface content of the mirrored display scheme will automatically revert to displaying the second application interface.

[0136] It is evident that by supporting operators to customize the application interface and duration, personalized interaction needs in different work scenarios can be met, continuous viewing of specific applications can be ensured, and the flexibility and practicality of human-computer interaction can be improved.

[0137] The reflective display module is used to reflect the visual interface output by the central control display module, so that the operator can view the visual interface through the reflective display module.

[0138] In this embodiment, the reflective display module can use an optical mirror as the core reflective carrier. The reflective mirror of the reflective display module can be an optical glass mirror with high light transmittance and low reflection loss. The mirror surface needs to be polished to form a highly flat reflective surface with a reflectivity of not less than 90%, and the surface is coated with an anti-glare coating, which can effectively filter ambient light in the control room and avoid problems such as light spots and ghosting on the reflective interface, ensuring that the interface of the central control display module seen by the operator in the mirror is clear and the colors are not distorted. The effective reflective area of ​​the reflective mirror needs to be larger than the screen size of the central control display module. For example, if the display screen of the central control display module is 10.1 inches, then the effective size of the reflective mirror should be not less than 11.1 inches, ensuring that the visual interface output by the central control display module can be completely projected into the mirror without content clipping, and the operator can view the application interface information completely.

[0139] For easier understanding, please refer to Figure 4 , Figure 4This is a scenario deployment diagram of a single-screen multi-display interactive system based on head orientation recognition, provided in an embodiment of this application. The system is deployed in a target control room, with the operator's seat positioned in the center. The target control room includes, but is not limited to, agricultural machinery control rooms, industrial equipment control rooms, and fixed monitoring consoles. Operators include, but are not limited to, agricultural machinery operators, industrial equipment operators, and fixed console monitoring personnel; no specific limitations are imposed here. The single-screen multi-display interactive system based on head orientation recognition includes a central control display module, a vision acquisition module, and a reflective display module. The central control display module, located on the left side of the target control room, is the core display and control unit of the system (i.e., an industrial-grade tablet PC). It directly outputs a forward-facing display interface for operators to view when their heads turn to the left; it can also output a mirrored display interface for use by the right-side reflective display module. The vision acquisition module is located above the reflective display module, with its lens facing the operator's head. It collects visual data on head position and identifies head orientation (left / right / front), providing interactive commands for switching interfaces on the central control display module. The reflective display module, located on the right side of the target control room, is a high-definition optical mirror used to reflect the mirrored display interface output by the central control display module. After reflection, the content is restored to a forward-facing state, allowing operators to comfortably view the full-screen application interface information when their heads turn to the right.

[0140] In one possible embodiment, when the operator sits in the middle seat of the target control room and looks towards the left-hand central control display module, the central control display module defaults to displaying the application interface of the agricultural machinery operation parameters application in normal state. The vision acquisition module collects the operator's head posture in real time. When it detects that the operator turns their head to look at the right-hand reflective display module, the Android control software in the central control display module is triggered, automatically switching the display interface to the farmland map application interface and horizontally mirroring it. The operator can then view the normally displayed farmland map interface through the reflective display module. When the operator turns their head back to the left-hand central control display module, the central control display module reverts to displaying the previous agricultural machinery operation parameters application interface, retaining the previous operating state (such as the set sowing depth value). The entire process requires no manual operation; the application interface switching is completed simply by turning the head, adapting to the need for both hands to focus on operating the equipment during agricultural machinery operations.

[0141] For easier understanding, please refer to Figure 5 , Figure 5This is a schematic diagram of the composition of a central control display module provided in an embodiment of this application. The central control display module includes, but is not limited to, a head orientation recognition module, an application switching control module, and a visualization processing module, which are not specifically limited herein. The head orientation recognition module receives target visual data transmitted by the visual acquisition module. Through steps such as extracting facial feature points, establishing a local coordinate system, calculating the deviation ratio, and determining the head orientation state, it outputs the operator's target head orientation (left, right, or forward), providing a decision basis for switching display schemes. The application switching control module receives the target head orientation output by the head orientation recognition module and executes the switching and maintenance logic of the display scheme, including switching rules for the default display scheme, the forward display scheme, and the mirrored display scheme, as well as interface replacement and duration maintenance functions based on the operator's custom commands. The visualization processing module generates corresponding visualization interfaces based on the target display scheme output by the application switching control module, including the default display interface, the forward display interface, and the mirrored display interface, and outputs them to the screen of the central control display module for display.

[0142] For easier understanding, please refer to Figure 6 , Figure 6 This is a schematic diagram illustrating the process of generating and restoring a mirrored display interface according to an embodiment of this application. When the operator's head is facing to the right, the target display scheme is a mirrored display scheme. The original second application interface corresponding to the mirrored display scheme is obtained through the central control display module, and a horizontal mirror flipping process is performed on the second application interface to obtain the mirrored second application interface, i.e., the mirrored display interface. Then, the mirrored second application interface is mirror-reflected through the reflection display module to obtain a positive second application interface, ensuring that the final application interface presented to the operator is completely consistent with the original second application interface.

[0143] The following is combined Figure 7 The electronic devices in the embodiments of this application will be described. Figure 7 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application, such as... Figure 7 As shown, the electronic device includes one or more processors, a memory, a communication interface, and one or more programs. The processor is connected to the memory and the communication interface via an internal communication bus.

[0144] The processor can be used for:

[0145] Determine the target's head orientation based on the target's visual data; the target's head orientation includes any of the following: left-side, right-side, or front-side; determine the target display scheme based on the target's head orientation; generate a visualization interface based on the target display scheme.

[0146] The one or more programs are stored in the aforementioned memory and configured to be executed by the aforementioned processor, and the one or more programs include instructions for performing any of the steps in the above embodiments.

[0147] The processor can be a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute the various exemplary logic blocks, cells, and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computational functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc. The communication unit can be a communication interface, transceiver, transceiver circuit, etc., and the storage unit can be a memory.

[0148] The memory can be volatile or non-volatile, or a combination of both. Non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), used as an external cache. By way of example, but not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate synchronous DRAM (DDR SDRAM), enhanced synchronous DRAM (ESDRAM), synchronous linked DRAM (SLDRAM), and direct rambus RAM (DR RAM).

[0149] It is understood that the electronic device may include more or fewer structural elements than those shown in the block diagram above, such as a power module, physical buttons, a Wi-Fi module, a speaker, a Bluetooth module, sensors, a display module, etc., without limitation. It is understood that the electronic device may be as follows: Figure 1 The aforementioned central control display module.

[0150] After understanding the software and hardware architecture of this application, the following will be combined with... Figure 8 This application describes a single-screen multi-display interaction method based on head orientation recognition in an embodiment of the present application. Figure 8 This is a flowchart illustrating a single-screen multi-display interaction method based on head orientation recognition, provided in an embodiment of this application. The method is applied to a single-screen multi-display interaction system based on head orientation recognition. The system includes a central control display module, a reflective display module, and a visual acquisition module. The system is installed in a target control room, with the operator's seat located in the center of the target control room. The central control display module is positioned at the front left of the target control room, the reflective display module is positioned at the front right of the target control room opposite to the central control display module, and the visual acquisition module is fixed directly above the reflective display module, with its lens facing the operator's head area. The method specifically includes the following steps:

[0151] S1. Collect the target visual data of the operator;

[0152] S2. Determine the target head orientation based on the target visual data; the target head orientation includes any one of the following: left-side direction, right-side direction, and front-facing direction;

[0153] S3. Determine the target display scheme based on the target's head orientation;

[0154] S4. Generate a visual interface according to the target display scheme, so that the operator can view the visual interface through the central control display module;

[0155] S5. Reflect the visualization interface output by the central control display module, so that the operator can view the visualization interface through the reflection display module.

[0156] As can be seen, the visual acquisition module collects target visual data of the operator's head features to accurately identify the target's head orientation. Then, the central control display module automatically switches the target display scheme and generates the corresponding visualization interface based on the identified target head orientation. Combined with the mirror reflection effect of the reflective display module, it enables parallel viewing of full-screen content of multiple applications, thereby improving the ease of operation of full-screen viewing of multiple applications with low hardware costs.

[0157] This application also provides a computer-readable storage medium storing a computer program for electronic data interchange, which causes a computer to perform some or all of the steps of the single-screen multi-display interaction method based on head orientation recognition as described in the above embodiments, wherein the computer includes an electronic device.

[0158] This application also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of the head orientation recognition-based single-screen multi-display interaction method described in the above embodiments. The computer program product can be a software installation package, and the computer includes an electronic device.

[0159] It should be noted that, for the sake of simplicity, the above embodiments are all described as a series of actions. Those skilled in the art should understand that this application is not limited to the described order of actions, as some steps in the embodiments of this application can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions, steps, modules, or units involved are not necessarily essential to the embodiments of this application.

[0160] In the above embodiments, the descriptions of each embodiment in this application have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0161] Those skilled in the art will understand that implementing all or part of the processes in the above embodiments can be accomplished by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

[0162] The steps of the methods or algorithms described in the embodiments of this application can be implemented in hardware or by a processor executing software instructions. The software instructions can consist of corresponding software modules, which can be stored in RAM, flash memory, ROM, EPROM, electrically erasable programmable read-only memory (EEPROM), registers, hard disk, portable hard disk, read-only optical disk (CD-ROM), or any other form of storage medium well known in the art. An exemplary storage medium is coupled to a processor, enabling the processor to read information from and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and storage medium can reside in an ASIC. Furthermore, the ASIC can reside in a terminal device or management device. Alternatively, the processor and storage medium can exist as discrete components in the terminal device or management device.

[0163] Those skilled in the art will recognize that, in one or more of the examples above, the functions described in the embodiments of this application can be implemented, in whole or in part, by software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. This computer program product includes one or more computer instructions. When these computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device such as a server or data center that integrates one or more available media. The available media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., digital video discs (DVDs)), or semiconductor media (e.g., solid-state disks (SSDs)).

[0164] The modules / units included in the various devices and products described in the above embodiments can be software modules / units, hardware modules / units, or a combination of both. For example, for devices and products applied to or integrated into a chip, all modules / units can be implemented using hardware methods such as circuits, or at least some modules / units can be implemented using software programs that run on a processor integrated within the chip, while the remaining (if any) modules / units can be implemented using hardware methods such as circuits. For devices and products applied to or integrated into a chip module, all modules / units can be implemented using hardware methods such as circuits. Different modules / units can be located in the same component (e.g., chip, circuit module, etc.) or different components of the chip module, or at least some modules / units can be implemented using hardware methods such as circuits. The implementation is achieved through a software program that runs on the processor integrated within the chip module. The remaining modules / units (if any) can be implemented using hardware methods such as circuits. For various devices and products applied to or integrated into terminal equipment, each of their modules / units can be implemented using hardware methods such as circuits. Different modules / units can be located in the same component (e.g., chip, circuit module, etc.) or different components within the terminal equipment. Alternatively, at least some modules / units can be implemented through a software program that runs on the processor integrated within the terminal equipment, while the remaining modules / units (if any) can be implemented using hardware methods such as circuits.

[0165] The specific embodiments described above further illustrate the purpose, technical solution, and beneficial effects of the embodiments of this application. It should be understood that the above descriptions are merely specific embodiments of the embodiments of this application and are not intended to limit the protection scope of the embodiments of this application. Any modifications, equivalent substitutions, improvements, etc., made on the basis of the technical solutions of the embodiments of this application should be included within the protection scope of the embodiments of this application.

Claims

1. A single-screen multi-display interactive system based on head orientation recognition, characterized in that, The system includes a central control display module, a reflective display module, and a vision acquisition module. The system is installed in the target control room, with the operator's seat located in the center of the target control room. The central control display module is positioned at the front left of the target control room, the reflective display module is positioned at the front right of the target control room opposite the central control display module, and the vision acquisition module is fixed directly above the reflective display module, with its lens facing the operator's head area. The visual acquisition module is used to acquire the target visual data of the operator; The central control display module is used to determine the target head orientation based on the target visual data; the target head orientation includes any one of the following: left side, right side, or front; determine the target display scheme based on the target head orientation; and generate a visualization interface based on the target display scheme, so that the operator can view the visualization interface through the central control display module. The reflective display module is used to reflect the visual interface output by the central control display module, so that the operator can view the visual interface through the reflective display module; The central control display module includes an application switching control module. The target display scheme is initialized to the default display scheme. Specifically, in determining the target display scheme based on the target head orientation, the application switching control module is used for: If the target head is facing the left direction, then the target display scheme is switched to a forward display scheme; If the target head is facing the right direction, then the target display scheme is switched to a mirror display scheme; If the target head is facing the forward direction, then obtain the first duration for which the target head continues to face the forward direction; If the first duration is less than the preset timeout switching threshold, the target display scheme remains unchanged; If the first duration is greater than or equal to the timeout switching threshold, then the target display scheme is switched to the default display scheme; When the target head is facing the right direction, the application switching control module triggers a scheme switching command to switch the current target display scheme from its existing state to the mirror display scheme. The visualization interface corresponding to the mirror display scheme is a horizontally flipped display interface. After being reflected by the reflection display module, the display interface is restored to a forward-facing visible state to ensure that the content viewed by the operator through the reflection display module has no directional deviation.

2. The system as described in claim 1, characterized in that, In acquiring the operator's target visual data, the visual acquisition module is specifically used for: Obtain the real-time light intensity corresponding to the target control room; The exposure parameters are determined based on the real-time light intensity. Obtain the preset image resolution and image acquisition frame rate; The visual acquisition parameters are determined based on the image resolution, the image acquisition frame rate, and the exposure parameters. Obtain the head position of the operator; The visual acquisition area is determined based on the head position; Image acquisition is performed on the visual acquisition area according to the visual acquisition parameters to obtain reference visual data; The reference visual data is preprocessed to obtain the target visual data.

3. The system as described in claim 2, characterized in that, The central control display module includes a head orientation recognition module. In determining the target head orientation based on the target visual data, the head orientation recognition module is specifically used for: Facial feature points are extracted from the target visual data according to a preset face recognition algorithm; the facial feature points include: the corner of the left eye, the corner of the right eye, and the tip of the nose; A local facial coordinate system is established with the tip of the nose as the origin, and the first and second horizontal coordinates of the left and right corners of the eyes in the local facial coordinate system are obtained respectively. Calculate the absolute values ​​of the differences between the first and second abscissas relative to the abscissa of the origin, respectively, to obtain the first deviation value and the second deviation value; The average of the first deviation value and the second deviation value is obtained to obtain the benchmark deviation value; Calculate the ratios of the first deviation value and the second deviation value to the reference deviation value, respectively, to obtain the first ratio and the second ratio; The target head orientation is determined based on the first ratio and the second ratio.

4. The system as described in claim 3, characterized in that, In determining the target head orientation based on the first ratio and the second ratio, the head orientation recognition module is specifically used for: Calculate the absolute value of the difference between the first ratio and the second ratio to obtain the third ratio; If the third ratio is less than or equal to a preset symmetry threshold, then the target head is determined to be facing the forward direction. If the third ratio is greater than the symmetry threshold, then the maximum value between the first ratio and the second ratio is taken as the effective deviation value; If the effective deviation value is the first ratio, then the target head orientation is determined to be the right-side direction; If the effective deviation value is the second ratio, then the target head orientation is determined to be the left-hand direction.

5. The system according to any one of claims 1-4, characterized in that, The central control display module further includes a visualization processing module. The visualization interface includes any one of the following: a default display interface, a forward display interface, or a mirrored display interface. Specifically, in generating the visualization interface based on the target display scheme, the visualization processing module is used for: If the target display scheme is the default display scheme, then the default display interface corresponding to the default display scheme is generated; If the target display scheme is the forward display scheme, then the first application interface corresponding to the forward display scheme is obtained, and the forward display interface is generated according to the first application interface; the forward display interface is in a mirror-off state. If the target display scheme is the mirrored display scheme, then the second application interface corresponding to the mirrored display scheme is obtained, and the mirrored display interface is generated according to the second application interface; the mirrored display interface is in the mirrored enabled state.

6. The system as described in claim 5, characterized in that, The application switching control module is also specifically used for: The operator obtains a first switching instruction and a second switching instruction for the forward display scheme and the mirrored display scheme, respectively; the first switching instruction includes a third application interface and a first duration; the second switching instruction includes a fourth application interface and a second duration. The first application interface in the positive display scheme is switched to the third application interface, and the positive display scheme is kept unchanged according to the first maintenance duration; The second application interface in the mirror display scheme is switched to the fourth application interface, and the mirror display scheme is kept unchanged according to the second maintenance duration.

7. A single-screen multi-display interaction method based on head orientation recognition, characterized in that, The system described in any one of claims 1-6, comprising: a central control display module, a reflective display module, and a visual acquisition module, wherein the system is installed in a target control room, and the operator's seat is located in the center of the target control room; wherein the central control display module is deployed at the left front of the target control room, the reflective display module is deployed at the right front of the target control room opposite to the central control display module, and the visual acquisition module is fixed directly above the reflective display module, with its lens facing the operator's head area; the method comprises: Collect the target visual data of the operator; The target head orientation is determined based on the target visual data; the target head orientation includes any one of the following: left-side direction, right-side direction, and front-facing direction; Determine the target display scheme based on the target's head orientation; A visual interface is generated based on the target display scheme, allowing the operator to view the visual interface through the central control display module; The visualization interface output by the central control display module is reflected, allowing the operator to view the visualization interface through the reflection display module.

8. An electronic device, characterized in that, include: Processor, memory, communication interface, and one or more programs; The one or more programs are stored in the memory and configured to be executed by the processor, the programs including instructions for performing the steps of the method as described in claim 7.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, the computer program including program instructions that, when executed by a processor, cause the processor to perform the method as described in claim 7.

Images