Main and auxiliary screen control method for main and auxiliary screen linkage, computing equipment and main and auxiliary screen linkage system

Abstract

The invention relates to a main and auxiliary screen control method for main and auxiliary screen linkage, computing equipment and a main and auxiliary screen linkage system.The main screen control method comprises the steps that in response to starting of a target program of a main screen, a program interface corresponding to the target program is displayed, and the auxiliary screen is controlled to execute operation of displaying a product image interface; the product image interface is used for displaying a product image obtained in the process of manufacturing the target product based on the target semiconductor technological process; and in response to determining that the display state of the product image interface in the secondary screen is abnormal display and the display state of the program interface is normal display, performing normal recovery adjustment aiming at the product image interface. The method and the device are used for solving the technical problem that the detection efficiency is reduced due to the fact that the production or detection process is forced to be interrupted and waiting for manual intervention because the image observation window of the secondary screen is abnormal.

Description

Technical Field

[0001] This application relates to the field of image display technology, and in particular to a main and secondary screen control method, computing device, and main and secondary screen linkage system. Background Technology

[0002] In precision equipment used for semiconductor wafer inspection and measurement, the host computer software on the main screen is a core tool for engineers to set up process recipes or review results. Engineers frequently need to precisely locate mark patterns, observe defect morphology, or perform feature measurements on wafer images acquired in real time by high-resolution observation cameras (such as optical microscope cameras or electron beam cameras). For this purpose, the host computer software provides a separate image viewing window and displays it on a secondary screen to show the camera-captured images in real time or in playback.

[0003] In traditional solutions, when an anomaly occurs in the image observation window of the secondary screen, engineers are required to manually identify the problem and restart the window, which forces the production or testing process to be interrupted and waits for manual intervention, thus reducing testing efficiency. Summary of the Invention

[0004] This application discloses a main and secondary screen linkage control method, computing device, and main and secondary screen linkage system, which is used to solve the technical problem that the production or testing process is forced to be interrupted due to abnormalities in the image observation window of the secondary screen, requiring manual intervention and reducing the testing efficiency.

[0005] In a first aspect, this application provides a main screen control method for main and secondary screen linkage, comprising: in response to the launch of a target program on the main screen, displaying the program interface corresponding to the target program, and controlling the secondary screen to perform an operation of displaying a product image interface, wherein the target program is an application used to detect a target product manufactured based on a target semiconductor process, and the product image interface is used to display product images obtained during the manufacturing process of the target product based on the target semiconductor process; in response to determining that the display state of the product image interface on the secondary screen is abnormal and the display state of the program interface is normal, performing adjustments to restore the product image interface to normal.

[0006] In this way, this application displays the program interface corresponding to the target program in response to the launch of the target program on the main screen, and controls the secondary screen to perform the operation of displaying the product image interface. This eliminates the need for the user to manually display the product image interface. Simultaneously, the program interface is displayed on the main screen, and the product image interface is displayed on the secondary screen. In response to determining that the display status of the product image interface on the secondary screen is abnormal while the display status of the program interface is normal, adjustments are made to restore the product image interface to normal. This ensures that even when the product image interface displays abnormally and the display status of the program interface on the main screen is normal, the interface can still be restored to normal display, keeping the product image interface permanently on the secondary screen for convenient user access. The target program is the application used to detect the target product manufactured based on the target semiconductor process. The product image interface is used to display product images obtained during the manufacturing process of the target product based on the target semiconductor process. The main screen control method is suitable for setting process recipes or reviewing results using semiconductor testing equipment. It enables dual-screen collaboration in the semiconductor testing process, with the main screen displaying process data and the secondary screen displaying image data. This avoids forced interruptions to the production or testing process due to abnormalities in the image observation window of the secondary screen, thus improving testing efficiency.

[0007] In one possible implementation, before the control sub-screen performs the operation of displaying the product image interface, the method further includes: calling the hardware query application programming interface provided by the operating system to enumerate all displays connected to the computing device; and determining the sub-screen for displaying the product image interface based on the enumeration results.

[0008] In this way, when the system connects to multiple external displays, the main computing device can automatically identify all available display resources by calling the operating system's hardware query API, reducing the manual configuration steps for users in a multi-screen environment, avoiding operational errors or connection omissions that may be caused by manual selection, and significantly improving the user experience in multi-screen collaboration scenarios.

[0009] In one possible implementation, determining the secondary screen for displaying the product image interface based on the enumeration result includes: determining the first detected display screen other than the main screen based on the enumeration result; and determining the first detected display screen as the secondary screen for displaying the product image interface.

[0010] In this way, the first detected display in the enumeration results is set as the secondary display. By standardizing the enumeration order, the plug-and-play capability of the multi-screen system is realized. This automatic selection mechanism based on the hardware discovery order eliminates the need for users to manually configure the display output target, reducing the manual configuration steps in the multi-screen environment. It is especially suitable for scenarios requiring rapid deployment.

[0011] In one possible implementation, the main screen is connected to a computing device, which has an operating system installed. The operation of controlling the secondary screen to display the product image interface includes: calling the window management application programming interface of the operating system to create the product image interface on the secondary screen; and controlling the secondary screen to display the product image interface through the window management application programming interface.

[0012] In this way, the main screen control method uses the operating system's native API for interface control, eliminating the compatibility dependency of third-party multi-screen management software. In the common Windows / Linux hybrid deployment environment of semiconductor process manufacturing lines, the success rate of creating product image interfaces can be improved.

[0013] In one possible implementation, determining that the display state of the product image interface in the secondary screen is abnormal includes: listening to a communication message sent by the secondary screen that indicates that the product image interface is abnormal; and determining that the display state of the product image interface is abnormal based on listening to the communication message.

[0014] In this way, the main screen control method determines the display status by actively listening to the abnormal communication messages actively sent by the secondary screen, which improves the real-time performance of abnormal detection. Furthermore, it determines whether the display status of the product image interface is abnormal based on the communication messages, thereby improving the accuracy of abnormal judgment.

[0015] In one possible implementation, the step of adjusting the product image interface to restore normal operation in response to determining that the display state of the product image interface in the secondary screen is abnormal and the display state of the program interface is normal includes: controlling the secondary screen to open the product image interface in response to the user actively closing the product image interface and the display state of the program interface being normal; controlling the secondary screen to adjust the product image interface to a preset size in response to the product image interface being minimized and the display state of the program interface being normal, or adjusting the display size of the product image interface in the secondary screen to a preset size so that the secondary screen displays the product image interface after the size adjustment; restarting the interface display program corresponding to the product image interface in response to the product image interface being unresponsive and the display state of the program interface being normal; or sending a program restart command to the secondary screen, the program restart command being used to control the secondary screen to restart the interface display program corresponding to the product image interface.

[0016] In this way, the main screen control method ensures the restoration of the product image interface by forcibly restarting it when the user actively closes it. By controlling the secondary screen to adjust to the pre-stored size, communication costs can be reduced to some extent. For scenarios where the interface is minimized, the product image interface can be precisely adjusted to the secondary screen ratio through a preset size forced restoration mechanism, thus restoring the product image interface. In case of interface program crashes, prioritizing a local restart of the interface display program can improve the recovery success rate and avoid image interruption timeout issues caused by communication delays in semiconductor testing. Through the process isolation design between the main screen program interface and the secondary screen interface display program, i.e., by controlling the secondary screen to restart the interface display program, it can be ensured that the restart operation does not affect the operation of the main screen defect identification algorithm.

[0017] In one possible implementation, the method further includes: when a new program window is launched, reading the image interface presence identifier in the shared storage area; if the image interface presence identifier is found to be valid, then the control sub-screen is no longer controlled to perform the operation of displaying the product image interface.

[0018] In this way, the presence of identifiers on the product image interface can directly and quickly determine whether the product image interface is displayed normally or has a display abnormality problem. Furthermore, when multiple instances of the semiconductor testing program are running (such as opening the testing windows of two wafers simultaneously), the valid value identifiers in the shared memory area can prevent the secondary screen from repeatedly creating product image interfaces, avoiding confusion caused by image overlap, and ensuring that the testing data of each wafer corresponds one-to-one with the product image interface displayed on the secondary screen.

[0019] In one possible implementation, the method further includes: if an invalid value is detected in the image interface, the identifier is updated to a valid value after the operation of controlling the secondary screen to display the product image interface is successfully completed.

[0020] In this way, the main screen control method updates the identifier to a valid value after successfully controlling the secondary screen to perform the operation of displaying the product image interface, ensuring that only one product image interface instance exists at any given time, thus avoiding problems such as GPU resource contention caused by repeatedly creating product image interfaces.

[0021] In one possible implementation, the method further includes: maintaining a program window counter in a shared storage area, the program window counter being used to record the number of program windows open on the main screen; incrementing the program window counter by 1 whenever a program window instance is successfully launched; and decrementing the program window counter by 1 whenever a program window instance is closed.

[0022] In this way, by maintaining a program window counter in the shared storage area and recording the number of program windows opened in real time, a precise resource monitoring and process control mechanism is built for the semiconductor testing system. Whenever a user starts a program window on the main screen, the number of program windows opened on the main screen will be updated for subsequent closing of the product image interface on the secondary screen.

[0023] In one possible implementation, the method further includes: continuously or periodically monitoring the program window counter; when the value of the counter is less than 1, controlling the secondary screen to perform the operation of closing the product image interface.

[0024] In this way, the main screen control method dynamically monitors the number of main screen program windows and controls the display status of secondary screens in conjunction with them, thereby realizing intelligent management of multi-screen device resources. Through the automatic closing mechanism triggered by window counting, the resource consumption of secondary screens in ineffective scenarios can be reduced.

[0025] In one possible implementation, the method further includes: initializing the program window counter of the shared storage area to 0 before the first program window is launched.

[0026] This ensures that the initial value of the program window counter matches the actual number of running program windows, preventing errors in subsequent program window counter counts that could affect the closing of the secondary screen product image interface.

[0027] In one possible implementation, the method further includes: in response to the shutdown of the target program, controlling the secondary screen to perform an operation to close the product image interface.

[0028] In this way, the main screen control method can ensure that the product image interface on the secondary screen is strictly bound to the application lifecycle of the main screen by actively issuing instructions when the target program is closed. When the main screen closes the target program that occupies high resources, the product image interface on the secondary screen can be closed simultaneously to achieve system-level resource release.

[0029] In one possible implementation, controlling the secondary screen to perform the operation of closing the product image interface includes: closing the interface display program corresponding to the product image interface so that the secondary screen stops displaying the product image interface; or, sending a program shutdown command to the secondary screen so that the secondary screen stops displaying the product image interface, wherein the program shutdown command is used to control the secondary screen to perform the interface display program corresponding to the operation of displaying the product image interface.

[0030] In this way, the method of directly closing the interface display program corresponding to the secondary screen from the main screen can completely release the system resources occupied by the program; or the mode of sending a shutdown command from the computing device of the secondary screen allows the secondary screen to execute the shutdown process on its own, maintaining control flexibility and system stability.

[0031] Secondly, this application provides a secondary screen control method for main and secondary screen linkage, comprising: in response to the launch of a target program on the main screen, displaying a product image interface, wherein the target program is an application used to detect a target product manufactured based on a target semiconductor process, and the product image interface is used to display product images obtained during the manufacturing process of the target product based on the target semiconductor process; in response to the display state of the product image interface being abnormal and the display state of the program interface on the main screen being normal, performing a normalization adjustment operation for the product image interface.

[0032] In this way, this application automatically displays the product image interface on the secondary screen in response to the launch of the target program on the main screen, without requiring manual operation from the user. Furthermore, displaying the program interface on the main screen and the product image interface on the secondary screen avoids the product image interface obscuring the program interface. In response to an abnormal display state of the product image interface while the program interface on the main screen is displaying normally, a restoration adjustment operation is performed on the product image interface. This ensures that even when the product image interface is displaying abnormally and the program interface on the main screen is displaying normally, the interface can still be restored to normal display, making the product... The image interface resides on the secondary screen, allowing users to view the product image interface at any time. The target program is the application used to detect the target product manufactured based on the target semiconductor process. The product image interface is used to display product images acquired during the manufacturing process of the target product based on the target semiconductor process. The main screen control method is suitable for setting process recipes or reviewing results using semiconductor testing equipment. It enables dual-screen collaboration in the semiconductor testing process, with the main screen displaying process data and the secondary screen displaying image data. This avoids forced interruptions to the production or testing process due to abnormalities in the image observation window of the secondary screen, thus improving testing efficiency.

[0033] In one possible implementation, displaying the product image interface in response to the launch of a target program on the main screen includes: displaying the product image interface in response to receiving a display instruction from the main screen; or, launching an interface display program corresponding to the product image interface in response to receiving a program launch instruction from the main screen, so as to display the product image interface on a secondary screen.

[0034] In this way, by displaying the product image interface via display commands from the main screen, pre-stored image resources can be directly retrieved and displayed in offline analysis scenarios (such as process optimization review scenarios), significantly improving response speed. Alternatively, by launching an interface display program pre-stored in the computing device of the secondary screen via a program launch command from the main screen to display the product image interface on the secondary screen, this independent process launch method ensures resource isolation between complex image display tasks and the main screen detection algorithm, reducing the GPU utilization of the defect identification algorithm related to the main screen's computing device and avoiding the computing power contention issues caused by traditional single-process operation.

[0035] In one possible implementation, the product image display interface includes: hiding the window title bar and / or window border of the product image interface; and setting the window size of the product image interface to be consistent with the work area size of the secondary screen.

[0036] In this way, the secondary screen control method can maximize the display area of ​​the product image interface by hiding the window title bar / border, and the title bar-less design significantly eliminates the risk of accidentally touching the close button, minimizing user operation interference. Setting the window size of the product image interface to be consistent with the working area size of the secondary screen can avoid pixel distortion caused by image stretching or compression.

[0037] In one possible implementation, before performing the adjustment operation to restore the product image interface to normal, the method further includes: sending a communication message to the main screen to notify the main screen that the display status of the product image interface is abnormal.

[0038] In this way, the secondary screen control method actively sends communication messages to the main screen before performing abnormal recovery, avoiding the one-sidedness of traditional single-screen monitoring. The communication messages can include the abnormal type (such as closed / minimized / unresponsive) and context data (such as resource utilization), which improves the accuracy of the main screen in judging abnormal situations.

[0039] In one possible implementation, the step of performing a restoration adjustment operation for the product image interface in response to a display anomaly and a normal display of the program interface on the main screen includes: sending a window destruction message to the main screen in response to the product image interface being closed; restoring the product image interface to its display state after receiving a restoration command from the main screen; displaying the product image interface based on a size adjustment result from the main screen in response to the product image interface being minimized and a normal display of the program interface on the main screen, or adjusting the display size of the product image interface according to a preset size in response to receiving an adjustment command from the main screen; and displaying the product image interface based on a program startup result from the main screen in response to the product image interface being unresponsive and a normal display of the program interface on the main screen, or restarting the interface display program corresponding to the product image interface in response to receiving a program restart command from the main screen.

[0040] In this way, triggering the main screen recovery command via the window destruction message can immediately resolve image interruption issues caused by accidental touches in the semiconductor production line, thus restoring the product image interface. Displaying the product image interface based on the size adjustment results sent by the main screen, this main screen-driven dynamic adaptation can largely match the user's actual display size requirements. The product image interface is restored by adjusting its display using pre-stored sizes. When the main screen detection algorithm pauses, the unresponsive state of the product image interface is temporarily suspended, and the interface is restored based on the main screen's program startup results after the main screen recovers, ensuring minimal deviation between the timestamps of semiconductor detection data (such as defect coordinates and dimensional parameters) and the secondary screen image. In case of interface program crashes, the secondary screen control method triggers automatic restart of the secondary screen via the main screen's program restart command, avoiding the time-consuming cross-screen data link reconstruction.

[0041] In one possible implementation, the method further includes: updating the image interface presence identifier based on the display state change of the product image interface; sending the updated image interface presence identifier to the main screen or writing it to a shared storage area, wherein the image interface presence identifier indicates the display state of the product image interface, and the display state includes display abnormality and display normality.

[0042] In this way, the secondary screen control method can immediately update the identifier value and write it to the shared storage area or send it to the main screen when it detects a change in the display status of the product image interface, ensuring that the main screen can obtain the latest status of the product image interface in real time, thus meeting the real-time requirements of semiconductor production lines for equipment status monitoring.

[0043] In one possible implementation, updating the image interface presence identifier based on the display status change of the product image interface includes: maintaining a product image interface presence identifier in a shared storage area; if the product image interface displays normally, setting the image interface presence identifier to a valid value; if the product image interface displays abnormally, setting the image interface presence identifier to an invalid value.

[0044] In this way, the secondary screen control method distinguishes between normal and abnormal display of the product image interface by valid and invalid values, and updates the image interface presence flag based on the display status changes of the product image interface in the secondary screen, ensuring that the main screen can obtain the latest status of the product image interface in real time.

[0045] In one possible implementation, the method further includes: monitoring a program window counter in a shared storage area; and when the value of the program window counter is less than 1, performing an operation to close the product image interface.

[0046] In this way, autonomous decision-making is achieved by directly monitoring the program window counter in the shared storage area through the secondary screen. Compared with the main screen control mode, it shows better distributed collaboration efficiency. The display / closing control logic of the product image interface is pushed down to the secondary screen device, and the state is synchronized through the shared storage area, forming a decentralized multi-screen linkage architecture. This can significantly reduce the load on the main screen. At the same time, distributed decision-making reduces the risk of single point of failure. Even if the main screen is temporarily unresponsive, the secondary screen can still execute the display strategy based on the latest program window counter value.

[0047] In one possible implementation, the method further includes: in response to receiving a program close command from the main screen, closing the interface display program corresponding to the product image interface.

[0048] In this way, precise control of the product image interface can be achieved by responding to the main screen's program closing command through the secondary screen. The program closing command issued directly by the main screen carries a clear operation intention, which is more suitable for multi-account login scenarios. When the main screen closes a specific program, the secondary screen can close the product image interface through the program closing command. This is more in line with actual business logic than simply relying on the number of windows.

[0049] Thirdly, this application provides a main screen control device for main and secondary screen linkage, comprising: a first display module, configured to, in response to the launch of a target program on the main screen, display the program interface corresponding to the target program, and control the secondary screen to perform the operation of displaying a product image interface, wherein the target program is an application used to detect a target product manufactured based on a target semiconductor process, and the product image interface is used to display product images obtained during the manufacturing process of the target product based on the target semiconductor process; and a first adjustment module, configured to, in response to determining that the display state of the product image interface on the secondary screen is abnormal and the display state of the program interface is normal, perform adjustments to restore the product image interface to normal.

[0050] In one possible implementation, the device further includes a secondary screen determination module, which is used to: call the hardware query application programming interface provided by the operating system to enumerate all displays connected to the computing device; and determine the secondary screen for displaying the product image interface based on the enumeration results.

[0051] In one possible implementation, the secondary screen determination module includes a secondary screen selection submodule, which is used to determine the first detected display screen other than the main screen based on the enumeration result; and to determine the first detected display screen as the secondary screen for displaying the product image interface.

[0052] In one possible implementation, the first display module includes a first interface display submodule, which is used to: call the window management application programming interface of the operating system to create the product image interface on the secondary screen; and control the secondary screen to perform the operation of displaying the product image interface through the window management application programming interface.

[0053] In one possible implementation, the first adjustment module includes a monitoring submodule, which is configured to: monitor a communication message sent by the secondary screen that indicates an abnormal display of the product image interface; and determine, based on the monitored communication message, that the display state of the product image interface is abnormal.

[0054] In one possible implementation, the first adjustment module further includes a first abnormal adjustment submodule, which is configured to: in response to the user actively closing the product image interface and the program interface being displayed normally, control the secondary screen to open the product image interface; in response to the product image interface being minimized and the program interface being displayed normally, control the secondary screen to adjust the product image interface to a preset size, or adjust the display size of the product image interface in the secondary screen to a preset size so that the secondary screen displays the product image interface after size adjustment; in response to the product image interface being unresponsive and the program interface being displayed normally, restart the interface display program corresponding to the product image interface; or send a program restart command to the secondary screen, the program restart command being used to control the secondary screen to restart the interface display program corresponding to the product image interface.

[0055] In one possible implementation, the device further includes a first control module, which is configured to: when a new program window is started, read the image interface presence identifier in the shared storage area; if the image interface presence identifier is found to be valid, then stop controlling the secondary screen to perform the operation of displaying the product image interface.

[0056] In one possible implementation, the device further includes a first update module, which is configured to: if an invalid value is read from the image interface, update the identifier to a valid value after successfully controlling the secondary screen to perform the operation of displaying the product image interface.

[0057] In one possible implementation, the device further includes a counting control module, which is configured to: maintain a program window counter in a shared storage area, the program window counter being used to record the number of program windows open on the main screen; increment the program window counter by 1 whenever a program window instance is successfully launched; and decrement the program window counter by 1 whenever a program window instance is closed.

[0058] In one possible implementation, the device further includes a second control module, which is configured to: continuously or periodically monitor the program window counter; and when the value of the counter is less than 1, control the secondary screen to perform the operation of closing the product image interface.

[0059] In one possible implementation, the apparatus further includes an initialization module configured to: initialize the program window counter of the shared storage area to 0 before the first program window is started.

[0060] In one possible implementation, the device further includes a third control module, which is configured to: control the secondary screen to perform an operation to close the product image interface in response to the closing of the target program.

[0061] In one possible implementation, the second control module further includes an interface shutdown submodule, which is used to: shut down the interface display program corresponding to the product image interface so that the secondary screen stops displaying the product image interface; or, send a program shutdown command to the secondary screen so that the secondary screen stops displaying the product image interface, wherein the program shutdown command is used to control the secondary screen to execute the interface display program corresponding to the operation of displaying the product image interface.

[0062] Fourthly, this application provides a secondary screen control device for main and secondary screen linkage, comprising: a second display module, used to display a product image interface in response to the launch of a target program on the main screen, wherein the target program is an application used to detect a target product manufactured based on a target semiconductor process, and the product image interface is used to display product images obtained during the manufacturing process of the target product based on the target semiconductor process; and a second adjustment module, used to perform a normalization adjustment operation on the product image interface in response to the display state of the product image interface being abnormal and the display state of the program interface on the main screen being normal.

[0063] In one possible implementation, the second display module includes a second interface display submodule, which is configured to: display the product image interface in response to receiving a display instruction from the main screen; or, start the interface display program corresponding to the product image interface in response to receiving a program start instruction from the main screen, so as to display the product image interface on the secondary screen.

[0064] In one possible implementation, the second display module includes an interface display settings submodule, which is used to: hide the window title bar and / or window border of the product image interface; and set the window size of the product image interface to be consistent with the working area size of the secondary screen.

[0065] In one possible implementation, the device further includes a communication module, which is configured to send a communication message to the main screen to notify the main screen that the display status of the product image interface is abnormal.

[0066] In one possible implementation, the second adjustment module includes a second abnormal adjustment submodule, which is configured to: in response to the product image interface being closed, send a window destruction message to the main screen; after receiving a restore command from the main screen, restore the product image interface to its display state; in response to the product image interface being minimized and the program interface on the main screen being displayed normally, display the product image interface based on the size adjustment result from the main screen, or, in response to receiving an adjustment command from the main screen, adjust the display size of the product image interface according to a preset size; in response to the product image interface being unresponsive and the program interface on the main screen being displayed normally, display the product image interface based on the program startup result from the main screen, or, in response to receiving a program restart command from the main screen, restart the interface display program corresponding to the product image interface.

[0067] In one possible implementation, the device further includes a second update module, which is configured to: update the image interface presence identifier based on the display state change of the product image interface; send the updated image interface presence identifier to the main screen or write it to a shared storage area, wherein the image interface presence identifier indicates the display state of the product image interface, and the display state includes display abnormality and display normality.

[0068] In one possible implementation, the second update module includes an identifier setting submodule, which is configured to: maintain a product image interface presence identifier in a shared storage area; if the product image interface displays normally, set the image interface presence identifier to a valid value; if the product image interface displays abnormally, set the image interface presence identifier to an invalid value.

[0069] In one possible implementation, the device further includes a monitoring execution module, which is used to: monitor a program window counter in a shared storage area; and when the value of the program window counter is less than 1, perform an operation to close the product image interface.

[0070] In one possible implementation, the device further includes a shutdown module, which is configured to: in response to receiving a program shutdown command from the main screen, shut down the interface display program corresponding to the product image interface.

[0071] Fifthly, this application provides a computing device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the aforementioned main screen control method and / or the aforementioned secondary screen control method.

[0072] Sixthly, this application provides a main and secondary screen linkage system, including: a main screen for displaying a corresponding program interface; a secondary screen for displaying a product image interface; and a computing device connected to the main screen and the secondary screen respectively, for executing the main screen control method and / or the secondary screen control method. Attached Figure Description

[0073] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0074] Figure 1 This is a schematic diagram of the main and secondary screen control method in related technologies;

[0075] Figure 2 A system architecture diagram of a main and secondary screen linkage system provided in an embodiment of this application;

[0076] Figure 3 A flowchart of the main screen control method provided in the embodiments of this application;

[0077] Figure 4 A flowchart of the secondary screen control method provided in the embodiments of this application;

[0078] Figure 5 A system architecture diagram of another main and secondary screen linkage system provided in this application embodiment;

[0079] Figure 6 A schematic diagram of a computing device provided in an embodiment of this application;

[0080] Figure 7 A schematic diagram of another computing device provided in an embodiment of this application. Detailed Implementation

[0081] Various exemplary embodiments, features, and aspects of this application will now be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings denote elements that have the same or similar functions. Although various aspects of the embodiments are shown in the drawings, they are not necessarily drawn to scale unless specifically indicated otherwise.

[0082] As used herein, the terms “comprising,” “including,” “having,” or variations thereof are open-ended and include one or more of the stated features, integrals, elements, steps, components, or functions, but do not exclude the presence or addition of one or more other features, integrals, elements, steps, components, functions, or groups thereof.

[0083] When an element is referred to as “connected,” “coupled,” “responding,” or a variation thereof relative to another element, it may be directly connected, coupled, or responding to another element, or there may be an intermediate element present.

[0084] Although the terms first, second, third, etc., may be used herein to describe various elements / operations, these elements / operations should not be limited by these terms. These terms are only used to distinguish one element / operation from another. Therefore, without departing from the teachings of this application, a first element / operation in some embodiments may be referred to as a second element / operation in other embodiments.

[0085] The term “exemplary” as used herein means “serving as an example, embodiment, or illustration.” Any embodiment illustrated herein as “exemplary” is not necessarily to be construed as superior to or better than other embodiments.

[0086] Furthermore, to better illustrate this application, numerous specific details are provided in the following detailed embodiments. Those skilled in the art should understand that this application can be implemented without certain specific details. In some instances, methods, means, components, and circuits well-known to those skilled in the art have not been described in detail in order to highlight the main points of this application.

[0087] The main-sub-screen linkage control method can be applied to semiconductor processing and inspection scenarios. This method can be used in a main-sub-screen linkage system. This system can be used for semiconductor inspection, such as wafer defect detection, mask defect detection, wafer alignment, wafer layout, scanning of the area of ​​interest, or result review. The system includes a main screen, a sub-screen, and a computing device. The main screen displays the corresponding program interface. The sub-screen displays the product image interface. The computing device is connected to both the main and sub-screens. It executes the main screen control method and / or the sub-screen control method. The computing device has an operating system installed for user operation.

[0088] In precision equipment used for semiconductor wafer inspection, measurement, and processing, the host computer software on the main screen is a core tool for engineers to perform process recipe setup or result review. For example... Figure 1 As shown, engineers perform interactive inspection operations through the program interface displayed on the main screen, such as precisely locating marked patterns, observing defect morphology, or performing feature measurements. To this end, the host computer software provides a separate image viewing window and displays it on the secondary screen, such as... Figure 1As shown. When engineers use the existing main-sub-screen linkage system for semiconductor testing, if an anomaly occurs in the image observation window of the sub-screen, they need to manually identify the problem and restart the window. This will force the production or testing process to be interrupted, reducing testing efficiency. Therefore, in order to solve the above problems, this application provides a main-sub-screen linkage control method.

[0089] The embodiments of this application are as follows: Figure 2 The illustrated main and secondary screen linkage system architecture explains the main and secondary screen control methods. For example... Figure 2 As shown, the main-secondary screen linkage system includes a main screen, a secondary screen, computing device b, and computing device c. The system uses computing device b to execute the main screen control method to control the main screen's program interface, and uses computing device c to execute the secondary screen control method to control the secondary screen's product image interface. Computing device b and computing device c can communicate with each other. It is understood that computing device b and computing device c can be the same device or different devices. For better understanding, the following will... Figure 2 In the diagram, computing device b is called the main screen's computing device, and computing device c is called the secondary screen's computing device.

[0090] like Figure 3 As shown, the main screen control method provided in this application embodiment may include the following steps S101 to S102.

[0091] In step S101, in response to the launch of the target program on the main screen, the program interface corresponding to the target program is displayed, and the secondary screen is controlled to perform the operation of displaying the product image interface.

[0092] In step S102, in response to determining that the display status of the product image interface in the sub-screen is abnormal and the display status of the program interface is normal, adjustments are made to restore the product image interface to normal.

[0093] When the product image interface is displayed in an abnormal state, it may be because the product image interface is minimized, or it may be due to a malfunction in the interface display program or a secondary screen, preventing the secondary screen from displaying the product image interface correctly. This means the user cannot directly access the product image through the secondary screen. Types of display abnormalities include window minimization, window obstruction, and window closure.

[0094] The program interface is displayed normally, which means that the program interface on the main screen is not closed. Not closed includes situations where the program interface is minimized or moved to another display screen.

[0095] To restore the product image interface to normal if the window is minimized, you can maximize the product image interface. To restore the product image interface to normal if the window is obstructed, you can display the product image interface on top. To restore the product image interface to normal if the window is closed, you can reopen the product image interface and display it on the secondary screen.

[0096] To address the aforementioned technical problems, this embodiment of the application displays the program interface corresponding to the target program in response to the startup of the target program on the main screen, and controls the secondary screen to display the product image interface. This eliminates the need for manual operation by the user to display the product image interface. Simultaneously displaying the program interface on the main screen and the product image interface on the secondary screen avoids the product image interface obscuring the program interface. In response to determining that the display status of the product image interface on the secondary screen is abnormal while the display status of the program interface is normal, adjustments are made to restore the product image interface to normal. This ensures that even when the product image interface displays abnormally, it can still be restored to normal display, allowing the product image interface to remain permanently on the secondary screen for convenient user viewing. The target program is an application used to detect target products manufactured based on the target semiconductor process. The product image interface displays product images obtained during the manufacturing process of the target product based on the target semiconductor process. The main screen control method is applicable to the process of setting process recipes or reviewing results using semiconductor testing equipment. It enables dual-screen collaboration in the semiconductor testing process, with the main screen displaying process data and the secondary screen displaying image data. This avoids forced interruptions to the production or testing process due to abnormalities in the image observation window of the secondary screen, thus improving testing efficiency.

[0097] like Figure 7 As shown, the secondary screen control method provided in this application embodiment may include the following steps S201 to S202.

[0098] In step S201, in response to the launch of the target program on the main screen, the product image interface is displayed.

[0099] In step S202, in response to the product image interface being in an abnormal display state and the program interface on the main screen being in a normal display state, an adjustment operation to restore the product image interface to normal is performed.

[0100] To address the aforementioned technical problems, this application embodiment displays a product image interface on a secondary screen in response to the launch of a target program on the main screen. This automatic display of the product image interface on the secondary screen eliminates the need for manual user intervention. Furthermore, displaying the program interface on the main screen and the product image interface on the secondary screen avoids the product image interface obscuring the program interface. In response to an abnormal display state of the product image interface while the program interface on the main screen is displayed normally, a restoration adjustment operation is performed on the product image interface. This ensures that even when the product image interface displays abnormally and the program interface on the main screen is displayed normally, the interface can still be restored to normal. The display keeps the product image interface permanently on the secondary screen, allowing users to view it at any time. The target program is the application used to detect the target product manufactured based on the target semiconductor process. The product image interface is used to display product images acquired during the manufacturing process of the target product based on the target semiconductor process. The main screen control method is suitable for setting process recipes or reviewing results using semiconductor testing equipment. It enables dual-screen collaboration in the semiconductor testing process, with the main screen displaying process data and the secondary screen displaying image data. This avoids forced interruptions to the production or testing process due to abnormalities in the image observation window of the secondary screen, thus improving testing efficiency.

[0101] The target program is an application used to detect a target product manufactured based on a target semiconductor process. The target semiconductor process can be a manufacturing flow within a semiconductor process that the user is interested in, such as defect detection; this application does not limit this. The target product can be a wafer or a photomask. Specifically, a suitable application can be selected as the target program based on the actual situation; this application does not limit this. In some embodiments, the launch of the target program may depend on the login result of the target program. For example, if the computing device on the main screen detects that the login information entered by the user meets the login conditions, it determines that the login result of the target program is successful, and then the computing device on the main screen launches the target program. In other embodiments, the launch of the target program can be achieved by checking whether the log contains information indicating successful launch.

[0102] The computing device on the main screen responds to the launch of the target program on the main screen, controlling the main screen to display the corresponding program interface. The computing device on the secondary screen responds to the launch of the target program on the main screen, controlling the secondary screen to display the product image interface. The product image interface can be used to display product images acquired during the manufacturing process of the target product based on the target semiconductor process. For example, the product image interface can be used to display wafer images or mask images acquired in real time by an image acquisition device, which can be a camera. In this way, in response to the launch of the target program, the program interface and the product image interface can be automatically displayed on two separate displays, with an automatic pop-up function for the product image interface. This eliminates the need for manual user operation to display the product image interface, significantly improving ease of operation and efficiency, while also avoiding the problem of mutual obstruction between the product image interface and the program interface on the same display screen.

[0103] The display status of the product image interface can be either abnormal or normal. When the product image interface is in a normal display status, the user can directly access the product image through the secondary screen. When the product image interface is in a abnormal display status, it may be because the product image interface is minimized, or there may be a problem with the interface display program or the secondary screen itself, preventing the secondary screen from displaying the product image interface correctly, thus preventing the user from directly accessing the product image through the secondary screen.

[0104] To resolve issues with abnormal product image interface display, the main screen's computing device can, in response to determining that the product image interface on the secondary screen is displaying abnormally while the program interface is displaying normally, perform adjustments to restore the product image interface to normal. Similarly, the secondary screen's computing device can, in response to the same situation, execute adjustments to restore the product image interface to normal. This ensures that even when the product image interface is displaying abnormally and the program interface on the main screen is displaying normally, the interface can still be restored to normal display, allowing the product image interface to remain on the secondary screen for convenient user access.

[0105] To control the secondary screen to display product images, the computing device on the main screen can call the operating system's window management application programming interface (API) to create the product image interface within the display coordinate system of the secondary screen. Then, through the window management API, the main screen can control the secondary screen to display the product image interface. This main screen control method uses the operating system's native API for interface control, eliminating the compatibility dependency of third-party multi-screen management software. In the common Windows / Linux hybrid deployment environment of semiconductor manufacturing lines, the success rate of product image interface creation can be improved. Specifically, Windows operating systems can call application programming interfaces (such as Win32 API) to create product image interfaces within the display coordinate system of the secondary screen; macOS operating systems can call application programming interfaces (such as Cocoa (AppKit)); and Linux operating systems can call application programming interfaces (such as Xlib / XCB or Wayland).

[0106] The main screen's computing device can display the product image interface by sending display commands or program start commands to the secondary screen's computing device. For example, the main screen's computing device can first search for the secondary screen's computing device using the Simple Service Discovery Protocol (SSDP), and then send display commands using the Simple Object Access Protocol (SOAP). The secondary screen's computing device can respond to the received display commands from the main screen by displaying the product image interface. In this way, the secondary screen control method displays the product image interface via display commands from the main screen, enabling direct retrieval of pre-stored image resources for display in offline analysis scenarios (such as process optimization review scenarios), significantly improving response speed. Alternatively, the secondary screen's computing device can respond to a program startup command received from the main screen by launching the interface display program corresponding to the product image interface to display the product image interface on the secondary screen. In this way, the secondary screen control method launches the interface display program pre-stored in the secondary screen's computing device through the program startup command from the main screen to display the product image interface on the secondary screen. This independent process startup method can ensure resource isolation between complex image display tasks and the main screen detection algorithm, reduce the GPU usage of the defect identification algorithm related to the main screen's computing device, and avoid the computing power contention problem caused by traditional single-process operation.

[0107] To better display the product image interface, the secondary screen's computing device can hide the product image interface's window title bar and / or window border; the window size of the product image interface is set to match the working area size of the secondary screen, which refers to the screen area that the secondary screen can display. In this way, the secondary screen control method, by hiding the window title bar / border, maximizes the display area of ​​the product image interface, and the title bar-less design significantly eliminates the risk of accidental close button activation, minimizing user operation interference. Setting the product image interface's window size to match the secondary screen's working area size avoids pixel distortion caused by image stretching or compression.

[0108] To better address product image interface display anomalies, both the main screen's computing device and the secondary screen's computing device need to be aware of whether the product image interface is displaying abnormally. To this end, the secondary screen's computing device can send a communication message to the corresponding main screen's computing device before performing any adjustments to restore the product image interface to normal, notifying the main screen that the product image interface is displaying abnormally. When the secondary screen's computing device needs to send a communication message, it can trigger a specific event to transmit data to the main screen's computing device. For example, the secondary screen's computing device encapsulates the content of the communication message, which may include the anomaly type (e.g., window closed / minimized / obscured) and contextual data (e.g., resource utilization). In this way, the secondary screen control method proactively sends a communication message to the main screen before performing anomaly recovery, avoiding the limitations of traditional single-screen monitoring. The communication message can include the anomaly type (e.g., window closed / minimized / obscured) and contextual data (e.g., resource utilization), improving the accuracy of the main screen's anomaly detection. The main screen's computing device can listen to communication messages sent by the secondary screen's computing device that indicate an anomaly in the product image interface's display. Based on these listened-to communication messages, it can determine that the product image interface's display state is abnormal. For example, in development, the main screen's computing program uses a Broadcast Channel API to listen for communication messages sent by the secondary screen's computing device. When the secondary screen calls the `postMessage` method, the main screen's computing device receives an event object containing the method name and parameters—the communication message—in real time. In this way, the main screen's control method actively listens for abnormal communication messages sent by the secondary screen to determine the display state, improving the real-time performance of anomaly detection. Furthermore, by determining whether the product image interface's display state is abnormal based on the communication messages, the accuracy of anomaly judgment is enhanced.

[0109] After both the main and secondary computing devices become aware of a display anomaly in the product image interface, to better facilitate the restoration of the interface, the secondary computing device can send a window destruction message to the main computing device in response to the product image interface being closed. For example, the secondary computing device can communicate across devices with the main computing device via the TCP / IP protocol suite. The secondary computing device can establish a persistent connection and transmit the window destruction message in JSON format. The transmitted content may include a secondary screen identifier and an identifier indicating that the product image interface has been closed. The main computing device can receive the window destruction message in real time through an event handler that receives messages / data. Upon receiving a restoration command from the main screen, it restores the product image interface to its display state. Thus, the secondary screen control method triggers the main screen restoration command through the window destruction message, immediately resolving image interruption issues caused by accidental touches in the semiconductor production line and restoring the product image interface. The main screen's computing device can respond to the user actively closing the product image interface while the program interface is displayed normally, and control the secondary screen to open the product image interface. In this way, the main screen control method ensures the restoration of the product image interface by detecting that the user actively closes it through a forced restart mechanism.

[0110] The secondary screen's computing device can respond to the product image interface being minimized and the program interface on the main screen being displayed normally. Then, it can display the product image interface based on the size adjustment result from the main screen. In this way, the secondary screen control method displays the product image interface through the size adjustment result sent by the main screen. This dynamic adaptation driven by the main screen can largely match the user's actual display size requirements. Alternatively, the secondary screen's computing device can respond to receiving adjustment instructions from the main screen and adjust the display size of the product image interface according to a preset size. In this way, the secondary screen control method can adjust the display of the product image interface through its own pre-stored size to restore the product image interface. The main screen's computing device can respond to the minimization of the product image interface and the normal display status of the program interface by controlling the secondary screen to adjust the product image interface to a preset size. In this way, the main screen control method can reduce communication costs to a certain extent by controlling the secondary screen to adjust itself to the preset size. Alternatively, the main screen's computing device can adjust the display size of the product image interface in the secondary screen to the preset size so that the secondary screen displays the product image interface after the size adjustment. In this way, for scenarios where the interface is minimized, the main screen control method can use a preset size forced recovery mechanism to accurately adjust the product image interface to the secondary screen, such as to 100% size, thereby restoring the product image interface.

[0111] The secondary screen's computing device can respond to a situation where the product image interface is unresponsive while the main screen's program interface is displaying normally. It can then display the product image interface based on the program startup result from the main screen. In this way, the secondary screen control method temporarily suspends processing of the unresponsive product image interface when the main screen's detection algorithm pauses, and resumes the product image interface based on the main screen's program startup result after the main screen recovers. This ensures that the timestamp deviation between semiconductor detection data (such as defect coordinates and dimensional parameters) and the secondary screen image is minimal. Alternatively, the secondary screen's computing device can respond to a program restart command from the main screen and restart the interface display program corresponding to the product image interface. In this way, in the event of an interface program crash, the secondary screen control method triggers an automatic restart of the secondary screen via the main screen's program restart command, avoiding the time-consuming cross-screen data link reconstruction. The main screen's computing device can respond to a situation where the product image interface is unresponsive but the program interface is displayed normally by restarting the interface display program corresponding to the product image interface. In this way, the main screen control method can improve the recovery success rate by prioritizing a local restart of the interface display program in the event of an interface program crash, thus avoiding image interruption timeout issues caused by communication delays in semiconductor testing. Alternatively, the main screen's computing device can send a program restart command to the computing device of the secondary screen. The program restart command is used to control the secondary screen to restart the interface display program corresponding to the product image interface. In this way, the main screen control method, through the process isolation design between the main screen program interface and the secondary screen interface display program, ensures that the restart operation does not affect the operation of the main screen defect identification algorithm by controlling the secondary screen to restart the interface display program.

[0112] To enable the computing devices on both the main and secondary screens to more easily determine the display status of the product image interface, the secondary screen's computing device can update the image interface presence flag based on changes in the display status (display status includes abnormal and normal display, and the change can be from abnormal to normal or vice versa). The image interface presence flag indicates the display status of the product image interface. A valid value indicates that the product image interface is displaying normally, where a valid value is a clear, correctly parsed, and responsive value. A valid value can be set to a predefined, clear positive value. Normal state values ​​include boolean values ​​like true or the number 1. Invalid values ​​have the opposite meaning to valid values; they can be set to false, 0, or even null. When the image interface presence flag is set to an invalid value, it indicates an abnormal display of the product image interface. For example, if the secondary screen's computing device detects a change in the product image interface from normal to abnormal display, it can update the image interface presence flag from its valid value to an invalid value. The updated flag is then sent to the primary screen's computing device or written to the shared storage area. The image interface presence flag indicates the display status of the product image interface, which includes both abnormal and normal display. In this way, the secondary screen control method can immediately update the flag value and write it to the shared storage area or send it to the primary screen when a change in the product image interface's display status is detected, ensuring that the primary screen can obtain the latest status of the product image interface in real time, meeting the real-time monitoring requirements of semiconductor production lines.

[0113] The secondary screen's computing device can pre-maintain a product image interface presence identifier in the shared storage area. The shared storage area provides a shared data interaction space for the secondary screen's computing device and / or the host's computing device. This shared storage area can be used to store the product image interface presence identifier for both the main and secondary screens to read. Considering that the secondary screen's computing device and the host's computing device are two independent computing devices, network storage can be built via a local area network. Common forms include, but are not limited to, shared hard drives (e.g., setting one device's local hard drive as a network shared directory) and dedicated network storage devices (e.g., enterprise-level server hard drives). If the product image interface displays normally... The secondary screen's computing device first reads the image interface presence flag from the shared storage area. If the product image interface displays abnormally, this indicates that the image interface presence flag needs to be set to an invalid value. The secondary screen's computing device then performs a write operation on the image interface presence flag in the shared storage area, setting its value to an invalid value, such as 0. The set invalid value is then saved in the shared storage area. The process of setting a valid value is similar to that of setting an invalid value, and for simplicity, it will not be elaborated further here. In this way, the secondary screen control method distinguishes between normal and abnormal product image interface displays using valid and invalid values, and updates the image interface presence flag based on changes in the display status of the product image interface on the secondary screen, ensuring that the main screen can obtain the latest status of the product image interface in real time.

[0114] When a new program window is launched, the main screen's computing device reads the image interface presence flag from the shared memory area. If the image interface presence flag is found to be valid, the main screen will no longer control the secondary screen to display the product image interface. In this way, the product image interface presence flag can directly and quickly determine whether the product image interface is displaying correctly or has a display problem. Furthermore, when multiple instances of the semiconductor testing program are running (e.g., simultaneously opening testing windows for two wafers), the valid value flag in the shared memory area can prevent the secondary screen from repeatedly creating product image interfaces, avoiding confusion caused by image overlap and ensuring a one-to-one correspondence between the testing data of each wafer and the product image interface displayed on the secondary screen.

[0115] If the main screen's computing device detects an invalid value for the image interface, it can update the flag to a valid value after successfully controlling the secondary screen to display the product image interface. Specifically, the main screen's computing device can write to the image interface flag in the shared storage area, setting its value to a valid value, such as 1, and then save the set valid value in the shared storage area, thus updating the flag to a valid value. In this way, the main screen control method ensures that only one instance of the product image interface exists at any given time by updating the flag to a valid value after successfully controlling the secondary screen to display the product image interface, avoiding GPU resource contention caused by duplicate creation of the product image interface.

[0116] To better track the number of running program window instances (i.e., a specific window created by a running target program on the main screen), the main screen's computing device can maintain a program window counter in the shared storage area. This counter records the number of open program windows on the main screen (denoted as appNum). Whenever a program window instance successfully starts, the program window counter is incremented by 1, i.e., appNum is incremented by 1; whenever a program window instance closes, the program window counter is decremented by 1, i.e., appNum is decremented by 1. This method of maintaining a program window counter in the shared storage area and recording the number of open program windows in real-time provides a precise resource monitoring and process control mechanism for the semiconductor testing system. Whenever a user starts a program window on the main screen, the number of open program windows on the main screen is updated for subsequent closing of the secondary screen's product image interface.

[0117] Before the first program window is launched, the computing device on the main screen can initialize the program window counter in the shared storage area to 0. This ensures that the initial value of the program window counter matches the actual number of running program windows, avoiding errors in the counting of subsequent program window counters and affecting the closing of the image interface of the subsequent secondary screen products.

[0118] The main screen's computing device can continuously or periodically monitor the program window counter to monitor the number of running program window instances in real time. For example, the main screen's computing device can read the value of the program window counter in the shared storage area every 2 seconds, such as 8, thus determining that the number of running program window instances is 8. When the monitored counter value is less than 1, the device controls the secondary screen to close the product image interface. In this way, the main screen control method achieves intelligent management of multi-screen device resources by dynamically monitoring the number of program windows on the main screen and controlling the display status of the secondary screen accordingly. The automatic closing mechanism triggered by window counting reduces resource consumption of the secondary screen in ineffective scenarios. The secondary screen's computing device can monitor the program window counter in the shared storage area; for example, the secondary screen's computing device can periodically read the value of the program window counter in the shared storage area. When the monitored program window counter value is less than 1, the device executes the operation to close the product image interface. In this way, autonomous decision-making is achieved by directly monitoring the program window counter in the shared storage area through the secondary screen. Compared with the main screen control mode, it shows better distributed collaboration efficiency. The display / closing control logic of the product image interface is pushed down to the secondary screen device, and the state is synchronized through the shared storage area, forming a decentralized multi-screen linkage architecture. This can significantly reduce the load on the main screen. At the same time, distributed decision-making reduces the risk of single point of failure. Even if the main screen is temporarily unresponsive, the secondary screen can still execute the display strategy based on the latest program window counter value.

[0119] In addition to automatically closing the product image interface by controlling the number of running program window instances, the secondary screen's computing device can also respond to program close commands received from the primary screen, closing the corresponding interface display program. This allows for precise control of the product image interface through the secondary screen responding to program close commands from the primary screen. The program close commands issued directly from the primary screen carry clear operational intent, making it more suitable for multi-account login scenarios. When the primary screen closes a specific program, the secondary screen can close the product image interface via a program close command, which aligns better with actual business logic than simply relying on the number of windows.

[0120] Furthermore, the computing device on the secondary screen can also close the product image interface when the target program is closed. The computing device on the primary screen can respond to the closure of the target program and control the secondary screen to close the product image interface. In this way, the primary screen control method, by proactively issuing commands when the target program is closed, ensures that the product image interface on the secondary screen is strictly bound to the application lifecycle on the primary screen. When the primary screen closes a resource-intensive target program, simultaneously closing the product image interface on the secondary screen achieves system-level resource release.

[0121] To control the secondary screen to close the product image interface, the main screen's computing device can close the interface display program corresponding to the product image interface, causing the secondary screen to stop displaying the product image interface. This method, where the main screen directly closes the interface display program corresponding to the secondary screen, completely releases the system resources occupied by the program. Alternatively, the main screen's computing device can send a program shutdown command to the computing device of the secondary screen corresponding to the product image interface, causing the secondary screen to stop displaying the product image interface. The program shutdown command controls the secondary screen to execute the interface display program corresponding to the operation of displaying the product image interface. This mode of sending shutdown commands to the computing device of the secondary screen corresponding to the product image interface allows the secondary screen to execute the shutdown process automatically, maintaining control flexibility and system stability.

[0122] Considering that a main-secondary screen linkage system may have more than one display connected to the system besides the main screen, the computing device of the main screen can call the hardware query application programming interface provided by the operating system to enumerate all the display screens connected to the computing device before controlling the secondary screen to display the product image interface. Based on the enumeration results, the secondary screen to display the product image interface is determined. In this way, when the system connects to multiple external display screens, the main computing device can automatically identify all available display resources by calling the operating system's hardware query API, reducing the manual configuration steps for users in a multi-screen environment, avoiding operational errors or connection omissions that may be caused by manual selection, and significantly improving the user experience in multi-screen collaboration scenarios.

[0123] Specifically, the computing device of the main screen can determine the first detected display screen other than the main screen based on the enumeration results; the first detected display screen is then designated as the secondary screen for displaying the product image interface. By setting the first detected display screen in the enumeration results as the secondary screen, the plug-and-play capability of the multi-screen system is achieved through a standardized enumeration order. This automatic selection mechanism based on hardware discovery order eliminates the need for users to manually configure the display output target, reducing manual configuration steps in a multi-screen environment, making it particularly suitable for rapid deployment scenarios.

[0124] This application also provides a main-sub-screen linkage system. This system can achieve main-sub-screen control through a main screen control method and a sub-screen control method, thereby improving semiconductor testing. The main-sub-screen linkage system may include a main screen, a sub-screen, and a computing device. The main screen can be used to display the corresponding program interface. The sub-screen can be used to display the product image interface. The computing device is connected to both the main screen and the sub-screen. The computing device can be used to execute the main screen control method and / or the sub-screen control method.

[0125] The computing device is equipped with an operating system for user operation. This application does not specifically limit the operating system running on the computing device; a suitable operating system, such as Windows or Linux, can be selected based on the actual situation.

[0126] The number of computing devices can be one; that is, the computing device executing the main screen control method and the computing device executing the secondary screen control method can be the same. For example... Figure 5 As shown, the main and secondary screen linkage system can use computing device a to execute the main screen control method to control the main screen display program interface, and can also use computing device a to execute the secondary screen control method to control the secondary screen display product image interface. For example, as... Figure 6 As shown, computing device a may include processor 1c, processor 1d, and memory 1e. Memory 1e stores a main screen computer program that can run on processor 1c and a secondary screen computer program that can run on processor 1d. Processor 1c can be used to implement a main screen control method when executing the main screen computer program. Processor 1d can be used to implement a secondary screen control method when executing the secondary screen computer program.

[0127] Alternatively, there can be two computing devices; that is, the computing device executing the main screen control method and the computing device executing the secondary screen control method are not the same. For example... Figure 4 As shown, the main and secondary screen linkage system can use computing device b to execute the main screen control method to control the main screen display program interface, and use computing device c to execute the secondary screen control method to control the secondary screen display product image interface. Computing device b and computing device c can communicate with each other. For example, as... Figure 7 As shown, computing device b may include processor 1f and memory 1h. Memory 1f stores a main screen computer program that can run on processor 1f. Processor 1f can be used to implement a main screen control method when executing the main screen computer program. The structure of computing device c is similar to that of computing device b, and will not be described further here.

[0128] This application embodiment also provides a main screen control device for main and secondary screen linkage, including: a first display module, used to display the program interface corresponding to the target program in response to the launch of the target program on the main screen, and control the secondary screen to perform the operation of displaying a product image interface, wherein the target program is an application used to detect a target product manufactured based on a target semiconductor process, and the product image interface is used to display product images obtained during the manufacturing process of the target product based on the target semiconductor process; and a first adjustment module, used to perform adjustments to restore the product image interface to normal in response to determining that the display state of the product image interface on the secondary screen is abnormal and the display state of the program interface is normal.

[0129] In one possible implementation, the device further includes a secondary screen determination module, which is used to: call the hardware query application programming interface provided by the operating system to enumerate all displays connected to the computing device; and determine the secondary screen for displaying the product image interface based on the enumeration results.

[0130] In one possible implementation, the secondary screen determination module includes a secondary screen selection submodule, which is used to: determine the first detected display screen other than the main screen based on the enumeration result; and determine the first detected display screen as the secondary screen for displaying the product image interface.

[0131] In one possible implementation, the first display module includes a first interface display submodule, which is used to: call the window management application programming interface of the operating system to create the product image interface on the secondary screen; and control the secondary screen to perform the operation of displaying the product image interface through the window management application programming interface.

[0132] In one possible implementation, the first adjustment module includes a monitoring submodule, which is configured to: monitor a communication message sent by the secondary screen that indicates an abnormal display of the product image interface; and determine, based on the monitored communication message, that the display state of the product image interface is abnormal.

[0133] In one possible implementation, the first adjustment module further includes a first abnormal adjustment submodule, which is configured to: in response to the user actively closing the product image interface and the program interface being displayed normally, control the secondary screen to open the product image interface; in response to the product image interface being minimized and the program interface being displayed normally, control the secondary screen to adjust the product image interface to a preset size, or adjust the display size of the product image interface in the secondary screen to a preset size so that the secondary screen displays the product image interface after size adjustment; in response to the product image interface being unresponsive and the program interface being displayed normally, restart the interface display program corresponding to the product image interface; or send a program restart command to the secondary screen, the program restart command being used to control the secondary screen to restart the interface display program corresponding to the product image interface.

[0134] In one possible implementation, the device further includes a first control module, which is configured to: when a new program window is started, read the image interface presence identifier in the shared storage area; if the image interface presence identifier is found to be valid, then stop controlling the secondary screen to perform the operation of displaying the product image interface.

[0135] In one possible implementation, the device further includes a first update module, which is configured to: if an invalid value is read from the image interface, update the identifier to a valid value after successfully controlling the secondary screen to perform the operation of displaying the product image interface.

[0136] In one possible implementation, the device further includes a counting control module, which is configured to: maintain a program window counter in a shared storage area, the program window counter being used to record the number of program windows open on the main screen; increment the program window counter by 1 whenever a program window instance is successfully launched; and decrement the program window counter by 1 whenever a program window instance is closed.

[0137] In one possible implementation, the device further includes a second control module, which is configured to: continuously or periodically monitor the program window counter; and when the value of the counter is less than 1, control the secondary screen to perform the operation of closing the product image interface.

[0138] In one possible implementation, the apparatus further includes an initialization module configured to: initialize the program window counter of the shared storage area to 0 before the first program window is started.

[0139] In one possible implementation, the device further includes a third control module, which is configured to: control the secondary screen to perform an operation to close the product image interface in response to the closing of the target program.

[0140] In one possible implementation, the second control module further includes an interface shutdown submodule, which is used to: shut down the interface display program corresponding to the product image interface so that the secondary screen stops displaying the product image interface; or, send a program shutdown command to the secondary screen so that the secondary screen stops displaying the product image interface, wherein the program shutdown command is used to control the secondary screen to execute the interface display program corresponding to the operation of displaying the product image interface.

[0141] In some embodiments, the functions or modules of the apparatus provided in this application can be used to perform the methods described in the above method embodiments. The specific implementation can be referred to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0142] This application embodiment also provides a secondary screen control device for main and secondary screen linkage, including: a second display module, used to display a product image interface in response to the launch of a target program on the main screen, wherein the target program is an application used to detect a target product manufactured based on a target semiconductor process, and the product image interface is used to display product images obtained during the manufacturing process of the target product based on the target semiconductor process; and a second adjustment module, used to perform a normalization adjustment operation on the product image interface in response to the display state of the product image interface being abnormal and the display state of the program interface on the main screen being normal.

[0143] In one possible implementation, the second display module includes a second interface display submodule, which is configured to: display the product image interface in response to receiving a display instruction from the main screen; or, start the interface display program corresponding to the product image interface in response to receiving a program start instruction from the main screen, so as to display the product image interface on the secondary screen.

[0144] In one possible implementation, the second display module includes an interface display settings submodule, which is used to: hide the window title bar and / or window border of the product image interface; and set the window size of the product image interface to be consistent with the working area size of the secondary screen.

[0145] In one possible implementation, the device further includes a communication module, which is configured to send a communication message to the main screen to notify the main screen that the display status of the product image interface is abnormal.

[0146] In one possible implementation, the second adjustment module includes a second abnormal adjustment submodule, which is configured to: in response to the product image interface being closed, send a window destruction message to the main screen; after receiving a restore command from the main screen, restore the product image interface to its display state; in response to the product image interface being minimized and the program interface on the main screen being displayed normally, display the product image interface based on the size adjustment result from the main screen, or, in response to receiving an adjustment command from the main screen, adjust the display size of the product image interface according to a preset size; in response to the product image interface being unresponsive and the program interface on the main screen being displayed normally, display the product image interface based on the program startup result from the main screen, or, in response to receiving a program restart command from the main screen, restart the interface display program corresponding to the product image interface.

[0147] In one possible implementation, the device further includes a second update module, which is configured to: update the image interface presence identifier based on the display state change of the product image interface; send the updated image interface presence identifier to the main screen or write it to a shared storage area, wherein the image interface presence identifier indicates the display state of the product image interface, and the display state includes display abnormality and display normality.

[0148] In one possible implementation, the second update module includes an identifier setting submodule, which is configured to: maintain a product image interface presence identifier in a shared storage area; if the product image interface displays normally, set the image interface presence identifier to a valid value; if the product image interface displays abnormally, set the image interface presence identifier to an invalid value.

[0149] In one possible implementation, the device further includes a monitoring execution module, which is used to: monitor a program window counter in a shared storage area; and when the value of the program window counter is less than 1, perform an operation to close the product image interface.

[0150] In one possible implementation, the device further includes a shutdown module, which is configured to: in response to receiving a program shutdown command from the main screen, shut down the interface display program corresponding to the product image interface.

[0151] In some embodiments, the functions or modules of the apparatus provided in this application can be used to perform the methods described in the above method embodiments. The specific implementation can be referred to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0152] This application also provides a non-volatile computer-readable storage medium storing a computer program thereon. When the computer program is executed by a processor, it implements the steps of the above-described main screen control method and / or secondary screen control method for main and secondary screen linkage.

[0153] This application also provides a computer program product, including a computer program or a non-volatile computer-readable storage medium carrying the computer program. When the computer program is executed by a processor, it implements the steps of the above-mentioned main screen control method and / or secondary screen control method for main and secondary screen linkage.

[0154] Computer-readable storage media can be tangible devices capable of holding and storing programs / instructions used by instruction execution devices. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination of the foregoing. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0155] The computer program (or computer-readable program instructions) described herein can be downloaded from a computer-readable storage medium to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage medium in the respective computing / processing device.

[0156] The computer program (or computer program instructions) used to perform the operations of this application may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), is personalized by utilizing the status information of the computer-readable program instructions. This electronic circuitry can execute the computer-readable program instructions to implement various aspects of this application.

[0157] Various aspects of this application are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0158] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0159] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0160] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0161] The above-described preferred embodiments have further detailed the purpose, technical solutions, and advantages of this application. It should be understood that the above description is only a preferred embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A main screen control method for main and secondary screen linkage, characterized in that, include: In response to the launch of the target program on the main screen, the program interface corresponding to the target program is displayed, and the secondary screen is controlled to perform the operation of displaying the product image interface. The target program is an application used to detect the target product manufactured based on the target semiconductor process. The product image interface is used to display the product image obtained during the manufacturing process of the target product based on the target semiconductor process. In response to determining that the display status of the product image interface in the secondary screen is abnormal and the display status of the program interface is normal, adjustments are made to restore the product image interface to normal.

2. The main screen control method according to claim 1, wherein the main screen is connected to a computing device, and the computing device is equipped with an operating system, characterized in that, Before the control sub-screen performs the operation of displaying the product image interface, the method further includes: Call the hardware query application programming interface provided by the operating system to enumerate all displays connected to the computing device; Based on the enumeration results, determine the secondary screen for displaying the product image interface.

3. The main screen control method according to claim 2, characterized in that, The step of determining the secondary screen for displaying the product image interface based on the enumeration results includes: Based on the enumeration results, the first detected display screen other than the main screen is determined; The first detected display screen is identified as the secondary screen for displaying the product image interface.

4. The main screen control method according to any one of claims 1 to 3, wherein the main screen is connected to a computing device, and the computing device is equipped with an operating system, characterized in that, The control sub-screen performs the operation of displaying the product image interface, including: The window management application programming interface of the operating system is invoked to create the product image interface on the secondary screen; The window management application programming interface controls the secondary screen to perform the operation of displaying the product image interface.

5. The main screen control method according to any one of claims 1 to 4, characterized in that, Determining that the display status of the product image interface in the secondary screen is abnormal includes: The system detects a communication message sent by the secondary screen that indicates an abnormality in the product image interface display. Based on the monitored communication messages, it is determined that the display status of the product image interface is abnormal.

6. The main screen control method according to any one of claims 1 to 5, characterized in that, The step of adjusting the product image interface to restore it to normal operation in response to determining that the display state of the product image interface in the secondary screen is abnormal and the display state of the program interface is normal includes: In response to the product image interface being actively closed by the user and the program interface being displayed normally, the secondary screen is controlled to perform the operation of opening the product image interface; In response to the product image interface being minimized and the program interface being displayed normally, the secondary screen is controlled to adjust the product image interface to a preset size, or the display size of the product image interface in the secondary screen is adjusted to a preset size, so that the secondary screen displays the product image interface after the size adjustment; In response to the product image interface becoming unresponsive and the program interface display status being normal, the interface display program corresponding to the product image interface is restarted; or, a program restart command is sent to the secondary screen, the program restart command being used to control the secondary screen to restart the interface display program corresponding to the product image interface.

7. The main screen control method according to claims 1 to 6, characterized in that, The method further includes: When a new program window is launched, the image interface in the shared storage area is identified; If the image interface is found to have a valid value, then the control sub-screen will no longer be controlled to display the product image interface.

8. The main screen control method according to claim 7, characterized in that, The method further includes: If the image interface is found to have an invalid value, the image interface will be updated to a valid value after the secondary screen successfully executes the operation of displaying the product image interface.

9. The main screen control method according to any one of claims 1 to 8, characterized in that, The method further includes: A program window counter is maintained in the shared storage area, and the program window counter is used to record the number of program windows opened on the main screen; Each time a program window instance is successfully launched, the program window counter is incremented by 1. Whenever a program window instance is closed, the program window counter is decremented by 1.

10. The main screen control method according to claim 9, characterized in that, The method further includes: Continuously or periodically monitor the program window counter; When the value of the program window counter is less than 1, the secondary screen is controlled to close the product image interface.

11. The main screen control method according to claim 9 or 10, characterized in that, The method further includes: Before the first program window is launched, the program window counter in the shared storage area is initialized to 0.

12. The main screen control method according to any one of claims 1 to 11, characterized in that, The method further includes: In response to the shutdown of the target program, the secondary screen is controlled to perform the operation of closing the product image interface.

13. The main screen control method according to claim 10 or 12, characterized in that, The operation of controlling the secondary screen to close the product image interface includes: Close the interface display program corresponding to the product image interface to stop the secondary screen from displaying the product image interface; or, A program shutdown command is sent to the secondary screen to stop the display of the product image interface. The program shutdown command is used to control the secondary screen to execute the interface display program corresponding to the operation of displaying the product image interface.

14. A method for controlling a secondary screen in a primary-secondary screen linkage, characterized in that, include: In response to the launch of the target program on the main screen, a product image interface is displayed. The target program is an application used to detect the target product manufactured based on the target semiconductor process. The product image interface is used to display product images obtained during the manufacturing process of the target product based on the target semiconductor process. In response to the product image interface being displayed as abnormal while the program interface on the main screen is displayed as normal, an adjustment operation to restore the product image interface to normal is performed.

15. The sub-screen control method according to claim 14, characterized in that, The step of displaying the product image interface in response to the launch of the target program on the main screen includes: In response to receiving a display command from the main screen, the product image interface is displayed; or, In response to receiving a program launch command from the main screen, the interface display program corresponding to the product image interface is launched to display the product image interface on the secondary screen.

16. The main screen control method according to claim 14 or 15, characterized in that, The product image display interface includes: Hide the window title bar and / or window border of the product image interface; Set the window size of the product image interface to be the same as the working area size of the secondary screen.

17. The sub-screen control method according to any one of claims 14 to 16, characterized in that, Before performing the restoration adjustment operation for the product image interface, the method further includes: A communication message is sent to the main screen to notify the main screen that the display status of the product image interface is abnormal.

18. The sub-screen control method according to any one of claims 14 to 17, characterized in that, The response to the product image interface displaying abnormally and the main screen program interface displaying normally, performing a normalization adjustment operation for the product image interface includes: In response to the product image interface being closed, a window destruction message is sent to the main screen; upon receiving a restore command from the main screen, the product image interface is restored to its display state. In response to the product image interface being minimized and the program interface on the main screen being displayed normally, the product image interface is displayed based on the size adjustment result from the main screen; or, in response to receiving an adjustment instruction from the main screen, the display size of the product image interface is adjusted according to a preset size. If the product image interface is unresponsive and the program interface on the main screen is displayed normally, the product image interface is displayed based on the program startup result from the main screen. Alternatively, if a program restart command is received from the main screen, the interface display program corresponding to the product image interface is restarted.

19. The sub-screen control method according to any one of claims 14 to 18, characterized in that, The method further includes: Update the presence flag of the image interface based on the changes in the display status of the product image interface; The updated image interface presence identifier is sent to the main screen or written to the shared storage area. The image interface presence identifier indicates the display status of the product image interface, and the display status includes display abnormality and display normality.

20. The main screen control method according to claim 19, characterized in that, The step of updating the presence flag of the image interface based on the change in the display state of the product image interface includes: A product image interface is maintained in the shared storage area with an identifier; If the product image interface is displayed normally, set the image interface presence flag to a valid value; If the product image interface displays abnormally, the existence flag of the image interface will be set to an invalid value.

21. The sub-screen control method according to any one of claims 14 to 20, characterized in that, The method further includes: Monitor the program window counter in the shared storage area; When the value of the program window counter is less than 1, the operation of closing the product image interface is executed.

22. The sub-screen control method according to any one of claims 14 to 20, characterized in that, The method further includes: In response to receiving a program close command from the main screen, the interface display program corresponding to the product image interface is closed.

23. A computing device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the main screen control method as described in any one of claims 1 to 13, and / or the secondary screen control method as described in any one of claims 14 to 22.

24. A main and secondary screen linkage system, characterized in that, include: The main screen is used to display the corresponding program interface; Secondary screen, used to display product image interface; The computing device as described in claim 23 is connected to the main screen and the secondary screen respectively, and is used to execute the main screen control method and / or the secondary screen control method.

Images