Practical training cart, practical training system and picture switching method
By using positioning cameras in the training cart system to track the target object and obtain its position information, the automatic switching of real-time video data is realized, which solves the problem of inconvenience and error in screen switching when operators move between different positions, and improves the The accuracy and convenience of monitoring.
Patent Information
- Application Number
- CN202411173638.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-26
- Publication Date
- 2024-12-06
AI Technical Summary
In vocational education, skills training and industrial environments, operators need to move between different positions, resulting in inconvenient switching of screens of trolley displays and prone to switching errors.
Adopt the practical training cart system, including positioning cameras, control terminals and display terminals, tracking the target object through the positioning camera, obtaining its position information, and obtaining the real-time video data of the corresponding station camera based on this information, sending it to the display terminal to realize automatic Screen switching.
It improves the convenience of screen switching operations, avoids switching errors, and ensures real-time monitoring and operation accuracy.
Smart Images

Figure CN119094702A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present invention relate to the field of practical training technology, and in particular to a practical training cart, a practical training system and a screen switching method. Background Art
[0002] In vocational education and skills training, students and trainers need to move between different workstations to perform practical operations. A training cart can provide a mobile platform for real-time observation and recording of these operations; in industrial environments, quality control personnel need to move between different production lines to check the manufacturing process of products. A training cart can help quality control personnel monitor the operations on the production line in real time; in dangerous or restricted environments, such as chemical laboratories or nuclear power plants, workers need to ensure the safety of operations through remote monitoring. A training cart can provide a mobile monitoring solution.
[0003] In the above-mentioned situations, the operator may need to move between different positions. If the staff standing in front of the training cart wants to capture the operator's operation in real time, they need to manually switch the screen of the training cart according to the operator's movement to accurately obtain the operator's operation screen. Manual switching will inevitably bring inconvenience to the operation and may cause switching errors. Summary of the invention
[0004] The main technical problem solved by the embodiments of the present invention is to provide a training cart, a training system and a screen switching method, which can improve the convenience of screen switching operations and avoid the problem of switching errors.
[0005] In order to solve the above technical problems, a technical solution adopted in an embodiment of the present invention is: providing a training cart, including: a power supply, a positioning camera, a control terminal and a display terminal, the power supply is used to power the positioning camera, the control terminal and the display terminal, the control terminal is respectively connected to the workstation cameras set on several workstations, and the control terminal is used to obtain real-time video data collected by each workstation camera; the positioning camera is connected to the control terminal, the positioning camera is used to track the target object, obtain the collected image, and send the collected image to the control terminal, the collected image includes the workstation where the target object is located; the control terminal obtains the sequence information of the workstation camera at the workstation where the target object is located according to the collected image; the control terminal is connected to the display terminal, and the control terminal sends the real-time video data obtained by the workstation camera corresponding to the sequence information to the display terminal, so that the display terminal displays the corresponding real-time video.
[0006] In some embodiments, the control terminal displays a control interface having a number of sequence information through the display terminal, and the number of sequence information corresponds to a number of workstation cameras respectively; the display terminal sends a switching instruction to the control terminal in response to an operation instruction input by an operator, and the switching instruction includes specified sequence information; the control terminal responds to the switching instruction and sends the real-time video data acquired by the workstation camera corresponding to the specified sequence information to the display terminal.
[0007] In some embodiments, corresponding identification information is set on the plurality of workstations, the captured images include the identification information, and the control terminal obtains the sequence information of the workstation cameras on the corresponding workstations according to the identification information.
[0008] In some embodiments, the positioning camera is provided with a first processing module having a deep learning algorithm, wherein the first processing module has a preset motion detection range and sensitivity to identify and track the target object; the first processing module also has an autofocus algorithm, an autoexposure algorithm and an auto white balance algorithm.
[0009] In order to solve the above technical problems, another technical solution adopted by the embodiment of the present invention is: to provide a training system, including: a plurality of workstation cameras arranged at corresponding workstations; and the training cart as described above.
[0010] In some embodiments, the workstation camera encodes the real-time video data using a high-efficiency video encoding method.
[0011] In some embodiments, a communication connection is established between the workstation camera and the control terminal in the training cart via dual-band wireless communication technology.
[0012] In order to solve the above technical problems, another technical solution adopted in the embodiment of the present invention is: to provide a screen switching method, which is applied to the control terminal of the training cart as described above, including: obtaining real-time video data collected by workstation cameras set at several workstations; obtaining a captured image of the positioning camera of the training cart; obtaining sequence information of the workstation camera at the workstation where the target object is located according to the captured image; and sending the real-time video data obtained by the workstation camera corresponding to the sequence information to the display terminal of the training cart, so that the display terminal displays the corresponding real-time video.
[0013] In some embodiments, the screen switching method also includes: obtaining a switching instruction generated by the display terminal, wherein the switching instruction is generated by the display terminal in response to an operation instruction input by an operator; in response to the switching instruction, sending real-time video data acquired by a workstation camera corresponding to the specified sequence information to the display terminal.
[0014] In some embodiments, corresponding identification information is set on the several workstations, the acquired image includes the identification information, and the sequence information of the workstation camera at the workstation where the target object is located is obtained according to the acquired image, including: obtaining the corresponding identification information according to the acquired image; obtaining the sequence information of the workstation camera at the corresponding workstation according to the identification information.
[0015] The beneficial effects of the embodiments of the present invention are as follows: different from the prior art, the embodiments of the present invention track the target object by setting a positioning camera, obtain the real-time position information of the target object, and then send the real-time video data of the workstation camera of the workstation to the display terminal, which can improve the convenience of screen switching operations and avoid the problem of switching errors. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] Figure 1 It is a structural schematic diagram of a training cart provided by an embodiment of the present invention;
[0017] Figure 2 It is a structural schematic diagram of a training system provided by an embodiment of the present invention;
[0018] Figure 3 It is a flowchart of a screen switching method provided by an embodiment of the present invention;
[0019] Figure 4 yes Figure 3 FIG. 1 is a flow chart of step S300 in the screen switching method. DETAILED DESCRIPTION
[0020] In order to facilitate the understanding of the present application, the present application is described in more detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that when an element is described as "fixed to" another element, it can be directly on another element or there can be one or more centered elements therebetween. When an element is described as "connected" to another element, it can be directly connected to another element or there can be one or more centered elements therebetween. The orientation or positional relationship indicated by the terms "upper", "lower", "inner", "outer", "bottom" and the like used in this specification is based on the orientation or positional relationship shown in the accompanying drawings, only for the convenience of describing the present application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present application. In addition, the terms "first", "second", "third" and the like are used only for descriptive purposes and cannot be understood as indicating or implying relative importance.
[0021] Unless otherwise defined, all technical and scientific terms used in this specification have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used in this specification and in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application. The term "and / or" used in this specification includes any and all combinations of one or more of the related listed items.
[0022] In addition, the technical features involved in the different embodiments of the present application described below can be combined with each other as long as they do not conflict with each other.
[0023] The technical solution in this application will be described below in conjunction with the accompanying drawings.
[0024] In some embodiments of the present application, a training cart is provided, and its structural schematic diagram is as follows: Figure 1 As shown, the training cart includes a power supply 110 , a positioning camera 120 , a control terminal 130 and a display terminal 140 .
[0025] Among them, the power supply 110 is respectively connected to the positioning camera 120, the control terminal 130 and the display terminal 140, the positioning camera 120 and the control terminal 130 are communicatively connected, the control terminal 130 and the display terminal 140 are communicatively connected, and the control terminal 130 is also communicatively connected to the workstation cameras (i.e., workstation camera 201, workstation camera 202, ... and workstation camera 20N) set at N workstations.
[0026] The power supply 110 is used to supply power to the positioning camera 120, the control terminal 130 and the display terminal 140. The control terminal 130 is used to obtain real-time video data collected by the cameras at each workstation. The positioning camera 120 is used to track the target object, obtain a captured image, and send the captured image to the control terminal 130. The captured image includes the workstation where the target object is located. The control terminal 130 obtains the sequence information of the workstation camera at the workstation where the target object is located based on the captured image. The control terminal 130 sends the real-time video data obtained by the workstation camera corresponding to the sequence information to the display terminal 140, so that the display terminal 140 displays the corresponding real-time video.
[0027] In some embodiments of the present application, the power supply 110 supports direct current and alternating current.
[0028] It should be noted that the positioning camera 120 and the control terminal 130 can establish a communication connection via wired or wireless means, and the control terminal 130 and the display terminal 140 can establish a communication connection via wired means. The target object refers to the operator.
[0029] Specifically, the workstation is provided with corresponding identification information, so the captured image contains identification information corresponding to the workstation where the target object is located. Each workstation camera is provided with corresponding sequence information. A data table in which sequence information and identification information correspond one to one is provided in the control terminal. When the operator moves to a certain workstation, the positioning camera 120 locates and tracks the operator to a certain workstation, and then obtains a captured image containing identification information. The captured image is further sent to the control terminal 130, and the control terminal 130 obtains the identification information in the captured image through image recognition.
[0030] The control terminal 130 then obtains the corresponding sequence information according to the data table, and sends the real-time video data obtained by the corresponding workstation camera to the display terminal 140 according to the sequence information. The display terminal 140 further decodes the real-time video data and then displays the corresponding real-time video, thereby realizing automatic switching of the display terminal screen.
[0031] It should be noted that the training cart is also equipped with silent omnidirectional wheels and flexible robotic arms to achieve the flexible mobility of the training cart, which is convenient for quick switching between different workstations; a 4K specific camera is also set on the flexible robotic arm to meet application requirements under different working conditions.
[0032] In some embodiments of the present application, the positioning camera 120 is provided with a first processing module having a deep learning algorithm, and the first processing module is preset with a motion detection range and sensitivity to identify and track the target object.
[0033] In some embodiments of the present application, the positioning camera 120 is further equipped with an automatic focus algorithm, an automatic exposure algorithm, and an automatic white balance algorithm.
[0034] Among them, the auto focus algorithm is used to adjust the position of the camera lens of the positioning camera 120 to ensure that the photographed object presents a clear image on the imaging plane; the automatic exposure algorithm is used to automatically adjust the exposure parameters according to the ambient light conditions to obtain appropriate image brightness and contrast. Ensure that the photographed object can be clearly photographed and identified under different lighting conditions; the automatic white balance algorithm is used to eliminate the color temperature deviation in the image, ensure that the white objects in the image appear white under various light conditions, and ensure the true color of the photographed object in the image.
[0035] In some embodiments of the present application, the positioning camera 120 is an artificial intelligence (AI) humanoid positioning and tracking camera, that is, an AI 4K binocular camera. The AI humanoid positioning and tracking camera includes an image sensor, an AI chip, and a visual processor. The image sensor and the visual processor are connected via a video serial communication III (Flat Panel Display Link III, FPDLink III) interface, and transmit uncompressed video, control signals, and power through a single low-latency cable, while providing adaptive equalization to compensate for cable aging and temperature changes. To ensure the transmission of high-quality images and achieve smooth and efficient operation. In addition, the AI humanoid positioning and tracking camera can also achieve scalable AI camera performance at the edge, improving processing efficiency and response speed.
[0036] The AI Human Positioning and Tracking Sensor Camera is an advanced surveillance device that integrates AI algorithms to automatically identify and track human-shaped targets. Specifically, the camera uses a built-in AI algorithm to detect human figures in an image to be able to identify the outline and key features of the person, such as the head, body, and limbs. Once a human figure is detected, the camera can automatically track the target and maintain continuous monitoring of the target even when the target moves. Through the camera and AI algorithm, the position of the person can be accurately located and provide real-time location data.
[0037] In other embodiments of the present application, in order to avoid the situation where the automatic switching of the display terminal screen fails due to a malfunction of the positioning camera, the control terminal 130 displays a control interface with a number of sequence information through the display terminal 140, and the number of sequence information corresponds to a number of workstation cameras respectively.
[0038] The display terminal 140 responds to the operation instruction input by the operator and sends a switching instruction to the control terminal 130, where the switching instruction includes specified sequence information; the control terminal 130 responds to the switching instruction and sends the real-time video data acquired by the workstation camera corresponding to the specified sequence information to the display terminal 140.
[0039] In the embodiment of the present application, the display terminal is a capacitive touch screen, and the size of the capacitive touch screen is determined according to the carrying capacity of the training cart.
[0040] Different from the prior art, the implementation mode of the present invention sets a positioning camera to track the target object, obtains the real-time position information of the target object, and then sends the real-time video data of the workstation camera at the workstation to the display terminal, which can improve the convenience of screen switching operations and avoid the problem of switching errors.
[0041] Based on the training cart provided in the above embodiment, the present application embodiment also provides a training system, and its structural diagram is as follows: Figure 2 As shown, the training system includes a training cart 100 and N workstation cameras arranged on corresponding workstations, namely, workstation camera 201, workstation camera 202, ... and workstation camera 20N.
[0042] The training cart 100 is respectively connected to the workstation cameras (ie, the workstation camera 201, the workstation camera 202, ... and the workstation camera 20N) arranged at the N workstations.
[0043] As an example but not a limitation, the workstation camera encodes the real-time video data using a high-efficiency video encoding method. The workstation camera and the control terminal in the training cart establish a communication connection through a dual-band wireless communication technology.
[0044] Based on the training cart provided in the above embodiment, the embodiment of the present invention provides a screen switching method, which is applied to the training cart provided in the above embodiment, and its flow chart is as follows: Figure 3 As shown, the method specifically comprises the following steps:
[0045] Step S100: acquiring real-time video data collected by workstation cameras installed at a plurality of workstations.
[0046] The control terminal of the training cart continuously receives real-time video streams from the cameras at each workstation by establishing a stable communication connection. The real-time video stream reflects the current situation at each workstation. After receiving the real-time video stream, the control terminal also needs to perform efficient data processing to ensure the stability and smoothness of the video stream.
[0047] In order to ensure the stability and smoothness of the video stream, the control terminal may use multi-threading or asynchronous processing technology to process the data from different cameras in parallel. In addition, in order to ensure the integrity and security of the data, the control terminal will also perform necessary encryption and verification on the data. In this way, the real-time and accuracy of the video data required in the subsequent steps are ensured.
[0048] Step S200: Acquire the captured image of the positioning camera of the training cart.
[0049] The positioning camera is responsible for tracking the target object and capturing an acquisition image that includes the target and the workstation it is located in. The acquisition image is not only used to determine the location of the target object, but also for subsequent identification of the workstation camera on the workstation.
[0050] An efficient communication mechanism is established between the control terminal and the positioning camera to ensure real-time transmission and processing of images. After the positioning camera captures the image, it will immediately send it to the control terminal. After receiving the image, the control terminal will perform pre-processing, such as denoising and enhancement, to improve the image quality and facilitate subsequent target recognition and station positioning.
[0051] Step S300: acquiring sequence information of a workstation camera at the workstation where the target object is located according to the captured image.
[0052] The control terminal uses advanced image processing technology to conduct in-depth analysis of the captured images obtained from the positioning camera. The control terminal uses image segmentation, feature extraction and pattern recognition technologies to identify the target object in the image and determine the location of its workstation.
[0053] Once the workstation where the target object is located is determined, the control terminal will further retrieve the sequence information of the workstation camera associated with the workstation. The sequence information may be stored in the database of the control terminal, or quickly searched through some mapping relationship. Therefore, the control terminal can accurately know which workstation camera corresponds to the workstation where the target object is located.
[0054] Step S400: sending the real-time video data acquired by the workstation camera corresponding to the sequence information to the display terminal of the training cart, so that the display terminal displays the corresponding real-time video.
[0055] The control terminal will select the corresponding video stream from the previously received and processed real-time video data stream according to the sequence information of the workstation camera obtained in step S300. This process requires efficient video stream management and accurate matching algorithms to ensure that the selected video stream fully corresponds to the workstation where the target object is located.
[0056] The selected video stream is then sent to the display terminal of the training cart. After receiving the video stream, the display terminal will immediately decode and render it to display the video image of the corresponding workstation on the screen in real time. Therefore, the staff can intuitively see the real-time situation of the workstation where the target object is located, thereby achieving efficient monitoring and management.
[0057] In some embodiments of the present application, the flowchart of step S300 is as follows: Figure 4 As shown, the specific steps include:
[0058] Step S310: Obtain corresponding identification information according to the collected image.
[0059] The control terminal will conduct an in-depth analysis of the captured images obtained from the positioning camera to extract the corresponding identification information. The identification information is pre-set on each workstation to uniquely identify each workstation. They may exist in the form of QR codes, barcodes, digital tags or specific patterns, and the identification information of each workstation is unique.
[0060] In order to accurately extract the identification information from the captured images, the control terminal uses advanced image processing technology. First, it pre-processes the image, such as denoising and contrast enhancement, to improve image quality and highlight the identification information. Then, through edge detection, morphological transformation and other algorithms, the control terminal can locate the approximate area of the identification information.
[0061] The control terminal then uses feature extraction and recognition algorithms, such as OCR (optical character recognition) technology, to accurately identify and interpret the logo information. This process requires a high degree of accuracy and robustness to ensure that the logo information can be reliably extracted under different lighting conditions, shooting angles and image quality.
[0062] Once the identification information is successfully extracted, the control terminal will store it in memory for use in subsequent steps.
[0063] Step S320: acquiring the sequence information of the workstation camera on the corresponding workstation according to the identification information.
[0064] The control terminal will use the identification information extracted in step S310 to search and obtain the sequence information of the workstation camera on the corresponding workstation.
[0065] In order to achieve this matching process, the control terminal maintains a database or mapping table, which stores the association between the identification information of each workstation and the sequence information of the corresponding workstation camera. This association is established during the system initialization or configuration phase, ensuring a one-to-one correspondence between the identification information of each workstation and the corresponding workstation camera.
[0066] When the control terminal extracts the identification information from the captured image, it will query this database or mapping table to find the sequence information of the workstation camera corresponding to the identification information. This query process needs to be efficient and accurate to ensure that the correct workstation image can be quickly switched in the real-time video stream.
[0067] Once the sequence information of the matching workstation camera is found, the control terminal will store it for use in subsequent steps. Therefore, the control terminal can accurately select the video stream of the corresponding workstation from all received real-time video streams based on this sequence information and send it to the display terminal for display.
[0068] Different from the prior art, the implementation mode of the present invention tracks the target object, obtains the real-time position information of the target object, and then sends the real-time video data of the workstation camera of the target object to the display terminal, which can improve the convenience of screen switching operation and avoid the problem of switching errors.
[0069] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Under the concept of the present application, the technical features in the above embodiments or different embodiments can also be combined, the steps can be implemented in any order, and there are many other changes in different aspects of the present application as above, which are not provided in detail for the sake of simplicity. Although the present application has been described in detail with reference to the aforementioned embodiments, a person of ordinary skill in the art should understand that the technical solutions described in the aforementioned embodiments can still be modified, or some of the technical features can be replaced by equivalents. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A training cart, It is characterized in that include: Power supply, positioning camera, control terminal and display terminal, The power supply is used to supply power to the positioning camera, the control terminal and the display terminal. The control terminal is respectively connected to the workstation cameras arranged at a plurality of workstations for communication. The control terminal is used to obtain the real-time video data collected by the cameras at each workstation. The positioning camera is communicatively connected with the control terminal, and is used to track the target object, obtain a captured image, and send the captured image to the control terminal, wherein the captured image includes the workstation where the target object is located; The control terminal acquires sequence information of a workstation camera at the workstation where the target object is located according to the collected image; The control terminal is in communication connection with the display terminal, and the control terminal sends the real-time video data acquired by the workstation camera corresponding to the sequence information to the display terminal, so that the display terminal displays the corresponding real-time video.
2. The training cart according to claim 1, It is characterized in that The control terminal displays a control interface having a plurality of sequence information through the display terminal, wherein the plurality of sequence information respectively corresponds to a plurality of workstation cameras; The display terminal sends a switching instruction to the control terminal in response to an operation instruction input by an operator, wherein the switching instruction includes specified sequence information; In response to the switching instruction, the control terminal sends the real-time video data acquired by the workstation camera corresponding to the designated sequence information to the display terminal.
3. The training cart according to claim 1, It is characterized in that The plurality of workstations are provided with corresponding identification information, the collected images include the identification information, and the control terminal obtains the sequence information of the workstation cameras on the corresponding workstations according to the identification information.
4. The training cart according to claim 1, It is characterized in that The positioning camera is provided with a first processing module having a deep learning algorithm, wherein the first processing module is preset with a motion detection range and sensitivity to identify and track a target object; The first processing module also has an auto-focus algorithm, an auto-exposure algorithm and an auto-white balance algorithm.
5. A training system, It is characterized in that include: A plurality of workstation cameras arranged at corresponding workstations; A training cart as described in any one of claims 1 to 4.
6. The training system according to claim 5, It is characterized in that The workstation camera encodes real-time video data using a high-efficiency video encoding method.
7. The training system according to claim 5, It is characterized in that A communication connection is established between the workstation camera and the control terminal in the training cart via dual-frequency wireless communication technology.
8. A screen switching method, applied to the control terminal of the training cart according to any one of claims 1 to 4, It is characterized in that include: Acquire real-time video data collected by workstation cameras installed at several workstations; Acquire a captured image of a positioning camera of the training cart; Acquire sequence information of a workstation camera at the workstation where the target object is located according to the collected image; The real-time video data acquired by the workstation camera corresponding to the sequence information is sent to the display terminal of the training cart, so that the display terminal displays the corresponding real-time video.
9. The method according to claim 8, It is characterized in that Also includes: Acquire a switching instruction generated by the display terminal, where the switching instruction is generated by the display terminal in response to an operation instruction input by an operator; In response to the switching instruction, the real-time video data acquired by the workstation camera corresponding to the designated sequence information is sent to the display terminal.
10. The method according to claim 8, It is characterized in that The plurality of workstations are provided with corresponding identification information, the collected image includes the identification information, and the sequence information of the workstation camera at the workstation where the target object is located is obtained according to the collected image, including: Acquire corresponding identification information according to the collected image; The sequence information of the workstation camera on the corresponding workstation is obtained according to the identification information.
