Vehicle-mounted display screen touch disconnection detection system and method

Abstract

The application relates to the technical field of vehicle detection, and discloses a touch line break detection system and method for a vehicle-mounted display screen, which comprises an upper computer, a mechanical arm, a vehicle-mounted display screen and a photographing device, wherein the upper computer comprises a mechanical arm control module, a video control module, a touch module and a photographing device control module. The upper computer sends a working instruction to the mechanical arm control module to control the mechanical arm to draw a line, and touch data is obtained; the touch module draws a line on a drawing board page according to the touch data; the photographing device control module controls the photographing device to take a photo of the drawing board page, and a picture of the touch line is obtained; and the upper computer detects the picture of the touch line, thereby judging whether the line is broken during drawing, solving the problem that the method for judging the touch effect has the risk of misjudgment and wrong detection, the problem that the product with a broken touch line flows to a client, and the problem that the abnormal product with a broken touch line is quickly and effectively detected.

Description

Technical Field

[0001] This invention relates to the field of vehicle inspection technology, and in particular to a system and method for detecting touch wire breakage on an in-vehicle display screen. Background Technology

[0002] In-vehicle displays are crucial for human-machine interaction, and touch performance is one of the most direct and important factors in evaluating customer experience, directly impacting the driving experience. Therefore, the production and delivery of in-vehicle displays places increasingly stringent demands on touch testing to prevent defective products from reaching customers and causing complaints. Touch testing primarily focuses on the quality of drawn lines to prevent broken lines from causing touch problems. Currently, production lines mainly rely on manual line drawing for touch performance testing, followed by subjective judgment. This method is not only simplistic and crude but also carries the risk of misjudgments and false positives, resulting in defective products with broken lines reaching customers. Furthermore, with the shift to automation in production lines, manual inspection is no longer sufficient to meet production demands. Summary of the Invention

[0003] The main objective of this invention is to provide a system and method for detecting touch line breakage in vehicle displays. This invention aims to address the technical problems of existing technologies that rely on human subjective judgment to determine touch effects, which carries the risk of misjudgment and false detection, leading to defective products with touch line breakage flowing to customers. It also addresses the issue that manual inspection can no longer meet production needs as production lines switch to automation.

[0004] To achieve the above objectives, the present invention provides a vehicle display screen touch line breakage detection system, which includes a host computer, a robotic arm, a vehicle display screen, and a camera. The host computer includes a robotic arm control module, a video control module, a touch module, and a camera control module. The camera is set at a target position on the vehicle display screen. The robotic arm is equipped with a line drawing component, which draws lines on the vehicle display screen.

[0005] The host computer is used to output a drawing board page to the vehicle display screen when it receives a touch test command;

[0006] The host computer is also used to send a working instruction to the robotic arm control module when it receives a touch test instruction, and control the robotic arm to draw lines on the vehicle display screen through the robotic arm control module, and obtain touch data through the vehicle display screen;

[0007] The touch module is used to receive and parse the touch data sent by the vehicle display screen to obtain touch coordinate information;

[0008] The touch module is also used to transmit the touch coordinate information to the drawing board page for drawing;

[0009] The video control module is used to project the drawn canvas page onto the vehicle display screen after parsing.

[0010] The host computer is also used to send a photo-taking command to the photo-taking device control module, and control the photo-taking device to take a photo of the drawing board page to obtain an image of the touch-drawn line;

[0011] The host computer is also used to detect the image of the touch-drawn line and determine whether the line is broken during the drawing process.

[0012] Optionally, the vehicle display screen includes a deserializer, an LCD, and a touch IC;

[0013] The touch IC is used to collect touch data from the vehicle display screen and transmit it to the deserializer;

[0014] The deserializer is used to parse the touch data and send it to the touch module;

[0015] The LCD is used to display the drawing board page and the drawn drawing board page.

[0016] To achieve the above objectives, the present invention also proposes a method for detecting touch disconnection on an in-vehicle display screen, the method comprising the following steps:

[0017] Upon receiving a touch test command, the whiteboard page is output to the vehicle display screen;

[0018] The robotic arm is controlled to draw lines on the vehicle-mounted display screen so that the display screen can receive touch data.

[0019] Receive and parse the touch data sent by the vehicle display screen to obtain touch coordinate information;

[0020] The touch coordinate information is transmitted to the drawing board for drawing, and the drawn drawing board is parsed and projected onto the vehicle display screen.

[0021] Control the camera to take a picture of the drawing board and obtain an image of the touched line;

[0022] The image of the touch-drawn line is detected to determine whether the line is broken during the drawing process.

[0023] Optionally, before controlling the robotic arm to draw lines on the vehicle-mounted display screen to enable the display screen to receive touch data, the method further includes:

[0024] Perform a status check to determine whether to enter line drawing mode;

[0025] If the drawing mode has been entered, then the step of controlling the robotic arm to draw lines on the vehicle display screen is executed so that the vehicle display screen can obtain touch data.

[0026] If the line drawing mode is not entered, return to the step of performing status detection to determine whether the line drawing mode has been entered.

[0027] Optionally, after controlling the robotic arm to draw lines on the vehicle-mounted display screen to obtain touch data, the method further includes:

[0028] Read the motion state of the robotic arm to determine whether the line drawing is complete;

[0029] When it is detected that the robotic arm is still in motion, it is determined that the line drawing is not completed and the step of reading the movement state of the robotic arm and determining whether the line drawing is completed is executed.

[0030] When the robot arm is detected to be in a stopped state, the marking is determined to be complete and the robot arm is retracted.

[0031] Optionally, detecting the image of the touch-drawn line to determine whether the line is broken during drawing includes:

[0032] The image of the touch-drawn line is detected, and when a line with a preset trajectory is detected, the line with the preset trajectory is located.

[0033] The image of the touch-drawn line is cropped by a preset rectangular area to obtain an image of the touch-drawn line area;

[0034] The image of the touch-drawn area is analyzed to obtain a preset number of connected regions;

[0035] Based on the preset number of connected regions, determine whether the touch line is broken.

[0036] Optionally, analyzing the image of the touch-drawn area to obtain a target number of connected regions includes:

[0037] The image of the touch-drawn area is normalized to obtain a normalized image;

[0038] The normalized image is converted to the target format image.

[0039] The target format image is binarized to obtain a binarized image;

[0040] The binarized image is then subjected to dilation followed by erosion.

[0041] Extract the binarized image after the erosion operation to obtain a preset number of connected regions.

[0042] Optionally, the step of performing an erosion operation after dilation on the binarized image includes:

[0043] Obtain the structuring element that moves on the binarized image;

[0044] The center of the structural element is used as the anchor point, and the pixel value of the anchor point is obtained;

[0045] Calculate the maximum and minimum pixel values ​​of the binarized image under the coverage of the structuring element;

[0046] The pixel value of the anchor point is replaced with the maximum pixel value to complete the dilation operation;

[0047] The pixel values ​​of the anchor points after the dilation operation are replaced with the minimum pixel value to complete the erosion operation.

[0048] Optionally, determining whether a broken line appears in the touch stroke based on the preset number of connected regions includes:

[0049] The preset number of connected regions are filtered based on the size characteristics of the touch drawing area to remove connected regions that do not meet the conditions, thereby obtaining the target number of connected regions.

[0050] Determine whether the target number of connected regions is equal to a preset value;

[0051] If the target number of connected regions equals the preset value, then touch drawing will work normally.

[0052] Optionally, after determining whether the target number of connected regions is equal to a preset value, the method further includes:

[0053] If the target number of connected regions is not equal to the preset value, a broken line will occur during the touch drawing process.

[0054] This invention uses a host computer to control a robotic arm to draw lines. The robotic arm draws lines on a drawing board and takes pictures, obtaining images of the lines touched and detecting whether the lines are broken. This solves the problems of existing technologies that rely on human subjective judgment to determine the touch effect, which carries the risk of misjudgment and false detection, leading to defective products with broken lines flowing to customers. It also addresses the technical problem that manual inspection can no longer meet production needs as production lines switch to automation. This invention can quickly and effectively detect abnormal products with broken lines. Attached Figure Description

[0055] Figure 1 This is a schematic diagram of the structure of the first embodiment of the vehicle-mounted display screen touch wire breakage detection system of the present invention;

[0056] Figure 2 This is a flowchart illustrating the first embodiment of the vehicle-mounted display screen touch disconnection detection method of the present invention;

[0057] Figure 3 This is a schematic diagram of the judgment process in one embodiment of the vehicle display screen touch disconnection detection method of the present invention;

[0058] Figure 4 This is a flowchart illustrating the second embodiment of the vehicle-mounted display screen touch disconnection detection method of the present invention;

[0059] Figure 5 This is a schematic diagram of the image analysis process in a second embodiment of the vehicle display screen touch disconnection detection method of the present invention.

[0060] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0061] It should be understood that the specific embodiments described herein are for illustrative purposes only and are not intended to limit the scope of the invention.

[0062] This invention provides a vehicle-mounted display screen touch disconnection detection system, referring to... Figure 1 , Figure 1 This is a schematic diagram of the first embodiment of the vehicle-mounted display screen touch disconnection detection system of the present invention.

[0063] In this embodiment, the vehicle display screen touch line breakage detection system 1 includes a host computer 10, a robotic arm 20, a vehicle display screen 30, and a camera 40. The host computer 10 includes a robotic arm control module 101, a video control module 102, a touch module 103, and a camera control module 104. The camera 40 is set at a target position on the vehicle display screen 30. The robotic arm 20 is equipped with a line drawing component, which draws lines on the vehicle display screen 30.

[0064] It should be noted that the camera device 40 is set at the target position of the vehicle display screen 30. Therefore, the camera device 40 can take a picture of the whiteboard page on the vehicle display screen 30 to obtain an image of the touched line.

[0065] It is understood that the robotic arm 20 draws lines on the vehicle display screen 30 through a drawing component, which is a copper rod. This embodiment does not impose specific limitations on this.

[0066] The host computer 10 is used to output a drawing board page to the vehicle display screen 30 when it receives a touch test command.

[0067] It should be noted that the host computer 10 refers to a computer that can directly issue control commands, generally a PC / hostcomputer / master computer / upper computer. The screen displays various signal changes (hydraulic pressure, water level, temperature, etc.). The commands issued by the host computer 10 are first sent to the slave computer, which then interprets the commands into corresponding timing signals to directly control the corresponding equipment. The slave computer reads the equipment status data (usually analog quantities) from time to time, converts them into digital signals, and feeds them back to the host computer 10.

[0068] It's worth noting that the vehicle display screen 30 refers to a display screen installed inside the vehicle, specifically for in-vehicle use. There are two types: one is a television placed on a bus for viewing, essentially a vehicle TV; the other is a smaller vehicle monitor, typically with two video inputs—one for connecting to a car DVD player and the other for connecting to a reversing camera. Some also have MP5 video playback and Bluetooth functionality. These displays can be used on similar vehicles, facilitating use while driving. Simply put, a vehicle TV is a mobile receiver for digital television (the difference from traditional digital television), mainly consisting of a set-top box, LCD screen, antenna, and vehicle power supply.

[0069] It is understood that the canvas page is used for drawing lines, and the canvas page is black; this embodiment does not impose specific limitations on this.

[0070] In the specific implementation, when the host computer 10 receives the touch test command, it outputs the canvas page to the LCD 303 of the vehicle display screen 30.

[0071] The host computer 10 is also used to send a working instruction to the robotic arm control module 101 when it receives a touch test instruction, and control the robotic arm 20 to draw lines on the vehicle display screen 30 through the robotic arm control module 101, and obtain touch data through the vehicle display screen 30.

[0072] It should be noted that the robotic arm control module 101 is used to control the robotic arm 20 to draw lines.

[0073] Understandably, robotic arms are among the most widely used automated mechanical devices in the field of robotics, found in industries such as industrial manufacturing, medical treatment, entertainment services, military, semiconductor manufacturing, and space exploration. Although they vary in form, they all share a common characteristic: the ability to receive commands and precisely position themselves at a point in three-dimensional (or two-dimensional) space to perform tasks.

[0074] In the specific implementation, the host computer controls the robotic arm through the UART interface, and uses a copper rod to draw a circle around the edge of the LCD303 of the vehicle display screen 30, so that the touch IC301 of the vehicle display screen 30 can obtain touch data.

[0075] The touch module 103 is used to receive and parse the touch data sent by the vehicle display screen 30 to obtain touch coordinate information.

[0076] The touch module 103 is also used to transmit the touch coordinate information to the drawing board page for drawing.

[0077] It should be noted that the touch coordinate information refers to the coordinates of points on the line drawn by the robotic arm 20.

[0078] Understandably, the touch module 103 receives and parses the touch data sent by the deserializer 302 of the vehicle display screen 30 to obtain touch coordinate information, and transmits the touch information and touch coordinate information to the drawing board page for drawing, drawing a line on the drawing board page that is consistent with the drawing trajectory of the robotic arm.

[0079] The video control module 102 is used to project the drawn canvas page onto the vehicle display screen 30 after parsing.

[0080] Understandably, the video control module 102 parses the lines drawn on the drawing board and projects them onto the LCD 303 of the vehicle display screen 30 via the LVDS interface.

[0081] The host computer 10 is also used to send a photo-taking command to the photo-taking device 40 control module, and control the photo-taking device 40 to take a photo of the drawing board page to obtain an image of the touched drawing line.

[0082] It should be noted that the camera control module 104 is used to control the camera 40 to take pictures.

[0083] It is understood that the photographing device 40 can be a color camera, which can obtain color images for easy detection and analysis. This embodiment does not impose specific limitations on this.

[0084] In practice, after the robotic arm 20 completes drawing the line, the host computer 10 controls a color camera via a USB interface to take a picture of the drawing page on the LCD 303 of the vehicle-mounted display screen 30, and obtain a color image of the line drawn by touch.

[0085] The host computer 10 is also used to detect the image of the touch-drawn line and determine whether the line is broken during the drawing process.

[0086] Understandably, the host computer 10 obtains color images of the touch-drawn lines via the USB interface to perform touch-drawn line breakage detection.

[0087] Furthermore, the vehicle-mounted display screen 30 includes a touch IC 301, a deserializer 302, and an LCD 303; the touch IC 301 is used to collect touch data from the vehicle-mounted display screen 30 and transmit it to the deserializer 302; the deserializer 302 is used to parse the touch data and send it to the touch module 103; the LCD 303 is used to display the drawing board page and the drawn drawing board page.

[0088] It should be noted that in Touch IC301, "touch" specifically refers to single-point or multi-point touch technology. IC, or integrated circuit, is a general term for semiconductor components, including: integrated circuit boards (IC); diodes and transistors; special electronic components, etc. Touch IC301 refers to the touch chip.

[0089] Understandably, the deserializer 302 is an interface circuit in high-speed data communication, playing an important role in short-distance chip interconnection. It can effectively reduce the number of pins and traces, and improve the communication data rate.

[0090] In a specific implementation, the touch IC 301 collects the touch data from the vehicle display screen 30 and transmits it to the deserializer 302 via the IIC interface. The deserializer 302 parses the touch data and sends it to the touch module 103 via the IIC interface.

[0091] In this embodiment, the host computer sends work instructions to the robotic arm control module to control the robotic arm to draw lines and obtain touch data. The touch module draws lines on the drawing board based on the touch data, and the camera control module controls the camera to take pictures of the drawing board to obtain images of the touch-drawn lines. The host computer detects the images of the touch-drawn lines to determine whether the lines are broken during drawing. This solves the problem of false judgment and misdetection in the current method of judging touch effects, which leads to products with broken touch lines flowing to the customer. It can quickly and effectively detect abnormal products with broken touch lines.

[0092] This invention also provides a method for detecting touch disconnection on a vehicle-mounted display screen, referring to... Figure 2 , Figure 2 This is a flowchart illustrating the first embodiment of the vehicle-mounted display screen touch disconnection detection method of the present invention.

[0093] In this embodiment, the in-vehicle display screen touch disconnection detection method includes the following steps:

[0094] Step S10: Upon receiving the touch test command, output the canvas page to the vehicle display screen.

[0095] It should be noted that the host computer refers to the computer that can directly issue control commands, generally a PC / hostcomputer / master computer / upper computer. The screen displays various signal changes (hydraulic pressure, water level, temperature, etc.). The commands issued by the host computer are first sent to the slave computer, which then interprets the commands into corresponding timing signals to directly control the corresponding equipment. The slave computer reads the equipment status data (usually analog quantities) from time to time, converts them into digital signals, and feeds them back to the host computer.

[0096] It's worth noting that a vehicle-mounted display screen, also known as a car monitor, is installed inside the vehicle and is specifically designed for use within the vehicle. There are two types: one is a television placed on a bus for viewing, essentially a car TV; the other is a smaller car monitor, typically with two video inputs—one for connecting to a car DVD player and the other for connecting to a reversing camera. Some also feature MP5 video playback and Bluetooth functionality. These displays can be used on vehicles and similar motorized vehicles, facilitating use while the vehicle is in motion. Simply put, a car TV is a mobile receiver for digital television (the difference from traditional digital television), and mainly includes a set-top box, LCD screen, antenna, and vehicle power supply.

[0097] It is understood that the canvas page is used for drawing lines, and the canvas page is black; this embodiment does not impose specific limitations on this.

[0098] In the specific implementation, when the host computer receives the touch test command, it outputs the canvas page to the LCD303 of the vehicle display screen 30.

[0099] Step S20: Control the robotic arm to draw lines on the vehicle display screen so that the vehicle display screen can obtain touch data.

[0100] Understandably, robotic arms are the most widely used automated mechanical devices in the field of robotics, found in industries such as industrial manufacturing, medical treatment, entertainment services, military, semiconductor manufacturing, and space exploration. Although they vary in form, they all share a common characteristic: the ability to receive commands and precisely position themselves at a point in three-dimensional (or two-dimensional) space to perform tasks.

[0101] In practice, the host computer controls the robotic arm via a UART interface, and the robotic arm moves a copper rod around the edge of the LCD screen of the vehicle display, so that the touch IC of the vehicle display can obtain touch data.

[0102] Furthermore, in order to perform the line drawing operation, before step S20, the method further includes: performing a state detection to determine whether the line drawing mode has been entered; if the line drawing mode has been entered, then the step of controlling the robotic arm to draw lines on the vehicle display screen to enable the vehicle display screen to obtain touch data is executed; if the line drawing mode has not been entered, then the method of performing a state detection to determine whether the line drawing mode has been entered is returned.

[0103] It is understandable that the host computer controls the robotic arm to draw lines when it is in line drawing mode. Therefore, a status detection is required before drawing lines. When the host computer is detected to be in line drawing mode, the robotic arm is controlled to draw lines. When the host computer is detected to be not in line drawing mode, the system returns and continues to detect until the host computer is detected to be in line drawing mode.

[0104] Furthermore, after step S20, the method further includes: reading the motion state of the robotic arm and determining whether the line drawing is completed; when the robotic arm is still in motion, determining that the line drawing is not completed and executing the step of reading the motion state of the robotic arm and determining whether the line drawing is completed; when the robotic arm is in a stopped state, determining that the line drawing is completed and retracting the robotic arm.

[0105] Understandably, when entering the line drawing mode, the movement status of the robotic arm is monitored in real time. After the robotic arm completes the action of drawing a circle along the edge of the LCD of the vehicle display, it stops moving. When the robotic arm is detected to be in a stopped state, it is determined that the line drawing is completed and the robotic arm is retracted.

[0106] like Figure 3 As shown, Figure 3 This is a schematic diagram of the judgment process of the vehicle display screen touch line breakage detection method in this embodiment. In the diagram, it is determined whether to enter the line drawing mode. If not, it returns and continues to judge whether to enter the line drawing mode until it enters the line drawing mode. If it does, it controls the robotic arm to draw a line and judges whether the line drawing is completed. If not, it returns and continues to judge whether the line drawing is completed until the line drawing is completed. Otherwise, it retracts the robotic arm, controls the camera to take a picture, and analyzes the touch line drawing image.

[0107] Step S30: Receive and parse the touch data sent by the vehicle display screen to obtain touch coordinate information.

[0108] It should be noted that the touch coordinate information refers to the coordinates of points on the line drawn by the robotic arm.

[0109] Step S40: The touch coordinate information is transmitted to the drawing board for drawing, and the drawn drawing board is parsed and projected onto the vehicle display screen.

[0110] Understandably, the host computer receives and parses the touch data sent by the deserializer of the vehicle display screen to obtain touch coordinate information. It then transmits the touch information and touch coordinate information to the drawing board for drawing. A line consistent with the drawing trajectory of the robotic arm is drawn on the drawing board, and the line drawn on the drawing board is then parsed and projected onto the LCD of the vehicle display screen.

[0111] Step S50: Control the camera device to take a picture of the drawing board page to obtain an image of the touched drawing line.

[0112] It is understood that the photographing device can be a color camera, which can obtain color images for easy detection and analysis. This embodiment does not impose specific limitations on this.

[0113] In practice, after the robotic arm completes drawing the line, the host computer controls a color camera via a USB interface to take a picture of the drawing screen on the vehicle's LCD display, obtaining a color image of the drawn line.

[0114] Step S60: Detect the image of the touch-drawn line to determine whether the line is broken during drawing.

[0115] Understandably, the host computer 10 obtains color images of the touch-drawn lines via the USB interface to detect broken lines.

[0116] This embodiment uses a host computer to control a robotic arm to draw lines, plotting the line trajectory and projecting it onto an LCD screen while taking a picture to obtain an image of the drawn lines. The image is then analyzed to determine if any lines are broken during the drawing process. This addresses the risks of misjudgment and false detection inherent in existing technologies that rely on human subjective judgment of touch effects, leading to defective products with broken lines reaching customers. It also addresses the issue that manual inspection is no longer sufficient to meet production demands as production lines become more automated. This embodiment can quickly and effectively detect defective products with broken lines.

[0117] refer to Figure 4 , Figure 4 This is a flowchart illustrating the second embodiment of the vehicle-mounted display screen touch disconnection detection method of the present invention.

[0118] Based on the first embodiment described above, in the vehicle display screen touch disconnection detection method of this embodiment, step S60 includes:

[0119] Step S601: Detect the image of the touch-drawn line, and when a line with a preset trajectory is detected, locate the line with the preset trajectory.

[0120] It should be noted that the preset trajectory is the drawing trajectory of the robotic arm, and this embodiment does not impose specific limitations on it.

[0121] It is understandable that the line trajectory on the image of the touch-drawn line is detected and compared with a preset trajectory. When the line trajectory on the image of the touch-drawn line matches the preset trajectory, the line of the preset trajectory on the image of the touch-drawn line is located.

[0122] Step S602: Extract the image of the touch-drawn line by using a preset rectangular area to obtain an image of the touch-drawn line area.

[0123] It should be noted that the preset rectangular area is the line area on the image where the touch line is drawn, and this embodiment does not impose specific limitations on it.

[0124] It is understandable that by pre-setting a rectangular area to crop the drawn area on the image of the touch-drawn line, and then analyzing the image of the touch-drawn line area, the detection speed can be accelerated.

[0125] Step S603: Analyze the image of the touch-drawn area to obtain a preset number of connected regions.

[0126] It should be noted that a connected region refers to an image region composed of foreground pixels with the same pixel value and adjacent positions.

[0127] Furthermore, in order to highlight the drawn lines in the image and eliminate interference, step S603 includes: normalizing the image of the touched line area to obtain a normalized image; converting the normalized image to obtain a target format image; binarizing the target format image to obtain a binarized image; performing a dilation operation on the binarized image and then an erosion operation; and extracting a preset number of connected regions from the binarized image after the erosion operation.

[0128] It should be noted that image normalization refers to the process of performing a series of standard processing transformations on an image to transform it into a fixed standard form. This standard image is called a normalized image. The input image has a pixel value ranging from 0 to 255. For computers, this value is too large. Therefore, pixel value normalization generally involves dividing the pixel value by 255 to obtain a value between 0 and 1 for calculation. Normalizing the touch-drawn area image can convert it into a standard mode, preventing the influence of affine transformation and reducing the influence of geometric transformation.

[0129] Understandably, the format conversion of a normalized image, that is, converting a normalized image in RGB format to HSV format, stems from two needs: hardware implementation and display effect adjustment. The former satisfies the need for simple and efficient implementation in the specific processing, while the latter adjusts according to the characteristics of human eye recognition, making it easier to achieve the display effect expected by the human eye.

[0130] It is worth noting that the color of the lines drawn in the image is white. Binarization is the process of color binarizing the white in the HSV format image. Image binarization is the process of setting the gray value of the pixels in the image to 0 or 255, which is to make the entire image present a clear black and white effect. Image binarization greatly reduces the amount of data in the image, thereby highlighting the outline of the target, that is, the outline of the lines drawn in the image.

[0131] Furthermore, to eliminate edge interference noise, the erosion operation performed after the dilation operation on the binarized image includes: obtaining a structuring element that moves on the binarized image; using the center of the structuring element as an anchor point and obtaining the pixel value of the anchor point; calculating the maximum and minimum pixel values ​​of the binarized image covered by the structuring element; replacing the pixel value of the anchor point with the maximum pixel value to complete the dilation operation; and replacing the pixel value of the anchor point after the dilation operation with the minimum pixel value to complete the erosion operation.

[0132] It should be noted that the structuring element is a key factor involved in morphological operations. When using morphological methods for image processing, an auxiliary tool called the structuring element is used. The structuring element is a set of pixels with known shape and size, and usually a center is defined for the structuring element.

[0133] It is worth noting that the pixel value is a value assigned by the computer when the original image is digitized. It represents the average brightness information of a small square in the original, or the average reflection (transmission) density information of that small square. When converting a digital image into a halftone image, the halftone dot area ratio (halftone dot percentage) is directly related to the pixel value (grayscale value) of the digital image. That is, the halftone dot represents the average brightness information of a small square in the original by its size.

[0134] Understandably, dilation operations can lengthen or thicken lines in a binarized image, while erosion operations can eliminate boundaries by shrinking them inwards, thus removing small and meaningless elements.

[0135] Step S604: Based on the preset number of connected areas, determine whether the touch line is broken.

[0136] It is understandable that after filtering out interference areas from the preset number of connected regions, a target number of connected regions is obtained, and the touch line is used to determine whether a broken line occurs.

[0137] Furthermore, in order to filter out interference areas, the step of determining whether the touch line is broken based on the preset number of connected regions includes: filtering the preset number of connected regions based on the size characteristics of the touch line area, removing connected regions that do not meet the conditions, and obtaining a target number of connected regions; determining whether the target number of connected regions is equal to a preset value; if the target number of connected regions is equal to the preset value, then the touch line is normal.

[0138] It should be noted that the preset value can be set by the user, and the preset value is 1. This embodiment does not impose any specific restrictions on this.

[0139] Understandably, connected regions that do not meet the criteria are filtered based on the size of the touch-drawn area. When there is only one connected region, it indicates that the touch drawing is normal and there is no broken line phenomenon.

[0140] Furthermore, after determining whether the target number of connected regions is equal to a preset value, the method further includes: if the target number of connected regions is not equal to the preset value, then a broken line occurs during the touch drawing process.

[0141] Understandably, when the number of connected regions is not equal to one, it indicates that a broken line has occurred during the touch drawing process, and the product has an abnormality.

[0142] like Figure 5 As shown, Figure 5 This is a schematic diagram of the image analysis process for the vehicle display screen touch line breakage detection method in this embodiment. In the diagram, the RGB image of the touch line is read, the touch display area is cropped, the size of the RGB image is normalized, the RGB image is converted to HSV, the white line in the HSV image is binarized, the binarized image is subjected to dilation operation to connect the regions, the connected regions are subjected to erosion operation to remove noise, the connected regions are extracted, the interference regions are filtered, and it is determined whether there is only one connected region. If so, the touch line is normal; otherwise, the touch line is broken.

[0143] This embodiment extracts the drawn area from the image of the touch-drawn line to obtain an image of the touch-drawn line area. The image of the touch-drawn line area is then analyzed and processed to obtain a preset number of connected regions and filter out interference regions to obtain a target number of connected regions. The number of connected regions is used to determine whether the touch-drawn line is broken. This increases the detection speed and can quickly and effectively detect products with broken touch lines, while also meeting the inspection requirements of automated production lines.

[0144] It should be understood that the above are merely illustrative examples and do not constitute any limitation on the technical solutions of the present invention. In specific applications, those skilled in the art can make settings as needed, and the present invention does not impose any restrictions on this.

[0145] It should be noted that the workflow described above is merely illustrative and does not limit the scope of protection of this invention. In practical applications, those skilled in the art can select some or all of the workflow to achieve the purpose of this embodiment according to actual needs, and no restrictions are imposed here.

[0146] In addition, for technical details not described in detail in this embodiment, please refer to the vehicle display screen touch disconnection detection method provided in any embodiment of the present invention, which will not be repeated here.

[0147] Furthermore, it should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0148] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0149] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as read-only memory (ROM) / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0150] The above are merely preferred embodiments of the present invention and do not limit the patent scope of the present invention. Any equivalent structural or procedural transformations made based on the content of the present invention's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of the present invention.

Claims

1. A vehicle-mounted display screen touch disconnection detection system, characterized in that, The vehicle display screen touch line breakage detection system includes a host computer, a robotic arm, a vehicle display screen, and a camera. The host computer includes a robotic arm control module, a video control module, a touch module, and a camera control module. The camera is set at the target position of the vehicle display screen. The robotic arm is equipped with a line drawing component, which draws lines on the vehicle display screen. The host computer is used to output a drawing board page to the vehicle display screen when it receives a touch test command; The host computer is also used to send a working instruction to the robotic arm control module when it receives a touch test instruction, and control the robotic arm to draw lines on the vehicle display screen through the robotic arm control module, and obtain touch data through the vehicle display screen; The touch module is used to receive and parse the touch data sent by the vehicle display screen to obtain touch coordinate information; The touch module is also used to transmit the touch coordinate information to the drawing board page for drawing; The video control module is used to project the drawn canvas page onto the vehicle display screen after parsing. The host computer is also used to send a photo-taking command to the photo-taking device control module, and control the photo-taking device to take a photo of the drawing board page to obtain an image of the touch-drawn line; The host computer is also used to detect the image of the touch-drawn line and determine whether the line is broken during the drawing process.

2. The system as described in claim 1, characterized in that, The vehicle-mounted display screen includes a deserializer, an LCD, and a touch IC; The touch IC is used to collect touch data from the vehicle display screen and transmit it to the deserializer; The deserializer is used to parse the touch data and send it to the touch module; The LCD is used to display the drawing board page and the drawn drawing board page.

3. A method for detecting touch line breakage on a vehicle-mounted display screen, characterized in that, Applied to the host computer as described in claim 1 or 2, the method includes: Upon receiving a touch test command, the whiteboard page is output to the vehicle display screen; The robotic arm is controlled to draw lines on the vehicle-mounted display screen so that the display screen can receive touch data. Receive and parse the touch data sent by the vehicle display screen to obtain touch coordinate information; The touch coordinate information is transmitted to the drawing board for drawing, and the drawn drawing board is parsed and projected onto the vehicle display screen. Control the camera to take a picture of the drawing board and obtain an image of the touched line; The image of the touch-drawn line is detected to determine whether the line is broken during the drawing process.

4. The method as described in claim 3, characterized in that, Before the controlled robotic arm draws lines on the vehicle-mounted display screen to allow the display screen to receive touch data, the system further includes: Perform a status check to determine whether to enter line drawing mode; If the drawing mode has been entered, then the step of controlling the robotic arm to draw lines on the vehicle display screen is executed so that the vehicle display screen can obtain touch data. If the line drawing mode is not entered, return to the step of performing status detection to determine whether the line drawing mode has been entered.

5. The method as described in claim 3, characterized in that, After the controlled robotic arm draws lines on the vehicle-mounted display screen to obtain touch data, the system further includes: Read the motion state of the robotic arm to determine whether the line drawing is complete; When it is detected that the robotic arm is still in motion, it is determined that the line drawing is not completed and the step of reading the movement state of the robotic arm and determining whether the line drawing is completed is executed. When the robot arm is detected to be in a stopped state, the marking is determined to be complete and the robot arm is retracted.

6. The method as described in claim 3, characterized in that, The step of detecting the image of the touch-drawn line and determining whether the line is broken during drawing includes: The image of the touch-drawn line is detected, and when a line with a preset trajectory is detected, the line with the preset trajectory is located. The image of the touch-drawn line is cropped by a preset rectangular area to obtain an image of the touch-drawn line area; The image of the touch-drawn area is analyzed to obtain a preset number of connected regions; Based on the preset number of connected regions, determine whether the touch line is broken.

7. The method as described in claim 6, characterized in that, The step of analyzing the image of the touch-drawn area to obtain a target number of connected regions includes: The image of the touch-drawn area is normalized to obtain a normalized image; The normalized image is converted to the target format image. The target format image is binarized to obtain a binarized image; The binarized image is then subjected to dilation followed by erosion. Extract the binarized image after the erosion operation to obtain a preset number of connected regions.

8. The method as described in claim 7, characterized in that, The step of performing an erosion operation after dilation on the binarized image includes: Obtain the structuring element that moves on the binarized image; The center of the structural element is used as the anchor point, and the pixel value of the anchor point is obtained; Calculate the maximum and minimum pixel values ​​of the binarized image under the coverage of the structuring element; The pixel value of the anchor point is replaced with the maximum pixel value to complete the dilation operation; The pixel values ​​of the anchor points after the dilation operation are replaced with the minimum pixel value to complete the erosion operation.

9. The method as described in claim 6, characterized in that, The step of determining whether a broken line appears in the touch line based on the preset number of connected regions includes: The preset number of connected regions are filtered based on the size characteristics of the touch drawing area to remove connected regions that do not meet the conditions, thereby obtaining the target number of connected regions. Determine whether the target number of connected regions is equal to a preset value; If the target number of connected regions equals the preset value, then touch drawing will work normally.

10. The method as described in claim 9, characterized in that, After determining whether the target number of connected regions is equal to a preset value, the method further includes: If the target number of connected regions is not equal to the preset value, a broken line will occur during the touch drawing process.

Images