Picture display method, device and equipment
By displaying the first and second sub-screens of the package to be detected on the client display interface, and using the target zoom ratio and target image output speed for screen processing, the problem of unsmooth and delayed images in the security check scene is solved, and efficient and real-time image output is achieved.
Patent Information
- Application Number
- CN202510244809.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-03-03
- Publication Date
- 2025-03-28
- Estimated Expiration
- 2045-03-03
AI Technical Summary
In security check scenarios, it is difficult for the prior art to achieve smooth and real-time image production of the image to be detected, and there are problems of image production lag and delay.
By displaying the first sub-screen and the second sub-screen to be detected on the client display interface, the original screen is scaled using the target zoom ratio, and the horizontal movement of the second sub-screen is determined based on the target image output speed, real-time update and splicing of the screen are achieved.
It improves the smooth picture output of the package to be detected, solves the problem of stuttering picture output, ensures the timeliness of picture output, and makes the difference between the picture displayed by the client and the picture collected by the security inspection device no more than the preset time, reducing the time delay difference.
Smart Images

Figure CN119718530A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of security inspection technology, and in particular to a screen display method, device and equipment. Background Art
[0002] In security inspection scenarios such as logistics, subways, and airports, multiple security inspection devices (such as security inspection machines) can be deployed. After the package to be inspected is placed on the security inspection device, the security inspection device can collect image data of the package to be inspected and send the image data of the package to be inspected to the client. The client generates an original image based on the image data of the package to be inspected and displays the original image on the display interface, so that the staff can view the original image displayed on the display interface and then analyze whether there is any abnormality in the package to be inspected. Summary of the invention
[0003] The present application provides a screen display method, which is applied to a client, wherein the image data of a package to be detected is stored in a designated storage medium of the client, and the method comprises: Each time the displayed picture of the package to be detected displayed on the display interface is updated, the picture to be displayed corresponding to the package to be detected is obtained, and the picture to be displayed includes a first sub-picture and a second sub-picture; wherein, if the target zoom ratio of the package to be detected increases, the first sub-data corresponding to the displayed picture is selected from the image data, an original picture is generated based on the first sub-data, and the original picture is zoomed based on the target zoom ratio to obtain the first sub-picture; if the target zoom ratio remains unchanged, the first sub-picture is the displayed picture; wherein, based on the obtained target image output speed, the second sub-data is selected from the image data, and the second sub-picture is generated based on the second sub-data, and the target image output speed indicates the pixel width of the horizontal movement corresponding to the second sub-picture; Displaying the first sub-picture and the second sub-picture through the display interface; The second sub-picture is spliced behind the first sub-picture.
[0004] The present application provides a screen display device, which is applied to a client, wherein a designated storage medium of the client stores image data of a package to be detected, and the device comprises: a processing module, configured to obtain a to-be-displayed picture corresponding to the to-be-detected package each time the displayed picture of the to-be-detected package displayed on the display interface is updated, the to-be-displayed picture including a first sub-picture and a second sub-picture; wherein, when obtaining the first sub-picture, if the target zoom ratio of the to-be-detected package increases, the first sub-data corresponding to the displayed picture is selected from the image data, an original picture is generated based on the first sub-data, and the original picture is zoomed based on the target zoom ratio to obtain the first sub-picture; if the target zoom ratio remains unchanged, the first sub-picture is the displayed picture; wherein, when obtaining the second sub-picture, the second sub-data is selected from the image data based on the acquired target image output speed, the second sub-picture is generated based on the second sub-data, and the target image output speed indicates the pixel width of the lateral movement corresponding to the second sub-picture; A display module, configured to display the first sub-picture and the second sub-picture through the display interface; The second sub-picture is spliced behind the first sub-picture.
[0005] The present application provides an electronic device, comprising: a processor and a machine-readable storage medium, wherein the machine-readable storage medium stores machine-executable instructions that can be executed by the processor; the processor is used to execute the machine-executable instructions to implement the screen display method of the above example.
[0006] The present application provides a computer program product, which includes a computer program. When the computer program is executed by a processor, the screen display method of the above example is implemented.
[0007] The present application provides a machine-readable storage medium, which stores machine-executable instructions that can be executed by a processor; wherein the processor is used to execute the machine-executable instructions, and implements the above-mentioned example screen display method when executing the machine-executable instructions.
[0008] It can be seen from the above technical solutions that in the embodiment of the present application, the first sub-screen and the second sub-screen corresponding to the package to be detected can be displayed through the display interface to improve the screen display effect, ensure the good display of the package to be detected, and facilitate the staff to view the first sub-screen and the second sub-screen displayed on the display interface, and then analyze whether there is an abnormality in the package to be detected, so as to realize remote real-time image judgment. The first sub-screen is obtained by scaling the original screen by the target zoom ratio, and the first sub-screen is displayed on the display interface, which can ensure the smooth output of the package to be detected, solve the problem of image jamming, and improve the smoothness of image output. The second sub-screen is determined based on the target image output speed, and the second sub-screen is displayed on the display interface, which can ensure the real-time output of the package to be detected, ensure the timeliness of the image output, so that the image displayed by the client and the image collected by the security inspection device do not differ by more than a preset time (such as 0.3s), and reduce the delay difference between the client and the security inspection device. BRIEF DESCRIPTION OF THE DRAWINGS
[0009] Figure 1 It is a flowchart of a screen display method in one embodiment of the present application; Figure 2 is a schematic diagram of a display interface of a client in one embodiment of the present application; Figure 3 It is a schematic diagram of a display interface in one embodiment of the present application showing images before and after cropping; Figure 4 It is a flowchart of a screen display method in one embodiment of the present application; Figure 5 is a schematic diagram of updating the starting coordinates of the target in one embodiment of the present application; Figure 6 It is a flowchart of a screen display method in one embodiment of the present application; Figure 7 It is a flowchart of a screen display method in one embodiment of the present application; Fig. 8A It is a flowchart of a screen display method in one embodiment of the present application; Figure 8B is a schematic diagram of real-time movement of a package to be detected in one embodiment of the present application; Fig. 9A is a schematic structural diagram of a screen display device in one embodiment of the present application; Fig. 9B It is a hardware structure diagram of an electronic device in one embodiment of the present application. DETAILED DESCRIPTION
[0010] In the embodiment of the present application, a screen display method is proposed, which can be applied to an electronic device, such as a client, and the image data of the package to be detected is stored in a designated storage medium of the client. Figure 1 FIG. 1 is a flow chart of the screen display method, which may include: Step 101, each time the displayed picture of the package to be detected displayed on the display interface is updated, the picture to be displayed corresponding to the package to be detected is obtained, and the picture to be displayed includes a first sub-picture and a second sub-picture. Wherein, if the target zoom ratio of the package to be detected increases, the first sub-data corresponding to the displayed picture is selected from the image data of the package to be detected, the original picture is generated based on the first sub-data, and the original picture is scaled based on the target zoom ratio to obtain the first sub-picture; if the target zoom ratio remains unchanged, the first sub-picture is the displayed picture; wherein, based on the obtained target image output speed, the second sub-data is selected from the image data of the package to be detected, and the second sub-picture is generated based on the second sub-data, and the target image output speed is used to indicate the pixel width of the horizontal movement corresponding to the second sub-picture.
[0011] Step 102: display the first sub-picture and the second sub-picture through the display interface; wherein, when displaying the first sub-picture and the second sub-picture, the second sub-picture is spliced behind the first sub-picture.
[0012] Exemplarily, the display interface of the client may include a main-view display area and a top-view display area, and displaying the first sub-picture and the second sub-picture through the display interface may include but is not limited to: displaying the first sub-picture of the main view and the second sub-picture of the main view through the main-view display area; and displaying the first sub-picture of the top-view and the second sub-picture of the top-view through the top-view display area. The image data of the package to be detected may include main-view image data and top-view image data, and the main-view image data may be used to obtain the first sub-picture of the main view and the second sub-picture of the main view, and the top-view image data may be used to obtain the first sub-picture of the top-view and the second sub-picture of the top-view.
[0013] Exemplarily, the process of obtaining the target zoom ratio of the package to be detected may include, but is not limited to: determining whether a data slice of the package to be detected is newly added in the designated storage medium each time the displayed screen of the package to be detected is updated; wherein, the image data of the package to be detected includes multiple data slices, the security inspection device sends each data slice to the client in turn, and the client stores each data slice in turn to the designated storage medium. If not, the stored zoom ratio is used as the target zoom ratio. And / or, if so, the target cropping value is determined based on the cropping value of the newly added data slice and the cropping value of each stored data slice, and the package display height is determined based on the target cropping value; the initial zoom ratio is determined based on the package display height and the height of the viewing angle display area of the display interface; the target zoom ratio is determined based on the initial zoom ratio.
[0014] After obtaining the target zoom ratio (eg, using a stored zoom ratio as the target zoom ratio, or determining the target zoom ratio based on the initial zoom ratio), the target zoom ratio may be compared with the stored zoom ratio.
[0015] If the target zoom ratio is greater than the stored zoom ratio, that is, the target zoom ratio increases, in step 101, it is necessary to select the first sub-data corresponding to the displayed picture from the image data of the package to be detected, and obtain the first sub-picture based on the first sub-data. In this case, it is necessary to store the target zoom ratio, that is, to use this target zoom ratio as the stored zoom ratio (when the displayed picture of the package to be detected is updated next time, the stored zoom ratio is the target zoom ratio), replacing the currently stored zoom ratio.
[0016] If the target zoom ratio is equal to the stored zoom ratio, that is, the target zoom ratio remains unchanged, in step 101, the first sub-image is the displayed image, that is, the displayed image is not zoomed. In this case, the stored zoom ratio can be kept unchanged, so that there is no need to replace the currently stored zoom ratio. Alternatively, the target zoom ratio can also be stored, that is, the target zoom ratio is used as the stored zoom ratio.
[0017] Exemplarily, determining a target cropping value based on the cropping value of the newly added data slice and the cropping values of the stored data slices may include, but is not limited to: selecting a minimum upper cropping starting value from the upper cropping starting value of the newly added data slice and the upper cropping starting values of the stored data slices, selecting a maximum lower cropping starting value from the lower cropping starting value of the newly added data slice and the lower cropping starting values of the stored data slices, and determining the minimum upper cropping starting value and the maximum lower cropping starting value as the target cropping value, that is, the target cropping value includes the minimum upper cropping starting value and the maximum lower cropping starting value.
[0018] Exemplarily, determining the package display height based on the target cropping value may include, but is not limited to: determining the package display height based on the actual height of the package of the data slice, the minimum upper cropping starting value, and the maximum lower cropping starting value; wherein the actual height of the package may represent the height of the image captured by the security inspection equipment, and the package display height may represent the height of the image displayed in the viewing angle display area.
[0019] Exemplarily, determining the initial zoom ratio based on the package display height and the height of the viewing angle display area of the display interface may include, but is not limited to: calculating the ratio between the height of the viewing angle display area of the display interface and the package display height; if the ratio is less than 1, determining the initial zoom ratio to be the ratio; or, if the ratio is not less than 1, determining the initial zoom ratio to be 1.
[0020] Exemplarily, determining the target zoom ratio based on the initial zoom ratio may include, but is not limited to: calculating a first product value between a frame interval parameter, an initial zoom ratio, and an acquired recommended package speed, and rounding down the first product value to obtain an initial image output speed; wherein the recommended package speed may be used to indicate a pixel width of lateral movement. If a second product value between the initial zoom ratio and the recommended package speed is greater than 1, the frame interval parameter may be 1; if the second product value is less than 1, the frame interval parameter may be greater than 1, and the frame interval parameter is used to make the first product value greater than or equal to 1.
[0021] If the frame interval parameter is 1 and the initial image output speed is greater than or equal to 1, the target zoom ratio can be determined based on the quotient of the initial image output speed and the recommended package speed; if the frame interval parameter is greater than 1, and / or the initial image output speed is less than 1, the target zoom ratio can be determined to be the initial zoom ratio.
[0022] Exemplarily, displaying the first sub-screen and the second sub-screen through the display interface may include, but is not limited to: starting from the target starting coordinates of the display interface, displaying the first sub-screen and the second sub-screen in sequence, the target starting coordinates being determined based on the current ending coordinates and the target zoom ratio, and the current ending coordinates representing the ending coordinates when the screen of the package to be detected was last displayed. Wherein, if the target zoom ratio remains unchanged, the target starting coordinates remain unchanged; and / or, if the target zoom ratio increases, the interval pixel width between the target starting coordinates and the current ending coordinates of the package to be detected is determined based on the current ending coordinates, the target zoom ratio and the stored zoom ratio, and the target starting coordinates are determined based on the interval pixel width and the current ending coordinates.
[0023] Exemplarily, the process of acquiring the target image output speed may include, but is not limited to: determining the undisplayed pixel width corresponding to the package to be detected; wherein, each time a data slice of the package to be detected is added to the designated storage medium, the undisplayed pixel width is increased based on the pixel width of the data slice; each time the second sub-data is selected from the image data based on the target image output speed, the undisplayed pixel width is reduced based on the pixel width of the lateral movement indicated by the target image output speed. If the undisplayed pixel width is greater than the pixel width of the data slice, and the package to be detected is not displayed on the display interface for the first time, it is determined whether the undisplayed pixel width is not greater than the product value between the acquired initial image output speed and the configured maximum time interval.
[0024] If so, the stored image output speed is determined as the target image output speed, and the target image output speed is stored; and / or, if not, the initial image output speed is determined as the target image output speed, and the target image output speed is stored.
[0025] Exemplarily, the process of acquiring the target output speed may include but is not limited to: if the undisplayed pixel width is not greater than the pixel width of the data slice, and the stored output speed is not 0, then the stored output speed is determined as the target output speed, and the target output speed is stored.
[0026] And / or, if the stored image output speed is 0, determine whether the frame interval is greater than a fixed frame number; wherein the fixed frame number is determined based on a quotient of a pixel width of the data slice and an acquired recommended speed of the package.
[0027] If not, add 1 to the frame interval, determine the target image output speed to be 0, store the target image output speed, and the initial value of the frame interval is 0; and / or, if yes, determine the initial image output speed as the target image output speed, store the target image output speed, and update the frame interval to 0.
[0028] Exemplarily, when the package to be detected is displayed on the display interface for the first time, the third sub-image corresponding to the package to be detected can be obtained, and the third sub-image can be displayed through the display interface. Wherein, based on the obtained target image output speed, the third sub-data is selected from the image data stored in the designated storage medium, and the third sub-image is generated based on the third sub-data. Wherein, the process of obtaining the target image output speed may include but is not limited to: Determine the undisplayed pixel width corresponding to the package to be detected; if the undisplayed pixel width is greater than the pixel width of the data slice, determine whether the undisplayed pixel width is greater than the product of the acquired initial image output speed and the configured maximum time interval; if not, determine the initial image output speed as the target image output speed, and store the target image output speed; and / or, if so, determine the target image output speed based on the initial image output speed and the configured target value, and store the target image output speed; the target image output speed is greater than the initial image output speed.
[0029] It can be seen from the above technical solutions that in the embodiment of the present application, the first sub-screen and the second sub-screen corresponding to the package to be detected can be displayed through the display interface to improve the screen display effect, ensure the good display of the package to be detected, and facilitate the staff to view the first sub-screen and the second sub-screen displayed on the display interface, and then analyze whether there is an abnormality in the package to be detected, so as to realize remote real-time image judgment. The first sub-screen is obtained by scaling the original screen by the target zoom ratio, and the first sub-screen is displayed on the display interface, which can ensure the smooth output of the package to be detected, solve the problem of image jamming, and improve the smoothness of image output. The second sub-screen is determined based on the target image output speed, and the second sub-screen is displayed on the display interface, which can ensure the real-time output of the package to be detected, ensure the timeliness of the image output, so that the image displayed by the client and the image collected by the security inspection device do not differ by more than a preset time (such as 0.3s), and reduce the delay difference between the client and the security inspection device.
[0030] The above technical solutions of the embodiments of the present application are described below in combination with specific application scenarios.
[0031] In security inspection scenarios such as logistics, subways, and airports, multiple security inspection devices (such as security inspection machines) and clients (also called image recognition clients) can be deployed. The client is used to receive image data of the package to be inspected. The client can be a PC, laptop, etc. There is no restriction on the type of client.
[0032] The security inspection device may include a conveying device and a collecting device. The package to be inspected may be placed on the conveying device and transported by the conveying device. During the transportation of the package to be inspected, the collecting device collects image data of the package to be inspected. In this way, after obtaining the image data of the package to be inspected, the security inspection device may send the image data of the package to be inspected to the client.
[0033] After receiving the image data of the package to be detected, the client can store the image data of the package to be detected in a designated storage medium (i.e., a carrier for storing data, such as a memory, a hard disk, etc.). In this way, the client can read the image data of the package to be detected from the designated storage medium, generate an original picture based on the image data of the package to be detected, and display the original picture on the display interface of the client, so that the staff can view the original picture displayed on the display interface and then analyze whether there is any abnormality in the package to be detected.
[0034] Exemplarily, the number of clients may be at least one, and for each client, the client may correspond to multiple security inspection devices at the same time. Based on this, multiple security inspection devices may send image data of packages to be inspected to the same client. In this case, the packages to be inspected of multiple security inspection devices may be uniformly displayed and processed by the same client, thereby improving the image recognition efficiency of the packages to be inspected and optimizing the processing flow of security inspection data. Alternatively, the client may correspond to a security inspection device alone, based on which one security inspection device sends image data of the package to be inspected to one client.
[0035] Exemplarily, when collecting image data of the package to be inspected, the image data of the package to be inspected can be package sliced, that is, the package to be inspected can be cut into several package parts, and the security inspection equipment collects the data slices of each package part through the collection device, and the data slices of all the package parts constitute the image data of the package to be inspected, that is, the image data of the package to be inspected includes multiple data slices.
[0036] For example, the package to be inspected is cut into package part 1, package part 2, and package part 3. When the package to be inspected is transported by a conveying device, when package part 1 is in the field of view of the collection device, the data slice 1 for package part 1 is collected by the collection device, and the security inspection device sends the data slice 1 to the client, and the client stores the data slice 1 in a designated storage medium. When package part 2 is in the field of view of the collection device, the data slice 2 for package part 2 is collected by the collection device, and the data slice 2 is sent to the client, and the client stores the data slice 2 in the designated storage medium. When package part 3 is in the field of view of the collection device, the data slice 3 for package part 3 is collected by the collection device, and the data slice 3 is sent to the client, and the client stores the data slice 3 in the designated storage medium.
[0037] In summary, the security inspection device sends data slice 1, data slice 2 and data slice 3 to the client in sequence, and the client stores data slice 1, data slice 2 and data slice 3 in sequence.
[0038] Exemplarily, when data slice 1 is already stored in the designated storage medium, there is no need to wait for data slice 2 and data slice 3. The client directly reads data slice 1 from the designated storage medium, generates sub-picture 1 based on data slice 1, and displays sub-picture 1 on the display interface, thereby reducing the waiting time for data slices and displaying the complete picture of the package to be detected on the display interface as soon as possible. When data slice 2 is already stored in the designated storage medium, the client reads data slice 2 from the designated storage medium, generates sub-picture 2 based on data slice 2, and displays sub-picture 2 on the display interface. When data slice 3 is already stored in the designated storage medium, the client reads data slice 3 from the designated storage medium, generates sub-picture 3 based on data slice 3, and displays sub-picture 3 on the display interface. At this point, the complete picture of the package to be detected can be displayed on the display interface, and the complete picture of the package to be detected can include sub-picture 1, sub-picture 2, and sub-picture 3.
[0039] Exemplarily, when collecting image data of a package to be inspected, the security inspection device may collect the main view image data of the package to be inspected through the collection device, and collect the top view image data of the package to be inspected through the collection device. For example, the main view image data may be the main view image data of the package to be inspected, and the top view image data may be the top view image data of the package to be inspected.
[0040] For example, when the package to be inspected is transported by the conveying device, when the package part 1 is in the field of view of the acquisition device, the data slice 11 of the main view and the data slice 12 of the top view for the package part 1 are collected by the acquisition device, and the security inspection device sends the data slice 11 of the main view and the data slice 12 of the top view to the client, and the client stores the data slice 11 and the data slice 12 in the designated storage medium. When the package part 2 is in the field of view of the acquisition device, the data slice 21 of the main view and the data slice 22 of the top view for the package part 2 are collected by the acquisition device, and the security inspection device sends the data slice 21 of the main view and the data slice 22 of the top view to the client, and the client stores the data slice 21 and the data slice 22 in the designated storage medium. When the package part 3 is in the field of view of the acquisition device, the data slice 31 of the main view and the data slice 32 of the top view for the package part 3 are collected by the acquisition device, and the security inspection device sends the data slice 31 of the main view and the data slice 32 of the top view to the client, and the client stores the data slice 31 and the data slice 32 in the designated storage medium. Data slices 11, 21 and 31 constitute the main-view image data of the package to be detected, and data slices 12, 22 and 32 constitute the top-view image data of the package to be detected.
[0041] Exemplarily, the display interface of the client may include a main viewing angle display area (hereinafter referred to as the main viewing angle display area) and a top-view viewing angle display area (hereinafter referred to as the top-view viewing angle display area), see Figure 2 The figure shows a schematic diagram of the display interface of the client. The title bar is used to display the current application name, file name, etc., and the information / button bar is used to display information and / or buttons. There is no restriction on the content of the title bar and the information / button bar.
[0042] The main viewing angle display area is used to display the main viewing angle picture corresponding to the main viewing angle image data (i.e. the main viewing angle picture of the package to be detected, Figure 2 The main perspective in the figure represents the main perspective picture), and the bird's-eye view display area is used to display the bird's-eye view picture corresponding to the bird's-eye view image data (that is, the bird's-eye view picture of the package to be detected).
[0043] For example, when data slices 11 and 12 are stored in the designated storage medium, the client generates sub-picture 11 based on data slice 11 and displays sub-picture 11 in the main viewing angle display area, and the client generates sub-picture 12 based on data slice 12 and displays sub-picture 12 in the overhead viewing angle display area. When data slices 21 and 22 are stored in the designated storage medium, the client generates sub-picture 21 based on data slice 21 and displays sub-picture 21 in the main viewing angle display area, and the client generates sub-picture 22 based on data slice 22 and displays sub-picture 22 in the overhead viewing angle display area. When data slices 31 and 32 are stored in the designated storage medium, the client generates sub-picture 31 based on data slice 31 and displays sub-picture 31 in the main viewing angle display area, and the client generates sub-picture 32 based on data slice 32 and displays sub-picture 32 in the overhead viewing angle display area. At this point, a complete picture of the main perspective of the package to be inspected can be displayed in the main perspective display area, and the complete picture of the main perspective can include sub-picture 11, sub-picture 21 and sub-picture 31, and a complete picture of the top-down perspective of the package to be inspected can be displayed in the top-down perspective display area, and the complete picture of the top-down perspective can include sub-picture 12, sub-picture 22 and sub-picture 32.
[0044] Exemplarily, in order to simultaneously display the main-perspective image and the overhead-perspective image, in this embodiment, a dual-screen client is not used (i.e., the display interface of one screen displays the main-perspective image, and the display interface of the other screen displays the overhead-perspective image), but a single screen is used to simultaneously display the main-perspective image and the overhead-perspective image, that is, a dual-perspective display area of a display interface is used to simultaneously display the main-perspective image and the overhead-perspective image.
[0045] For example, the dual-view display area may include a main-view display area and a top-view display area. The main-view display area and the top-view display area are arranged in an up-down manner, and a single screen is used to display the dual-view. Considering that the top-view is relatively flat, the dual-view arrangement is cut with a longitudinal axis of 6 / 4. Of course, the longitudinal axis can also be cut with a longitudinal axis of 5 / 5 or a longitudinal axis of 7 / 3, and there is no restriction on this. The main-view display area can be larger than the top-view display area, and the main-view display area can also be smaller than or equal to the top-view display area.
[0046] When the dual-view layout is cut at 6 / 4 along the vertical axis, the main view display area can be located in the upper half of the display interface, and the top view display area can be located in the lower half of the display interface, see Figure 2 shown.
[0047] For example, for the application scenario of security inspection equipment, when the data slice 11 (data slice 12) is collected by the collection device, there is non-wrapped data on the upper and lower sides of the data slice 11. In this way, when the client generates the sub-screen 11 based on the data slice 11, there are invalid areas on the upper and lower sides of the sub-screen 11, that is, the sub-screen 11 includes a valid wrapped area and an invalid area. Similarly, when the client generates the sub-screen 12 based on the data slice 12, the sub-screen 12 includes a valid wrapped area and an invalid area. Figure 3 As shown, it is a schematic diagram of the display interface of the client showing the screen before and after cropping. In the schematic diagram on the left, the upper white edge and the lower white edge of the sub-screen 11 in the main viewing area are invalid areas, and the upper white edge and the lower white edge of the sub-screen 12 in the top-view viewing area are invalid areas.
[0048] When sub-screen 11 is fully displayed through a display interface of a screen, due to the large screen size, sub-screen 11 can be fully displayed, and scaling of sub-screen 11 is not involved. When sub-screen 11 and sub-screen 12 are displayed simultaneously through a display interface of a screen, the size of the main viewing angle display area of sub-screen 11 is small, and sub-screen 11 may need to be reduced. The size of the top-view display area of sub-screen 12 is small, and sub-screen 12 may need to be reduced. Based on this, when sub-screen 11 is reduced, the existence of the upper and lower white edges (invalid areas) of sub-screen 11 will cause the effective package area to be very small, thereby affecting the staff's reading of the map. When sub-screen 12 is reduced, the existence of the upper and lower white edges of sub-screen 12 will cause the effective package area to be very small. Based on this, sub-screen 11 can also be cropped, that is, the invalid areas of the upper and lower white edges are cropped, and the remaining area is the effective package area, and the effective package area of sub-screen 11 is displayed through the main viewing angle display area, see Figure 3As shown, in the schematic diagram on the right, the effective wrapping area of the sub-image 11 is shown. Similarly, the sub-image 12 can be cropped, that is, the invalid areas of the upper and lower white edges are cropped, and the remaining area is the effective wrapping area, and the effective wrapping area of the sub-image 12 is displayed through the top-down display area.
[0049] When the sub-image 11 is cropped, the upper cropping start value of the sub-image 11 can be determined. The upper cropping start value is the overlapped area of the invalid area and the valid wrapping area (which can be a row of pixel areas). The upper side of the overlapped area is the invalid area, and the lower side of the overlapped area is the valid wrapping area. The upper cropping start value represents a row of pixel areas. For example, when the upper cropping start value is 150, it means that the 150th row of pixels of the sub-image 11 (in order from top to bottom, the 1st, 2nd, 3rd, and 4th rows of pixels are sequentially) is used as the upper cropping start value. The lower cropping start value of the sub-image 11 is determined, that is, the overlapped area of the invalid area and the valid wrapping area. The upper side of the overlapped area is the valid wrapping area, and the lower side of the overlapped area is the invalid area. The lower cropping start value represents a row of pixel areas. For example, when the lower cropping start value is 400, it means that the 400th row of pixels of the sub-image 11 is used as the lower cropping start value.
[0050] Based on this, the sub-picture 11 may be cropped from the 150th row of pixels and the 400th row of pixels, that is, the effective wrapping area of the sub-picture 11 is from the 150th row of pixels to the 400th row of pixels of the sub-picture 11 .
[0051] After obtaining the effective wrapping area of the sub-image 11, the wrapping display height of the sub-image 11 can be determined. The wrapping display height can represent the height of the image displayed in the main viewing angle display area. For example, the height of the effective wrapping area of the sub-image 11 is used as the wrapping display height. For example, when the 150th row of pixels to the 400th row of pixels are used as the effective wrapping area, the wrapping display height can be 250 rows of pixels (i.e., 400-150).
[0052] In summary, the package display height can be determined based on the actual package height of the data slice, the upper cropping start value, and the lower cropping start value. The actual package height can represent the height of the image collected by the security inspection device (i.e., the image height corresponding to the data slice, i.e., the height of the sub-screen 11). For example, assuming that the actual package height is 700, the height of the sub-screen 11 is 700 (from the 1st to the 700th row). If the upper cropping start value is 150 and the lower cropping start value is 400, the package display height is 250 (700-150-300). Here, 150 means that 150 rows of pixels are cropped on the upper side, and 300 (700-400) means that 300 rows of pixels are cropped on the lower side.
[0053] In addition, the height of the main viewing angle display area of the display interface can also be determined, and then the ratio between the height of the main viewing angle display area and the package display height is calculated. If the ratio is less than 1, the zoom ratio 1 of the sub-screen 11 is determined to be the ratio; if the ratio is not less than 1, the zoom ratio 1 is determined to be 1.
[0054] When the sub-image 12 is cropped, the upper cropping start value of the sub-image 12 can be determined, the upper cropping start value represents a row of pixel areas, and the lower cropping start value of the sub-image 12 can be determined, the lower cropping start value represents a row of pixel areas. Based on this, the sub-image 12 can be cropped based on the upper cropping start value and the lower cropping start value. After obtaining the effective wrapping area of the sub-image 12, the wrapping display height of the sub-image 12 can be determined.
[0055] In addition, the height of the top-view display area of the display interface can be determined, and then the ratio between the height of the top-view display area and the package display height is calculated. If the ratio is less than 1, the zoom ratio 2 of the sub-screen 12 is determined to be the ratio; if the ratio is not less than 1, the zoom ratio 2 is determined to be 1.
[0056] In summary, the zoom ratio 1 of the sub-screen 11 and the zoom ratio 2 of the sub-screen 12 can be obtained. If the zoom ratio 1 is less than the zoom ratio 2, the zoom ratio 1 is used to zoom the effective package area of the sub-screen 11, and the zoomed effective package area of the sub-screen 11 is displayed in the main viewing angle display area. For example, if the zoom ratio 1 is 0.5, the width after zooming is 0.5 times the width before zooming, and the height after zooming is 0.5 times the height before zooming. If the zoom ratio 1 is 1, the width after zooming is 1 times the width before zooming, and the height after zooming is 1 times the height before zooming. In this case, the zoomed screen is consistent with the screen before zooming. And, the zoom ratio 1 is used to zoom the effective package area of the sub-screen 12, and the zoomed effective package area of the sub-screen 12 is displayed in the top-view display area. Alternatively, if the zoom ratio 1 is not less than the zoom ratio 2, the zoom ratio 2 is used to zoom the effective package area of the sub-screen 11, and the zoomed effective package area of the sub-screen 11 is displayed in the main viewing angle display area. Furthermore, a zooming operation is performed on the effective enclosing area of the sub-picture 12 using a zooming ratio of 2, and the zoomed effective enclosing area of the sub-picture 12 is displayed in the top-view display area.
[0057] From the above, it can be seen that the effective package area of the scaled sub-image 11 can be displayed in the main viewing angle display area, and the effective package area of the scaled sub-image 12 can be displayed in the top-view viewing area.
[0058] Further, after the client generates the sub-screen 21 based on the data slice 21, the sub-screen 21 can be cropped to obtain the effective package area of the sub-screen 21. The package display height of the sub-screen 21 is determined, and the ratio between the height of the main viewing angle display area and the package display height is calculated. If the ratio value is less than 1, the zoom ratio of the sub-screen 21 is determined to be the ratio value; if the ratio value is not less than 1, the zoom ratio of the sub-screen 21 is determined to be 1. After the client generates the sub-screen 22 based on the data slice 22, the sub-screen 22 can be cropped to obtain the effective package area of the sub-screen 22, and the zoom ratio of the sub-screen 22 is determined.
[0059] In summary, the zoom ratio of the sub-picture 21 and the zoom ratio of the sub-picture 22 can be obtained. Then, the minimum zoom ratio is selected from the zoom ratio of the sub-picture 11, the zoom ratio of the sub-picture 12, the zoom ratio of the sub-picture 21, and the zoom ratio of the sub-picture 22. If the minimum zoom ratio is the zoom ratio of the sub-picture 11 or the zoom ratio of the sub-picture 12, the effective package area of the sub-picture 11 and the effective package area of the sub-picture 12 that have been displayed remain unchanged, the effective package area of the sub-picture 21 is zoomed using the minimum zoom ratio, and the zoomed effective package area of the sub-picture 21 is displayed in the main viewing angle display area, the effective package area of the sub-picture 22 is zoomed using the minimum zoom ratio, and the zoomed effective package area of the sub-picture 22 is displayed in the overhead viewing angle display area.
[0060] If the minimum zoom ratio is the zoom ratio of sub-picture 21 or the zoom ratio of sub-picture 22, the effective package area of sub-picture 11 and the effective package area of sub-picture 12 that have been displayed will change, and the effective package area of sub-picture 11 will be zoomed using the minimum zoom ratio, and the zoomed effective package area of sub-picture 11 will be displayed in the main viewing angle display area (i.e., the currently displayed picture will be replaced), and the effective package area of sub-picture 12 will be zoomed using the minimum zoom ratio, and the zoomed effective package area of sub-picture 12 will be displayed in the overhead viewing angle display area. The effective package area of sub-picture 21 will be zoomed using the minimum zoom ratio, and the zoomed effective package area of sub-picture 21 will be displayed in the main viewing angle display area, and the effective package area of sub-picture 22 will be zoomed using the minimum zoom ratio, and the zoomed effective package area of sub-picture 22 will be displayed in the overhead viewing angle display area.
[0061] In summary, the effective enclosing areas of the scaled sub-pictures 11 and 21 are displayed in the main viewing angle display area, and the effective enclosing areas of the scaled sub-pictures 12 and 22 are displayed in the top-view viewing angle display area.
[0062] Further, after the client generates the sub-screen 31 based on the data slice 31, the sub-screen 31 may be cropped to obtain the effective package area of the sub-screen 31, and the zoom ratio of the sub-screen 31 may be determined. After the client generates the sub-screen 32 based on the data slice 32, the sub-screen 32 may be cropped to obtain the effective package area of the sub-screen 32, and the zoom ratio of the sub-screen 32 may be determined. Then, the minimum zoom ratio is selected from the zoom ratios of the sub-screen 11, the zoom ratio of the sub-screen 12, the zoom ratio of the sub-screen 21, the zoom ratio of the sub-screen 22, the zoom ratio of the sub-screen 31, and the zoom ratio of the sub-screen 32. Then, based on the minimum zoom ratio, the effective package area of the sub-screen 11, the effective package area of the sub-screen 12, the effective package area of the sub-screen 21, the effective package area of the sub-screen 22, the effective package area of the sub-screen 31, and the effective package area of the sub-screen 32 are zoomed, and the zoomed effective package area is displayed in the main viewing angle display area and the top-view viewing angle display area.
[0063] At this point, a complete picture of the package to be detected from the main perspective can be displayed in the main perspective display area, and the complete picture can include the scaled effective package area of sub-picture 11, the scaled effective package area of sub-picture 21, and the scaled effective package area of sub-picture 31. A complete picture of the package to be detected from the top-down perspective can be displayed in the top-down perspective display area, and the complete picture can include the scaled effective package area of sub-picture 12, the scaled effective package area of sub-picture 22, and the scaled effective package area of sub-picture 32.
[0064] In the above application scenario, an embodiment of the present application proposes a screen display method, which can be applied to a client, and the image data of the package to be detected is stored in a designated storage medium of the client.
[0065] For example, the security inspection device may send the main-view image data to the client, and the client stores the main-view image data of the package to be inspected in a designated storage medium. In this case, the main-view image data may include multiple data slices, that is, the security inspection device sends the multiple data slices to the client in sequence, and the client stores the multiple data slices in sequence in the designated storage medium. Alternatively, the security inspection device may send the main-view image data and the overhead view image data to the client, and the client stores the main-view image data and the overhead view image data of the package to be inspected in a designated storage medium. In this case, the main-view image data may include multiple data slices, and the overhead view image data may include multiple data slices.
[0066] For the convenience of description, in this embodiment, the image data of the package to be detected is taken as an example. For the scenario where only the main-view image data exists, the image data of the package to be detected is the main-view image data, and all display areas of the display interface are used as the main-view display area. Alternatively, for the scenario where both the main-view image data and the overhead view image data exist, all display areas of the display interface are divided into the main-view display area and the overhead view display area. If the image data of the package to be detected is the main-view image data, the picture corresponding to the main-view image data is displayed in the main-view display area, and if the image data of the package to be detected is the overhead view image data, the picture corresponding to the overhead view image data is displayed in the overhead view display area.
[0067] See also Figure 4 FIG. 1 is a flow chart of a method for displaying a screen, and the method may include: Step 401: for each package to be detected (hereinafter, one package to be detected is taken as an example), when the package to be detected is displayed on the display interface for the first time, or each time the displayed image of the package to be detected displayed on the display interface is updated, the initial image output speed corresponding to the package to be detected is obtained.
[0068] Exemplarily, the screen display frame rate of the client can be obtained, and the screen display frame rate can be 120hz or 60hz, etc. 120hz means that the client displays the picture 120 times per second, and 60hz means that the client displays the picture 60 times per second. Taking 60hz as an example, assuming that at the 1st millisecond, the picture a1 of the package to be detected is first displayed on the display interface (the height of the picture a1 is the height of the display interface, and the width of the picture a1 is m pixels, where m can be a positive integer, such as 1, 2, 3, etc.), see the subsequent steps for how to display the picture a1.
[0069] At the second millisecond, the displayed screen (i.e., screen a1) of the package to be detected displayed on the display interface needs to be updated, and screen a1 and screen a2 of the package to be detected are displayed on the display interface. At the third millisecond, the displayed screen (i.e., screen a1 and screen a2) of the package to be detected displayed on the display interface needs to be updated, and screen a1, screen a2, and screen a3 of the package to be detected are displayed on the display interface, and so on.
[0070] In summary, the displayed image of the package to be detected on the display interface needs to be updated every 1 millisecond. That is to say, every 1 millisecond, Figure 4 The process shown.
[0071] For example, in order to obtain the initial image output speed corresponding to the package to be detected, the following steps can be used: Step 4011: When the package to be detected is displayed on the display interface for the first time, or each time the displayed screen of the package to be detected is updated, determine whether a data slice of the package to be detected is newly added in the designated storage medium. For example, the image data of the package to be detected may include multiple data slices, and the security inspection device sends each data slice to the client in turn, and the client stores each data slice in turn to the designated storage medium. Based on this, it can be determined whether a data slice is newly added in the designated storage medium.
[0072] If no new data shards are added to the specified storage medium, step 4012 can be executed.
[0073] If a new data slice is added to the specified storage medium, step 4013 can be executed.
[0074] Step 4012: Use the stored image output speed as the initial image output speed.
[0075] For example, each time the displayed image of the package to be inspected is updated, the image output speed is stored (the storage process of the image output speed is described in the subsequent embodiments). Based on this, if no new data slices are added to the designated storage medium, the image output speed is kept unchanged and the stored image output speed is used as the initial image output speed.
[0076] Step 4013: If a new data slice has been added to the specified storage medium, a target clipping value may be determined based on the clipping value of the new data slice and the clipping values of each stored data slice.
[0077] For example, if other data slices of the package to be detected are not stored in the designated storage medium except for the newly added data slice, the upper cropping start value and the lower cropping start value of the newly added data slice are used as the target cropping value, the upper cropping start value is the upper cropping start value of the sub-screen corresponding to the newly added data slice, and is the overlapped area of the invalid area and the valid package area. The lower cropping start value is the lower cropping start value of the sub-screen corresponding to the newly added data slice.
[0078] For example, taking the 1st, 2nd, and 3rd rows of pixels from top to bottom as an example, in addition to the newly added data slices, if other data slices of the package to be detected are already stored in the designated storage medium, the minimum upper cropping start value is selected from the upper cropping start value of the newly added data slice and the upper cropping start value of each stored data slice, and the maximum lower cropping start value is selected from the lower cropping start value of the newly added data slice and the lower cropping start value of each stored data slice, and the minimum upper cropping start value and the maximum lower cropping start value are determined as the target cropping value, that is, the target cropping value includes the minimum upper cropping start value and the maximum lower cropping start value. Alternatively, if the 1st, 2nd, and 3rd rows of pixels are taken from bottom to top as an example, the maximum upper cropping start value and the minimum lower cropping start value are selected as the target cropping value.
[0079] For example, the minimum upper clipping start value may represent a height value clipped from the upper side of the actual height of the package, and the maximum lower clipping start value may represent a height value clipped from the lower side of the actual height of the package.
[0080] Step 4014: Determine the package display height based on the target cropping value.
[0081] Exemplarily, the package display height can be determined based on the actual height of the package, the minimum upper cropping start value, and the maximum lower cropping start value of the data slice. The actual height of the package can represent the height of the image collected by the security inspection device, that is, the image height corresponding to the data slice. The package display height can represent the height of the image displayed in the viewing angle display area. For example, assuming that the actual height of the package is 700, the minimum upper cropping start value is 150, and the maximum lower cropping start value is 400, then the package display height is 250.
[0082] Step 4015: determine an initial zoom ratio based on the display height of the package and the height of the viewing angle display area (such as the main viewing angle display area and the top viewing angle display area) of the display interface.
[0083] For example, the ratio between the height of the viewing angle display area of the display interface and the display height of the package can be calculated. Then, if the ratio is less than 1, the initial zoom ratio can be determined to be the ratio; or if the ratio is not less than 1, the initial zoom ratio can be determined to be 1.
[0084] For example, if the display interface includes a main-view display area and a top-view display area, then the ratio between the height of the main-view display area and the package display height can be calculated, and then the zoom ratio corresponding to the main-view display area (such as the ratio or 1) can be determined. The ratio between the height of the top-view display area and the package display height can be calculated, and then the zoom ratio corresponding to the top-view display area (such as the ratio or 1) can be determined. Then, if the zoom ratio corresponding to the main-view display area is less than the zoom ratio corresponding to the top-view display area, the zoom ratio corresponding to the main-view display area is used as the initial zoom ratio. If the zoom ratio corresponding to the main-view display area is not less than the zoom ratio corresponding to the top-view display area, the zoom ratio corresponding to the top-view display area is used as the initial zoom ratio. At this point, the initial zoom ratio can be obtained.
[0085] For example, the initial zoom ratio orgscale can be calculated by the following formula: orgscale=MIN(MIN (main_show_h / main_packet_h, sub_show_h / sub_packet_h), 1.0). In the above formula, main_show_h can represent the height of the main viewing angle display area, main_packet_h can represent the package display height corresponding to the main viewing angle picture, sub_show_h can represent the height of the top-down viewing angle display area, and sub_packet_h can represent the package display height corresponding to the top-down viewing angle picture.
[0086] Step 4016: Get the recommended speed of the package, which can be recorded as Vpacketorg.
[0087] For example, the recommended speed of the package is used to indicate the pixel width of the horizontal movement. For example, the user can pre-configure the number of pixels to move per second (linePerSec), and the client can convert it into the number of pixels to move per frame. The number of pixels represents the pixel width of the horizontal movement, that is, the recommended speed of the package. For example, the following formula can be used to determine the recommended speed of the package: Vpacketorg=linePerSec / ioFramerate. linePerSec indicates the number of pixels to move per second, and ioFramerate indicates the screen display frame rate.
[0088] Step 4017, calculate the first product value between the frame interval parameter, the initial zoom ratio and the recommended speed of the package, round down the first product value, and obtain the initial image output speed corresponding to the package to be detected.
[0089] For example, the following formula can be used to determine the initial image output speed: In the above formula, Vpacket can represent the initial image output speed, n can represent the frame interval parameter, orgscale can represent the initial scaling ratio, and Vpacketorg can represent the recommended package speed. n*orgscale* Vpacketorg can represent the first product value, Can represent a floor operation.
[0090] The product value of the initial scaling ratio and the recommended package speed (orgscale*Vpacketorg) may be referred to as the second product value. If the second product value is greater than or equal to 1, the frame interval parameter n may be 1. If the second product value is less than 1, the frame interval parameter n may be greater than 1, and the frame interval parameter n is used to make the first product value greater than or equal to 1, and the frame interval parameter n may be a positive integer. For example, if the second product value is 0.5, the frame interval parameter n may be 2. If the second product value is 0.4, the frame interval parameter n may be 3. If the second product value is 0.3, the frame interval parameter n may be 4, and so on.
[0091] For example, when the package to be detected is scaled, the initial output speed Vpacket can be determined according to the initial scaling ratio orgscale and the recommended speed Vpacketorg of the package, such as Vpacket=⌊orgscale*Vpacketorg⌋. However, considering that the movement of screen pixels needs to be an integer, and the calculated value of orgscale*Vpacketorg may be less than 1, in order to ensure that Vpacket is an integer, Vpacket=0, indicating that the initial output speed is 0 (stop). In this way, the package to be detected will not move for output, which is obviously illogical.
[0092] To handle this situation, it is necessary to make Vpacket>=1. Based on this, n*orgscale* Vpacketorg is rounded down, and the frame interval parameter n is used to make n*orgscale* Vpacketorg greater than or equal to 1. In this way, it can be ensured that the initial output speed Vpacket is a positive integer greater than or equal to 1, avoiding Vpacket=0.
[0093] In the above formula, n represents the frame interval parameter. If n is 1, it means that in normal case, m pixels are moved every 1 frame (n=1). If n is greater than 1, it means that in the case of frame drop, m pixels are moved every n frames (n>1). In summary, the initial image output speed Vpacket is to move m (m>=1) pixels every n frames (n>=1), that is, the initial image output speed Vpacket is used to indicate the pixel width of the horizontal movement.
[0094] At this point, step 401 is completed, and the initial image output speed Vpacket corresponding to the package to be detected is obtained.
[0095] Step 402: Obtain the target zoom ratio corresponding to the package to be detected.
[0096] Exemplarily, when the package to be detected is displayed on the display interface for the first time, or each time the displayed screen of the package to be detected is updated, it is determined whether a data slice of the package to be detected is newly added in the designated storage medium. If no data slice is newly added in the designated storage medium, the stored zoom ratio is used as the target zoom ratio and the target zoom ratio is stored (in the next processing process, the target zoom ratio is used as the stored zoom ratio to calculate the target zoom ratio in the next processing process, and so on).
[0097] If a new data slice is added to the specified storage medium, the target scaling ratio is determined based on the initial scaling ratio. If the target scaling ratio is greater than the stored scaling ratio, the target scaling ratio is stored (as the stored scaling ratio in the next processing process). If the target scaling ratio is equal to the stored scaling ratio, the target scaling ratio can be stored or the stored scaling ratio can be kept unchanged (to be used in the next processing process). For example, regarding the initial scaling ratio orgscale, the method for obtaining the initial scaling ratio orgscale is shown in step 4015.
[0098] Exemplarily, if the frame interval parameter n is 1 and the initial image output speed Vpacket is greater than or equal to 1, the target scaling ratio scale is determined based on the quotient of the initial image output speed Vpacket and the recommended package speed Vpacketorg, such as scale=Vpacket / Vpacketorg. If the frame interval parameter n is greater than 1, and / or the initial image output speed Vpacket is less than 1, the target scaling ratio is determined to be the initial scaling ratio, such as scale=orgscale.
[0099] Step 403: Obtain the target image output speed corresponding to the package to be detected.
[0100] Case 1: When the package to be detected is displayed on the display interface for the first time, the following steps can be used to obtain the target image output speed, and the target image output speed is used to indicate the pixel width of the lateral movement.
[0101] Step S11, determining the undisplayed pixel width corresponding to the package to be detected.
[0102] Exemplarily, each time a data slice of the package to be detected is added to the designated storage medium, the non-displayed pixel width corresponding to the package to be detected is increased based on the pixel width of the data slice. When no data slice of the package to be detected is added to the designated storage medium, the non-displayed pixel width is not increased.
[0103] For example, the pixel width of the data fragment (also called the package fragment width) can indicate how many pixels the data fragment corresponds to in the horizontal direction. The pixel width of the data fragment is recorded as Wfrag, and the client knows the pixel width of the data fragment. In addition, the undisplayed pixel width can indicate the remaining length of the package to be detected. The undisplayed pixel width is recorded as Lremain. The undisplayed pixel width indicates the sum of the widths of all the undisplayed contents. The undisplayed pixel width is the remaining width of the undisplayed portion of the package to be detected.
[0104] Assuming that the current value of the undisplayed pixel width is Lremain1, and the pixel width of the data fragment is Wfrag, when a data fragment of a package to be detected is added, the updated undisplayed pixel width is Lremain1+Wfrag.
[0105] Exemplarily, each time a sub-image is displayed on the display interface based on the target image output speed, the pixel width of the horizontal movement indicated by the target image output speed is reduced by the undisplayed pixel width.
[0106] For example, if the target image output speed is to move m (m>=1) pixels per frame, the target image output speed is used to indicate that the pixel width of the horizontal movement is m, that is, when the sub-image is displayed on the display interface, the width of the sub-image is m, and the height of the sub-image is the height of the viewing angle display area. Assuming that the current value of the undisplayed pixel width is Lremain1, the updated undisplayed pixel width is Lremain1-m.
[0107] Step S12: If the undisplayed pixel width Lremain is greater than the pixel width Wfrag of the data fragment, determine whether the undisplayed pixel width Lremain is greater than the product of the initial image output speed Vpacket and the configured maximum time interval frameMax, that is, whether Lremain is greater than Vpacket*frameMax.
[0108] For example, frameMax indicates the maximum time interval, which can be configured based on experience. The maximum time interval indicates the maximum interval between the image displayed by the client and the image collected by the security inspection device. If the time difference between the image displayed by the client and the image collected by the security inspection device needs to be controlled to be no more than 300ms to ensure timeliness, the maximum time interval can be 300ms. The maximum time interval is used to control the time difference to be no more than 300ms.
[0109] If not, that is, Lremain is not greater than Vpacket*frameMax, step S13 can be executed.
[0110] If so, that is, Lremain is greater than Vpacket*frameMax, step S14 can be executed.
[0111] Step S13, determine the initial image output speed Vpacket as the target image output speed Vmove, and store the target image output speed (in the next processing process, the target image output speed is used as the stored image output speed).
[0112] Step S14: Determine the target output speed Vmove based on the initial output speed Vpacket and the configured target value, and store the target output speed (in the next processing, the target output speed is used as the stored output speed). For example, the target value can be configured based on experience, and the target value can be a value greater than 0, such as 0.5, 1, 1.5, 2, etc. Since the target value is greater than 0, the target output speed Vmove can be greater than the initial output speed Vpacket, such as Vmove=Vpacket+1.
[0113] At this point, the target image output speed Vmove corresponding to the package to be detected can be obtained.
[0114] In case 2, each time the displayed image of the package to be inspected is updated, the following steps may be used to obtain a target image output speed, and the target image output speed is used to indicate the pixel width of the lateral movement.
[0115] Step S21, determining the undisplayed pixel width corresponding to the package to be detected.
[0116] Exemplarily, each time a data slice of the package to be detected is added to the designated storage medium, the non-displayed pixel width corresponding to the package to be detected can be increased based on the pixel width of the data slice. Each time a sub-image is displayed on the display interface based on the target image output speed, the non-displayed pixel width corresponding to the package to be detected can be reduced based on the pixel width of the lateral movement indicated by the target image output speed.
[0117] Step S22: Determine whether the undisplayed pixel width Lremain is greater than the pixel width Wfrag of the data fragment. If so, step S23 may be executed, and if not, step S26 may be executed.
[0118] Step S23, each time the displayed image of the package to be detected is updated, if the package to be detected is not displayed on the display interface for the first time, it can be determined whether the undisplayed pixel width is not greater than the product of the initial image output speed and the maximum time interval, that is, whether Lremain is not greater than Vpacket*frameMax.
[0119] If so, that is, Lremain is not greater than Vpacket*frameMax, step S24 can be executed.
[0120] If not, that is, Lremain is greater than Vpacket*frameMax, step S25 can be executed.
[0121] Step S24, determine the stored image output speed (ie, the target image output speed in the last processing) as the target image output speed Vmove, and store the target image output speed, ie, as the stored image output speed.
[0122] Step S25, determine the initial image output speed Vpacket as the target image output speed Vmove, and store the target image output speed (in the next processing process, the target image output speed is used as the stored image output speed).
[0123] Step S26: If the pixel width Lremain is not greater than the pixel width Wfrag of the data fragment, it is determined whether the stored image output speed is 0. If the stored image output speed is not 0, step S27 can be executed. If the stored image output speed is 0, step S28 can be executed.
[0124] Step S27, determine the stored image output speed as the target image output speed Vmove, and store the target image output speed, that is, the target image output speed is used as the stored image output speed.
[0125] Step S28, determine whether the frame interval is greater than the fixed frame number. If not, the frame interval can be increased by 1, the target image output speed Vmove is determined to be 0, and the target image output speed is stored. If so, the initial image output speed Vpacket can be determined as the target image output speed Vmove, the target image output speed is stored, and the frame interval is updated to 0.
[0126] Exemplarily, the initial value of the frame interval is 0. When the frame interval is not greater than the fixed number of frames, each time the displayed image of the package to be detected is updated (such as every 1 millisecond), the frame interval can be increased by 1, and the target image output speed Vmove is determined to be 0, and so on, until the frame interval is greater than the fixed number of frames, the initial image output speed Vpacket is determined as the target image output speed Vmove, the frame interval is updated to 0, and the above steps are repeated.
[0127] Exemplarily, the fixed frame number can be determined based on the quotient of the pixel width Wfrag of the data slice and the recommended package speed Vpacketorg. For example, the fixed frame number is the number of frames required to move a data slice. The fixed frame number is recorded as FixedGapFrame. When each data slice of the package to be detected moves at the recommended package speed Vpacketorg, it will move under the fixed frame number FixedGapFrame. For example, the fixed frame number can be determined by the following formula: FixedGapFrame=Wfrag / Vpacketorg.
[0128] When the package is scaled, the pixel width Wfrag and the recommended package speed Vpacketorg will also change synchronously. Assuming the scaling ratio is scale, FixedGapFrame=(scale*Wfrag) / (scale*Vpacketorg). Obviously, the fixed number of frames remains unchanged, that is, FixedGapFrame=Wfrag / Vpacketorg.
[0129] At this point, the target image output speed Vmove corresponding to the package to be detected can be obtained.
[0130] Step 404: When the package to be inspected is displayed on the display interface for the first time, third sub-data is selected from the image data stored in the designated storage medium based on the target image output speed (the target image output speed obtained in case 1), a third sub-picture is generated based on the third sub-data, and the third sub-picture is displayed through the display interface.
[0131] Exemplarily, when the package to be detected is displayed on the display interface for the first time, there is no displayed image of the package to be detected on the display interface, and it is necessary to add an image of the package to be detected on the display interface. Based on this, considering that the target image output speed is used to indicate the pixel width of the lateral movement, if the pixel width is m, then the third sub-data with a width of m pixels can be selected from the image data of the package to be detected, and the original image is generated based on the third sub-data. The original image is the effective package area after cropping. The cropping process is shown in the above embodiment. Then, the original image is scaled based on the target zoom ratio to obtain the third sub-image.
[0132] After the third sub-picture is obtained, the third sub-picture may be displayed through the display interface. For example, the third sub-picture may be displayed after the complete picture of the previous package to be inspected.
[0133] Exemplarily, if the display interface includes a main-view display area and a top-view display area, then, based on the target image output speed, the third sub-data 1 of the main view is selected from the main-view image data stored in the designated storage medium, the third sub-screen 1 of the main view is generated based on the third sub-data 1, and the third sub-screen 1 of the main view is displayed in the main-view display area. And, based on the target image output speed, the third sub-data 2 of the top-view is selected from the top-view image data stored in the designated storage medium, the third sub-screen 2 of the top-view is generated based on the third sub-data 2, and the third sub-screen 2 of the top-view is displayed in the top-view display area.
[0134] Step 405: Each time the displayed picture of the package to be detected is updated, a picture to be displayed corresponding to the package to be detected is obtained, and the picture to be displayed may include a first sub-picture and a second sub-picture.
[0135] Exemplarily, when the package to be detected is not displayed on the display interface for the first time, a displayed screen of the package to be detected already exists on the display interface, and therefore, the displayed screen of the package to be detected needs to be updated, and an additional screen of the package to be detected needs to be added to the display interface. When the displayed screen is updated, the updated screen is referred to as the first sub-screen. When an additional screen of the package to be detected is added, the additional screen is referred to as the second sub-screen. In summary, the screen to be displayed includes the first sub-screen and the second sub-screen.
[0136] For the acquisition process of the first sub-image, after obtaining the target zoom ratio corresponding to the package to be detected, it can be determined whether the target zoom ratio is increased. For example, if the target zoom ratio is greater than the stored zoom ratio (i.e., the target zoom ratio used in the previous processing process), it means that the target zoom ratio is increased. If the target zoom ratio is equal to the stored zoom ratio, it means that the target zoom ratio remains unchanged.
[0137] If the target zoom ratio of the package to be detected increases, the first sub-data corresponding to the displayed picture of the package to be detected can be selected from the image data of the package to be detected. For example, assuming that a displayed picture of the package to be detected with a width of K pixels is displayed on the display interface, the first sub-data with a width of K pixels can be selected from the image data of the package to be detected (selection needs to start from the first pixel of the package to be detected), and the original picture is generated based on the first sub-data. The original picture is the effective package area after cropping. Then, the original picture can be scaled based on the target zoom ratio to obtain the first sub-picture.
[0138] If the target zoom ratio of the package to be detected remains unchanged, the first sub-image is the displayed image, that is, the displayed image with a width of K pixels displayed on the display interface, that is, the displayed image remains unchanged.
[0139] Regarding the acquisition process of the second sub-image, considering that the target image output speed is used to indicate the pixel width of the horizontal movement, if the pixel width is m, then the second sub-data with a width of m pixels can be selected from the image data of the package to be detected (it is necessary to start selecting from the K+1th pixel of the package to be detected, K represents the pixel width of the displayed image), and the original image is generated based on the second sub-data. The original image is the effective package area after cropping. The second sub-image is obtained by scaling the original image based on the target scaling ratio.
[0140] Step 406: Display the first sub-picture and the second sub-picture through the display interface. When displaying the first sub-picture and the second sub-picture, the second sub-picture is spliced behind the first sub-picture.
[0141] Exemplarily, if the display interface includes a main-view display area and a top-view display area, the first sub-picture 1 and the second sub-picture 1 of the main view are obtained based on the main-view image data stored in the designated storage medium, and the first sub-picture 1 and the second sub-picture 1 of the main view are displayed in the main-view display area. Also, the first sub-picture 2 and the second sub-picture 2 of the top-view are obtained based on the top-view image data stored in the designated storage medium, and the first sub-picture 2 and the second sub-picture 2 of the top-view are displayed in the top-view display area.
[0142] For example, when the first sub-image and the second sub-image are displayed, the second sub-image is spliced behind the first sub-image, so that a display process similar to a video mode can be achieved. For example, multiple sub-images are dynamically and real-time scrolled in sequence in the direction of "from left to right" or "from right to left".
[0143] For example, when multiple sub-pictures are displayed from left to right, the first sub-picture is located on the left, and the second sub-picture can be spliced on the right side of the first sub-picture. When multiple sub-pictures are displayed from right to left, the first sub-picture is located on the right, and the second sub-picture can be spliced on the left side of the first sub-picture.
[0144] Exemplarily, relying on the dual-perspective data reported by the security inspection equipment, by proposing dual-perspective output, that is, displaying the picture through the main perspective display area and the top-view display area, the efficiency of image judgment is better improved.
[0145] For example, see Figure 5 , which is a schematic diagram of updating the target starting coordinates. Package A to be detected has been moved, that is, the complete screen of package A to be detected has been displayed, and the starting coordinates of package A to be detected are A_x. Package B to be detected has been moved, that is, the complete screen of package B to be detected has been displayed, and the starting coordinates of package B to be detected are B_x. Package C to be detected is moving, and the complete screen of package C to be detected has not been displayed. The current starting coordinates of package C to be detected are C_x.
[0146] On this basis, when the first sub-picture and the second sub-picture of the package C to be detected are displayed through the display interface, it is necessary to first determine the target starting coordinates of the package C to be detected, and then, starting from the target starting coordinates of the display interface, the first sub-picture and the second sub-picture are displayed in sequence. For example, if the target zoom ratio of the package to be detected remains unchanged, the target starting coordinates remain unchanged, which is the current starting coordinates C_x, therefore, starting from the target starting coordinates C_x of the display interface, the first sub-picture and the second sub-picture are displayed in sequence.
[0147] If the target zoom ratio of the package to be detected increases, the target start coordinate is determined based on the current end coordinate and the target zoom ratio, and the target start coordinate is not the current start coordinate C_x. For example, the current end coordinate indicates the end coordinate when the screen of the package to be detected C was last displayed, see Figure 5 shown.
[0148] For example, based on the current end coordinate, the target scaling ratio and the stored scaling ratio (i.e., the target scaling ratio of the previous processing process), the interval pixel width between the target start coordinate and the current end coordinate of the package to be detected is determined. For example, the interval pixel width can be determined by the following formula: intgapContentWidth=displayPos-(displayPos / curScale*m_contentScale). In the above formula, intgapContentWidth represents the interval pixel width, displayPos represents the current end coordinate of the package to be detected, curScale represents the target scaling ratio, and m_contentScale represents the stored scaling ratio.
[0149] Then, the target start coordinates are determined based on the interval pixel width and the current end coordinate displayPos. For example, the difference between the current end coordinate displayPos and the interval pixel width is used as the target start coordinates.
[0150] Considering that the interval pixel width may be determined multiple times during the movement of the package to be detected, each time the interval pixel width is determined, the sum of all interval pixel widths may be calculated, and the difference between the current end coordinate displayPos and the sum may be used as the target start coordinate.
[0151] exist Figure 5 In the example, the target starting coordinate of the package C to be detected is C_x1, so the first sub-screen and the second sub-screen can be displayed in sequence starting from the target starting coordinate C_x1 of the display interface.
[0152] from Figure 5 It can be seen that there is a blank strip gap between the target starting coordinate C_x1 of the package C to be detected and the ending coordinate of the package B to be detected, that is, there is a certain gap between the target starting coordinate C_x1 of the package C to be detected and the ending coordinate of the package B to be detected, instead of being continuous. The reason is: After the displayed image of the package C to be detected is displayed on the display interface, when the target zoom ratio increases, the displayed image of the package C to be detected also needs to be zoomed (after zooming, it becomes the first sub-image). Once zoomed, the width of the displayed image will become smaller, thus causing the image to freeze. When the width becomes smaller, the displayed part of the package C to be detected cannot be pulled back, that is, the displayed part of the package C to be detected needs to move according to the calculated new speed. Therefore, while adjusting the target starting coordinates of the package C to be detected, the continued forward movement of the tail of the package C to be detected (the entire package C) cannot be affected. In view of the above findings, in this embodiment, the target starting coordinates of the package C to be detected can be recalculated, that is, the starting coordinates are updated due to the real-time change of the zoom ratio, so as to supplement the blank strips of the package C to be detected, so as to solve the freeze problem caused by the overall pullback of the image output interface, and can ensure the smooth output of the package to be detected, thereby improving the smoothness of the image output.
[0153] For example, when the target zoom ratio increases, the displayed image of the package C to be detected needs to be scaled, which affects the coordinate starting point of the package C to be detected. Since different packages to be detected are continuous, the reduction of the package C to be detected will cause all packages to be pulled back as a whole, resulting in visual freeze.
[0154] In a possible implementation, when the client displays the image of the package to be detected, it can display the image of the package to be detected based on the screen display frame rate (such as 120hz or 60hz, etc.) to ensure the real-time movement of the image on the display interface. For example, when the screen display frame rate is 60hz, one frame is displayed every 1 millisecond, and each frame moves m pixels (m>=1) to achieve the effect of real-time movement. In order to ensure the smooth output of the image of the package to be detected, and to take into account timeliness while ensuring smoothness, a screen display method is proposed in the embodiment of the present application, see Figure 6 As shown, it is a flowchart of the screen display method.
[0155] Step 601: Get the screen display frame rate, which may be 120 Hz or 60 Hz.
[0156] Step 602: Update frames in real time based on the screen display frame rate. For example, if the screen display frame rate is 60 Hz, a frame is updated every 1 millisecond. Each time a frame is updated, the displayed image of the package to be detected displayed on the display interface is updated, such as moving m pixels.
[0157] Step 603: Processing with the slice cropping and package update strategy. For example, when processing with the slice cropping and package update strategy, parameters such as the initial image output speed corresponding to the package to be detected, the target zoom ratio corresponding to the package to be detected, and the target starting coordinates of the package to be detected can be obtained.
[0158] Step 604: Use the real-time package movement strategy for processing. For example, when using the real-time package movement strategy for processing, the target image output speed corresponding to the package to be detected can be obtained, and based on the target image output speed corresponding to the package to be detected, the image corresponding to the package to be detected is displayed on the display interface.
[0159] Step 605: Determine whether the drawing is finished, that is, whether the screen display process has ended.
[0160] If yes, the drawing process ends; if no, the frame is updated in real time based on the screen display frame rate.
[0161] In a possible implementation, for step 603, the process of using the slice cutting and package update strategy for processing can be seen in Figure 7 As shown, the process may include the following steps: Step 701, determine whether a new data segment is added, that is, for the package to be detected, each time a frame is updated, determine whether a new data segment of the package to be detected is added in the designated storage medium. If not, execute step 604, and use the package real-time movement strategy for processing. If yes, execute step 702.
[0162] Step 702, determine whether the package to be detected already exists. For example, when a new data slice is added, determine whether the package to be detected of the new data slice already exists. If yes, it means that the new data slice is a data slice of an existing package to be detected, and execute step 703; if no, it means that the new data slice is a data slice of a new package to be detected, and there is no package to be detected of the new data slice, and execute step 704.
[0163] Step 703: update the data slice for the existing package to be detected, that is, add the newly added data slice for the existing package to be detected. After step 703, step 707 can be executed.
[0164] Step 704: Add a new package to be detected and update the data slice for the package to be detected.
[0165] Step 705: Calculate the recommended package speed Vpacketorg of the package to be detected.
[0166] For example, Vpacketorg = linePerSec / ioFramerate, where linePerSec indicates how many pixels are moved per second, which can be a value pre-configured by the user, and ioFramerate indicates the screen display frame rate.
[0167] Step 706: Calculate the fixed frame number FixedGapFrame, which is the number of frames required to move a data slice. For example, FixedGapFrame = Wfrag / Vpacketorg. For example, Wfrag can represent the pixel width of the data slice, and Vpacketorg can represent the recommended speed of the package.
[0168] Step 707: Update the target clipping value, that is, the target clipping value corresponding to the effective wrapping area.
[0169] For example, when the package to be detected does not exist, the upper cropping start value and the lower cropping start value of the newly added data slice can be used as the target cropping value. Alternatively, when the package to be detected already exists, the minimum upper cropping start value is selected from the upper cropping start value of the newly added data slice and the upper cropping start values of the stored data slices, and the maximum lower cropping start value is selected from the lower cropping start value of the newly added data slice and the lower cropping start values of the stored data slices, and the minimum upper cropping start value and the maximum lower cropping start value can be determined as the target cropping value.
[0170] Step 708: Determine the package display height based on the target clipping value. For example, determine the package display height based on the actual package height of the data slice, the minimum upper clipping start value, and the maximum lower clipping start value.
[0171] Step 709: Determine an initial zoom ratio based on the package display height and the height of the viewing angle display area.
[0172] Step 710: Determine an initial image output speed based on the initial zoom ratio. For example, determine an initial image output speed Vpacket corresponding to the package to be detected based on the frame interval parameter, the initial zoom ratio and the recommended package speed.
[0173] Step 711: Obtain a target zoom ratio corresponding to the package to be detected. For example, the target zoom ratio is determined based on the initial image output speed and the recommended speed of the package, or the target zoom ratio is determined based on the initial zoom ratio.
[0174] Step 712: Determine whether the target zoom ratio is increased. For example, if the target zoom ratio is greater than the stored zoom ratio, it means that the target zoom ratio is increased. If the target zoom ratio is equal to the stored zoom ratio, it means that the target zoom ratio remains unchanged. If so, execute step 713; if not, execute step 715.
[0175] Step 713: Determine whether the package to be detected is the currently displayed package, that is, whether the package of the newly added data slice is currently displayed. If yes, execute step 714; if no, execute step 715.
[0176] Step 714: Determine the target starting coordinates based on the current ending coordinates and the target zoom ratio.
[0177] For example, based on the current end coordinate, the target zoom ratio and the stored zoom ratio, the interval pixel width between the target start coordinate and the current end coordinate is determined. Then, the target start coordinate is determined based on the interval pixel width and the current end coordinate, such as the difference between the current end coordinate and the interval pixel width as the target start coordinate. Obviously, there is a blank strip gap between the target start coordinate and the end coordinate of the previous package, and the width of the blank strip gap is the interval pixel width.
[0178] Step 715: Update the undisplayed pixel width Lremain corresponding to the package to be detected.
[0179] For example, each time a data slice of the package to be detected is added to the designated storage medium, the undisplayed pixel width corresponding to the package to be detected is increased based on the pixel width of the data slice.
[0180] Completed Figure 7 The process shown ends at step 603 and then executes step 604.
[0181] In a possible implementation, for step 604, the process of using the package real-time mobile strategy for processing can be seen in Fig. 8A As shown, the process may include the following steps: Step 801: Determine whether the undisplayed pixel width Lremain is greater than 0.
[0182] If not, 0 can be used as the target image output speed Vmove, the current picture is retained, and this frame does not need to be moved, that is, the current picture is not updated, and then step 605 is executed. If so, step 802 can be executed.
[0183] Step 802: Determine whether the frame interval parameter n is 1, where n is a value greater than or equal to 1.
[0184] If not, that is, the frame interval parameter n is greater than 1, then determine whether the frame interval framgap is equal to n. If the frame interval framgap is equal to n, then restore the frame interval framgap to 0 and execute step 803. If the frame interval framgap is not equal to n, then increase the frame interval framgap by 1, retain the current picture, and then execute step 605. For example, the initial value of the frame interval framgap is 0. Each time the frame is updated, the frame interval framgap can be increased by 1 until the frame interval framgap is equal to n, and then the frame interval framgap is restored to 0.
[0185] If so, that is, the frame interval parameter n is equal to 1, step 803 can be executed.
[0186] Step 803: Determine whether the undisplayed pixel width Lremain is greater than the pixel width Wfrag of the data fragment. If not, then execute step 804; if so, then execute step 807.
[0187] Step 804: If the pixel width Lremain is not greater than the pixel width Wfrag of the data fragment, it is determined whether the stored image output speed is 0. If not, that is, the stored image output speed is not 0, then step 805 can be executed. If yes, that is, the stored image output speed is 0, then step 806 can be executed.
[0188] Step 805: Determine the stored output speed as the target output speed Vmove, i.e., continue the output speed used last time, and store the target output speed, i.e., the target output speed is used as the stored output speed. On this basis, the screen can be updated based on the target output speed Vmove, i.e., the screen is displayed on the display interface, and step 604 is completed, and then step 605 can be executed.
[0189] Step 806: Determine whether the frame interval framgap is greater than the fixed frame number FixedGapFrame.
[0190] If not, the frame interval framgap can be increased by 1, the target image output speed Vmove is determined to be 0, the target image output speed Vmove is stored, and on this basis, the current picture is retained, and then step 605 is executed.
[0191] If yes, the frame interval framgap can be restored to 0, the initial image output speed Vpacket is used as the target image output speed Vmove, and the target image output speed Vmove is stored. The screen is updated based on the target image output speed Vmove, that is, the screen is displayed on the display interface, and step 604 is completed, and step 605 is executed.
[0192] Step 807: If the pixel width Lremain is not greater than the pixel width Wfrag of the data fragment, it is determined whether the package to be detected is displayed on the display interface for the first time. If not, that is, the package to be detected is not displayed on the display interface for the first time (the package to be detected is not moved for the first time), then step 808 is executed. If yes, that is, the package to be detected is displayed on the display interface for the first time (the package to be detected is moved for the first time), then step 809 is executed.
[0193] Step 808: Determine whether the undisplayed pixel width Lremain is not greater than the product of the initial image output speed Vpacket and the maximum time interval frameMax, that is, whether Lremain is not greater than Vpacket*frameMax.
[0194] If so, that is, Lremain is not greater than Vpacket*frameMax, the stored output speed is determined as the target output speed Vmove, that is, the output speed used last time is continued, and the target output speed is stored, and the screen is updated based on the target output speed Vmove, thus completing step 604 and executing step 605.
[0195] If not, that is, Lremain is greater than Vpacket*frameMax, the initial image output speed Vpacket is determined as the target image output speed Vmove, and the target image output speed Vmove is stored. Then, the screen is updated based on the target image output speed Vmove, and step 604 is completed, and step 605 is executed.
[0196] Step 809: determine whether the current package to be detected has been received, that is, whether all data fragments of the current package to be detected have been stored in the designated storage medium. If not, step 810 can be executed.
[0197] If so, the maximum image output speed Vset is determined as the target image output speed Vmove, and the target image output speed Vmove is stored, and the screen is updated based on the target image output speed Vmove, thus completing step 604 and executing step 605. For example, the maximum image output speed Vset can be configured by the user based on experience, and the maximum image output speed Vset is manually and subjectively configured by the user in the client configuration interface according to his or her own image judgment ability.
[0198] Step 810: Determine whether the undisplayed pixel width Lremain is greater than the product of the initial image output speed Vpacket and the maximum time interval frameMax, that is, whether Lremain is greater than Vpacket*frameMax.
[0199] If not, that is, Lremain is not greater than Vpacket*frameMax, the initial image output speed Vpacket is determined as the target image output speed Vmove, and the target image output speed Vmove is stored. Then, the screen is updated based on the target image output speed Vmove, and step 604 is completed, and step 605 is executed.
[0200] If so, that is, Lremain is greater than Vpacket*frameMax, the target output speed Vmove is determined based on the initial output speed Vpacket and the target value, and the target output speed Vmove is stored. Then, the screen is updated based on the target output speed Vmove, and step 604 is completed, and step 605 is executed.
[0201] For example, the target value can be configured based on experience, and the target value can be a value greater than 0. For example, Vpacket+1 is used as the target output speed Vmove. Obviously, Vmove is greater than Vpacket.
[0202] Completed Fig. 8A The process shown ends at step 604 and then executes step 605.
[0203] from Fig. 8A It can be seen that the target output speed Vmove can be the maximum output speed Vset, the initial output speed Vpacket, Vpacket+1 and 0, etc., that is, it is necessary to consider four target output speeds such as Vset, Vpacket, Vpacket+1 and 0. For example, if Lremain>0 and n is 1, there is no need to drop the frame, and the normal refresh process is performed every frame. If Lremain>Wfrag, then: when the current package moves for the first time and has been received, Vset is used as Vmove to move frame by frame; when the current package moves for the first time and has not been received, if the acceleration condition is met (Lremain>Vpacket* frameMax), Vpacket+1 is used as Vmove to move frame by frame; when the current package is not moving for the first time (the current frame is not the first frame of the current package), if Lremain>Vpacket* frameMax, Vmove is continued to move frame by frame; when the current package is not moving for the first time, if Lremain<=Vpacket* frameMax, Vpacket is used as Vmove to move frame by frame.
[0204] If Lremain>0, and n is 1, if Lremain<=Wfrag, then: when the Vmove of the current frame is not 0, Vmove will continue to move frame by frame. When the Vmove of the current frame is 0, a data fragment needs to be cached. Therefore, it is determined whether the frame interval framgap is greater than FixedGapFrame. If so, Lremain<= Wfrag is still met, indicating that there is no subsequent package report, so to avoid the current data fragment not being displayed, the display is completed by moving frame by frame according to Vpacket. If framgap is greater than FixedGapFrame, the frame interval framgap is restored to 0, and Vpacket is used as Vmove for frame-by-frame movement. If framgap is not greater than FixedGapFrame, the frame interval framgap increases, skips the current frame, and does not move.
[0205] If Lremain>0, and n>1, frame reduction processing is required, and it is determined whether the frame interval framgap is equal to n. If it is satisfied, the current frame reuses the processing flow of "Lremain>0, and n is 1". If it is not satisfied, the frame interval framgap is increased, and the current frame is skipped without moving.
[0206] In one possible implementation, see Figure 8B The figure shows the real-time movement of the package to be detected. Figure 8B In the figure, package A to be detected has been moved, that is, the complete picture of package A to be detected has been displayed, and package B to be detected has been moved, that is, the complete picture of package B to be detected has been displayed. Package C to be detected is moving, and the complete picture of package C to be detected has not been displayed. Packages D and E to be detected are waiting for the output of the image, and the pictures of packages D and E to be detected have not been displayed.
[0207] For the package C to be detected, each time a data slice of the package C to be detected is added to the designated storage medium, the undisplayed pixel width Lremain of the package C to be detected is increased based on the pixel width of the data slice. Each time the package C to be detected is moved based on the target image output speed Vmove, since Vmove is used to indicate the number of pixels moved horizontally, the undisplayed pixel width Lremain is subtracted from Vmove until Lremain of the package C to be detected = 0, and the movement of the package C to be detected is completed, and the package D to be detected is continued to be moved. The movement process of the package D to be detected is the same as that of the package C to be detected, and will not be repeated here.
[0208] Since the security inspection device reports data fragments of fixed width Wfrag to the client in the form of data fragments and at fixed time intervals Tgap, the client can adopt a regular and effective image output strategy to solve the following problem, that is, adopt the screen display method of this embodiment to solve the following problem.
[0209] 1. In an ideal state, the security inspection device reports data fragments at a fixed time interval Tgap and moves normally at the recommended speed of the package Vpacketorg, then smooth mapping can be completed. However, due to reasons such as abnormal security inspection devices or network fluctuations, the fixed time interval Tgap will change, and the change of the fixed time interval Tgap will cause mapping jams. 2. After the displayed image of the package to be detected is shown on the display interface, when the target zoom ratio increases, the displayed image of the package to be detected needs to be zoomed, which affects the starting point of the coordinates of the package to be detected. Also, since the packages to be detected are continuous, the reduction of the package to be detected will cause an overall pull-back of all packages, resulting in visual jams, that is, mapping jams. 3. The time delay needs to be considered. Comparing the client with the security inspection device, the time difference between the two should not be greater than 300 ms to ensure timeliness, that is, the time difference between the image shown on the client and the image collected by the security inspection device should not be greater than 300 ms. 4. When multiple security inspection devices are connected to the client, there may be a backlog problem caused by excessive reception of packages to be detected. In this case, how to better display the packages that have been received and reduce the time delay also needs to be solved.
[0210] In view of the above findings, the following solutions can be adopted in this embodiment to solve the above problems: When Lremain is not greater than the pixel width Wfrag of the data fragment, the target mapping speed Vmove may be 0. When Lremain is greater than the pixel width Wfrag of the data fragment, the target mapping speed Vmove cannot be 0, but Vset, Vpacket, Vpacket + 1 are used as the target mapping speeds. That is, when Lremain < Wfrag, the interface stays still, and when Lremain is greater than or equal to Wfrag, Vset, Vpacket, Vpacket + 1 need to be used as the target mapping speeds, and the displayed image is moved based on the target mapping speeds.
[0211] Based on this, at most one data fragment is cached, which is equivalent to at most a 1-data-fragment time delay. The time delay of one data fragment is the fixed time interval Tgap, which is less than 100 ms. In this way, the time difference between the image shown on the client and the image collected by the security inspection device can be controlled to be not greater than 300 ms, ensuring timeliness, and thus solving problem 3. On the basis of ensuring timeliness, problem 4 can also be solved. By caching one data fragment, even if the fixed time interval Tgap changes and the next data fragment cannot be sent to the client in time, before the next data fragment arrives, the client can also display the data fragment cached locally, avoiding display interruption, solving the mapping jams caused by the change of the fixed time interval Tgap, and thus solving problem 1.
[0212] When Lremain is greater than Vpacket*frameMax, it means that the width of undisplayed pixels is large. By taking the sum of Vpacket and the target value as the target image output speed Vmove, that is, increasing the value of the target image output speed Vmove, more images can be displayed each time. Based on this, the width of undisplayed pixels can be displayed as soon as possible, so that the time difference between the image displayed by the client and the image collected by the security inspection device is controlled to be no more than 300ms, ensuring timeliness, thereby solving problem 3. On the basis of ensuring timeliness, problem 4 can also be solved.
[0213] After the displayed image of the package to be detected is displayed on the display interface, when the target zoom ratio increases, the target starting coordinates of the package to be detected can be recalculated, that is, the starting coordinates are updated due to the real-time change of the zoom ratio, so as to add blank strips to the package to be detected, so as to solve the jamming problem caused by the overall pull-back of the output interface, and ensure the smooth output of the package to be detected, thereby improving the smoothness of the output, thereby solving problem 2.
[0214] It can be seen from the above technical solutions that in the embodiment of the present application, the original screen is scaled by the target zoom ratio to obtain the first sub-screen, and the first sub-screen is displayed on the display interface, which can ensure the smooth output of the package to be detected, solve the problem of image jamming, and improve the smoothness of image output. The second sub-screen is determined based on the target image output speed, and the second sub-screen is displayed on the display interface, which can ensure the real-time output of the package to be detected, ensure the timeliness of the image output, so that the image displayed by the client and the image collected by the security inspection device do not differ by more than a preset time (such as 0.3s), reducing the delay difference between the client and the security inspection device.
[0215] Solve the problem of image output jamming while ensuring timeliness, improve the smoothness of image output, and achieve smooth image output. Smooth image output means that the package data can be output in real time according to the different speeds of the security inspection equipment. The overall display efficiency of the package on the client is no more than 0.3s different from that of the security inspection equipment. By displaying the main view and the top view on the display interface at the same time, it is convenient for the image judge to judge the image, and the smooth display of the image allows the image judge to judge multiple images at the same time, reducing the situation of missed package judgment and distribution timeout, better improving the efficiency of security inspection image judgment, and making the client more efficient.
[0216] Based on the same application concept as the above method, an image display device is proposed in the embodiment of the present application, which is applied to a client, and the image data of the package to be detected is stored in the designated storage medium of the client, see Fig. 9A FIG. 1 is a schematic diagram of the structure of the image display device, and the device may include: The processing module 911 is used to obtain the to-be-displayed picture corresponding to the to-be-detected package each time the displayed picture of the to-be-detected package displayed on the display interface is updated, and the to-be-displayed picture includes a first sub-picture and a second sub-picture; wherein, when obtaining the first sub-picture, if the target zoom ratio of the to-be-detected package increases, the first sub-data corresponding to the displayed picture is selected from the image data, an original picture is generated based on the first sub-data, and the original picture is zoomed based on the target zoom ratio to obtain the first sub-picture; if the target zoom ratio remains unchanged, the first sub-picture is the displayed picture; wherein, when obtaining the second sub-picture, the second sub-data is selected from the image data based on the acquired target image output speed, and the second sub-picture is generated based on the second sub-data, and the target image output speed indicates the pixel width of the lateral movement corresponding to the second sub-picture; The display module 912 is used to display the first sub-picture and the second sub-picture through the display interface; wherein the second sub-picture is spliced behind the first sub-picture.
[0217] Exemplarily, the display interface includes a main perspective display area and a bird's-eye view display area, and when the display module 912 displays the first sub-screen and the second sub-screen through the display interface, it is specifically used to: display the first sub-screen of the main perspective and the second sub-screen of the main perspective through the main perspective display area; display the first sub-screen of the bird's-eye view and the second sub-screen of the bird's-eye view through the bird's-eye view display area; wherein the image data includes main perspective image data and bird's-eye view image data, the main perspective image data is used to obtain the first sub-screen of the main perspective and the second sub-screen of the main perspective, and the bird's-eye view image data is used to obtain the first sub-screen of the bird's-eye view and the second sub-screen of the bird's-eye view.
[0218] Exemplarily, when the processing module 911 obtains the target zoom ratio of the package to be detected, it is specifically used to: determine whether a new data slice of the package to be detected is added to the designated storage medium each time the displayed image of the package to be detected is updated; wherein, the image data of the package to be detected includes multiple data slices, and the security inspection device sends each data slice to the client in turn, and the client stores each data slice to the designated storage medium in turn; if not, the stored zoom ratio is used as the target zoom ratio; and / or, if so, determine the target cropping value based on the cropping value of the newly added data slice and the cropping value of each stored data slice, and determine the package display height based on the target cropping value; determine the initial zoom ratio based on the package display height and the height of the viewing angle display area of the display interface; determine the target zoom ratio based on the initial zoom ratio.
[0219] Exemplarily, when the processing module 911 determines the target cropping value based on the cropping value of the newly added data slice and the cropping value of each stored data slice, it is specifically used to: select the minimum upper cropping starting value from the upper cropping starting value of the newly added data slice and the upper cropping starting value of each stored data slice, select the maximum lower cropping starting value from the lower cropping starting value of the newly added data slice and the lower cropping starting value of each stored data slice, and determine the minimum upper cropping starting value and the maximum lower cropping starting value as the target cropping value. And / or, when the processing module 911 determines the package display height based on the target cropping value, it is specifically used to: determine the package display height based on the actual package height of the data slice, the minimum upper cropping starting value and the maximum lower cropping starting value; wherein the actual package height represents the height of the image collected by the security inspection device, and the package display height represents the height of the image displayed in the viewing angle display area.
[0220] Exemplarily, when determining the initial zoom ratio based on the package display height and the height of the viewing angle display area of the display interface, the processing module 911 is specifically used to: calculate the ratio value between the height of the viewing angle display area of the display interface and the package display height; if the ratio value is less than 1, determine the initial zoom ratio to be the ratio value; if the ratio value is not less than 1, determine the initial zoom ratio to be 1.
[0221] Exemplarily, when determining the target zoom ratio based on the initial zoom ratio, the processing module 911 is specifically used to: calculate a first product value between a frame interval parameter, the initial zoom ratio and the obtained recommended package speed, and round down the first product value to obtain an initial image output speed; wherein the recommended package speed is used to indicate the pixel width of the lateral movement; if the second product value between the initial zoom ratio and the recommended package speed is greater than 1, the frame interval parameter is 1; if the second product value is less than 1, the frame interval parameter is greater than 1, and the frame interval parameter is used to make the first product value greater than or equal to 1; if the frame interval parameter is 1 and the initial image output speed is greater than or equal to 1, the target zoom ratio is determined based on the quotient of the initial image output speed and the recommended package speed; if the frame interval parameter is greater than 1, and / or the initial image output speed is less than 1, the target zoom ratio is determined to be the initial zoom ratio.
[0222] Exemplarily, when the display module 912 displays the first sub-screen and the second sub-screen through the display interface, it is specifically used to: start from the target starting coordinates of the display interface, and display the first sub-screen and the second sub-screen in sequence; wherein the target starting coordinates are determined based on the current ending coordinates and the target zoom ratio, and the current ending coordinates represent the ending coordinates when the screen of the package to be detected was last displayed; if the target zoom ratio remains unchanged, the target starting coordinates remain unchanged; and / or, if the target zoom ratio increases, based on the current ending coordinates, the target zoom ratio and the stored zoom ratio, determine the interval pixel width between the target starting coordinates and the current ending coordinates of the package to be detected, and determine the target starting coordinates based on the interval pixel width and the current ending coordinates.
[0223] Exemplarily, when the processing module 911 obtains the target image output speed, it is specifically used to: determine the undisplayed pixel width corresponding to the package to be detected; wherein, each time a data slice of the package to be detected is added in the designated storage medium, the undisplayed pixel width is increased based on the pixel width of the data slice; each time the second sub-data is selected from the image data based on the target image output speed, the undisplayed pixel width is reduced based on the pixel width of the lateral movement indicated by the target image output speed; if the undisplayed pixel width is greater than the pixel width of the data slice, and the package to be detected is not displayed on the display interface for the first time, it is determined whether the undisplayed pixel width is not greater than the product value between the acquired initial image output speed and the configured maximum time interval; if so, the stored image output speed is determined as the target image output speed, and the target image output speed is stored; and / or, if not, the initial image output speed is determined as the target image output speed, and the target image output speed is stored.
[0224] Exemplarily, when the processing module 911 obtains the target image output speed, it is specifically used to: if the undisplayed pixel width is not greater than the pixel width of the data slice, and the stored image output speed is not 0, determine the stored image output speed as the target image output speed, and store the target image output speed; and / or, if the stored image output speed is 0, determining whether the frame interval is greater than a fixed frame number; wherein the fixed frame number is determined based on a quotient of a pixel width of the data slice and an acquired recommended speed of the package; If not, add 1 to the frame interval, determine that the target image output speed is 0, and store the target image output speed, and the initial value of the frame interval is 0; and / or, if yes, determine the initial image output speed as the target image output speed, store the target image output speed, and update the frame interval to 0.
[0225] Exemplarily, the processing module 911 is further used to obtain a third sub-screen corresponding to the package to be detected when the package to be detected is displayed on the display interface for the first time; the display module 912 is further used to display the third sub-screen through the display interface; wherein, the processing module 911 is further used to select third sub-data from the image data stored in the designated storage medium based on the acquired target output speed, and generate the third sub-screen based on the third sub-data.
[0226] Exemplarily, when the processing module 911 obtains the target image output speed, it is specifically used to: determine the undisplayed pixel width corresponding to the package to be detected; if the undisplayed pixel width is larger than the pixel width of the data slice, determine whether the undisplayed pixel width is larger than the product value of the acquired initial image output speed and the configured maximum time interval; if not, determine the initial image output speed as the target image output speed, and store the target image output speed; and / or, if so, determine the target image output speed based on the initial image output speed and the configured target value, and store the target image output speed; wherein, the target image output speed is larger than the initial image output speed, and the target value is larger than 0.
[0227] Based on the same application concept as the above method, an electronic device (such as a client) is proposed in the embodiment of the present application, see Fig. 9B As shown, it includes: a processor 921 and a machine-readable storage medium 922, the machine-readable storage medium 922 stores machine-executable instructions that can be executed by the processor 921; the processor 921 is used to execute the machine-executable instructions to implement the screen display method disclosed in the above example of this application.
[0228] Based on the same application concept as the above method, an embodiment of the present application also provides a machine-readable storage medium, on which a number of computer instructions are stored. When the computer instructions are executed by a processor, the screen display method disclosed in the above example of the present application can be implemented.
[0229] The above-mentioned machine-readable storage medium may be any electronic, magnetic, optical or other physical storage device, which may contain or store information, such as executable instructions, data, etc. For example, the machine-readable storage medium may be: RAM (Radom Access Memory), volatile memory, non-volatile memory, flash memory, storage drive (such as hard disk drive), solid state drive, any type of storage disk (such as optical disk, DVD, etc.), or similar storage medium, or a combination thereof.
[0230] Based on the same application concept as the above method, an embodiment of the present application further provides a computer program product, which may include a computer program. When the computer program is executed by a processor, the screen display method disclosed in the above example of the present application can be implemented.
[0231] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
[0232] The above is only the embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims
1. A screen display method, characterized in that: Applied to a client, the image data of the package to be detected is stored in a designated storage medium of the client, and the method includes: Each time the displayed picture of the package to be detected displayed on the display interface is updated, the picture to be displayed corresponding to the package to be detected is obtained, and the picture to be displayed includes a first sub-picture and a second sub-picture; wherein, if the target zoom ratio of the package to be detected increases, the first sub-data corresponding to the displayed picture is selected from the image data, an original picture is generated based on the first sub-data, and the original picture is zoomed based on the target zoom ratio to obtain the first sub-picture; if the target zoom ratio remains unchanged, the first sub-picture is the displayed picture; wherein, based on the obtained target image output speed, the second sub-data is selected from the image data, and the second sub-picture is generated based on the second sub-data, and the target image output speed indicates the pixel width of the horizontal movement corresponding to the second sub-picture; Displaying the first sub-picture and the second sub-picture through the display interface; The second sub-picture is spliced behind the first sub-picture.
2. The method according to claim 1, characterized in that The display interface includes a main viewing angle display area and a top-view viewing angle display area, and displaying the first sub-picture and the second sub-picture through the display interface includes: Displaying a first sub-picture from the main perspective and a second sub-picture from the main perspective in the main perspective display area; Displaying a first sub-picture from a top-down perspective and a second sub-picture from a top-down perspective in the top-down perspective display area; Among them, the image data includes main perspective image data and overhead perspective image data, the main perspective image data is used to obtain a first sub-picture of the main perspective and a second sub-picture of the main perspective, and the overhead perspective image data is used to obtain a first sub-picture of the overhead perspective and a second sub-picture of the overhead perspective.
3. The method according to claim 1, characterized in that The process of acquiring the target scaling ratio of the package to be detected includes: Each time the displayed image of the package to be detected is updated, determining whether a data slice of the package to be detected is newly added in the designated storage medium; wherein the image data of the package to be detected includes a plurality of data slices, the security inspection device sends each data slice to the client in turn, and the client stores each data slice in turn to the designated storage medium; If not, the stored zoom ratio is used as the target zoom ratio; And / or, if so, determining a target cropping value based on the cropping value of the newly added data slice and the cropping values of each stored data slice, determining a package display height based on the target cropping value; determining an initial zoom ratio based on the package display height and the height of the viewing angle display area of the display interface; and determining a target zoom ratio based on the initial zoom ratio.
4. The method according to claim 3, characterized in that The determining of the target clipping value based on the clipping value of the newly added data slice and the clipping values of each stored data slice comprises: selecting a minimum upper clipping starting value from the upper clipping starting value of the newly added data slice and the upper clipping starting values of each stored data slice, selecting a maximum lower clipping starting value from the lower clipping starting value of the newly added data slice and the lower clipping starting values of each stored data slice, and determining the minimum upper clipping starting value and the maximum lower clipping starting value as the target clipping value; And / or, determining the package display height based on the target cropping value includes: determining the package display height based on the actual height of the package of the data slice, the minimum upper cropping starting value and the maximum lower cropping starting value; wherein, the actual height of the package represents the height of the image collected by the security inspection equipment, and the package display height represents the height of the image displayed in the viewing angle display area.
5. The method according to claim 3, characterized in that: The determining of the initial zoom ratio based on the package display height and the height of the viewing angle display area of the display interface includes: calculating the ratio value between the height of the viewing angle display area of the display interface and the package display height; if the ratio value is less than 1, determining the initial zoom ratio to be the ratio value; if the ratio value is not less than 1, determining the initial zoom ratio to be 1.
6. The method according to claim 3, characterized in that: The determining the target zoom ratio based on the initial zoom ratio comprises: Calculate a first product value between a frame interval parameter, the initial zoom ratio and the obtained recommended package speed, and round down the first product value to obtain an initial image output speed; wherein the recommended package speed is used to indicate a pixel width of lateral movement; if a second product value between the initial zoom ratio and the recommended package speed is greater than 1, the frame interval parameter is 1; if the second product value is less than 1, the frame interval parameter is greater than 1, and the frame interval parameter is used to make the first product value greater than or equal to 1; If the frame interval parameter is 1 and the initial image output speed is greater than or equal to 1, the target zoom ratio is determined based on the quotient of the initial image output speed and the recommended package speed; If the frame interval parameter is greater than 1, and / or the initial image output speed is less than 1, the target zoom ratio is determined to be the initial zoom ratio.
7. The method according to any one of claims 1 to 6, characterized in that: The displaying the first sub-picture and the second sub-picture through the display interface includes: Starting from the target starting coordinates of the display interface, the first sub-screen and the second sub-screen are displayed in sequence; wherein the target starting coordinates are determined based on the current ending coordinates and the target zoom ratio, and the current ending coordinates represent the ending coordinates when the screen of the package to be detected was last displayed; Among them, if the target zoom ratio remains unchanged, the target starting coordinates remain unchanged; and / or, if the target zoom ratio increases, the interval pixel width between the target starting coordinates and the current ending coordinates of the package to be detected is determined based on the current ending coordinates, the target zoom ratio and the stored zoom ratio, and the target starting coordinates are determined based on the interval pixel width and the current ending coordinates.
8. The method according to any one of claims 1 to 6, characterized in that: The process of obtaining the target image output speed includes: Determine the undisplayed pixel width corresponding to the package to be detected; wherein, each time a data slice of the package to be detected is added to the designated storage medium, the undisplayed pixel width is increased based on the pixel width of the data slice; each time a second sub-data is selected from the image data based on the target image output speed, the undisplayed pixel width is reduced based on the pixel width of the lateral movement indicated by the target image output speed; If the undisplayed pixel width is greater than the pixel width of the data slice, and the package to be detected is not displayed on the display interface for the first time, then determining whether the undisplayed pixel width is not greater than the product value of the acquired initial image output speed and the configured maximum time interval; If so, the stored image output speed is determined as the target image output speed, and the target image output speed is stored; and / or, if not, the initial image output speed is determined as the target image output speed, and the target image output speed is stored.
9. The method according to claim 8, characterized in that The process of obtaining the target image output speed includes: If the undisplayed pixel width is not greater than the pixel width of the data slice, and the stored image output speed is not 0, the stored image output speed is determined as the target image output speed, and the target image output speed is stored; and / or, if the stored image output speed is 0, determining whether the frame interval is greater than a fixed frame number; wherein the fixed frame number is determined based on a quotient of a pixel width of the data slice and an acquired recommended speed of the package; If not, the frame interval is increased by 1, the target image output speed is determined to be 0, and the target image output speed is stored, and the initial value of the frame interval is 0; and / or, if yes, the initial image output speed is determined as the target image output speed, and the target image output speed is stored, and the frame interval is updated to 0.
10. The method according to any one of claims 1 to 6, characterized in that: The method further comprises: When the package to be detected is displayed on the display interface for the first time, obtaining a third sub-picture corresponding to the package to be detected, and displaying the third sub-picture through the display interface; wherein, based on the acquired target image output speed, third sub-data is selected from the image data stored in the designated storage medium, and the third sub-picture is generated based on the third sub-data; The process of obtaining the target image output speed includes: Determine the undisplayed pixel width corresponding to the package to be detected; If the undisplayed pixel width is greater than the pixel width of the data slice, determining whether the undisplayed pixel width is greater than the product value of the acquired initial image output speed and the configured maximum time interval; If not, the initial image output speed is determined as the target image output speed, and the target image output speed is stored; And / or, if so, determining a target image output speed based on the initial image output speed and the configured target value, and storing the target image output speed; wherein the target image output speed is greater than the initial image output speed.
11. A screen display device, characterized in that: Applied to a client, the image data of the package to be detected is stored in a designated storage medium of the client, and the device comprises: a processing module, configured to obtain a to-be-displayed picture corresponding to the to-be-detected package each time the displayed picture of the to-be-detected package displayed on the display interface is updated, the to-be-displayed picture including a first sub-picture and a second sub-picture; wherein, when obtaining the first sub-picture, if the target zoom ratio of the to-be-detected package increases, the first sub-data corresponding to the displayed picture is selected from the image data, an original picture is generated based on the first sub-data, and the original picture is zoomed based on the target zoom ratio to obtain the first sub-picture; if the target zoom ratio remains unchanged, the first sub-picture is the displayed picture; wherein, when obtaining the second sub-picture, the second sub-data is selected from the image data based on the acquired target image output speed, the second sub-picture is generated based on the second sub-data, and the target image output speed indicates the pixel width of the lateral movement corresponding to the second sub-picture; A display module, configured to display the first sub-picture and the second sub-picture through the display interface; The second sub-picture is spliced behind the first sub-picture.
12. An electronic device, characterized in that: include: a processor and a machine-readable storage medium storing machine-executable instructions executable by the processor; The processor is used to execute machine executable instructions to implement the method described in any one of claims 1-10.
Citation Information
Patent Citations
Image presenting method, device and electronic equipment
CN108008870A
Interaction method and device for touch display terminal
CN108459802A
Method and equipment for marking dangerous goods in security inspection machine
CN111612089A
Display device and video image scaling method
CN112243148A
Display control method, display control device and intelligent equipment
CN115657893A