Image processing method, electronic equipment, shooting equipment and image processing system

Abstract

The embodiment of the invention discloses an image processing method, electronic equipment, shooting equipment and an image processing system. The image processing method comprises the following steps: acquiring images corresponding to a plurality of candidate display boards; in response to a selection operation for the candidate display boards, determining a selected target display board from the plurality of candidate display boards; and based on the image corresponding to the target display board, highlighting the target display board.

Description

Technical Field

[0001] This application relates to, but is not limited to, the field of image detection, and particularly to an image processing method, electronic device, imaging device, and image processing system. Background Technology

[0002] In applications such as video conferencing, video calls, and live video streaming, information can be written or displayed on a display board. In related technologies, the display board in the scene image can be identified by recognizing the scene image captured by the shooting device. However, in actual application scenarios, when there are multiple display boards, since users usually only need to focus on the information in one display board, the display board identified by image recognition may not meet the user's display needs. Summary of the Invention

[0003] This application provides an image processing method, an electronic device, an imaging device, and an image processing system.

[0004] According to a first aspect of the embodiments of this application, an image processing method is provided, applied in an electronic device, the method comprising:

[0005] Acquire images corresponding to multiple candidate display panels;

[0006] In response to the selection operation for the candidate display panel, a target display panel is determined from the plurality of candidate display panels;

[0007] Based on the image corresponding to the target display panel, the target display panel is highlighted.

[0008] In some embodiments, determining the selected target display panel from the plurality of candidate display panels in response to a selection operation on the candidate display panels includes: displaying a target selection control for the display panel, wherein the target selection control includes a first area for selecting a target display panel from the plurality of candidate display panels; and determining the selected target display panel from the plurality of candidate display panels in response to a target selection operation on the first area.

[0009] In some embodiments, the target selection control further includes a second area for previewing the target display panel, and the first area and the second area have the same display priority.

[0010] In some embodiments, determining the selected target display panel from the plurality of candidate display panels in response to a target selection operation for the first region includes: determining the target display panel with an adjustable range from the plurality of candidate display panels in response to a target selection operation for the first region; displaying a range adjustment control in response to an adjustment trigger operation for the target display panel, the range adjustment control being used to adjust the range of the target display panel; and determining the adjusted target display panel range in response to a range adjustment operation for the range adjustment control, and using the display panel area corresponding to the target display panel range as the selected target display panel.

[0011] In some embodiments, the step of determining the adjusted target display board range in response to a range adjustment operation of the range adjustment control, and using the display board area corresponding to the target display board range as the selected target display board, includes: determining the adjusted target display board range in response to a range adjustment operation of the range adjustment control; and updating the first area according to the adjusted target display board range in response to a confirmation operation of the adjusted target display board range.

[0012] In some embodiments, the target selection control further includes a third region for displaying a target display panel of the range to be adjusted, the third region having a higher display priority than the first region; the step of displaying the range adjustment control of the target display panel in response to an adjustment trigger operation for the target display panel includes: displaying the range adjustment control of the target display panel in the third region in response to an adjustment trigger operation for the target display panel.

[0013] In some embodiments, the range adjustment control adjusts the target display panel range by adjusting at least one of the corner points, edges, and the entirety of the target display panel range.

[0014] In some embodiments, after determining a selected target display panel from the plurality of candidate display panels in response to a target selection operation for the first region, the method further includes: enhancing the image corresponding to the target display panel in the second region to preview the target display panel.

[0015] In some embodiments, the first area is further used to display images corresponding to the plurality of candidate display panels; the step of determining the selected target display panel from the plurality of candidate display panels in response to a target selection operation for the first area includes: in response to a trigger operation for the first area, magnifying the first area to emphasize the images corresponding to the plurality of candidate display panels; and in response to a selection operation for candidate display panels in the magnified image, determining the selected target display panel from the plurality of candidate display panels.

[0016] In some embodiments, acquiring images corresponding to multiple candidate display boards includes: displaying a mode switching control for a display board mode, the trigger control being used to switch the electronic device from the current mode to the display board mode; in response to a trigger operation on the mode switching control, issuing a shooting command to a shooting device that has a communication connection with the electronic device; acquiring a first image captured by the shooting device based on the shooting command; and acquiring images corresponding to the multiple candidate display boards based on the first image.

[0017] In some embodiments, obtaining the images corresponding to the plurality of candidate display boards based on the first image includes: converting the first image into a grayscale image and detecting line segments in the grayscale image; determining the positions of a plurality of corner points in the captured image by calculating the intersection points of the detected line segments; determining a plurality of sets of corner points based on the positions of the plurality of corner points in the first image, wherein each set of corner points belongs to the same display board image; and obtaining the images corresponding to the plurality of candidate display boards in the first image based on the relative positions of each set of corner points in the plurality of sets of corner points.

[0018] In some embodiments, obtaining the images corresponding to the plurality of candidate display boards based on the first image includes: converting the first image into a grayscale image and detecting line segments in the grayscale image; determining the positions of a plurality of corner points in the captured image by calculating the intersection points of the detected line segments; determining a group of corner points belonging to the same display board image from among the plurality of corner points based on the positions of the plurality of corner points in the first image; and obtaining the images corresponding to the plurality of candidate display boards based on the group of corner points belonging to the same display board image.

[0019] In some embodiments, obtaining the images corresponding to the plurality of candidate display boards based on a set of corner points belonging to the same display board image includes: determining the position of the corresponding display board image in the first image based on a set of corner points belonging to the same display board image; determining the rotation parameters of the shooting device based on the position of the corresponding display board image in the first image; sending a control command to the shooting device, the control command being used to instruct the shooting device to take a picture after rotating according to the rotation parameters; receiving a second image sent by the shooting device, and obtaining the images corresponding to the plurality of candidate display boards based on the second image.

[0020] According to a second aspect of the embodiments of this application, an image processing method is provided, applied to a shooting device, the method comprising: in response to receiving a shooting instruction sent by an electronic device, acquiring a first image based on the shooting instruction; sending the first image to the electronic device, the electronic device being configured to acquire images corresponding to a plurality of candidate display panels based on the first image, and to determine a target display panel from the plurality of candidate display panels in response to a selection operation for the candidate display panels; and highlighting the target display panel based on the image corresponding to the target display panel.

[0021] In some embodiments, after sending the first image to the electronic device, the method further includes: receiving a control command sent by the electronic device, the control command being used to instruct the shooting device to take a picture after rotating according to the rotation parameters; acquiring a second image by executing the control command; and sending the second image to the electronic device, so that the electronic device acquires the image corresponding to the plurality of candidate display boards based on the second image.

[0022] According to a third aspect of the present application, an electronic device is provided, the electronic device including a processor and a memory for storing a computer program capable of running on the processor; wherein the processor is used to run the computer program to perform any of the above-described image processing methods applied to the electronic device.

[0023] According to a fourth aspect of the embodiments of this application, a shooting device is provided, the shooting device being configured to perform any of the above-described image processing methods applied to the shooting device.

[0024] According to a fifth aspect of the embodiments of this application, an image processing system is provided, the image processing system including at least one electronic device and at least one shooting device, wherein the electronic device and the shooting device are in a communication connection.

[0025] As can be seen, the embodiments of this application can determine the target display board from multiple candidate display boards after obtaining images corresponding to multiple candidate display boards, based on the selection operation for the candidate display boards, which is beneficial to meeting the user's selection and display needs for display boards.

[0026] It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and are not intended to limit the technical solutions of this application. Attached Figure Description

[0027] To more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0028] Figure 1 This is a schematic diagram illustrating the process of switching electronic devices to display panel mode in related technologies;

[0029] Figure 2 This is a schematic diagram illustrating the process of an electronic device exiting the display panel mode in related technologies.

[0030] Figure 3 This is a flowchart illustrating an image processing method applied to an electronic device according to an embodiment of this application;

[0031] Figure 4 This is an example image of a candidate display panel according to an embodiment of this application;

[0032] Figure 5 These are example images of multiple candidate display panels according to embodiments of this application;

[0033] Figure 6 A schematic diagram of the target selection control provided in an embodiment of this application;

[0034] Figure 7 This is a magnified schematic diagram of the first region provided in an embodiment of this application;

[0035] Figure 8 This is a schematic diagram illustrating the effect of the target display panel provided in an embodiment of this application.

[0036] Figure 9 A schematic diagram of the range adjustment control provided in an embodiment of this application;

[0037] Figure 10 A schematic diagram illustrating the execution logic of an electronic device after switching to display panel mode, as provided in an embodiment of this application.

[0038] Figure 11 This is a flowchart illustrating an image processing method applied to a shooting device according to an embodiment of this application;

[0039] Figure 12 A schematic diagram of the composition structure of the electronic device provided in the embodiments of this application;

[0040] Figure 13 This is a schematic diagram of an image processing system provided in an embodiment of this application. Detailed Implementation

[0041] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0042] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0043] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains. The terminology used herein is for descriptive purposes only and is not intended to be limiting of this application.

[0044] In related technologies, information can be written or displayed on a display board, which refers to a flat surface that can be used for writing or demonstrations. For example, display boards can include, but are not limited to, whiteboards, transparent boards, semi-transparent boards, blackboards, white walls, electronic whiteboards, wallpaper, screens, writable glass surfaces, and monitors. In application scenarios such as video conferencing, video calls, and live video streaming, there is a need for information display on display boards. In practical applications, the display board can be identified by recognizing scene images captured by a camera. Specifically, the information display needs for display boards in related technologies manifest in the following ways: 1) When the camera cannot directly face the display board, the surface of the display board will be distorted to some extent. Users need to correct the area of ​​the display board to a rectangle to facilitate reading; 2) There is a need for enhanced visual effects, such as wanting to magnify the display board area to make details clearer; 3) In meeting scenarios, there is a need to share the display board image with others.

[0045] To address the above requirements, the positions of the four corner points of the display board in the image can be determined automatically or manually, thereby achieving display board recognition. In the first technical solution, a dedicated camera can be installed above the display board. The camera detects the four corner points in the captured image and generates a corrected rectangular image based on their positions. The drawbacks of this solution include: 1) Insufficient flexibility, requiring pre-installation of the camera, and the installation location is limited; 2) Once installed, the camera can only be used to capture the display board image and cannot be used for other purposes, limiting its application scenarios; 3) The display board recognition is not accurate enough, usually requiring manual adjustment of the recognition results by the user, resulting in low intelligence.

[0046] In the second technical solution related to the technology, the display board image can be displayed using a webcam and related software for recognizing the display board, as shown in the reference. Figure 1 After the software on the electronic device is running, the user can trigger relevant processing for the display panel by clicking on the display panel mode. No prompts will be generated during the display panel recognition process. (See reference...) Figure 2 When the electronic device is in display board mode, the user can exit display board mode by clicking the display board button or other buttons.

[0047] The second technical solution of the related technology has the following problems: 1) There are no relevant prompts for the display board. The image display board is unpredictable, and there are no related abnormal or error prompts, resulting in poor user perception. Throughout the process of the electronic device displaying the display board information, the user cannot know the stage the electronic device is in, nor how to adjust for potential errors; 2) When the image display board includes multiple display boards, it does not support the user selecting a target display board; 3) It does not support the user's fine-tuning or manual adjustment of the display board. The user cannot edit the recognized display board, and there may be situations where the display board area does not meet the user's expectations.

[0048] In view of the above-mentioned technical problems existing in related technologies, the technical solutions of the embodiments of this application are proposed.

[0049] This application provides an image processing method that can be applied to an electronic device. Exemplarily, the electronic device can be a terminal with a display, such as a mobile phone, tablet computer, personal computer (PC), or camera. In some embodiments, the electronic device may include a camera for capturing images of a display panel; in other embodiments, the electronic device may be independently configured from the camera, and the electronic device and the camera may form a communication connection, for example, through a wired or wireless means.

[0050] Figure 3 This is a flowchart of an image processing method applied to an electronic device according to an embodiment of this application, such as... Figure 3 As shown, the process includes:

[0051] Step 301: Obtain the images corresponding to multiple candidate display boards.

[0052] In this embodiment, images of multiple candidate display boards can be captured using a camera. In some embodiments, the user can aim the camera in an electronic device at the area of ​​the display board. Here, the display board may not be centered in the captured image. For example, the images of multiple candidate display boards captured by the camera include... Figure 4The image of the first candidate display panel 401, and the images of the other candidate display panels besides the image of the first candidate display panel 401. Figure 4 It is not shown in the text.

[0053] It is worth noting that the controls in this application can take the form of icons, input boxes, and buttons, etc. This will not be elaborated further below.

[0054] The triggering operation, selection operation, and other operations can take the form of specific touch operations, such as single click, long press, double click, swipe, and mouse hover, or they can be triggered by voice, gesture, etc. Optionally, the aforementioned operations can also be a combination of a series of operations, which is not limited in this embodiment. This will not be elaborated further in the following sections.

[0055] In some embodiments, the electronic device can be switched from the current mode to the display panel mode based on a preset event. For example, the electronic device can be automatically switched to display panel mode after powering on, or it can be automatically switched to display panel mode periodically. In some embodiments, a mode switching control for the display panel mode can be displayed on the electronic device. The mode switching control can be a specially designed button that can be triggered by user clicks, double-clicks, swipes, gestures, or other actions. For example, refer to... Figure 5 In response to a trigger operation on the mode switching control 501, the electronic device can switch from the current mode to the display board mode. Then, the electronic device can send a shooting command to the shooting device, thereby capturing images corresponding to multiple candidate display boards through the shooting device. Figure 5 The multiple candidate display boards include a second candidate display board 502, a third candidate display board 503, and a fourth candidate display board 504. For example, when the electronic device is in an abnormal state, a mode switching control for the display board mode can be displayed. Here, the abnormal state of the electronic device includes, but is not limited to: the electronic device being in privacy mode, the electronic device being unable to preview images, etc. Privacy mode indicates a mode in which the device's screen cannot be shared with others.

[0056] Step 302: In response to the selection operation for the candidate display panel, determine the target display panel to be selected from multiple candidate display panels.

[0057] In some embodiments, a target selection control for a display panel can be displayed, wherein the target selection control includes a first area for selecting a target display panel from a plurality of candidate display panels; in response to a target selection operation on the first area, the selected target display panel is determined from the plurality of candidate display panels, wherein the target selection operation refers to a related triggering operation for selecting a target display panel from the plurality of candidate display panels. For example, refer to Figure 6The target selection control 60 includes a first area 601. It is worth noting that the candidate display panel in the first area can be presented in various ways; for example, it can be referenced... Figure 6 As shown, the first area displays images including multiple candidate display boards; or, the first area can display the corresponding logos for each candidate display board, wherein the size of each logo can match the actual size of each candidate display board, and the spatial relationship between each logo can match the actual spatial relationship between each candidate display board, so that users can quickly identify the corresponding candidate display board by the logo.

[0058] Here, by presenting a target selection control and a first area, users can clearly know the number and spatial location of each candidate display board and determine the currently selected target display board. That is, the embodiments of this application can make it easier for users to select the target display board by displaying a target selection control for the display board in the electronic device, which is conducive to meeting the user's needs for display board information presentation.

[0059] In some embodiments, refer to Figure 6 The target selection control 60 also includes a second area 602, which is used to preview the target display panel. The first area 601 and the second area 602 have the same display priority.

[0060] Here, display priority is used to characterize the order of priority display. When the first area 601 and the second area 602 have the same display priority, the first area 601 and the second area 602 need to be displayed simultaneously in the target selection control 602. It can be seen that when the first area 601 and the second area 602 have the same display priority, the user can intuitively understand the number and spatial position of each candidate display board, as well as the preview result of the currently selected target display board. This is beneficial for selecting the display board that meets the user's actual needs based on the number and spatial position of each candidate display board and the preview result of the currently selected target display board. This can increase the probability that the user selects the target display board that meets the requirements at once, and the user has a strong perception of the overall process of display board display.

[0061] In some embodiments, after determining the selected target display panel from multiple candidate display panels in response to a target selection operation for a first region, the image corresponding to the target display panel can be enhanced in a second region to preview the target display panel. Exemplarily, enhancing the image corresponding to the target display panel can include, but is not limited to, sharpening the image or enhancing its contrast. By enhancing the image corresponding to the target display panel, the clarity of the corresponding image can be improved, thereby enhancing the preview effect and readability of the target display panel.

[0062] In some embodiments, the first area is further used to display images corresponding to multiple candidate display panels; for example... Figure 6 The images corresponding to the multiple candidate display boards in the first region 601 include the image of the second candidate display board 502, the image of the third candidate display board 503, and the image of the fourth candidate display board 504.

[0063] Accordingly, the process of determining the selected target display panel from multiple candidate display panels in response to a target selection operation on a first region may include: in response to a trigger operation on the first region, magnifying the first region to emphasize the images corresponding to the multiple candidate display panels; and in response to a selection operation on candidate display panels in the magnified image, determining the selected target display panel from the multiple candidate display panels. For example, when targeting... Figure 6 When the first area 601 shown is subjected to click, double-click, mouse hover, or other triggered operations, the first area 601 can be enlarged for display. Figure 7 This is a magnified view of the first area 601.

[0064] As can be seen, by magnifying the first area, users can more intuitively understand the positional relationship of each candidate display board and the information in each candidate display board. Thus, based on the positional relationship of each candidate display board and the information in each candidate display board, they can determine the target display board that meets their actual needs.

[0065] Step 303: Highlight the target display board based on the image corresponding to the target display board.

[0066] Here, refer to Figure 8 Highlighting the target display panel yields a displayed image 80. Examples of methods for highlighting the target display panel include, but are not limited to: sharpening the image corresponding to the target display panel, and enhancing the contrast of the image corresponding to the target display panel. By highlighting the target display panel, the clarity of the image corresponding to the target display panel can be enhanced, increasing readability.

[0067] As can be seen, the embodiments of this application can determine the target display board from multiple candidate display boards after obtaining images corresponding to multiple candidate display boards, based on the selection operation for the candidate display boards, which is beneficial to meeting the user's selection and display needs for display boards.

[0068] In some embodiments of this application, the process of determining the selected target display panel from a plurality of candidate display panels in response to a target selection operation for a first region includes:

[0069] In response to the target selection operation for the first region, the target display panel for the range to be adjusted is determined from multiple candidate display panels;

[0070] In response to an adjustment trigger operation targeting the target display panel, a range adjustment control is displayed, which is used to adjust the range of the target display panel;

[0071] In response to the range adjustment operation of the range adjustment control, the adjusted target display board range is determined, and the display board area corresponding to the target display board range is used as the selected target display board.

[0072] For example, refer to Figure 9 Multiple candidate display panels include a third candidate display panel 503 and a fourth candidate display panel 504. The target display panel for adjustment is determined from these candidates as the third candidate display panel 503. The adjustment trigger operation for the target display panel can be a human-computer interaction operation such as clicking, double-clicking, or dragging, as described in [reference needed]. Figure 9 In response to an adjustment trigger operation targeting the display panel, the range adjustment control 901 can be displayed.

[0073] As can be seen, the scope of the target display board can be manually adjusted using the scope adjustment control, thereby outputting a target display board that meets the user's needs.

[0074] This application embodiment supports adjusting the target display panel range through multiple interactive methods. For example, the range adjustment control 901 can adjust the target display panel range by adjusting at least one of the corner points, edges, and the entire target display panel range. That is, this application embodiment supports rapid adjustment of the target display panel range through dragging points, moving edges, and moving the entire target display panel.

[0075] In some embodiments of this application, in response to a range adjustment operation on the range adjustment control, determining the adjusted target display board range and using the display board area corresponding to the target display board range as the selected target display board includes: in response to a range adjustment operation on the range adjustment control, determining the adjusted target display board range; in response to a confirmation operation on the adjusted target display board range, updating the first area according to the adjusted target display board range. Thus, by performing a confirmation operation on the adjusted target display board range, it can be determined that the adjusted target display board range meets the user's actual needs, thereby updating the first area to meet the user's actual needs based on the adjusted target display board range.

[0076] In some embodiments of this application, reference is made to Figure 9 The target selection control 60 also includes a third region 902, which is used to display the target display panel of the range to be adjusted. The display priority of the third region 902 is higher than that of the first region. In response to the adjustment trigger operation for the target display panel, the range adjustment control of the target display panel is displayed, including: in response to the adjustment trigger operation for the target display panel, the range adjustment control 901 of the target display panel is displayed in the third region 902.

[0077] Understandably, when the third area has a higher display priority than the first area, the third area will be displayed first in the target selection control. In this way, by intuitively displaying the range adjustment control in the third area, the range of the target display board can be quickly and accurately adjusted.

[0078] In some embodiments of this application, in response to a trigger operation on the mode switching control, a shooting command can be issued to the shooting device; then, a first image captured by the shooting device based on the shooting command can be obtained; and images corresponding to multiple candidate display boards can be obtained based on the first image.

[0079] In some embodiments, after acquiring the first image, the user can manually set corner points in the first image to determine the images corresponding to multiple candidate display boards based on the manually determined corner point positions. By manually setting the display board corner points, any area of ​​interest to the user can be determined as the area of ​​the candidate display board.

[0080] In some embodiments, after acquiring the first image, corner points in the first image can be automatically identified, thereby acquiring images corresponding to multiple candidate display boards in the first image based on the positions of each corner point. For example, the process of acquiring images corresponding to multiple candidate display boards based on the first image includes: converting the first image to a grayscale image and detecting line segments in the grayscale image; determining the positions of multiple corner points present in the captured image by calculating the intersection points of the detected line segments; determining multiple sets of corner points based on the positions of the multiple corner points present in the first image, where each set of corner points belongs to the same display board image; and acquiring images corresponding to multiple candidate display boards in the first image based on the relative positions of each set of corner points.

[0081] For example, the first image can be identified by using a detector based on a convolutional neural network to identify the display board regions in the first image. For example, the convolutional neural network detector can be You Only Look Once (YOLO), Single Shot Multibox Detector (SSD), Regions with Convolutional Neural Networks (R-CNN), etc.

[0082] As can be seen, in this embodiment of the application, after the shooting device acquires the first image, the corner position in the image can be determined by automatically identifying the corner point in the first image. Thus, the images corresponding to multiple candidate display boards can be automatically determined based on the position of the corner point.

[0083] In some embodiments, after acquiring images corresponding to multiple candidate display boards in the first image, the candidate display boards can be corrected. For example, based on the principle of perspective transformation, the quadrilateral area enclosed by the corner points can be corrected to a rectangle. Here, the candidate display boards can be corrected using optical correction or software correction. For example, when the distortion of the candidate display board is too great or it is located at the edge of the image, the correction of the candidate display board may result in insufficient edge pixels in the corrected candidate display board image. In this case, pixel filling can be used to ensure the integrity of the image. For example, pixels from the other edge can be used for filling, or fixed pixels such as all-black pixels or all-white pixels can be used for filling.

[0084] This application proposes a scheme based on intelligent recognition and correction of display boards. It eliminates the need for additional stickers or other markers. Users simply place the display board within the shooting range of the camera, and the electronic device automatically detects candidate display board areas in the image using image algorithms. It accurately locates the coordinates of the four corner points of each candidate display board, and then performs rectangular correction, magnification, and display enhancement on the candidate display board area. This scheme boasts advantages such as high display board recognition accuracy, low false detection rate, and intelligent interaction.

[0085] In some embodiments of this application, the process of obtaining images corresponding to multiple candidate display boards based on a first image includes: converting the first image into a grayscale image and detecting line segments in the grayscale image; determining the positions of multiple corner points in the captured image by calculating the intersection points of the detected line segments; determining a group of corner points belonging to the same display board image from among the multiple corner points based on the positions of the multiple corner points in the first image; and obtaining images corresponding to multiple candidate display boards based on the group of corner points belonging to the same display board image.

[0086] In some embodiments, the process of obtaining images corresponding to multiple candidate display boards based on a set of corner points belonging to the same display board image includes: determining the position of the corresponding display board image in a first image based on a set of corner points belonging to the same display board image; determining the rotation parameters of the shooting device based on the position of the corresponding display board image in the first image; sending a control command to the shooting device, the control command being used to instruct the shooting device to take a picture after rotating according to the rotation parameters; receiving a second image sent by the shooting device, and obtaining images corresponding to multiple candidate display boards based on the second image.

[0087] For example, the shooting device may include a camera with a gimbal, and the rotation parameters of the shooting device may include the rotation direction and / or rotation angle of the gimbal.

[0088] Understandably, based on a set of corner points belonging to the same display board image, the position of a corresponding display board image in the first image can be determined. When determining that the corresponding display board image is at the edge of the first image based on its position in the first image, the rotation parameters of the shooting device can be determined based on the positional relationship between the center of the corresponding display board image and the center of the first image, thereby causing the shooting device to rotate towards the corresponding display board. In this way, in the second image re-captured by the shooting device, the corresponding display board image can be located in the central area of ​​the second image. In some embodiments, after acquiring the image captured by the shooting device, candidate display boards can be detected once every 1 second. If the four corner points of the display board are successfully detected, the lens of the shooting device is rotated towards the corresponding display board. After detecting the display board image, the quadrilateral area of ​​the display board image can be corrected and the image magnified, and the display board detection process can be stopped. If no candidate display board image is successfully detected after a period of continuous detection (e.g., 10 seconds), the display board mode can be exited.

[0089] As can be seen, the embodiments of this application can automatically capture a complete image of a display board when only part of the display board is in the image, by controlling the rotation of the shooting device, which has the advantages of high intelligence and good interactive experience.

[0090] In some embodiments, refer to Figure 10 When an electronic device switches to display board mode for the first time, candidate display boards can be identified based on the content described in the aforementioned embodiments, a target display board can be selected, the range of the target display board can be adjusted, and then the target display board can be highlighted. When the electronic device switches to display board mode for the first time, a prompt control can be displayed to prompt the user whether to select the previously displayed target display board. The prompt control can be a pop-up window or other text prompts. If the user decides to select the previously displayed target display board, it can be displayed directly. If the user decides not to select the previously displayed target display board, the execution logic of the electronic device switching to display board mode for the first time can be followed to re-identify candidate display boards, select a target display board, adjust the range of the target display board, and highlight the target display board.

[0091] Figure 11 This is a flowchart of an image processing method applied to a shooting device according to an embodiment of this application, such as... Figure 11 As shown, the process includes:

[0092] Step 111: In response to receiving a shooting command from an electronic device, acquire a first image based on the shooting command.

[0093] Step 112: Send the first image to the electronic device, which is used to acquire images corresponding to multiple candidate display boards based on the first image, and to determine the target display board from the multiple candidate display boards in response to the selection operation of the candidate display board; and to highlight the target display board based on the image corresponding to the target display board.

[0094] The implementation methods of steps 111 and 112 have been explained in the foregoing description.

[0095] As can be seen, the embodiments of this application can obtain images corresponding to multiple candidate display boards based on the first image. After obtaining the images corresponding to multiple candidate display boards, the target display board is determined from multiple candidate display boards based on the selection operation for the candidate display boards, which is beneficial to meeting the user's selection and display needs for display boards.

[0096] In some embodiments, after sending the first image to the electronic device, the capturing device can also receive a control command sent by the electronic device, the control command being used to instruct the capturing device to take a picture after rotating according to the rotation parameters; the capturing device can also acquire a second image by executing the control command; and send the second image to the electronic device, so that the electronic device can acquire the image corresponding to the plurality of candidate display boards based on the second image.

[0097] Those skilled in the art will understand that, in the above-described method of the specific implementation, the order in which each step is written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0098] It should be noted that, in the embodiments of this application, if the above methods are implemented as software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiments of this application, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a terminal, server, etc.) to execute all or part of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), magnetic disks, or optical disks. Thus, the embodiments of this application are not limited to any specific hardware and software combination.

[0099] Correspondingly, this application embodiment further provides a computer program product, the computer program product including computer executable instructions, which are used to implement any of the image processing methods provided in this application embodiment.

[0100] Accordingly, this application embodiment further provides a computer storage medium storing computer-executable instructions, which are used to implement any of the image processing methods provided in the above embodiments.

[0101] Based on the image processing method for electronic devices proposed in the foregoing embodiments, this application proposes an electronic device. Figure 12 This is a schematic diagram of the composition structure of the electronic device provided in the embodiments of this application, such as... Figure 12 As shown, the electronic device 120 may include:

[0102] Memory 121 is configured to store executable instructions;

[0103] When the processor 122 is configured to execute executable instructions stored in the memory 121, it implements any of the above-described image processing methods applied to an electronic device.

[0104] The processor 122 mentioned above can be at least one of ASIC, DSP, DSPD, PLD, FPGA, CPU, controller, microcontroller, and microprocessor.

[0105] The aforementioned computer-readable storage medium and memory 122 may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM), etc.; or it may be various terminals including one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.

[0106] Based on the image processing method for shooting devices proposed in the foregoing embodiments, this application proposes a shooting device configured to execute any of the above-described image processing methods for shooting devices.

[0107] This application also provides an image processing system, referring to... Figure 13 The image processing system 130 includes at least one of the above-described electronic devices 120 and at least one of the above-described imaging devices 131, with the electronic devices 120 and the imaging devices 131 forming a communication connection.

[0108] It should be noted that the description of the above device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects. For technical details not disclosed in the device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0109] In some embodiments, the functions or modules of the apparatus provided in this application can be used to perform the methods described in the above method embodiments. The specific implementation can be referred to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0110] The description of the various embodiments above tends to emphasize the differences between the various embodiments. The similarities or similarities between them can be referred to, and for the sake of brevity, they will not be repeated here.

[0111] The methods disclosed in the various method embodiments provided in this application can be arbitrarily combined to obtain new method embodiments without conflict.

[0112] The features disclosed in the various product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0113] The features disclosed in the various method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method or device embodiments.

[0114] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims. All of these forms are within the protection scope of this application.

Claims

1. An image processing method, characterized in that, When applied to electronic devices, the method includes: Acquire images corresponding to multiple candidate display panels; In response to the selection operation for the candidate display panel, a target display panel is determined from the plurality of candidate display panels; Based on the image corresponding to the target display panel, the target display panel is highlighted.

2. The method according to claim 1, characterized in that, The step of determining the target display panel from the plurality of candidate display panels in response to the selection operation for the candidate display panel includes: Display a target selection control for a display panel, wherein the target selection control includes a first area for selecting a target display panel from the plurality of candidate display panels; In response to a target selection operation for the first region, a target display panel is determined from the plurality of candidate display panels.

3. The method according to claim 2, characterized in that, The target selection control also includes a second area, which is used to preview the target display panel. The first area and the second area have the same display priority.

4. The method according to claim 3, characterized in that, The step of determining the selected target display panel from the plurality of candidate display panels in response to the target selection operation for the first region includes: In response to the target selection operation for the first region, a target display panel for the range to be adjusted is determined from the plurality of candidate display panels; In response to an adjustment trigger operation on the target display panel, a range adjustment control is displayed, which is used to adjust the range of the target display panel; In response to the range adjustment operation of the range adjustment control, the adjusted target display board range is determined, and the display board area corresponding to the target display board range is selected as the target display board.

5. The method according to claim 4, characterized in that, The step of responding to a range adjustment operation on the range adjustment control, determining the adjusted target display board range, and using the display board area corresponding to the target display board range as the selected target display board includes: In response to a range adjustment operation on the range adjustment control, the adjusted target display panel range is determined; In response to the confirmation operation for the adjusted target display panel range, the first region is updated according to the adjusted target display panel range.

6. The method according to claim 4, characterized in that, The target selection control also includes a third area, which is used to display the target display panel of the range to be adjusted. The display priority of the third area is higher than that of the first area. The step of displaying a range adjustment control for the target display panel in response to an adjustment trigger operation includes: In response to an adjustment trigger operation for the target display panel, a range adjustment control for the target display panel is displayed in the third area.

7. The method according to claim 4, characterized in that, The range adjustment control adjusts the target display panel range by adjusting at least one of the corner points, edges, and the entire range.

8. The method according to claim 3, characterized in that, After determining the selected target display panel from the plurality of candidate display panels in response to the target selection operation for the first region, the method further includes: The image corresponding to the target display panel is enhanced in the second area to preview the target display panel.

9. The method according to claim 2, characterized in that, The first area is also used to display images corresponding to the plurality of candidate display panels; The step of determining the selected target display panel from the plurality of candidate display panels in response to the target selection operation for the first region includes: In response to a trigger operation on the first region, the first region is magnified to emphasize the images corresponding to the plurality of candidate display panels; In response to a selection operation on candidate display panels in the magnified image, a target display panel is determined from the plurality of candidate display panels.

10. The method according to any one of claims 1 to 9, characterized in that, The step of obtaining images corresponding to multiple candidate display panels includes: A mode switching control for displaying the presentation board mode is used to switch the electronic device from the current mode to the presentation board mode. In response to a trigger operation on the mode switching control, a shooting command is sent to the shooting device that is in communication with the electronic device; Acquire the first image captured by the shooting device based on the shooting command; The images corresponding to the multiple candidate display boards are obtained based on the first image.

11. The method according to claim 10, characterized in that, The step of obtaining the images corresponding to the plurality of candidate display panels based on the first image includes: The first image is converted into a grayscale image, and line segments are detected in the grayscale image; the positions of multiple corner points in the captured image are determined by calculating the intersection points of the detected line segments. Based on the positions of multiple corner points in the first image, multiple sets of corner points are determined, and each set of corner points belongs to the same display board image. Based on the relative position of each set of corner points, the image corresponding to the multiple candidate display boards is obtained in the first image.

12. The method according to claim 10, characterized in that, The step of obtaining the images corresponding to the plurality of candidate display panels based on the first image includes: The first image is converted into a grayscale image, and line segments are detected in the grayscale image; the positions of multiple corner points in the captured image are determined by calculating the intersection points of the detected line segments. Based on the positions of multiple corner points present in the first image, a group of corner points belonging to the same display board image are determined from among the multiple corner points; Based on a set of corner points belonging to the same display board image, obtain the images corresponding to the multiple candidate display boards.

13. The method according to claim 12, characterized in that, The step of obtaining the images corresponding to the multiple candidate display boards based on a set of corner points belonging to the same display board image includes: Based on a set of corner points belonging to the same display board image, determine the position of the corresponding display board image in the first image; The rotation parameters of the shooting device are determined based on the position of the corresponding display board image in the first image; Send a control command to the shooting device, the control command being used to instruct the shooting device to take a picture after rotating according to the rotation parameters; The system receives a second image sent by the shooting device and obtains images corresponding to the plurality of candidate display boards based on the second image.

14. An image processing method, characterized in that, Applied to a shooting device, the method includes: In response to receiving a shooting command from an electronic device, a first image is acquired based on the shooting command; The first image is sent to the electronic device, which is configured to acquire images corresponding to a plurality of candidate display panels based on the first image, and to determine a target display panel from the plurality of candidate display panels in response to a selection operation for the candidate display panels; and to highlight the target display panel based on the image corresponding to the target display panel.

15. The method according to claim 14, characterized in that, After sending the first image to the electronic device, the method further includes: The device receives a control command sent by the electronic device, the control command being used to instruct the shooting device to take a picture after rotating according to the rotation parameters; The second image is acquired by executing the control command; The second image is sent to the electronic device, so that the electronic device can obtain the images corresponding to the plurality of candidate display boards based on the second image.

16. An electronic device, characterized in that, The electronic device includes a processor and a memory for storing computer programs capable of running on the processor; wherein, The processor is configured to run the computer program to perform the method according to any one of claims 1 to 13.

17. A shooting device, characterized in that, The imaging device is configured to perform the method of claim 14 or 15.

18. An image processing system, characterized in that, It includes at least one electronic device as described in claim 16 and at least one photographing device as described in claim 17, wherein the electronic device and the photographing device form a communication connection.

Images