Image processing method and system based on shooting range, terminal and storage medium

Abstract

The invention discloses an image processing method and system based on a shooting range, a terminal and a storage medium. The method comprises the steps that an environment picture collected by a camera of an intelligent door lock is received; obtaining a frame selection instruction of a user, and selecting the environment picture according to the frame selection instruction to obtain an effective area; physical parameters of the camera are obtained, three-dimensional coordinate mapping is conducted on the effective area according to the physical parameters, target coordinate parameters are obtained, and the target coordinate parameters are sent to the intelligent door lock; a target image sent by the intelligent door lock is received so that a user can check the target image, and the target image is obtained after the intelligent door lock conducts privacy processing on an environment picture shot by a camera according to the target coordinate parameters. According to the method, after the camera picture and the user frame selection area are received, three-dimensional mapping is carried out in combination with the camera parameters, the target coordinates are generated, the door lock is sent, and the picture is privately processed, so that the user can check the picture conveniently, the target area is positioned greatly and accurately, and the information security is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of image capture and processing, and in particular to an image processing method, system, terminal and computer-readable storage medium based on a capture range. Background Art

[0002] With the development of smart home technology, it has become common for smart door locks to be equipped with cameras for security monitoring. However, the camera's field of view may cover public areas, such as hallways and neighbors' doors, posing a risk of infringing on others' privacy. Existing technologies typically use fixed physical shielding or software-preset area shielding functions, but these lack flexibility and cannot adapt to different installation environments. They also do not provide interactive methods for users to actively participate in privacy settings, making it difficult to meet personalized needs. Furthermore, due to the wide field of view, video data storage resources are severely wasted, resulting in the risk of infringing on others' privacy by the content captured by the smart door lock camera. This wide field of view and the serious waste of video data storage resources have become urgent issues that need to be addressed.

[0003] Therefore, the existing technology still needs to be improved and developed. Summary of the Invention

[0004] The main purpose of the present invention is to provide an image processing method, system, terminal and computer-readable storage medium based on shooting range, aiming to solve the problems in the prior art that the content captured by the camera of the smart door lock has the risk of infringing on the privacy of others, the shooting range is too wide, and the video data storage resources are seriously wasted.

[0005] To achieve the above object, the present invention provides an image processing method based on a shooting range, the image processing method based on a shooting range comprising the following steps:

[0006] Receive the environmental images captured by the camera of the smart door lock;

[0007] Obtaining a user's frame selection instruction, and selecting the environment screen according to the frame selection instruction to obtain a valid area;

[0008] Acquire physical parameters of the camera, perform three-dimensional coordinate mapping on the effective area according to the physical parameters, obtain target coordinate parameters, and send the target coordinate parameters to the smart door lock;

[0009] The target image sent by the smart door lock is received so that the user can view the target image. The target image is obtained by the smart door lock after performing privacy processing on the environment image captured by the camera according to the target coordinate parameters.

[0010] Optionally, in the image processing method based on the shooting range, the frame selection instruction includes: a rectangular frame selection instruction or a polygonal frame selection instruction, and a manual smear instruction;

[0011] The obtaining of a user's frame selection instruction and selecting the environment screen according to the frame selection instruction to obtain a valid area specifically includes:

[0012] Obtain the user's rectangular or polygonal selection instructions, as well as manual smearing instructions;

[0013] The environment picture is selected according to the rectangular frame selection instruction or the polygonal frame selection instruction and the manual painting instruction to obtain a valid area.

[0014] Optionally, in the image processing method based on the shooting range, the effective area includes: a first effective area and a second effective area;

[0015] The selecting the environment image according to the rectangular frame selection instruction or the polygonal frame selection instruction and the manual painting instruction to obtain a valid area specifically includes:

[0016] Performing a frame selection operation on the environment screen according to the rectangular frame selection instruction or the polygonal frame selection instruction to obtain a first valid area;

[0017] A smearing operation is performed on the environment picture according to the manual smearing instruction to obtain an ineffective area, and a reverse selection operation is performed on the environment picture according to the ineffective area to obtain a second effective area.

[0018] Optionally, in the image processing method based on shooting range, the physical parameters include: camera position coordinate parameters, camera angle parameters and camera focal length parameters;

[0019] The acquiring physical parameters of the camera, performing three-dimensional coordinate mapping on the effective area according to the physical parameters to obtain target coordinate parameters, and sending the target coordinate parameters to the smart door lock specifically includes:

[0020] Obtaining camera position coordinate parameters, camera angle parameters, and camera focal length parameters of the camera;

[0021] The coordinate parameters of the effective area are three-dimensionally mapped according to the camera position coordinate parameters, the camera angle parameters and the camera focal length parameters to obtain target coordinate parameters, and the target coordinate parameters are sent to the smart door lock.

[0022] Optionally, the image processing method based on the shooting range, wherein the coordinate parameters of the effective area are three-dimensionally mapped according to the camera position coordinate parameters, the camera angle parameters, and the camera focal length parameters to obtain target coordinate parameters, and the target coordinate parameters are sent to the smart door lock, specifically includes:

[0023] Performing scaling calculation on the coordinate parameters of the effective area according to the camera position coordinate parameters, the camera angle parameters, and the camera focal length parameters to obtain scaled coordinate parameters;

[0024] The scaled coordinate parameters are mapped to three-dimensional coordinates according to the camera position coordinate parameters to obtain target coordinate parameters, and the target coordinate parameters are sent to the smart door lock.

[0025] Optionally, the image processing method based on the shooting range, wherein the three-dimensional coordinate mapping of the scaled coordinate parameters according to the camera position coordinate parameters to obtain target coordinate parameters, and sending the target coordinate parameters to the smart door lock, specifically includes:

[0026] Performing three-dimensional coordinate mapping on the scaling coordinate parameters according to the camera position coordinate parameters to obtain reference coordinate parameters;

[0027] Performing offset calculation on the scaled coordinate parameters according to the reference coordinate parameters to obtain target coordinate parameters;

[0028] If the target coordinate parameter meets the preset boundary value, the target coordinate parameter is sent to the smart door lock.

[0029] Optionally, in the image processing method based on shooting range, the privacy processing includes cropping, shielding and blurring;

[0030] If the non-valid area of the environment image has a high privacy level, the target image is obtained by the smart door lock performing cropping and shielding processing on the non-valid area of the environment image according to the target coordinate parameters;

[0031] If the non-valid area of the environmental image has a low privacy level, the target image is obtained by the smart door lock by blurring the non-valid area of the environmental image according to the target coordinate parameters.

[0032] In addition, to achieve the above-mentioned purpose, the present invention further provides an image processing system based on a shooting range, wherein the image processing system based on a shooting range:

[0033] The environment page acquisition module is used to receive the environment image captured by the camera of the smart door lock;

[0034] An effective area setting module is used to obtain a user's frame selection instruction, select the environment screen according to the frame selection instruction, and obtain a valid area;

[0035] A coordinate conversion module is used to receive physical parameters of the camera of the smart door lock, perform three-dimensional coordinate mapping on the effective area according to the physical parameters, obtain target coordinate parameters, and send the target coordinate parameters to the smart door lock;

[0036] The privacy processing module receives the target image sent by the smart door lock so that the user can view the target image. The target image is obtained by the smart door lock performing privacy processing on the environment image captured by the camera according to the target coordinate parameters.

[0037] In addition, to achieve the above-mentioned purpose, the present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores an image processing program based on the shooting range, and when the image processing program based on the shooting range is executed by the processor, the steps of the image processing method based on the shooting range as described above are implemented.

[0038] In the present invention, the environment image captured by the camera of the smart door lock is received; the user's selection instruction is obtained, and the environment image is selected according to the selection instruction to obtain a valid area; the physical parameters of the camera are obtained, and the valid area is mapped to three-dimensional coordinates according to the physical parameters to obtain target coordinate parameters, and the target coordinate parameters are sent to the smart door lock; the target image sent by the smart door lock is received so that the user can view the target image. The target image is obtained by the smart door lock after performing privacy processing on the environment image captured by the camera according to the target coordinate parameters. The present invention receives the camera image, and after the user selects the area, the camera parameters are combined to perform three-dimensional mapping, generate target coordinates, and send them to the door lock. The door lock privacy processes the image accordingly and feeds back the target image for the user to view. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 is a flow chart of a preferred embodiment of the image processing method based on the shooting range of the present invention;

[0040] Figure 2 is a flowchart of step S10 of a preferred embodiment of the image processing method based on the shooting range of the present invention;

[0041] Figure 3 is a flowchart of S20 of a preferred embodiment of the image processing method based on the shooting range of the present invention;

[0042] Figure 4 is a flow chart of S30 of a preferred embodiment of the image processing method based on the shooting range of the present invention;

[0043] Figure 5 is a flow chart of S32 of a preferred embodiment of the image processing method based on the shooting range of the present invention;

[0044] Figure 6 is a flow chart of S322 of a preferred embodiment of the image processing method based on the shooting range of the present invention;

[0045] Figure 7 is a flow chart of S40 of a preferred embodiment of the image processing method based on the shooting range of the present invention;

[0046] Figure 8 is an interactive flow chart of a preferred embodiment of the image processing method based on the shooting range of the present invention;

[0047] Figure 9 is a structural diagram of a preferred embodiment of the image processing system based on the shooting range of the present invention;

[0048] Figure 10 It is a structural diagram of a preferred embodiment of the terminal of the device of the present invention. DETAILED DESCRIPTION

[0049] In order to make the purpose, technical solutions and advantages of the present invention more clear and distinct, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0050] With the development of smart home technology, it's become common for smart door locks to be equipped with cameras for security monitoring. However, the camera's field of view may cover public areas, such as hallways and neighbors' doors, posing the risk of infringing on others' privacy. Existing technologies typically employ fixed physical shielding or software-preset area blocking functions, but these solutions lack flexibility and adaptability to diverse installation environments. They also lack interactive methods for users to actively participate in privacy settings, making it difficult to meet personalized needs. Furthermore, the wide field of view results in significant waste of video data storage resources. To address these issues, a solution is urgently needed that ensures home security while avoiding privacy violations. This solution should allow users to customize the camera's effective field of view, while maintaining privacy protection for the remaining areas. Coordinate mapping technology should be used to ensure the accuracy of these settings. Furthermore, the solution should provide a user-friendly interface that allows users to customize the field of view in a variety of ways to meet personalized needs. In addition, the solution should also combine AI technology to optimize privacy protection effects and reduce storage resource usage through data optimization. Therefore, an image processing method based on the shooting range is required. By receiving the camera image, the user selects the area, and then performs three-dimensional mapping based on the camera parameters, the target coordinates are generated and sent to the door lock. The door lock then processes the image based on the privacy and feeds back the target image for the user to view.

[0051] The image processing method based on the shooting range described in the preferred embodiment of the present invention is as follows: Figure 1 As shown, the image processing method based on the shooting range includes the following steps:

[0052] Step S10: Receive the environmental image captured by the camera of the smart door lock.

[0053] like Figure 2 As shown, step S10 includes:

[0054] Step S11: Obtain the user's rectangular frame selection instruction or polygonal frame selection instruction, as well as the manual smear instruction;

[0055] Step S12: Select the environment image according to the rectangular frame selection instruction or the polygonal frame selection instruction and the manual painting instruction to obtain a valid area.

[0056] Specifically, the user's rectangular frame selection instruction or polygonal frame selection instruction, and manual smearing instruction are obtained (the user sets the effective shooting area in the mobile terminal application interface through rectangular / polygonal frame selection (rectangular frame selection instruction or the polygonal frame selection instruction, rectangular / polygonal frame selection: manually drawing the area to be retained), real-time preview of the manual smearing and blocking area (the manual smearing instruction, manual smearing and blocking area: manually smearing the blocking area, the video content of the smeared area is blocked) and other methods), and the environment picture is selected according to the rectangular frame selection instruction or the polygonal frame selection instruction and the manual smearing instruction to obtain the effective area, and the frame selection instruction includes: a rectangular frame selection instruction or a polygonal frame selection instruction, and a manual smearing instruction.

[0057] In this embodiment, the user views the preview video in real time on their phone and manually marks the areas to be blocked. For example, a user can mark the area in front of a neighbor's door with their finger in the preview image, which will be the inactive area to be blocked. The mobile terminal application obtains the coordinates of the area marked by the user and transmits them to the smart door lock or cloud server.

[0058] Step S20: Obtain a frame selection instruction from the user, select the environment image according to the frame selection instruction, and obtain a valid area.

[0059] like Figure 3 As shown, step S20 includes:

[0060] Step S21: performing a frame selection operation on the environment image according to the rectangular frame selection instruction or the polygonal frame selection instruction to obtain a first valid area;

[0061] Step S22: performing a smearing operation on the environment picture according to the manual smearing instruction to obtain an ineffective area, and performing a reverse selection operation on the environment picture according to the ineffective area to obtain a second effective area.

[0062] Specifically, a frame selection operation is performed on the environment picture according to the rectangular frame selection instruction or the polygon frame selection instruction to obtain a first valid area, a smear operation is performed on the environment picture according to the manual smear instruction to obtain an invalid area, and a reverse selection operation is performed on the environment picture according to the invalid area to obtain a second valid area (the setting method of the invalid area mainly includes setting a rectangle, setting a polygon and manually smearing. When setting a rectangle and a polygon, the area in the image circle is the valid area, and the other parts are invalid areas. When manually smearing is performed, the smeared part is the invalid area, and the unsmeared part is the valid area). The valid areas include: a first valid area and a second valid area (the picture captured by the entire camera will be displayed on a mobile terminal such as a mobile phone or tablet. When we do not want to see the picture captured by the entire camera, we need to circle the part we want to see in the picture of the mobile terminal. This part belongs to the valid shooting area (valid area) that the camera needs to retain, and the other parts can be hidden (invalid area)).

[0063] In this embodiment, the user sets the effective shooting area on the mobile terminal application interface by selecting a rectangular frame, previewing the video in real time, or manually painting the blocked area. For example, the user selects a rectangular frame on the application interface and drags it to select the effective area. The area within the rectangular frame is the effective shooting area to be retained. Alternatively, the user can preview the real-time image captured by the door lock camera through the app and adjust the blocked area based on the captured image. Alternatively, the user can manually paint the blocked area on the interface, and the video content in the painted area will be blocked. The mobile terminal application transmits the coordinates of the effective shooting area set by the user to the smart door lock and the cloud server.

[0064] Furthermore, the user draws a polygonal box (polygonal box selection command) with his finger on the application interface to select the valid shooting area (valid area) that needs to be retained. For example, the user can manually draw a pentagonal area on the application interface as the valid shooting area. The mobile terminal application obtains the coordinates of each vertex of the polygon and transmits these coordinates to the smart door lock and the cloud server.

[0065] Step S30: Acquire the physical parameters of the camera, perform three-dimensional coordinate mapping on the effective area according to the physical parameters, obtain target coordinate parameters, and send the target coordinate parameters to the smart door lock.

[0066] like Figure 4 As shown, step S30 includes:

[0067] Step S31, obtaining camera position coordinate parameters, camera angle parameters and camera focal length parameters of the camera;

[0068] Step S32: Perform three-dimensional coordinate mapping on the coordinate parameters of the effective area according to the camera position coordinate parameters, the camera angle parameters, and the camera focal length parameters to obtain target coordinate parameters, and send the target coordinate parameters to the smart door lock.

[0069] Specifically, the camera position coordinate parameters, camera angle parameters and camera focal length parameters of the camera are obtained (based on the camera position coordinate parameters, camera angle parameters and camera focal length parameters), and the coordinate parameters of the effective area are three-dimensionally mapped according to the camera position coordinate parameters, the camera angle parameters and the camera focal length parameters to obtain target coordinate parameters, and the target coordinate parameters are sent to the smart door lock (the effective shooting area coordinates set by the user on the two-dimensional interface are converted into shooting parameters (target coordinate parameters) in a three-dimensional physical space, and the mobile terminal application transmits the effective shooting area coordinates set by the user to the smart door lock and the cloud server, that is, the smart door lock and the cloud server receive the effective shooting area coordinates).

[0070] like Figure 5 As shown, step S32 includes:

[0071] Step S321: performing scaling calculation on the coordinate parameters of the effective area according to the camera position coordinate parameters, the camera angle parameters, and the camera focal length parameters to obtain scaled coordinate parameters;

[0072] Step S322: Perform three-dimensional coordinate mapping on the scaled coordinate parameters according to the camera position coordinate parameters to obtain target coordinate parameters, and send the target coordinate parameters to the smart door lock.

[0073] Specifically, the coordinate parameters of the effective area are scaled and calculated according to the camera position coordinate parameters, the camera angle parameters and the camera focal length parameters to obtain scaled coordinate parameters (the screen coordinates are mapped to the original resolution of the camera. Since the screen and the camera have the same aspect ratio (both are 16:9), the coordinates on the screen need to be scaled to the camera resolution proportionally), and the scaled coordinate parameters are three-dimensionally mapped according to the camera position coordinate parameters to obtain target coordinate parameters, and the target coordinate parameters are sent to the smart door lock.

[0074] The coordinate scaling relationship is as follows:

[0075]

[0076] Among them, x cam Expressed as the horizontal coordinate of the camera, y cam Indicates the vertical coordinate of the camera, x screen Indicates the horizontal coordinate of the mobile terminal, y sreen Indicates the vertical coordinate of the mobile terminal.

[0077] like Figure 6 As shown, the step S322 includes:

[0078] Step S3221: performing three-dimensional coordinate mapping on the scaling coordinate parameters according to the camera position coordinate parameters to obtain reference coordinate parameters;

[0079] Step S3222: performing offset calculation on the scaled coordinate parameters according to the reference coordinate parameters to obtain target coordinate parameters;

[0080] Step S3223: If the target coordinate parameter meets the preset boundary value, the target coordinate parameter is sent to the smart door lock.

[0081] Specifically, the scaled coordinate parameters are mapped into three-dimensional coordinates according to the camera position coordinate parameters to obtain reference coordinate parameters, and the scaled coordinate parameters are offset calculated according to the reference coordinate parameters (the original coordinates of the camera are mapped to the valid area in the center of the camera image) to obtain target coordinate parameters (the mapped valid area coordinate parameters, the video module needs to perform image cropping, blackening or coding according to the parameters). If the target coordinate parameters meet the preset boundary values, the target coordinate parameters are sent to the smart door lock, which ensures that the mapped coordinates are within the valid area.

[0082] The offset calculation formula is as follows:

[0083]

[0084] Among them, offset x Indicates the offset of the horizontal axis, offset y Indicates the offset of the vertical axis.

[0085] The target coordinate parameter calculation formula is as follows:

[0086]

[0087] Among them, x valid Indicates the horizontal coordinate of the target coordinate parameter, y valid Indicates the vertical coordinate of the target coordinate parameter.

[0088] Furthermore, the calculation formula for determining whether the value meets the preset boundary is as follows:

[0089]

[0090] Among them, max() represents x valid and y valid Comply with the preset boundary value.

[0091] As an example, the coordinates of the polygon vertices drawn by the user on the two-dimensional interface are converted into coordinates in the three-dimensional physical space according to the camera's position, orientation angle, focal length and other parameters. For example, assuming that the vertex coordinates of the pentagon drawn by the user are (x1, y1), (x2, y2), (x3, y3), (x4, y4), (x5, y5), the horizontal field of view angle of the camera is W, and the vertical field of view angle is H, then at a distance D, tan() represents the tangent function, and the actual coordinate range of the pentagon in the three-dimensional physical space is: [(x cam +D*tan(W / 2)*x1,y cam +D*tan(H / 2)*y1),(x cam +D*tan(W / 2)*x2,y cam +D*tan(H / 2)*y2),(x cam +D*tan(W / 2)*x5,y cam +D*tan(H / 2)*y5)]; Set the coordinate range as the effective shooting area of the camera.

[0092] Step S40: receiving a target image sent by the smart door lock, so that the user can view the target image. The target image is obtained by the smart door lock performing privacy processing on the environment image captured by the camera according to the target coordinate parameters.

[0093] like Figure 7 As shown, the step S40 includes:

[0094] Step S41: If the non-valid area of the environment image has a high privacy level, the target image is obtained by the smart door lock performing a cropping and shielding process on the non-valid area of the environment image according to the target coordinate parameters;

[0095] Step S42: If the non-valid area of the environment image is of a low privacy level, the target image is obtained by the smart door lock by blurring the non-valid area of the environment image according to the target coordinate parameters.

[0096] Specifically, the target image sent by the smart door lock is received for the user to view the target image (multiple areas can be set when setting the ineffective area, such as area 1 is set as a completely black area (neighbor's door), and area 2 is set as a fuzzy reserved area (retaining a fuzzy image, such as a public staircase). In this way, privacy hierarchical management is achieved by setting multiple ineffective areas, and images with different requirements are retained for different areas). If the ineffective area of the environmental picture is at a high privacy level, the target image is obtained by the smart door lock by cropping and shielding the ineffective area of the environmental picture according to the target coordinate parameters (privacy grading processing is performed on the image data of the ineffective area, and different privacy levels are selected according to scene requirements, such as complete shielding, low-definition retention, etc.). If the ineffective area of the environmental picture is at a low privacy level, the target image is obtained by the smart door lock by cropping and shielding the ineffective area of the environmental picture according to the target coordinate parameters. The coordinate parameters are obtained by blurring the non-valid area of the environmental picture. Furthermore, public areas are identified through AI technology, and the shielding range is automatically recommended (when no alarm or other events are triggered, neighbors or passers-by are photographed, and their activity areas are automatically blurred or set as non-valid areas to avoid photographing neighbors). The shielding range is temporarily expanded when someone is detected entering the public area. When the door lock detects an abnormality, the shooting range is temporarily expanded (the effective shooting area (effective area) is expanded so that a larger range can be clearly presented (when an alarm is generated, a clear image of a larger range is obtained first, and privacy is downgraded)) to record the complete event (anti-theft, loitering, door lock abnormality and other alarm events, when these alarm events occur, the effective area is temporarily expanded), permissions are set by role, administrators can set the global range, visitors can only view cropped videos, and the cloud only stores videos in the effective area to reduce cloud storage resource usage.

[0097] In this embodiment, privacy grading is performed on image data in non-valid areas, and different privacy levels are selected according to scenario requirements, such as complete shielding, low-definition retention, etc. For example, public areas can be completely shielded; for semi-public areas, low-definition images can be retained; at the same time, public areas are identified through AI technology, and shielding ranges are automatically recommended. When someone is detected entering a public area, the shielding range is temporarily expanded. When the door lock detects an abnormality, the shooting range is temporarily expanded to record the complete event. Permissions are set by role, and the administrator can set the global range. Visitors can only view cropped videos. Finally, only videos in valid areas are stored to reduce cloud storage resource usage.

[0098] like Figure 8As shown, the APP (mobile terminal) converts the effective area set by the user into user-defined shooting range parameters (target coordinate parameters) and sends them to the camera. The camera performs image processing according to the target coordinate parameters through the image processor, that is, performs privacy processing according to the target coordinate parameters and privacy processing instructions, and can upload the target image to the server (processed by AI algorithm, identifies public areas through AI technology, automatically recommends shielding ranges, and temporarily expands the shielding range when someone is detected entering the public area), and sends it to the mobile terminal to display the picture of the effective area.

[0099] Further, if Figure 9 As shown, based on the above-mentioned image processing method based on the shooting range, the present invention also provides an image processing system based on the shooting range, wherein the image processing system based on the shooting range includes:

[0100] The environment page acquisition module 51 is used to receive the environment image captured by the camera of the smart door lock;

[0101] The effective area setting module 52 is used to obtain a user's frame selection instruction, select the environment screen according to the frame selection instruction, and obtain a valid area;

[0102] A coordinate conversion module 53 is configured to receive physical parameters of the camera of the smart door lock, perform three-dimensional coordinate mapping on the effective area according to the physical parameters, obtain target coordinate parameters, and send the target coordinate parameters to the smart door lock;

[0103] The privacy processing module 54 is used to receive the target image sent by the smart door lock so that the user can view the target image. The target image is obtained by the smart door lock after performing privacy processing on the environment image captured by the camera according to the target coordinate parameters.

[0104] Further, if Figure 10 As shown, based on the above-mentioned image processing method and system based on shooting range, the present invention also provides a terminal, which includes a processor 10, a memory 20 and a display 30. Figure 10 Only some of the components of the terminal are shown, but it should be understood that implementation of all of the shown components is not required, and more or fewer components may be implemented instead.

[0105] In some embodiments, the memory 20 may be an internal storage unit of the terminal, such as a hard disk or memory of the terminal. In other embodiments, the memory 20 may also be an external storage device of the terminal, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SecureDigital, SD) card, a flash card (Flash Card), etc. equipped on the terminal. Furthermore, the memory 20 may also include both an internal storage unit of the terminal and an external storage device. The memory 20 is used to store application software and various types of data installed on the terminal, such as program codes of the installation terminal, etc. The memory 20 may also be used to temporarily store data that has been output or is to be output. In one embodiment, an image processing program 40 based on a shooting range is stored on the memory 20, and the image processing program 40 based on a shooting range can be executed by the processor 10, thereby realizing the image processing method based on a shooting range in the present application.

[0106] In some embodiments, the processor 10 may be a central processing unit (CPU), a microprocessor, or other data processing chip, configured to execute program codes or process data stored in the memory 20, such as executing the image processing method based on the shooting range.

[0107] In some embodiments, the display 30 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, or an OLED (Organic Light-Emitting Diode) touchscreen. The display 30 is used to display information on the terminal and to display a visual user interface. The terminals communicate with each other via a system bus.

[0108] In one embodiment, when the processor 10 executes the image processing program 40 based on the shooting range in the memory 20, the following steps are implemented:

[0109] Receive the environmental images captured by the camera of the smart door lock;

[0110] Obtaining a user's frame selection instruction, and selecting the environment screen according to the frame selection instruction to obtain a valid area;

[0111] Acquire physical parameters of the camera, perform three-dimensional coordinate mapping on the effective area according to the physical parameters, obtain target coordinate parameters, and send the target coordinate parameters to the smart door lock;

[0112] Receiving a target image sent by the smart door lock, so that the user can view the target image, the target image being obtained by the smart door lock after performing privacy processing on the environment image captured by the camera according to the target coordinate parameters;

[0113] The frame selection instructions include: rectangular frame selection instructions or polygonal frame selection instructions, and manual smearing instructions;

[0114] The obtaining of a user's frame selection instruction and selecting the environment screen according to the frame selection instruction to obtain a valid area specifically includes:

[0115] Obtain the user's rectangular or polygonal selection instructions, as well as manual smearing instructions;

[0116] The environment picture is selected according to the rectangular frame selection instruction or the polygonal frame selection instruction and the manual painting instruction to obtain a valid area.

[0117] Wherein, the effective area includes: a first effective area and a second effective area;

[0118] The selecting the environment image according to the rectangular frame selection instruction or the polygonal frame selection instruction and the manual painting instruction to obtain a valid area specifically includes:

[0119] Performing a frame selection operation on the environment screen according to the rectangular frame selection instruction or the polygonal frame selection instruction to obtain a first valid area;

[0120] A smearing operation is performed on the environment picture according to the manual smearing instruction to obtain an ineffective area, and a reverse selection operation is performed on the environment picture according to the ineffective area to obtain a second effective area.

[0121] The physical parameters include: camera position coordinate parameters, camera angle parameters and camera focal length parameters;

[0122] The acquiring physical parameters of the camera, performing three-dimensional coordinate mapping on the effective area according to the physical parameters to obtain target coordinate parameters, and sending the target coordinate parameters to the smart door lock specifically includes:

[0123] Obtaining camera position coordinate parameters, camera angle parameters, and camera focal length parameters of the camera;

[0124] The coordinate parameters of the effective area are three-dimensionally mapped according to the camera position coordinate parameters, the camera angle parameters and the camera focal length parameters to obtain target coordinate parameters, and the target coordinate parameters are sent to the smart door lock.

[0125] The step of performing three-dimensional coordinate mapping on the coordinate parameters of the effective area according to the camera position coordinate parameters, the camera angle parameters, and the camera focal length parameters to obtain target coordinate parameters, and sending the target coordinate parameters to the smart door lock specifically includes:

[0126] Performing scaling calculation on the coordinate parameters of the effective area according to the camera position coordinate parameters, the camera angle parameters, and the camera focal length parameters to obtain scaled coordinate parameters;

[0127] The scaled coordinate parameters are mapped to three-dimensional coordinates according to the camera position coordinate parameters to obtain target coordinate parameters, and the target coordinate parameters are sent to the smart door lock.

[0128] The performing three-dimensional coordinate mapping on the scaled coordinate parameters according to the camera position coordinate parameters to obtain target coordinate parameters, and sending the target coordinate parameters to the smart door lock specifically includes:

[0129] Performing three-dimensional coordinate mapping on the scaling coordinate parameters according to the camera position coordinate parameters to obtain reference coordinate parameters;

[0130] Performing offset calculation on the scaled coordinate parameters according to the reference coordinate parameters to obtain target coordinate parameters;

[0131] If the target coordinate parameter meets the preset boundary value, the target coordinate parameter is sent to the smart door lock.

[0132] The privacy processing includes cropping, shielding and blurring.

[0133] If the non-valid area of the environment image has a high privacy level, the target image is obtained by the smart door lock performing cropping and shielding processing on the non-valid area of the environment image according to the target coordinate parameters;

[0134] If the non-valid area of the environmental image has a low privacy level, the target image is obtained by the smart door lock by blurring the non-valid area of the environmental image according to the target coordinate parameters.

[0135] The present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores an image processing program based on a shooting range, and when the image processing program based on a shooting range is executed by a processor, the steps of the image processing method based on a shooting range as described above are implemented.

[0136] In summary, the present invention provides an image processing method, system, terminal and storage medium based on shooting range, the method comprising: receiving an environmental image captured by a camera of a smart door lock; obtaining a user's selection instruction, selecting the environmental image according to the selection instruction, and obtaining a valid area; obtaining the physical parameters of the camera, performing three-dimensional coordinate mapping on the valid area according to the physical parameters, obtaining target coordinate parameters, and sending the target coordinate parameters to the smart door lock; receiving a target image sent by the smart door lock so that the user can view the target image, the target image being obtained by the smart door lock after performing privacy processing on the environmental image captured by the camera according to the target coordinate parameters. The present invention receives the camera image, and after the user selects the area, performs three-dimensional mapping in combination with the camera parameters, generates target coordinates and sends them to the door lock. The door lock performs privacy processing on the image accordingly, and feeds back the target image for the user to view, thereby greatly increasing the space for video data storage and avoiding infringement of others' privacy.

[0137] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or terminal system comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or terminal system. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or terminal system comprising the element.

[0138] Of course, those skilled in the art will appreciate that all or part of the processes in the above-described method embodiments can be implemented by instructing related hardware (such as a processor, controller, etc.) through a computer program. The program can be stored in a computer-readable storage medium that can be read by a computer. When the program is executed, it can include the processes in the above-described method embodiments. The computer-readable storage medium can be a memory, a magnetic disk, an optical disk, etc.

[0139] It should be understood that the application of the present invention is not limited to the above examples. For those skilled in the art, improvements or changes can be made based on the above description. All these improvements and changes should fall within the scope of protection of the claims attached to the present invention.

Claims

1. An image processing method based on shooting range, characterized in that: The image processing method based on the shooting range includes: Receive the environmental images captured by the camera of the smart door lock; Obtaining a user's frame selection instruction, and selecting the environment screen according to the frame selection instruction to obtain a valid area; Acquire physical parameters of the camera, perform three-dimensional coordinate mapping on the effective area according to the physical parameters, obtain target coordinate parameters, and send the target coordinate parameters to the smart door lock; The target image sent by the smart door lock is received so that the user can view the target image. The target image is obtained by the smart door lock after performing privacy processing on the environment image captured by the camera according to the target coordinate parameters.

2. The image processing method based on shooting range according to claim 1, characterized in that: The frame selection instructions include: rectangular frame selection instructions or polygonal frame selection instructions, and manual smearing instructions; The obtaining of a user's frame selection instruction and selecting the environment screen according to the frame selection instruction to obtain a valid area specifically includes: Obtain the user's rectangular or polygonal selection instructions, as well as manual smearing instructions; The environment picture is selected according to the rectangular frame selection instruction or the polygonal frame selection instruction, and the manual painting instruction to obtain a valid area.

3. The image processing method based on shooting range according to claim 2, characterized in that: The effective area includes: a first effective area and a second effective area; The selecting the environment image according to the rectangular frame selection instruction or the polygonal frame selection instruction and the manual painting instruction to obtain a valid area specifically includes: Performing a frame selection operation on the environment screen according to the rectangular frame selection instruction or the polygonal frame selection instruction to obtain a first valid area; A smearing operation is performed on the environment picture according to the manual smearing instruction to obtain an ineffective area, and a reverse selection operation is performed on the environment picture according to the ineffective area to obtain a second effective area.

4. The image processing method based on shooting range according to claim 1, characterized in that: The physical parameters include: camera position coordinate parameters, camera angle parameters and camera focal length parameters; The acquiring physical parameters of the camera, performing three-dimensional coordinate mapping on the effective area according to the physical parameters to obtain target coordinate parameters, and sending the target coordinate parameters to the smart door lock specifically includes: Obtaining camera position coordinate parameters, camera angle parameters, and camera focal length parameters of the camera; The coordinate parameters of the effective area are three-dimensionally mapped according to the camera position coordinate parameters, the camera angle parameters and the camera focal length parameters to obtain target coordinate parameters, and the target coordinate parameters are sent to the smart door lock.

5. The image processing method based on shooting range according to claim 4, characterized in that: The performing three-dimensional coordinate mapping on the coordinate parameters of the effective area according to the camera position coordinate parameters, the camera angle parameters, and the camera focal length parameters to obtain target coordinate parameters, and sending the target coordinate parameters to the smart door lock specifically includes: Performing scaling calculation on the coordinate parameters of the effective area according to the camera position coordinate parameters, the camera angle parameters, and the camera focal length parameters to obtain scaled coordinate parameters; The scaled coordinate parameters are mapped to three-dimensional coordinates according to the camera position coordinate parameters to obtain target coordinate parameters, and the target coordinate parameters are sent to the smart door lock.

6. The image processing method based on shooting range according to claim 5, characterized in that: The method further comprises: performing three-dimensional coordinate mapping on the scaled coordinate parameters according to the camera position coordinate parameters to obtain target coordinate parameters, and sending the target coordinate parameters to the smart door lock. Performing three-dimensional coordinate mapping on the scaling coordinate parameters according to the camera position coordinate parameters to obtain reference coordinate parameters; Performing offset calculation on the scaled coordinate parameters according to the reference coordinate parameters to obtain target coordinate parameters; If the target coordinate parameter meets the preset boundary value, the target coordinate parameter is sent to the smart door lock.

7. The image processing method based on shooting range according to claim 1, characterized in that: The privacy processing includes cropping, shielding and blurring; If the non-valid area of the environment image has a high privacy level, the target image is obtained by the smart door lock performing a cropping and shielding process on the non-valid area of the environment image according to the target coordinate parameters; If the non-valid area of the environmental image has a low privacy level, the target image is obtained by the smart door lock by blurring the non-valid area of the environmental image according to the target coordinate parameters.

8. An image processing system based on shooting range, characterized in that: The image processing system based on the shooting range includes: The environment page acquisition module is used to receive the environment image captured by the camera of the smart door lock; An effective area setting module is used to obtain a user's frame selection instruction, select the environment screen according to the frame selection instruction, and obtain a valid area; A coordinate conversion module is used to receive physical parameters of the camera of the smart door lock, perform three-dimensional coordinate mapping on the effective area according to the physical parameters, obtain target coordinate parameters, and send the target coordinate parameters to the smart door lock; The privacy processing module is used to receive the target image sent by the smart door lock so that the user can view the target image. The target image is obtained by the smart door lock after performing privacy processing on the environment image captured by the camera according to the target coordinate parameters.

9. A terminal, characterized in that: The terminal includes: a memory, a processor, and an image processing program based on a shooting range stored in the memory and executable on the processor. When the image processing program based on a shooting range is executed by the processor, the steps of the image processing method based on a shooting range as described in any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores an image processing program based on a shooting range, and when the image processing program based on a shooting range is executed by a processor, the steps of the image processing method based on a shooting range according to any one of claims 1 to 7 are implemented.

Images