Method and device for verifying camera area, and electronic equipment

Abstract

One or more embodiments of the present specification provide a method and device for verifying a camera area, and an electronic device, wherein the method is applied to a camera system, wherein the camera system includes a client and multiple cameras; wherein there is an overlapping area between the camera areas of the multiple cameras; the method is applied to the client, and includes: obtaining a camera point to be checked selected by a user in the overlapping area; respectively determining relative position information of the camera point to be checked in an electronic map output and displayed by the client and in images captured by the multiple cameras; based on the relative position information, determining whether the camera point to be checked indicates the same geographical location in the real world in the electronic map and in the images captured by the multiple cameras; if the camera point to be checked indicates the same geographical location in the real world in the electronic map and in the images captured by the multiple cameras, determining that the overlapping area verification has passed.

Description

Technical Field

[0001] One or more embodiments of the present specification relate to the field of computer application technology, and in particular, to a method and device for verifying an imaging area, and an electronic device. Background Art

[0002] In offline retail scenarios, it is often necessary to locate specific people based on the images captured by the camera equipment in the retail venue. For example, for a child who is not supervised by his parents, the child can be located to prevent the child from getting lost; or for a customer with abnormal behavior, the customer can be located to ensure the safety of people and property in the retail venue.

[0003] Since the range of the camera area of ​​a single camera device is limited, when locating a specific person, it is usually necessary to switch from the image captured by the previous camera device to the image captured by the next camera device according to the movement trajectory of the specific person. In this case, if the positioning accuracy of the camera area of ​​the camera device is not high, or the positioning accuracy of the overlapping area between the camera areas of different camera devices is not high, it will cause problems in locating the specific person. Therefore, how to verify the overlapping area between the camera areas of different camera devices to determine whether the overlapping area is accurate has become a problem that needs to be solved urgently. Summary of the invention

[0004] This specification provides a method for verifying a camera area. The method is applied to a camera system, wherein the camera system includes a client and multiple camera devices; wherein the camera areas of the multiple camera devices have overlapping areas; the method is applied to the client, and includes:

[0005] Acquire the to-be-checked image point selected by the user in the overlapping area;

[0006] Respectively determining the relative position information of the to-be-detected camera point in the electronic map output and displayed by the client and in the pictures captured by the multiple camera devices;

[0007] Based on the relative position information, determining whether the to-be-checked image point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple image capture devices;

[0008] If the to-be-checked imaging point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple imaging devices, it is determined that the overlapping area verification has passed.

[0009] Optionally, determining, based on the relative position information, whether the to-be-detected imaging point indicates a same geographical location in the real world in the electronic map and the images captured by the multiple imaging devices includes:

[0010] Mapping the relative position information into geographic location information in the real world;

[0011] Determining whether geographic location information corresponding to the electronic map and the images captured by the multiple camera devices matches;

[0012] If the geographical location information corresponding to the electronic map and the images captured by the multiple cameras matches, it is determined that the to-be-checked image point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple cameras.

[0013] Optionally, the camera system maintains a mapping relationship between an electronic map coordinate system corresponding to the electronic map and an image coordinate system corresponding to the images captured by each camera device;

[0014] The step of respectively determining the relative position information of the to-be-detected camera point in the electronic map output and displayed by the client and in the pictures captured by the multiple camera devices includes:

[0015] Based on the mapping relationship, the position coordinates of the to-be-detected imaging point in the electronic map coordinate system and each of the image coordinate systems are determined respectively.

[0016] Optionally, the camera system further maintains a mapping relationship between the electronic map coordinate system and a preset world map coordinate system, and a mapping relationship between each of the image coordinate systems and the world map coordinate system;

[0017] The determining, based on the relative position information, whether the to-be-detected image point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple image capture devices comprises:

[0018] Based on the mapping relationship between the electronic map coordinate system and the world map coordinate system, mapping the position coordinates of the to-be-detected camera point in the electronic map coordinate system to the position coordinates in the world map coordinate system;

[0019] Based on the mapping relationship between each of the image coordinate systems and the world map coordinate system, mapping the position coordinates of the to-be-detected camera point in each of the image coordinate systems to the position coordinates in the world map coordinate system;

[0020] Determine whether the position coordinates of each mapped position in the world map coordinate system are consistent;

[0021] If the mapped position coordinates in the world map coordinate system are consistent, it is determined that the to-be-checked imaging point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple imaging devices.

[0022] Optionally, the method further comprises:

[0023] When it is determined that the overlap area verification has passed, the overlap area is marked as valid, and a valid mark of the overlap area is displayed in the electronic map and in the pictures captured by each camera device.

[0024] Optionally, the method further comprises:

[0025] When it is determined that the overlap area check fails, the overlap area is marked as invalid, and an invalid mark of the overlap area is displayed in the electronic map and the pictures taken by each camera device.

[0026] This specification also proposes a camera area verification device, which is applied to a camera system, wherein the camera system includes a client and multiple camera devices; wherein the camera areas of the multiple camera devices have overlapping areas; the device is applied to the client, and includes:

[0027] An acquisition module, used for acquiring the to-be-detected image point selected by the user in the overlapping area;

[0028] A first determination module is used to respectively determine the relative position information of the to-be-detected camera point in the electronic map output and displayed by the client and in the pictures captured by the multiple camera devices;

[0029] A second determination module is used to determine, based on the relative position information, whether the to-be-checked image point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple camera devices;

[0030] The third determination module is used to determine that the overlap area verification has passed if the to-be-checked imaging point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple imaging devices.

[0031] Optionally, the second determining module is specifically configured to:

[0032] Mapping the relative position information into geographic location information in the real world;

[0033] Determining whether geographic location information corresponding to the electronic map and the images captured by the multiple camera devices matches;

[0034] If the geographical location information corresponding to the electronic map and the images captured by the multiple cameras matches, it is determined that the to-be-checked image point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple cameras.

[0035] Optionally, the camera system maintains a mapping relationship between an electronic map coordinate system corresponding to the electronic map and an image coordinate system corresponding to the images captured by each camera device;

[0036] The first determining module is specifically used for:

[0037] Based on the mapping relationship, the position coordinates of the to-be-detected imaging point in the electronic map coordinate system and each of the image coordinate systems are determined respectively.

[0038] Optionally, the camera system further maintains a mapping relationship between the electronic map coordinate system and a preset world map coordinate system, and a mapping relationship between each of the image coordinate systems and the world map coordinate system;

[0039] The second determining module is specifically used for:

[0040] Based on the mapping relationship between the electronic map coordinate system and the world map coordinate system, mapping the position coordinates of the to-be-detected camera point in the electronic map coordinate system to the position coordinates in the world map coordinate system;

[0041] Based on the mapping relationship between each of the image coordinate systems and the world map coordinate system, mapping the position coordinates of the to-be-detected camera point in each of the image coordinate systems to the position coordinates in the world map coordinate system;

[0042] Determine whether the position coordinates of each mapped position in the world map coordinate system are consistent;

[0043] If the mapped position coordinates in the world map coordinate system are consistent, it is determined that the to-be-checked imaging point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple imaging devices.

[0044] Optionally, the device further comprises:

[0045] The first marking module is used to mark the overlapping area as valid when it is determined that the overlapping area verification has passed, and to display the valid mark of the overlapping area in the electronic map and the pictures taken by each camera device.

[0046] Optionally, the device further comprises:

[0047] The second marking module is used to mark the overlapping area as invalid when it is determined that the overlapping area verification fails, and display the invalid mark of the overlapping area in the electronic map and the pictures taken by each camera device.

[0048] This specification also proposes an electronic device, comprising:

[0049] processor;

[0050] a memory for storing processor-executable instructions;

[0051] The processor implements the steps of the above method by running the executable instructions.

[0052] The present specification also proposes a computer-readable storage medium on which computer instructions are stored. When the instructions are executed by a processor, the steps of the above method are implemented.

[0053] In the above technical solution, a user can select a camera point to be checked in the overlapping area between the camera areas of multiple camera devices, and when it is determined that the camera point to be checked indicates the same geographical location in the real world in the electronic map output and displayed by the client and the pictures taken by multiple camera devices, it is determined that the overlapping area verification has passed, otherwise it can be determined that the overlapping area verification has not passed. In this way, for the overlapping area that has passed the verification, it can be considered that the overlapping area is accurate, that is, the overlapping area is valid; for the overlapping area that has not passed the verification, it can be considered that there is an error in the overlapping area, that is, the overlapping area is invalid. By verifying the overlapping area between the camera areas of multiple camera devices, it can be determined whether the overlapping area is valid, so that invalid overlapping areas can be discovered in time, and users can also check and adjust invalid overlapping areas in time. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] Figure 1 is a schematic diagram of a camera system shown in an exemplary embodiment of this specification;

[0055] Figure 2 is a schematic diagram of an electronic map shown in an exemplary embodiment of this specification;

[0056] Figure 3 is a flow chart of a method for verifying an imaging area shown in an exemplary embodiment of this specification;

[0057] Figure 4 is a schematic diagram of a verification interface shown in an exemplary embodiment of this specification;

[0058] Figure 5 is a hardware structure diagram of an electronic device where a verification device for a camera area is located, as shown in an exemplary embodiment of this specification;

[0059] Figure 6 It is a block diagram of a device for verifying an imaging area shown in an exemplary embodiment of the present specification. DETAILED DESCRIPTION

[0060] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with one or more embodiments of this specification. Instead, they are merely examples of devices and methods consistent with some aspects of one or more embodiments of this specification as detailed in the appended claims.

[0061] The terms used in this specification are for the purpose of describing specific embodiments only and are not intended to limit this specification. The singular forms "a", "the" and "the" used in this specification and the appended claims are also intended to include plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0062] It should be understood that although the terms first, second, third, etc. may be used in this specification to describe various information, this information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this specification, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0063] The present specification aims to provide a technical solution for verifying the overlapping area by allowing a user to select a camera point to be checked in the overlapping area between the camera areas of multiple cameras, and by determining whether the camera point to be checked indicates the same geographical location in the real world in an electronic map output and displayed by a client and in images captured by multiple cameras.

[0064] Please refer to Figure 1 , Figure 1 FIG. 1 is a schematic diagram of a camera system shown in an exemplary embodiment of the present specification.

[0065] like Figure 1 As shown, the camera system may include a client and multiple camera devices ( Figure 1 Two camera devices are shown, namely: camera device 1 and camera device 2). There are overlapping areas between the camera areas of these multiple camera devices.

[0066] In practical applications, the client can be deployed on an electronic device, which can be a server, a computer, a mobile phone, a tablet device, a laptop, a PDA (Personal Digital Assistants), etc.; the camera device can be a video camera or a webcam.

[0067] The technician can pre-set an electronic map corresponding to the area including the camera areas of the above-mentioned multiple camera devices, and store the electronic map. Later, when the above-mentioned overlapping area needs to be verified, the client can obtain the electronic map and output the electronic map to display it to the user for viewing.

[0068] Please combine Figure 1 ,refer to Figure 2 , Figure 2 It is a schematic diagram of an electronic map shown in an exemplary embodiment of this specification.

[0069] like Figure 2 As shown, for Figure 1 For the camera system shown, in the electronic map output and displayed by the client, the camera area of ​​camera device 1 is camera area 1, and the camera area of ​​camera device 2 is camera area 2; there is an overlapping area X between camera area 1 and camera area 2.

[0070] In actual applications, there may be a problem that the relative position of the overlapping area X displayed in the above-mentioned electronic map in the electronic map does not match the geographical location of the overlapping area X in the real world; and there may be a problem that the overlapping area X is displayed incorrectly in the electronic map because the relative position of the camera area 1 (and / or the camera area 2) displayed in the electronic map in the electronic map does not match the geographical location of the camera area 1 (and / or the camera area 2) in the real world; and so on.

[0071] In this case, the technical solution provided in this specification for verifying the overlapping area between the camera areas of multiple cameras can determine whether the overlapping area is valid (that is, whether the overlapping area is accurate), so that invalid overlapping areas can be discovered in time, and users can also check and adjust the invalid overlapping areas in time.

[0072] Please refer to Figure 3 , Figure 3 FIG. 1 is a flowchart of a method for verifying a camera area according to an exemplary embodiment of the present specification. The method for verifying a camera area can be applied to Figure 1 The client in the camera system shown; the verification method of the camera area may include the following steps:

[0073] Step 301, obtaining the to-be-detected camera point selected by the user in the overlapping area;

[0074] Step 302, respectively determining the relative position information of the to-be-detected camera point in the electronic map output and displayed by the client and in the pictures captured by the multiple camera devices;

[0075] Step 303, based on the relative position information, determining whether the to-be-checked image point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple image capture devices;

[0076] Step 304: If the to-be-checked imaging point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple imaging devices, it is determined that the overlapping area verification has passed.

[0077] The following is Figure 1 This embodiment is described in detail by taking the camera system including a client and two camera devices as an example.

[0078] In this embodiment, the camera device 1 can send the picture 1 obtained by shooting the camera area 1 to the above-mentioned client; the camera device 2 can send the picture 2 obtained by shooting the camera area 2 to the above-mentioned client.

[0079] In this case, the client can output the following to the user: Figure 4 The verification interface shown in the figure allows the user to verify the overlapping area X between the camera areas of the two camera devices through the verification interface. Figure 2 The electronic map shown, picture 1 captured by camera 1, and picture 2 captured by camera 2.

[0080] In this embodiment, the user can first select the camera point to be inspected in the overlapping area X by dragging the circular frame for selecting the camera point displayed in the above-mentioned electronic map or the picture taken by any camera device (the center point of the circular frame is the selected camera point).

[0081] That is, the user can select the camera point to be checked in the overlapping area X by dragging the circular box for selecting the camera point displayed in the electronic map; or the user can select the camera point to be checked in the overlapping area X by dragging the circular box for selecting the camera point displayed in the screen 1; or the user can select the camera point to be checked in the overlapping area X by dragging the circular box for selecting the camera point displayed in the screen 2; this manual does not impose any restrictions on this.

[0082] In this embodiment, after the user selects the above-mentioned camera point to be inspected, the relative position information of the above-mentioned camera point to be inspected selected by the user in the above-mentioned electronic map and the pictures taken by the above-mentioned two camera devices can be determined respectively. The relative position information may include information such as the direction and distance between the camera device and the location, or the direction and distance between the camera point and the boundary of the camera area.

[0083] Specifically, assuming that the user selects a camera point to be inspected in the overlapping area X by dragging the circular frame displayed in the electronic map, the relative position information of the camera point to be inspected selected by the user in the electronic map can be directly determined; in addition, the camera point to be inspected in the screen 1 corresponding to the camera point to be inspected in the electronic map can be determined based on the correspondence between the electronic map and the camera points in the screen 1, so that the relative position information of the camera point to be inspected in the screen 1 can be further determined. Similarly, the camera point to be inspected in the screen 2 corresponding to the camera point to be inspected in the electronic map can be determined based on the correspondence between the electronic map and the camera points in the screen 2, so that the relative position information of the camera point to be inspected in the screen 2 can be further determined.

[0084] Alternatively, assuming that the user selects a camera point to be inspected in the overlapping area X by dragging the circular frame displayed in the above-mentioned screen 1, the relative position information of the camera point to be inspected selected by the user in the screen 1 can be directly determined; in addition, the camera point to be inspected in the electronic map corresponding to the camera point to be inspected in the screen 1 can be determined based on the correspondence between the above-mentioned electronic map and the camera points in the screen 1, so that the relative position information of the camera point to be inspected in the electronic map can be further determined. Similarly, the camera point to be inspected in the screen 2 corresponding to the camera point to be inspected in the screen 1 can be determined based on the correspondence between the camera points in the screen 1 and the screen 2, so that the relative position information of the camera point to be inspected in the screen 2 can be further determined.

[0085] Alternatively, assuming that the user selects a camera point to be inspected in the overlapping area X by dragging the circular frame displayed in the above-mentioned screen 2, the relative position information of the camera point to be inspected selected by the user in screen 2 can be directly determined; in addition, the camera point to be inspected in the electronic map corresponding to the camera point to be inspected in screen 2 can be determined based on the correspondence between the above-mentioned electronic map and the camera points in screen 2, so that the relative position information of the camera point to be inspected in the electronic map can be further determined. Similarly, the camera point to be inspected in screen 1 corresponding to the camera point to be inspected in screen 2 can be determined based on the correspondence between the camera points in screen 1 and screen 2, so that the relative position information of the camera point to be inspected in screen 1 can be further determined.

[0086] In practical applications, the positions of the circular frames displayed on the electronic map and the images captured by the two cameras can be adjusted according to the relative position information of the to-be-detected image points in the electronic map and the images captured by the two cameras.

[0087] In this embodiment, after determining the relative position information of the above-mentioned camera point to be checked in the above-mentioned electronic map and the pictures taken by the above-mentioned two camera devices, it can be determined based on the relative position information whether the camera point to be checked indicates the same geographical location in the real world in the electronic map and the pictures taken by the two camera devices. If the camera point to be checked indicates the same geographical location in the real world in the electronic map and the pictures taken by the two camera devices, it can be determined that the overlap area check between the camera areas of the two camera devices has passed. Correspondingly, if the camera point to be checked does not indicate the same geographical location in the real world in the electronic map and the pictures taken by the two camera devices, it can be determined that the overlap area check between the camera areas of the two camera devices has not passed.

[0088] In one embodiment shown, in order to determine whether the above-mentioned camera point to be inspected indicates the same geographical location in the real world in the above-mentioned electronic map and the images captured by the above-mentioned two cameras, the relative position information of the camera point to be inspected in the electronic map and the images captured by the two cameras can be first mapped to the geographical location information in the real world.

[0089] Specifically, for the relative position information of the camera point to be inspected in the electronic map, the relative position information can be mapped to the geographical location information in the real world according to the distance reduction ratio of the electronic map. For example, assuming that the relative position information includes: 30 degrees east of the south of the location of the camera device 1, and a distance of 10 centimeters; and assuming that the distance reduction ratio of the electronic map is 100:1; then the geographical location in the real world obtained by mapping the relative position information includes: 30 degrees east of the south of the location of the camera device 1, and a distance of 10 meters.

[0090] With respect to the relative position information of the above-mentioned camera point to be inspected in the picture captured by any of the above-mentioned camera devices, since the imaging model adopted by the camera device is a pinhole imaging model, the position information such as the direction and distance between the camera point to be inspected and the position of the camera device can be calculated based on the relative position information, the pinhole imaging principle, and the camera parameters such as the optical center position, focal length and size of the imaging plane of the camera device. The calculated position information is the geographical location information of the camera point to be inspected in the real world.

[0091] Subsequently, it can be determined whether the geographic location information in the real world corresponding to the electronic map and the images captured by the two cameras matches. If the geographic location information in the real world corresponding to the electronic map and the images captured by the two cameras matches, it can be determined that the overlap area check between the camera areas of the two cameras has passed; otherwise, it can be determined that the overlap area check between the camera areas of the two cameras has failed.

[0092] Specifically, it can be determined whether the geographic location information in the real world corresponding to the electronic map and the screen 1 is consistent, and whether the geographic location information in the real world corresponding to the electronic map and the screen 2 is consistent. If the geographic location information in the real world corresponding to the electronic map and the screen 1 is consistent, and the geographic location information in the real world corresponding to the electronic map and the screen 2 is also consistent, it can be determined that the geographic location information in the real world corresponding to the electronic map and the screens captured by the two camera devices matches; otherwise, it can be determined that the geographic location information in the real world corresponding to the electronic map and the screens captured by the two camera devices does not match.

[0093] In another embodiment shown, an electronic map coordinate system can be set in advance for the electronic map, a screen 1 coordinate system can be set for the above-mentioned screen 1, and a screen 2 coordinate system can be set for the above-mentioned screen 2; and the mapping relationship between the electronic map coordinate system, the screen 1 coordinate system and the screen 2 coordinate system can be determined.

[0094] Specifically, in one example, based on the correspondence between the camera point in the electronic map and the screen 1, the mapping relationship between the position coordinates of the camera point in the electronic map coordinate system and the screen 1 coordinate system can be determined, and the mapping relationship can be used as the mapping relationship between the electronic map coordinate system and the screen 1 coordinate system; similarly, based on the correspondence between the camera point in the electronic map and the screen 2, the mapping relationship between the position coordinates of the camera point in the electronic map coordinate system and the screen 2 coordinate system can be determined, and the mapping relationship can be used as the mapping relationship between the electronic map coordinate system and the screen 2 coordinate system.

[0095] By integrating the mapping relationship between the electronic map coordinate system and the screen 1 coordinate system, and the mapping relationship between the electronic map coordinate system and the screen 2 coordinate system, the mapping relationship among the electronic map coordinate system, the screen 1 coordinate system and the screen 2 coordinate system can be obtained, and the mapping relationship is maintained by the above-mentioned camera system.

[0096] In another example, a world map coordinate system can also be set for the real world. In this case, for the above-mentioned electronic map, the mapping relationship between the above-mentioned electronic map coordinate system and the world map coordinate system can be determined based on the mapping relationship between the relative position of the camera point in the electronic map and the geographical location in the real world; for the picture taken by any of the above-mentioned camera devices, the mapping relationship between the picture coordinate system corresponding to the picture and the world map coordinate system can be determined based on the mapping relationship between the relative position of the camera point in the picture and the geographical location in the real world.

[0097] By integrating the mapping relationship between the electronic map coordinate system and the world map coordinate system, the mapping relationship between the above-mentioned screen 1 coordinate system and the world map coordinate system, and the mapping relationship between the above-mentioned screen 2 coordinate system and the world map coordinate system, the mapping relationship between the electronic map coordinate system, the screen 1 coordinate system, the screen 2 coordinate system and the world map coordinate system can be obtained, and the mapping relationship is maintained by the above-mentioned camera system.

[0098] By adopting this method, on the one hand, based on the mapping relationship among the electronic map coordinate system, the screen 1 coordinate system and the screen 2 coordinate system, the relative position information of the above-mentioned camera point to be inspected selected by the user in the above-mentioned electronic map and the pictures taken by the above-mentioned two cameras can be determined respectively.

[0099] Assuming that the user selects a camera point to be inspected in the above-mentioned overlapping area X by dragging the above-mentioned circular box displayed in the above-mentioned electronic map, the position coordinates of the camera point to be inspected selected by the user in the above-mentioned electronic map coordinate system can be directly determined; in addition, the position coordinates of the camera point to be inspected in the screen 1 coordinate system can be determined based on the mapping relationship between the electronic map coordinate system and the above-mentioned screen 1 coordinate system. Similarly, the position coordinates of the camera point to be inspected in the screen 2 coordinate system can be determined based on the mapping relationship between the electronic map coordinate system and the above-mentioned screen 2 coordinate system.

[0100] Alternatively, assuming that the user selects a camera point to be inspected in the above-mentioned overlapping area X by dragging the above-mentioned circular frame displayed in the above-mentioned screen 1, the position coordinates of the camera point to be inspected selected by the user in the above-mentioned screen 1 coordinate system can be directly determined; in addition, the position coordinates of the camera point to be inspected in the electronic map coordinate system can be determined based on the mapping relationship between the screen 1 coordinate system and the above-mentioned electronic map coordinate system. Similarly, the position coordinates of the camera point to be inspected in the screen 2 coordinate system can be determined based on the mapping relationship between the screen 1 coordinate system and the above-mentioned screen 2 coordinate system.

[0101] Alternatively, assuming that the user selects a camera point to be inspected in the overlapping area X by dragging the circular frame displayed in the above-mentioned screen 2, the position coordinates of the camera point to be inspected selected by the user in the coordinate system of the above-mentioned screen 2 can be directly determined; in addition, the position coordinates of the camera point to be inspected in the electronic map coordinate system can be determined based on the mapping relationship between the coordinate system of the screen 2 and the above-mentioned electronic map coordinate system. Similarly, the position coordinates of the camera point to be inspected in the coordinate system of the screen 1 can be determined based on the mapping relationship between the coordinate system of the screen 2 and the above-mentioned coordinate system of the screen 1.

[0102] On the other hand, when determining whether the above-mentioned camera point to be inspected indicates the same geographical location in the real world in the above-mentioned electronic map and the images captured by the above-mentioned two cameras, the position coordinates of the camera point to be inspected in the electronic map coordinate system can be mapped to the position coordinates in the world map coordinate system based on the mapping relationship between the above-mentioned electronic map coordinate system and the above-mentioned world map coordinate system, and the position coordinates of the camera point to be inspected in the picture 1 coordinate system can be mapped to the position coordinates in the world map coordinate system based on the mapping relationship between the above-mentioned picture 1 coordinate system and the world map coordinate system, and the position coordinates of the camera point to be inspected in the picture 2 coordinate system can be mapped to the position coordinates in the world map coordinate system based on the mapping relationship between the above-mentioned picture 2 coordinate system and the world map coordinate system.

[0103] Subsequently, it can be determined whether the three mapped position coordinates in the world map coordinate system are consistent. If the three position coordinates in the world map coordinate system are consistent, it can be determined that the above-mentioned camera point to be checked indicates the same geographical location in the real world in the above-mentioned electronic map and the pictures taken by the above-mentioned two camera devices; otherwise, it can be determined that the above-mentioned camera point to be checked does not indicate the same geographical location in the real world in the above-mentioned electronic map and the pictures taken by the above-mentioned two camera devices.

[0104] In this embodiment, in order to facilitate the user to identify the overlapped area that has passed the verification, the overlapped area that has passed the verification can be marked as valid, and the valid mark of the overlapped area can be displayed in the above-mentioned electronic map and the pictures taken by each camera device. The valid mark can be a mark such as a shadow fill, a color fill or a colored area border.

[0105] Accordingly, in this embodiment, in order to facilitate the user to identify the overlapping area that has not passed the verification, the overlapping area that has passed the verification can be marked as invalid, and the invalid mark of the overlapping area can be displayed in the above-mentioned electronic map and the pictures taken by each camera device. Among them, the invalid mark can also be a mark such as a shadow fill, a color fill or a colored area border, but it should be noted that the invalid mark is different from the above-mentioned valid mark.

[0106] In the above technical solution, a user can select a camera point to be checked in the overlapping area between the camera areas of multiple camera devices, and when it is determined that the camera point to be checked indicates the same geographical location in the real world in the electronic map output and displayed by the client and the pictures taken by multiple camera devices, it is determined that the overlapping area verification has passed, otherwise it can be determined that the overlapping area verification has not passed. In this way, for the overlapping area that has passed the verification, it can be considered that the overlapping area is accurate, that is, the overlapping area is valid; for the overlapping area that has not passed the verification, it can be considered that there is an error in the overlapping area, that is, the overlapping area is invalid. By verifying the overlapping area between the camera areas of multiple camera devices, it can be determined whether the overlapping area is valid, so that invalid overlapping areas can be discovered in time, and users can also check and adjust invalid overlapping areas in time.

[0107] Corresponding to the embodiment of the aforementioned method for verifying an imaging area, this specification also provides an embodiment of a device for verifying an imaging area.

[0108] The embodiments of the camera area verification device of this specification can be applied to electronic devices. The device embodiments can be implemented by software, hardware, or a combination of software and hardware. Taking software implementation as an example, as a device in a logical sense, it is formed by the processor of the electronic device in which it is located reading the corresponding computer program instructions in the non-volatile memory into the memory and running them. From the hardware level, if Figure 5 The figure is a hardware structure diagram of the electronic device where the verification device of the camera area of ​​this manual is located, except Figure 5 In addition to the processor, memory, network interface, and non-volatile memory shown, the electronic device in which the device in the embodiment is located may also include other hardware according to the actual function of verifying the camera area, which will not be described in detail.

[0109] Please refer to Figure 6 , Figure 6 FIG. 6 is a block diagram of a camera area verification device shown in an exemplary embodiment of the present specification. The camera area verification device 60 can be applied to Figure 5 The electronic device shown in the figure has a client in the camera system deployed on the electronic device; the camera system includes a client and multiple camera devices; wherein the camera areas of the multiple camera devices have overlapping areas; the camera area verification device 60 may include:

[0110] An acquisition module 601 is used to acquire a to-be-detected image point selected by a user in the overlapping area;

[0111] A first determination module 602 is used to respectively determine the relative position information of the to-be-detected camera point in the electronic map output and displayed by the client and in the pictures captured by the multiple camera devices;

[0112] A second determination module 603 is used to determine, based on the relative position information, whether the to-be-detected image point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple image capture devices;

[0113] The third determination module 604 is configured to determine that the overlap area check has passed if the to-be-checked imaging point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple imaging devices.

[0114] In this embodiment, the second determining module 603 is specifically configured to:

[0115] Mapping the relative position information into geographic location information in the real world;

[0116] Determining whether geographic location information corresponding to the electronic map and the images captured by the multiple camera devices matches;

[0117] If the geographical location information corresponding to the electronic map and the images captured by the multiple cameras matches, it is determined that the to-be-checked image point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple cameras.

[0118] In this embodiment, the camera system maintains a mapping relationship between the electronic map coordinate system corresponding to the electronic map and the image coordinate system corresponding to the picture captured by each camera device;

[0119] The first determining module 602 is specifically configured to:

[0120] Based on the mapping relationship, the position coordinates of the to-be-detected imaging point in the electronic map coordinate system and each of the image coordinate systems are determined respectively.

[0121] In this embodiment, the camera system further maintains a mapping relationship between the electronic map coordinate system and a preset world map coordinate system, and a mapping relationship between each of the image coordinate systems and the world map coordinate system;

[0122] The second determining module 603 is specifically used for:

[0123] Based on the mapping relationship between the electronic map coordinate system and the world map coordinate system, mapping the position coordinates of the to-be-detected camera point in the electronic map coordinate system to the position coordinates in the world map coordinate system;

[0124] Based on the mapping relationship between each of the image coordinate systems and the world map coordinate system, mapping the position coordinates of the to-be-detected camera point in each of the image coordinate systems to the position coordinates in the world map coordinate system;

[0125] Determine whether the position coordinates of each mapped position in the world map coordinate system are consistent;

[0126] If the mapped position coordinates in the world map coordinate system are consistent, it is determined that the to-be-checked imaging point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple imaging devices.

[0127] In this embodiment, the device 60 further includes:

[0128] The first marking module 605 is used to mark the overlapping area as valid when it is determined that the overlapping area verification has passed, and to display the valid mark of the overlapping area in the electronic map and the pictures taken by each camera device.

[0129] In this embodiment, the device 60 further includes:

[0130] The second marking module 606 is used to mark the overlapping area as invalid when it is determined that the overlapping area check fails, and display an invalid mark of the overlapping area in the electronic map and the pictures taken by each camera device.

[0131] The implementation process of the functions and effects of each module in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, which will not be repeated here.

[0132] For the device embodiment, since it basically corresponds to the method embodiment, the relevant parts can refer to the partial description of the method embodiment. The device embodiment described above is only schematic, wherein the modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this specification. A person of ordinary skill in the art can understand and implement it without paying creative labor.

[0133] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer, which may be in the form of a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email transceiver, a game console, a tablet computer, a wearable device or a combination of any of these devices.

[0134] In a typical configuration, a computer includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0135] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0136] Computer-readable media include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, disk storage, quantum memory, graphene-based storage media or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include temporary computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0137] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0138] The above is a description of a specific embodiment of the specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0139] The terms used in one or more embodiments of this specification are only for the purpose of describing specific embodiments, and are not intended to limit one or more embodiments of this specification. The singular forms of "a", "said" and "the" used in one or more embodiments of this specification and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0140] It should be understood that although the terms first, second, third, etc. may be used to describe various information in one or more embodiments of this specification, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of one or more embodiments of this specification, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0141] The above description is merely a preferred embodiment of one or more embodiments of the present specification and is not intended to limit one or more embodiments of the present specification. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of one or more embodiments of the present specification shall be included in the scope of protection of one or more embodiments of the present specification.

Claims

1. A method for verifying an imaging area, the method being applied to an imaging system, the imaging system comprising a client and a plurality of imaging devices; wherein: There is an overlapping area between the imaging areas of the multiple imaging devices; The method is applied to the client, comprising: Acquire the to-be-checked image point selected by the user in the overlapping area; Respectively determining the relative position information of the to-be-detected camera point in the electronic map output and displayed by the client and in the pictures captured by the multiple camera devices; Based on the relative position information, determining whether the to-be-checked image point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple image capture devices; If the to-be-checked imaging point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple imaging devices, it is determined that the overlapping area verification has passed.

2. The method according to claim 1, wherein determining, based on the relative position information, whether the to-be-detected image point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple image capture devices comprises: Mapping the relative position information into geographic location information in the real world; Determining whether geographic location information corresponding to the electronic map and the images captured by the multiple camera devices matches; If the geographical location information corresponding to the electronic map and the images captured by the multiple cameras matches, it is determined that the to-be-checked image point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple cameras.

3. According to the method of claim 1, the camera system maintains a mapping relationship between the electronic map coordinate system corresponding to the electronic map and the image coordinate system corresponding to the picture captured by each camera device; The step of respectively determining the relative position information of the to-be-detected camera point in the electronic map output and displayed by the client and in the pictures captured by the multiple camera devices includes: Based on the mapping relationship, the position coordinates of the to-be-detected imaging point in the electronic map coordinate system and each of the image coordinate systems are determined respectively.

4. According to the method of claim 3, the camera system further maintains a mapping relationship between the electronic map coordinate system and a preset world map coordinate system, and a mapping relationship between each of the image coordinate systems and the world map coordinate system; The determining, based on the relative position information, whether the to-be-detected image point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple image capture devices comprises: Based on the mapping relationship between the electronic map coordinate system and the world map coordinate system, mapping the position coordinates of the to-be-detected camera point in the electronic map coordinate system to the position coordinates in the world map coordinate system; Based on the mapping relationship between each of the image coordinate systems and the world map coordinate system, mapping the position coordinates of the to-be-detected camera point in each of the image coordinate systems to the position coordinates in the world map coordinate system; Determine whether the position coordinates of each mapped position in the world map coordinate system are consistent; If the mapped position coordinates in the world map coordinate system are consistent, it is determined that the to-be-checked imaging point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple imaging devices.

5. The method according to claim 1, further comprising: When it is determined that the overlap area verification has passed, the overlap area is marked as valid, and a valid mark of the overlap area is displayed in the electronic map and in the pictures captured by each camera device.

6. The method according to claim 1 or 5, further comprising: When it is determined that the overlap area check fails, the overlap area is marked as invalid, and an invalid mark of the overlap area is displayed in the electronic map and the pictures taken by each camera device.

7. A device for verifying a camera area, the device being applied to a camera system, the camera system comprising a client and a plurality of camera devices; wherein: There is an overlapping area between the imaging areas of the multiple imaging devices; The device is applied to the client, and includes: An acquisition module, used for acquiring the to-be-detected image point selected by the user in the overlapping area; A first determination module is used to respectively determine the relative position information of the to-be-detected camera point in the electronic map output and displayed by the client and in the pictures captured by the multiple camera devices; A second determination module is used to determine, based on the relative position information, whether the to-be-checked image point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple camera devices; The third determination module is used to determine that the overlap area verification has passed if the to-be-checked imaging point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple imaging devices.

8. The device according to claim 7, wherein the second determining module is specifically configured to: Mapping the relative position information into geographic location information in the real world; Determining whether geographic location information corresponding to the electronic map and the images captured by the multiple camera devices matches; If the geographical location information corresponding to the electronic map and the images captured by the multiple cameras matches, it is determined that the to-be-checked image point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple cameras.

9. The device according to claim 7, wherein the camera system maintains a mapping relationship between an electronic map coordinate system corresponding to the electronic map and an image coordinate system corresponding to the images captured by each camera device; The first determining module is specifically used for: Based on the mapping relationship, the position coordinates of the to-be-detected imaging point in the electronic map coordinate system and each of the image coordinate systems are determined respectively.

10. The device according to claim 9, wherein the camera system further maintains a mapping relationship between the electronic map coordinate system and a preset world map coordinate system, and a mapping relationship between each of the image coordinate systems and the world map coordinate system; The second determining module is specifically used for: Based on the mapping relationship between the electronic map coordinate system and the world map coordinate system, mapping the position coordinates of the to-be-detected camera point in the electronic map coordinate system to the position coordinates in the world map coordinate system; Based on the mapping relationship between each of the image coordinate systems and the world map coordinate system, mapping the position coordinates of the to-be-detected camera point in each of the image coordinate systems to the position coordinates in the world map coordinate system; Determine whether the position coordinates of each mapped position in the world map coordinate system are consistent; If the mapped position coordinates in the world map coordinate system are consistent, it is determined that the to-be-checked imaging point indicates the same geographical location in the real world in the electronic map and the images captured by the multiple imaging devices.

11. The device according to claim 7, further comprising: The first marking module is used to mark the overlapping area as valid when it is determined that the overlapping area verification has passed, and to display the valid mark of the overlapping area in the electronic map and the pictures taken by each camera device.

12. The device according to claim 7 or 11, further comprising: The second marking module is used to mark the overlapping area as invalid when it is determined that the overlapping area verification fails, and display the invalid mark of the overlapping area in the electronic map and the pictures taken by each camera device.

13. An electronic device, comprising: processor; a memory for storing processor-executable instructions; The processor implements the method according to any one of claims 1 to 6 by running the executable instructions.

14. A computer-readable storage medium having computer instructions stored thereon, which, when executed by a processor, implement the steps of the method according to any one of claims 1 to 6.

Images