An image information processing method based on camera pose adjustment and related device

Abstract

Embodiments of the present application disclose a kind of image information processing method based on camera posture adjustment and related device, wherein method includes: obtaining first image information and second image information;According to the first image information and the second image information generate third image information;The third image information is sent to terminal device;Receiving the terminal device sends the selection operation for fifth image information in the third image information;Determine that target area and third area exist overlapping part;According to the target area determines second posture, to enable intelligent camera to be with the second posture the image information of target area is photographed;Target instruction is sent to the terminal device.The embodiments of the present application process image information to indicate terminal device to output prompt information to assist user to adjust the posture of intelligent camera, improve the use convenience of intelligent camera.

Description

Technical Field

[0001] This application is applied to the field of general data processing technology in the Internet industry, and particularly relates to an image information processing method and related apparatus based on camera posture adjustment. Background Technology

[0002] In recent years, the adoption rate of smart cameras in home applications has gradually increased. Through smart cameras, users can view their homes in real time, meeting their daily needs and bringing convenience to their lives. Currently, the shooting range of indoor smart cameras is limited. Users typically adjust the placement and angle of the smart camera (i.e., the camera's orientation) based on experience or actual usage to ensure its shooting range covers the area the user needs to monitor, which often consumes a significant amount of time and effort.

[0003] Therefore, how to improve the ease of use of smart cameras is a technical problem that urgently needs to be solved by those skilled in the art. Summary of the Invention

[0004] This application discloses an image information processing method and related apparatus based on camera posture adjustment, aiming to enable the server to instruct the terminal device to output prompt information to assist the user in adjusting the posture of the smart camera and improve the ease of use of the smart camera.

[0005] In a first aspect, embodiments of this application provide an image information processing method based on camera pose adjustment, applied to a server, the method comprising:

[0006] Acquire first image information and second image information, wherein the first image information includes image information of the area where the smart camera is located, and the second image information is image information captured when the smart camera is in a first posture. The area corresponding to the first image information is a first region, and the area corresponding to the second image information is a second region, which is a part of the first region. The smart camera can rotate and shoot within a preset shooting angle range after being placed at a fixed angle.

[0007] A third image is generated based on the first image information and the second image information, wherein the third image information includes a fourth image information and the second image information, the fourth image information is the image information of the third region in the first image information, and the third region is the part of the first region excluding the second region;

[0008] Send the third image information to the terminal device;

[0009] The terminal device sends a selection operation for the fifth image information in the third image information, wherein the fifth image information is image information for one or more target areas;

[0010] It is determined that the one or more target regions overlap with the third region;

[0011] A second pose is determined based on the one or more target areas, so that the smart camera can capture image information of at least one target area in the second pose.

[0012] In the above method, the server can determine, using the second and fifth image information, whether the second area captured by the smart camera in its first pose cannot completely encompass the target area the user expects the smart camera to capture; that is, whether the smart camera in its first pose can meet the user's needs. When the smart camera in its first pose fails to meet the user's needs, the server can determine the second pose of the smart camera based on one or more target areas, so that the smart camera can capture image information of at least one target area in its second pose. Therefore, the above method avoids the user determining the pose of the smart camera based on experience, thus improving the ease of use of the smart camera.

[0013] It should be noted that the second posture includes the second position and the second placement angle.

[0014] In conjunction with the first aspect, in one possible implementation, after determining the second posture based on the one or more target areas, the server sends a target instruction to the terminal device, wherein the target instruction is used to instruct the terminal device to output a prompt message, the prompt message being used to prompt the user to adjust the smart camera to the second posture.

[0015] In the above method, the server can instruct the terminal device to output a prompt message to assist the user in adjusting the smart camera from a first pose to a second pose. Therefore, this method can output prompt information based on the user's needs regarding the smart camera's shooting area, enabling the user to quickly adjust the smart camera's pose and further improving the ease of use of the smart camera.

[0016] In conjunction with the first aspect, or any of the above possible implementations of the first aspect, in another possible implementation, the third image information is image information obtained by stitching together the second image information and the fourth image information.

[0017] In the above method, the third image information is continuous and without repetition. It is used to distinguish the second image information captured by the smart camera in the first posture from the fourth image information that is outside its shooting range, making it easier for the user to differentiate between the second and fourth image information when selecting the fifth image information based on the third image information. Therefore, the above method can help users initially determine whether the smart camera in the first posture meets their needs.

[0018] In conjunction with the first aspect, or any of the above possible implementations of the first aspect, in yet another possible implementation, the one or more target regions correspond to a leftmost rotation angle, a rightmost rotation angle, a topmost rotation angle, and a bottommost rotation angle; determining the second pose based on the one or more target regions includes:

[0019] A first shooting angle is determined based on the leftmost rotation angle and the rightmost rotation angle, wherein the first shooting angle is the maximum shooting angle for the one or more target areas in the left and right direction;

[0020] A second shooting angle is determined based on the uppermost rotation angle and the lowermost rotation angle, wherein the second shooting angle is the maximum shooting angle in the vertical direction for the one or more target areas;

[0021] The first information of the second position relative to the first position and the second information of the second placement angle relative to the first placement angle are determined based on the first shooting angle and the third shooting angle, wherein the third shooting angle is the maximum shooting angle in the left and right direction when the smart camera is in the first posture.

[0022] The third information of the second position relative to the first position and the fourth information of the second placement angle relative to the first placement angle are determined based on the second shooting angle and the fourth shooting angle, wherein the fourth shooting angle is the maximum shooting angle of the smart camera in the vertical direction.

[0023] The second posture is determined based on the first information, the second information, the third information, and the fourth information.

[0024] In the above method, by comparing the shooting angle of the target area with the maximum shooting angle of the smart camera in the left-right and up-down directions respectively, the position and angle information of the second pose relative to the first pose can be obtained, which is helpful for determining the second pose in the future.

[0025] It should be noted that in three-dimensional space, the left-right and up-down directions are the left-right and up-down directions centered on the smart camera in its first posture.

[0026] In combination with the first aspect, or any of the above possible implementations of the first aspect, in yet another possible implementation:

[0027] The first posture includes first positions in the left-right, up-down, and front-back directions, and first placement angles in the left-right and up-down directions, respectively; the second posture includes second positions in the left-right, up-down, and front-back directions, and second placement angles in the left-right and up-down directions, respectively.

[0028] The first information includes a first coordinate and a second coordinate, the second information includes a first angle, the third information includes a third coordinate and a fourth coordinate, and the fourth information includes a second angle;

[0029] Wherein, the first coordinate is used to represent the relative distance between the second position and the first position in the left-right direction, the third coordinate is used to represent the relative distance between the second position and the first position in the up-down direction, and the second coordinate and the fourth coordinate are both used to represent the relative distance between the second position and the first position in the front-back direction; the first angle is used to represent the relative angle between the second placement angle and the first placement angle in the left-right direction, and the second angle is used to represent the relative angle between the second placement angle and the first placement angle in the up-down direction.

[0030] In three-dimensional space, the position of an object is often represented by its position in multiple directions within a coordinate system. In this embodiment, a three-dimensional coordinate system is established with the initial position (i.e., the first position) of the smart camera as the origin, encompassing three directions (left-right, up-down, and front-back). Therefore, the first pose includes first positions in the left-right, up-down, and front-back directions, respectively, and the second pose includes second positions in the left-right, up-down, and front-back directions, respectively. Considering that the placement angle of the smart camera can be adjusted in the left-right direction and / or the up-down direction, the first pose includes first placement angles in the left-right and up-down directions, respectively, and the second pose includes second placement angles in the left-right and up-down directions, respectively.

[0031] The above method can further determine the relative positional and angular relationships (i.e., relative attitudes) between the first attitude and the second attitude in the same three-dimensional space in different directions using the first, second, third, and fourth information, which is beneficial for determining the second attitude based on the first attitude and the relative attitude.

[0032] In conjunction with the first aspect, or any of the above possible implementations of the first aspect, in yet another possible implementation, determining the first information of the second position relative to the first position in the left-right direction and the second information of the second placement angle relative to the first placement angle based on the first shooting angle and the third shooting angle includes:

[0033] When the first shooting angle is less than or equal to the third shooting angle:

[0034] The first coordinate and the second coordinate are both set to zero and the first angle is set to the first deviation angle, or the second coordinate and the first angle are both set to zero and the first coordinate is set to the first distance value, wherein the first deviation angle is the angle by which the first shooting angle deviates from the third shooting angle, the first distance value is a non-zero value, and the first distance value is determined by the first deviation angle.

[0035] When the first shooting angle is larger than the third shooting angle:

[0036] If there is a non-overlapping view between the first shooting view and the third shooting view, then the first coordinate is determined to be zero, the second coordinate is determined to be the second distance value, and the first angle is determined to be the first deviation angle, wherein the second distance value is a non-zero value, and the second distance value is determined by the first angle difference between the first shooting view and the third shooting view.

[0037] If there is no non-overlapping view between the first shooting view and the third shooting view, then the first coordinate and the first angle are both determined to be zero, and the second coordinate is determined to be the third distance value, wherein the third distance value is a non-zero value and is determined by the difference in the first angle.

[0038] In the above method, the third shooting angle can be understood as the maximum shooting angle of the second area in the left-right direction. Considering that the target area and the third area overlap (the shooting range of the smart camera in the first posture fails to meet the user's needs), there are three possible situations: Situation 1: The first shooting angle is less than or equal to the third shooting angle; Situation 2: The first shooting angle is greater than the third shooting angle and there is a non-overlapping angle between them; Situation 3: The first shooting angle is greater than the third shooting angle and there is no non-overlapping angle between them.

[0039] The above method can determine the first and second information for the three different situations, which not only expands the scope of application of the method, but also helps to improve the accuracy of the subsequent determination of the second attitude.

[0040] In conjunction with the first aspect, or any of the possible implementations of the first aspect described above, in yet another possible implementation, based on the second shooting angle and the fourth shooting angle, determining the third information of the second position relative to the first position in the vertical direction and the fourth information of the second placement angle relative to the first placement angle includes:

[0041] When the second shooting angle is less than or equal to the fourth shooting angle:

[0042] The third coordinate and the fourth coordinate are both set to zero and the second angle is set to the second deviation angle, or the fourth coordinate and the second angle are both set to zero and the third coordinate is set to the fourth distance value, wherein the second deviation angle is the angle by which the second shooting angle deviates from the fourth shooting angle, the fourth distance value is a non-zero value, and the fourth distance value is determined by the second deviation angle;

[0043] When the second shooting angle is larger than the fourth shooting angle:

[0044] If there is a non-overlapping view between the second shooting view and the fourth shooting view, then the third coordinate is determined to be zero, the fourth coordinate is determined to be the fifth distance value, and the second angle is determined to be the second deviation angle, wherein the fifth distance value is a non-zero value, and the fifth distance value is determined by the second angle difference between the second shooting view and the fourth shooting view;

[0045] If there is no non-overlapping view between the second shooting view and the fourth shooting view, then the third coordinate and the second angle are both determined to be zero, and the fourth coordinate is determined to be the sixth distance value, wherein the sixth distance value is a non-zero value and is determined by the difference of the second angle.

[0046] In the above method, the fourth shooting angle can be understood as the maximum shooting angle of the second region in the vertical direction. Considering that the target region and the third region overlap (the shooting range of the smart camera in the first posture fails to meet the user's needs), there are three possible scenarios: Scenario 1: The second shooting angle is less than or equal to the fourth shooting angle; Scenario 2: The second shooting angle is greater than the fourth shooting angle and there is a non-overlapping angle between them; Scenario 3: The second shooting angle is greater than the fourth shooting angle and there is no non-overlapping angle between them.

[0047] The above method can determine the third and fourth information for the three different situations, which not only expands the scope of application of the method, but also helps to improve the accuracy of the subsequent determination of the second attitude.

[0048] In conjunction with the first aspect, or any of the above possible implementations of the first aspect, in yet another possible implementation, determining the second posture based on the first information, the second information, the third information, and the fourth information includes:

[0049] For the left and right directions, the second position in the second posture is determined based on the first position in the first posture and the first coordinate, and the second placement angle in the second posture is determined based on the first placement angle in the first posture and the first angle.

[0050] For the vertical direction, the second position in the second posture is determined based on the first position in the first posture and the third coordinate, and the second placement angle in the second posture is determined based on the first placement angle in the first posture and the second angle.

[0051] For the forward and backward directions, the second position in the second posture is determined based on the first position in the first posture and the fifth coordinate, wherein the fifth coordinate is the smaller value of the second coordinate and the fourth coordinate.

[0052] Considering that the position of the smart camera in the front-back direction can affect the shooting angle of the smart camera in the front-back and vertical directions, in order to enable the smart camera to capture image information of the target area when it is in the second pose, even if the shooting angle of the smart camera in the left-right direction is not less than the first shooting angle, and the shooting angle in the vertical direction is not less than the third shooting angle, the above method finally takes the smaller value of the second coordinate and the fourth coordinate (the fifth coordinate) as the distance between the second position and the first position in the front-back direction, in order to improve the accuracy of the subsequently determined second pose.

[0053] Secondly, embodiments of this application provide an image information processing method based on camera pose adjustment, applied to a terminal device, the method comprising:

[0054] The system acquires third image information sent by the server. This third image information is generated based on the first image information and the second image information. The first image information includes image information of the area where the smart camera is located. The second image information is image information captured when the smart camera is in a first posture, where the first posture includes the current first position and a first placement angle of the smart camera. The area corresponding to the first image information is a first region, and the area corresponding to the second image information is a second region, which is a part of the first region. The smart camera can rotate and capture images within a preset shooting angle range after a fixed placement angle. The third image information includes the second image information and a fourth image information. The fourth image information is the image information of the first image information for the third region, where the third region is the part of the first region excluding the second region.

[0055] In response to the user's operation command, a selection operation for the fifth image information in the third image information is sent to the server, wherein the fifth image information is image information for one or more target areas;

[0056] In response to the target instruction sent by the server, a prompt message is output, wherein the prompt message is used to prompt the user to adjust the smart camera to the second posture so that the smart camera can capture image information of at least one target area in the second posture.

[0057] Thirdly, embodiments of this application provide an image information processing apparatus, the apparatus comprising:

[0058] The first acquisition unit is used to acquire first image information and second image information, wherein the first image information includes image information of the area where the smart camera is located, and the second image information is image information captured when the smart camera is in a first posture, the first posture including the current first position and first placement angle of the smart camera; the area corresponding to the first image information is a first region, the area corresponding to the second image information is a second region, and the second region is a part of the first region; the smart camera can rotate and shoot within a preset shooting angle range after fixing the placement angle.

[0059] A processing unit is configured to generate third image information based on the first image information and the second image information, wherein the third image information includes fourth image information and the second image information, the fourth image information is image information of the third region in the first image information, and the third region is the part of the first region excluding the second region;

[0060] The first sending unit is used to send the third image information to the terminal device;

[0061] The second acquisition unit is used to receive a selection operation sent by the terminal device for the fifth image information in the third image information, wherein the fifth image information is image information for one or more target areas;

[0062] The first determining unit is configured to determine that there is an overlap between the one or more target regions and the third region;

[0063] The second determining unit is configured to determine a second posture based on the target area, so that the smart camera can capture image information of at least one target area in the second posture, wherein the second posture includes a second position and a second placement angle.

[0064] In conjunction with the third aspect, in one possible implementation, the apparatus further includes:

[0065] The second sending unit is used to send a target instruction to the terminal device, wherein the target instruction is used to instruct the terminal device to output a prompt message, and the prompt message is used to prompt the user to adjust the smart camera to the second posture.

[0066] In conjunction with the third aspect, or any of the above possible implementations of the third aspect, in another possible implementation, the third image information is image information obtained by stitching together the second image information and the fourth image information.

[0067] In conjunction with the third aspect, or any of the above possible implementations of the third aspect, in yet another possible implementation, the one or more target regions correspond to a leftmost rotation angle, a rightmost rotation angle, a topmost rotation angle, and a bottommost rotation angle; in determining the second pose based on the one or more target regions, the second determining unit is specifically used for:

[0068] A first shooting angle is determined based on the leftmost rotation angle and the rightmost rotation angle, wherein the first shooting angle is the maximum shooting angle for the one or more target areas in the left and right direction;

[0069] A second shooting angle is determined based on the uppermost rotation angle and the lowermost rotation angle, wherein the second shooting angle is the maximum shooting angle in the vertical direction for the one or more target areas;

[0070] The first information of the second position relative to the first position and the second information of the second placement angle relative to the first placement angle are determined based on the first shooting angle and the third shooting angle, wherein the third shooting angle is the maximum shooting angle in the left and right direction when the smart camera is in the first posture.

[0071] The third information of the second position relative to the first position and the fourth information of the second placement angle relative to the first placement angle are determined based on the second shooting angle and the fourth shooting angle, wherein the fourth shooting angle is the maximum shooting angle of the smart camera in the vertical direction.

[0072] The second posture is determined based on the first information, the second information, the third information, and the fourth information.

[0073] In conjunction with the third aspect, or any of the above possible implementations of the third aspect, in yet another possible implementation, the first posture includes first positions respectively in the left-right direction, up-down direction, and front-back direction, and first placement angles respectively in the left-right direction and up-down direction; the second posture includes second positions respectively in the left-right direction, up-down direction, and front-back direction, and second placement angles respectively in the left-right direction and up-down direction.

[0074] The first information includes a first coordinate and a second coordinate, the second information includes a first angle, the third information includes a third coordinate and a fourth coordinate, and the fourth information includes a second angle;

[0075] Wherein, the first coordinate is used to represent the relative distance between the second position and the first position in the left-right direction, the third coordinate is used to represent the relative distance between the second position and the first position in the up-down direction, and the second coordinate and the fourth coordinate are both used to represent the relative distance between the second position and the first position in the front-back direction; the first angle is used to represent the relative angle between the second placement angle and the first placement angle in the left-right direction, and the second angle is used to represent the relative angle between the second placement angle and the first placement angle in the up-down direction.

[0076] In conjunction with the third aspect, or any of the above possible implementations of the third aspect, in yet another possible implementation, regarding determining the first information of the second position relative to the first position in the left-right direction and the second information of the second placement angle relative to the first placement angle based on the first shooting angle and the third shooting angle, the second determining unit is specifically used for:

[0077] When the first shooting angle is less than or equal to the third shooting angle:

[0078] The first coordinate and the second coordinate are both set to zero and the first angle is set to the first deviation angle, or the second coordinate and the first angle are both set to zero and the first coordinate is set to the first distance value, wherein the first deviation angle is the angle by which the first shooting angle deviates from the third shooting angle, the first distance value is a non-zero value, and the first distance value is determined by the first deviation angle.

[0079] When the first shooting angle is larger than the third shooting angle:

[0080] If there is a non-overlapping view between the first shooting view and the third shooting view, then the first coordinate is determined to be zero, the second coordinate is determined to be the second distance value, and the first angle is determined to be the first deviation angle, wherein the second distance value is a non-zero value, and the second distance value is determined by the first angle difference between the first shooting view and the third shooting view.

[0081] If there is no non-overlapping view between the first shooting view and the third shooting view, then the first coordinate and the first angle are both determined to be zero, and the second coordinate is determined to be the third distance value, wherein the third distance value is a non-zero value and is determined by the difference in the first angle.

[0082] In conjunction with the third aspect, or any of the above possible implementations of the third aspect, in yet another possible implementation, regarding determining the third information of the second position relative to the first position in the vertical direction and the fourth information of the second placement angle relative to the first placement angle based on the second shooting angle and the fourth shooting angle, the second determining unit is specifically used for:

[0083] When the second shooting angle is less than or equal to the fourth shooting angle:

[0084] The third coordinate and the fourth coordinate are both set to zero and the second angle is set to the second deviation angle, or the fourth coordinate and the second angle are both set to zero and the third coordinate is set to the fourth distance value, wherein the second deviation angle is the angle by which the second shooting angle deviates from the fourth shooting angle, the fourth distance value is a non-zero value, and the fourth distance value is determined by the second deviation angle;

[0085] When the second shooting angle is larger than the fourth shooting angle:

[0086] If there is a non-overlapping view between the second shooting view and the fourth shooting view, then the third coordinate is determined to be zero, the fourth coordinate is determined to be the fifth distance value, and the second angle is determined to be the second deviation angle, wherein the fifth distance value is a non-zero value, and the fifth distance value is determined by the second angle difference between the second shooting view and the fourth shooting view;

[0087] If there is no non-overlapping view between the second shooting view and the fourth shooting view, then the third coordinate and the second angle are both determined to be zero, and the fourth coordinate is determined to be the sixth distance value, wherein the sixth distance value is a non-zero value and is determined by the difference of the second angle.

[0088] In conjunction with the third aspect, or any of the above possible implementations of the third aspect, in yet another possible implementation, regarding the determination of the second attitude based on the first information, the second information, the third information, and the fourth information, the second determining unit is specifically used for:

[0089] For the left and right directions, the second position in the second posture is determined based on the first position in the first posture and the first coordinate, and the second placement angle in the second posture is determined based on the first placement angle in the first posture and the first angle.

[0090] For the vertical direction, the second position in the second posture is determined based on the first position in the first posture and the third coordinate, and the second placement angle in the second posture is determined based on the first placement angle in the first posture and the second angle.

[0091] For the forward and backward directions, the second position in the second posture is determined based on the first position in the first posture and the fifth coordinate, wherein the fifth coordinate is the smaller value of the second coordinate and the fourth coordinate.

[0092] Fourthly, embodiments of this application provide an image information processing apparatus, the apparatus comprising:

[0093] The third acquisition unit is used to acquire third image information sent by the server. The third image information is image information generated based on the first image information and the second image information. The first image information includes image information of the area where the smart camera is located. The second image information is image information captured when the smart camera is in a first posture, where the first posture includes the current first position and a first placement angle of the smart camera. The area corresponding to the first image information is a first region, and the area corresponding to the second image information is a second region, which is a part of the first region. The smart camera can rotate and capture images within a preset shooting angle range after a fixed placement angle. The third image information includes the second image information and fourth image information. The fourth image information is the image information of the first image information for the third region, where the third region is the part of the first region excluding the second region.

[0094] The third sending unit is used to send a selection operation for the fifth image information in the third image information to the server in response to the user's operation command, wherein the fifth image information is image information for one or more target areas;

[0095] The output unit is configured to output a prompt message in response to a target instruction sent by the server, wherein the prompt message is configured to prompt the user to adjust the smart camera to the second posture so that the smart camera can capture image information of at least one target area in the second posture.

[0096] Fifthly, embodiments of this application provide a server, the server including a processor, a memory, and a communication interface, wherein the communication interface is used to perform receiving and / or sending operations under the control of the processor, the memory is used to store a computer program, and the processor is used to call the computer program to implement the method described in the first aspect or any possible implementation of the first aspect.

[0097] Sixthly, embodiments of this application provide a terminal device, the terminal device including a processor, a memory, and a communication interface, wherein the communication interface is used to perform receiving and / or sending operations under the control of the processor, the memory is used to store a computer program, and the processor is used to call the computer program to implement the method described in the second aspect or any possible implementation of the second aspect.

[0098] In a seventh aspect, embodiments of this application provide a computer-readable storage medium storing a computer program that, when run on a processor, implements the method described in the first aspect or any possible implementation thereof.

[0099] Eighthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when run on a processor, implements the method described in the second aspect or any possible implementation of the second aspect.

[0100] The beneficial effects of the methods or apparatus provided in the second to eighth aspects of this application can be referred to the beneficial effects of the technical solution in the first aspect, and will not be repeated here. Attached Figure Description

[0101] The accompanying drawings used in the description of the embodiments of this application will be briefly introduced below.

[0102] Figure 1 This is a schematic diagram of the architecture of an image information processing system based on camera pose adjustment provided in an embodiment of this application;

[0103] Figure 2 This is a schematic flowchart of an image information processing method based on camera pose adjustment provided in an embodiment of this application;

[0104] Figure 3 This is a scene diagram of a coordinate system provided in an embodiment of this application;

[0105] Figure 4 This is a schematic diagram of a user interface provided in an embodiment of this application;

[0106] Figure 5A This is a schematic diagram of another user interface provided in the embodiments of this application;

[0107] Figure 5B This is a schematic diagram of another user interface provided in the embodiments of this application;

[0108] Figure 6 This is a scene diagram of a target area provided in an embodiment of this application;

[0109] Figure 7 This is a schematic diagram of an algorithm for determining a second pose provided in an embodiment of this application;

[0110] Figure 8 This is a schematic diagram of the structure of an image information processing device 80 provided in an embodiment of this application;

[0111] Figure 9 This is a schematic diagram of the structure of a server 90 provided in an embodiment of this application. Detailed Implementation

[0112] The embodiments of this application will now be described in detail with reference to the accompanying drawings.

[0113] Please see Figure 1 , Figure 1 This is a schematic diagram of the architecture of an image information processing system based on camera pose adjustment provided in an embodiment of this application. The system includes a terminal device 101, a server 102, and a smart camera 103. The number of terminal devices and smart cameras is not strictly limited in this application. Figure 1 The embodiments shown are merely examples.

[0114] Terminal device 101 is a device with both data processing and data transmission / reception capabilities, used to present an operating interface to the user. Terminal device 101 can obtain image information captured by smart camera 103 through server 102, and can also send control commands to smart camera 103 through server 102 to instruct smart camera 103 to rotate within its shooting range to acquire image information from different areas. Terminal device 101 can also receive third image information sent by server 102 and display the third image information on the operating interface. The user can distinguish between the second image information captured by smart camera 103 in its first posture and the fourth image information (excluding the second image information) in the first image information corresponding to the area where smart camera 103 is located, using the third image information. The user can also select the fifth image information corresponding to the target area they wish the smart camera to capture through the operating interface. In response to the user's operation command, terminal device 101 can send a selection operation for the fifth image information to server 102, facilitating server 102's subsequent determination of whether the smart camera in its first posture meets the user's needs and to determine the second posture. Furthermore, in response to the target instruction sent by the server 102, the terminal device 101 can output a prompt message, which prompts the user to adjust the smart camera 103 to a second pose so that the smart camera 103 can capture the target area in the second pose.

[0115] It should be noted that the first posture includes the first position and the first placement angle of the smart camera 103; the second posture includes the second position and the second placement angle of the smart camera 103.

[0116] Optionally, the terminal device 101 can be a standalone device such as a handheld terminal, a desktop terminal, or a wearable device, or it can be a component (such as a chip or integrated circuit) included in a standalone device. When the terminal device is a handheld terminal, it can be a mobile phone, a tablet computer, a computer (such as a laptop computer, a PDA, etc.).

[0117] Server 102 is a device with computing power and storage space. The storage space is used to store first image information of the area where the smart camera 103 is located, second image information sent by the smart camera 103, and related algorithms for processing the image information. Server 102 can generate third image information based on the first and second image information and send the third image information to terminal device 101. In response to a selection operation by terminal device 101 regarding fifth image information in the third image information, server 102 determines whether the smart camera 103 in its first posture can meet the user's needs based on the target area corresponding to the fifth image information. If the smart camera 103 in its first posture fails to capture the target area, server 102 can determine a second posture based on the fifth image information, enabling the smart camera 103 to capture the target area in the second posture, and sends a target instruction to terminal device 101. This target instruction instructs terminal device 101 to prompt the user to adjust the smart camera 103 to the second posture.

[0118] Optionally, server 102 can be a physical device such as a server or host, or a virtual device such as a virtual machine or container. Optionally, server 102 can be in the cloud, such as a single service in the cloud or a server cluster composed of multiple servers, or it can be a local device, such as a single service or a server cluster composed of multiple servers locally.

[0119] In one optional embodiment, the server 102 can perform daily monitoring of the image information sent from the smart camera 103. When it is determined that a person has passed by in the image information, the server 102 instructs the terminal device 101 to output corresponding prompt information to notify the user that a person has passed by or appeared within the shooting range of the smart camera 103.

[0120] The smart camera 103 is a shooting device with data transmission and reception capabilities. It is used to record video of the situation within its shooting range and send the collected image data to the server 102 for subsequent analysis of the image information. The smart camera 103 can also receive control commands sent by terminal devices through the server 102. In response to the control command, the smart camera 103 can rotate within its shooting range to acquire image information from different areas.

[0121] Optionally, the terminal device 101 and the server 102 can be directly connected via wired communication, such as tangible media like metal wires or optical fibers, or indirectly connected via wireless communication, such as intangible media like wireless local area networks or Bluetooth.

[0122] Optionally, the server 102 and the smart camera 103 can be directly connected via wired communication, such as tangible media like metal wires or optical fibers, or indirectly connected via wireless communication, such as intangible media like wireless LAN or Bluetooth.

[0123] Optionally, terminal device 101 may perform some or all of the operations performed by server 102.

[0124] In summary, Figure 1 In the architecture shown, the server can output prompts based on the user's needs for the smart camera's shooting area, enabling the user to quickly adjust the smart camera's orientation and further improving the ease of use of the smart camera.

[0125] Please see Figure 2 , Figure 2 This is a flowchart illustrating an image information processing method based on camera pose adjustment provided in an embodiment of this application. The method can be based on... Figure 1 The architecture shown is used to implement this method, which includes, but is not limited to, the following steps:

[0126] Step S201: The server obtains the first image information and the second image information.

[0127] Specifically, the first image information includes image information of the area where the smart camera is located, and the second image information is image information collected when the smart camera is in a first posture, the first posture including the first position and the first placement angle of the smart camera; the area corresponding to the first image information is the first region, the area corresponding to the second image information is the second region, and the second region is a part of the first region.

[0128] The server can be Figure 1 The server 102 in the described embodiment can also be other devices capable of performing the same operations as the server. The smart camera can be... Figure 1 The smart camera 103 in the described embodiments may also be other devices that can perform the same operations as the camera.

[0129] The first image information is image information pre-stored on the server. For example, a user can use a terminal device to capture a panoramic image of the indoor space where the smart camera is located and upload it to the server for storage; a user can also use a terminal device to send a panoramic image of the indoor space where the smart camera is located that is pre-stored on the terminal device; a user can also use a handheld smart camera to capture video footage of the indoor space and upload it to the server.

[0130] The terminal device can be Figure 1The terminal device 101 in the described embodiments can also be other devices capable of performing the same operations. The terminal device may have built-in control software, which can be a software module composed of program code, such as an application (APP), used to present an operating interface to the user and interact with the server through an application programming interface (API).

[0131] The user places the smart camera at a first angle in a first position. For example, the first angle reflects the lens orientation when the smart camera's rotation angle is zero. When the smart camera's rotation angle is zero, the smart camera is in its initial state where the lens does not rotate in any direction.

[0132] In three-dimensional space, the position of an object is often represented by its position in multiple directions within a coordinate system. This embodiment establishes a three-dimensional coordinate system with the initial position (i.e., the first position) of the smart camera as the origin, encompassing three directions (the first direction, the second direction, and the third direction). For ease of understanding, the following explanation uses the first direction as left-right, the second direction as up-down, and the third direction as front-back as examples. Please refer to [link to relevant documentation]. Figure 3 , Figure 3 This is a scene diagram of a coordinate system provided in an embodiment of this application.

[0133] Point A represents the smart camera in the first position, and arrow 301 represents the lens orientation when the rotation angle of the smart camera is zero. In the first posture, the first position can include the first position in the left-right direction, the first position in the up-down direction, and the first position in the front-back direction, respectively, and the first placement angle can include the first placement angle in the left-right direction and the first placement angle in the up-down direction, respectively.

[0134] For example, since the first position is the origin, it can be represented as (0, 0, 0), meaning the first position is zero in the left-right, up-down, and front-back directions. Since the lens of the smart camera faces forward when its rotation angle is zero, and the angle between the forward direction and the left-right direction is 90 degrees, and the angle with the up-down direction is also 90 degrees, the first placement angle can be represented as (90, 90), meaning the first placement angle is 90 degrees in both the left-right and up-down directions.

[0135] It should be noted that the smart camera in this embodiment rotates and takes pictures within a preset shooting angle range after being placed at a fixed angle, that is, the rotatable angle of the smart camera in the left-right and up-down directions is a fixed range.

[0136] Next, users can view the second image information captured by the smart camera when it was in the first pose through the user interface of their terminal device. For ease of understanding, an example is provided below; please refer to [link / reference]. Figure 4 , Figure 4 This is a schematic diagram of a user interface provided in an embodiment of this application.

[0137] The icon 402 in the operation interface 401 can display the smart camera connected to the server, and the image information area 403 can display the real-time video footage captured by the smart camera in its first posture. Users can send control commands to the server by clicking the left icon 404, right icon 405, top icon 406, or bottom icon 407. In response to these control commands, the smart camera can rotate to different directions to capture images. Users can view the real-time video footage captured by the camera at different rotation angles in the image information area 403. The image information area 403 can display information about the rotation angle; for example, [10, 0, 10, 0] indicates that the camera rotates 10 degrees to the left and 10 degrees upwards, and [0, 15, 0, 15] indicates that the camera rotates 15 degrees to the right and 15 degrees downwards. Additionally, users can click the initialization icon 408 to reset the smart camera's rotation angle to zero.

[0138] In an optional embodiment, the terminal device may also preset gesture commands to replace the functions of the left icon 404, right icon 405, top icon 406, bottom icon 407, and initialization icon 408 in the operation interface 401. That is, the user can execute preset gesture commands on the operation interface to send control commands to the server to control the smart camera to rotate in different directions.

[0139] In one alternative embodiment, the terminal device may also be configured with a gravity sensing function (such as a gyroscope function), allowing the user to send control commands to the server by rotating the terminal device to control the smart camera to rotate in different directions.

[0140] Therefore, users can send control commands to the server via their terminal devices to make the smart camera rotate and capture images within a preset shooting angle after being placed at a fixed angle. Simultaneously, the smart camera sends the collected second image information to the server for storage.

[0141] Step S202: The server generates third image information based on the first image information and the second image information.

[0142] The server identifies the corresponding first region based on the first image information and the corresponding second region based on the second image information. It can be understood that the second region is a part of the first region.

[0143] The server can filter out the portion of the first region excluding the second region as the third region, and then stitch the fourth image information and the second image information corresponding to the third region together to generate the third image information. That is to say, the third image information can be continuous image information without duplicate content, used to distinguish the second image information captured by the smart camera in the first posture from the fourth image information outside its shooting range in the first image information.

[0144] Step S203: The server sends third image information to the terminal device.

[0145] The server sends third-party image information to the terminal device, allowing the user to select fifth-party image information through the terminal device's interface. The fifth-party image information is for one or more target areas, which are the areas the user wants the smart camera to capture.

[0146] For ease of understanding, examples are provided below. Please refer to [link / reference]. Figure 5A , Figure 5A This is a schematic diagram of another user interface provided in the embodiments of this application.

[0147] The image information area 501 can display the real-time video footage captured by the smart camera in its first pose, as well as the rotation angle information of the smart camera. The thumbnail image area 502 can display third image information, and the user can use color to distinguish the second area 503 and the third area 504 in the third image information. The thumbnail image area 502 can also use a marker box 505 to distinguish the corresponding area of ​​the real-time video footage from the smart camera in the third image information.

[0148] For example, in the operation interface 506, the user can send a control command to the server by clicking the left icon 507. In response to this control command, the smart camera can rotate to the left to take a picture. The user can view the real-time video footage taken when the camera rotates to the left at different angles in the image information area 501, and the marker box 505 also moves to the left as the smart camera rotates. When the user determines that the area corresponding to the real-time video footage in the image information area 501 is the target area, they can click the OK icon 508. In response to the user's operation command, the terminal device stores the current real-time video footage as the fifth image information. Alternatively, the user can also cancel the previous selection operation of the fifth image information by clicking the Cancel icon 509.

[0149] If the smart camera in the first posture rotates to the left to the maximum rotation angle (e.g., 60 degrees), and the image information area 501 still does not display the fifth image information of the corresponding target area, the user can continue to click the left icon 507, as shown in the operation interface 510. At this time, the image displayed in the image information area 501 is the image information generated by the server based on the angle (e.g., 80 degrees) that the user expects the smart camera to continue rotating to the left, as well as the third image information. That is, the third image information is used to supplement the image information corresponding to the area that the smart camera cannot actually capture.

[0150] Understandably, users can determine the fifth image information for different directions and the corresponding rotation angle information of the smart camera through their terminal devices. Optionally, the rotation angle information corresponding to the fifth image information can be represented by four numbers, representing the rotation angle to the left / right / up / down when the smart camera is capturing the target area. For example, the information [80, 0, 0, 0] indicates that the smart camera rotates 80 degrees to the left and 0 degrees to the right / up / down. It should be noted that, taking the lens orientation when the smart camera's rotation angle is zero as a reference or benchmark, the smart camera needs to rotate by a corresponding angle to make the target area in the fifth image information fall within the camera's shooting range. The left component of this corresponding angle is the left rotation angle corresponding to the fifth image information, the right component is the right rotation angle, the up component is the up rotation angle, and the down component is the down rotation angle.

[0151] Therefore, the fifth image information can be image information corresponding to multiple target areas. For example, if a user wants a smart camera placed in the living room to capture the kitchen door area and the balcony area by rotating its camera, the fifth image information can be image information for the kitchen door area and image information for the balcony area, meaning that both the kitchen door area and the balcony area are target areas.

[0152] Furthermore, after selecting the fifth image information, users can view it through their terminal devices. For a clearer understanding, please refer to [link to relevant documentation]. Figure 5B , Figure 5B This is a schematic diagram of another user interface provided in the embodiments of this application.

[0153] In the operation interface 511, the user can view the fifth image information by clicking the image information icon 512, set the target area name 514 (such as kitchen door or balcony) corresponding to the fifth image information by clicking the edit icon 513, delete the fifth image information (including the target area name 514) by clicking the delete icon 515, and enter new fifth image information by clicking the add icon 516. After the user confirms the fifth image information, they can click the confirm icon 517. In response to the user's operation command, the terminal device sends the selection operation for the fifth image information to the server.

[0154] Step S204: The server determines the second pose based on one or more target regions.

[0155] The second posture includes a second position and a second placement angle. It should be noted that, in the three-dimensional coordinate system of this application embodiment, the second position may include a second position relative to the left-right direction, a second position relative to the up-down direction, and a second position relative to the front-back direction, and the second placement angle may include a second placement angle relative to the left-right direction and a second placement angle relative to the up-down direction.

[0156] After receiving the fifth image information, the server determines whether there is any overlap between the target area (or the captured, or the illustrated area) corresponding to the fifth image information and the third area corresponding to the fourth image information. If the server determines that there is an overlap between the target area and the third area, it determines that the content captured by the smart camera in the first posture does not meet the user's needs, and therefore needs to determine the second posture of the smart camera so that the smart camera can capture image information of the target area in the second posture.

[0157] The server can determine the leftmost, rightmost, topmost, and bottommost rotation angles of the target area by using the leftward, rightward, upward, and downward rotation angles corresponding to the fifth image information.

[0158] For ease of understanding, examples are provided below. Please refer to [link / reference]. Figure 6 , Figure 6 This is a scene diagram of a target area provided in an embodiment of this application. Figure 6 In the scene shown, the second image information corresponds to the second region 601, the fourth image information corresponds to the third region 602, and the fifth image information corresponds to the target region 603 and the target region 604.

[0159] Point A represents the smart camera in the first position, point B represents the center point of the second area 601, point C represents the center point of the target area 603, and point D represents the center point of the target area 603. Arrow 605 indicates the lens orientation when the smart camera's rotation angle is zero, arrow 606 indicates the lens orientation when the smart camera is capturing the target area 603, and arrow 607 indicates the lens orientation when the smart camera is capturing the target area 604. It should be noted that the center point in this embodiment can also be other preset reference positions, such as the upper left corner, lower right corner, etc.

[0160] Arrows 606 and 605 have an angular component of 80 degrees to the left and 60 degrees to the top. Arrows 607 and 605 have an angular component of 70 degrees to the right and 50 degrees to the bottom. Therefore, using the lens orientation indicated by arrow 605 as a reference, the smart camera actually needs to rotate 80 degrees to the left and 60 degrees to the top to capture the target area 603; it does not need to rotate to the right or down. Therefore, the server sets the left rotation angle corresponding to the target area 603 to 80 degrees and the right rotation angle to 60 degrees, and sets the right rotation angle and the downward rotation angle to 0. Optionally, the rotation angle information corresponding to the target area can be represented as [80, 0, 60, 0].

[0161] Similarly, using the lens orientation indicated by arrow 605 as a reference or benchmark, the smart camera actually needs to rotate 70 degrees to the right and 50 degrees downward to capture the target area 604; it does not need to rotate to the left or upward. Therefore, the server determines the rightward rotation angle corresponding to the target area 604 as 70 degrees and the downward rotation angle as 50 degrees, and sets the leftward rotation angle and the upward rotation angle corresponding to the target area 603 to 0. Optionally, the rotation angle information corresponding to the target area 604 can be [0, 70, 0, 50].

[0162] The leftmost rotation angle corresponding to target area 603 and target area 604 is the left rotation angle of target area 603 (i.e., 80 degrees), the rightmost rotation angle is the right rotation angle of target area 604 (i.e., 70 degrees), the topmost rotation angle is the upward rotation angle of target area 603 (i.e., 60 degrees), and the bottommost rotation angle is the downward rotation angle of target area 604 (i.e., 50 degrees).

[0163] In other words, in this embodiment, when there are multiple target regions, the leftmost rotation angle corresponding to the target region is the largest angle among the multiple leftward rotation angles; when there is only one target region, the leftward rotation angle corresponding to that target region is the leftmost rotation angle of that target region. The above rules also apply to the rightmost rotation angle, the topmost rotation angle, and the bottommost rotation angle, which will not be elaborated here.

[0164] Furthermore, the server compares the shooting angle of the target area with the maximum shooting angle of the smart camera in the left-right direction to obtain the position and angle information of the second pose relative to the first pose, which is helpful for determining the second pose in the future.

[0165] Specifically, regarding the left and right directions, the server determines the first shooting angle based on the leftmost and rightmost rotation angles of the target area. The first shooting angle is the maximum shooting angle of the target area in the left and right directions. For example, as... Figure 6 As shown, the maximum shooting angle of target area 603 and target area 604 is the sum of the leftmost rotation angle (i.e., 80 degrees) and the rightmost rotation angle (i.e., 70 degrees) (i.e., 150 degrees).

[0166] Next, the server determines the first information of the second position relative to the first position and the second information of the second placement angle relative to the first placement angle based on the first shooting perspective and the third shooting perspective. The third shooting perspective is the maximum shooting perspective in the left-right direction when the smart camera is in the first posture, which can also be understood as the maximum shooting perspective for the second area in the left-right direction.

[0167] Optionally, the third shooting perspective can be shooting perspective information about the smart camera pre-stored in the server, or it can be calculated by the server based on the rotation angle data of the smart camera when acquiring the second image information.

[0168] In one optional embodiment, the first information includes a first coordinate and a second coordinate, and the second information includes a first angle, wherein the first coordinate is used to represent the relative distance between the second position and the first position in the left-right direction, the second coordinate is used to represent the relative distance between the second position and the first position in the front-back direction, and the first angle is used to represent the relative angle between the second placement angle and the first placement angle in the left-right direction.

[0169] For better understanding, please refer to Figure 7 , Figure 7This is a schematic diagram of an algorithm for determining a second pose provided in an embodiment of this application. Point E represents the first position of the smart camera, arrow 701 represents the lens orientation when the smart camera in the first pose has a rotation angle of zero, viewing angle ∠FEH is the first shooting viewing angle, and viewing angle ∠GEI is the third shooting viewing angle. Point M represents the second position of the smart camera, arrow 702 represents the lens orientation when the smart camera in the second pose has a rotation angle of zero, and viewing angle ∠FMH is the fifth shooting viewing angle of the smart camera in the second pose, directed towards the target area in the left-right direction.

[0170] Therefore, the first coordinate can be the relative distance between point M and point E in the left-right direction, the second coordinate can be the relative distance between point M and point E in the front-back direction, and the first angle can be the angle between arrow 701 and arrow 702.

[0171] When the target area overlaps with the third area, and the smart camera in the first posture cannot capture the target area no matter how it rotates left or right, that is, when the first shooting view cannot completely cover the third shooting view, the server can determine the position and angle information of the smart camera's second posture relative to the first posture in the left and right directions for the three possible situations where the first shooting view cannot completely cover the third shooting view.

[0172] Scenario 1: The first shooting angle is less than or equal to the third shooting angle.

[0173] For example, please see Figure 7 The first shooting angle ∠FEH and the third shooting angle ∠GEI partially overlap, and the first shooting angle ∠FEH is offset to the left relative to the third shooting angle ∠GEI.

[0174] It's easy to understand that a smart camera in its second pose can only capture the target area when its maximum left-right shooting angle completely covers the target area—that is, when the fifth shooting angle ∠FMH is less than or equal to the third shooting angle ∠GEI. Therefore, a smart camera in its first pose can move a certain distance to the left while maintaining its lens orientation (hereinafter referred to as "positioning orientation" when its rotation angle is zero) to become a smart camera in its second pose. In other words, for scenario one, the server can set both the second coordinate and the first angle to zero and set the first coordinate to the first distance value.

[0175] It should be noted that the maximum shooting angle of the smart camera in the left and right directions does not change with the camera's orientation.

[0176] Optionally, the orientation of the smart camera in the first posture can be shifted to the left while maintaining its position, thus becoming a smart camera in the second posture. That is to say, for scenario one, the server can also set both the first and second coordinates to zero and set the first angle as the first deviation angle.

[0177] It should be noted that the first deviation angle is the angle between the first shooting viewpoint ∠FEH and the third shooting viewpoint ∠GEI, which can be the angle ∠FEG or ∠HEG. The first distance value is related to the first deviation angle; the larger the first deviation angle, the larger the first distance value. Optionally, the server can preset the correspondence between the first distance value and the first deviation angle, so that when the first deviation angle is determined, the first distance value is also determined accordingly.

[0178] In addition, for scenario one, the first shooting angle ∠FEH can be shifted to the right relative to the third shooting angle ∠GEI. In order to make the fifth shooting angle ∠FMH less than or equal to the third shooting angle ∠GEI, the smart camera in the first posture can be moved to the right a certain distance while its orientation remains unchanged, or the orientation of the smart camera can be shifted to the left while its position remains unchanged, thus becoming the smart camera in the second posture.

[0179] Scenario 2: The first shooting angle is larger than the third shooting angle, and there are non-overlapping angles between the first shooting angle and the third shooting angle.

[0180] For example, please see Figure 7 The first shooting angle ∠FEH and the third shooting angle ∠GEI partially overlap, and the first shooting angle ∠FEH is offset to the left relative to the third shooting angle ∠GEI.

[0181] To ensure that the fifth shooting angle ∠FMH is less than or equal to the third shooting angle ∠GEI, the smart camera in the first posture can move backward a certain distance while its orientation can shift to the left, thus becoming a smart camera in the second posture. In other words, for scenario two, the server can set the first coordinate to zero, the second coordinate to the second distance value, and the first angle to the first deviation angle (the angle value of ∠FEG or ∠HEI).

[0182] It should be noted that the second distance value is a non-zero value, and it is related to the first angular difference between the first shooting viewpoint ∠FEH and the third shooting viewpoint ∠GEI. The larger the first angular difference, the larger the second distance value. Optionally, the server can preset the correspondence between the second distance value and the first angular difference. When the first angular difference is determined, the second distance value is also determined accordingly.

[0183] In addition, for scenario two, the first shooting angle ∠FEH can be shifted to the right relative to the third shooting angle ∠GEI. In order to make the fifth shooting angle ∠FMH less than or equal to the third shooting angle ∠GEI, the smart camera in the first posture can move back a certain distance and its orientation can be shifted to the right, thus becoming the smart camera in the second posture.

[0184] Scenario 3: The first shooting angle is larger than the third shooting angle, and there are no non-overlapping angles between the first shooting angle and the third shooting angle.

[0185] For example, please see Figure 7 The first shooting angle ∠FEH completely covers the third shooting angle ∠GEI. To make the fifth shooting angle ∠FMH less than or equal to the third shooting angle ∠GEI, the smart camera in the first posture can be moved backward a certain distance while maintaining its orientation, thus becoming a smart camera in the second posture. That is to say, for scenario two, the server can set both the first coordinate and the first angle to zero, and set the second coordinate as the third distance value, where the third distance value is a non-zero value determined by the difference in the first angle.

[0186] It should be noted that the third distance value is a non-zero value, and it is related to the first angular difference between the first shooting viewpoint ∠FEH and the third shooting viewpoint ∠GEI. The larger the first angular difference, the larger the third distance value. Optionally, the server can preset the correspondence between the third distance value and the first angular difference. When the first angular difference is determined, the third distance value is also determined accordingly.

[0187] Optionally, the server can distinguish the relative position between the first and second positions in the left-right direction by the sign of the first coordinate. For example, a negative first coordinate indicates that the second position is to the left of the first position in the left-right direction.

[0188] Optionally, the server can distinguish the relative orientation between the first placement angle and the second placement angle by the sign of the first angle. For example, when the first angle is negative, it indicates that the placement orientation of the smart camera in the second posture in the left-right direction is shifted to the left compared to the smart camera in the first posture.

[0189] Alternatively, the server can distinguish the relative position between the first and second positions in the left-right direction by the sign of the second coordinate. For example, when the first coordinate is positive, it indicates that the second position is behind the first position in the front-back direction.

[0190] Furthermore, the server compares the shooting angle of the target area with the maximum shooting angle of the smart camera in the vertical direction to obtain the position and angle information of the second pose relative to the first pose in the vertical direction, which is helpful for determining the second pose in the future.

[0191] Specifically, the server determines the second shooting angle based on the top and bottom rotation angles of the target area. This second shooting angle is the maximum shooting angle of the target area in the vertical direction. For example, ... Figure 6 As shown, the maximum shooting angle of target area 603 and target area 604 is the sum of the uppermost rotation angle (i.e., 60 degrees) and the lowermost rotation angle (i.e., 50 degrees) (i.e., 110 degrees).

[0192] Next, the server determines the third information of the second position relative to the first position and the fourth information of the second placement angle relative to the first placement angle based on the second and fourth shooting perspectives. The fourth shooting perspective is the maximum shooting perspective in the vertical direction when the smart camera is in the first posture, which can also be understood as the maximum shooting perspective for the second area in the vertical direction.

[0193] Optionally, the fourth shooting perspective can be shooting perspective information about the smart camera pre-stored in the server, or it can be calculated by the server based on the rotation angle data of the smart camera when acquiring the second image information.

[0194] In one optional embodiment, the third information includes a third coordinate and a fourth coordinate, the fourth information including a second angle, the third coordinate being used to represent the relative distance between the second position and the first position in the vertical direction, the fourth coordinate being used to represent the relative distance between the second position and the first position in the front-back direction; the second angle being used to represent the relative angle between the second placement angle and the first placement angle in the vertical direction.

[0195] When the target area overlaps with the third area, and the smart camera in the first posture cannot capture the target area no matter how it rotates its lens up or down, that is, when the second shooting view cannot completely cover the fourth shooting view, the server can determine the position and angle information of the smart camera's second posture relative to the first posture for the three possible situations where the second shooting view cannot completely cover the fourth shooting view.

[0196] Scenario 4: The second shooting angle is less than or equal to the fourth shooting angle.

[0197] Optionally, if the second shooting angle is shifted upward relative to the fourth shooting angle, the smart camera in the first posture can be moved upward a certain distance while its placement angle remains unchanged; or, the placement angle of the smart camera can be shifted upward while its position remains unchanged, thus becoming a smart camera in the second posture.

[0198] Optionally, if the second shooting angle is shifted downward relative to the fourth shooting angle, the smart camera in the first posture can be moved downward a certain distance while its orientation remains unchanged; or, the placement angle of the smart camera can be shifted downward while its position remains unchanged, thus becoming a smart camera in the second posture.

[0199] In other words, the server can set both the third and fourth coordinates to zero and the second angle to the second deviation angle, or set both the fourth coordinate and the second angle to zero and the third coordinate to the fourth distance value. Here, the second deviation angle is the angle by which the second shooting angle deviates from the fourth shooting angle, and the fourth distance value is a non-zero value related to the second deviation angle. The larger the second deviation angle, the larger the fourth distance value. Optionally, the server can preset the correspondence between the fourth distance value and the second deviation angle; when the second deviation angle is determined, the fourth distance value is also determined accordingly.

[0200] Case 5: The second shooting angle is larger than the fourth shooting angle, and there are non-overlapping angles between the second and fourth shooting angles.

[0201] Optionally, if the second shooting angle is shifted upward relative to the fourth shooting angle, the smart camera in the first posture can move backward a certain distance while its orientation can be shifted upward, thus becoming a smart camera in the second posture.

[0202] Optionally, if the second shooting angle is shifted downward relative to the fourth shooting angle, the smart camera in the first posture can move backward a certain distance while its orientation can be shifted downward, thus becoming a smart camera in the second posture.

[0203] In other words, the server can define the third coordinate as zero, the fourth coordinate as the fifth distance value, and the second angle as the second deviation angle. The fifth distance value is a non-zero value and is related to the difference in the second angle between the second and fourth shooting perspectives. The larger the difference in the second angle, the larger the fifth distance value. Optionally, the server can preset the correspondence between the fifth distance value and the difference in the second angle. When the difference in the second angle is determined, the fifth distance value is also determined accordingly.

[0204] Case 6: The second shooting angle is larger than the fourth shooting angle, and there are no non-overlapping angles between the second and fourth shooting angles.

[0205] Optionally, if the second shooting angle completely covers the fourth shooting angle, the smart camera in the first posture can be moved back a certain distance while its orientation remains unchanged, thus becoming a smart camera in the second posture.

[0206] In other words, the server can set the third coordinate and the second angle to zero, and the fourth coordinate to the sixth distance value. The sixth distance value is a non-zero value and is related to the difference between the second and third angles. The larger the difference between the second and third angles, the larger the sixth distance value. Optionally, the server can preset the correspondence between the sixth distance value and the difference between the second and third angles. When the difference between the second and third angles is determined, the sixth distance value is also determined accordingly.

[0207] Optionally, the server can distinguish the relative position between the first and second positions in the vertical direction by using the sign of the third coordinate. For example, a negative third coordinate indicates that the second position is above the first position in the vertical direction.

[0208] Optionally, the server can distinguish the relative orientation between the first and second placement angles by the sign of the second angle. For example, when the second angle is negative, it indicates that the placement orientation of the smart camera in the second posture in the vertical direction is offset upwards compared to the smart camera in the first posture.

[0209] Alternatively, the server can use the sign of the fourth coordinate to distinguish the relative position between the first and second positions in the front-back direction. For example, a positive fourth coordinate indicates that the second position is behind the first position in the front-back direction.

[0210] Then, the server can determine the second pose based on the first pose and the relative relationship between the second pose and the first pose. That is to say, the server can determine the second pose based on the first information, the second information, the third information, and the fourth information.

[0211] Specifically, for the left-right direction, the second position in the second posture is determined based on the first position and first coordinate in the first posture, and the second placement angle in the second posture is determined based on the first placement angle and first angle in the first posture. For the up-down direction, the second position in the second posture is determined based on the first position and third coordinate in the first posture, and the second placement angle in the second posture is determined based on the first placement angle and second angle in the first posture. For the front-back direction, the second position in the second posture is determined based on the first position and fifth coordinate in the first posture, where the fifth coordinate is the smaller value between the second and fourth coordinates.

[0212] It should be noted that, in order for the smart camera to capture image information of the target area when it is in the second pose, even if the smart camera's shooting angle in the left and right direction is not less than the first shooting angle, and its shooting angle in the up and down direction is not less than the third shooting angle, the server finally takes the smaller value of the second coordinate and the fourth coordinate (the fifth coordinate) as the distance between the second position and the first position in the front and back direction, in order to improve the accuracy of the subsequently determined second pose.

[0213] For example, as described above, in the three-dimensional coordinate system of this application embodiment, the first position in the first pose can be represented as [0, 0, 0], and the first placement angle can be represented as [90, 90]. When the server determines that the first coordinate is -10, the third coordinate is -15, the fifth coordinate is 8, the first angle is -15, and the second angle is 0, then the second position in the second pose can be represented as [-10, -15, 8], and the second placement angle can be represented as [75, 90]. That is to say, the smart camera in the first position can be moved 10 cm to the left, 15 cm upward, and 8 cm backward to obtain the smart camera in the second position, and the smart camera in the first placement angle can be obtained by shifting the placement lens 15 degrees to the left to obtain the smart camera in the second placement angle.

[0214] In one possible embodiment, the camera cannot be positioned in the actual space to the second pose determined by the server. For example, the second pose determined by the server for multiple target areas indicates that the camera in the first position needs to move back 20 centimeters to achieve the second position. However, the camera in the first position is limited by the actual space and can only move back a maximum of 10 centimeters. Therefore, the server can redetermine the second pose so that the camera can capture images of at least one of the multiple target areas in the redetermined second pose.

[0215] Step S205: The server sends the target instruction to the terminal device.

[0216] Specifically, the target instruction is used to instruct the terminal device to output a prompt message, which prompts the user to adjust the smart camera to the second pose.

[0217] The prompt message can be displayed as text, read aloud, or played as video. For example, the first prompt message could be a voice message: "The camera needs to maintain its current angle and move 20 centimeters to the left."

[0218] Optionally, when outputting prompts, the terminal device can further remind the user that the camera in the current posture does not meet their usage needs by vibrating or ringing.

[0219] In summary, the embodiments of this application can output prompt information based on the user's needs for the shooting area of ​​the smart camera, so as to enable the user to quickly adjust the posture of the smart camera and further improve the ease of use of the smart camera.

[0220] The methods of the embodiments of this application have been described in detail above. In order to facilitate better implementation of the above solutions of the embodiments of this application, the apparatus of the embodiments of this application is provided below.

[0221] It is understood that the apparatus provided in the embodiments of this application, such as an image information processing apparatus, includes hardware structures, software modules, or combinations of hardware structures and software structures to perform the functions described in the above method embodiments in order to achieve the functions.

[0222] Those skilled in the art will readily recognize that, based on the units and steps described in conjunction with the embodiments disclosed herein, the embodiments of this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can implement the foregoing method embodiments using different device implementations in different usage scenarios, and such different device implementations should not be considered beyond the scope of the embodiments of this application.

[0223] This application embodiment can divide the device into functional modules. For example, each function can be divided into its own functional modules, or two or more functions can be integrated into one functional module. The integrated module can be implemented in hardware or software. It should be noted that the module division in this application embodiment is illustrative and only represents one logical functional division; other division methods may be used in actual implementation. For example, taking the case of dividing the device into functional modules through integration as an example, this application illustrates several possible processing devices.

[0224] Please see Figure 8 , Figure 8 This is a schematic diagram of the structure of an image information processing device provided in an embodiment of this application. The image information processing device 80 can be... Figure 1 The server 102 shown, or the devices in the server 102; the image information processing device 80 may include:

[0225] The unit comprises a first acquisition unit 801, a processing unit 802, a first transmission unit 803, a second acquisition unit 804, a first determination unit 805, a second determination unit 806, and a second transmission unit 807. These units are connected via a bus. A detailed description of each unit is as follows:

[0226] The first acquisition unit 801 is used to acquire first image information and second image information. The first image information includes image information of the area where the smart camera is located, and the second image information is image information captured when the smart camera is in a first posture. The first posture includes the first position and the first placement angle of the smart camera. The second area captured by the second image information is a part of the first area captured by the first image information. The smart camera can rotate and capture images within a preset shooting angle range after the placement angle is fixed.

[0227] Processing unit 802 is configured to generate third image information based on the first image information and the second image information, wherein the third image information includes the second image information and the fourth image information, the fourth image information is the image information of the third region in the first image information, and the third region is the part of the first region excluding the second region;

[0228] The first sending unit 803 is used to send the third image information to the terminal device;

[0229] The second acquisition unit 804 is used to receive a selection operation sent by the terminal device for the fifth image information in the third image information, wherein the fifth image information is image information for a target area;

[0230] The first determining unit 805 is used to determine that the target region and the third region have an overlapping portion;

[0231] The second determining unit 806 is used to determine a second posture based on the target area, so that the smart camera can capture image information of the target area in the second posture, wherein the second posture includes a second position and a second placement angle.

[0232] The second sending unit 807 is used to send a target instruction to the terminal device, wherein the target instruction is used to instruct the terminal device to output a prompt message, and the prompt message is used to prompt the user to adjust the smart camera to the second posture.

[0233] In one possible implementation, the third image information is image information obtained by stitching together the second image information and the fourth image information.

[0234] In another possible implementation, the target region corresponds to a leftmost rotation angle, a rightmost rotation angle, a topmost rotation angle, and a bottommost rotation angle; in determining the second pose based on the target region, the second determining unit 806 is specifically used for:

[0235] A first shooting angle is determined based on the leftmost rotation angle and the rightmost rotation angle, wherein the first shooting angle is the maximum shooting angle for the target area in the left and right direction;

[0236] The second shooting angle is determined based on the uppermost rotation angle and the lowermost rotation angle, wherein the second shooting angle is the maximum shooting angle for the target area in the vertical direction;

[0237] The first information of the second position relative to the first position and the second information of the second placement angle relative to the first placement angle are determined based on the first shooting angle and the third shooting angle, wherein the third shooting angle is the maximum shooting angle in the left and right direction when the smart camera is in the first posture.

[0238] The third information of the second position relative to the first position and the fourth information of the second placement angle relative to the first placement angle are determined based on the second shooting angle and the fourth shooting angle, wherein the fourth shooting angle is the maximum shooting angle of the smart camera in the vertical direction.

[0239] The second posture is determined based on the first information, the second information, the third information, and the fourth information.

[0240] In another possible implementation, the first posture includes a first position relative to the left-right direction, the up-down direction, and the front-back direction, and a first placement angle relative to the left-right direction and the up-down direction, respectively; the second posture includes a second position relative to the left-right direction, the up-down direction, and the front-back direction, and a second placement angle relative to the left-right direction and the up-down direction, respectively.

[0241] The first information includes a first coordinate and a second coordinate, the second information includes a first angle, the third information includes the third coordinate and a fourth coordinate, and the fourth information includes the second angle;

[0242] Wherein, the first coordinate is used to represent the relative distance between the second position and the first position in the left-right direction, the third coordinate is used to represent the relative distance between the second position and the first position in the up-down direction, and the second coordinate and the fourth coordinate are both used to represent the relative distance between the second position and the first position in the front-back direction; the first angle is used to represent the relative angle between the second placement angle and the first placement angle in the left-right direction, and the second angle is used to represent the relative angle between the second placement angle and the first placement angle in the up-down direction.

[0243] In another possible implementation, regarding determining the first information of the second position relative to the first position in the left-right direction and the second information of the second placement angle relative to the first placement angle based on the first shooting angle and the third shooting angle, the second determining unit 806 is specifically used for:

[0244] When the first shooting angle is less than or equal to the third shooting angle:

[0245] The first coordinate and the second coordinate are both set to zero and the first angle is set to the first deviation angle, or the second coordinate and the first angle are both set to zero and the first coordinate is set to the first distance value, wherein the first deviation angle is the angle by which the first shooting angle deviates from the third shooting angle, the first distance value is a non-zero value, and the first distance value is determined by the first deviation angle.

[0246] When the first shooting angle is larger than the third shooting angle:

[0247] If there is a non-overlapping view between the first shooting view and the third shooting view, then the first coordinate is determined to be zero, the second coordinate is determined to be the second distance value, and the first angle is determined to be the first deviation angle, wherein the second distance value is a non-zero value, and the second distance value is determined by the first angle difference between the first shooting view and the third shooting view.

[0248] If there is no non-overlapping view between the first shooting view and the third shooting view, then the first coordinate and the first angle are both determined to be zero, and the second coordinate is determined to be the third distance value, wherein the third distance value is a non-zero value and is determined by the difference in the first angle.

[0249] In another possible implementation, in determining the third information of the second position relative to the first position in the vertical direction and the fourth information of the second placement angle relative to the first placement angle based on the second shooting angle and the fourth shooting angle, the second determining unit 806 is specifically used for:

[0250] When the second shooting angle is less than or equal to the fourth shooting angle:

[0251] The third coordinate and the fourth coordinate are both set to zero and the second angle is set to the second deviation angle, or the fourth coordinate and the second angle are both set to zero and the third coordinate is set to the fourth distance value, wherein the second deviation angle is the angle by which the second shooting angle deviates from the fourth shooting angle, the fourth distance value is a non-zero value, and the fourth distance value is determined by the second deviation angle;

[0252] When the second shooting angle is larger than the fourth shooting angle:

[0253] If there is a non-overlapping view between the second shooting view and the fourth shooting view, then the third coordinate is determined to be zero, the fourth coordinate is determined to be the fifth distance value, and the second angle is determined to be the second deviation angle, wherein the fifth distance value is a non-zero value, and the fifth distance value is determined by the second angle difference between the second shooting view and the fourth shooting view;

[0254] If there is no non-overlapping view between the second shooting view and the fourth shooting view, then the third coordinate and the second angle are both determined to be zero, and the fourth coordinate is determined to be the sixth distance value, wherein the sixth distance value is a non-zero value and is determined by the difference of the second angle.

[0255] In another possible implementation, regarding the determination of the second attitude based on the first information, the second information, the third information, and the fourth information, the second determining unit is specifically configured to:

[0256] For the left and right directions, the second position in the second posture is determined based on the first position in the first posture and the first coordinate, and the second placement angle in the second posture is determined based on the first placement angle in the first posture and the first angle.

[0257] For the vertical direction, the second position in the second posture is determined based on the first position in the first posture and the third coordinate, and the second placement angle in the second posture is determined based on the first placement angle in the first posture and the second angle.

[0258] For the forward and backward directions, the second position in the second posture is determined based on the first position in the first posture and the fifth coordinate, wherein the fifth coordinate is the smaller value of the second coordinate and the fourth coordinate.

[0259] It should be noted that, in the embodiments of this application, the specific implementation and technical effects of each unit can also be referred to accordingly. Figure 2 The corresponding description of the method embodiments.

[0260] Please see Figure 9 , Figure 9 This application provides a server 90, which includes a processor 901, a memory 902, and a communication interface 903. The processor 901, memory 902, and communication interface 903 are interconnected via a bus.

[0261] Processor 901 can be one or more central processing units (CPUs). If processor 901 is a CPU, the CPU can be a single-core CPU or a multi-core CPU.

[0262] The memory 902 includes, but is not limited to, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or compact disc read-only memory (CD-ROM), which is used for related computer programs and data.

[0263] The communication interface 903 is used to receive and send data. For example, the communication interface 903 can acquire image information and send the image information to the processor 901; the communication interface 903 can also receive target instructions from the processor 901 and send the target instructions to the terminal device.

[0264] Processor 901 is used to read the computer program code stored in memory 902 and perform the following operations:

[0265] Acquire first image information and second image information, wherein the first image information includes image information of the area where the smart camera is located, and the second image information is image information captured when the smart camera is in a first posture, the first posture including the current first position and first placement angle of the smart camera; the second area captured by the second image information is a part of the first area captured by the first image information; the smart camera can rotate and capture within a preset shooting angle range after fixing the placement angle.

[0266] A third image is generated based on the first image information and the second image information, wherein the third image information includes the second image information and the fourth image information, the fourth image information is the image information of the third region in the first image information, and the third region is the part of the first region excluding the second region;

[0267] Send the third image information to the terminal device;

[0268] The terminal device sends a selection operation for the fifth image information in the third image information, wherein the fifth image information is image information for a target area;

[0269] It was determined that the target region and the third region overlapped;

[0270] A second posture is determined based on the target area so that the smart camera can capture image information of the target area in the second posture, wherein the second posture includes a second position and a second placement angle;

[0271] A target instruction is sent to the terminal device, wherein the target instruction is used to instruct the terminal device to output a prompt message, and the prompt message is used to prompt the user to adjust the smart camera to the second posture.

[0272] In one possible implementation, the third image information is image information obtained by stitching together the second image information and the fourth image information.

[0273] In another possible implementation, the target region corresponds to a leftmost rotation angle, a rightmost rotation angle, a topmost rotation angle, and a bottommost rotation angle; in determining the second pose based on the target region, the processor 901 is specifically used for:

[0274] A first shooting angle is determined based on the leftmost rotation angle and the rightmost rotation angle, wherein the first shooting angle is the maximum shooting angle for the target area in the left and right direction;

[0275] The second shooting angle is determined based on the uppermost rotation angle and the lowermost rotation angle, wherein the second shooting angle is the maximum shooting angle for the target area in the vertical direction;

[0276] The first information of the second position relative to the first position and the second information of the second placement angle relative to the first placement angle are determined based on the first shooting angle and the third shooting angle, wherein the third shooting angle is the maximum shooting angle in the left and right direction when the smart camera is in the first posture.

[0277] The third information of the second position relative to the first position and the fourth information of the second placement angle relative to the first placement angle are determined based on the second shooting angle and the fourth shooting angle, wherein the fourth shooting angle is the maximum shooting angle of the smart camera in the vertical direction.

[0278] The second posture is determined based on the first information, the second information, the third information, and the fourth information.

[0279] In another possible implementation, the first posture includes a first position relative to the left-right direction, the up-down direction, and the front-back direction, and a first placement angle relative to the left-right direction and the up-down direction, respectively; the second posture includes a second position relative to the left-right direction, the up-down direction, and the front-back direction, and a second placement angle relative to the left-right direction and the up-down direction, respectively.

[0280] The first information includes a first coordinate and a second coordinate, the second information includes a first angle, the third information includes the third coordinate and a fourth coordinate, and the fourth information includes the second angle;

[0281] Wherein, the first coordinate is used to represent the relative distance between the second position and the first position in the left-right direction, the third coordinate is used to represent the relative distance between the second position and the first position in the up-down direction, and the second coordinate and the fourth coordinate are both used to represent the relative distance between the second position and the first position in the front-back direction; the first angle is used to represent the relative angle between the second placement angle and the first placement angle in the left-right direction, and the second angle is used to represent the relative angle between the second placement angle and the first placement angle in the up-down direction.

[0282] In another possible implementation, regarding determining the first information about the second position relative to the first position in the left-right direction and the second information about the second placement angle relative to the first placement angle based on the first shooting angle and the third shooting angle, the processor 901 is specifically configured to:

[0283] When the first shooting angle is less than or equal to the third shooting angle:

[0284] The first coordinate and the second coordinate are both set to zero and the first angle is set to the first deviation angle, or the second coordinate and the first angle are both set to zero and the first coordinate is set to the first distance value, wherein the first deviation angle is the angle by which the first shooting angle deviates from the third shooting angle, the first distance value is a non-zero value, and the first distance value is determined by the first deviation angle.

[0285] When the first shooting angle is larger than the third shooting angle:

[0286] If there is a non-overlapping view between the first shooting view and the third shooting view, then the first coordinate is determined to be zero, the second coordinate is determined to be the second distance value, and the first angle is determined to be the first deviation angle, wherein the second distance value is a non-zero value, and the second distance value is determined by the first angle difference between the first shooting view and the third shooting view.

[0287] If there is no non-overlapping view between the first shooting view and the third shooting view, then the first coordinate and the first angle are both determined to be zero, and the second coordinate is determined to be the third distance value, wherein the third distance value is a non-zero value and is determined by the difference in the first angle.

[0288] In another possible implementation, in determining, based on the second shooting angle and the fourth shooting angle, the processor 901 is specifically configured to:

[0289] When the second shooting angle is less than or equal to the fourth shooting angle:

[0290] The third coordinate and the fourth coordinate are both set to zero and the second angle is set to the second deviation angle, or the fourth coordinate and the second angle are both set to zero and the third coordinate is set to the fourth distance value, wherein the second deviation angle is the angle by which the second shooting angle deviates from the fourth shooting angle, the fourth distance value is a non-zero value, and the fourth distance value is determined by the second deviation angle;

[0291] When the second shooting angle is larger than the fourth shooting angle:

[0292] If there is a non-overlapping view between the second shooting view and the fourth shooting view, then the third coordinate is determined to be zero, the fourth coordinate is determined to be the fifth distance value, and the second angle is determined to be the second deviation angle, wherein the fifth distance value is a non-zero value, and the fifth distance value is determined by the second angle difference between the second shooting view and the fourth shooting view;

[0293] If there is no non-overlapping view between the second shooting view and the fourth shooting view, then the third coordinate and the second angle are both determined to be zero, and the fourth coordinate is determined to be the sixth distance value, wherein the sixth distance value is a non-zero value and is determined by the difference of the second angle.

[0294] In yet another possible implementation, in determining the second pose based on the first information, the second information, the third information, and the fourth information, the processor 901 is specifically configured to:

[0295] For the left and right directions, the second position in the second posture is determined based on the first position in the first posture and the first coordinate, and the second placement angle in the second posture is determined based on the first placement angle in the first posture and the first angle.

[0296] For the vertical direction, the second position in the second posture is determined based on the first position in the first posture and the third coordinate, and the second placement angle in the second posture is determined based on the first placement angle in the first posture and the second angle.

[0297] For the forward and backward directions, the second position in the second posture is determined based on the first position in the first posture and the fifth coordinate, wherein the fifth coordinate is the smaller value of the second coordinate and the fourth coordinate.

[0298] It should be noted that the implementation of each operation can also be referred to accordingly. Figure 2 The corresponding description of the method embodiments.

[0299] This application also provides a computer-readable storage medium storing a computer program that, when run on a processor... Figure 2 The method flow shown is thus implemented.

[0300] In this application, the term "multiple" in the embodiments refers to two or more objects, and "and / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent three situations: A existing alone, A and B existing simultaneously, and B existing alone. A and B can be singular or plural. Furthermore, unless otherwise stated, the use of ordinal numbers such as "first" and "second" in the embodiments of this application is for distinguishing multiple objects and is not used to limit the order, timing, priority, or importance of multiple objects. For example, "first image information" and "second image information" are only used to distinguish different image information and do not indicate differences in timing, importance, etc., between the two types of image information.

[0301] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An image information processing method, characterized in that, Applied to a server, the method includes: The system acquires first image information and second image information, wherein the first image information includes image information of the area where the smart camera is located, and the second image information is image information captured when the smart camera is in a first posture, the first posture including the current first position and first placement angle of the smart camera; the area corresponding to the first image information is a first region, the area corresponding to the second image information is a second region, and the second region is a part of the first region; the smart camera can rotate and capture images within a preset shooting angle range. A third image is generated based on the first image information and the second image information, wherein the third image information includes a fourth image information and the second image information, the fourth image information is the image information of the third region in the first image information, and the third region is the part of the first region excluding the second region; Send the third image information to the terminal device; The terminal device sends a selection operation for the fifth image information in the third image information, wherein the fifth image information is image information for one or more target areas; It is determined that the one or more target regions overlap with the third region; A second pose is determined based on the one or more target areas, so that the smart camera can capture image information of at least one target area in the second pose. The first image information is image information pre-stored by the server; the third image information is image information obtained by stitching together the second image information and the fourth image information.

2. The method according to claim 1, characterized in that, The one or more target regions correspond to the leftmost rotation angle, the rightmost rotation angle, the topmost rotation angle, and the bottommost rotation angle; Determining the second pose based on the one or more target regions includes: A first shooting angle is determined based on the leftmost rotation angle and the rightmost rotation angle, wherein the first shooting angle is the maximum shooting angle for the one or more target areas in the left and right direction; A second shooting angle is determined based on the uppermost rotation angle and the lowermost rotation angle, wherein the second shooting angle is the maximum shooting angle in the vertical direction for the one or more target areas; The first information of the second position relative to the first position and the second information of the second placement angle relative to the first placement angle are determined based on the first shooting angle and the third shooting angle, wherein the third shooting angle is the maximum shooting angle in the left and right direction when the smart camera is in the first posture. The third information of the second position relative to the first position and the fourth information of the second placement angle relative to the first placement angle are determined based on the second shooting angle and the fourth shooting angle, wherein the fourth shooting angle is the maximum shooting angle of the smart camera in the vertical direction. The second posture is determined based on the first information, the second information, the third information, and the fourth information.

3. The method according to claim 2, characterized in that: The first posture includes a first position in the left-right direction, a first position in the up-down direction, and a first position in the front-back direction, as well as a first placement angle in the left-right direction and a first placement angle in the up-down direction; the second posture includes a second position in the left-right direction, a second position in the up-down direction, and a second position in the front-back direction, as well as a second placement angle in the left-right direction and a second placement angle in the up-down direction. The first information includes a first coordinate and a second coordinate, the second information includes a first angle, the third information includes a third coordinate and a fourth coordinate, and the fourth information includes a second angle; Wherein, the first coordinate is used to represent the relative distance between the second position and the first position in the left-right direction, the third coordinate is used to represent the relative distance between the second position and the first position in the up-down direction, and the second coordinate and the fourth coordinate are both used to represent the relative distance between the second position and the first position in the front-back direction; the first angle is used to represent the relative angle between the second placement angle and the first placement angle in the left-right direction, and the second angle is used to represent the relative angle between the second placement angle and the first placement angle in the up-down direction.

4. The method according to claim 3, characterized in that, The step of determining, based on the first shooting angle and the third shooting angle, the first information of the second position relative to the first position in the left-right direction and the second information of the second placement angle relative to the first placement angle, includes: When the first shooting angle is less than or equal to the third shooting angle: The first coordinate and the second coordinate are both set to zero and the first angle is set to the first deviation angle, or the second coordinate and the first angle are both set to zero and the first coordinate is set to the first distance value, wherein the first deviation angle is the angle by which the first shooting angle deviates from the third shooting angle, the first distance value is a non-zero value, and the first distance value is determined by the first deviation angle. When the first shooting angle is larger than the third shooting angle: If there is a non-overlapping view between the first shooting view and the third shooting view, then the first coordinate is determined to be zero, the second coordinate is determined to be the second distance value, and the first angle is determined to be the first deviation angle, wherein the second distance value is a non-zero value, and the second distance value is determined by the first angle difference between the first shooting view and the third shooting view. If there is no non-overlapping view between the first shooting view and the third shooting view, then the first coordinate and the first angle are both determined to be zero, and the second coordinate is determined to be the third distance value, wherein the third distance value is a non-zero value and is determined by the difference in the first angle.

5. The method according to claim 4, characterized in that, The step of determining, based on the second shooting angle and the fourth shooting angle, the third information of the second position relative to the first position in the vertical direction and the fourth information of the second placement angle relative to the first placement angle, includes: When the second shooting angle is less than or equal to the fourth shooting angle: The third coordinate and the fourth coordinate are both set to zero and the second angle is set to the second deviation angle, or the fourth coordinate and the second angle are both set to zero and the third coordinate is set to the fourth distance value, wherein the second deviation angle is the angle by which the second shooting angle deviates from the fourth shooting angle, the fourth distance value is a non-zero value, and the fourth distance value is determined by the second deviation angle; When the second shooting angle is larger than the fourth shooting angle: If there is a non-overlapping view between the second shooting view and the fourth shooting view, then the third coordinate is determined to be zero, the fourth coordinate is determined to be the fifth distance value, and the second angle is determined to be the second deviation angle, wherein the fifth distance value is a non-zero value, and the fifth distance value is determined by the second angle difference between the second shooting view and the fourth shooting view; If there is no non-overlapping view between the second shooting view and the fourth shooting view, then the third coordinate and the second angle are both determined to be zero, and the fourth coordinate is determined to be the sixth distance value, wherein the sixth distance value is a non-zero value and is determined by the difference of the second angle.

6. The method according to claim 5, characterized in that, Determining the second posture based on the first information, the second information, the third information, and the fourth information includes: For the left and right directions, the second position in the second posture is determined based on the first position in the first posture and the first coordinate, and the second placement angle in the second posture is determined based on the first placement angle in the first posture and the first angle. For the vertical direction, the second position in the second posture is determined based on the first position in the first posture and the third coordinate, and the second placement angle in the second posture is determined based on the first placement angle in the first posture and the second angle. For the forward and backward directions, the second position in the second posture is determined based on the first position in the first posture and the fifth coordinate, wherein the fifth coordinate is the smaller value of the second coordinate and the fourth coordinate.

7. An image information processing method, characterized in that, Applied to a terminal device, the method includes: The system acquires third image information sent by the server. This third image information is generated based on first and second image information. The first image information includes image information of the area where the smart camera is located. The second image information is image information captured when the smart camera is in a first posture, which includes the current first position and first placement angle of the smart camera. The area corresponding to the first image information is a first region, and the area corresponding to the second image information is a second region, which is a part of the first region. The smart camera can rotate and capture images within a preset shooting angle range. The third image information includes second and fourth image information, where the fourth image information is the image information of the first image information for the third region, and the third region is the part of the first region excluding the second region. In response to the user's operation command, a selection operation for the fifth image information in the third image information is sent to the server, wherein the fifth image information is image information for one or more target areas; In response to the target instruction sent by the server, a prompt message is output, wherein the prompt message is used to prompt the user to adjust the smart camera to a second posture so that the smart camera can capture image information of at least one target area in the second posture; The first image information is image information pre-stored by the server; the third image information is image information obtained by stitching together the second image information and the fourth image information.

8. A server, characterized in that, The method includes a processor, a memory, and a communication interface, wherein the communication interface is used to perform receiving and / or sending operations under the control of the processor, the memory is used to store a computer program, and the processor is used to call the computer program to implement the method according to any one of claims 1-6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when run on a processor, implements the method described in any one of claims 1-6.

Images