A real-time monitoring method for agricultural information based on remote monitoring
By introducing resolution adjustment functions of user terminals and camera devices into the agricultural information monitoring system, the problem that existing systems cannot flexibly adjust resolutions is solved, and efficient and low-cost agricultural information monitoring is achieved.
Patent Information
- Application Number
- CN202410182629.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-02-19
- Publication Date
- 2025-04-22
- Estimated Expiration
- 2044-02-19
AI Technical Summary
The existing agricultural information monitoring system cannot flexibly adjust the resolution, resulting in a surge in monitoring costs, large storage demand, and interference with monitoring personnel.
By setting the reaction time and initial resolution by the user terminal, the camera device divides the crop image information into multiple image segments, and recodes and sends image frames according to the resolution adjustment command of the user terminal. The user terminal can select specific image frames in the new interface for high-resolution viewing.
The function of flexible resolution adjustment is realized, reducing monitoring costs, reducing storage needs, avoiding interference to monitoring personnel, and improving the efficiency and accuracy of agricultural information monitoring.
Smart Images

Figure CN118055268B_ABST
Abstract
Description
Technical Field
[0001] The invention relates to the technical field of image transmission, and in particular to a real-time monitoring method of agricultural information based on remote monitoring. Background Art
[0002] Agricultural information includes plant growth information and pest information. Currently, agricultural information is mainly collected through video surveillance. The specific method is as follows: first, the agricultural research department installs surveillance cameras in a specific area, and then the surveillance cameras send the acquired surveillance videos to the researchers' terminals (the terminals can be mobile terminals or desktop computers). The researchers determine the plant growth conditions or whether the plants are suffering from pests and diseases by watching the surveillance images. During the research process, we found that the existing system has the problem of not being able to easily adjust the resolution. Summary of the invention
[0003] To achieve the above object, the present invention provides a method for real-time monitoring of agricultural information based on remote monitoring, comprising:
[0004] The user terminal sets the response time and the first resolution;
[0005] The user terminal sends the response time and the first resolution to the camera device;
[0006] Acquiring crop image information by a camera device, wherein the crop image information includes a plurality of image frames associated with the crops;
[0007] The camera device divides the crop image information into a plurality of image segments based on the reaction time, wherein the plurality of image segments include a first image segment and a second image segment, wherein the first image segment includes a plurality of image frames associated with the crop, and the second image segment includes a plurality of image frames associated with the crop;
[0008] encoding, by the camera device, image frames in the first image segment according to a first resolution;
[0009] The camera device sends the encoded image frames in the first image segment to the user terminal, wherein the encoded image frames in the first image segment each include an identifier of the first image segment and an identifier of the image frame;
[0010] The user terminal plays the image frames in the first image segment to the user.
[0011] Further, preferably, the method further comprises:
[0012] In the process of the user terminal playing the first image segment to the user, the user terminal receives a first resolution adjustment instruction triggered by the user, wherein the first resolution adjustment instruction indicates adjusting the first resolution to the second resolution;
[0013] The user terminal determines whether the first resolution is higher than the second resolution;
[0014] If the user terminal determines that the first resolution is higher than the second resolution, the user terminal continues to play the image frames in the first image segment, and the user terminal sends the second resolution to the camera device;
[0015] After the camera receives the second resolution, the camera encodes the image frames in the first image segment or the image frames in the second image segment according to the second resolution.
[0016] Further, preferably, the method further comprises:
[0017] In the process of the user terminal playing the first image segment to the user, the user terminal receives a second resolution adjustment instruction triggered by the user, wherein the second resolution adjustment instruction indicates adjusting the first resolution to a third resolution;
[0018] The user terminal determines whether the first resolution is higher than the third resolution;
[0019] If the user terminal determines that the first resolution is lower than the third resolution, the user terminal pauses playing the image frames in the first image segment;
[0020] After the user terminal pauses playing the image frames in the first image segment, the user terminal displays all the image frames in the first image segment that have been played to the user in a new interface;
[0021] After the user terminal displays all the image frames in the first image segment that have been played to the user in the new interface, the user terminal receives an image frame selection instruction from the user, wherein the image frame selection instruction indicates that the user has selected one or more image frames from all the displayed image frames in the first image segment that have been played;
[0022] The user terminal sends a resolution adjustment command to the camera device, wherein the resolution adjustment command includes an identifier of the first image segment, an identifier of one or more selected image frames, and a third resolution.
[0023] Further, preferably, the method further comprises:
[0024] After the camera device receives the resolution adjustment command, the camera device determines, based on the identifier of the first image segment and the identifier of the selected one or more image frames, one or more image frames of which resolution is to be adjusted;
[0025] encoding, by the camera device, one or more image frames to be adjusted in resolution according to a third resolution;
[0026] The camera device sends the encoded one or more image frames with adjusted resolution to the user terminal, wherein the encoded one or more image frames with adjusted resolution each include an identifier of the first image segment and an identifier of the image frame;
[0027] The user terminal displays one or more image frames with adjusted resolution to the user in a new interface.
[0028] Further, preferably, the method further comprises:
[0029] After the user terminal displays one or more image frames with adjusted resolutions to the user in the new interface, the user terminal provides an option box to the user, wherein the option box provides the user with a first option and a second option;
[0030] If the user selects the first option, the user terminal sends the third resolution to the camera device;
[0031] After the camera device receives the third resolution, the camera device encodes the image frame in the first image segment or the image frame in the second image segment according to the third resolution;
[0032] The camera device sends the image frame in the first image segment or the image frame in the second image segment encoded according to the third resolution to the user terminal;
[0033] The user terminal plays the image frames in the first image segment or the image frames in the second image segment to the user.
[0034] Further, preferably, the method further comprises:
[0035] If the user selects the second option, the user terminal continues to play the image frames in the first image segment, and the user terminal notifies the camera device to continue to use the first resolution;
[0036] The method further includes:
[0037] The camera device determines the image segment storage period based on the reaction time;
[0038] If the current time exceeds the image segment saving period, all image frames in the first image segment are deleted by the camera apparatus.
[0039] The present invention also provides a real-time monitoring system for agricultural information based on remote monitoring, which includes modules for performing the following operations:
[0040] The user terminal sets the response time and the first resolution;
[0041] The user terminal sends the response time and the first resolution to the camera device;
[0042] Acquiring crop image information by a camera device, wherein the crop image information includes a plurality of image frames associated with the crops;
[0043] The camera device divides the crop image information into a plurality of image segments based on the reaction time, wherein the plurality of image segments include a first image segment and a second image segment, wherein the first image segment includes a plurality of image frames associated with the crop, and the second image segment includes a plurality of image frames associated with the crop;
[0044] encoding, by the camera device, image frames in the first image segment according to a first resolution;
[0045] The camera device sends the encoded image frames in the first image segment to the user terminal, wherein the encoded image frames in the first image segment each include an identifier of the first image segment and an identifier of the image frame;
[0046] The user terminal plays the image frames in the first image segment to the user.
[0047] Further, preferably, the system also includes a module for performing the following operations:
[0048] In the process of the user terminal playing the first image segment to the user, the user terminal receives a first resolution adjustment instruction triggered by the user, wherein the first resolution adjustment instruction indicates adjusting the first resolution to the second resolution;
[0049] The user terminal determines whether the first resolution is higher than the second resolution;
[0050] If the user terminal determines that the first resolution is higher than the second resolution, the user terminal continues to play the image frames in the first image segment, and the user terminal sends the second resolution to the camera device;
[0051] After the camera receives the second resolution, the camera encodes the image frames in the first image segment or the image frames in the second image segment according to the second resolution.
[0052] Further, preferably, the system also includes a module for performing the following operations:
[0053] In the process of the user terminal playing the first image segment to the user, the user terminal receives a second resolution adjustment instruction triggered by the user, wherein the second resolution adjustment instruction indicates adjusting the first resolution to a third resolution;
[0054] The user terminal determines whether the first resolution is higher than the third resolution;
[0055] If the user terminal determines that the first resolution is lower than the third resolution, the user terminal pauses playing the image frames in the first image segment;
[0056] After the user terminal pauses playing the image frames in the first image segment, the user terminal displays all the image frames in the first image segment that have been played to the user in a new interface;
[0057] After the user terminal displays all the image frames in the first image segment that have been played to the user in the new interface, the user terminal receives an image frame selection instruction from the user, wherein the image frame selection instruction indicates that the user has selected one or more image frames from all the displayed image frames in the first image segment that have been played;
[0058] The user terminal sends a resolution adjustment command to the camera device, wherein the resolution adjustment command includes an identifier of the first image segment, an identifier of one or more selected image frames, and a third resolution.
[0059] Further, preferably, the system also includes a module for performing the following operations:
[0060] After the camera device receives the resolution adjustment command, the camera device determines, based on the identifier of the first image segment and the identifier of the selected one or more image frames, one or more image frames of which resolution is to be adjusted;
[0061] encoding, by the camera device, one or more image frames to be adjusted in resolution according to a third resolution;
[0062] The camera device sends the encoded one or more image frames with adjusted resolution to the user terminal, wherein the encoded one or more image frames with adjusted resolution each include an identifier of the first image segment and an identifier of the image frame;
[0063] The user terminal displays one or more image frames with adjusted resolution to the user in a new interface.
[0064] Compared with the prior art, the real-time monitoring method of agricultural information based on remote monitoring of the present invention has the following beneficial effects:
[0065] The current system cannot provide a function of flexibly adjusting the resolution, and the technology for adjusting the resolution in the prior art will lead to a surge in monitoring costs. In addition, the technology for adjusting the resolution in the prior art requires a large storage space, and the existing technology for adjusting the resolution will interfere with agricultural monitoring personnel. In order to solve the problems of the prior art, the present invention provides a corresponding solution. BRIEF DESCRIPTION OF THE DRAWINGS
[0066] Figure 1 It is a schematic diagram of the system architecture of the prior art.
[0067] Figure 2 It is a method flow chart of an embodiment of the present invention.
[0068] Figure 3 It is a schematic diagram of an interface of an embodiment of the present invention.
[0069] Figure 4 It is a schematic diagram of another interface of an embodiment of the present invention.
[0070] Figure 5 It is a schematic diagram of another interface of an embodiment of the present invention. DETAILED DESCRIPTION
[0071] The specific implementation modes of the present invention are described in detail below in conjunction with the accompanying drawings, but it should be understood that the protection scope of the present invention is not limited by the specific implementation modes.
[0072] During the research process, we found that the existing system has the problem of not being able to conveniently adjust the resolution (it should be understood that in the present invention, resolution refers to both the video resolution and the resolution of each frame of the video. In the full text of the present invention, the two are no longer distinguished). Currently, the common resolution adjustment method is widely used in various video playback apps (for example, Youku, Tencent Video, Bilibili, etc.). Taking Bilibili APP as an example, the software provides users with multiple resolutions such as 360P, 480P, 720P, and 1080P. If the user selects 480P resolution, the server encodes the image frames in the video stored in the server at a resolution of 480P, and then the server sends the encoded image data to the terminal, and then the terminal decodes the image data, thereby displaying 480P continuous image frames (that is, video) to the user. Subsequently, for example, in order to improve the video quality, the user may switch the resolution to 1080P, then the terminal sends the resolution switching instruction to the server, and then the server encodes the image frames in the subsequent video at a resolution of 1080P, and then the server sends the image frames encoded at a resolution of 1080P to the terminal, thereby completing the resolution switching. If the user wants to watch the previously played video at a resolution of 1080P, the terminal will request the server to re-encode the image frames previously encoded at a resolution of 480P at a resolution of 1080P, and then the server will send these re-encoded image frames to the terminal, thereby completing the playback of the previously played video at a resolution of 1080P. This resolution switching mode is not flexible enough for agricultural monitoring, and the specific analysis is as follows: the purpose of agricultural researchers watching monitoring videos is different from that of ordinary users watching videos provided by Bilibili. The main purpose of ordinary users watching videos is entertainment and relaxation, so ordinary users do not pay attention to a certain frame or several frames of images in the video, so it is appropriate for ordinary users to drag the progress bar to achieve a high-resolution playback of previously played videos. However, the purpose of agricultural researchers watching monitoring videos is to monitor whether plants are suffering from pests and diseases (of course, it can also monitor plant growth). The current way of playing videos for monitoring plants is that the terminal plays the monitoring images of multiple monitoring cameras in turn (the angle of each monitoring camera is also adjusted at any time to ensure that one camera can monitor plant growth more comprehensively). Therefore, if agricultural researchers also watch the previously played videos by dragging the progress bar, it will cause the agricultural researchers to be unable to accurately obtain the information they are interested in. For example, when watching the monitoring video, agricultural researchers may suddenly find that the leaves of plant A in the video show the characteristics of suffering from pests and diseases, but because the resolution of the current video is low, the researchers need to carefully review the monitoring images of the leaves of plant A at a higher resolution.If the previously played video is reviewed at a higher resolution by dragging the progress bar, since it is impossible for researchers to accurately drag the progress bar to the frame image of the leaf of plant A, researchers need to request to replay the earlier video at a higher resolution as much as possible. This operation causes the camera device to retransmit a large number of image frames, and most of these retransmitted image frames are useless information. For agricultural monitoring, a terminal may need to control hundreds of cameras. If these cameras retransmit high-resolution videos in this way, this will lead to a surge in monitoring costs. In addition, the method of dragging the progress bar to review the previously played video at a higher resolution requires the video provider to store the entire video. For large video providers such as Bilibili, it is feasible to invest a lot of money to upgrade equipment to store massive videos, but for agricultural monitoring, it is difficult to require each camera device to store a large amount of video information. In addition, repeatedly playing a large amount of video information that is not related to the leaves of plant A will also interfere with researchers. It should be understood that most of the images captured by the plant monitoring video are of the plant itself. In the replayed video, the monitoring image of plant B, which is the same as plant A, may be played first, but the leaves of plant B may be normal (i.e., not showing the characteristics of suffering from pests and diseases). However, since plant B is the same as plant A, it is difficult for researchers to distinguish whether plant B is plant A with pests and diseases. Researchers may even mistake the monitoring video of plant B for the monitoring video of plant A, thereby missing the agricultural situation of plant A with pests and diseases. Therefore, repeatedly playing a large amount of video information that is not related to the leaves of plant A will interfere with researchers. The technology provided by the present invention is intended to solve the defects of the prior art.
[0073] Figure 1 As shown in the figure, the agricultural monitoring system in the prior art may include a user terminal and multiple camera devices, and the multiple camera devices may transmit the captured video images to the user terminal, and the user terminal may play the monitoring videos transmitted by these camera devices in turn.
[0074] Example 1
[0075] Figure 2 1 is a method flow chart of an embodiment of the present invention. As shown in the figure, the real-time monitoring method of agricultural information based on remote monitoring of the present invention includes the following steps:
[0076] Step 1: The user terminal sets the reaction time and the first resolution; in one example, the first resolution may be 360P; the reaction time refers to the time from when the researcher sees the image frame of interest to when he decides to adjust the resolution, and this time period may be set based on experience, for example, the reaction time may be 2 seconds, 3 seconds, 4 seconds, 5 seconds, etc.; the role of the reaction time is further described below; in addition, it should be understood that the purpose of agricultural monitoring is to discover pests and diseases, rather than to provide entertainment, so the user terminal of the present invention may play the video at a lower frame rate;
[0077] Step 2: The user terminal sends the response time and the first resolution to the camera device;
[0078] Step 3: acquiring crop image information by a camera device, wherein the crop image information includes a plurality of image frames associated with the crops;
[0079] Step 4: The camera device divides the crop image information into a plurality of image segments based on the reaction time, wherein the plurality of image segments include a first image segment and a second image segment, wherein the first image segment includes a plurality of image frames associated with the crop, and the second image segment includes a plurality of image frames associated with the crop; in an example, the playback frame rate set by the user terminal is 10 frames per second, then the camera device can also capture the crop image at a rate of 10 frames per second; assuming that the camera device has shot a time frequency of 12 seconds at this time, 120 frames of images are currently stored in the camera device, and assuming that the reaction time is 3 seconds, then the 120 frames of images can be divided into 4 image segments, each image segment has 30 frames of images, and each image segment takes 3 seconds to play at the user terminal; those skilled in the art can understand that, although the crop image information can be divided into a plurality of image segments, for the purpose of introducing the technology of the present invention, the present invention only introduces the first image segment and the second image segment, and the processing of other segments can refer to the first image segment and the second image segment;
[0080] Step 5: The camera device encodes the image frames in the first image segment according to the first resolution; continuing with the above example, the first image segment includes 30 frames of images, and the camera device encodes the 30 frames of images according to the resolution of 360P;
[0081] Step 6: The camera device sends the encoded image frames in the first image segment to the user terminal, wherein the encoded image frames in the first image segment all include an identifier of the first image segment and an identifier of the image frame; in an example, the identifier of the first image segment and the identifier of the image frame may be located in the header of the data packet of each frame of the image, the identifier of the image segment may be a separate field, and the identifier of the image frame may be another separate field, and the identifier of the image segment may be a natural number 1, 2, 3, 4, etc. (of course, it needs to be converted into a binary number during encoding), for example, the identifier of the first image segment is 1, (continuing the previous example, there are 30 frames of images in one image segment) and the identifier of the image frame may also be a corresponding natural number 1-30;
[0082] Step 7: The user terminal plays the image frames in the first image segment to the user. Those skilled in the art will appreciate that the user terminal needs to decode the image frames transmitted by the camera device, and then the user terminal can play the image frames in the first image segment (ie, a surveillance video).
[0083] Example 2
[0084] In Example 2, the real-time monitoring method of agricultural information based on remote monitoring also includes:
[0085] In the process of the user terminal playing the first image segment to the user, the user terminal receives a first resolution adjustment instruction triggered by the user, wherein the first resolution adjustment instruction indicates adjusting the first resolution to the second resolution;
[0086] The user terminal determines whether the first resolution is higher than the second resolution;
[0087] If the user terminal determines that the first resolution is higher than the second resolution, the user terminal continues to play the image frames in the first image segment, and sends the second resolution to the camera device; in an example, the second resolution is, for example, 240P. At this time, the user terminal determines that the first resolution is higher than the second resolution, which means that the researchers may not see any interesting content in this section of monitoring video (that is, no pests and diseases are found, and the plants are growing well). At this time, the researchers may want to further reduce the resolution to save transmission overhead; at this time, the user terminal can continue to play the image frames in the first image segment (that is, continue to play the video). It should be understood by those skilled in the art that the video that continues to be played may be the image frames that the user terminal has received from the camera device, so the resolution of this section of the video that continues to be played may still be 360P (this is similar to the situation of current video software);
[0088] After the camera receives the second resolution, the camera encodes the image frames in the first image segment or the image frames in the second image segment according to the second resolution. In one example, when the camera receives the second resolution, the camera may not have completed encoding the image frames in the first image segment, so the camera may encode the (remaining unencoded) image frames in the first image segment according to the second resolution, and when the camera receives the second resolution, the camera may have completed encoding the image frames in the first image segment, so the camera may encode the image frames in the second image segment according to the second resolution.
[0089] Example 3
[0090] In Example 3, the real-time monitoring method of agricultural information based on remote monitoring also includes:
[0091] In the process of the user terminal playing the first image segment to the user, the user terminal receives a second resolution adjustment instruction triggered by the user, wherein the second resolution adjustment instruction indicates to adjust the first resolution to a third resolution; for the convenience of subsequent discussion, it is assumed here that the user terminal has played the first image segment for 2 seconds, that is, the current user terminal has played 20 frames of images in the first image segment; when the user terminal has played the first image segment for 2 seconds, the researchers triggered the resolution adjustment instruction; for the specific interface, please refer to Figure 3 , wherein the display device of the user terminal can be a display of a desktop computer; the researcher can click on the resolution control below the video screen (shown as 360P in the figure), after which the resolution control can provide a drop-down menu, and the researcher can click on the desired resolution to complete the triggering of the resolution adjustment instruction;
[0092] The user terminal determines whether the first resolution is higher than the third resolution;
[0093] If the user terminal determines that the first resolution is lower than the third resolution, the user terminal pauses playing the image frames in the first image segment; in one example, the third resolution may be 720P; continuing with the above example, although there are still 10 frames in the first image segment that have not been played, the image that the researcher is interested in must appear in the first 20 frames, so the user terminal may pause playing the image frames (i.e., video) in the first image segment;
[0094] After the user terminal pauses playing the image frames in the first image segment, the user terminal displays all the image frames in the first image segment that have been played to the user in a new interface; continuing with the above example, the user terminal displays 20 frames of images in the first image segment that have been played to the user in a new interface; it should be understood by those skilled in the art that before the user terminal plays the first image segment, the user terminal may have played videos of other image segments, but here the user terminal only displays the image frames in the first image segment, and does not display the image frames that have been played in the previous image segment; the example of the user terminal displaying 20 frames of images in the first image segment that have been played to the user in a new interface can be seen in Figure 4 , It should be understood by those skilled in the art that due to the size of the drawings, Figure 4 Only the state where the display shows 9 frames of images is shown. When the present invention is actually implemented, all 20 frames of images need to be shown on the display;
[0095] After the user terminal displays all the image frames in the first image segment that have been played to the user in the new interface, the user terminal receives the user's image frame selection instruction, wherein the image frame selection instruction indicates that the user has selected one or more image frames among all the displayed image frames in the first image segment that have been played; in one example, the researcher can select a certain frame or several frames of images by clicking on the image frame on the display. For the convenience of discussion, this example assumes that the researcher selects the fourth and fifth frames of images by clicking; in this way, the present invention avoids the problem of watching the video back by dragging the progress bar, and the researcher can accurately locate the image of interest by checking the image frames that have been viewed one by one. For example, the fourth and fifth frames of images show the characteristics of the presence of pests and diseases in plant A, but due to the low current resolution, the researcher cannot accurately judge and determine what kind of pests and diseases plant A has, so the researcher only hopes to obtain clearer fourth and fifth frames of images. The present invention provides this possibility, thereby avoiding the problems existing in the prior art;
[0096] The user terminal sends a resolution adjustment command to the camera device, wherein the resolution adjustment command includes an identifier of the first image segment, an identifier of one or more selected image frames, and a third resolution. Continuing with the previous example, the resolution adjustment command includes an identifier "1" of the first image segment, an identifier of one or more selected image frames (i.e., an identifier "4" of the image frame of the fourth frame and an identifier "5" of the image frame of the fifth frame);
[0097] Example 4
[0098] In Example 4, the real-time monitoring method of agricultural information based on remote monitoring also includes:
[0099] After the camera device receives the resolution adjustment command, the camera device determines the one or more image frames whose resolutions are to be adjusted based on the identifier of the first image segment and the identifier of the selected one or more image frames; continuing with the previous example, the camera device can determine that the researcher only wants to review the high-resolution images of the fourth frame and the fifth frame based on the identifier "1" of the first image segment, the identifier "4" of the image frame of the fourth frame, and the identifier "5" of the image frame of the fifth frame in the resolution adjustment command, and at this time, the one or more image frames whose resolutions are to be adjusted refer to the fourth frame and the fifth frame of the first image segment;
[0100] The camera device encodes one or more image frames of which the resolution is to be adjusted according to the third resolution; that is, the camera device re-encodes the fourth frame and the fifth frame of the first image segment according to 720P;
[0101] The camera device sends the encoded one or more image frames with adjusted resolution to the user terminal, wherein the encoded one or more image frames with adjusted resolution each include an identifier of the first image segment and an identifier of the image frame;
[0102] The user terminal displays one or more image frames with adjusted resolution to the user in the new interface. After receiving the encoded one or more image frames with adjusted resolution (i.e., the fourth frame and the fifth frame of the first image segment encoded according to 720P), the user terminal may Figure 4 The 20 frames of images shown in are removed, and then the fourth and fifth frames of the first image segment of 720P are redisplayed.
[0103] Example 5
[0104] In Example 5, the real-time monitoring method of agricultural information based on remote monitoring also includes:
[0105] After the user terminal displays one or more image frames with adjusted resolution to the user in the new interface, the user terminal provides an option box to the user, wherein the option box provides the user with a first option and a second option; an example of the option box can be found in Figure 5 ; The option box provides two clickable options, namely, continue to use the original resolution (that is, continue to use 360P) and use the new resolution (that is, use 720P resolution); the "Close" button in the upper right corner of the option box is used to close the option box;
[0106] If the user selects the first option, the user terminal sends the third resolution to the camera device; continuing with the previous example, the researcher clicks to use the new resolution, that is, the researcher selects the first option; it should be understood by those skilled in the art that since the researcher hopes that subsequent videos will be played at 720P resolution, even if the user terminal has received and cached a portion of the image frames of the first image segment of 360P, the user terminal does not play these image frames of the first image segment of 360P, so at this time the user terminal is still in a paused playback state;
[0107] After the camera device receives the third resolution, the camera device encodes the image frames in the first image segment or the image frames in the second image segment according to the third resolution; continuing with the previous example, the user terminal notifies the camera device that the first 20 frames of the first image segment have been played at a resolution of 360P. At this time, although the camera device has encoded and sent the last 10 frames of the first image segment, the camera device still re-encodes the last 10 frames of the first image segment at a resolution of 720P; in another possibility, the user terminal has played all the first image segments, then the camera device encodes the image frames in the second image segment according to the third resolution;
[0108] The camera device sends the image frame in the first image segment or the image frame in the second image segment encoded according to the third resolution to the user terminal;
[0109] The user terminal plays the image frames in the first image segment or the image frames in the second image segment to the user.
[0110] Furthermore, the real-time monitoring method of agricultural information based on remote monitoring also includes:
[0111] If the user selects the second option, the user terminal continues to play the image frames in the first image segment, and the user terminal notifies the camera device to continue to use the first resolution;
[0112] Among them, the real-time monitoring method of agricultural information based on remote monitoring also includes:
[0113] The image segment storage period is determined by the camera device based on the reaction time; in one example, the image segment storage period can be the sum of the reaction time and a reasonable time length, and the reasonable time length is mainly the data transmission delay (including the retransmission time). Generally speaking, the data transmission delay of the equipment used in the agricultural monitoring field will not be greater than 10s, but considering special circumstances, the image segment storage period can be set to the reaction time + 60s;
[0114] If the current time exceeds the image segment saving period, all image frames in the first image segment are deleted by the camera apparatus.
[0115] Example 6
[0116] The present invention provides a real-time monitoring system for agricultural information based on remote monitoring, comprising modules for performing the following operations:
[0117] The user terminal sets the response time and the first resolution;
[0118] The user terminal sends the response time and the first resolution to the camera device;
[0119] Acquiring crop image information by a camera device, wherein the crop image information includes a plurality of image frames associated with the crops;
[0120] The camera device divides the crop image information into a plurality of image segments based on the reaction time, wherein the plurality of image segments include a first image segment and a second image segment, wherein the first image segment includes a plurality of image frames associated with the crop, and the second image segment includes a plurality of image frames associated with the crop;
[0121] encoding, by the camera device, image frames in the first image segment according to a first resolution;
[0122] The camera device sends the encoded image frames in the first image segment to the user terminal, wherein the encoded image frames in the first image segment each include an identifier of the first image segment and an identifier of the image frame;
[0123] The user terminal plays the image frames in the first image segment to the user.
[0124] Furthermore, the real-time monitoring system for agricultural information based on remote monitoring also includes modules for performing the following operations:
[0125] In the process of the user terminal playing the first image segment to the user, the user terminal receives a first resolution adjustment instruction triggered by the user, wherein the first resolution adjustment instruction indicates adjusting the first resolution to the second resolution;
[0126] The user terminal determines whether the first resolution is higher than the second resolution;
[0127] If the user terminal determines that the first resolution is higher than the second resolution, the user terminal continues to play the image frames in the first image segment, and the user terminal sends the second resolution to the camera device;
[0128] After the camera receives the second resolution, the camera encodes the image frames in the first image segment or the image frames in the second image segment according to the second resolution.
[0129] Furthermore, the real-time monitoring system for agricultural information based on remote monitoring also includes modules for performing the following operations:
[0130] In the process of the user terminal playing the first image segment to the user, the user terminal receives a second resolution adjustment instruction triggered by the user, wherein the second resolution adjustment instruction indicates adjusting the first resolution to a third resolution;
[0131] The user terminal determines whether the first resolution is higher than the third resolution;
[0132] If the user terminal determines that the first resolution is lower than the third resolution, the user terminal pauses playing the image frames in the first image segment;
[0133] After the user terminal pauses playing the image frames in the first image segment, the user terminal displays all the image frames in the first image segment that have been played to the user in a new interface;
[0134] After the user terminal displays all the image frames in the first image segment that have been played to the user in the new interface, the user terminal receives an image frame selection instruction from the user, wherein the image frame selection instruction indicates that the user has selected one or more image frames from all the displayed image frames in the first image segment that have been played;
[0135] The user terminal sends a resolution adjustment command to the camera device, wherein the resolution adjustment command includes an identifier of the first image segment, an identifier of one or more selected image frames, and a third resolution.
[0136] Furthermore, the real-time monitoring system for agricultural information based on remote monitoring also includes modules for performing the following operations:
[0137] After the camera device receives the resolution adjustment command, the camera device determines, based on the identifier of the first image segment and the identifier of the selected one or more image frames, one or more image frames of which resolution is to be adjusted;
[0138] encoding, by the camera device, one or more image frames to be adjusted in resolution according to a third resolution;
[0139] The camera device sends the encoded one or more image frames with adjusted resolution to the user terminal, wherein the encoded one or more image frames with adjusted resolution each include an identifier of the first image segment and an identifier of the image frame;
[0140] The user terminal displays one or more image frames with adjusted resolution to the user in a new interface.
[0141] The foregoing description of specific exemplary embodiments of the present invention is for the purpose of illustration and demonstration. These descriptions are not intended to limit the present invention to the precise form disclosed, and it is clear that many changes and variations can be made based on the above teachings. The purpose of selecting and describing the exemplary embodiments is to explain the specific principles of the present invention and its practical application, so that those skilled in the art can realize and utilize various different exemplary embodiments of the present invention and various different selections and changes. The scope of the present invention is intended to be limited by the claims and their equivalents.
Claims
1. A real-time monitoring method for agricultural information based on remote monitoring, characterized in that: The method comprises: The user terminal sets the response time and the first resolution; The user terminal sends the response time and the first resolution to the camera device; Acquiring crop image information by a camera device, wherein the crop image information includes a plurality of image frames associated with the crops; The camera device divides the crop image information into a plurality of image segments based on the reaction time, wherein the plurality of image segments include a first image segment and a second image segment, wherein the first image segment includes a plurality of image frames associated with the crop, and the second image segment includes a plurality of image frames associated with the crop; encoding, by a camera device, image frames in the first image segment according to the first resolution; The camera device sends the encoded image frames in the first image segment to the user terminal, wherein the encoded image frames in the first image segment each include an identifier of the first image segment and an identifier of the image frame; The user terminal plays the image frames in the first image segment to the user.
2. The method of claim 1, wherein: The method further comprises: In the process of the user terminal playing the first image segment to the user, the user terminal receives a first resolution adjustment instruction triggered by the user, wherein the first resolution adjustment instruction indicates adjusting the first resolution to a second resolution; Determining, by the user terminal, whether the first resolution is higher than the second resolution; If the user terminal determines that the first resolution is higher than the second resolution, the user terminal continues to play the image frames in the first image segment, and the user terminal sends the second resolution to the camera device; After the camera receives the second resolution, the camera encodes the image frames in the first image segment or the image frames in the second image segment according to the second resolution.
3. The method of claim 2, wherein: The method further comprises: In the process of the user terminal playing the first image segment to the user, the user terminal receives a second resolution adjustment instruction triggered by the user, wherein the second resolution adjustment instruction indicates adjusting the first resolution to a third resolution; Determining, by the user terminal, whether the first resolution is higher than the third resolution; If the user terminal determines that the first resolution is lower than the third resolution, the user terminal pauses playing the image frames in the first image segment; After the user terminal pauses playing the image frames in the first image segment, the user terminal displays all the image frames in the first image segment that have been played to the user in a new interface; After the user terminal displays all the image frames in the first image segment that have been played to the user in the new interface, the user terminal receives an image frame selection instruction from the user, wherein the image frame selection instruction indicates that the user has selected one or more image frames among all the displayed image frames in the first image segment that have been played; A resolution adjustment command is sent by a user terminal to the camera device, wherein the resolution adjustment command includes an identifier of the first image segment, an identifier of one or more selected image frames, and a third resolution.
4. The method of claim 3, wherein: The method further comprises: After the camera device receives the resolution adjustment command, the camera device determines, based on the identifier of the first image segment and the identifier of the selected one or more image frames, one or more image frames of which resolution is to be adjusted; The camera device encodes the one or more image frames whose resolution is to be adjusted according to the third resolution; The camera device sends the encoded one or more image frames with adjusted resolution to the user terminal, wherein the encoded one or more image frames with adjusted resolution each include an identifier of the first image segment and an identifier of the image frame; The user terminal displays one or more image frames with adjusted resolution to the user in the new interface.
5. The method of claim 4, wherein: The method further comprises: After the user terminal displays one or more image frames with adjusted resolutions to the user in the new interface, the user terminal provides an option box to the user, wherein the option box provides the user with a first option and a second option; If the user selects the first option, the user terminal sends the third resolution to the camera device; After the camera device receives the third resolution, the camera device encodes the image frame in the first image segment or the image frame in the second image segment according to the third resolution; The camera device sends the image frames in the first image segment or the image frames in the second image segment encoded according to the third resolution to the user terminal; The user terminal plays the image frames in the first image segment or the image frames in the second image segment to the user.
6. The method of claim 5, wherein: The method further comprises: If the user selects the second option, the user terminal continues to play the image frames in the first image segment, and the user terminal notifies the camera device to continue to use the first resolution; Wherein, the method further comprises: The camera device determines the image segment storage period based on the reaction time; If the current time exceeds the image segment saving period, all image frames in the first image segment are deleted by the camera device.
7. A real-time monitoring system for agricultural information based on remote monitoring, characterized in that: The system includes modules for performing the following operations: The user terminal sets the response time and the first resolution; The user terminal sends the response time and the first resolution to the camera device; Acquiring crop image information by a camera device, wherein the crop image information includes a plurality of image frames associated with the crops; The camera device divides the crop image information into a plurality of image segments based on the reaction time, wherein the plurality of image segments include a first image segment and a second image segment, wherein the first image segment includes a plurality of image frames associated with the crop, and the second image segment includes a plurality of image frames associated with the crop; encoding, by a camera device, image frames in the first image segment according to the first resolution; The camera device sends the encoded image frames in the first image segment to the user terminal, wherein the encoded image frames in the first image segment each include an identifier of the first image segment and an identifier of the image frame; The user terminal plays the image frames in the first image segment to the user.
8. The system of claim 7, wherein: The system also includes modules for performing the following operations: In the process of the user terminal playing the first image segment to the user, the user terminal receives a first resolution adjustment instruction triggered by the user, wherein the first resolution adjustment instruction indicates adjusting the first resolution to a second resolution; Determining, by the user terminal, whether the first resolution is higher than the second resolution; If the user terminal determines that the first resolution is higher than the second resolution, the user terminal continues to play the image frames in the first image segment, and the user terminal sends the second resolution to the camera device; After the camera receives the second resolution, the camera encodes the image frames in the first image segment or the image frames in the second image segment according to the second resolution.
9. The system of claim 8, wherein: The system also includes modules for performing the following operations: In the process of the user terminal playing the first image segment to the user, the user terminal receives a second resolution adjustment instruction triggered by the user, wherein the second resolution adjustment instruction indicates adjusting the first resolution to a third resolution; Determining, by the user terminal, whether the first resolution is higher than the third resolution; If the user terminal determines that the first resolution is lower than the third resolution, the user terminal pauses playing the image frames in the first image segment; After the user terminal pauses playing the image frames in the first image segment, the user terminal displays all the image frames in the first image segment that have been played to the user in a new interface; After the user terminal displays all the image frames in the first image segment that have been played to the user in the new interface, the user terminal receives an image frame selection instruction from the user, wherein the image frame selection instruction indicates that the user has selected one or more image frames among all the displayed image frames in the first image segment that have been played; A resolution adjustment command is sent by a user terminal to the camera device, wherein the resolution adjustment command includes an identifier of the first image segment, an identifier of one or more selected image frames, and a third resolution.
10. The system of claim 9, wherein: The system also includes modules for performing the following operations: After the camera device receives the resolution adjustment command, the camera device determines, based on the identifier of the first image segment and the identifier of the selected one or more image frames, one or more image frames of which resolution is to be adjusted; The camera device encodes the one or more image frames whose resolution is to be adjusted according to the third resolution; The camera device sends the encoded one or more image frames with adjusted resolution to the user terminal, wherein the encoded one or more image frames with adjusted resolution each include an identifier of the first image segment and an identifier of the image frame; The user terminal displays one or more image frames with adjusted resolution to the user in the new interface.
Citation Information
Patent Citations
Video resolution adaptive adjustment method and device, equipment and storage medium
CN114827662A
Real-time logistics information tracking method and system
CN116993253A