Solar camera media processing method based on STR technology

Abstract

The invention relates to a solar camera media processing method based on an STR technology, and the method achieves the balance between equipment power utilization and solar charging through the construction of a camera low-power-consumption software architecture, and achieves the purpose of continuous work. Adjusting a control method of an internal MPP according to a low-power-consumption software architecture of the camera; media processing is realized according to a camera low-power-consumption software architecture for adjusting an internal MPP method. According to the invention, the frame rate of the sensor in the sleep or wake-up stage is controlled; when the user does not operate, 1 frame / 1s, 1 frame / Ns and N frame / 1s are achieved, and flexible setting of the user is allowed. And meanwhile, by adjusting the effect in the AOV working process, I / P combination is performed according to the GOP value, so that the storage space occupied by the video in the same time period is smaller. Incremental design is carried out on the basis of traditional timing video recording, and the control mode of AOV coding, interaction logic of media and services and the working principle of the media in the low-power-consumption process are optimized.

Description

Technical Field

[0001] The invention belongs to the technical field of video processing, in particular to a solar camera media processing method based on STR technology. Background Art

[0002] As the concept of green and low carbon has become more popular, many traditional industries have also been moving towards energy conservation, and low power consumption is the general trend. AOV (Always On Video) recording is a key technology in low power consumption. In traditional solutions, because the device will switch during power off / on, the media is always in a non-continuous encoding state. Because there is no reference relationship between the previous frame and the next frame, each frame of the video needs to be encoded into an I frame, and the size of the I frame generally occupies 90% of the total bit rate, which places high requirements on chip memory, CF storage capacity, and network quality during playback.

[0003] The existing low-power IPC has the following defects and deficiencies in the use of intelligent security equipment:

[0004] 1. Long AOV video interval: Since the single-frame processing time is too long, in order to reduce power consumption and meet the maximum time requirement of continuous operation of the device, the AOV video interval is long and cannot meet 1 frame / 1s; key information may be missed during playback.

[0005] 2. High implementation cost: Since each frame is encoded as an I frame, it will cause storage pressure and require high capacity of chip memory and storage card. During playback, due to the full I frame data, the playback bit rate is high, and when the network environment is poor, it will cause freezes.

[0006] 3. Poor video quality: In sports scenes, mosaics are quite serious. Summary of the invention

[0007] The purpose of the present invention is to overcome the shortcomings of the prior art and propose a solar camera media processing method based on STR technology, which can control the AOV interval by controlling the frame rate of the sensor in the sleep or wake-up stage: when the user has no operation, it can achieve 1 frame / 1s, 1 frame / Ns, N frames / 1s, allowing the user to set it flexibly. At the same time, the present invention adjusts the effect of the AOV working process and performs I / P combination according to the GOP value, so that the storage space occupied by the video in the same time period is smaller.

[0008] The present invention solves the technical problem by adopting the following technical solutions:

[0009] A solar camera media processing method based on STR technology includes the following steps:

[0010] Step 1: Build a low-power software architecture for the camera;

[0011] Step 2: Adjust the internal MPP control method according to the camera's low-power software architecture;

[0012] Step 3: Process the media according to the camera's low-power software architecture that adjusts the internal MPP method.

[0013] Moreover, the low-power software architecture of the camera in step 1 includes IPC processing, single-chip microcomputer, module, server and APP, and the IPC processing includes sensor control, driver & SDK, MPP, business and network control module, wherein the sensor control, MPP and driver & SDK are connected in sequence, the output end of the driver & SDK is connected to the input end of the sensor control, the MPP and the business are bidirectionally connected, the business and the network control module are bidirectionally connected, the business and the module are bidirectionally connected, the business and the single-chip microcomputer are bidirectionally connected, the single-chip microcomputer and the module are bidirectionally connected, the module, the server and the APP are connected in sequence,

[0014] MPP is used to provide control of the video core.

[0015] The service is used for external presentation and notification of the MPP module to enter low power consumption mode;

[0016] The network control module is used to upload the media and status data on the device to the network during APP operation, as well as receive real-time messages on the network and notify the business;

[0017] The single-chip microcomputer is used to control the power supply of each module of the IPC. When working in low power consumption, it powers on / off the IPC. During the power-off period of the IPC, it monitors the abnormality of the module and performs abnormal recovery processing.

[0018] The module adopts 4G or wifi module;

[0019] The server is used to provide network services;

[0020] APP is used to provide a terminal for user operations;

[0021] The Sensor is used to collect raw video data and supports the sleep function.

[0022] Furthermore, the control of the video core includes: sensor control, effect module, encoding control parameters and uploading of encoded video data.

[0023] Furthermore, the step 2 comprises the following steps:

[0024] Step 2.1, confirm the equipment environment before entering STR mode;

[0025] Step 2.2: Frame rate control of the sensor during sleep or wake-up phase;

[0026] Step 2.3: Effect adjustment during AOV working process.

[0027] Moreover, the specific implementation method of step 2.1 is: querying the data stream status through the business calling the media standard interface, when there is no video data being transmitted on the entire pipeline, entering the low power consumption mode.

[0028] Moreover, the specific implementation method of step 2.2 is: after the business confirms to enter the STR mode, the media standard interface is called to notify that the STR mode is to be entered, and the media implements the control of the sensor frame rate in the media standard interface, and changes the original frame rate to the STR frame rate. At the same time, the encoding parameters and the internal working mode of the record are also changed to adjust the AOV video effect; after the device exits from the STR mode, the original encoding parameters and sensor frame rate are restored according to the working mode.

[0029] Moreover, the specific implementation method of step 2.3 is: the internal parameters of the media are intelligently adjusted according to the working status and scene complexity, and no external control is required.

[0030] The advantages and positive effects of the present invention are:

[0031] The present invention realizes media processing by constructing a low-power software architecture for a camera; adjusting the control method of the internal MPP according to the low-power software architecture for the camera; and realizing media processing according to the low-power software architecture for the camera of adjusting the internal MPP method. The present invention controls the frame rate of the sensor in the sleep or wake-up stage; enabling it to control the AOV interval: when the user has no operation, 1 frame / 1s, 1 frame / Ns, N frames / 1s are achieved, allowing the user to set flexibly. At the same time, the present invention adjusts the effect in the AOV working process, and performs I / P combination according to the GOP value, so that the storage space occupied by the video in the same time period is smaller. The present invention is incrementally designed on the basis of traditional timed video recording, and optimizes the control method of AOV encoding, the interaction logic between media and business, and the working principle of media in the low-power process. The present invention performs intelligent effect adjustment after entering the sleep mode: identifies complex scenes to adjust the effect, and improves the viewing effect of the video. At the same time, the present invention applies the str solution of Linux, and can be implemented with a slight change in the original implementation, which accelerates the development and listing speed of low-power cameras. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 This is a low-power software architecture diagram for the camera of the present invention;

[0033] Figure 2 This is a schematic diagram of the MPP implementation principle of the present invention.

[0034] Figure 3 This is a workflow diagram for STR state switching of the present invention. DETAILED DESCRIPTION

[0035] The present invention is further described in detail below with reference to the accompanying drawings.

[0036] Low-power cameras are used on batteries, but even the largest batteries will eventually run out, and only when they are paired with solar charging panels can the device be kept in a state of continuous operation; the present invention is based on the installation of a solar-charged camera, and the means of reducing the power consumption of the device at the same time is to ensure that the power consumption of the device and the solar charging can be balanced to achieve the purpose of continuous operation.

[0037] A solar camera media processing method based on STR technology includes the following steps:

[0038] Step 1: Build a low-power software architecture for the camera.

[0039] like Figure 1 As shown, the low-power software architecture of the camera in step 1 includes sensor control, driver & SDK, MPP, service, network control module, single-chip microcomputer, module, server and APP, wherein sensor control, MPP and driver & SDK are connected in sequence, the output end of the driver & SDK is connected to the input end of the sensor control, the MPP and the service are bidirectionally connected, the service and the network control module are bidirectionally connected, the service and the module are bidirectionally connected, the service and the single-chip microcomputer are bidirectionally connected, the single-chip microcomputer and the module are bidirectionally connected, the module, the server and the APP are connected in sequence, and the low-power software architecture of the camera is integrated on the SOC.

[0040] MPP is used to provide control of the video core, which includes sensor control, effect module, encoding control parameters and uploading of encoded video data.

[0041] like Figure 2 As shown, the original process can be realized by only making changes to the yellow part. The present invention applies the linux str solution and can be implemented with a slight change on the original implementation, which speeds up the development and market launch of low-power cameras.

[0042] The service is used for external presentation and to notify the MPP module to enter low power consumption mode.

[0043] The network control module is used for APP operation to upload the media and status data on the device to the network, receive real-time messages on the network, and notify the business.

[0044] The single-chip microcomputer is used to control the power supply of each module of the IPC. When working in low power consumption, it powers off / on the IPC. When the IPC is powered off, it monitors the abnormality of the module and performs abnormal recovery processing.

[0045] The module uses a 4G or wifi module. The peripherals provided by the module manufacturer are the medium for IPC to access the Internet. It is best to support low-power mode. When the IPC works in low-power mode, the power consumption of the device can be reduced.

[0046] The server is used to provide network services.

[0047] APP is used to provide a terminal for user operations.

[0048] The Sensor is used to collect raw video data and supports the sleep function.

[0049] Step 2: Adjust the internal MPP control method according to the camera's low-power software architecture.

[0050] Step 2 includes the following steps:

[0051] Step 2.1: Confirm the equipment environment before entering STR mode.

[0052] The specific implementation method of step 2.1 is: the business module calls the media standard interface to query the data stream status. When there is no video data being transmitted on the entire pipeline, it can enter the low power mode (echo mem> / sys / power / state).

[0053] Step 2.2: Frame rate control of the sensor during sleep or wake-up phase.

[0054] The specific implementation method of step 2.2 is as follows: after the business confirms to enter the STR mode, the media standard interface is called to notify that the STR mode is to be entered. The media implements the sensor frame rate control in the media standard interface, changes the original frame rate to the STR frame rate, and also changes the encoding parameters and records the internal working mode to adjust the AOV video effect; after the device exits the STR mode, the original encoding parameters and sensor frame rate are restored according to the working mode.

[0055] Sensor selection: You need to select a sensor that supports low power consumption. The app can use the sleep command to control the number of frames sent by the sensor during each resume process to achieve specifications such as 1 frame / 1s.

[0056] Media pipeline: By controlling the number of frames sent by the sensor during the media resume process, the number of AOVs encoded in one wake-up is controlled, so the media does not need to change the frame rate control value on the pipeline.

[0057] Among them, STR is suspend to RAM, a low-power working mode of Linux.

[0058] Step 2.3, effect adjustment during AOV working process. The internal parameters of the media are intelligently adjusted according to the working status and scene complexity, and no external control is required.

[0059] AOV interval: Since the data stored in RAM in STR mode does not sense the time interval between suspend / resume, the encoder always thinks that the device is in the process of continuous encoding. It will use the bit rate sent to control the encoding result of I / P frames. Since the video frames are not generated in a continuous time, the difference between P frames and I frames will be large, causing the previous P frames to be too large and the subsequent P frames to be compressed too small, which will produce mosaics. In STR mode, it is necessary to debug a set of appropriate RC parameters to balance the encoding data and video effects.

[0060] Scene changes: When the device is placed in a pond, roadside or other place with many trees or grass, the scene complexity increases sharply when it is windy or rainy. If no adjustment is made, a large number of mosaics will appear in the video, affecting the viewing effect. At this time, the media needs to be able to actively judge the complexity of the scene and gradually adjust the effect parameters such as sharpness according to certain conditions, thereby reducing the pressure of encoding and solving the video effect problem.

[0061] Among them, Suspend is the device sleep state, which is a state in STR mode. By setting echo mem> / sys / power / state, Linux is triggered to save data such as APP, driver and system status into RAM. After suspend, the soc-IPC can be powered off, but it should be noted that the RAM cannot be powered off.

[0062] Resume wakes up the device. By powering on the soc-IPC, Linux is triggered to restore the data stored in RAM during suspend, so that the device can resume its work before suspend.

[0063] Step 3: Process the media according to the camera's low-power software architecture that adjusts the internal MPP method.

[0064] like Figure 3 As shown, this step includes the following steps:

[0065] Step 3.1: When the user does not operate for a period of time, confirm the device environment;

[0066] Step 3.2, the business is ready to enter the dormant mode;

[0067] Step 3.3, notify the MPP module to control the sensor frame rate and effect;

[0068] Step 3.4, enter sleep mode;

[0069] Step 3.5, set the AOV to wake up at a scheduled time, write the video file, perform image detection and linkage effect adjustment at the same time, and return to step 3.4.

[0070] It should be emphasized that the embodiments described in the present invention are illustrative rather than restrictive. Therefore, the present invention includes but is not limited to the embodiments described in the specific implementation manner. Any other implementation manners derived by those skilled in the art based on the technical solution of the present invention also fall within the scope of protection of the present invention.

Claims

1. A solar camera media processing method based on STR technology, characterized in that: The following steps are involved: Step 1: Build a low-power software architecture for the camera; Step 2: Adjust the internal MPP control method according to the low-power software architecture of the camera; Step 3: Process the media according to the camera's low-power software architecture that adjusts the internal MPP method.

2. The method for processing media of a solar camera based on STR technology according to claim 1, characterized in that: The low-power software architecture of the camera in step 1 includes IPC processing, single-chip microcomputer, module, server and APP. The IPC processing includes sensor control, driver & SDK, MPP, business and network control modules, wherein sensor control, MPP and driver & SDK are connected in sequence, the output end of driver & SDK is connected to the input end of sensor control, MPP and business are bidirectionally connected, business and network control module are bidirectionally connected, business and module are bidirectionally connected, business and single-chip microcomputer are bidirectionally connected, single-chip microcomputer and module are bidirectionally connected, module, server and APP are connected in sequence, MPP is used to provide control of the video core. The service is used for external presentation and notification of the MPP module to enter low power consumption mode; The network control module is used to upload the media and status data on the device to the network during APP operation, receive real-time messages on the network, and notify the business; The single-chip microcomputer is used to control the power supply of each module of the IPC. When working in low power consumption, it powers on / off the IPC. During the power-off period of the IPC, it monitors the abnormality of the module and performs abnormal recovery processing. The module adopts 4G or wifi module; The server is used to provide network services; APP is used to provide a terminal for user operations; The Sensor is used to collect raw video data and supports the sleep function.

3. The method for processing media of a solar camera based on STR technology according to claim 2, characterized in that: The control of the video core includes: sensor control, effect module, encoding control parameters and uploading of encoded video data.

4. The method for processing media of a solar camera based on STR technology according to claim 1, characterized in that: The step 2 comprises the following steps: Step 2.1, confirm the equipment environment before entering STR mode; Step 2.2: Frame rate control of the sensor during sleep or wake-up phase; Step 2.3: Effect adjustment during AOV working process.

5. The method for processing media of a solar camera based on STR technology according to claim 4, characterized in that: The specific implementation method of step 2.1 is: query the data stream status through the business call media standard interface, and when there is no video data being transmitted on the entire pipeline, enter the low power consumption mode.

6. The method for processing media of a solar camera based on STR technology according to claim 4, characterized in that: The specific implementation method of step 2.2 is as follows: after the business confirms to enter the STR mode, the media standard interface is called to notify that the STR mode is to be entered. The media implements the sensor frame rate control in the media standard interface, and changes the original frame rate to the STR frame rate. At the same time, the encoding parameters and the internal working mode of the record are also changed to adjust the AOV video effect; after the device exits the STR mode, the original encoding parameters and sensor frame rate are restored according to the working mode.

7. The method for processing media of a solar camera based on STR technology according to claim 4, characterized in that At: The specific implementation method of step 2.3 is: the internal parameters of the media are intelligently adjusted according to the working status and scene complexity, No external control is required.

Images