An image acquisition method, device, job recorder and medium

Abstract

Embodiments of the present application provide an image acquisition method and device, a work recorder and a medium. In the method, a video recording function is started, and a color camera and an infrared camera are powered on but not framed. If it is detected that the current environment is a night scene, the infrared camera is controlled to start recording, and the color camera is kept powered on but not framed. It is determined whether to take a color photo in the current environment. If yes, the infrared camera is kept recording, and the color camera is controlled to take a photo. In the method, the infrared camera is always used to record infrared images in the night scene, and the color camera is used to take color photos when taking photos. The recording content can be ensured to be always clear, and the color information required can be recorded. Therefore, the problem in the night work can be traced, and safety generation is facilitated.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of image processing, and in particular to an image acquisition method and device, a work recorder and a medium. BACKGROUND

[0002] On a construction site of a railway department or the like, a construction worker generally wears a law enforcement recorder or the like to record daily work, which can be used for problem tracing when an accident occurs. Usually, during daytime work, the law enforcement recorder uses a color camera to record, and during nighttime work, the law enforcement recorder switches to an infrared camera to record.

[0003] In some nighttime work, the construction worker takes different operations according to the indication of a signal light, in which the signal light indicates according to the light of different colors. However, during nighttime work, the law enforcement recorder uses the infrared camera to record, and the infrared camera can only output black and white colors, so the color information of the signal light cannot be recorded. When an accident occurs, it cannot be determined whether the accident is caused by the misoperation of the signal light, and problem tracing cannot be achieved, which is not conducive to safety production. SUMMARY

[0004] Embodiments of the present application provide an image acquisition method and device, a work recorder and a medium, to solve the problem that problem tracing cannot be achieved in the prior art.

[0005] In a first aspect, embodiments of the present application provide an image acquisition method applied to a work recorder, the work recorder comprising a color camera and an infrared camera, and the method comprising:

[0006] starting a recording function, and controlling the color camera and the infrared camera to be powered on but not to output frames;

[0007] if it is detected that a current environment is a nighttime scene, controlling the infrared camera to start recording, and keeping the color camera powered on but not to output frames;

[0008] judging whether a color photo is taken in the current environment;

[0009] if yes, keeping the infrared camera to record, and controlling the color camera to take a photo.

[0010] In a second aspect, embodiments of the present application provide an image acquisition device applied to a work recorder, the work recorder comprising a color camera and an infrared camera, and the device comprising:

[0011] a first control module configured to start a recording function, and control the color camera and the infrared camera to be powered on but not to output frames;

[0012] a second control module configured to control the infrared camera to start recording if it is detected that the current environment is a night scene, and keep the color camera powered on but not outputting frames;

[0013] a judging module configured to judge whether to take a color photo in the current environment;

[0014] a third control module configured to keep the infrared camera recording and control the color camera to take a photo if the judging result of the judging module is yes.

[0015] In a third aspect, an electronic device is provided, which includes at least a processor and a memory. The processor is configured to execute a computer program stored in the memory to implement the steps of the image acquisition method according to any one of the preceding aspects.

[0016] In a fourth aspect, a computer readable storage medium is provided, which stores a computer program. The computer program is executed by a processor to implement the steps of the image acquisition method according to any one of the preceding aspects.

[0017] In the embodiments of the present application, the recording function is started, and the color camera and the infrared camera are powered on but not outputting frames. If it is detected that the current environment is a night scene, the infrared camera is controlled to start recording, and the color camera is kept powered on but not outputting frames. It is judged whether to take a color photo in the current environment. If yes, the infrared camera is kept recording, and the color camera is controlled to take a photo. In the method, the infrared camera is always used to record infrared images in the night scene, and the color camera is used to take color photos when taking photos. The content recorded is always clear, and the color information required can be recorded. Therefore, the problem in the night work can be traced, and the safety production is facilitated. In the method, the camera is not switched when recording, the recording is not interrupted due to the switching of the camera, the infrared camera records continuously, and the image acquisition effect is improved and the recording integrity is ensured. BRIEF DESCRIPTION OF DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative effort.

[0019] Figure 1 A structural schematic diagram of a work recorder is provided for some embodiments of the present application;

[0020] Figure 2 A software structure block diagram of a work recorder is provided for some embodiments of the present application;

[0021] Figure 3 An image acquisition process schematic diagram provided for some embodiments of the present application;

[0022] Figure 4 An automatic photographing switch display interface schematic diagram provided for some embodiments of the present application;

[0023] Figure 5 A night color photographing switch display interface schematic diagram provided for some embodiments of the present application;

[0024] Figure 6 An image acquisition process schematic diagram provided for some embodiments of the present application;

[0025] Figure 7 An image acquisition process schematic diagram provided for some embodiments of the present application;

[0026] Figure 8 An image acquisition process schematic diagram provided for some embodiments of the present application;

[0027] Figure 9 A structure schematic diagram of an image acquisition device provided for some embodiments of the present application;

[0028] Figure 10 A work recorder structure schematic diagram provided for some embodiments of the present application. DETAILED DESCRIPTION

[0029] In order to make the purposes, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the drawings. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of protection of the present application.

[0030] In order to realize the problem tracing during construction, the present application provides an image acquisition method, device, work recorder and medium.

[0031] The present application is mainly applied to the construction scene of railway and the like, and is used for the record of daily work and the problem tracing when an accident occurs. In order to realize the image acquisition method provided by the present application, the present application provides a possible structure schematic diagram of a work recorder, as shown in Figure 1 It should be understood that, Figure 1 The work recorder 100 shown in Figure 1More or less elements than those shown, combinations of elements, or different configurations of elements can be provided in the future. The various elements shown in the figures can be implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing and / or application specific integrated circuits. In one implementation, the job logger is a terminal device.

[0032] As shown in FIG. 1, the job logger 100 includes radio frequency (RF) circuitry 110, a memory 120, a display unit 130, a camera 140, a sensor 150, an audio circuit 160, a wireless fidelity (Wi-Fi) module 170, a processor 180, a Bluetooth module 181, and a power supply 190, among other components. Figure 1

[0033] The RF circuitry 110 can be used for receiving and sending signals in the process of receiving information or calling, and can receive downlink data of a base station and hand over the downlink data to the processor 180 for processing; and can send uplink data to the base station. Generally, the RF circuitry includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.

[0034] The memory 120 can be used to store software programs and data. The processor 180 executes various functions and data processing of the job logger 100 by running the software programs or data stored in the memory 120. The memory 120 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state memory device. The memory 120 stores an operating system that enables the job logger 100 to run. In this application, the memory 120 can store an operating system and various application programs, and can also store program codes for executing the image acquisition method in the embodiments of the present application.

[0035] The display unit 130 can be used to receive input digital or character information, and generate signal input related to user settings and function control of the job logger 100. Specifically, the display unit 130 can include a touch screen 131 arranged on the front of the job logger 100, and can collect touch operations of the user thereon or therearound, such as clicking buttons, dragging scroll boxes, and the like.

[0036] ​The display unit 130 can also be used to display information input by the user or provided to the user, as well as a graphical user interface (GUI) of various menus of the job recorder 100. Specifically, the display unit 130 can include a display screen 132 disposed on the front face of the job recorder 100. Among them, the display screen 132 can be configured in the form of a liquid crystal display, a light-emitting diode, etc. The display unit 130 can be used to display videos or photos, enabling recording of the working environment.

[0037] Among them, the touch screen 131 can be overlaid on the display screen 132, or the touch screen 131 can be integrated with the display screen 132 to realize the input and output functions of the job recorder 100, and after integration, it can be simply referred to as a touch display screen. In this application, the display unit 130 can display application programs and corresponding operation steps.

[0038] The camera 140 can be used to capture still images or videos. Objects generate optical images through lenses and project them onto photosensitive elements. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the processor 180 to convert it into a digital image signal. In the embodiments of the present application, the camera 140 includes a color camera and an infrared camera. The color camera, also known as a visible light lens, is used to capture visible light images, and the infrared camera is used to capture infrared images.

[0039] The job recorder 100 can also include at least one sensor 150, such as an acceleration sensor 151, a distance sensor 152, a fingerprint sensor 153, and a temperature sensor 154. The job recorder 100 can also be configured with a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, a light sensor, a motion sensor, and other sensors.

[0040] The audio circuit 160, the speaker 161, and the microphone 162 can provide an audio interface between the user and the job recorder 100. The audio circuit 160 can convert the received audio data into an electrical signal and transmit it to the speaker 161, which converts it into a sound signal for output. The job recorder 100 can also be configured with a volume button for adjusting the volume of the sound signal. On the other hand, the microphone 162 converts the collected sound signal into an electrical signal, which is received by the audio circuit 160 and converted into audio data, which is then output to the RF circuit 110 for transmission to another terminal device, for example, or to the memory 120 for further processing. In this application, the microphone 162 can obtain the user's voice.

[0041] Wi-Fi belongs to short distance wireless transmission technology, and the work recorder 100 can help users to send and receive emails, browse web pages, access streaming media and the like through the Wi-Fi module 170, which provides wireless broadband Internet access for users.

[0042] The processor 180 is the control center of the work recorder 100, and connects all parts of the work recorder 100 through various interfaces and lines, and performs various functions of the work recorder 100 and processes data by running or executing software programs stored in the memory 120 and calling data stored in the memory 120. In some embodiments, the processor 180 can include one or more processing units; the processor 180 can also integrate an application processor and a baseband processor, wherein the application processor mainly processes the operating system, user interface and application program, etc., and the baseband processor mainly processes wireless communication. It can be understood that the above-mentioned baseband processor can also not be integrated into the processor 180. The processor 180 in the present application can run the operating system, application program, user interface display and touch response, and the image acquisition method described in the embodiments of the present application. In addition, the processor 180 is coupled with the display unit 130.

[0043] The Bluetooth module 181 is used for information interaction with other Bluetooth devices with Bluetooth module through Bluetooth protocol. For example, the work recorder 100 can establish Bluetooth connection with a wearable electronic device (such as a smart watch) also provided with a Bluetooth module through the Bluetooth module 181, so as to interact data.

[0044] The work recorder 100 further includes a power supply 190 (such as a battery) for supplying power to various components. The power supply can be logically connected with the processor 180 through a power management system, so as to realize the functions of managing charging, discharging and power consumption through the power management system. The work recorder 100 can also be configured with a power button for the functions of turning on and off the work recorder, and locking the screen.

[0045] Figure 2 A software structure block diagram of the work recorder 100 provided by the embodiments of the present application is shown.

[0046] The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system can be divided into four layers, from top to bottom, the application layer, the application framework layer, the Android runtime and the system library, and the kernel layer.

[0047] The application layer can include a series of application packages.

[0048] AsFigure 2 As shown, the application package can include camera, gallery, calendar, call, map, navigation, wireless local area network (WLAN), Bluetooth, music, video, short message, etc. applications.

[0049] The application framework layer provides application programming interface (API) and programming framework for the applications of the application layer. The application framework layer includes some pre-defined functions.

[0050] As shown, the application framework layer can include window manager, content provider, view system, phone manager, resource manager, notification manager, etc. Figure 2

[0051] The window manager is used to manage window programs. The window manager can acquire display screen size, determine whether there is a status bar, lock the screen, and intercept the screen, etc.

[0052] The content provider is used to store and acquire data, and make the data accessible by the applications. The data can include video, image, audio, dialed and received calls, browsing history and bookmarks, phonebook, short message, etc.

[0053] The view system includes visual controls, such as controls for displaying photograph, text, picture, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface of an application for image acquisition can include a view for displaying text and a view for displaying pictures.

[0054] The phone manager is used to provide communication functions of the job recorder 100. For example, management of call status (including call connection, call hang-up, etc.).

[0055] The resource manager provides various resources for the applications, such as localized strings, icons, pictures, layout files, video files, etc.

[0056] The notification manager makes the applications able to display notification information (such as message digest, message content of short message) in the status bar, which can be used to convey notification type messages, which can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminder, etc. The notification manager can also be a notification in the form of a chart or a scroll bar text appearing in the top status bar of the system, such as a notification of an application running in the background, and can also be a notification in the form of a dialogue window appearing on the screen. For example, the notification manager can be used to prompt text information in the status bar, issue a prompt sound, vibrate the job recorder, flash the indicator light, etc. ​

[0057] The Android Runtime includes a core library and a virtual machine. The Android runtime is responsible for scheduling and managing the Android system.

[0058] The core library contains two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.

[0059] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java files of the application layer and the application framework layer into binary files. The virtual machine is used to perform functions such as management of object life cycle, stack management, thread management, security and exception management, and garbage collection.

[0060] The system library can include multiple functional modules. For example: surface manager, media library, three-dimensional graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0061] The surface manager is used to manage the display subsystem, and provides fusion of 2D and 3D layers for multiple applications.

[0062] The media library supports playback and recording of multiple commonly used audio, video formats, and static image files. The media library can support multiple audio and video encoding formats, such as moving pictures experts group (MPEG) 4, H.264, MP3, advanced audio coding (AAC), adaptive multi-rate (AMR), JPG, PNG, etc.

[0063] The three-dimensional graphics processing library is used to realize three-dimensional graphics drawing, image rendering, synthesis, and layer processing, etc.

[0064] The 2D (a kind of animation method) graphics engine is a drawing engine for 2D drawing.

[0065] The kernel layer is the layer between hardware and software. The kernel layer at least contains display driver, camera driver, audio driver, sensor driver.

[0066] First, the terms involved in the embodiments of the present application are simply explained:

[0067] 1) Power on, which means to turn on power supply for the camera hardware, at this time, it is in a waiting but not working state. Generally, power on is the first step of the camera work. This step usually takes time, therefore, in the embodiment of the present application, after starting the recording function, before starting the formal recording / photographing, the camera is powered on first, so that when there is a recording / photographing demand later, the recording / photographing can be quickly responded to, so as to improve the recording / photographing efficiency and thus improve the user experience.

[0068] 2) Stream configuration, which means to configure parameters related to the shooting effect for the camera. Different specific configurations of the parameters will affect the imaging effect of the final recording / photo. This step is mainly to prepare for the subsequent recording / photographing, after the stream configuration is completed, the job recorder waits for a recording request / photographing request.

[0069] 3) Frame output, which means that the camera outputs frame data according to the set frame rate. The purpose of frame output is to record or record, or only to preview on the display screen, that is, the job recorder can use the frame data output by the camera to complete recording, photographing, or previewing, etc.

[0070] Then the image acquisition process is described in combination with the following embodiments.

[0071] In some embodiments, the image acquisition process provided by the embodiment of the present application is as shown in Figure 3 , which includes:

[0072] S301: Start the recording function, control the color camera and the infrared camera to power on but not to output frames.

[0073] The image acquisition method provided by the embodiment of the present application is applied to a job recorder, in the actual application scenario, the job recorder can also be other terminal devices with image acquisition function. The job recorder includes a color camera and an infrared camera, the color camera is used to acquire a visible light image, and the infrared camera is used to acquire an infrared image. Among them, the visible light image is a color image (i.e. color photo), and the infrared image is a black and white image.

[0074] The job recorder starting the recording function can be triggered manually by the user, or can be automatically started after the job recorder is powered on.

[0075] The job recorder starting the recording function means that there can be a recording demand in the current environment, so the job recorder can control the color camera and the infrared camera to power on at the same time (only as an example, the color camera and the infrared camera can also be powered on one by one in the implementation process), and keep in a state that can output frames at any time, which is beneficial to subsequent quick recording / photographing. But because the recording / photographing demand of the current environment has not been determined at this time, therefore, the color camera and the infrared camera can be powered on first but not output frames at this time.

[0076] S302: If it is detected that the current environment is a night scene, control the infrared camera to start recording, and keep the color camera powered on but not frame output.

[0077] The work recorder can detect whether the current environment is a daytime scene or a night scene. In one implementation, a light sensor in the work recorder detects the brightness of the current environment. If the brightness of the current environment is greater than a set first brightness threshold, it is determined that the current environment is a daytime scene. If the brightness of the current environment is less than the first brightness threshold, it is determined that the current environment is a night scene. In another implementation, the work recorder determines according to the current time and the sunset time of the day. If the current time reaches the sunset time, it is determined that the current environment is a night scene. If the current time does not reach the sunset time, it is determined that the current environment is a daytime scene.

[0078] If the current environment is a night scene, the work recorder can record work in a night scene during work, so the infrared camera can be controlled to start recording. In an example, a recording request can be sent to the infrared camera. The infrared camera starts frame output and recording in response to the recording request, while the color camera continues to be powered on but not frame output. Only the infrared camera is frame output and recording at night, while the color camera is powered on but not frame output except at the time of subsequent photographing. The power consumption of the camera in the powered-on state is very low, so the work recorder does not increase much power consumption, and has little effect on the endurance time of the work recorder. Therefore, during the recording of the infrared camera, the color camera is kept in a powered-on but not frame output state, which can quickly respond to the demand for photographing without increasing the power consumption of the work recorder too much, and is conducive to improving the user experience.

[0079] S303: Determine whether to take a color photo in the current environment. If so, perform S304.

[0080] The work recorder can automatically detect whether there is a demand for taking a color photo in the current environment, or can trigger the determination of whether there is a demand for taking a color photo in the current environment according to the user's operation.

[0081] The work recorder can perform different steps according to different determination results. If the work recorder determines that there is a demand for taking a color photo in the current night environment in this step, S304 can be performed.

[0082] S304: Keep the infrared camera recording, and control the color camera to take a photo.

[0083] If there is a need to take color photos in the current night environment, the operation recorder can keep the infrared camera recording and control the color camera to take photos. Because the color camera has been kept powered on in the previous step, it can quickly respond to frame shooting when taking photos, that is, the color camera that is kept powered on but not framed is ready to frame at any time, and when the shooting conditions are met, the color camera can quickly collect and output color photos according to the set frame rate, so it has the advantage of fast response to shooting, and the infrared camera keeps recording during the color camera shooting process without switching, so the user cannot perceive the change of the image acquisition camera, and thus the user experience is not affected.

[0084] The recording data of the infrared camera and the shooting data of the color camera can be saved in one folder or in different folders respectively, for the user to view.

[0085] If there is no need to take color photos in the current night environment, the operation recorder can keep the infrared camera recording and continue to keep the color camera powered on but not framed.

[0086] In the embodiments of the present application, the infrared camera is always used to record infrared images in the night scene, and the color camera is used to take color photos when shooting, which can ensure that the recording content is always clear and record the required color information, so that the problem in the night work can be traced back, which is beneficial to safety production. In the method, the camera is not switched during recording, which can avoid the interruption of recording caused by lens switching, the infrared camera can record continuously, and the image acquisition effect is improved and the recording integrity is ensured.

[0087] The above embodiments are mainly described for the night scene, and the corresponding description for the daytime scene is also given below. If it is detected that the current environment is a daytime scene, the operation recorder can record the work in the daytime scene during the work process through the color camera, so the color camera can be controlled to start recording. For example, a recording request can be sent to the color camera, and the color camera can respond to the recording request to start framing and recording. During the process of starting framing and recording, the color camera can collect and output color photos according to the preset frame rate of the color camera, so as to ensure the smoothness of the recording picture.

[0088] In some implementations, if the current environment is a daytime scene, the job recorder can also determine whether to take a color photo in the current environment. If yes, the color camera is controlled to take a photo. If no, the color camera continues to record a video. The color camera can record a video and take a photo at the same time, that is, controlling the color camera to take a photo does not interrupt the recording process of the color camera. Of course, it can be understood that since the color camera records color video data, the job recorder can keep the color camera recording in the current daytime environment, and the user can trace the problem by checking the color video data.

[0089] In yet some implementations, if the current environment is a daytime scene, the color camera is controlled to record a video, and the infrared camera is also controlled to be powered on but not to output a frame. In this way, when the daytime scene is switched to a nighttime scene, the infrared camera can quickly respond to the recording request and then start recording to improve the completeness of the recording. It can be understood that the power consumption of the infrared camera in the powered-on but not frame output state is very low, and the impact on the endurance time of the job recorder is also very slight.

[0090] On the basis of the above embodiments, in the embodiments of the present application, the process of S303 can include:

[0091] According to the pre-stored scene detection algorithm, it is determined whether to take a color photo in the current environment; and / or

[0092] It is determined whether a color photo shooting instruction is received from the user.

[0093] In one implementation, the job recorder stores a scene detection algorithm, which can detect in real time whether to take a color photo in the current environment. When it is determined that there is a demand to take a color photo in the current environment, the job recorder can automatically take a photo using the color camera. Especially in the case where the user cannot operate the photo shooting but encounters an important scene that needs to be recorded, the automatic detection and photo shooting of the job recorder are beneficial to record the color information required, and realize the problem tracing in the nighttime work. For example, the important scene that needs to be recorded includes but is not limited to a signal lamp scene and / or a text scene, in which there may be colored text content.

[0094] The work recorder can save the "automatic photo capture" function switch. Users can decide whether to use this function. If they decide to use it, they can turn the "automatic photo capture" switch on; if they decide not to use it, they can turn it off. For example, the work recorder's user interface (UI) displays the "automatic photo capture" control switch, or the work recorder's casing (such as the side frame) has an "automatic photo capture" button switch. Figure 4 The "Auto Photo" switch displayed on the UI interface is shown. Figure 4 In (a) of the image, the "Automatic Photo" switch is turned on. Figure 4 In section (b), the "Automatic Photo Capture" switch is in the off state. When the "Automatic Photo Capture" switch is in the on state, the work recorder can detect whether to take a color photo in the current environment based on the scene detection algorithm.

[0095] In another implementation, the user can issue a color photo capture command via the photo capture button displayed on the work recorder's UI, or via a photo capture button or shortcut operation on the work recorder's casing. When the user determines that there is a need to take a color photo in the current environment, they can issue a color photo capture command. After recognizing the command, the work recorder will take a picture using its color camera.

[0096] It is understandable that the order in which the processes of detecting whether a color photograph is being taken in the current environment and determining whether a user's command to take a color photograph has been received are not limited. For example, the work recorder can automatically detect whether a color photograph is being taken in the current environment while simultaneously determining whether a user's command to take a color photograph has been received. Alternatively, the work recorder can first detect whether a color photograph is being taken in the current environment, and then determine whether a user's command to take a color photograph has been received. Or, the work recorder can first determine whether a user's command to take a color photograph has been received, and then detect whether a color photograph is being taken in the current environment.

[0097] In this embodiment, the work recorder can automatically detect the need to take color photos in the current environment and / or take color photos based on user operations, which is beneficial for recording the required color information and enabling problem tracing during nighttime work. Furthermore, multiple trigger conditions for taking color photos can improve the flexibility of image acquisition.

[0098] Taking the display of a photo button on the UI of a work recorder as an example, we will explain some possible application scenarios.

[0099] Possible scenario one, the photographing key includes a "take color photo" button and an optional "take black and white photo" button, that is, the UI interface directly displays a function button capable of taking color photos. When the user clicks the "take color photo" button, the work recorder determines that a color photo shooting instruction is received from the user, and then responds to the color photo shooting instruction to control the color camera to take a photo.

[0100] Possible scenario two, the photographing key only includes a "take photo" button, that is, the UI interface only displays a function button capable of taking photos, without being limited to the function of taking color photos. When the user clicks the "take photo" button, the work recorder determines that a photo shooting instruction is received from the user, but whether to take a color photo, the work recorder can jointly determine in combination with other factors.

[0101] In this scenario, on the basis of the above embodiments, in the embodiments of the present application, determining whether a color photo shooting instruction is received from the user can include:

[0102] determining whether a photo shooting instruction is received from the user and determining that the night color photo shooting switch is in an open state.

[0103] In this embodiment, the work recorder can also be provided with a "night color photo shooting" function switch, and the user can decide whether to use the function. If it is determined to use, the user can turn on the "night color photo shooting" switch by himself / herself, and if it is determined not to use, the user can turn off the "night color photo shooting" switch by himself / herself. Similar to the above "automatic shooting", the UI interface of the work recorder can display a "night color photo shooting" control switch, or the shell of the work recorder can be provided with a "night color photo shooting" button switch. Figure 5 The "night color photo shooting" switch displayed on the UI interface is shown in (a) in which the "night color photo shooting" switch is in an open state, Figure 5 (b) in which the "night color photo shooting" switch is in a closed state. Figure 5 (b) in which the "night color photo shooting" switch is in a closed state.

[0104] That is, in this scenario two, the work recorder determines whether to take a color photo in combination with whether the "night color photo shooting" switch is open when / after receiving a photo shooting instruction from the user. When the "night color photo shooting" function switch is turned on, the work recorder always uses the color camera to take a color photo when the user issues a photo shooting instruction in the night scenario. In the embodiments of the present application, the work recorder is provided with a night color photo shooting switch, and when the night color photo shooting switch is turned on, the work recorder keeps the infrared camera to record and controls the color camera to take a photo, which can ensure that the recorded content is always clear and can record the required color information, which is conducive to problem tracing and safety production.

[0105] When the night color photographing function switch is closed, since the user issues a photographing instruction, it indicates that the user has a photographing demand, in order to meet the user's photographing demand, the work recorder can continue to detect the current environment, and determine whether to take a color photograph or a black and white photograph according to the detection result. On the basis of the above embodiments, the method further includes:

[0106] If a photographing instruction is received, and the night color photographing switch is in the closed state; it is judged whether a color photograph or a black and white photograph is taken in the current environment;

[0107] If it is determined that a color photograph is taken in the current environment, the color camera is controlled to take a photograph;

[0108] If it is determined that a black and white photograph is taken in the current environment, the infrared camera is controlled to take a photograph.

[0109] When the above-mentioned night color photographing function switch is closed, the work recorder can continue to determine whether a color photograph or a black and white photograph is taken in the current environment. In one implementation, when the work recorder determines whether a color photograph or a black and white photograph is taken in the current environment, the above-mentioned scene detection algorithm can be used for detection, and it is determined whether a color photograph is taken according to the detection result. If it is determined that a color photograph is taken according to the detection result, it is determined that a color photograph is taken in the current environment, otherwise, it is determined that a black and white photograph is taken in the current environment.

[0110] If it is determined that a color photograph is taken in the current environment, the work recorder can control the color camera to take a color photograph. If it is determined that a color photograph is not taken in the current environment, the work recorder can use the infrared camera to take a black and white photograph.

[0111] Of course, it can be understood that since the infrared camera records data in black and white, in the current night scene, the work recorder can keep the infrared camera recording, and the user can trace the problem by viewing the black and white recording data.

[0112] A possible image acquisition process is shown in Figure 6 , including the following steps:

[0113] S601: Start the recording function, control the color camera and the infrared camera to be powered on but not to output frames.

[0114] S602: If it is detected that the current environment is a night scene, control the infrared camera to start recording, and keep the color camera powered on but not to output frames.

[0115] S603: judging whether a color photo is detected to be taken in the current environment or a shooting instruction is received from the user; if the color photo is detected to be taken in the current environment, performing S606; if the shooting instruction is received from the user, performing S604.

[0116] If neither the demand for taking the color photo in the current environment is detected nor the shooting instruction is received, the infrared camera can continue to be controlled to record a video, and the color camera can be kept powered on but not frame output.

[0117] S604: judging whether the night color photo shooting switch is turned on; if yes, performing S606; if no, performing S605.

[0118] S605: judging whether a color photo or a black-and-white photo is taken in the current environment; if the color photo is taken, performing S606; if the black-and-white photo is taken, performing S607. S606: keeping the infrared camera to record a video, and controlling the color camera to take a photo.

[0119] S607: keeping the infrared camera to record a video, and controlling the infrared camera to take a photo.

[0120] On the basis of the above embodiments, in the embodiments of the present application, before the color camera is controlled to take a photo, the following steps are further included:

[0121] judging whether light compensation is needed in the current environment;

[0122] if yes, turning on the flash to compensate light for the color camera.

[0123] Before starting to take a photo, the work recorder can further judge whether light compensation is needed in the current environment; if the light compensation is needed, the work recorder can take a flash photo, that is, turn on the flash to compensate light for the color camera, and control the color camera to take a photo. If the light compensation is not needed, the work recorder can directly take a color photo by using the color camera.

[0124] In an implementation manner, when judging whether light compensation is needed in the current environment, the work recorder can detect the brightness of the current environment by using a light sensor; if the brightness of the current environment is greater than a second brightness threshold, it is determined that the light compensation is not needed in the current environment; if the brightness of the current environment is not greater than the second brightness threshold, it is determined that the light compensation is needed in the current environment. The first brightness threshold and the second brightness threshold can be the same or different, which is not limited in the embodiments of the present application, for example but not limited to, the first brightness threshold and the second brightness threshold are different, and the first brightness threshold is less than the second brightness threshold.

[0125] A possible image acquisition process is shown in FIG. 6, including the following steps: Figure 7 ​

[0126] S701: start the video recording function, control the color camera and the infrared camera to be powered on but not to output frames.

[0127] S702: if it is detected that the current environment is a night scene, control the infrared camera to start recording, and keep the color camera powered on but not to output frames.

[0128] S703: determine whether a color photo is taken in the current environment or a user's photo shooting instruction is received; if a color photo is taken in the current environment, execute S706; if a user's photo shooting instruction is received, execute S704.

[0129] S704: determine whether the night color photo shooting switch is turned on; if yes, execute S706; if no, execute S705.

[0130] S705: determine whether a color photo or a black-and-white photo is taken in the current environment; if a color photo is taken, execute S706; if a black-and-white photo is taken, execute S709.

[0131] S706: determine whether the flash is turned on in the current environment; if yes, execute S707; if no, execute S708.

[0132] S707: turn on the flash, and execute S708.

[0133] S708: keep the infrared camera recording, and control the color camera to take a photo.

[0134] S709: keep the infrared camera recording, and control the infrared camera to take a photo.

[0135] On the basis of the above embodiments, before S304, the method further includes:

[0136] controlling the color camera to be powered on but not to output frames, and performing flow distribution for the color camera.

[0137] If it is determined that a color photo is taken in the current environment or the night color photo shooting switch is turned on, the work recorder can perform flow distribution for the color camera in the powered-on but not frame output state, to prepare for photo shooting, so that the color camera can quickly respond to frame output for photo shooting.

[0138] On the basis of the above embodiments, the above embodiments are described below with reference to a specific embodiment, as shown in FIG. 8, including the following steps: Figure 8

[0139] S801: the work recorder starts recording.

[0140] S802: turn on the color camera and the infrared camera.​

[0141] In this step, the color camera and the infrared camera can be powered on at the same time, and kept in a state that can frame at any time.

[0142] S803: Determine whether the current environment is daytime or night. If it is daytime, execute S804, and if it is night, execute S808.

[0143] S804: If it is daytime, the color camera frames, and the infrared camera does not frame.

[0144] Specifically, in this step, a preview request can be issued to the color camera, the color camera starts to frame and record, and the infrared camera remains in a powered-on state but does not frame.

[0145] S805: The color camera records in real time.

[0146] S806: Determine whether the current environment is for taking a photo; if so, execute S807; if not, return to S805, and the color camera can continue to record in real time.

[0147] S807: The color camera takes a color photo and saves it.

[0148] S808: If it is night, the infrared camera frames, and the color camera does not frame.

[0149] Specifically, in this step, a recording request can be issued to the infrared camera, the infrared camera starts to frame and record, and the color camera remains in a powered-on but non-framing state.

[0150] S809: The infrared camera records in real time, and executes S810 and S810'.

[0151] In a night scene, the infrared camera keeps recording in real time. During the recording process, a scene detection algorithm is used to determine whether to take a color photo and whether the user has pressed the shutter button. When either determination result determines to take a color photo, the color camera can be controlled to take a photo to ensure that the required color information in the night scene is recorded, facilitate problem tracing, and improve user experience.

[0152] S810': Determine whether the "automatic photo" function switch is on; if so, execute S811'; if not, repeat S810'.

[0153] S811': Start the scene detection algorithm to determine whether to take a color photo; if so, execute S814; if not, return to execute S810'.

[0154] After starting the video recording at night, the work recorder judges whether the automatic photographing is opened. If yes, the real-time scene detection algorithm is started to automatically identify whether the current environment has the demand of taking color photos. The automatic photographing function switch can be decided by the user whether to use and open.

[0155] S810: whether the user presses the photographing key is judged; if yes, S811 is executed; if no, the S810 can be repeatedly executed.

[0156] Whether the user presses the photographing key is one of the bases for judging whether to take color photos.

[0157] S811: whether the night color photo function switch is opened is judged; if no, S812 is executed; if yes, S814 is executed.

[0158] If the night color photo is opened, the color camera is always used to take color photos at night. If the night color photo is not opened, the scene detection algorithm can be used to automatically identify whether the current environment has the demand of taking color photos. The night color photo function switch can be used for but not limited to the following scenes: text scene and / or signal light scene, etc.

[0159] S812: whether the current scene takes color photos or black and white photos is judged; if the black and white photos are taken, S813 is executed; if the color photos are taken, S814 is executed.

[0160] S813: the infrared camera takes the black and white photos and saves.

[0161] S814: the color camera is prepared for photographing by being powered on but not framing, and S815 is executed.

[0162] Before photographing, the color camera is always powered on, and can quickly respond to frame photographing when photographing, so as to have the advantage of fast photographing response. Moreover, the infrared camera recording is always kept during the video recording process, so that the user does not perceive, the user experience is not affected, and the complete recording data can be collected.

[0163] S815: whether the flash is opened is judged; if yes, S816 is executed; if no, S817 is executed.

[0164] Before starting photographing, the work recorder can also judge whether the current environment brightness has the demand of light compensation. If yes, the light compensation can be performed by opening the flash.

[0165] S816: the flash is opened, and S817 is executed.

[0166] S817: the color camera takes the color photos, and S818 is executed.

[0167] If it is determined in step S815 to turn on the flash, then in this step, the color camera is used to take a picture with the flash providing fill light. If it is determined in step S815 not to turn on the flash, then in this step, the color camera is used to take a picture without the flash providing fill light.

[0168] S818: Determine whether a picture is triggered by a user; if yes, execute S819; if no, execute S820.

[0169] S819: Save the color picture in an existing folder, and execute S821.

[0170] S820: Create a new folder, save the color picture in the new folder, and execute S821.

[0171] When a picture is taken and saved, if the user actively triggers the picture, the color picture can be normally saved in an existing folder. If the picture is not triggered by the user, such as being automatically triggered by the system through a scene detection algorithm, the color picture can be saved in a separate folder, which is convenient for the user to view.

[0172] Of course, in some implementations, the collected images can be distinguished and named by information such as an infrared camera / color camera, a user actively triggering a picture, and the system automatically determining to trigger a picture. For example, the images can be distinguished and named by adding a suffix. This naming method can inform the user of the source of the current video / picture, such as enabling the user to know that the camera used to take a color picture is different from the camera used to record a video.

[0173] S821: The color camera returns to the state of being powered on but not outputting frames.

[0174] After this step is executed, the method can continue to return to S809.

[0175] In the embodiments of the present application, the job recorder is equipped with an infrared camera and a color camera. In a night scene and under the condition that the infrared camera is continuously working, a color picture can be taken in a video. Specifically, in a night scene, the infrared camera always outputs images, and no camera switching is performed. When a picture is taken, the image of the color camera is taken, which can ensure that the recorded content is always clear and enables the user to record the required color information, and the user does not perceive the action of using the color camera to take a color picture.

[0176] In order to realize problem tracing during construction, on the basis of the above embodiments, based on the same technical concept as the above method embodiments, the present application also provides an image acquisition device applied to a job recorder, the job recorder comprising a color camera and an infrared camera. Figure 9A structural schematic diagram of an image acquisition device 900 provided in the present application is shown in Figure 9 The image acquisition device 900 includes:

[0177] A first control module 901 is configured to start a video recording function, and control the color camera and the infrared camera to be powered on but not to output frames.

[0178] A second control module 902 is configured to, if it is detected that the current environment is a night scene, control the infrared camera to start recording, and keep the color camera powered on but not to output frames.

[0179] A judgment module 903 is configured to judge whether to take a color photo in the current environment.

[0180] A third control module 904 is configured to, if the judgment result of the judgment module 903 is yes, keep the infrared camera recording, and control the color camera to take a photo.

[0181] In a possible implementation, the judgment module 903 is specifically configured to detect, according to a pre-stored scene detection algorithm, whether to take a color photo in the current environment, and / or whether a user instruction of taking a color photo is received.

[0182] In a possible implementation, the judgment module 903 is further configured to judge whether a user instruction of taking a photo is received, and determine whether a night color photo taking switch is in an open state.

[0183] In a possible implementation, the judgment module 903 is further configured to, if the user instruction of taking a photo is received and the night color photo taking switch is in a closed state, judge whether to take a color photo or a black-and-white photo in the current environment.

[0184] The third control module 904 is further configured to, if the judgment module 903 determines to take a color photo in the current environment, control the color camera to take a photo, and if the judgment module 903 determines to take a black-and-white photo in the current environment, control the infrared camera to take a photo.

[0185] In a possible implementation, the judgment module 903 is further configured to judge whether to perform light compensation in the current environment.

[0186] The third control module 904 is further configured to, if the judgment module 903 determines to perform light compensation in the current environment, turn on a flash to perform light compensation for the color camera.

[0187] In a possible implementation, the third control module 904 is further configured to keep the color camera powered on but not to output frames, to perform flow distribution for the color camera.

[0188] Figure 10is a structural schematic diagram of a work recorder provided in an embodiment of the present application. The work recorder comprises one or more than two (including two) processors 1001 and a communication interface 1002.

[0189] Optionally, the work recorder further comprises a memory 1003, which can comprise a read-only memory and a random access memory, and provides operation instructions and data for the processor. A part of the memory can further comprise a non-volatile random access memory (NVRAM).

[0190] In some embodiments, as shown in the figure, the memory 1003 stores the following elements, execution modules or data structures, or a subset of them, or an extended set of them. Figure 10

[0191] As shown in the figure, in an embodiment of the present application, corresponding operations are performed by calling operation instructions (which can be stored in an operating system) stored in the memory 1003. Figure 10

[0192] As shown in the figure, the processor 1001 controls the processing operation of the head-end device, and the processor can also be referred to as a central processing unit (CPU). Figure 10

[0193] As shown in the figure, the memory 1003 can comprise a read-only memory and a random access memory, and provides instructions and data for the processor. In the application, the communication interface 1002 and the memory 1003 are coupled together through a bus system 1004. The method disclosed in the above embodiments of the present application can be applied to the processor or implemented by the processor. The communication interface 1002 is used for communication between the work recorder and other devices. Figure 10 On the basis of the above embodiments, an embodiment of the present application provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program executable by a processor, and when the program runs on the processor, the processor performs the steps to realize any of the above embodiments.

[0194] Since the principle of solving the problem by the above provided computer readable medium is similar to the image acquisition method, the steps realized after the processor executes the computer program in the above computer readable medium can refer to the above other embodiments, and the repeated parts will not be described herein.

[0195]

[0196] ​​​​Obviously, many modifications and variations of the present application are possible in light of the above teachings. It is, therefore, to be understood that within the scope of the appended claims and their equivalents, the application can be practiced otherwise than as specifically described.

Claims

1. An image acquisition method, characterized in that, The method is applied to a work recorder, the work recorder comprises a color camera and an infrared camera, and the method comprises the following steps: starting a video recording function, controlling the color camera and the infrared camera to be powered on but not to output frames; if it is detected that the current environment is a night scene, controlling the infrared camera to start recording, and keeping the color camera powered on but not to output frames; determining whether to take a color photo under the current environment; if yes, keeping the infrared camera to record, and controlling the color camera to take a photo; the keeping the infrared camera to record, and controlling the color camera to take a photo comprises: controlling the color camera to collect and output a color photo at a set frame rate, and keeping the infrared camera to record without switching during the photo taking process of the color camera; wherein the determining whether to take a color photo under the current environment comprises: determining whether a photo taking instruction is received from a user, and determining that a night color photo taking switch is in an open state; if the photo taking instruction is received and the night color photo taking switch is in a closed state, determining whether to take a color photo or a black and white photo under the current environment; if it is determined to take a color photo under the current environment, controlling the color camera to take a photo; if it is determined to take a black and white photo under the current environment, controlling the infrared camera to take a photo.

2. The method of claim 1, wherein, before the controlling the color camera to take a photo, the method further comprises: determining whether to perform light compensation under the current environment; if yes, turning on a flash to perform light compensation for the color camera.

3. The method of claim 2, wherein, before the keeping the infrared camera to record, and the controlling the color camera to take a photo, the method further comprises: keeping the color camera powered on but not to output frames, and performing flow distribution for the color camera.

4. An image acquisition device, characterized in that The device is applied to a work recorder, the work recorder comprises a color camera and an infrared camera, and the device comprises: a first control module, configured to start a video recording function, and control the color camera and the infrared camera to be powered on but not to output frames; a second control module, configured to, if it is detected that the current environment is a night scene, control the infrared camera to start recording, and keep the color camera powered on but not to output frames; a determination module, configured to determine whether to take a color photo under the current environment; a third control module, configured to, if the determination result of the determination module is yes, keep the infrared camera to record, and control the color camera to take a photo; the third control module is specifically configured to control the color camera to collect and output a color photo at a set frame rate, and keep the infrared camera to record without switching during the photo taking process of the color camera; wherein the determination module is specifically configured to determine whether a photo taking instruction is received from a user, and determine that a night color photo taking switch is in an open state. The third control module is specifically configured to: if the photographing instruction is received and the night color photographing switch is in the off state, determine whether a color photograph or a black-and-white photograph is taken in the current environment; if it is determined that a color photograph is taken in the current environment, control the color camera to take a photograph; and if it is determined that a black-and-white photograph is taken in the current environment, control the infrared camera to take a photograph.

5. A work recorder characterized by comprising: The work recorder comprises a processor and a communication interface coupled with the processor, and the processor is configured to run a computer program or instruction to implement the steps of the image acquisition method according to any one of claims 1-3.

6. A computer-readable storage medium, characterized in that, The computer program is stored in the computer readable storage medium, and the computer program is executed by the processor to implement the steps of the image acquisition method according to any one of claims 1-3.

Images