Video recording method, device and system, storage medium and electronic equipment

Abstract

The invention provides a video recording method, a video recording device, a video recording system, a computer readable storage medium and electronic equipment, and relates to the technical field of computers. The video recording method comprises the following steps: determining hardware configuration parameters in response to an operation of entering a slow action mode, and starting video recording hardware according to the hardware configuration parameters; performing scene recognition on image data acquired based on video recording hardware to determine a recording scene; determining a recording frame rate corresponding to the recording scene; and in response to the recording trigger operation, performing video recording based on the recording frame rate. According to the invention, the recording effect of the slow-action video can be improved.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a video recording method, a video recording device, a video recording system, a computer-readable storage medium, and an electronic device. Background Art

[0002] With the development of terminal technology, terminal devices such as smart phones and tablet computers have become indispensable tools in people's daily lives. People have higher and higher requirements for the functions of terminal devices, including the video recording function of terminal devices.

[0003] Regarding the recording of slow-motion videos, there is currently a problem of poor video recording effect. Summary of the invention

[0004] The present disclosure provides a video recording method, a video recording device, a video recording system, a computer-readable storage medium and an electronic device, thereby overcoming the problem of poor slow-motion video recording effect at least to a certain extent.

[0005] According to a first aspect of the present disclosure, a video recording method is provided, including: determining hardware configuration parameters in response to an operation of entering a slow motion mode, and starting video recording hardware according to the hardware configuration parameters; performing scene recognition on image data collected by the video recording hardware to determine a recording scene; determining a recording frame rate corresponding to the recording scene; and performing video recording based on the recording frame rate in response to a recording trigger operation.

[0006] According to a second aspect of the present disclosure, a video recording device is provided, including: a preview configuration module, used to determine hardware configuration parameters in response to an operation of entering a slow-motion mode, and to start video recording hardware according to the hardware configuration parameters; a scene determination module, used to perform scene recognition on image data collected by the video recording hardware to determine a recording scene; a frame rate determination module, used to determine a recording frame rate corresponding to the recording scene; and a video recording module, used to respond to a recording trigger operation and perform video recording based on the recording frame rate.

[0007] According to a third aspect of the present disclosure, a video recording system is provided, including an application layer, an application framework layer, a hardware abstraction layer, a kernel layer and video recording hardware. The application layer is used to generate preview configuration parameters in response to an operation of entering a slow motion mode, and send the preview configuration parameters to the hardware abstraction layer via the application framework layer, and the hardware abstraction layer generates hardware configuration parameters according to the preview configuration parameters, and sends the hardware configuration parameters to the kernel layer, so that the kernel layer starts the video recording hardware according to the hardware configuration parameters; the hardware abstraction layer is used to obtain image data collected by the video recording hardware, perform scene recognition on the image data to determine the recording scene, and determine the recording frame rate corresponding to the recording scene, so as to perform video recording based on the recording frame rate in response to the recording trigger operation.

[0008] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, the above-mentioned video recording method is implemented.

[0009] According to a fifth aspect of the present disclosure, an electronic device is provided, comprising a processor; and a memory for storing one or more programs, wherein when the one or more programs are executed by the processor, the processor implements the above-mentioned video recording method.

[0010] In the technical solutions provided by some embodiments of the present disclosure, for the slow-motion video recording mode, the recording frame rate of the video recording is determined according to the scene, thereby effectively solving the problem that some technologies use a fixed frame rate that does not match the shooting scene, causing video anomalies, and can improve the recording effect of the slow-motion video of the terminal device. In addition, since the present solution can adaptively adjust the recording frame rate, in the scene that requires low frame rate recording, the recording frame rate can be adaptively reduced to save power consumption.

[0011] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present disclosure, and together with the specification, are used to explain the principles of the present disclosure. Obviously, the drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. In the drawings:

[0013] Figure 1 A schematic diagram showing the architecture of a video recording system according to an embodiment of the present disclosure;

[0014] Figure 2 A flowchart of a video recording method according to an exemplary embodiment of the present disclosure is schematically shown;

[0015] Figure 3 A schematic diagram of a user side interface for entering a slow motion preview mode in response to an operation of entering a slow motion mode according to an embodiment of the present disclosure is shown;

[0016] Figure 4 A flowchart schematically shows the entire process of slow-motion video recording according to an embodiment of the present disclosure;

[0017] Figure 5 A block diagram of a video recording device according to an exemplary embodiment of the present disclosure is schematically shown;

[0018] Figure 6 A block diagram of an electronic device according to an exemplary embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0019] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as being limited to the examples set forth herein; on the contrary, these embodiments are provided so that the present disclosure will be more comprehensive and complete, and the concepts of the example embodiments are fully conveyed to those skilled in the art. The described features, structures, or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced while omitting one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, known technical solutions are not shown or described in detail to avoid obscuring various aspects of the present disclosure.

[0020] In addition, the accompanying drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.

[0021] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the steps. For example, some steps may be decomposed, while some steps may be combined or partially combined, so the actual execution order may change according to the actual situation.

[0022] Frame rate is a measure of the number of displayed frames. Its unit is "frames per second" (fps) or "Hz". Generally speaking, this unit is used to describe the number of frames played per second in videos, electronic graphics or games. Due to the special physiological structure of the human eye, if the frame rate of the picture seen by the human eye is higher than about 10 frames per second, the picture is considered to be coherent. This phenomenon is called visual persistence. When the terminal device is recording video, the frame rate usually refers to the frame rate of the video recording at the image acquisition end, that is, the frame rate of the image captured by the camera sensor.

[0023] In order to capture high-speed moving objects and the trajectory of the objects' movements, the terminal device's camera mode adds a slow motion mode, i.e., a high frame rate recording mode. The slow motion mode is mainly achieved by capturing images at a high frame rate (such as 480fps, 960fps, etc.) and playing them back at a normal rate (such as 30fps). In addition, the frame rate can be further increased through algorithms such as interpolation, so that the user can see processes such as moving bullets, falling steel balls, and burning matches.

[0024] In addition, when using a high frame rate to record slow-motion videos, high-speed image acquisition requires a high-performance ISP (Image Signal Processor) to perform denoising and color optimization on the image data, and the system memory consumption is large, so the shooting time of most slow-motion videos is limited.

[0025] Currently, in the slow-motion video recording mode, the terminal device sets the resolution and frame rate of slow-motion recording by default, and cannot support the selection of a suitable frame rate in combination with the scene. Even if the function of setting the frame rate is opened to the user side, the user learning cost is high and it is impossible to configure a suitable frame rate.

[0026] For some scenes where slow motion scenes with low frame rates (such as 240fps) can meet the needs, if the system defaults to a high frame rate (such as 960fps), it will cause unnecessary waste of performance and power consumption. For some scenes that require slow motion recording with high frame rates (such as 960fps), if the system defaults to a low frame rate (such as 240fps), the slow motion recording effect will be poor, which will not meet the needs and lead to a degraded user experience.

[0027] In order to solve the above problems, the embodiments of the present disclosure provide a new video recording solution. The video recording solution of the embodiments of the present disclosure can be implemented by a terminal device, that is, the following video recording system and video recording device can be configured in the terminal device, and each step of the following video recording method can be performed by the terminal device. The present disclosure does not limit the type of terminal device, including but not limited to smart phones, tablet computers, smart wearable devices, etc.

[0028] Figure 1 A schematic diagram showing the architecture of a video recording system according to an embodiment of the present disclosure is shown. Figure 1 The video recording system of the embodiment of the present disclosure may include an application layer (Application layer), an application framework layer (Framework layer), a hardware abstraction layer (HAL), a kernel layer (Kernel layer) and video recording hardware (Hardware, HW).

[0029] The application layer includes the system's own camera application, gallery application or third-party camera application, etc. In the application layer, the default parameters of slow motion can be configured for the first time, such as preview frame rate, preview resolution, preview buffer, etc. In addition, the application layer can generate the request buffer, batch and other information of the current scene in combination with the information fed back by the hardware abstraction layer.

[0030] The application framework layer may be an Android standard framework layer, including the CameraManager (camera manager) of the Java framework, the API2 interface implementation of the CameraDevice (camera device), the CameraService (camera service) of the Native framework, and the like.

[0031] The hardware abstraction layer can be the underlying logic layer for the slow motion mode. The first configuration mainly generates the configuration parameters of the ISP, sensor and other hardware based on the settings of the application layer, and transmits the image data processed by the ISP to the scene detection module and slow motion strategy module included in the hardware abstraction layer through the kernel layer configuration, and then transmits the recording frame rate of the current scene back to the application layer through metadata. In addition, the hardware abstraction layer can create use cases and pipelines based on the current slow motion scene, and determine whether to generate the hardware configuration parameters for slow motion recording based on the instructions of the application layer.

[0032] The kernel layer is mainly used to control the video recording hardware, such as Figure 1As shown, it may include an image sensor driver, a voice coil motor (VCM) driver, a flashlight driver, an image signal processing driver, an optical image stabilization (OIS) driver, etc. The kernel layer can control these hardware through the I2C bus in combination with the configuration of the hardware abstraction layer. The above-mentioned driver can also be called a driver.

[0033] Video recording hardware may include but is not limited to sensors, voice coil motors, flashes, image signal processors, optical image stabilization modules, etc.

[0034] In the video recording scheme of the presently disclosed embodiment, the application layer can generate preview configuration parameters in response to the operation of entering the slow motion mode, and send the preview configuration parameters to the hardware abstraction layer via the application framework layer. The hardware abstraction layer generates hardware configuration parameters based on the preview configuration parameters. The hardware abstraction layer can send the hardware configuration parameters to the kernel layer, and the kernel layer starts the video recording hardware based on the hardware configuration parameters.

[0035] The hardware abstraction layer can also be used to obtain image data collected by the video recording hardware, and the hardware abstraction layer can perform scene recognition on the image data to determine the recording scene. Subsequently, the hardware abstraction layer can determine the recording frame rate corresponding to the recording scene so that the video can be recorded based on the recording frame rate when the application layer responds to the recording trigger operation.

[0036] The video recording system based on the embodiment of the present disclosure can realize adaptive adjustment of the recording frame rate based on the scene, which can effectively improve the recording effect of the slow-motion video of the terminal device.

[0037] According to some embodiments of the present disclosure, for the process of determining the recording frame rate, first, the hardware abstraction layer can determine a frame rate determination factor from the recording scene, and the frame rate determination factor includes object information contained in the scene and / or image attribute information of the scene. Next, the hardware abstraction layer can use the frame rate determination factor to determine the recording frame rate corresponding to the recording scene.

[0038] When the frame rate determination factors include object information contained in the scene and image attribute information of the scene, the hardware abstraction layer can determine the candidate frame rate range based on the object information contained in the scene, and then determine the recording frame rate corresponding to the recording scene from the candidate frame rate range based on the image attribute information of the scene.

[0039] In addition to the recording frame rate of the slow-motion video, the hardware abstraction layer can also determine the resolution corresponding to the scene according to the scene, and record the slow-motion video according to the resolution and recording frame rate. In this way, the recording resolution of the slow-motion video can be adaptively adjusted, further improving the recording effect of the slow-motion video.

[0040] Figure 2 The flowchart of the video recording method according to an exemplary embodiment of the present disclosure is schematically shown. Figure 2 , the video recording method may include the following steps:

[0041] S22. Determine hardware configuration parameters in response to the operation of entering the slow motion mode, and start the video recording hardware according to the hardware configuration parameters.

[0042] In an exemplary embodiment of the present disclosure, hardware configuration parameters may include, but are not limited to, data acquisition parameters of hardware such as image sensors and image signal processors, and the present disclosure does not limit the types of parameters contained therein and the specific values ​​of the parameters.

[0043] First, the terminal device can generate preview configuration parameters in response to the operation of entering the slow motion mode. The preview configuration parameters include but are not limited to preview frame rate, preview resolution, preview buffer, etc. Next, the terminal device can select a use case of the slow motion mode and form a pipeline according to the preview configuration parameters. Subsequently, the terminal device can determine the hardware configuration parameters according to the use case of the slow motion mode.

[0044] Corresponding to the above system architecture, the application layer can generate preview configuration parameters in response to the operation of entering the slow motion mode, and the hardware abstraction layer selects the use case of the slow motion mode and builds the pipeline according to the preview configuration parameters, and generates hardware configuration parameters according to the use case. After obtaining the hardware configuration parameters, the kernel layer can control the corresponding video recording hardware to start.

[0045] refer to Figure 3 After entering the camera APP interface of the terminal device, the user can select the slow motion mode by clicking. In this case, the terminal device enters the preview state of the slow motion mode based on the parameters matching the slow motion mode. Figure 3 As shown, in order to distinguish it from the normal shooting mode, the shutter style in the slow motion mode can be different from the shutter styles in other shooting modes.

[0046] S24. Perform scene recognition on the image data collected by the video recording hardware to determine the recording scene.

[0047] After starting the video recording hardware, the terminal device can obtain preview image data, which can be data collected by an image sensor and processed by an ISP. The terminal device can perform scene recognition based on the image data to determine the recording scene.

[0048] The embodiments of the present disclosure do not limit the division of scenes. In some embodiments, scenes can be divided according to the types of objects contained in the scenes, for example, people and animals belong to different scenes, waterfalls and vehicles belong to different scenes, etc. In other embodiments, scenes can be divided according to the motion states of the objects contained in the scenes, for example, a car driving at a low speed and a car driving at a high speed belong to different scenes, a running boy and a boy walking quietly belong to different scenes, etc.

[0049] Specifically, a classification model based on a neural network may be used to perform scene recognition, and the present disclosure does not impose any limitation on this.

[0050] S26. Determine a recording frame rate corresponding to the recording scene.

[0051] According to some embodiments of the present disclosure, first, the terminal device can determine a frame rate determination factor based on a recording scene, and the frame rate determination factor can be object information contained in the scene. Among them, the object information contained in the scene may include object type information and / or object motion information contained in the scene. It can be understood that the object type information represents the object type to which the objects contained in the scene belong, such as people and animals belong to different types, fallen leaves and vehicles belong to different types, and so on. The object motion information represents information about the intensity of the movement of the objects contained in the scene, such as the motion information of running is different from that of walking still, and the motion information of a vehicle traveling at 20 km / h is different from that of a vehicle traveling at 80 km / h.

[0052] Next, the terminal device can use the object information contained in the scene to determine the recording frame rate corresponding to the recording scene. Specifically, a mapping relationship between the object information contained in the scene and the recording frame rate can be pre-constructed. After the terminal device determines the object information contained in the scene, the recording frame rate corresponding to the recording scene can be directly determined based on the mapping relationship. For example, for a recording scene of a waterfall, the determined recording frame rate can be 240fps. For another example, for a recording scene of a sports car, the determined recording frame rate can be 960fps.

[0053] In addition, in an embodiment where the object information included in the scene includes object type information and object motion information included in the scene, first, the terminal device may determine a candidate frame rate range based on the object type information included in the scene, wherein the candidate frame rate range may include more than two candidate frame rates. Next, the terminal device may determine a recording frame rate corresponding to the recording scene from the candidate frame rate range according to the object motion information.

[0054] According to other embodiments of the present disclosure, first, the terminal device may determine a frame rate determination factor according to the recording scene, and the frame rate determination factor may be the image attribute information of the scene, wherein the image attribute information of the scene may include but is not limited to hue, brightness, etc. In these embodiments, image attribute information such as hue and brightness may affect slow motion recording. Next, the terminal device may use the image attribute information of the scene to determine the recording frame rate corresponding to the recording scene. Specifically, a mapping relationship between the image attribute information of the scene and the recording frame rate may be pre-constructed, and after the terminal device determines the image attribute information of the scene, the recording frame rate corresponding to the recording scene may be directly determined based on the mapping relationship. For example, for a scene with a lower average brightness, the determined recording frame rate is smaller; for a scene with a higher average brightness, the underestimated recording frame rate is larger.

[0055] According to some other embodiments of the present disclosure, first, the terminal device may determine a frame rate determination factor according to a recording scene, and the frame rate determination factor may include object information contained in the scene and image attribute information of the scene. The object information contained in the scene and the image attribute information of the scene have the same meaning as in the above embodiment.

[0056] Next, the terminal device can determine the recording frame rate corresponding to the recording scene according to the object information contained in the scene and the image attribute information of the scene. Considering that the object information of the scene is more important than the image attribute of the scene in determining the recording frame rate, the weight of the interest point of the object information is usually higher than the weight of the interest point of the image attribute. Therefore, the object factor in the scene can be given priority over the image attribute factor in the scene.

[0057] Specifically, the terminal device may determine a candidate frame rate range according to the object information contained in the scene, and the candidate frame rate range includes more than two candidate frame rates. Subsequently, the terminal device may determine a recording frame rate corresponding to the recording scene from the candidate frame rate range according to the image attribute information of the scene.

[0058] S28. Respond to the recording trigger operation and perform video recording based on the recording frame rate.

[0059] After determining the recording frame rate, the terminal device can respond to the recording trigger operation to record the video based on the recording frame rate. The recording trigger operation can be an operation in which the user clicks a button to start recording. Figure 3 As shown, the recording trigger operation may be an operation in which the user clicks the shutter button under the "slow motion" prompt.

[0060] In addition, the image data generated after the video is recorded can be transmitted to the encoding module of the terminal device after being processed by the ISP, and stored after being encoded, such as in an SD (Secure Digital) card.

[0061] Reference below Figure 4 The entire process of slow-motion video recording according to the embodiment of the present disclosure is described.

[0062] In step S402, the user clicks on the icon of the camera APP on the terminal device to enter the camera APP interface, and the user can manually select the slow-motion video recording mode on the camera APP interface.

[0063] In step S404, the terminal device sets the slow motion mode parameters and packages the parameters into metadata. These parameters may include resolution, frame rate, requested buffer, etc. These parameters may be sent to the hardware abstraction layer through the application framework layer. Specifically, the generation of the parameters may be combined with the initialization configuration and the scene information fed back by the hardware abstraction layer.

[0064] In step S406, the terminal device may determine whether a recording stream (ie, a Recording data stream) is currently configured. If the recording stream is not configured, step S408 is executed; if the recording stream is configured, step S418 is executed.

[0065] In step S408, the hardware abstraction layer of the terminal device may receive parameters sent by the application layer and transmitted via the application framework layer, select a corresponding use case and build a pipeline.

[0066] In step S410, the hardware abstraction layer of the terminal device may generate corresponding hardware configuration parameters according to the use case, and send the hardware configuration parameters to the kernel layer.

[0067] In step S412, the kernel layer of the terminal device performs hardware configuration according to the hardware configuration parameters, including configuring the registers involved in the hardware, and then starts the hardware to capture images.

[0068] In step S414, the hardware abstraction layer of the terminal device obtains the collected image data and detects the scene according to the image data.

[0069] In step S416, the hardware abstraction layer of the terminal device determines the recording frame rate corresponding to the scene, packages the recording frame rate into metadata, and feeds it back to the application layer through the metadata. Thus, the APP layer can parse the metadata from the hardware abstraction layer, identify the recording frame rate of the current scene, apply for recording resources (such as buffers), and set the recording stream and send it to the hardware abstraction layer.

[0070] In step S418, the hardware abstraction layer of the terminal device may configure the data port. Specifically, the data port may be configured according to the configuration data sent by the application layer and the batch mode.

[0071] In step S420, the camera APP of the terminal device requests the buffer of the recording stream. For example, 240fps means 4 buffers per batch (60fps); 960fps means 16 buffers per batch (60fps).

[0072] In step S422, the terminal device monitors in real time whether there is a recording trigger operation.

[0073] In step S424, if a recording trigger operation is detected, the hardware abstraction layer of the terminal device generates new hardware configuration parameters.

[0074] In step S426, the kernel layer of the terminal device performs hardware configuration according to the new hardware configuration parameters, including configuration of related registers.

[0075] In step S428, the terminal device may send the slow-motion video data captured by the hardware and processed by the ISP to the encoding module, which is encoded by the encoding module and then stored.

[0076] It should be noted that although the steps of the method in the present disclosure are described in a specific order in the drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps, etc.

[0077] Furthermore, this example implementation also provides a video recording device.

[0078] Figure 5 FIG. 1 schematically shows a block diagram of a video recording device according to an exemplary embodiment of the present disclosure. Figure 5 According to an exemplary embodiment of the present disclosure, the video recording device 5 may include a preview configuration module 51 , a scene determination module 53 , a frame rate determination module 55 , and a video recording module 57 .

[0079] Specifically, the preview configuration module 51 can be used to determine the hardware configuration parameters in response to the operation of entering the slow motion mode, and start the video recording hardware according to the hardware configuration parameters; the scene determination module 53 can be used to perform scene recognition on the image data collected by the video recording hardware to determine the recording scene; the frame rate determination module 55 can be used to determine the recording frame rate corresponding to the recording scene; the video recording module 57 can be used to respond to the recording trigger operation and perform video recording based on the recording frame rate.

[0080] According to an exemplary embodiment of the present disclosure, the preview configuration module 51 may be configured to execute: generating preview configuration parameters in response to an operation of entering a slow motion mode; selecting a use case of the slow motion mode according to the preview configuration parameters; and determining hardware configuration parameters according to the use case of the slow motion mode.

[0081] According to an exemplary embodiment of the present disclosure, the frame rate determination module 55 can be configured to perform: determining a frame rate determination element from a recording scene; wherein the frame rate determination element includes object information contained in the scene and / or image attribute information of the scene; and determining a recording frame rate corresponding to the recording scene using the frame rate determination element.

[0082] According to an exemplary embodiment of the present disclosure, when the frame rate determination elements include object information contained in the scene and image attribute information of the scene, the frame rate determination module 55 can be configured to perform: determining a candidate frame rate range based on the object information contained in the scene; determining a recording frame rate corresponding to the recording scene from the candidate frame rate range based on the image attribute information of the scene.

[0083] Since the functional modules of the video recording device in the embodiment of the present disclosure are the same as those in the above method implementation, they will not be described in detail here.

[0084] Figure 6 Schematic diagram of an electronic device suitable for implementing the exemplary embodiment of the present disclosure is shown. The terminal device of the exemplary embodiment of the present disclosure may be configured as follows Figure 6 It should be noted that Figure 6 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0085] The electronic device of the present disclosure includes at least a processor and a memory, wherein the memory is used to store one or more programs. When the one or more programs are executed by the processor, the processor can implement the video recording method of the exemplary embodiment of the present disclosure.

[0086] Specifically, Figure 6As shown, the electronic device 60 may include: a processor 610, an internal memory 621, an external memory interface 622, a Universal Serial Bus (USB) interface 630, a charging management module 640, a power management module 641, a battery 642, an antenna 1, an antenna 2, a mobile communication module 650, a wireless communication module 660, an audio module 670, a sensor module 680, a display screen 690, a camera module 691, an indicator 692, a motor 693, a button 694, and a Subscriber Identification Module (SIM) card interface 695, etc. The sensor module 680 may include a depth sensor, a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, and a bone conduction sensor, etc.

[0087] It is to be understood that the structure illustrated in the embodiment of the present disclosure does not constitute a specific limitation on the electronic device 60. In other embodiments of the present disclosure, the electronic device 60 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0088] The processor 610 may include one or more processing units, for example, the processor 610 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor and / or a neural network processor (NPU). Different processing units may be independent devices or integrated into one or more processors. In addition, a memory may be provided in the processor 610 for storing instructions and data.

[0089] The electronic device 60 can realize the shooting function through the ISP, the camera module 691, the video codec, the GPU, the display screen 690 and the application processor, etc. In some embodiments, the electronic device 60 may include 1 or N camera modules 691, where N is a positive integer greater than 1. If the electronic device 60 includes N cameras, one of the N cameras is a main camera.

[0090] The internal memory 621 can be used to store computer executable program codes, which include instructions. The internal memory 621 can include a program storage area and a data storage area. The external memory interface 622 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 60.

[0091] The present disclosure also provides a computer-readable storage medium, which may be included in the electronic device described in the above embodiments; or may exist independently without being assembled into the electronic device.

[0092] The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in conjunction with an instruction execution system, apparatus, or device.

[0093] Computer-readable storage media can send, propagate or transmit programs for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable storage medium can be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0094] The computer-readable storage medium carries one or more programs. When the one or more programs are executed by an electronic device, the electronic device implements the method described in the embodiments of the present disclosure.

[0095] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0096] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware, and the units described may also be arranged in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.

[0097] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the implementation of the present disclosure.

[0098] In addition, the above-mentioned figures are only schematic illustrations of the processes included in the method according to the exemplary embodiments of the present disclosure, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0099] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.

[0100] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing what is disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and embodiments are to be considered merely as exemplary, and the true scope and spirit of the present disclosure are indicated by the claims.

[0101] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A video recording method, characterized in that: include: In response to the operation of entering the slow motion mode, determining hardware configuration parameters, and starting the video recording hardware according to the hardware configuration parameters; Performing scene recognition on the image data collected based on the video recording hardware to determine the recording scene; Determining a recording frame rate corresponding to the recording scene; In response to the recording trigger operation, video recording is performed based on the recording frame rate.

2. The video recording method according to claim 1, characterized in that: The operation of determining hardware configuration parameters in response to entering the slow motion mode includes: generating preview configuration parameters in response to an operation of entering the slow motion mode; Selecting a use case of the slow motion mode according to the preview configuration parameters; The hardware configuration parameters are determined according to a use case of the slow motion mode.

3. The video recording method according to claim 1, characterized in that: The determining of the recording frame rate corresponding to the recording scene comprises: Determining a frame rate determination factor from the recording scene; wherein the frame rate determination factor includes object information contained in the scene and / or image attribute information of the scene; The frame rate determination factor is used to determine a recording frame rate corresponding to the recording scene.

4. The video recording method according to claim 3, characterized in that: In a case where the frame rate determination factor includes object information included in the scene and image attribute information of the scene, determining the recording frame rate corresponding to the recording scene by using the frame rate determination factor includes: Determining a candidate frame rate range according to object information included in the scene; A recording frame rate corresponding to the recording scene is determined from the candidate frame rate range according to the image attribute information of the scene.

5. A video recording system, characterized in that: The video recording system includes an application layer, an application framework layer, a hardware abstraction layer, a kernel layer and video recording hardware; The application layer is used to generate preview configuration parameters in response to the operation of entering the slow motion mode, and send the preview configuration parameters to the hardware abstraction layer via the application framework layer, and the hardware abstraction layer generates hardware configuration parameters according to the preview configuration parameters, and sends the hardware configuration parameters to the kernel layer, so that the kernel layer starts the video recording hardware according to the hardware configuration parameters; The hardware abstraction layer is used to obtain image data collected by the video recording hardware, perform scene recognition on the image data to determine a recording scene, and determine a recording frame rate corresponding to the recording scene, so as to respond to a recording trigger operation and perform video recording based on the recording frame rate.

6. The video recording system according to claim 5, characterized in that: The hardware abstraction layer is used to determine a frame rate determination factor from the recording scene, and use the frame rate determination factor to determine a recording frame rate corresponding to the recording scene; wherein the frame rate determination factor includes object information contained in the scene and / or image attribute information of the scene.

7. The video recording system according to claim 6, characterized in that: In a case where the frame rate determination factor includes object information contained in a scene and image attribute information of the scene, the hardware abstraction layer is used to determine a candidate frame rate range based on the object information contained in the scene, and to determine a recording frame rate corresponding to the recording scene from the candidate frame rate range based on the image attribute information of the scene.

8. A video recording device, characterized in that: include: A preview configuration module, used to determine hardware configuration parameters in response to the operation of entering the slow motion mode, and start the video recording hardware according to the hardware configuration parameters; A scene determination module, used to perform scene recognition on the image data collected by the video recording hardware to determine the recording scene; A frame rate determination module, used to determine a recording frame rate corresponding to the recording scene; The video recording module is used to respond to a recording trigger operation and perform video recording based on the recording frame rate.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the video recording method according to any one of claims 1 to 4 is implemented.

10. An electronic device, characterized in that: include: processor; A memory, used to store one or more programs, when the one or more programs are executed by the processor, enables the processor to implement the video recording method as described in any one of claims 1 to 4.

Images