Information transmission method and device, electronic equipment and readable storage medium

Abstract

The invention discloses an information transmission method and device, electronic equipment and a readable storage medium, and belongs to the technical field of image processing. The method comprises the following steps: collecting a first video frame; acquiring first information corresponding to the first video frame through a first module of the electronic equipment, wherein the first information comprises at least one of exposure information, automatic focusing information and face detection information; first information is transmitted to a camera application of the electronic device by the first module using a first service for communication between the first module and the camera application.

Description

Technical Field

[0001] The present application belongs to the field of image processing technology, and specifically relates to an information transmission method, device, electronic device and readable storage medium. Background Art

[0002] With the continuous development of electronic equipment technology, electronic equipment has more and more shooting functions, such as automatic focusing, face detection, and exposure control during shooting.

[0003] Currently, in the preview process of shooting, the exposure information, autofocus information or face detection information of the current frame can be placed in metadata, and then the frame information and metadata of the current frame are transmitted together to the subsequent image signal processor (Image Signal Processor, ISP) and software algorithm module for processing. After the processing of each module is completed, the final processing result is returned through the ISP and application framework layer by layer to the camera application.

[0004] However, the module for obtaining shooting information such as exposure information, autofocus information or face detection information is located at the front end of the entire preview process, so that the shooting information can only be transmitted to the camera application after the entire preview process is completed, which has a high information transmission delay. As a result, the difference between the shooting information calculated at the current moment and the shooting information actually obtained by the camera application is too large. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide an information transmission method, device, electronic device and readable storage medium, which can reduce the difference between the shooting information calculated at the current moment and the shooting information actually obtained by the camera application.

[0006] In a first aspect, an embodiment of the present application provides an information transmission method, the method comprising: acquiring a first video frame; obtaining first information corresponding to the first video frame through a first module of an electronic device, the first information comprising at least one of the following: exposure information, autofocus information, face detection information; sending the first information to a camera application of the electronic device through the first module using a first service, the first service being used for communication between the first module and the camera application.

[0007] In a second aspect, an embodiment of the present application provides an information transmission device, which includes a collection module, an acquisition module and a sending module; the collection module is used to collect a first video frame; the acquisition module is used to obtain first information corresponding to the first video frame through a first module of the electronic device, and the first information includes at least one of the following: exposure information, autofocus information, face detection information; the sending module is used to send the first information to a camera application of the electronic device through the first module using a first service, and the first service is used for communication between the first module and the camera application.

[0008] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0009] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0010] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0011] In a sixth aspect, an embodiment of the present application provides a computer program / program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0012] In an embodiment of the present application, a first video frame can be captured; and first information corresponding to the first video frame can be obtained through a first module of an electronic device, the first information including at least one of the following: exposure information, autofocus information, and face detection information; and the first information can be sent to a camera application of the electronic device through a first service through the first module, and the first service is used for communication between the first module and the camera application. Through this solution, after obtaining at least one of the exposure information, autofocus information, and face detection information of the current frame, the module at the front end of the entire preview process can directly pass the obtained information to the camera application through the service used for communication between the module and the camera application, instead of being able to pass it to the camera application only after the entire preview process is completed, thereby reducing the information transmission delay and reducing the difference between the shooting information calculated at the current moment and the shooting information actually obtained by the camera application. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1It is a schematic diagram of a transmission path of exposure information in the related art;

[0014] Figure 2 This is one of the flow charts of the information transmission method provided in the embodiment of the present application;

[0015] Figure 3 This is the second flowchart of the information transmission method provided in the embodiment of the present application;

[0016] Figure 4 This is the third flowchart of the information transmission method provided in the embodiment of the present application;

[0017] Figure 5 This is the fourth flowchart of the information transmission method provided in the embodiment of the present application;

[0018] Figure 6 This is the fifth flowchart of the information transmission method provided in the embodiment of the present application;

[0019] Figure 7 is a schematic diagram of a transmission path of exposure information in the information transmission method provided in an embodiment of the present application;

[0020] Figure 8 is a schematic diagram of an information transmission device provided in an embodiment of the present application;

[0021] Fig. 9 is a schematic diagram of an electronic device provided in an embodiment of the present application;

[0022] Fig.10 It is a hardware schematic diagram of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0023] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0024] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0025] The term "indication" in this application can be a direct indication (or explicit indication) or an indirect indication (or implicit indication). A direct indication can be understood as the sender explicitly informing the receiver of specific information, operations to be performed, or request results in the sent indication; an indirect indication can be understood as the receiver determining the corresponding information according to the indication sent by the sender, or making a judgment and determining the operation to be performed or the request result according to the judgment result.

[0026] The terms "at least one (item)", "at least one of" and the like in the specification and claims of the present application refer to any one, any two or a combination of more than two of the objects included therein. For example, at least one (item) of a, b, and c can be represented by: "a", "b", "c", "a and b", "a and c", "b and c" and "a, b and c", where a, b, and c can be single or multiple. Similarly, "at least two (items)" refers to two or more, and its meaning is similar to that of "at least one (item)".

[0027] The following first explains the nouns or terms in the embodiments of the present application.

[0028] Image Signal Processor (ISP) is used to process the image signal output by the image signal sensor. ISP plays a core role in the camera system and is an important device in the camera. ISP completes the effect processing of digital images through a series of digital image processing algorithms.

[0029] Metadata is a concept in Android that is used to convey and describe additional information about a specific resource or component.

[0030] Automatic Exposure Control (AEC) is an automated function used in photography. It can help photographers or photographic equipment automatically adjust exposure parameters such as aperture, shutter speed or sensitivity to ensure appropriate exposure results under a variety of different lighting conditions.

[0031] Application framework layer (FrameWork): The application framework layer includes a series of APIs and tools provided to developers to implement and call system-level functions and features; the application framework layer is composed of various service and management modules.

[0032] The application layer (Application, APP) is composed of various applications installed on electronic devices, which are directly facing users and meet their different needs.

[0033] Image sensor (Sensor), Sensor is one of the core components of the camera, responsible for converting the light entering through the lens into electrical signals to form a digital image.

[0034] Android Interface Definition Language (Aidl), a language mechanism for implementing inter-process communication.

[0035] The information transmission method, device, electronic device and readable storage medium provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

[0036] With the continuous development of electronic equipment technology, electronic equipment has more and more shooting functions, such as automatic focusing, face detection, and exposure control during shooting.

[0037] For example, the three elements of exposure in photography (aperture, shutter and sensitivity) determine whether a photo can properly record the scene in front of the lens. In the camera system, the three elements are usually implemented through AEC. For example, when the camera application is taking pictures in high dynamic range imaging (HDR) or dark environment scenes, it often prompts the user that it is currently in the exposure process through shutter animation. The display time of the shutter animation is calculated by the exposure information given by the AEC module. Therefore, the transmission of exposure information calculated by the AEC module has become an important basic technology in the camera system.

[0038] At present, after obtaining the image information of the current frame, the AEC module can automatically adjust the exposure according to the brightness of the subject in the current frame, and feed back the calculated exposure information to the upper module. The upper module will pass the specified exposure parameters to the AEC module when taking pictures to control the exposure at the moment of taking pictures. The specific channel implementation of the AEC module is usually related to the platform ISP. Developers often need to design the corresponding system channel according to the characteristics of the current platform. Therefore, the overall channel design of the camera is often constrained by the special restrictions of different platforms. Because the transmission channel of exposure information is limited by the platform ISP architecture, different platforms have different information transmission delays, which brings different user experience and affects the final exposure effect of the photo in extreme scenarios.

[0039] For example, Figure 1As shown in the figure, in the normal camera preview process, the AEC module obtains the information of the current frame to calculate the exposure parameters and puts the calculation results in the metadata. Then the frame information and metadata are sent to the subsequent ISP and software algorithms (such as scene detection, face detection, etc.) for processing. After the processing of each module is completed, the final result is returned through the ISP and Framework layer by layer until it reaches the camera application.

[0040] However, the AEC module is located at the front end of the entire camera preview process, so the exposure information calculated by the AEC module can only be passed to the camera application after the entire camera preview process is completed, which has a high information transmission delay. When the ambient brightness and motion intensity change, it is easy for the exposure information calculated by the AEC module at the current moment to differ too much from the exposure information actually obtained by the camera application, resulting in poor shooting effects.

[0041] In order to solve the above problems, an information transmission method, device, electronic device and readable storage medium provided in the embodiments of the present application can be applied to the transmission scenario of at least one of exposure information, autofocus information and face detection information in the electronic device, and the present application is not limited thereto.

[0042] In a possible application scenario, taking the transmission of exposure information by an electronic device as an example, after capturing a first video frame, the electronic device can obtain the exposure information corresponding to the first video frame through the AEC module; and use the Aidl service 1 through the AEC module to send the exposure information to the camera application of the electronic device, and the Aidl service 1 is used for communication between the AEC module and the camera application.

[0043] In another possible application scenario, taking the transmission of autofocus information and face detection information by an electronic device as an example, after capturing a first video frame, the electronic device can obtain the autofocus information and face detection information corresponding to the first video frame through a detection module, and the detection module is used to obtain the autofocus information and face detection information of the video frame; and use the Aidl service 2 through the detection module to send the exposure information to the camera application of the electronic device, and the Aidl service 2 is used for communication between the detection module and the camera application.

[0044] Through the above scheme, in the normal camera preview process, after the AEC module obtains the frame information of the current frame, it can directly pass the acquired frame information of the current frame to the camera application through the aidl service. At the same time, these frame information and metadata are sent to the subsequent ISP and software algorithm for processing and use; wherein, the frame information includes at least one of exposure information, autofocus information and face detection information. The AEC module is located at the front end of the entire camera preview process, and returns the AEC module calculation results to the camera application in advance through the aidl service, without waiting for the subsequent process of the ISP, with a shorter information transmission delay, reducing the difference between the shooting information calculated at the current moment and the shooting information actually obtained by the camera application, which helps the camera application obtain more accurate exposure information and improves the user experience.

[0045] Furthermore, the shooting information feedback channels under different platforms can be unified to ensure the consistency of user experience and the uniformity of technical solutions, reduce the repetitive workload of repeatedly adapting platform-related channels, and reduce software maintenance costs.

[0046] It should be noted that the information transmission method provided in the embodiments of the present application can be executed by an information transmission device, an electronic device, or a functional module in an electronic device, etc. In some embodiments of the present application, an electronic device executing the information transmission method is taken as an example to illustrate the information transmission method provided in the embodiments of the present application.

[0047] Figure 2 FIG. 1 is a flow chart showing the information transmission method provided by an embodiment of the present application. Figure 2 As shown, the information transmission method provided in the embodiment of the present application may include the following steps 201 to 203.

[0048] Step 201: An electronic device captures a first video frame.

[0049] Optionally, in an embodiment of the present application, the electronic device may capture the first video frame through a camera in the electronic device.

[0050] Optionally, in an embodiment of the present application, the above-mentioned camera can be any possible camera such as an optical camera, an infrared camera, or an extended reality (Extended Reality, XR) camera, and the embodiment of the present application is not limited thereto.

[0051] Optionally, in an embodiment of the present application, after the electronic device captures the first video frame, the electronic device may display the first video frame in a shooting preview interface or a shooting interface of the electronic device.

[0052] Optionally, in an embodiment of the present application, the above-mentioned shooting preview interface can be an interface for displaying a shooting preview screen in a camera application of the electronic device, and the electronic device can display the shooting preview interface after the user triggers and selects the camera application; the above-mentioned shooting interface can be an interface for shooting by the camera application of the electronic device, and the electronic device can display the shooting interface after the user triggers the camera application to shoot.

[0053] Optionally, in an embodiment of the present application, the first video frame may be a video frame captured by the system at a current moment among a plurality of video frames continuously captured by the electronic device.

[0054] Step 202: The electronic device obtains first information corresponding to the first video frame through a first module of the electronic device.

[0055] The first information mentioned above includes at least one of the following: exposure information, auto focus information, and face detection information.

[0056] Optionally, in an embodiment of the present application, the above exposure information may also be referred to as exposure parameters, which may specifically include aperture, shutter, and sensitivity.

[0057] Optionally, in an embodiment of the present application, the above-mentioned autofocus information is used to adjust the density difference between adjacent pixels in the image to achieve real-time and accurate focusing of the image.

[0058] Optionally, in an embodiment of the present application, the above-mentioned face detection information is used to indicate the position of the face in the image, so as to accurately display the face detection frame in the image preview.

[0059] Optionally, in an embodiment of the present application, the first module may be a module for acquiring the first information.

[0060] For example, taking the example that the first information includes the exposure information, the first module may be an AEC module.

[0061] For another example, taking the example that the first information includes the exposure information and the face detection information, the first module includes an AEC module and a face detection module.

[0062] For the specific method for the first module to obtain the first information, please refer to the specific description in the relevant technology. In order to avoid repetition, it will not be repeated here.

[0063] Step 203: The electronic device sends first information to a camera application of the electronic device using a first service via a first module.

[0064] The first service is used for communication between the first module and the camera application.

[0065] Optionally, in the embodiment of the present application, the first service may be a newly constructed Aidl service, or any service in other systems used for communication between the first module and the camera application.

[0066] Optionally, in the embodiment of the present application, when building the Aidl service, the client and server of the Aidl service can be built at the same time.

[0067] It should be noted that the Aidl service is mainly used for inter-process communication in the Android system. The client of the Aidl service sends requests to the server of the Aidl service through the defined service interface, and the server processes these requests and returns the results to the client.

[0068] Specifically: Server: The server implements the method logic defined in the Aidl interface and processes the client's call request. The server is usually implemented by binding the service. After receiving the client's request, the server performs the corresponding operation and returns the result to the client. The server can also push information to the client through broadcast receivers or other mechanisms. Client: The client establishes a connection with the remote server through the binding service, calls the interface method provided by the server, and processes the result returned by the server. The client is the initiator of the request and is responsible for calling the server's method and processing the returned data. The client can also receive information pushed by the server by listening to the broadcast.

[0069] Optionally, in the embodiment of the present application, combined with Figure 2 ,like Figure 3 As shown, the above step 203 can be specifically implemented through the following steps 203a and 203b.

[0070] Step 203a: The electronic device sends first information to a server of the first service through the first module.

[0071] Optionally, in the embodiment of the present application, combined with Figure 3 ,like Figure 4 As shown, the above step 203a can be specifically implemented through the following steps 203a1 and 203a2.

[0072] Step 203a1: The electronic device obtains a client of the first service through the first module.

[0073] Optionally, in an embodiment of the present application, the first module may obtain a client of the first service through a service manager in the electronic device system.

[0074] It should be noted that the above service manager is a management tool for managing system services. Through the service manager, you can start and stop services; set services to start automatically, manually or disable; view relevant information of a service; set which user to start the service; set user logout, software, etc.

[0075] Step 203a2: The electronic device accesses the second interface through the client, and sends the first information to the server through the second interface.

[0076] The second interface is used to obtain and forward the information obtained by the first module.

[0077] Optionally, in an embodiment of the present application, the second interface may be an interface defined when building the first service.

[0078] Optionally, in the embodiment of the present application, the above-mentioned second interface can also be called an information parameter setting interface.

[0079] Optionally, in an embodiment of the present application, the second interface may obtain information transmitted by the first module, and forward the obtained information to the camera application through a callback function.

[0080] In an embodiment of the present application, since the above-mentioned first module can first obtain the client of the above-mentioned first service, and then access the second interface through the client, and send the above-mentioned first information to the server of the first service through the second interface, the first information obtained by the first module can be transmitted to the server of the first service, so that the server can forward it to the camera application.

[0081] Optionally, in the embodiment of the present application, the electronic device may also send the first information to the server of the first service through the first module in any other possible implementation manner, which is not limited in the embodiment of the present application.

[0082] Step 203b: When the server receives the first information, the electronic device sends the first information to the camera application through the server.

[0083] Optionally, in an embodiment of the present application, the server may first send the first information to an application framework layer of the electronic device, and then the application framework layer may send the first information to the camera application.

[0084] Optionally, in the embodiment of the present application, combined with Figure 3 ,like Figure 5 As shown, the above step 203b can be specifically implemented through the following step 203b1.

[0085] Step 203b1: When the server receives the first information, the electronic device executes a callback function through the server to send the first information to the camera application.

[0086] The callback function is a function registered by the camera application in the first service and used to obtain the information obtained by the first module.

[0087] Optionally, in an embodiment of the present application, the server may execute the callback function by accessing an interface of the callback function, which may be an interface defined when building the first service.

[0088] It should be noted that a callback function is a function that is passed as a parameter. The callback function can be implemented using a function pointer, a functor, or an anonymous function.

[0089] Optionally, in an embodiment of the present application, after executing the callback function, the first information may be directly sent to the camera application.

[0090] In the embodiment of the present application, since the electronic device can execute a callback function through the server to send the first information to the camera application, the process of sending the first information to the camera application can be simplified and the time for sending the first information can be reduced, so that the camera application can receive the first information in a timely manner.

[0091] Optionally, in the embodiment of the present application, the electronic device may also send the first information to the camera application through the server in any other possible implementation manner, which is not limited in the embodiment of the present application.

[0092] In the embodiment of the present application, the electronic device can directly forward the first information obtained by the first module to the camera application through the server of the first service, thereby simplifying the transmission process of the first information and reducing the information transmission delay.

[0093] Optionally, in the embodiment of the present application, combined with Figure 5 ,like Figure 6 As shown, before the above step 203b1, the information transmission method provided in the embodiment of the present application may also include the following steps A and B.

[0094] Step A: The electronic device obtains the client of the first service through the camera application.

[0095] Optionally, in an embodiment of the present application, the camera application may obtain the client of the first service through the service manager.

[0096] Step B: The electronic device accesses the first interface through the client, and registers the callback function on the server through the first interface.

[0097] The first interface is used for registering a callback function.

[0098] Optionally, in an embodiment of the present application, the first interface may be an interface defined when building the first service.

[0099] Optionally, in an embodiment of the present application, the above-mentioned first interface can also be called a callback function registration interface.

[0100] It can be understood that after the callback function is registered on the server, the server can directly send the first information to the camera application by executing the callback function.

[0101] It should be noted that the above Figure 6 The above step A and the above step B are only taken as an example to be executed before the above step 203b1 and after the above step 203a. In actual implementation, the step A and the step B can also be executed when setting up the above first service, or can be executed at any possible time, and the embodiments of the present application are not limited thereto.

[0102] In the embodiment of the present application, since the electronic device can access the first interface through the above-mentioned client and register the above-mentioned callback function on the above-mentioned server through the first interface, the callback function can be registered in advance so that the first information corresponding to each subsequent video frame can be quickly passed to the above-mentioned camera application through the callback function when it is transmitted.

[0103] The information transmission method provided in the embodiments of the present application is exemplarily described below in conjunction with the accompanying drawings.

[0104] For example, Figure 7 As shown, when the electronic device starts the camera application, the camera application can register the callback function for obtaining the information obtained by the above-mentioned first module to the above-mentioned first service. In the normal camera preview process, the first module obtains the information of the current frame to calculate the exposure information, autofocus information, face detection information and other shooting information, and places the calculated shooting information in metadata and the newly added service interface respectively. The service interface calls back the incoming shooting information to the application framework layer and the camera application through the callback function. At the same time, the frame information and metadata are sent to the subsequent ISP and software algorithm for processing and use.

[0105] In one example, when starting the camera application, the camera application can register the callback function for obtaining the calculation results of the AEC module to the aidl service. In the normal camera preview process, the AEC module obtains the information of the current frame to calculate the exposure parameters, and places the calculation results in the metadata and the newly added aidl interface respectively. The aidl interface calls back the incoming AEC module calculation results to the framework and camera application through the callback function. At the same time, the frame information and metadata are sent to the subsequent ISP and software algorithms for processing and use. The AEC module is located at the front end of the entire camera preview process, and returns the AEC module calculation results to the camera application in advance through the aidl service interface, without waiting for the subsequent process of the ISP. It has a shorter information transmission delay, which helps the camera application obtain more accurate exposure information and improve the user experience.

[0106] In the information transmission method provided in the embodiment of the present application, after the module located at the front end of the entire preview process obtains at least one of the exposure information, autofocus information and face detection information of the current frame, it can directly pass the obtained information to the camera application through the service used for communication between the module and the camera application, instead of only being able to pass it to the camera application after the entire preview process is completed, thereby reducing the information transmission delay and reducing the difference between the shooting information calculated at the current moment and the shooting information actually obtained by the camera application.

[0107] The above-mentioned method embodiments, or various possible implementation methods in each method embodiment, can be executed separately, or, under the premise that there is no contradiction, can also be executed in combination with each other. The specific implementation can be determined according to actual usage requirements, and the embodiments of the present application do not limit this.

[0108] The information transmission method provided in the embodiment of the present application can be executed by an information transmission device. In the embodiment of the present application, the information transmission device provided in the embodiment of the present application is described by taking the information transmission method executed by the information transmission device as an example.

[0109] like Figure 8 As shown, an embodiment of the present application provides an information transmission device 80 , which may include a collection module 81 , an acquisition module 82 and a sending module 83 .

[0110] Among them, the acquisition module 81 can be used to acquire a first video frame. The acquisition module 82 can be used to acquire first information corresponding to the first video frame through the first module of the electronic device, and the first information includes at least one of the following: exposure information, autofocus information, and face detection information. The sending module 83 can be used to send the first information to the camera application of the electronic device through the first module using a first service, and the first service is used for communication between the first module and the camera application.

[0111] In a possible implementation, the sending module 83 can be specifically used to send the above-mentioned first information to the server of the above-mentioned first service through the above-mentioned first module; and when the server receives the first information, send the first information to the above-mentioned camera application through the server.

[0112] In one possible implementation, the sending module 83 can be specifically used to execute a callback function through the server to send the first information to the camera application when the server receives the first information; wherein the callback function is a function registered by the camera application in the first service and used to obtain the information obtained by the first module.

[0113] In a possible implementation, the information transmission device 80 may further include a processing module. The acquisition module 82 may also be used to acquire the client of the first service through the camera application before the sending module 83 executes the callback function through the server. The processing module may be used to access the first interface through the client and register the callback function on the server through the first interface, and the first interface is used to register the callback function.

[0114] In a possible implementation, the sending module 83 may include an acquisition submodule and a processing submodule. The acquisition submodule may be used to acquire the client of the first service through the first module. The processing submodule may be used to access the second interface through the client and send the first information to the server through the second interface, and the second interface is used to acquire and forward the information acquired by the first module.

[0115] In the information transmission device provided in the embodiment of the present application, after obtaining at least one of the exposure information, autofocus information and face detection information of the current frame through a module located at the front end of the entire preview process, the information transmission device can directly pass the obtained information to the camera application through the service used for communication between the module and the camera application, rather than only being able to pass it to the camera application after the entire preview process is completed, thereby reducing the information transmission delay and reducing the difference between the shooting information calculated at the current moment and the shooting information actually obtained by the camera application.

[0116] The information transmission device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or it can be other devices other than the terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0117] The information transmission device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an IOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0118] The information transmission device provided in the embodiment of the present application can implement each process implemented in the above method embodiment and achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0119] like Fig. 9 As shown, an embodiment of the present application also provides an electronic device 100, including a processor 101 and a memory 102, wherein the memory 102 stores programs or instructions that can be executed on the processor 101, and when the program or instructions are executed by the processor 101, the various steps of the above-mentioned information transmission method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0120] It should be noted that the electronic devices in the embodiments of the present application include mobile electronic devices and non-mobile electronic devices.

[0121] Fig.10 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0122] like Fig.10As shown, the electronic device 1000 includes but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010 and other components.

[0123] Those skilled in the art will appreciate that the electronic device 1000 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1010 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.10 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0124] The sensor 1005 can be used to collect a first video frame. The processor 1010 can be used to obtain first information corresponding to the first video frame through a first module of the electronic device, the first information including at least one of the following: exposure information, autofocus information, and face detection information; and send the first information to a camera application of the electronic device through the first module using a first service, the first service being used for communication between the first module and the camera application.

[0125] In a possible implementation, the processor 1010 may be specifically configured to send the first information to the server of the first service through the first module; and when the server receives the first information, send the first information to the camera application through the server.

[0126] In one possible implementation, the processor 1010 can be specifically used to execute a callback function through the server to send the first information to the camera application when the server receives the first information; wherein the callback function is a function registered by the camera application in the first service and used to obtain the information obtained by the first module.

[0127] In one possible implementation, the processor 1010 can also be used to obtain the client of the above-mentioned first service through the above-mentioned camera application before executing the above-mentioned callback function through the above-mentioned server; and access the first interface through the client, and register the callback function on the server through the first interface, and the first interface is used for registration of the callback function.

[0128] In one possible implementation, the processor 1010 can be specifically used to obtain the client of the above-mentioned first service through the above-mentioned first module; and access the second interface through the client, and send the above-mentioned first information to the above-mentioned server through the second interface, and the second interface is used to obtain and forward the information obtained by the first module.

[0129] In the electronic device provided in the embodiment of the present application, after obtaining at least one of the exposure information, autofocus information and face detection information of the current frame through a module located at the front end of the entire preview process, the electronic device can directly pass the obtained information to the camera application through a service for communication between the module and the camera application, rather than having to pass it to the camera application after the entire preview process is completed, thereby reducing the information transmission delay and reducing the difference between the shooting information calculated at the current moment and the shooting information actually obtained by the camera application.

[0130] It should be understood that in the embodiment of the present application, the input unit 1004 may include a graphics processor (Graphics Processing Unit, GPU) 10041 and a microphone 10042, and the graphics processor 10041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and at least one of other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include two parts: a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0131] The memory 1009 can be used to store software programs and various data. The memory 1009 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1009 may include a volatile memory or a non-volatile memory, or the memory 1009 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1009 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0132] The processor 1010 may include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1010.

[0133] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned information transmission method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0134] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0135] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned information transmission method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0136] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0137] An embodiment of the present application provides a computer program / program product, which is stored in a storage medium. The program / program product is executed by at least one processor to implement the various processes of the above-mentioned information transmission method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0138] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0139] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0140] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An information transmission method, characterized in that: The method comprises: Capturing a first video frame; Acquiring first information corresponding to the first video frame through a first module of the electronic device, where the first information includes at least one of the following: exposure information, autofocus information, and face detection information; The first information is sent to a camera application of the electronic device by using a first service through the first module, where the first service is used for communication between the first module and the camera application.

2. The method according to claim 1, characterized in that: The sending the first information to the camera application of the electronic device by using the first service through the first module includes: Sending the first information to the server of the first service through the first module; When the server receives the first information, the server sends the first information to the camera application.

3. The method according to claim 2, characterized in that The sending the first information to the camera application through the server includes: Executing a callback function through the server to send the first information to the camera application; The callback function is a function registered by the camera application in the first service and used to obtain the information obtained by the first module.

4. The method according to claim 3, characterized in that: Before executing the callback function by the server, the method further includes: A client that obtains the first service through the camera application; The first interface is accessed through the client, and the callback function is registered on the server through the first interface, where the first interface is used for callback function registration.

5. The method according to any one of claims 2 to 4, characterized in that The sending the first information to the server of the first service through the first module includes: Acquire a client of the first service through the first module; The second interface is accessed through the client, and the first information is sent to the server through the second interface, where the second interface is used to obtain and forward the information obtained by the first module.

6. An information transmission device, characterized in that: The device comprises a collection module, an acquisition module and a sending module; The acquisition module is used to acquire the first video frame; The acquisition module is used to acquire first information corresponding to the first video frame through a first module of the electronic device, where the first information includes at least one of the following: exposure information, auto focus information, and face detection information; The sending module is used to send the first information to the camera application of the electronic device through the first module using a first service, and the first service is used for communication between the first module and the camera application.

7. The device according to claim 6, characterized in that The sending module is specifically configured to send the first information to the server of the first service through the first module; and when the server receives the first information, send the first information to the camera application through the server.

8. The device according to claim 7, characterized in that The sending module is specifically configured to execute a callback function through the server to send the first information to the camera application; The callback function is a function registered by the camera application in the first service and used to obtain the information obtained by the first module.

9. The device according to claim 8, characterized in that The device also includes a processing module; The acquisition module is further configured to acquire the client of the first service through the camera application before the sending module executes the callback function through the server; The processing module is used to access the first interface through the client, and register the callback function on the server through the first interface, where the first interface is used for callback function registration.

10. The device according to any one of claims 7 to 9, characterized in that The sending module includes an acquisition submodule and a processing submodule; The acquisition submodule is used to acquire the client of the first service through the first module; The processing submodule is used to access the second interface through the client and send the first information to the server through the second interface, and the second interface is used to obtain and forward the information obtained by the first module.

11. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the information transmission method according to any one of claims 1 to 5 are implemented.

12. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the information transmission method according to any one of claims 1 to 5 are implemented.

Images