Mobile terminal, video acquisition method and device, computer-readable storage medium

By setting the microphone radio end on the backplate side of the mobile terminal, the problem of inconsistent direction between the camera and the microphone is solved, the sound and video are matched, and the user experience is improved.

CN114079676BActive Publication Date: 2025-07-08BEIJING XIAOMI MOBILE SOFTWARE CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202010797322.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-08-10
Publication Date
2025-07-08
Estimated Expiration
2040-08-10

AI Technical Summary

Technical Problem

The shooting direction of the mobile terminal camera is different from the radio direction of the microphone, which causes the sound and image to not match the video recording, and the user experience is poor.

Method used

The audio end of the microphone is set on the backplane side of the light acquisition area of the camera, so that both the external sound source and the light are collected on the backplane side, transmitted to the microphone module through the audio channel, and the sound source volume is adjusted through the algorithm to match the video screen.

Benefits of technology

The shooting direction of the camera module is consistent with the sound pick-up direction of the microphone module, improving the user experience and matching the sound information with the video picture.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114079676B_ABST
    Figure CN114079676B_ABST
Patent Text Reader

Abstract

The present disclosure relates to a mobile terminal, a video acquisition method and device, and a computer-readable storage medium. The mobile terminal includes: a microphone module, a camera module, the camera module including a lens, and the mobile terminal includes a light acquisition area disposed on the back plate side and facing the lens; a sound collection channel, the sound collection channel including a sound collection end and a sound output end, the sound collection end communicating with the outside of the mobile terminal, and the sound collection end being disposed on the back plate side so that the sound of an external sound source and external light are both collected on the back plate side of the mobile terminal, and the sound output end communicating with the microphone module.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the technical field of terminals, and in particular, to a mobile terminal, a video acquisition method and device, and a computer-readable storage medium. Background Art

[0002] The photographing functions configured in mobile terminals such as mobile phone terminals are becoming increasingly powerful. For example, the cameras of mobile terminals usually have a zoom function to clearly photograph distant shooting objects. However, in the related art, the light-gathering area of the camera is generally set on the back, while the microphone is set on the side of the mobile terminal. This results in different shooting directions of the camera and the sound collection direction of the microphone. Therefore, in the video images recorded by the mobile terminal, the propagation direction of the sound is different from the shooting direction of the camera, resulting in a mismatch between the sound and the video image, and poor user experience. Summary of the Invention

[0003] The present disclosure provides a mobile terminal, a video acquisition method and device, and a computer-readable storage medium to solve the deficiencies in the related art.

[0004] According to a first aspect of an embodiment of the present disclosure, a mobile terminal is provided, including:

[0005] A microphone module;

[0006] A camera module, the camera module includes a lens, and the mobile terminal includes a light collection area provided on the back plate side and facing the lens;

[0007] A sound collection channel, the sound collection channel includes a sound collection end and a sound output end, the sound collection end is connected to the outside of the mobile terminal, and the sound collection end is provided on the back plate side so that the sound of an external sound source and external light are both collected on the back plate side of the mobile terminal, and the sound output end is connected to the microphone module.

[0008] Optionally, the camera module includes a plurality of lenses, the back plate side of the mobile terminal includes a plurality of light collection areas corresponding to the plurality of lenses one by one, and the sound collection end is provided in the middle area of the plurality of light collection areas.

[0009] Optionally, the sound collection end is surrounded by the plurality of light collection areas, or the sound collection end is provided at the central position of the plurality of light collection areas, or the sound collection end is provided between any two of the plurality of light collection areas.

[0010] Optionally, the camera module includes a single lens, and the sound collection end is adjacent to the light collection area facing the single lens.

[0011] Optionally, the sound receiving end extends in the thickness direction of the mobile terminal to the sound output end to form the sound receiving channel.

[0012] Optionally, in the thickness direction of the mobile terminal, at least a part of the projection of the sound receiving end does not coincide with the projection of the sound output end.

[0013] Optionally, the mobile terminal further includes at least one dust-proof net disposed in the sound receiving channel.

[0014] Optionally, the mobile terminal includes a first dust-proof net and a second dust-proof net. The first dust-proof net is disposed near the sound receiving end, the second dust-proof net is disposed near the sound output end, and the mesh density of the first dust-proof net is greater than that of the second dust-proof net.

[0015] Optionally, the mobile terminal further includes a first decorative sheet disposed on the back panel side. The light collection area is formed on the first decorative sheet, and the sound receiving end penetrates through the first decorative sheet.

[0016] Optionally, the camera module includes a protective bracket. The protective bracket includes a lens hole facing the lens. The first decorative sheet covers the lens hole, and the sound receiving channel penetrates through the protective bracket to communicate the sound receiving end and the sound output end.

[0017] Optionally, further includes:

[0018] A rubber sleeve that is sleeved on the microphone module, and the rubber sleeve seals the area where the sound output end communicates with the microphone module.

[0019] Optionally, the mobile terminal further includes a second decorative sheet disposed on the back panel side. When the microphone module is in the sound receiving state, the second decorative sheet is away from the sound receiving end. When the microphone module stops receiving sound, the second decorative sheet shields the sound receiving end.

[0020] According to a second aspect of the embodiments of the present disclosure, a video acquisition method is provided, which is applied to the mobile terminal according to any one of the above embodiments. The video acquisition method includes:

[0021] When collecting a video image through the camera module, start the microphone module;

[0022] Receive a focusing instruction for the camera module;

[0023] Adjust the video image collected by the camera module and the sound information collected by the microphone module according to the focusing instruction, so that the sound information matches the video image.

[0024] Optionally, the sound information includes volume. Adjusting the video picture captured by the camera module and the sound information captured by the microphone module according to the focusing instruction includes:

[0025] Amplifying the volume according to the focusing instruction;

[0026] Reducing the volume according to the focusing instruction.

[0027] Optionally, the mobile terminal includes a plurality of microphone modules, and at least one microphone module of the plurality of microphone modules picks up sound on the non-back plate side of the mobile terminal;

[0028] Adjusting the video picture captured by the camera module and the sound information captured by the microphone module according to the focusing instruction includes:

[0029] Suppressing the sound information captured by the at least one microphone module.

[0030] According to a third aspect of the embodiments of the present disclosure, there is provided a video acquisition device applied to the mobile terminal according to any one of the above embodiments. The video acquisition device includes:

[0031] A start module that starts the microphone module when capturing a video picture through the camera module;

[0032] A receiving module that receives a focusing instruction for the camera module;

[0033] An adjustment module that adjusts the video picture captured by the camera module and the sound information captured by the microphone module according to the focusing instruction so that the sound information matches the video picture.

[0034] Optionally, the sound information includes volume. According to the adjustment module, it includes:

[0035] An amplifying unit that amplifies the volume according to the focusing instruction;

[0036] A reducing unit that reduces the volume according to the focusing instruction.

[0037] Optionally, the mobile terminal includes a plurality of microphone modules, and at least one microphone module of the plurality of microphone modules picks up sound on the non-back plate side of the mobile terminal;

[0038] The adjustment module includes;

[0039] A noise reduction unit that suppresses the sound information captured by the at least one microphone module.

[0040] According to a fourth aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium having computer instructions stored thereon, and when the instructions are executed by a processor, the steps of the method described in any one of the above embodiments are implemented.

[0041] According to a fifth aspect of the embodiments of the present disclosure, there is provided an electronic device, including:

[0042] a processor;

[0043] a memory for storing instructions executable by the processor;

[0044] wherein the processor is configured to implement the steps of the method described in any one of the above embodiments.

[0045] The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

[0046] As can be seen from the above embodiments, in the present disclosure, by arranging the sound receiving end on the back plate side where the light collection area is formed, both the external sound source information and the external light can be collected on the back plate side of the mobile terminal. Thus, when the user holds the mobile terminal to shoot a video picture, both the light incident direction and the sound source information direction are towards the back plate side of the mobile terminal, and the shooting direction of the camera module is basically the same as the sound pickup direction of the microphone module. The captured image perceived by the user is basically matched with the sound source direction, improving the user experience.

[0047] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present disclosure and used together with the specification to explain the principles of the present disclosure.

[0049] Figure 1 is a schematic structural diagram of a mobile terminal shown according to an exemplary embodiment.

[0050] Figure 2 is a partial cross-sectional schematic diagram of a mobile terminal shown according to an exemplary embodiment.

[0051] Figure 3 is a schematic structural diagram of another mobile terminal shown according to an exemplary embodiment.

[0052] Figure 4 is a schematic structural diagram of still another mobile terminal shown according to an exemplary embodiment.

[0053] Figure 5 is a flowchart of a video collection shown according to an exemplary embodiment.

[0054] Figure 6 is a block diagram of a video acquisition device shown according to an exemplary embodiment.

[0055] Figure 7 is a block diagram of another video acquisition device shown according to an exemplary embodiment.

[0056] Figure 8 is a block diagram of yet another video acquisition device shown according to an exemplary embodiment.

[0057] Figure 9 is a block diagram of a video acquisition device shown according to an exemplary embodiment. Detailed implementation manners

[0058] Here, exemplary embodiments will be described in detail, and examples thereof are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with the present disclosure. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0059] The terms used in the present disclosure are for the purpose of describing specific embodiments only and are not intended to limit the present disclosure. The singular forms "a", "the", and "said" used in the present disclosure and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" as used herein refers to and includes any or all possible combinations of one or more of the associated listed items.

[0060] It should be understood that although the terms first, second, third, etc. may be used in the present disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present disclosure, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "when" or "while" or "in response to determining".

[0061] Figure 1 is a schematic structural diagram of a mobile terminal 100 shown according to an exemplary embodiment. Figure 2 is a partial cross-sectional schematic diagram of a mobile terminal 100 shown according to an exemplary embodiment. As Figure 1 , Figure 2As shown, the mobile terminal 100 may include a camera module 1, a microphone module 2, and a sound receiving channel 3. Among them, the camera module 1 may include a camera body (not shown) and a lens (not shown) connected to the camera body. In the mobile terminal 100, a light collection area may be provided on the back panel side and facing the lens. External light may enter the camera body through the light collection area for imaging.

[0062] The microphone module 2 may be disposed adjacent to the camera module 1, or the camera module 1 may also be spaced apart from the microphone module 2 by a certain distance, which may be a certain distance in the thickness direction of the mobile terminal 100 or a certain distance in a direction perpendicular to the thickness direction, and may be specifically set according to the component layout inside the mobile terminal 100. The sound receiving channel 3 may include a sound receiving end 31 and a sound output end 32. The sound output end 32 may communicate with the microphone module 2, and the sound receiving end 31 may communicate with the outside of the mobile terminal 100, so that the sound emitted by an external sound source can be transmitted to the microphone module 2 through the sound receiving channel 3. Further, the sound receiving end 31 is provided on the back panel side of the mobile terminal 31, so that both the external sound source information and the external light can be collected on the back panel side of the mobile terminal 100. Thus, when the user holds the mobile terminal 100 to shoot a video picture, both the incident light direction and the sound source information direction are towards the back panel side of the mobile terminal 100, and the shooting direction of the camera module 1 is basically the same as the sound pickup direction of the microphone module 2, and the captured image perceived by the user is basically matched with the sound source direction. Moreover, further, an internal algorithm can be combined to adjust the volume of the sound source according to the zoom situation of the camera module. When the shooting object is brought closer to the user through zooming, the sound source volume is increased, and when the shooting object is moved away from the user through zooming, the sound source volume is decreased; at the same time, one or more microphones away from the camera module may be provided on the mobile terminal 100, and the sound pickup situation of the microphones away from the camera module can also be suppressed through the zoom situation to achieve the purpose of noise reduction. Among them, both the sound receiving end 31 and the sound output end 32 may be circularly arranged, and the diameter of the circular hole may be between 0.8 mm and 1 mm, or may be other shapes in other embodiments, such as square or triangular or other irregular shapes, and the present disclosure does not limit this.

[0063] Among them, the camera module 1 may include multiple lenses. On the back panel side of the mobile terminal 100, multiple light collection areas corresponding to the multiple lenses one by one may be formed, and the sound receiving end 31 may be disposed in the middle of the multiple light collection areas. For example, in Figure 1 In an embodiment, the camera module 1 of the mobile terminal 100 may include three lenses, and the three lenses are arranged in a straight line in sequence, and the sound receiving end 31 may be disposed at Figure 1between the first lens and the second lens in the top-down direction in the [device], or, in other embodiments, the sound receiving end 31 may be disposed Figure 1 between the second lens and the third lens in the top-down direction in the [device]. Or, in other embodiments, as Figure 3 shown, the multiple light collection areas may be disposed around the sound receiving end 31. Further, the sound receiving end 31 may be disposed at the center of the light collection area. Figure 3 Taking the camera module 1 including four lenses arranged in a rectangle as an example for illustration. In other embodiments, they may also be arranged in a circular shape or other regular shapes, and the present disclosure does not limit this. Of course, as Figure 4 shown, in still some other embodiments, the camera module 1 may also include only a single lens, and a single light collection area corresponding to the single lens is formed on the back plate side of the mobile terminal 100. At this time, the sound receiving end 31 may be disposed with the single light collection area to further improve the consistency between the shooting direction of the camera module 1 and the sound pickup direction of the microphone module 2.

[0064] In one embodiment, in the thickness direction of the mobile terminal 100, at least a part of the projection of the sound receiving end 31 does not coincide with the projection of the sound output end 32. For example, as Figure 2 shown, in the thickness direction of the mobile terminal 100, the projection of the sound receiving end 31 is completely separated from the projection of the sound output end 32, that is, the sound receiving channel 3 may be set to be curved. Thus, when an external foreign object is inserted into the sound receiving channel 3 through the sound receiving end 31, it cannot directly reach the sound output end 32, thereby reducing the probability of damaging the microphone module 2. Of course, in another embodiment, the sound receiving end 31 may also extend to the sound output end 32 in the thickness direction of the mobile terminal 100, that is, the sound receiving channel 3 may be set to be straight, simplifying the manufacturing process, reducing the propagation path of sound in the mobile terminal 100, and reducing losses.

[0065] Since the sound receiving channel 3 communicates with the outside of the mobile terminal 100, in order to reduce the probability of external dust or other impurities entering the inside of the mobile terminal 100, as Figure 2 shown, the mobile terminal 100 may include a first dust-proof net 4 and a second dust-proof net 5. The first dust-proof net 4 may be disposed close to the sound receiving end 31, and the second dust-proof net 5 may be disposed close to the sound output end 32, so as to provide double protection. Further, since the first dust-proof net 4 is disposed close to the sound receiving end 31, that is, closer to the outside of the mobile terminal 100 than the second dust-proof net 4, the mesh density of the first dust-proof net 4 may be set to be larger, while the mesh density of the second dust-proof net 5 may be set to be smaller. In this way, most of the dust and foreign objects can be blocked by the first dust-proof net 4, and the larger mesh density of the second dust-proof net 5 can reduce the blockage of sound. Of course, in Figure 2In an embodiment, taking the mobile terminal 100 including a first dust screen 4 and a second dust screen 5 as an example for illustration, in other embodiments, the mobile terminal 100 may also include one dust screen, and in some other embodiments, it may also include three or more dust screens. When the mobile terminal 100 includes three or more dust screens, the mesh density of the dust screen is inversely proportional to the interval distance between the dust screen and the sound receiving end 32.

[0066] In each of the above embodiments, the sound receiving end 31 and the sound output end 32 of the sound receiving channel 3 need to be communicated, so that corresponding openings need to be provided in the structure disposed between the microphone module 1 and the sound receiving end 31 within the mobile terminal 100. For example, Figure 2 As shown in the figure, the mobile terminal 100 may further include a first decorative sheet 6, a metal bracket 7, a protection bracket 8, a circuit board 9, and a housing 10. Among them, the first decorative sheet 6 is disposed on the back plate side of the mobile terminal 100, a light collection area may be formed on the first decorative sheet 6, and the sound receiving end 31 may penetrate through the first decorative sheet 6. The metal bracket 7 may be connected to the housing 10, and the metal bracket 7 may protrude from the surface of the housing 10 to adapt to the height of the camera module 1. The protection bracket 8 is adapted to the camera module 1, and the protection bracket 8 is farther from the first decorative sheet 6 than the metal bracket 7. The protection bracket 8 may include a lens hole facing the lens, and the metal bracket 7 may include an opening communicating with the lens hole so that external light can enter the lens. The first decorative sheet 6 may cover the openings on the metal bracket 7 and the protection bracket 8, and the sound receiving channel 3 may penetrate through the metal bracket 7, the protection bracket 8, and the first decorative sheet 6.

[0067] The circuit board 9 may be connected to the side of the protection bracket 7 away from the first decorative sheet 6, and the circuit board 9 may be electrically connected to the microphone module 2. The circuit board 9 may also be electrically connected to the main board of the mobile terminal through a metal elastic sheet. An opening may be formed on the circuit board 9 to form a sound output end 32 facing the microphone module 2. Among them, as Figure 2 shown, the first dust screen 4 is disposed between the first decorative sheet 6 and the metal bracket 7, and the second dust screen 5 may be disposed between the circuit board 9 and the protection bracket 8. Further, in order to ensure the sealing performance of the sound receiving channel 3 and improve the sound receiving effect, a sealing layer may be provided between two adjacent parts. For example, a first sealing layer 11 may also be provided between the first decorative sheet 6 and the metal bracket 7, a second sealing layer 12 may be provided between the metal bracket 7 and the protection bracket 8, and a third sealing layer 13 may be provided between the protection bracket 8 and the circuit board 9. The first sealing layer 11, the second sealing layer 12, and the third sealing layer 13 may be sealed in the circumferential direction of the sound receiving channel 3. The first sealing layer 11, the second sealing layer 12, and the third sealing layer 13 may include sealing foam or sealing glue, etc., and the present disclosure does not limit this.

[0068] In each of the above embodiments, the mobile terminal 100 may further include a rubber sleeve 14 which can be sleeved outside the microphone module 2. When other components in the mobile terminal 100 press against the rubber sleeve 14, the rubber sleeve 14 can apply a force towards the circuit board 9 to the microphone module 2. The housing 10 may be connected to the metal bracket 7 which protrudes from the housing 10. During the process of fixing the housing 10, the housing 10 can apply a force towards the circuit board 9 to the metal bracket 7. Thus, through the forces applied by the housing 10 and the rubber sleeve 14 in opposite directions, the rubber sleeve 14 can be pressed against the circuit board 9, so that the rubber sleeve 14 can seal the area where the sound output end 32 communicates with the microphone module 2, and further can press against the second sealing layer 12 and the third sealing layer 13, reducing the internal gaps between the second sealing layer 12 and the third sealing layer 13, and further improving the sealing performance of the sound collection channel 3.

[0069] The mobile terminal further includes a second decorative piece (not shown) disposed on the back panel side of the mobile terminal 100. When the microphone module 2 is in the sound collection state, the second decorative piece is away from the sound input end 31 to avoid blocking the sound transmission. When the microphone module 2 stops collecting sound, the second decorative piece can cover the sound input end 31 to play a role in dust prevention and waterproofing.

[0070] Based on the mobile terminal 100 provided in the above embodiments, the present disclosure further provides a video acquisition method, as Figure 5 shown, the video acquisition method may include the following steps:

[0071] In step 501, when collecting a video image through the camera module, the microphone module is started.

[0072] In this embodiment, when the mobile terminal 100 receives a start instruction for the user to start the camera module 1 for video acquisition, the microphone module 2 is started in its entirety to collect sound information consistent with the shooting object through the microphone module 2.

[0073] In step 502, a focusing instruction for the camera module is received.

[0074] In this embodiment, a focusing instruction input by the user through touching a virtual button or a physical button of the mobile terminal 100 or a swipe on the display screen can be received to adjust the focal length of the camera module 1 according to the focusing instruction.

[0075] In step 503, the video image collected by the camera module and the sound information collected by the microphone module are adjusted according to the focusing instruction so that the sound information matches the video image.

[0076] In this embodiment, the video picture captured by the camera module can be adjusted according to the focusing instruction, and at the same time, the sound information captured by the microphone module can be adjusted, so that the captured sound information can match the video picture, that is, when the user views the captured video picture, the sound information emitted by the shooting object can be obtained. For example, when the shooting picture at a long distance is zoomed in through the focusing instruction, the volume can be increased, and when the shooting picture at a short distance is zoomed out through the focusing instruction, the volume can be decreased, so as to realize the matching of the sound size and the distance of the object.

[0077] Further, the mobile terminal may include a plurality of microphone modules, and at least one microphone module of the plurality of microphone modules receives sound on the non-back plate side of the mobile terminal 100. For example, the sound can be received on the side of the mobile terminal 100. Then, during the video capture process, the at least one microphone module is very likely to capture the sound emitted by the shooting user, and this sound will also become noise in the video picture. Therefore, the sound information captured by the at least one microphone module can also be adjusted according to the focus, for example, it can be reduced or eliminated.

[0078] Corresponding to the foregoing embodiments of the video capture method, the present disclosure also provides an embodiment of a video capture device.

[0079] Figure 6 is a block diagram of a video capture device shown according to an exemplary embodiment. Refer to Figure 6 In this, the device is applied to the mobile terminal 100 described in any one of the above, and the video capture device includes a start module 601, a reception module 602, and an adjustment module 603, where:

[0080] The start module 601 starts the microphone module when capturing a video picture through the camera module;

[0081] The reception module 602 receives a focusing instruction for the camera module;

[0082] The adjustment module 603 adjusts the video picture captured by the camera module and the sound information captured by the microphone module according to the focusing instruction, so that the sound information matches the video picture.

[0083] As Figure 7 shown, Figure 7 is a block diagram of another video capture device shown according to an exemplary embodiment. Based on the embodiment shown in the foregoing Figure 6 In the embodiment shown, the sound information includes volume, and the adjustment module 603 may include: a magnification unit 613 and a reduction unit 623, where:

[0084] The magnification unit 613 increases the volume according to the focusing instruction.

[0085] The reduction unit 623 reduces the volume according to the focusing instruction.

[0086] Figure 8 As shown, Figure 8 is a block diagram of another video acquisition device shown according to an exemplary embodiment, which is based on the foregoing Figure 6 shown embodiment. The mobile terminal includes a plurality of microphone modules, and at least one microphone module of the plurality of microphone modules receives sound on the non-back plate side of the mobile terminal; the adjustment module 603 includes;

[0087] The noise reduction unit 633 suppresses the sound information collected by the at least one microphone module.

[0088] It should be noted that the structure of the noise reduction unit 633 in the above Figure 8 shown device embodiment may also be included in the foregoing Figure 7 device embodiment, and the present disclosure does not limit this.

[0089] Regarding the device in the above embodiments, the specific manner in which each module performs operations has been described in detail in the embodiments related to the method, and will not be elaborated here.

[0090] For the device embodiments, since they basically correspond to the method embodiments, the relevant parts can be referred to the descriptions of the method embodiments. The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the present disclosure solution. Those of ordinary skill in the art can understand and implement it without creative work.

[0091] Correspondingly, the present disclosure also provides a video acquisition device, which applies the mobile terminal in any of the foregoing embodiments, including: a processor; a memory for storing instructions executable by the processor; wherein, the processor is configured to: when collecting a video image through the camera module, start the microphone module; receive a focusing instruction for the camera module; adjust the video image collected by the camera module and the sound information collected by the microphone module according to the focusing instruction, so that the sound information matches the video image.

[0092] Correspondingly, the present disclosure also provides a terminal, which includes a memory and one or more programs. One or more programs are stored in the memory and configured to be executed by one or more processors. The one or more programs include instructions for performing the following operations: when collecting a video image through the camera module, starting the microphone module; receiving a focusing instruction for the camera module; and adjusting the video image collected by the camera module and the sound information collected by the microphone module according to the focusing instruction, so that the sound information matches the video image.

[0093] Figure 9 FIG. 900 is a block diagram of a video capture device 900 according to an exemplary embodiment. For example, device 900 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0094] Referring to Figure 9 , device 900 may include one or more of the following components: a processing component 902, a memory 904, a power component 906, a multimedia component 908, an audio component 910, an input / output (I / O) interface 912, a sensor component 914, and a communication component 916.

[0095] The processing component 902 generally controls the overall operation of the device 900, such as operations associated with display, telephone calls, data communication, camera operations, and recording operations. The processing component 902 may include one or more processors 920 to execute instructions to complete all or part of the steps of the above method. In addition, the processing component 902 may include one or more modules to facilitate the interaction between the processing component 902 and other components. For example, the processing component 902 may include a multimedia module to facilitate the interaction between the multimedia component 908 and the processing component 902.

[0096] The memory 904 is configured to store various types of data to support the operation of the device 900. Examples of these data include instructions for any application program or method operating on the device 900, contact data, phone book data, messages, pictures, videos, etc. The memory 904 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, a magnetic disk, or an optical disk.

[0097] The power supply component 906 provides power for various components of the device 900. The power supply component 906 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 900.

[0098] The multimedia component 908 includes a screen that provides an output interface between the device 900 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors can not only sense the boundaries of the touch or swipe actions, but also detect the duration and pressure associated with the touch or swipe operation. In some embodiments, the multimedia component 908 includes a front camera and / or a rear camera. When the device 900 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each of the front camera and the rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.

[0099] The audio component 910 is configured to output and / or input audio signals. For example, the audio component 910 includes a microphone (MIC) that is configured to receive external audio signals when the device 900 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals can be further stored in the memory 904 or transmitted via the communication component 916. In some embodiments, the audio component 910 further includes a speaker for outputting audio signals.

[0100] The I / O interface 912 provides an interface between the processing component 902 and a peripheral interface module, and the peripheral interface module can be a keyboard, a click wheel, buttons, etc. These buttons can include but are not limited to: a home button, a volume button, a power-on button, and a lock button.

[0101] The sensor assembly 914 includes one or more sensors for providing a status assessment of various aspects of the device 900. For example, the sensor assembly 914 can detect the on / off state of the device 900, the relative positioning of components, such as the display and keypad of the device 900. The sensor assembly 914 can also detect a change in the position of the device 900 or a component of the device 900, the presence or absence of user contact with the device 900, the orientation or acceleration / deceleration of the device 900, and a change in the temperature of the device 900. The sensor assembly 914 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 914 can also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 914 can also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0102] The communication component 916 is configured to facilitate communication between the device 900 and other devices in a wired or wireless manner. The device 900 can access a wireless network based on communication standards, such as WiFi, 2G or 3G, 4G LTE, 5G NR, or a combination thereof. In an exemplary embodiment, the communication component 916 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 916 further includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0103] In an exemplary embodiment, the device 900 can be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the above method.

[0104] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 904 including instructions that can be executed by a processor 920 of the device 900 to complete the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device, etc.

[0105] Other embodiments of the present disclosure will be readily apparent to those skilled in the art in view of the specification and practice of the disclosure herein. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include known common general knowledge or conventional technical means in the technical field not disclosed in the present disclosure. The specification and examples are only to be considered as exemplary, and the true scope and spirit of the present disclosure are pointed out by the following claims.

[0106] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.

Claims

1. A mobile terminal, characterized in that, Comprising: A microphone module; A camera module, the camera module including a lens, and the mobile terminal including a light collection area provided on the back plate side and facing the lens; A sound receiving channel, the sound receiving channel including a sound receiving end and a sound output end, the sound receiving end communicating with the outside of the mobile terminal, and the sound receiving end being provided on the back plate side so that external sound sources and external light are both collected on the back plate side of the mobile terminal, and the sound output end communicating with the microphone module; In the thickness direction of the mobile terminal, at least a part of the projection of the sound receiving end does not coincide with the projection of the sound output end; the sound receiving end is adjacent to the camera module.

2. The mobile terminal according to claim 1, wherein The camera module includes a plurality of lenses, and the back plate side of the mobile terminal includes a plurality of light collection areas corresponding to the plurality of lenses one by one, and the sound receiving end is provided in the middle area of the plurality of light collection areas.

3. The mobile terminal according to claim 2, wherein, The sound receiving end is surrounded by the plurality of light collection areas, or the sound receiving end is provided at the central position of the plurality of light collection areas, or the sound receiving end is provided between any two of the plurality of light collection areas.

4. The mobile terminal according to claim 2, characterized in that The camera module includes a single lens, and the sound receiving end is adjacent to the light collection area facing the single lens.

5. The mobile terminal according to claim 1, characterized in that The mobile terminal further includes at least one dust-proof net provided in the sound receiving channel.

6. The mobile terminal according to claim 5, wherein The mobile terminal includes a first dust-proof net and a second dust-proof net, the first dust-proof net is provided close to the sound receiving end, the second dust-proof net is provided close to the sound output end, and the mesh density of the first dust-proof net is greater than the mesh density of the second dust-proof net.

7. The mobile terminal according to claim 1, wherein The mobile terminal further includes a first decorative piece provided on the back plate side, the light collection area is formed on the first decorative piece, and the sound receiving end penetrates through the first decorative piece.

8. The mobile terminal according to claim 7, characterized in that The camera module includes a protective bracket, the protective bracket includes a lens hole facing the lens, the first decorative piece covers the lens hole, and the sound receiving channel penetrates through the protective bracket to communicate the sound receiving end and the sound output end.

9. The mobile terminal according to claim 1, wherein Further comprising: A rubber sleeve, the rubber sleeve being sleeved on the microphone module, and the rubber sleeve sealing the area where the sound output end communicates with the microphone module.

10. The mobile terminal according to claim 1, wherein The mobile terminal further includes a second decorative piece provided on the back plate side. When the microphone module is in a sound receiving state, the second decorative piece is away from the sound receiving end. When the microphone module stops receiving sound, the second decorative piece blocks the sound receiving end.

11. A video acquisition method, characterized in that, Applied to the mobile terminal according to any one of claims 1-10, the video acquisition method includes: When collecting a video picture through the camera module, starting the microphone module; Receiving a focusing instruction for the camera module; Adjusting the video picture collected by the camera module and the sound information collected by the microphone module according to the focusing instruction so that the sound information matches the video picture.

12. The video acquisition method according to claim 11, wherein The sound information includes volume. Adjusting the video picture collected by the camera module and the sound information collected by the microphone module according to the focusing instruction includes: Amplifying the volume according to the focusing instruction; Reduce the volume according to the focusing instruction.

13. The video acquisition method according to claim 11, wherein, The mobile terminal includes a plurality of microphone modules, and at least one of the plurality of microphone modules picks up sound on the non-backplate side of the mobile terminal; The adjusting, according to the focusing instruction, the video picture collected by the camera module and the sound information collected by the microphone module includes: Suppress the sound information collected by the at least one microphone module.

14. A video acquisition device, characterized in that, Applied to the mobile terminal according to any one of claims 1-10, the video acquisition device includes: A starting module that starts the microphone module when collecting a video picture through the camera module; A receiving module that receives a focusing instruction for the camera module; An adjusting module that adjusts the video picture collected by the camera module and the sound information collected by the microphone module according to the focusing instruction so that the sound information matches the video picture.

15. The video acquisition device according to claim 14, wherein The sound information includes volume, and according to the adjusting module, it includes: An amplifying unit that amplifies the volume according to the focusing instruction; A reducing unit that reduces the volume according to the focusing instruction.

16. The video acquisition device according to claim 14, wherein The mobile terminal includes a plurality of microphone modules, and at least one of the plurality of microphone modules picks up sound on the non-backplate side of the mobile terminal; The adjusting module includes; A noise reduction unit that suppresses the sound information collected by the at least one microphone module.

17. A computer-readable storage medium having computer instructions stored thereon, characterized in that, When the instruction is executed by the processor, it implements the steps of the method according to any one of claims 11-13.

18. An electronic device, characterized in that, Including: A processor; A memory for storing processor-executable instructions; Wherein, the processor is configured to implement the steps of the method according to any one of claims 11-13.

Citation Information

Patent Citations

  • Video-recording processing method, video-recording processing device and mobile terminal

    CN108076300A

  • Acoustic output device

    WO2023145734A1